2023-10-07T08:44:52.787 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-07T08:44:52.787 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --name yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291 -- /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/orig.config.yaml 2023-10-07T08:44:52.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-07T08:44:53.046 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: yweinste@redhat.com first_in_suite: false job_id: '7416291' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-06-0949-quincy sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4726 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-06-0949-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMizICYrSuj0JLA84CqKR01RR1r4+yAWvnpDbWKXz2nI9imHUcwnkQSziagr04+RZakxWCeBl/Np614nWfQFvRw= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIuEOzbetpGZoWEiQY9UMReh/o20TP9sxSQfSnkYu49JiCZpXdgHiW+UVS7yKZfWCLF0lG6+XiPPCZqB8uTFFk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_00:40:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-07T08:44:53.047 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa; will attempt to use it 2023-10-07T08:44:53.048 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks 2023-10-07T08:44:53.048 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-07T08:44:53.050 INFO:teuthology.task.internal:Checking packages... 2023-10-07T08:44:53.080 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-07T08:44:53.080 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-07T08:44:53.080 INFO:teuthology.packaging:ref: None 2023-10-07T08:44:53.080 INFO:teuthology.packaging:tag: None 2023-10-07T08:44:53.080 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-07T08:44:53.080 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:44:53.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-07T08:44:53.310 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-07T08:44:53.310 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-07T08:44:53.317 INFO:teuthology.task.internal:no buildpackages task found 2023-10-07T08:44:53.317 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-07T08:44:53.332 INFO:teuthology.task.internal:Saving configuration 2023-10-07T08:44:53.350 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-07T08:44:53.356 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T08:44:53.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:39:53.287276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMizICYrSuj0JLA84CqKR01RR1r4+yAWvnpDbWKXz2nI9imHUcwnkQSziagr04+RZakxWCeBl/Np614nWfQFvRw='} 2023-10-07T08:44:53.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:39:53.285305', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIuEOzbetpGZoWEiQY9UMReh/o20TP9sxSQfSnkYu49JiCZpXdgHiW+UVS7yKZfWCLF0lG6+XiPPCZqB8uTFFk='} 2023-10-07T08:44:53.403 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-07T08:44:53.409 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-07T08:44:53.409 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-07T08:44:53.409 INFO:teuthology.run_tasks:Running task console_log... 2023-10-07T08:44:53.485 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f77c30feb80>, signals=[15]) 2023-10-07T08:44:53.485 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-07T08:44:53.491 INFO:teuthology.task.internal:Opening connections... 2023-10-07T08:44:53.492 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:44:53.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:44:53.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:44:53.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:44:53.633 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-07T08:44:53.640 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-10-07T08:44:53.658 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-10-07T08:44:53.658 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.4 (Ootpa)" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.4" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-10-07T08:44:53.715 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-07T08:44:53.716 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-07T08:44:53.717 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-10-07T08:44:53.740 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-10-07T08:44:53.756 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-10-07T08:44:53.757 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-07T08:44:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.4 (Ootpa)" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.4" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2023-10-07T08:44:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-07T08:44:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-07T08:44:53.814 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-07T08:44:53.839 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-07T08:44:53.849 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-07T08:44:53.855 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-07T08:44:53.855 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2023-10-07T08:44:53.857 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-10-07T08:44:53.873 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-07T08:44:53.879 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-07T08:44:53.880 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2023-10-07T08:44:53.914 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi046.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-07T08:44:53.930 INFO:teuthology.orchestra.run.smithi133.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-07T08:44:53.931 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-07T08:44:53.986 INFO:teuthology.run_tasks:Running task kernel... 2023-10-07T08:44:54.002 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-07T08:44:54.003 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-07T08:44:54.003 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-07T08:44:54.003 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-07T08:44:54.003 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-07T08:44:54.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:44:54.019 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-10-07T08:44:54.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:44:54.021 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-10-07T08:44:54.076 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:44:54.076 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:44:54.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2023-10-07T08:44:54.077 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:44:54.078 INFO:teuthology.task.kernel:Running kernel on smithi046: 4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:44:54.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2023-10-07T08:44:55.487 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-10-07T08:44:55.487 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-10-07T08:44:55.573 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-07T08:44:55.573 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-10-07T08:44:56.880 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-07T08:44:57.110 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2023-10-07T08:44:57.824 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-07T08:44:58.428 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-07T08:45:01.328 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-07T08:45:01.718 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-07T08:45:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-07T08:45:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-07T08:45:02.138 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-07T08:45:02.296 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-07T08:45:02.297 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2023-10-07T08:45:02.297 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-07T08:45:02.411 DEBUG:teuthology.orchestra.run.smithi046:> echo no | sudo yum reinstall kernel || true 2023-10-07T08:45:02.480 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-07T08:45:02.480 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-07T08:45:02.480 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-07T08:45:02.628 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-10-07T08:45:02.629 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-10-07T08:45:02.629 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-10-07T08:45:02.752 DEBUG:teuthology.orchestra.run.smithi133:> echo no | sudo yum reinstall kernel || true 2023-10-07T08:45:02.817 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-07T08:45:02.817 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-10-07T08:45:03.094 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-10-07T08:45:03.094 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-10-07T08:45:03.123 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:02 ago on Sat 07 Oct 2023 08:45:01 AM UTC. 2023-10-07T08:45:03.263 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:45:03.263 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:03.263 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:03.289 INFO:teuthology.orchestra.run.smithi046.stderr:Error: No packages marked for reinstall. 2023-10-07T08:45:03.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum reinstall -y kernel || true 2023-10-07T08:45:03.384 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:02 ago on Sat 07 Oct 2023 08:45:01 AM UTC. 2023-10-07T08:45:03.514 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:45:03.514 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:03.514 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:03.543 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2023-10-07T08:45:03.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum reinstall -y kernel || true 2023-10-07T08:45:03.710 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-07T08:45:03.710 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-10-07T08:45:03.935 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-10-07T08:45:03.935 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-10-07T08:45:04.008 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Oct 2023 08:45:01 AM UTC. 2023-10-07T08:45:04.174 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:45:04.174 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:04.174 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:04.189 INFO:teuthology.orchestra.run.smithi046.stderr:Error: No packages marked for reinstall. 2023-10-07T08:45:04.219 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Oct 2023 08:45:01 AM UTC. 2023-10-07T08:45:04.241 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:45:04.361 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:45:04.361 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:04.362 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:45:04.371 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.371 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.371 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.372 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-07T08:45:04.372 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-07T08:45:04.372 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-07T08:45:04.372 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2023-10-07T08:45:04.372 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:45:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2023-10-07T08:45:04.427 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:45:04.502 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.503 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2023-10-07T08:45:04.531 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2023-10-07T08:45:04.531 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2023-10-07T08:45:04.531 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.02 2023-10-07T08:45:04.531 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 99.el8_4.1 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Group : System Environment/Base 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 9264631 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-07T08:45:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:Relocations : (not relocatable) 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : Red Hat, Inc. 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : Red Hat, Inc. 2023-10-07T08:45:04.533 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-07T08:45:04.534 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2023-10-07T08:45:04.534 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2023-10-07T08:45:04.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:45:04.535 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-07T08:45:04.535 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-07T08:45:04.535 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-07T08:45:04.535 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2023-10-07T08:45:04.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:45:04.536 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2023-10-07T08:45:04.537 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-07T08:45:04.537 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-07T08:45:04.552 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.553 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.553 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.553 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-07T08:45:04.554 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-07T08:45:04.554 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-07T08:45:04.554 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2023-10-07T08:45:04.554 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:45:04.678 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2023-10-07T08:45:04.705 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.02 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 99.el8_4.1 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Group : System Environment/Base 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 9264631 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2023-10-07T08:45:04.706 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Relocations : (not relocatable) 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : Red Hat, Inc. 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : Red Hat, Inc. 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-07T08:45:04.707 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-07T08:45:04.708 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2023-10-07T08:45:04.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:45:04.708 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2023-10-07T08:45:04.708 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-07T08:45:04.709 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:04.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-07T08:45:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2023-10-07T08:45:06.052 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-10-07T08:45:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:done 2023-10-07T08:45:07.646 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-10-07T08:45:07.701 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.01qj03Ms2u 2023-10-07T08:45:07.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.01qj03Ms2u 2023-10-07T08:45:07.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.01qj03Ms2u 2023-10-07T08:45:07.928 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.01qj03Ms2u is 6KB 2023-10-07T08:45:07.976 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.01qj03Ms2u 2023-10-07T08:45:07.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2023-10-07T08:45:08.067 INFO:teuthology.orchestra.run.smithi046.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-07T08:45:08.067 INFO:teuthology.orchestra.run.smithi046.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-07T08:45:08.067 INFO:teuthology.orchestra.run.smithi046.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-07T08:45:08.067 INFO:teuthology.orchestra.run.smithi046.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-07T08:45:08.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-10-07T08:45:08.076 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-10-07T08:45:08.099 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.l9qZdPLDdJ 2023-10-07T08:45:08.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.l9qZdPLDdJ 2023-10-07T08:45:08.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.l9qZdPLDdJ 2023-10-07T08:45:08.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2023-10-07T08:45:08.334 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.l9qZdPLDdJ is 6KB 2023-10-07T08:45:08.382 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.l9qZdPLDdJ 2023-10-07T08:45:08.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2023-10-07T08:45:08.461 INFO:teuthology.orchestra.run.smithi133.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-07T08:45:08.461 INFO:teuthology.orchestra.run.smithi133.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-07T08:45:08.461 INFO:teuthology.orchestra.run.smithi133.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-07T08:45:08.462 INFO:teuthology.orchestra.run.smithi133.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-07T08:45:08.463 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:45:08.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2023-10-07T08:45:38.246 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-07T08:45:38.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:45:38.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:45:38.663 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-07T08:45:38.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:45:38.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:45:56.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-07T08:45:56.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-07T08:46:05.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:46:05.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:46:05.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:46:05.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:46:08.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-07T08:46:09.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-07T08:46:20.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:46:20.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:46:21.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:46:21.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:46:39.227 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-07T08:46:53.204 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:46:54.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:46:54.522 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-10-07T08:46:54.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:46:54.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-07T08:46:54.623 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-10-07T08:46:54.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:46:54.885 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-07T08:46:54.885 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-10-07T08:46:54.900 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-07T08:46:54.900 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:46:54.900 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-07T08:46:54.900 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-07T08:46:54.953 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-07T08:46:54.953 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:46:54.953 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-07T08:46:54.953 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-07T08:46:55.901 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:55.954 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:55.954 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-07T08:46:55.965 INFO:teuthology.task.internal:Creating test directory... 2023-10-07T08:46:55.965 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-07T08:46:55.968 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-07T08:46:55.985 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-07T08:46:55.992 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-07T08:46:56.073 INFO:teuthology.task.internal:Creating archive directory... 2023-10-07T08:46:56.073 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-07T08:46:56.076 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-07T08:46:56.185 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-07T08:46:56.192 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-07T08:46:56.192 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-07T08:46:56.195 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-07T08:46:56.287 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:46:56.307 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:46:56.344 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:46:56.360 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:46:56.361 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-07T08:46:56.368 INFO:teuthology.task.internal:Configuring sudo... 2023-10-07T08:46:56.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-07T08:46:56.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-07T08:46:56.395 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-07T08:46:56.439 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-07T08:46:56.440 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-07T08:46:56.442 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-07T08:46:56.455 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:46:56.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:46:56.587 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:46:56.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:46:56.712 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:46:56.712 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-07T08:46:56.787 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:46:56.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:46:56.883 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:46:56.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:46:57.004 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:46:57.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-07T08:46:57.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2023-10-07T08:46:57.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-10-07T08:46:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:46:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:46:57.640 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-07T08:46:57.648 INFO:teuthology.task.internal:Starting timer... 2023-10-07T08:46:57.648 INFO:teuthology.run_tasks:Running task pcp... 2023-10-07T08:46:57.667 INFO:teuthology.run_tasks:Running task selinux... 2023-10-07T08:46:57.700 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-07T08:46:57.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2023-10-07T08:46:57.786 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: [ OK ] 2023-10-07T08:46:57.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2023-10-07T08:46:57.841 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: [ OK ] 2023-10-07T08:46:57.842 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-07T08:46:57.843 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2023-10-07T08:46:57.862 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2023-10-07T08:46:57.863 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2023-10-07T08:46:57.884 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2023-10-07T08:46:57.884 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2023-10-07T08:46:57.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:46:57.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:46:57.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:46:57.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:46:57.957 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-07T08:46:57.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2023-10-07T08:46:58.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2023-10-07T08:46:58.028 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-07T08:46:58.037 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-07T08:46:58.042 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-07T08:46:58.163 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-07T08:46:58.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-07T08:46:58.184 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-07T08:55:25.803 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2023-10-07T08:55:25.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:55:25.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:55:25.879 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-10-07T08:55:25.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-07T08:55:25.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:55:25.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:55:26.019 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-07T08:55:26.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-07T08:55:26.087 INFO:teuthology.run_tasks:Running task clock... 2023-10-07T08:55:26.098 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-07T08:55:26.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-07T08:55:26.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:55:26.102 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-07T08:55:26.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:55:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-07T08:55:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-07T08:55:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-07T08:55:26.173 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-07T08:55:26.186 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2023-10-07T08:55:26.196 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2023-10-07T08:55:26.210 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2023-10-07T08:55:26.211 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-07T08:55:26.222 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2023-10-07T08:55:26.225 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-07T08:55:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-07T08:55:26.249 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-07T08:55:26.295 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:210 Number of sources = 4 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.298 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.316 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-10-07T08:55:26.318 INFO:teuthology.orchestra.run.smithi133.stdout:210 Number of sources = 4 2023-10-07T08:55:26.318 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:55:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-10-07T08:55:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:26.320 INFO:teuthology.run_tasks:Running task install... 2023-10-07T08:55:26.329 DEBUG:teuthology.task.install:project ceph 2023-10-07T08:55:26.329 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-07T08:55:26.330 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-07T08:55:26.330 INFO:teuthology.task.install:Using flavor: default 2023-10-07T08:55:26.335 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-07T08:55:26.336 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-07T08:55:26.336 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-07T08:55:26.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:55:26.338 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-07T08:55:26.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:55:26.491 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-07T08:55:26.492 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-07T08:55:26.496 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-07T08:55:26.497 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-07T08:55:26.605 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-07T08:55:26.606 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:55:26.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-07T08:55:26.633 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-07T08:55:26.634 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-07T08:55:26.669 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-07T08:55:26.670 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:55:26.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-07T08:55:26.695 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-07T08:55:26.695 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-07T08:55:26.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-07T08:55:26.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-07T08:55:26.776 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-07T08:55:26.835 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-07T08:55:26.841 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2023-10-07T08:55:26.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2023-10-07T08:55:26.898 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2023-10-07T08:55:26.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2023-10-07T08:55:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-07T08:55:27.293 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-10-07T08:55:27.575 INFO:teuthology.orchestra.run.smithi046.stdout:44 files removed 2023-10-07T08:55:27.589 INFO:teuthology.orchestra.run.smithi133.stdout:44 files removed 2023-10-07T08:55:27.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-07T08:55:27.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-07T08:55:27.987 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-10-07T08:55:28.002 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-07T08:55:28.751 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 355 kB/s | 78 kB 00:00 2023-10-07T08:55:28.804 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 212 kB/s | 78 kB 00:00 2023-10-07T08:55:29.040 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-07T08:55:29.088 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-07T08:55:29.318 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-07T08:55:29.416 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-07T08:55:29.431 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-07T08:55:29.534 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-07T08:55:30.519 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-07T08:55:31.476 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 16 MB 00:02 2023-10-07T08:55:33.783 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-07T08:55:34.134 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 122 MB/s | 33 MB 00:00 2023-10-07T08:55:35.108 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-07T08:55:35.537 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 112 MB/s | 38 MB 00:00 2023-10-07T08:55:39.286 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 116 MB/s | 38 MB 00:00 2023-10-07T08:55:41.600 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 MB/s | 33 MB 00:00 2023-10-07T08:55:47.732 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:55:47.733 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:55:47.744 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-07T08:55:47.745 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-07T08:55:47.745 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-07T08:55:47.746 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-07T08:55:47.748 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-07T08:55:47.750 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-07T08:55:47.751 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-07T08:55:48.236 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-10-07T08:55:48.247 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================================== 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================================== 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-07T08:55:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-07T08:55:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:55:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-07T08:55:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-07T08:55:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-07T08:55:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-07T08:55:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-07T08:55:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-07T08:55:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-07T08:55:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================================== 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout:Install 118 Packages 2023-10-07T08:55:48.258 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2023-10-07T08:55:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:55:48.259 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 202 M 2023-10-07T08:55:48.259 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-10-07T08:55:48.713 INFO:teuthology.orchestra.run.smithi133.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 70 kB/s | 6.4 kB 00:00 2023-10-07T08:55:48.860 INFO:teuthology.orchestra.run.smithi133.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 5.8 MB/s | 876 kB 00:00 2023-10-07T08:55:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 7.2 MB/s | 162 kB 00:00 2023-10-07T08:55:49.031 INFO:teuthology.orchestra.run.smithi133.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 15 MB/s | 2.3 MB 00:00 2023-10-07T08:55:49.142 INFO:teuthology.orchestra.run.smithi133.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 14 MB/s | 1.6 MB 00:00 2023-10-07T08:55:49.424 INFO:teuthology.orchestra.run.smithi133.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 14 MB/s | 3.9 MB 00:00 2023-10-07T08:55:49.564 INFO:teuthology.orchestra.run.smithi133.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 5.5 MB/s | 5.2 MB 00:00 2023-10-07T08:55:50.315 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:55:50.316 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:55:50.327 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-07T08:55:50.328 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-07T08:55:50.329 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-07T08:55:50.330 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-07T08:55:50.332 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-07T08:55:50.334 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-07T08:55:50.335 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-07T08:55:50.801 INFO:teuthology.orchestra.run.smithi133.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 17 MB 00:01 2023-10-07T08:55:50.857 INFO:teuthology.orchestra.run.smithi133.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 441 kB/s | 24 kB 00:00 2023-10-07T08:55:50.870 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-07T08:55:50.882 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================================================== 2023-10-07T08:55:50.882 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-10-07T08:55:50.882 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================================================== 2023-10-07T08:55:50.883 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-10-07T08:55:50.883 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-07T08:55:50.883 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-07T08:55:50.883 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-07T08:55:50.883 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-07T08:55:50.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-07T08:55:50.886 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-07T08:55:50.887 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-07T08:55:50.888 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-07T08:55:50.889 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-07T08:55:50.890 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-07T08:55:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-07T08:55:50.892 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-07T08:55:50.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-07T08:55:50.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-07T08:55:50.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-07T08:55:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-10-07T08:55:50.897 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================================================== 2023-10-07T08:55:50.898 INFO:teuthology.orchestra.run.smithi046.stdout:Install 118 Packages 2023-10-07T08:55:50.898 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2023-10-07T08:55:50.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:55:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 202 M 2023-10-07T08:55:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-10-07T08:55:51.289 INFO:teuthology.orchestra.run.smithi046.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-10-07T08:55:51.445 INFO:teuthology.orchestra.run.smithi133.stdout:(10/120): ceph-common-17.2.6-1320.g08cac018.el8 8.3 MB/s | 23 MB 00:02 2023-10-07T08:55:51.523 INFO:teuthology.orchestra.run.smithi133.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.2 MB/s | 255 kB 00:00 2023-10-07T08:55:51.585 INFO:teuthology.orchestra.run.smithi133.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 401 kB/s | 25 kB 00:00 2023-10-07T08:55:51.676 INFO:teuthology.orchestra.run.smithi133.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 8.6 MB/s | 797 kB 00:00 2023-10-07T08:55:51.745 INFO:teuthology.orchestra.run.smithi133.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.5 MB/s | 174 kB 00:00 2023-10-07T08:55:51.814 INFO:teuthology.orchestra.run.smithi133.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 1.9 MB/s | 130 kB 00:00 2023-10-07T08:55:51.899 INFO:teuthology.orchestra.run.smithi133.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 5.8 MB/s | 507 kB 00:00 2023-10-07T08:55:51.924 INFO:teuthology.orchestra.run.smithi046.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.3 MB/s | 876 kB 00:00 2023-10-07T08:55:52.221 INFO:teuthology.orchestra.run.smithi133.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 6.3 MB/s | 17 MB 00:02 2023-10-07T08:55:52.296 INFO:teuthology.orchestra.run.smithi133.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 601 kB/s | 45 kB 00:00 2023-10-07T08:55:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 383 kB/s | 162 kB 00:00 2023-10-07T08:55:52.359 INFO:teuthology.orchestra.run.smithi133.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 1.8 MB/s | 115 kB 00:00 2023-10-07T08:55:52.405 INFO:teuthology.orchestra.run.smithi133.stdout:(20/120): librgw2-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 5.6 MB 00:00 2023-10-07T08:55:52.413 INFO:teuthology.orchestra.run.smithi133.stdout:(21/120): python3-cephfs-17.2.6-1320.g08cac018. 3.5 MB/s | 190 kB 00:00 2023-10-07T08:55:52.459 INFO:teuthology.orchestra.run.smithi133.stdout:(22/120): python3-rados-17.2.6-1320.g08cac018.e 6.7 MB/s | 371 kB 00:00 2023-10-07T08:55:52.474 INFO:teuthology.orchestra.run.smithi133.stdout:(23/120): python3-rbd-17.2.6-1320.g08cac018.el8 5.7 MB/s | 358 kB 00:00 2023-10-07T08:55:52.508 INFO:teuthology.orchestra.run.smithi133.stdout:(24/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.2 MB/s | 107 kB 00:00 2023-10-07T08:55:52.521 INFO:teuthology.orchestra.run.smithi133.stdout:(25/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 90 kB 00:00 2023-10-07T08:55:52.599 INFO:teuthology.orchestra.run.smithi133.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.2 MB/s | 173 kB 00:00 2023-10-07T08:55:52.680 INFO:teuthology.orchestra.run.smithi133.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 284 kB/s | 23 kB 00:00 2023-10-07T08:55:52.752 INFO:teuthology.orchestra.run.smithi133.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.7 MB/s | 121 kB 00:00 2023-10-07T08:55:52.802 INFO:teuthology.orchestra.run.smithi133.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-07T08:55:53.152 INFO:teuthology.orchestra.run.smithi133.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 4.2 MB/s | 1.7 MB 00:00 2023-10-07T08:55:53.231 INFO:teuthology.orchestra.run.smithi133.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 2.9 MB/s | 238 kB 00:00 2023-10-07T08:55:53.304 INFO:teuthology.orchestra.run.smithi133.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 654 kB/s | 47 kB 00:00 2023-10-07T08:55:53.376 INFO:teuthology.orchestra.run.smithi133.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 201 kB/s | 14 kB 00:00 2023-10-07T08:55:53.444 INFO:teuthology.orchestra.run.smithi133.stdout:(34/120): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-10-07T08:55:53.454 INFO:teuthology.orchestra.run.smithi133.stdout:(35/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.3 MB/s | 267 kB 00:00 2023-10-07T08:55:53.494 INFO:teuthology.orchestra.run.smithi133.stdout:(36/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.6 MB/s | 80 kB 00:00 2023-10-07T08:55:53.504 INFO:teuthology.orchestra.run.smithi133.stdout:(37/120): cephfs-top-17.2.6-1320.g08cac018.el8. 364 kB/s | 18 kB 00:00 2023-10-07T08:55:53.637 INFO:teuthology.orchestra.run.smithi133.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 442 kB/s | 59 kB 00:00 2023-10-07T08:55:53.691 INFO:teuthology.orchestra.run.smithi046.stdout:(4/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 2.0 MB/s | 5.2 MB 00:02 2023-10-07T08:55:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-10-07T08:55:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-07T08:55:53.708 INFO:teuthology.orchestra.run.smithi046.stdout:(5/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-10-07T08:55:53.738 INFO:teuthology.orchestra.run.smithi133.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-10-07T08:55:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.1 MB/s | 185 kB 00:00 2023-10-07T08:55:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.4 MB/s | 476 kB 00:00 2023-10-07T08:55:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-10-07T08:55:53.837 INFO:teuthology.orchestra.run.smithi133.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 526 kB/s | 16 kB 00:00 2023-10-07T08:55:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.0 MB/s | 173 kB 00:00 2023-10-07T08:55:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.3 MB/s | 384 kB 00:00 2023-10-07T08:55:53.893 INFO:teuthology.orchestra.run.smithi133.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 2.2 MB/s | 81 kB 00:00 2023-10-07T08:55:53.913 INFO:teuthology.orchestra.run.smithi133.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 362 kB/s | 11 kB 00:00 2023-10-07T08:55:53.924 INFO:teuthology.orchestra.run.smithi133.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 564 kB/s | 18 kB 00:00 2023-10-07T08:55:53.958 INFO:teuthology.orchestra.run.smithi133.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-07T08:55:53.992 INFO:teuthology.orchestra.run.smithi133.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-10-07T08:55:53.998 INFO:teuthology.orchestra.run.smithi133.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-10-07T08:55:54.034 INFO:teuthology.orchestra.run.smithi133.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-07T08:55:54.044 INFO:teuthology.orchestra.run.smithi133.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.0 MB/s | 283 kB 00:00 2023-10-07T08:55:54.079 INFO:teuthology.orchestra.run.smithi133.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 350 kB/s | 16 kB 00:00 2023-10-07T08:55:54.090 INFO:teuthology.orchestra.run.smithi133.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 743 kB/s | 34 kB 00:00 2023-10-07T08:55:54.135 INFO:teuthology.orchestra.run.smithi133.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 1.4 MB/s | 64 kB 00:00 2023-10-07T08:55:54.139 INFO:teuthology.orchestra.run.smithi133.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 3.2 MB/s | 196 kB 00:00 2023-10-07T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.3 MB/s | 1.6 MB 00:00 2023-10-07T08:55:54.177 INFO:teuthology.orchestra.run.smithi133.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 437 kB/s | 19 kB 00:00 2023-10-07T08:55:54.183 INFO:teuthology.orchestra.run.smithi133.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 546 kB/s | 24 kB 00:00 2023-10-07T08:55:54.208 INFO:teuthology.orchestra.run.smithi133.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 952 kB/s | 29 kB 00:00 2023-10-07T08:55:54.215 INFO:teuthology.orchestra.run.smithi133.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 855 kB/s | 27 kB 00:00 2023-10-07T08:55:54.243 INFO:teuthology.orchestra.run.smithi133.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 7.2 MB/s | 255 kB 00:00 2023-10-07T08:55:54.263 INFO:teuthology.orchestra.run.smithi133.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.1 MB/s | 251 kB 00:00 2023-10-07T08:55:54.275 INFO:teuthology.orchestra.run.smithi133.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-07T08:55:54.299 INFO:teuthology.orchestra.run.smithi133.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2023-10-07T08:55:54.306 INFO:teuthology.orchestra.run.smithi133.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 745 kB/s | 23 kB 00:00 2023-10-07T08:55:54.310 INFO:teuthology.orchestra.run.smithi133.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-07T08:55:54.586 INFO:teuthology.orchestra.run.smithi133.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 53 MB/s | 15 MB 00:00 2023-10-07T08:55:54.591 INFO:teuthology.orchestra.run.smithi133.stdout:(71/120): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-10-07T08:55:54.623 INFO:teuthology.orchestra.run.smithi133.stdout:(72/120): python3-prettytable-0.7.2-14.el8.noar 1.2 MB/s | 44 kB 00:00 2023-10-07T08:55:54.645 INFO:teuthology.orchestra.run.smithi133.stdout:(73/120): python3-jsonpatch-1.21-2.el8.noarch.r 501 kB/s | 27 kB 00:00 2023-10-07T08:55:54.661 INFO:teuthology.orchestra.run.smithi133.stdout:(74/120): jq-1.5-12.el8.x86_64.rpm 4.2 MB/s | 161 kB 00:00 2023-10-07T08:55:54.679 INFO:teuthology.orchestra.run.smithi133.stdout:(75/120): flex-2.6.1-9.el8.x86_64.rpm 9.1 MB/s | 320 kB 00:00 2023-10-07T08:55:54.702 INFO:teuthology.orchestra.run.smithi133.stdout:(76/120): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-07T08:55:54.735 INFO:teuthology.orchestra.run.smithi133.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 1.2 MB/s | 39 kB 00:00 2023-10-07T08:55:54.885 INFO:teuthology.orchestra.run.smithi046.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 3.3 MB/s | 3.9 MB 00:01 2023-10-07T08:55:55.139 INFO:teuthology.orchestra.run.smithi133.stdout:(78/120): ceph-test-17.2.6-1320.g08cac018.el8.x 12 MB/s | 52 MB 00:04 2023-10-07T08:55:55.151 INFO:teuthology.orchestra.run.smithi133.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 1.6 MB/s | 688 kB 00:00 2023-10-07T08:55:55.179 INFO:teuthology.orchestra.run.smithi133.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 9.6 MB/s | 4.8 MB 00:00 2023-10-07T08:55:55.202 INFO:teuthology.orchestra.run.smithi133.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 4.4 MB/s | 225 kB 00:00 2023-10-07T08:55:55.219 INFO:teuthology.orchestra.run.smithi133.stdout:(82/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.2 MB/s | 259 kB 00:00 2023-10-07T08:55:55.242 INFO:teuthology.orchestra.run.smithi133.stdout:(83/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.0 MB/s | 126 kB 00:00 2023-10-07T08:55:55.269 INFO:teuthology.orchestra.run.smithi133.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-07T08:55:55.283 INFO:teuthology.orchestra.run.smithi133.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 46 MB/s | 3.7 MB 00:00 2023-10-07T08:55:55.289 INFO:teuthology.orchestra.run.smithi133.stdout:(86/120): python3-jinja2-2.10.1-2.el8_0.noarch. 11 MB/s | 538 kB 00:00 2023-10-07T08:55:55.321 INFO:teuthology.orchestra.run.smithi133.stdout:(87/120): socat-1.7.3.3-2.el8.x86_64.rpm 5.7 MB/s | 302 kB 00:00 2023-10-07T08:55:55.328 INFO:teuthology.orchestra.run.smithi133.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 2.8 MB/s | 110 kB 00:00 2023-10-07T08:55:55.333 INFO:teuthology.orchestra.run.smithi133.stdout:(89/120): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-10-07T08:55:55.362 INFO:teuthology.orchestra.run.smithi133.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 586 kB/s | 20 kB 00:00 2023-10-07T08:55:55.365 INFO:teuthology.orchestra.run.smithi133.stdout:(91/120): librdkafka-0.11.4-1.el8.x86_64.rpm 8.0 MB/s | 353 kB 00:00 2023-10-07T08:55:55.383 INFO:teuthology.orchestra.run.smithi133.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-10-07T08:55:55.408 INFO:teuthology.orchestra.run.smithi133.stdout:(93/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-10-07T08:55:55.460 INFO:teuthology.orchestra.run.smithi133.stdout:(94/120): openblas-threads-0.3.12-1.el8.x86_64. 50 MB/s | 4.7 MB 00:00 2023-10-07T08:55:55.462 INFO:teuthology.orchestra.run.smithi133.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 13 MB/s | 713 kB 00:00 2023-10-07T08:55:55.493 INFO:teuthology.orchestra.run.smithi133.stdout:(96/120): openblas-0.3.12-1.el8.x86_64.rpm 42 MB/s | 4.6 MB 00:00 2023-10-07T08:55:55.494 INFO:teuthology.orchestra.run.smithi133.stdout:(97/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 546 kB/s | 19 kB 00:00 2023-10-07T08:55:55.499 INFO:teuthology.orchestra.run.smithi133.stdout:(98/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-07T08:55:55.533 INFO:teuthology.orchestra.run.smithi133.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 3.9 MB/s | 155 kB 00:00 2023-10-07T08:55:55.546 INFO:teuthology.orchestra.run.smithi133.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.2 MB/s | 220 kB 00:00 2023-10-07T08:55:55.547 INFO:teuthology.orchestra.run.smithi133.stdout:(101/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.0 MB/s | 48 kB 00:00 2023-10-07T08:55:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-10-07T08:55:55.606 INFO:teuthology.orchestra.run.smithi133.stdout:(103/120): openssl-devel-1.1.1g-15.el8_3.x86_64 39 MB/s | 2.3 MB 00:00 2023-10-07T08:55:55.612 INFO:teuthology.orchestra.run.smithi133.stdout:(104/120): python3-requests-oauthlib-1.0.0-1.el 648 kB/s | 43 kB 00:00 2023-10-07T08:55:55.654 INFO:teuthology.orchestra.run.smithi133.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-10-07T08:55:55.666 INFO:teuthology.orchestra.run.smithi133.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 1.5 MB/s | 83 kB 00:00 2023-10-07T08:55:55.690 INFO:teuthology.orchestra.run.smithi133.stdout:(107/120): libverto-devel-0.3.0-5.el8.x86_64.rp 154 kB/s | 18 kB 00:00 2023-10-07T08:55:55.719 INFO:teuthology.orchestra.run.smithi133.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 901 kB/s | 59 kB 00:00 2023-10-07T08:55:55.731 INFO:teuthology.orchestra.run.smithi133.stdout:(109/120): libquadmath-8.4.1-1.el8.x86_64.rpm 2.6 MB/s | 169 kB 00:00 2023-10-07T08:55:55.744 INFO:teuthology.orchestra.run.smithi133.stdout:(110/120): libcom_err-devel-1.45.6-1.el8.x86_64 706 kB/s | 38 kB 00:00 2023-10-07T08:55:55.784 INFO:teuthology.orchestra.run.smithi133.stdout:(111/120): libsepol-devel-2.9-2.el8.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2023-10-07T08:55:55.796 INFO:teuthology.orchestra.run.smithi133.stdout:(112/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 896 kB/s | 58 kB 00:00 2023-10-07T08:55:55.805 INFO:teuthology.orchestra.run.smithi133.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 774 kB/s | 47 kB 00:00 2023-10-07T08:55:55.841 INFO:teuthology.orchestra.run.smithi133.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 1.9 MB/s | 70 kB 00:00 2023-10-07T08:55:55.869 INFO:teuthology.orchestra.run.smithi133.stdout:(115/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 6.5 MB/s | 559 kB 00:00 2023-10-07T08:55:55.890 INFO:teuthology.orchestra.run.smithi133.stdout:(116/120): libgfortran-8.4.1-1.el8.x86_64.rpm 6.7 MB/s | 639 kB 00:00 2023-10-07T08:55:55.906 INFO:teuthology.orchestra.run.smithi133.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 3.0 MB/s | 200 kB 00:00 2023-10-07T08:55:55.920 INFO:teuthology.orchestra.run.smithi133.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 1.9 MB/s | 97 kB 00:00 2023-10-07T08:55:56.807 INFO:teuthology.orchestra.run.smithi133.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 3.8 MB/s | 3.5 MB 00:00 2023-10-07T08:55:57.178 INFO:teuthology.orchestra.run.smithi133.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 2.8 MB/s | 3.6 MB 00:01 2023-10-07T08:55:57.182 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-10-07T08:55:57.182 INFO:teuthology.orchestra.run.smithi133.stdout:Total 23 MB/s | 202 MB 00:08 2023-10-07T08:55:57.231 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-10-07T08:55:57.344 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-10-07T08:55:57.345 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-10-07T08:55:59.023 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-10-07T08:55:59.027 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-10-07T08:56:02.411 INFO:teuthology.orchestra.run.smithi046.stdout:(8/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 2.2 MB/s | 17 MB 00:07 2023-10-07T08:56:02.468 INFO:teuthology.orchestra.run.smithi046.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 426 kB/s | 24 kB 00:00 2023-10-07T08:56:02.809 INFO:teuthology.orchestra.run.smithi046.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 17 MB 00:08 2023-10-07T08:56:02.959 INFO:teuthology.orchestra.run.smithi046.stdout:(11/120): ceph-common-17.2.6-1320.g08cac018.el8 2.0 MB/s | 23 MB 00:11 2023-10-07T08:56:02.990 INFO:teuthology.orchestra.run.smithi046.stdout:(12/120): cephfs-mirror-17.2.6-1320.g08cac018.e 1.4 MB/s | 255 kB 00:00 2023-10-07T08:56:03.032 INFO:teuthology.orchestra.run.smithi046.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 343 kB/s | 25 kB 00:00 2023-10-07T08:56:03.185 INFO:teuthology.orchestra.run.smithi046.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 1.1 MB/s | 174 kB 00:00 2023-10-07T08:56:03.334 INFO:teuthology.orchestra.run.smithi046.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 872 kB/s | 130 kB 00:00 2023-10-07T08:56:03.371 INFO:teuthology.orchestra.run.smithi046.stdout:(16/120): libcephfs2-17.2.6-1320.g08cac018.el8. 2.0 MB/s | 797 kB 00:00 2023-10-07T08:56:03.514 INFO:teuthology.orchestra.run.smithi046.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 2.7 MB/s | 507 kB 00:00 2023-10-07T08:56:03.552 INFO:teuthology.orchestra.run.smithi046.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.2 MB/s | 45 kB 00:00 2023-10-07T08:56:03.590 INFO:teuthology.orchestra.run.smithi046.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 3.0 MB/s | 115 kB 00:00 2023-10-07T08:56:03.665 INFO:teuthology.orchestra.run.smithi046.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 2.5 MB/s | 190 kB 00:00 2023-10-07T08:56:03.701 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-10-07T08:56:03.778 INFO:teuthology.orchestra.run.smithi046.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 3.2 MB/s | 371 kB 00:00 2023-10-07T08:56:03.897 INFO:teuthology.orchestra.run.smithi046.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 3.0 MB/s | 358 kB 00:00 2023-10-07T08:56:03.932 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-07T08:56:03.935 INFO:teuthology.orchestra.run.smithi046.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.8 MB/s | 107 kB 00:00 2023-10-07T08:56:03.972 INFO:teuthology.orchestra.run.smithi046.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-07T08:56:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-07T08:56:04.387 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-07T08:56:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-07T08:56:04.720 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-07T08:56:04.797 INFO:teuthology.orchestra.run.smithi046.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 3.9 MB/s | 5.6 MB 00:01 2023-10-07T08:56:04.881 INFO:teuthology.orchestra.run.smithi046.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.0 MB/s | 173 kB 00:00 2023-10-07T08:56:04.956 INFO:teuthology.orchestra.run.smithi046.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 308 kB/s | 23 kB 00:00 2023-10-07T08:56:05.020 INFO:teuthology.orchestra.run.smithi046.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.8 MB/s | 121 kB 00:00 2023-10-07T08:56:05.049 INFO:teuthology.orchestra.run.smithi046.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 3.2 MB/s | 3.5 MB 00:01 2023-10-07T08:56:05.112 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-07T08:56:05.354 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:56:05.653 INFO:teuthology.orchestra.run.smithi046.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 2.7 MB/s | 1.7 MB 00:00 2023-10-07T08:56:05.746 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:56:05.780 INFO:teuthology.orchestra.run.smithi046.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.8 MB/s | 238 kB 00:00 2023-10-07T08:56:05.844 INFO:teuthology.orchestra.run.smithi046.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 748 kB/s | 47 kB 00:00 2023-10-07T08:56:05.910 INFO:teuthology.orchestra.run.smithi046.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 222 kB/s | 14 kB 00:00 2023-10-07T08:56:05.937 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:56:06.044 INFO:teuthology.orchestra.run.smithi046.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 1.9 MB/s | 267 kB 00:00 2023-10-07T08:56:06.104 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:56:06.119 INFO:teuthology.orchestra.run.smithi046.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-07T08:56:06.187 INFO:teuthology.orchestra.run.smithi046.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 266 kB/s | 18 kB 00:00 2023-10-07T08:56:06.312 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:56:06.408 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:56:06.630 INFO:teuthology.orchestra.run.smithi046.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 693 kB/s | 306 kB 00:00 2023-10-07T08:56:06.710 INFO:teuthology.orchestra.run.smithi046.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 734 kB/s | 59 kB 00:00 2023-10-07T08:56:06.789 INFO:teuthology.orchestra.run.smithi046.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 956 kB/s | 75 kB 00:00 2023-10-07T08:56:06.799 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-07T08:56:06.909 INFO:teuthology.orchestra.run.smithi046.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.9 MB/s | 476 kB 00:00 2023-10-07T08:56:06.952 INFO:teuthology.orchestra.run.smithi046.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 996 kB/s | 44 kB 00:00 2023-10-07T08:56:06.993 INFO:teuthology.orchestra.run.smithi046.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.5 MB/s | 185 kB 00:00 2023-10-07T08:56:07.027 INFO:teuthology.orchestra.run.smithi046.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 994 kB/s | 33 kB 00:00 2023-10-07T08:56:07.061 INFO:teuthology.orchestra.run.smithi046.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 482 kB/s | 16 kB 00:00 2023-10-07T08:56:07.102 INFO:teuthology.orchestra.run.smithi046.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.2 MB/s | 173 kB 00:00 2023-10-07T08:56:07.157 INFO:teuthology.orchestra.run.smithi046.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 6.8 MB/s | 384 kB 00:00 2023-10-07T08:56:07.201 INFO:teuthology.orchestra.run.smithi046.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.8 MB/s | 81 kB 00:00 2023-10-07T08:56:07.236 INFO:teuthology.orchestra.run.smithi046.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 316 kB/s | 11 kB 00:00 2023-10-07T08:56:07.282 INFO:teuthology.orchestra.run.smithi046.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 383 kB/s | 18 kB 00:00 2023-10-07T08:56:07.418 INFO:teuthology.orchestra.run.smithi046.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 8.6 MB/s | 1.2 MB 00:00 2023-10-07T08:56:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-07T08:56:07.496 INFO:teuthology.orchestra.run.smithi046.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 630 kB/s | 49 kB 00:00 2023-10-07T08:56:07.547 INFO:teuthology.orchestra.run.smithi046.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-07T08:56:07.628 INFO:teuthology.orchestra.run.smithi046.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 746 kB/s | 60 kB 00:00 2023-10-07T08:56:07.666 INFO:teuthology.orchestra.run.smithi046.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 7.4 MB/s | 283 kB 00:00 2023-10-07T08:56:07.687 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:56:07.697 INFO:teuthology.orchestra.run.smithi046.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 509 kB/s | 16 kB 00:00 2023-10-07T08:56:07.729 INFO:teuthology.orchestra.run.smithi046.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-10-07T08:56:07.766 INFO:teuthology.orchestra.run.smithi046.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 5.2 MB/s | 196 kB 00:00 2023-10-07T08:56:07.798 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:56:07.799 INFO:teuthology.orchestra.run.smithi046.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-10-07T08:56:07.824 INFO:teuthology.orchestra.run.smithi046.stdout:(59/120): ceph-mgr-diskprediction-local-17.2.6- 2.7 MB/s | 7.4 MB 00:02 2023-10-07T08:56:07.831 INFO:teuthology.orchestra.run.smithi046.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 590 kB/s | 19 kB 00:00 2023-10-07T08:56:07.864 INFO:teuthology.orchestra.run.smithi046.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 910 kB/s | 29 kB 00:00 2023-10-07T08:56:07.896 INFO:teuthology.orchestra.run.smithi046.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 874 kB/s | 27 kB 00:00 2023-10-07T08:56:08.066 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-07T08:56:08.243 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-07T08:56:08.316 INFO:teuthology.orchestra.run.smithi046.stdout:(63/120): ceph-test-17.2.6-1320.g08cac018.el8.x 8.8 MB/s | 52 MB 00:05 2023-10-07T08:56:08.316 INFO:teuthology.orchestra.run.smithi046.stdout:(64/120): python3-singledispatch-3.4.0.3-18.el8 49 kB/s | 24 kB 00:00 2023-10-07T08:56:08.318 INFO:teuthology.orchestra.run.smithi046.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 604 kB/s | 255 kB 00:00 2023-10-07T08:56:08.350 INFO:teuthology.orchestra.run.smithi046.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 2.6 MB/s | 85 kB 00:00 2023-10-07T08:56:08.383 INFO:teuthology.orchestra.run.smithi046.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 717 kB/s | 23 kB 00:00 2023-10-07T08:56:08.453 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:56:08.464 INFO:teuthology.orchestra.run.smithi046.stdout:(68/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-07T08:56:08.468 INFO:teuthology.orchestra.run.smithi046.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-07T08:56:08.469 INFO:teuthology.orchestra.run.smithi046.stdout:(70/120): python3-websocket-client-0.56.0-5.el8 402 kB/s | 61 kB 00:00 2023-10-07T08:56:08.476 INFO:teuthology.orchestra.run.smithi046.stdout:(71/120): thrift-0.13.0-2.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-10-07T08:56:08.507 INFO:teuthology.orchestra.run.smithi046.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-07T08:56:08.515 INFO:teuthology.orchestra.run.smithi046.stdout:(73/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 401 kB/s | 19 kB 00:00 2023-10-07T08:56:08.527 INFO:teuthology.orchestra.run.smithi046.stdout:(74/120): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-07T08:56:08.528 INFO:teuthology.orchestra.run.smithi046.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 10 MB/s | 220 kB 00:00 2023-10-07T08:56:08.529 INFO:teuthology.orchestra.run.smithi046.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.3 MB/s | 48 kB 00:00 2023-10-07T08:56:08.545 INFO:teuthology.orchestra.run.smithi046.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.6 MB/s | 43 kB 00:00 2023-10-07T08:56:08.546 INFO:teuthology.orchestra.run.smithi046.stdout:(78/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-07T08:56:08.561 INFO:teuthology.orchestra.run.smithi046.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2023-10-07T08:56:08.572 INFO:teuthology.orchestra.run.smithi046.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-07T08:56:08.575 INFO:teuthology.orchestra.run.smithi046.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.8 MB/s | 83 kB 00:00 2023-10-07T08:56:08.583 INFO:teuthology.orchestra.run.smithi046.stdout:(82/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 43 MB/s | 2.3 MB 00:00 2023-10-07T08:56:08.591 INFO:teuthology.orchestra.run.smithi046.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 3.1 MB/s | 59 kB 00:00 2023-10-07T08:56:08.592 INFO:teuthology.orchestra.run.smithi046.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.9 MB/s | 169 kB 00:00 2023-10-07T08:56:08.601 INFO:teuthology.orchestra.run.smithi046.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-10-07T08:56:08.607 INFO:teuthology.orchestra.run.smithi046.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.1 MB/s | 86 kB 00:00 2023-10-07T08:56:08.608 INFO:teuthology.orchestra.run.smithi046.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2023-10-07T08:56:08.615 INFO:teuthology.orchestra.run.smithi046.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.2 MB/s | 47 kB 00:00 2023-10-07T08:56:08.631 INFO:teuthology.orchestra.run.smithi046.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-10-07T08:56:08.633 INFO:teuthology.orchestra.run.smithi046.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.9 MB/s | 70 kB 00:00 2023-10-07T08:56:08.635 INFO:teuthology.orchestra.run.smithi046.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2023-10-07T08:56:08.649 INFO:teuthology.orchestra.run.smithi046.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 11 MB/s | 200 kB 00:00 2023-10-07T08:56:08.651 INFO:teuthology.orchestra.run.smithi046.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.1 MB/s | 97 kB 00:00 2023-10-07T08:56:08.665 INFO:teuthology.orchestra.run.smithi046.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.7 MB/s | 44 kB 00:00 2023-10-07T08:56:08.668 INFO:teuthology.orchestra.run.smithi046.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-07T08:56:08.683 INFO:teuthology.orchestra.run.smithi046.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 9.1 MB/s | 161 kB 00:00 2023-10-07T08:56:08.690 INFO:teuthology.orchestra.run.smithi046.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2023-10-07T08:56:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-07T08:56:08.719 INFO:teuthology.orchestra.run.smithi046.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.6 MB/s | 39 kB 00:00 2023-10-07T08:56:08.746 INFO:teuthology.orchestra.run.smithi046.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 26 MB/s | 688 kB 00:00 2023-10-07T08:56:08.766 INFO:teuthology.orchestra.run.smithi046.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-07T08:56:08.790 INFO:teuthology.orchestra.run.smithi046.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 48 MB/s | 4.8 MB 00:00 2023-10-07T08:56:08.794 INFO:teuthology.orchestra.run.smithi046.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 8.0 MB/s | 225 kB 00:00 2023-10-07T08:56:08.812 INFO:teuthology.orchestra.run.smithi046.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.5 MB/s | 126 kB 00:00 2023-10-07T08:56:08.831 INFO:teuthology.orchestra.run.smithi046.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 10 MB/s | 187 kB 00:00 2023-10-07T08:56:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:56:08.974 INFO:teuthology.orchestra.run.smithi046.stdout:(106/120): python3-scipy-1.0.0-20.module+el8.1. 43 MB/s | 15 MB 00:00 2023-10-07T08:56:08.977 INFO:teuthology.orchestra.run.smithi046.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 3.6 MB/s | 538 kB 00:00 2023-10-07T08:56:09.002 INFO:teuthology.orchestra.run.smithi046.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 18 MB/s | 3.7 MB 00:00 2023-10-07T08:56:09.004 INFO:teuthology.orchestra.run.smithi046.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.8 MB/s | 157 kB 00:00 2023-10-07T08:56:09.006 INFO:teuthology.orchestra.run.smithi046.stdout:(110/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.1 MB/s | 302 kB 00:00 2023-10-07T08:56:09.022 INFO:teuthology.orchestra.run.smithi046.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.5 MB/s | 110 kB 00:00 2023-10-07T08:56:09.026 INFO:teuthology.orchestra.run.smithi046.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-07T08:56:09.030 INFO:teuthology.orchestra.run.smithi046.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 838 kB/s | 20 kB 00:00 2023-10-07T08:56:09.043 INFO:teuthology.orchestra.run.smithi046.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-10-07T08:56:09.049 INFO:teuthology.orchestra.run.smithi046.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2023-10-07T08:56:09.082 INFO:teuthology.orchestra.run.smithi046.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2023-10-07T08:56:09.124 INFO:teuthology.orchestra.run.smithi046.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 51 MB/s | 4.7 MB 00:00 2023-10-07T08:56:09.145 INFO:teuthology.orchestra.run.smithi046.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2023-10-07T08:56:09.498 INFO:teuthology.orchestra.run.smithi046.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 8.3 MB/s | 3.5 MB 00:00 2023-10-07T08:56:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:56:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:56:09.995 INFO:teuthology.orchestra.run.smithi046.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 3.6 MB 00:00 2023-10-07T08:56:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-10-07T08:56:09.998 INFO:teuthology.orchestra.run.smithi046.stdout:Total 11 MB/s | 202 MB 00:19 2023-10-07T08:56:10.051 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-10-07T08:56:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-07T08:56:10.175 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-10-07T08:56:10.175 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-10-07T08:56:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-07T08:56:10.402 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-07T08:56:10.619 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-07T08:56:11.168 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-07T08:56:11.353 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-07T08:56:11.832 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-10-07T08:56:11.837 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-10-07T08:56:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-07T08:56:12.111 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-07T08:56:12.852 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-07T08:56:13.190 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-07T08:56:13.368 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-07T08:56:13.565 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-07T08:56:13.835 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-07T08:56:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-07T08:56:14.416 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-07T08:56:14.609 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-07T08:56:14.738 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-07T08:56:15.024 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-07T08:56:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-07T08:56:16.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-07T08:56:16.970 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-07T08:56:17.242 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-07T08:56:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-10-07T08:56:17.496 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-07T08:56:17.578 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-07T08:56:17.689 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:56:17.843 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-07T08:56:17.861 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:56:18.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:56:18.494 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:56:18.931 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:56:19.366 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:56:19.597 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:56:19.761 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:56:19.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:56:19.991 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-07T08:56:20.072 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:56:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:56:20.338 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-07T08:56:20.583 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-07T08:56:20.626 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-07T08:56:20.821 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-07T08:56:21.038 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-07T08:56:21.261 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-07T08:56:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-07T08:56:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-07T08:56:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:56:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:56:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-07T08:56:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-07T08:56:21.848 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-07T08:56:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-07T08:56:22.062 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-07T08:56:22.220 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-07T08:56:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:56:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:56:22.380 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-07T08:56:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:56:22.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-07T08:56:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:56:22.737 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-07T08:56:22.863 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-07T08:56:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-07T08:56:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-07T08:56:23.334 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-07T08:56:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-07T08:56:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-07T08:56:23.586 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-07T08:56:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:56:23.888 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:56:23.929 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-07T08:56:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:56:24.174 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-07T08:56:24.358 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-07T08:56:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-07T08:56:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:56:24.771 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-07T08:56:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:56:24.925 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-07T08:56:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-07T08:56:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-07T08:56:25.402 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:56:25.423 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-07T08:56:25.621 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:56:25.626 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-07T08:56:25.838 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-07T08:56:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-07T08:56:26.378 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-07T08:56:26.378 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:56:26.582 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-07T08:56:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-07T08:56:26.718 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-07T08:56:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-07T08:56:26.943 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-07T08:56:27.059 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-07T08:56:27.228 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-07T08:56:27.279 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-07T08:56:27.429 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-07T08:56:27.544 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-07T08:56:27.566 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-07T08:56:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-07T08:56:27.865 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-07T08:56:27.973 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-07T08:56:28.112 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-07T08:56:28.243 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-07T08:56:28.410 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-07T08:56:28.505 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-07T08:56:28.654 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:56:28.749 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-07T08:56:29.025 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-07T08:56:29.308 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-07T08:56:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-07T08:56:29.765 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-07T08:56:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:56:30.939 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-07T08:56:31.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-07T08:56:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-07T08:56:31.568 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-07T08:56:31.943 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-07T08:56:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-07T08:56:32.297 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-07T08:56:32.550 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-07T08:56:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-07T08:56:32.804 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-07T08:56:32.951 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-07T08:56:33.067 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-07T08:56:33.214 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-07T08:56:33.308 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-07T08:56:33.430 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-07T08:56:33.613 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-07T08:56:33.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-07T08:56:34.120 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-07T08:56:34.361 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-07T08:56:34.570 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-07T08:56:34.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-07T08:56:35.012 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-07T08:56:35.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:56:35.297 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:56:35.506 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-07T08:56:35.709 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-07T08:56:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-07T08:56:36.060 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-07T08:56:36.258 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-07T08:56:36.406 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-07T08:56:36.567 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-07T08:56:36.791 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-07T08:56:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-07T08:56:37.308 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-07T08:56:37.558 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-07T08:56:37.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-07T08:56:38.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-07T08:56:38.296 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-07T08:56:38.373 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:38.502 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-07T08:56:38.615 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:38.802 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-07T08:56:39.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-07T08:56:39.193 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:39.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-07T08:56:39.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-07T08:56:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:56:39.603 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:56:39.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-07T08:56:39.748 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:56:39.837 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-07T08:56:40.105 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-07T08:56:40.370 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-07T08:56:40.607 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-07T08:56:40.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-07T08:56:41.037 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-07T08:56:41.293 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-07T08:56:41.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-07T08:56:41.834 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-07T08:56:42.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-07T08:56:42.373 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-07T08:56:42.630 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-07T08:56:43.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-07T08:56:44.244 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-07T08:56:44.498 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-07T08:56:44.882 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-07T08:56:45.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-07T08:56:45.510 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-07T08:56:45.757 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-07T08:56:45.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-07T08:56:46.211 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-07T08:56:51.534 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:51.786 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:52.398 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:56:52.719 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:56:52.821 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:56:52.943 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:56:57.414 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2023-10-07T08:56:57.600 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2023-10-07T08:56:57.601 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2023-10-07T08:56:57.601 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2023-10-07T08:56:57.601 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-10-07T08:56:57.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:56:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:56:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:56:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:56:59.701 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:56:59.914 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:57:00.305 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:57:00.486 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:57:00.503 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:57:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:57:03.605 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:57:03.767 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-07T08:57:03.990 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-07T08:57:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:57:04.368 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:57:04.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:57:05.573 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:57:05.726 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:57:05.828 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:57:06.201 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-07T08:57:06.393 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:57:06.430 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:57:06.618 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:57:06.630 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:57:08.225 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-07T08:57:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:57:08.571 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:57:08.760 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:57:08.802 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:57:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:57:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:57:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /run 2023-10-07T08:57:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2023-10-07T08:57:11.222 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2023-10-07T08:57:11.222 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2023-10-07T08:57:11.222 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2023-10-07T08:57:11.222 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-10-07T08:57:11.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:11.641 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:57:13.219 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:57:13.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:57:13.648 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:57:13.866 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:57:14.279 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:57:14.466 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:57:14.477 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:57:14.483 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:57:14.831 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-07T08:57:14.983 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-07T08:57:15.700 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-07T08:57:16.051 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-07T08:57:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-07T08:57:16.478 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-07T08:57:16.630 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-07T08:57:16.813 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-07T08:57:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-07T08:57:17.216 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-07T08:57:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-07T08:57:17.627 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:57:17.649 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-07T08:57:17.774 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:57:17.866 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-07T08:57:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-07T08:57:17.989 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-07T08:57:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-07T08:57:18.126 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-07T08:57:18.126 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:57:18.203 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-07T08:57:18.377 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:57:18.378 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:57:18.862 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:57:19.291 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-07T08:57:19.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-07T08:57:19.293 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-07T08:57:19.294 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-07T08:57:19.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-07T08:57:19.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-07T08:57:19.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-07T08:57:19.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-07T08:57:19.303 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-07T08:57:19.303 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-07T08:57:19.303 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-07T08:57:19.304 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-07T08:57:19.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-07T08:57:19.306 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-07T08:57:19.307 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-07T08:57:19.308 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-07T08:57:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-07T08:57:19.310 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-07T08:57:19.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-07T08:57:19.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-07T08:57:19.895 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:57:20.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:57:20.320 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:57:20.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-07T08:57:20.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:57:20.925 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:57:21.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:57:21.101 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:57:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:21.650 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:42 ago on Sat 07 Oct 2023 08:55:39 AM UTC. 2023-10-07T08:57:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-07T08:57:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:57:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:57:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:57:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:57:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:57:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:57:24.086 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2023-10-07T08:57:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:57:24.267 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:24.267 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2023-10-07T08:57:24.267 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.5-12.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-07T08:57:24.270 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.271 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-07T08:57:24.272 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T08:57:24.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T08:57:24.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T08:57:24.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-07T08:57:24.277 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T08:57:24.278 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-07T08:57:24.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:24.278 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-10-07T08:57:24.571 DEBUG:teuthology.parallel:result is None 2023-10-07T08:57:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:57:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-07T08:57:31.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-07T08:57:31.218 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-07T08:57:31.441 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-07T08:57:31.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:57:31.592 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:57:31.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-07T08:57:32.077 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-07T08:57:32.239 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-07T08:57:32.439 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-07T08:57:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-07T08:57:32.930 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:57:32.995 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:57:33.213 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:57:33.223 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:57:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-07T08:57:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:57:33.558 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:57:33.558 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:57:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-07T08:57:34.517 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-07T08:57:34.518 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-07T08:57:34.519 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-07T08:57:34.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-07T08:57:34.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-07T08:57:34.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-07T08:57:34.534 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-07T08:57:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-07T08:57:34.536 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-07T08:57:34.537 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-07T08:57:34.538 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-07T08:57:34.539 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-07T08:57:34.540 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-07T08:57:34.541 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-07T08:57:36.713 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:57:36.713 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:55 ago on Sat 07 Oct 2023 08:55:41 AM UTC. 2023-10-07T08:57:38.979 INFO:teuthology.orchestra.run.smithi046.stdout:Installed products updated. 2023-10-07T08:57:39.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.126 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.5-12.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-07T08:57:39.128 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-07T08:57:39.129 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T08:57:39.130 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T08:57:39.131 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T08:57:39.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T08:57:39.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T08:57:39.134 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.135 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.136 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:57:39.136 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-07T08:57:39.136 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T08:57:39.136 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-07T08:57:39.136 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T08:57:39.137 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-07T08:57:39.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:39.137 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-07T08:57:39.408 DEBUG:teuthology.parallel:result is None 2023-10-07T08:57:39.408 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:57:39.630 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T08:57:39.652 INFO:teuthology.orchestra.run.smithi046.stdout:17.2.6-1320.g08cac018.el8 2023-10-07T08:57:39.652 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-07T08:57:39.652 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-07T08:57:39.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:57:39.796 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T08:57:39.821 INFO:teuthology.orchestra.run.smithi133.stdout:17.2.6-1320.g08cac018.el8 2023-10-07T08:57:39.821 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-07T08:57:39.821 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-07T08:57:39.822 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-07T08:57:39.822 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:39.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T08:57:39.863 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:39.863 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T08:57:39.904 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-07T08:57:39.905 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:39.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T08:57:39.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T08:57:39.998 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:39.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T08:57:40.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T08:57:40.090 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-07T08:57:40.091 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:40.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T08:57:40.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T08:57:40.181 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:40.182 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T08:57:40.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T08:57:40.272 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-07T08:57:40.272 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:40.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T08:57:40.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T08:57:40.361 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:40.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T08:57:40.386 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T08:57:40.451 INFO:teuthology.run_tasks:Running task ceph... 2023-10-07T08:57:40.521 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-07T08:57:40.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2023-10-07T08:57:40.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-10-07T08:57:40.547 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-07T08:57:40.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-07T08:57:40.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-07T08:57:40.613 INFO:tasks.ceph:Creating extra log directories... 2023-10-07T08:57:40.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-07T08:57:40.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-07T08:57:40.685 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-07T08:57:40.685 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-07T08:57:40.685 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-07T08:57:40.685 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:40.685 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-07T08:57:40.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-07T08:57:40.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-07T08:57:40.870 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:40.871 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-07T08:57:40.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-07T08:57:40.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-07T08:57:41.027 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-07T08:57:41.027 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-07T08:57:41.028 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7416291', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4726, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMizICYrSuj0JLA84CqKR01RR1r4+yAWvnpDbWKXz2nI9imHUcwnkQSziagr04+RZakxWCeBl/Np614nWfQFvRw=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIuEOzbetpGZoWEiQY9UMReh/o20TP9sxSQfSnkYu49JiCZpXdgHiW+UVS7yKZfWCLF0lG6+XiPPCZqB8uTFFk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_00:40:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-07T08:57:41.028 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-07T08:57:41.030 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-07T08:57:41.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2023-10-07T08:57:41.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-10-07T08:57:41.141 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:41.141 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T08:57:41.163 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T08:57:41.164 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 217750 Links: 1 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-07 08:57:34.029377495 +0000 2023-10-07T08:57:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-07 08:54:57.302204878 +0000 2023-10-07T08:57:41.220 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-07 08:54:57.302204878 +0000 2023-10-07T08:57:41.220 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-10-07T08:57:41.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T08:57:41.283 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-07T08:57:41.283 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-07T08:57:41.283 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000124928 s, 4.1 MB/s 2023-10-07T08:57:41.284 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T08:57:41.341 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 216919 Links: 1 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-07 08:57:34.029377495 +0000 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-07 08:54:57.803199852 +0000 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-07 08:54:57.803199852 +0000 2023-10-07T08:57:41.397 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-10-07T08:57:41.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T08:57:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-07T08:57:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-07T08:57:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000113349 s, 4.5 MB/s 2023-10-07T08:57:41.462 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T08:57:41.518 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2023-10-07T08:57:41.573 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 216982 Links: 1 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-07 08:57:34.029377495 +0000 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-07 08:54:58.303194836 +0000 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-07 08:54:58.303194836 +0000 2023-10-07T08:57:41.574 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-10-07T08:57:41.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T08:57:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-07T08:57:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-07T08:57:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000112547 s, 4.5 MB/s 2023-10-07T08:57:41.638 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T08:57:41.694 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 220023 Links: 1 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-07 08:57:34.029377495 +0000 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-07 08:54:58.829189559 +0000 2023-10-07T08:57:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-07 08:54:58.829189559 +0000 2023-10-07T08:57:41.751 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-10-07T08:57:41.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T08:57:41.814 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-07T08:57:41.814 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-07T08:57:41.814 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.2304e-05 s, 5.5 MB/s 2023-10-07T08:57:41.815 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T08:57:41.871 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:41.871 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:41.871 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T08:57:41.888 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T08:57:41.888 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-10-07T08:57:41.944 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T08:57:41.944 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 217006 Links: 1 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-07 08:57:18.856225026 +0000 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-07 08:54:42.443933192 +0000 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-07 08:54:42.443933192 +0000 2023-10-07T08:57:41.945 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-07T08:57:41.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T08:57:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-07T08:57:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-07T08:57:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000290811 s, 1.8 MB/s 2023-10-07T08:57:42.011 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T08:57:42.069 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-10-07T08:57:42.126 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 222237 Links: 1 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-07 08:57:18.856225026 +0000 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-07 08:54:42.934924726 +0000 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-07 08:54:42.934924726 +0000 2023-10-07T08:57:42.127 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-07T08:57:42.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T08:57:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-07T08:57:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-07T08:57:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000272109 s, 1.9 MB/s 2023-10-07T08:57:42.192 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T08:57:42.250 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-10-07T08:57:42.305 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T08:57:42.305 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:42.305 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 222396 Links: 1 2023-10-07T08:57:42.305 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:42.306 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:42.306 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-07 08:57:18.857225009 +0000 2023-10-07T08:57:42.306 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-07 08:54:43.435916088 +0000 2023-10-07T08:57:42.306 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-07 08:54:43.435916088 +0000 2023-10-07T08:57:42.306 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-07T08:57:42.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T08:57:42.368 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-07T08:57:42.368 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-07T08:57:42.368 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000239366 s, 2.1 MB/s 2023-10-07T08:57:42.369 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T08:57:42.425 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 218979 Links: 1 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:57:42.480 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-07 08:57:18.857225009 +0000 2023-10-07T08:57:42.481 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-07 08:54:43.936907450 +0000 2023-10-07T08:57:42.481 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-07 08:54:43.936907450 +0000 2023-10-07T08:57:42.481 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-07T08:57:42.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T08:57:42.542 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-07T08:57:42.543 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-07T08:57:42.543 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000195459 s, 2.6 MB/s 2023-10-07T08:57:42.544 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T08:57:42.599 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:42.600 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-07T08:57:42.600 INFO:tasks.ceph:Generating config... 2023-10-07T08:57:42.601 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-07T08:57:42.602 INFO:tasks.ceph:[client] debug client = 20 2023-10-07T08:57:42.602 INFO:tasks.ceph:[client] debug ms = 1 2023-10-07T08:57:42.602 INFO:tasks.ceph:[client] pid file = 2023-10-07T08:57:42.602 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-07T08:57:42.602 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-07T08:57:42.602 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-07T08:57:42.602 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-07T08:57:42.602 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-07T08:57:42.603 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-07T08:57:42.604 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-07T08:57:42.604 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-07T08:57:42.604 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-07T08:57:42.604 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-07T08:57:42.604 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-07T08:57:42.604 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-07T08:57:42.604 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-07T08:57:42.604 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-07T08:57:42.605 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-07T08:57:42.606 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-07T08:57:42.606 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-07T08:57:42.606 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-07T08:57:42.606 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-07T08:57:42.606 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-07T08:57:42.606 INFO:tasks.ceph:Setting up mon.a... 2023-10-07T08:57:42.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-07T08:57:42.653 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2023-10-07T08:57:42.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-07T08:57:42.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:57:42.762 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.133'), ('mon.c', '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]')] 2023-10-07T08:57:42.763 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-07T08:57:42.764 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:42.764 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-07T08:57:42.817 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.133 --addv c '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:42.901 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 28716a76-cc98-43f4-9a5b-38266bddfb96 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = octopus 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 28716a76-cc98-43f4-9a5b-38266bddfb96 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2023-10-07T08:57:42.901813+0000 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-10-07T08:57:42.901813+0000 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 15 (octopus) 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2023-10-07T08:57:42.902 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2023-10-07T08:57:42.903 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2023-10-07T08:57:42.903 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-07T08:57:42.904 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-07T08:57:42.958 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 28716a76-cc98-43f4-9a5b-38266bddfb96... 2023-10-07T08:57:42.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-07T08:57:43.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-07T08:57:43.043 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2023-10-07T08:57:43.043 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2023-10-07T08:57:43.043 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2023-10-07T08:57:43.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2023-10-07T08:57:43.045 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.046 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on skipped message = False 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 28716a76-cc98-43f4-9a5b-38266bddfb96 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2023-10-07T08:57:43.047 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.048 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2023-10-07T08:57:43.049 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2023-10-07T08:57:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2023-10-07T08:57:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: debug finisher = 20 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2023-10-07T08:57:43.052 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2023-10-07T08:57:43.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2023-10-07T08:57:43.054 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = "" 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2023-10-07T08:57:43.055 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2023-10-07T08:57:43.056 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-10-07T08:57:43.057 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-10-07T08:57:43.057 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-10-07T08:57:43.058 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-10-07T08:57:43.058 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-10-07T08:57:43.058 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-07T08:57:43.058 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-10-07T08:57:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-10-07T08:57:43.060 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.061 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.46,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2023-10-07T08:57:43.062 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 28716a76-cc98-43f4-9a5b-38266bddfb96 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-10-07T08:57:43.063 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-10-07T08:57:43.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.065 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-07T08:57:43.066 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-10-07T08:57:43.067 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: debug finisher = 20 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-07T08:57:43.068 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:57:43.069 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-10-07T08:57:43.070 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-10-07T08:57:43.071 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-10-07T08:57:43.072 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-10-07T08:57:43.073 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-10-07T08:57:43.074 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-10-07T08:57:43.074 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-07T08:57:43.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-07T08:57:43.150 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-07T08:57:43.150 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:43.151 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-07T08:57:43.165 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:43.165 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-07T08:57:43.220 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:57:43.221 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:43.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-07T08:57:43.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:57:43.295 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:57:43.295 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:43.350 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:57:43.351 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:43.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-07T08:57:43.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:57:43.386 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:57:43.386 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:43.441 INFO:tasks.ceph:Setting up mon nodes... 2023-10-07T08:57:43.441 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-07T08:57:43.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-07T08:57:43.491 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-07T08:57:43.493 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-07T08:57:43.557 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-07T08:57:43.559 INFO:tasks.ceph:Setting up mds nodes... 2023-10-07T08:57:43.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-07T08:57:43.610 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-07T08:57:43.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-07T08:57:43.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-07T08:57:43.726 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-07T08:57:43.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-07T08:57:43.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-07T08:57:43.802 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-07T08:57:43.805 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-07T08:57:43.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-07T08:57:43.917 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-07T08:57:43.920 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-07T08:57:43.944 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-07T08:57:43.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-07T08:57:43.985 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-07T08:57:43.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-07T08:57:44.078 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-07T08:57:44.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-07T08:57:44.129 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-07T08:57:44.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-07T08:57:44.219 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-07T08:57:44.232 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-07T08:57:44.232 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-07T08:57:44.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-07T08:57:44.257 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:44.257 INFO:tasks.ceph:role: osd.0 2023-10-07T08:57:44.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:57:44.257 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-07T08:57:44.322 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:44.322 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:44.322 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:44.322 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-10-07T08:57:44.322 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:44.323 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:44.323 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:44.323 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:44.323 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:44.323 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:44.345 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-10-07T08:57:44.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-10-07T08:57:44.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-07T08:57:44.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-07T08:57:44.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-07T08:57:44.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:44.562 INFO:tasks.ceph:role: osd.1 2023-10-07T08:57:44.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:57:44.562 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:44.626 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:44.627 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:44.652 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-10-07T08:57:44.653 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-10-07T08:57:44.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-07T08:57:44.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-07T08:57:44.800 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-07T08:57:44.865 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:44.865 INFO:tasks.ceph:role: osd.2 2023-10-07T08:57:44.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:57:44.866 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:44.930 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:44.931 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:44.931 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:44.953 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-10-07T08:57:44.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-10-07T08:57:44.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-07T08:57:45.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-07T08:57:45.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-07T08:57:45.166 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:45.167 INFO:tasks.ceph:role: osd.3 2023-10-07T08:57:45.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:57:45.167 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-07T08:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-10-07T08:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:45.232 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:45.232 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:45.254 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-10-07T08:57:45.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-10-07T08:57:45.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-07T08:57:45.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-07T08:57:45.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:45.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-07T08:57:45.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-07T08:57:45.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-07T08:57:45.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-07T08:57:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-07T08:57:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:45.494+0000 7f613951f540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-07T08:57:46.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:46.021+0000 7f613951f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:46.783+0000 7f613951f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:47.546+0000 7f613951f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:48.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-07T08:57:48.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-07T08:57:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.461+0000 7f5efae34540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-07T08:57:48.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:48.985+0000 7f5efae34540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:49.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:49.747+0000 7f5efae34540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:50.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:50.509+0000 7f5efae34540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:51.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-07T08:57:51.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.426+0000 7f05eda2f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-07T08:57:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.426+0000 7f05eda2f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-07T08:57:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.426+0000 7f05eda2f540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-07T08:57:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.426+0000 7f05eda2f540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-07T08:57:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.426+0000 7f05eda2f540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-07T08:57:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.427+0000 7f05eda2f540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-07T08:57:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:51.953+0000 7f05eda2f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:52.722+0000 7f05eda2f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:53.486+0000 7f05eda2f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:54.284 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-07T08:57:54.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:57:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.397+0000 7fb7d243f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-07T08:57:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.398+0000 7fb7d243f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-07T08:57:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.398+0000 7fb7d243f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-07T08:57:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.398+0000 7fb7d243f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-07T08:57:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.398+0000 7fb7d243f540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-07T08:57:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.398+0000 7fb7d243f540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-07T08:57:54.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:54.924+0000 7fb7d243f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:55.688+0000 7fb7d243f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:57:56.453+0000 7fb7d243f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:57:57.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-07T08:57:57.284 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-07T08:57:57.312 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:57.313 INFO:tasks.ceph:role: osd.4 2023-10-07T08:57:57.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:57:57.313 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-07T08:57:57.386 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:57.386 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:57.386 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:57.386 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-07T08:57:57.386 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:57.387 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:57.387 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:57.387 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:57.387 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:57.387 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:57.825 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-10-07T08:57:57.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-07T08:57:57.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-07T08:57:58.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-07T08:57:58.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-07T08:57:58.099 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:58.099 INFO:tasks.ceph:role: osd.5 2023-10-07T08:57:58.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:57:58.099 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:58.173 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:58.595 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-10-07T08:57:58.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-07T08:57:58.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-07T08:57:58.699 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-07T08:57:58.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-07T08:57:58.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:58.792 INFO:tasks.ceph:role: osd.6 2023-10-07T08:57:58.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:57:58.793 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:58.866 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:57:59.303 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-10-07T08:57:59.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-07T08:57:59.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-07T08:57:59.455 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-07T08:57:59.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-07T08:57:59.572 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:57:59.572 INFO:tasks.ceph:role: osd.7 2023-10-07T08:57:59.572 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:57:59.572 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-07T08:57:59.649 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:57:59.649 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:57:59.649 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:57:59.649 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-07T08:57:59.650 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:57:59.650 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:57:59.651 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:57:59.651 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:57:59.651 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:57:59.651 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:58:00.093 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-10-07T08:58:00.094 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-07T08:58:00.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-07T08:58:00.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-07T08:58:00.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.390+0000 7fcb0a8d0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.390+0000 7fcb0a8d0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.390+0000 7fcb0a8d0540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.391+0000 7fcb0a8d0540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.391+0000 7fcb0a8d0540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-07T08:58:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.391+0000 7fcb0a8d0540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-07T08:58:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:00.915+0000 7fcb0a8d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:01.679+0000 7fcb0a8d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:02.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:02.449+0000 7fcb0a8d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:03.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-07T08:58:03.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.366+0000 7fcbc1080540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-07T08:58:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.367+0000 7fcbc1080540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-07T08:58:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.367+0000 7fcbc1080540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-07T08:58:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.367+0000 7fcbc1080540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-07T08:58:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.367+0000 7fcbc1080540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-07T08:58:03.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.367+0000 7fcbc1080540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-07T08:58:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:03.889+0000 7fcbc1080540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:04.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:04.652+0000 7fcbc1080540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:05.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:05.420+0000 7fcbc1080540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:06.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-07T08:58:06.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.363+0000 7f21f4782540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.363+0000 7f21f4782540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.363+0000 7f21f4782540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.363+0000 7f21f4782540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.363+0000 7f21f4782540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-07T08:58:06.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.364+0000 7f21f4782540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-07T08:58:06.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:06.891+0000 7f21f4782540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:07.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:07.656+0000 7f21f4782540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:08.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:08.418+0000 7f21f4782540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:09.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-07T08:58:09.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.358+0000 7f3598531540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.358+0000 7f3598531540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.358+0000 7f3598531540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.358+0000 7f3598531540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.358+0000 7f3598531540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-07T08:58:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.359+0000 7f3598531540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-07T08:58:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:09.880+0000 7f3598531540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:10.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:10.651+0000 7f3598531540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:11.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:58:11.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:58:11.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:11.415+0000 7f3598531540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-07T08:58:12.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-07T08:58:12.236 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-07T08:58:12.236 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-07T08:58:12.266 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-07T08:58:12.334 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-07T08:58:12.402 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-07T08:58:12.469 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-07T08:58:12.536 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-07T08:58:12.603 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:12.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-07T08:58:12.669 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-07T08:58:12.695 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-07T08:58:12.760 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-07T08:58:12.824 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.824 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-07T08:58:12.888 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-07T08:58:12.951 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:12.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-07T08:58:13.016 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:13.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-07T08:58:13.080 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:13.080 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-07T08:58:13.097 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:13.097 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-07T08:58:13.153 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:13.153 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-07T08:58:13.167 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:13.167 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-07T08:58:13.221 INFO:tasks.ceph:Adding keys to all mons... 2023-10-07T08:58:13.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-07T08:58:13.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-07T08:58:13.264 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2023-10-07T08:58:13.264 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw== 2023-10-07T08:58:13.264 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-10-07T08:58:13.264 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A== 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2023-10-07T08:58:13.265 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ== 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w== 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg== 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw== 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg== 2023-10-07T08:58:13.266 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg== 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ== 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ== 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout:[client.2] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg== 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ== 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout:[client.3] 2023-10-07T08:58:13.267 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw== 2023-10-07T08:58:13.283 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-10-07T08:58:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw== 2023-10-07T08:58:13.284 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g== 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g== 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ== 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg== 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-10-07T08:58:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw== 2023-10-07T08:58:13.286 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ== 2023-10-07T08:58:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2023-10-07T08:58:13.288 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw== 2023-10-07T08:58:13.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:58:13.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:58:13.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.483 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.532 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.630 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:58:13.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:58:13.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:58:13.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.881 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:13.982 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:58:14.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:58:14.241 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-07T08:58:14.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-07T08:58:14.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:58:14.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-07T08:58:14.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-07T08:58:14.409 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:58:14.500 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-07T08:58:14.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-07T08:58:14.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:58:14.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-07T08:58:14.704 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:14.706 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:58:14.758 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-07T08:58:14.759 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-07T08:58:14.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-07T08:58:14.762 INFO:tasks.ceph.mon.a:Started 2023-10-07T08:58:14.762 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-07T08:58:14.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-07T08:58:14.802 INFO:tasks.ceph.mon.b:Started 2023-10-07T08:58:14.802 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-07T08:58:14.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-07T08:58:14.806 INFO:tasks.ceph.mon.c:Started 2023-10-07T08:58:14.807 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-07T08:58:14.807 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-07T08:58:14.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-07T08:58:14.809 INFO:tasks.ceph.mgr.y:Started 2023-10-07T08:58:14.809 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-07T08:58:14.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-07T08:58:14.811 INFO:tasks.ceph.mgr.x:Started 2023-10-07T08:58:14.811 INFO:tasks.ceph:Setting crush tunables to default 2023-10-07T08:58:14.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2023-10-07T08:58:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.929+0000 7f839eff0700 1 Processor -- start 2023-10-07T08:58:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.929+0000 7f839eff0700 1 -- start start 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839eff0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839eff0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839eff0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398069ee0 con 0x7f8398159c60 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839eff0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839815a160 con 0x7f8398159890 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839eff0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980d13a0 con 0x7f8398069560 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57864/0 (socket says 172.21.15.46:57864) 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 learned_addr learned my addr 172.21.15.46:0/4216047882 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.930+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.931+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.931+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:14.931+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:58:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.131+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.131+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.131+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.131+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.131+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:58:15.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.132+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:15.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.132+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:15.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.132+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:15.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.132+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:15.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.132+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:58:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.532+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.532+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.532+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.532+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.532+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-07T08:58:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.533+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.533+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.533+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.533+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:15.533+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-07T08:58:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.333+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.333+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.333+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.333+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.333+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-07T08:58:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.334+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.335+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:58:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.335+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.335+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:16.335+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-07T08:58:17.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 msgr2=0x7f83980699a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8398069560 0x7f83980699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 msgr2=0x7f839815abd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.46:3300/0 conn(0x7f8398159890 0x7f839815abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 -- 172.21.15.46:0/4216047882 >> v1:172.21.15.133:6789/0 conn(0x7f8398159c60 legacy=0x7f839815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 -- 172.21.15.46:0/4216047882 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839815e140 con 0x7f8378003710 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.930+0000 7f83967fc700 1 -- 172.21.15.46:0/4216047882 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839815a160 con 0x7f8378007390 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.931+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.931+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.931+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.931+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:17.931+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:58:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.132+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.132+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:58:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.132+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.132+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.132+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:58:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.533+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.533+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:58:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.533+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.533+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:18.533+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-07T08:58:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:19.335+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:19.335+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:58:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:19.335+0000 7f8397fff700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:58:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:19.335+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:58:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:19.335+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-07T08:58:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.134+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267829187 0 0) 0x7f839815e140 con 0x7f8378003710 2023-10-07T08:58:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.134+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8384003570 con 0x7f8378003710 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423145845 0 0) 0x7f8384003570 con 0x7f8378003710 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 msgr2=0x7f8378009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 --2- 172.21.15.46:0/4216047882 >> v2:172.21.15.133:3300/0 conn(0x7f8378007390 0x7f8378009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837800af40 con 0x7f8378003710 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f839000c2f0 con 0x7f8378003710 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 >> v1:172.21.15.46:6789/0 conn(0x7f8378003710 legacy=0x7f8378005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f839d58d700 1 -- 172.21.15.46:0/4216047882 reap_dead start 2023-10-07T08:58:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f8384003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8384004810 0x7f8384004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83840052e0 0x7f838400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839815a160 con 0x7f8384003a60 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838400c2a0 con 0x7f83840052e0 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838400c460 con 0x7f8384004810 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f8384003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f8397fff700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8384004810 0x7f8384004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f839d58d700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83840052e0 0x7f838400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.135+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8384004810 msgr2=0x7f8384004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.136+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8384004810 0x7f8384004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.136+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83840052e0 msgr2=0x7f838400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.136+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83840052e0 0x7f838400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.136+0000 7f839cd8c700 1 -- 172.21.15.46:0/4216047882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384003570 con 0x7f8384003a60 2023-10-07T08:58:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.136+0000 7f839cd8c700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f8384003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8390009060 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccf566ead2b915b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:20.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.137+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000ccc0 con 0x7f8384003a60 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.137+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000c040 con 0x7f8384003a60 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.137+0000 7f83977fe700 1 -- 172.21.15.46:0/4216047882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390017470 con 0x7f8384003a60 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 -- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 msgr2=0x7f8384003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f8384003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8390009060 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 -- 172.21.15.46:0/4216047882 shutdown_connections 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83840052e0 0x7f838400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8384004810 0x7f8384004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 --2- 172.21.15.46:0/4216047882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f8384003e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 -- 172.21.15.46:0/4216047882 >> 172.21.15.46:0/4216047882 conn(0x7f8398068e20 msgr2=0x7f83980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 -- 172.21.15.46:0/4216047882 shutdown_connections 2023-10-07T08:58:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.138+0000 7f839eff0700 1 -- 172.21.15.46:0/4216047882 wait complete. 2023-10-07T08:58:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.139+0000 7f839eff0700 1 Processor -- start 2023-10-07T08:58:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 -- start start 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 0x7f83980c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83840052e0 0x7f83980c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839815ce20 con 0x7f8384003a60 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839814f900 con 0x7f8384004810 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.140+0000 7f839eff0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839814f3f0 con 0x7f83840052e0 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50966/0 (socket says 172.21.15.46:50966) 2023-10-07T08:58:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 -- 172.21.15.46:0/2675498647 learned_addr learned my addr 172.21.15.46:0/2675498647 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f8397fff700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 0x7f83980c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839d58d700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83840052e0 0x7f83980c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 -- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83840052e0 msgr2=0x7f83980c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83840052e0 0x7f83980c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 -- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 msgr2=0x7f83980c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 0x7f83980c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 -- 172.21.15.46:0/2675498647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980ca200 con 0x7f8384003a60 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f8397fff700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 0x7f83980c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f839cd8c700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f838400c270 tx=0x7f8390020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.141+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390027070 con 0x7f8384003a60 2023-10-07T08:58:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900179f0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980ca4e0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390006af0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980c9eb0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f83900206d0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.142+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f839002b750 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.143+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839804c3c0 con 0x7f8384003a60 2023-10-07T08:58:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.145+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8390030060 con 0x7f8384003a60 2023-10-07T08:58:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.223+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f839815cc00 con 0x7f8384003a60 2023-10-07T08:58:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.226+0000 7f8394ff9700 1 -- 172.21.15.46:0/2675498647 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f839003a090 con 0x7f8384003a60 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 msgr2=0x7f839814eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f838400c270 tx=0x7f8390020000 comp rx=0 tx=0).stop 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 shutdown_connections 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83840052e0 0x7f83980c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8384003a60 0x7f839814eeb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 --2- 172.21.15.46:0/2675498647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8384004810 0x7f83980c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 >> 172.21.15.46:0/2675498647 conn(0x7f8398068e20 msgr2=0x7f8398151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 shutdown_connections 2023-10-07T08:58:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:20.227+0000 7f839eff0700 1 -- 172.21.15.46:0/2675498647 wait complete. 2023-10-07T08:58:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2023-10-07T08:58:20.241 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-07T08:58:20.241 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:20.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-07T08:58:20.267 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:20.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-07T08:58:20.333 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:20.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-07T08:58:20.397 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-07T08:58:20.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-07T08:58:20.462 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:20.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-07T08:58:20.486 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:20.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-07T08:58:20.552 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:20.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-07T08:58:20.616 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-07T08:58:20.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-07T08:58:20.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new f56cc423-ff67-41b9-bd9d-a86cd44b3af0 0 2023-10-07T08:58:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.837+0000 7f7f09d9c700 1 Processor -- start 2023-10-07T08:58:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.837+0000 7f7f09d9c700 1 -- start start 2023-10-07T08:58:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f09d9c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 0x7f7f0415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f09d9c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0415a160 con 0x7f7f0415db10 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f09d9c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040d13a0 con 0x7f7f04159890 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f09d9c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0415e140 con 0x7f7f04159c60 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 0x7f7f0415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f037fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7f04159890 0x7f7f0415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54664/0 (socket says 172.21.15.133:54664) 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f037fe700 1 -- 172.21.15.133:0/3340794663 learned_addr learned my addr 172.21.15.133:0/3340794663 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f027fc700 1 -- 172.21.15.133:0/3340794663 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992649273 0 0) 0x7f7f040d13a0 con 0x7f7f04159890 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f02ffd700 1 -- 172.21.15.133:0/3340794663 >> v1:172.21.15.133:6789/0 conn(0x7f7f04159890 legacy=0x7f7f0415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f02ffd700 1 -- 172.21.15.133:0/3340794663 >> v1:172.21.15.46:6789/0 conn(0x7f7f0415db10 legacy=0x7f7f04069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f02ffd700 1 -- 172.21.15.133:0/3340794663 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0415a3d0 con 0x7f7f04159c60 2023-10-07T08:58:20.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f02ffd700 1 --2- 172.21.15.133:0/3340794663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 0x7f7f0415d5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009910 tx=0x7f7eec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a2a3b6f2cd6fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f027fc700 1 -- 172.21.15.133:0/3340794663 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00b860 con 0x7f7f04159c60 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f027fc700 1 -- 172.21.15.133:0/3340794663 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00b9c0 con 0x7f7f04159c60 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.838+0000 7f7f027fc700 1 -- 172.21.15.133:0/3340794663 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00bd60 con 0x7f7f04159c60 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 -- 172.21.15.133:0/3340794663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 msgr2=0x7f7f0415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/3340794663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 0x7f7f0415d5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009910 tx=0x7f7eec0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 -- 172.21.15.133:0/3340794663 shutdown_connections 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/3340794663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f04159c60 0x7f7f0415d5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 -- 172.21.15.133:0/3340794663 >> 172.21.15.133:0/3340794663 conn(0x7f7f04068e20 msgr2=0x7f7f040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 -- 172.21.15.133:0/3340794663 shutdown_connections 2023-10-07T08:58:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.839+0000 7f7f09d9c700 1 -- 172.21.15.133:0/3340794663 wait complete. 2023-10-07T08:58:20.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.840+0000 7f7f09d9c700 1 Processor -- start 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.840+0000 7f7f09d9c700 1 -- start start 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04159890 0x7f7f040cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040cd390 con 0x7f7f04159890 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04152e30 con 0x7f7f04159c60 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f09d9c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040cb650 con 0x7f7f0415db10 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f03fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53368/0 (socket says 172.21.15.133:53368) 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f03fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35842/0 (socket says 172.21.15.133:35842) 2023-10-07T08:58:20.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 -- 172.21.15.133:0/932706257 learned_addr learned my addr 172.21.15.133:0/932706257 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f037fe700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04159890 0x7f7f040cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 -- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 msgr2=0x7f7f040b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 -- 172.21.15.133:0/932706257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04159890 msgr2=0x7f7f040cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04159890 0x7f7f040cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f02ffd700 1 -- 172.21.15.133:0/932706257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009420 con 0x7f7f04159c60 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.841+0000 7f7f03fff700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7f02ffd700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7eec013000 tx=0x7f7eec017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec01f070 con 0x7f7f04159c60 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec002f70 con 0x7f7f04159c60 2023-10-07T08:58:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec025420 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f040b4870 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040b4e30 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7eec023070 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.842+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7eec01a420 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.843+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0404c3c0 con 0x7f7f04159c60 2023-10-07T08:58:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.845+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7eec02a070 con 0x7f7f04159c60 2023-10-07T08:58:20.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.943+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f56cc423-ff67-41b9-bd9d-a86cd44b3af0", "id": 0} v 0) v1 -- 0x7f7f040cbec0 con 0x7f7f04159c60 2023-10-07T08:58:20.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.946+0000 7f7efb7fe700 1 -- 172.21.15.133:0/932706257 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f56cc423-ff67-41b9-bd9d-a86cd44b3af0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7eec015020 con 0x7f7f04159c60 2023-10-07T08:58:20.947 INFO:teuthology.orchestra.run.smithi133.stdout:0 2023-10-07T08:58:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 msgr2=0x7f7f04169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7eec013000 tx=0x7f7eec017000 comp rx=0 tx=0).stop 2023-10-07T08:58:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 shutdown_connections 2023-10-07T08:58:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f0415db10 0x7f7f040b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04159890 0x7f7f040cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 --2- 172.21.15.133:0/932706257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f04159c60 0x7f7f04169cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:20.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.947+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 >> 172.21.15.133:0/932706257 conn(0x7f7f04068e20 msgr2=0x7f7f041573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:20.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.948+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 shutdown_connections 2023-10-07T08:58:20.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:20.948+0000 7f7f09d9c700 1 -- 172.21.15.133:0/932706257 wait complete. 2023-10-07T08:58:20.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0286373a-6c70-4f10-b219-3f8d5e4fdd0e 1 2023-10-07T08:58:21.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 Processor -- start 2023-10-07T08:58:21.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 -- start start 2023-10-07T08:58:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8900159b10 0x7f89000cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f890015d730 0x7f890015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000c74b0 con 0x7f8900159ee0 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89000c8700 con 0x7f8900159b10 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.075+0000 7f8905bf2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89000c9070 con 0x7f890015d730 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f890015d730 0x7f890015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f890015d730 0x7f890015dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53384/0 (socket says 172.21.15.133:53384) 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 -- 172.21.15.133:0/1025980101 learned_addr learned my addr 172.21.15.133:0/1025980101 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88ff7fe700 1 --2- 172.21.15.133:0/1025980101 >> v2:172.21.15.46:3300/0 conn(0x7f8900159b10 0x7f89000cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 -- 172.21.15.133:0/1025980101 >> v2:172.21.15.46:3300/0 conn(0x7f8900159b10 msgr2=0x7f89000cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 --2- 172.21.15.133:0/1025980101 >> v2:172.21.15.46:3300/0 conn(0x7f8900159b10 0x7f89000cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 -- 172.21.15.133:0/1025980101 >> v1:172.21.15.46:6789/0 conn(0x7f8900159ee0 legacy=0x7f890015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 -- 172.21.15.133:0/1025980101 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890015e0e0 con 0x7f890015d730 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88feffd700 1 --2- 172.21.15.133:0/1025980101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015dba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f890006cce0 tx=0x7f88f0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edbf9ba7c62074f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88fe7fc700 1 -- 172.21.15.133:0/1025980101 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0009e70 con 0x7f890015d730 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88fe7fc700 1 -- 172.21.15.133:0/1025980101 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000b8f0 con 0x7f890015d730 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.076+0000 7f88fe7fc700 1 -- 172.21.15.133:0/1025980101 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000bc90 con 0x7f890015d730 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 -- 172.21.15.133:0/1025980101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 msgr2=0x7f890015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 --2- 172.21.15.133:0/1025980101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015dba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f890006cce0 tx=0x7f88f0009250 comp rx=0 tx=0).stop 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 -- 172.21.15.133:0/1025980101 shutdown_connections 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 --2- 172.21.15.133:0/1025980101 >> v2:172.21.15.46:3300/0 conn(0x7f8900159b10 0x7f89000cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 --2- 172.21.15.133:0/1025980101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015dba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 -- 172.21.15.133:0/1025980101 >> 172.21.15.133:0/1025980101 conn(0x7f89000c9870 msgr2=0x7f89000c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 -- 172.21.15.133:0/1025980101 shutdown_connections 2023-10-07T08:58:21.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.077+0000 7f8905bf2700 1 -- 172.21.15.133:0/1025980101 wait complete. 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.078+0000 7f8905bf2700 1 Processor -- start 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.078+0000 7f8905bf2700 1 -- start start 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 0x7f89000c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89000b28e0 con 0x7f8900159b10 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890015b300 con 0x7f890015d730 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f8905bf2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890015b5e0 con 0x7f8900159ee0 2023-10-07T08:58:21.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35854/0 (socket says 172.21.15.133:35854) 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53396/0 (socket says 172.21.15.133:53396) 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 -- 172.21.15.133:0/3157099877 learned_addr learned my addr 172.21.15.133:0/3157099877 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88ff7fe700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 0x7f89000c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 -- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 msgr2=0x7f890015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 -- 172.21.15.133:0/3157099877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 msgr2=0x7f89000c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 0x7f89000c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88feffd700 1 -- 172.21.15.133:0/3157099877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00094f0 con 0x7f8900159ee0 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88fffff700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.079+0000 7f88ff7fe700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 0x7f89000c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88feffd700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89000c91b0 tx=0x7f88f0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000bc70 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0024440 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890015b8c0 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00247c0 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89000c43f0 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f88f001a6a0 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.080+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f88f002d3f0 con 0x7f8900159ee0 2023-10-07T08:58:21.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.081+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8900067e50 con 0x7f8900159ee0 2023-10-07T08:58:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.083+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8900067e50 con 0x7f8900159ee0 2023-10-07T08:58:21.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.166+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0286373a-6c70-4f10-b219-3f8d5e4fdd0e", "id": 1} v 0) v1 -- 0x7f890004c3c0 con 0x7f8900159ee0 2023-10-07T08:58:21.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.168+0000 7f88f77fe700 1 -- 172.21.15.133:0/3157099877 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0286373a-6c70-4f10-b219-3f8d5e4fdd0e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88f0015020 con 0x7f8900159ee0 2023-10-07T08:58:21.169 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 msgr2=0x7f89000b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89000c91b0 tx=0x7f88f0017000 comp rx=0 tx=0).stop 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 shutdown_connections 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890015d730 0x7f890015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8900159b10 0x7f89000c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 --2- 172.21.15.133:0/3157099877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8900159ee0 0x7f89000b1e30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.169+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 >> 172.21.15.133:0/3157099877 conn(0x7f89000c9870 msgr2=0x7f890006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.170+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 shutdown_connections 2023-10-07T08:58:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.170+0000 7f8905bf2700 1 -- 172.21.15.133:0/3157099877 wait complete. 2023-10-07T08:58:21.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 7fb775db-f310-42c7-97c1-feab5e9067fe 2 2023-10-07T08:58:21.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.297+0000 7f80d23ab700 1 Processor -- start 2023-10-07T08:58:21.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.297+0000 7f80d23ab700 1 -- start start 2023-10-07T08:58:21.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d23ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80cc159c60 0x7f80cc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d23ab700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80cc15db10 0x7f80cc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d23ab700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc15a160 con 0x7f80cc159890 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d23ab700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc15df50 con 0x7f80cc159c60 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d23ab700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0d13a0 con 0x7f80cc15db10 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80cc15db10 0x7f80cc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80cc15db10 0x7f80cc069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53400/0 (socket says 172.21.15.133:53400) 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 -- 172.21.15.133:0/100975571 learned_addr learned my addr 172.21.15.133:0/100975571 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80cb7fe700 1 --2- 172.21.15.133:0/100975571 >> v2:172.21.15.46:3300/0 conn(0x7f80cc159c60 0x7f80cc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 -- 172.21.15.133:0/100975571 >> v2:172.21.15.46:3300/0 conn(0x7f80cc159c60 msgr2=0x7f80cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 --2- 172.21.15.133:0/100975571 >> v2:172.21.15.46:3300/0 conn(0x7f80cc159c60 0x7f80cc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 -- 172.21.15.133:0/100975571 >> v1:172.21.15.46:6789/0 conn(0x7f80cc159890 legacy=0x7f80cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 -- 172.21.15.133:0/100975571 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc15e140 con 0x7f80cc15db10 2023-10-07T08:58:21.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80d0948700 1 --2- 172.21.15.133:0/100975571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc15db10 0x7f80cc069560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06a890 tx=0x7f80c4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88837c0a3e7d5076 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80caffd700 1 -- 172.21.15.133:0/100975571 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400e070 con 0x7f80cc15db10 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.298+0000 7f80caffd700 1 -- 172.21.15.133:0/100975571 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400ba20 con 0x7f80cc15db10 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80caffd700 1 -- 172.21.15.133:0/100975571 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40092e0 con 0x7f80cc15db10 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 -- 172.21.15.133:0/100975571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc15db10 msgr2=0x7f80cc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 --2- 172.21.15.133:0/100975571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc15db10 0x7f80cc069560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06a890 tx=0x7f80c4009840 comp rx=0 tx=0).stop 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 -- 172.21.15.133:0/100975571 shutdown_connections 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 --2- 172.21.15.133:0/100975571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc15db10 0x7f80cc069560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 --2- 172.21.15.133:0/100975571 >> v2:172.21.15.46:3300/0 conn(0x7f80cc159c60 0x7f80cc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 -- 172.21.15.133:0/100975571 >> 172.21.15.133:0/100975571 conn(0x7f80cc068e20 msgr2=0x7f80cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 -- 172.21.15.133:0/100975571 shutdown_connections 2023-10-07T08:58:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.299+0000 7f80d23ab700 1 -- 172.21.15.133:0/100975571 wait complete. 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.300+0000 7f80d23ab700 1 Processor -- start 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 -- start start 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 0x7f80cc0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80cc15db10 0x7f80cc0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc169cc0 con 0x7f80cc15db10 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16a550 con 0x7f80cc159890 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80d23ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0cdd20 con 0x7f80cc159c60 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 0x7f80cc0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.301+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35868/0 (socket says 172.21.15.133:35868) 2023-10-07T08:58:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cb7fe700 1 -- 172.21.15.133:0/2321979251 learned_addr learned my addr 172.21.15.133:0/2321979251 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80d0948700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80cc15db10 0x7f80cc0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 -- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 msgr2=0x7f80cc0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 -- 172.21.15.133:0/2321979251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80cc15db10 msgr2=0x7f80cc0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80cc15db10 0x7f80cc0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 -- 172.21.15.133:0/2321979251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4009ae0 con 0x7f80cc159890 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cb7fe700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:21.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80cbfff700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 0x7f80cc0c6600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c590 tx=0x7f80c0007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0011590 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0011710 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc169f00 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0011ad0 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc153150 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f80c001c6c0 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.302+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f80c0012850 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.303+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc04c3c0 con 0x7f80cc159890 2023-10-07T08:58:21.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.305+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f80c0017070 con 0x7f80cc159890 2023-10-07T08:58:21.365 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:21.365+0000 7f4796283180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T08:58:21.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.389+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7fb775db-f310-42c7-97c1-feab5e9067fe", "id": 2} v 0) v1 -- 0x7f80cc064e70 con 0x7f80cc159890 2023-10-07T08:58:21.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.392+0000 7f80b3fff700 1 -- 172.21.15.133:0/2321979251 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fb775db-f310-42c7-97c1-feab5e9067fe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80c001cba0 con 0x7f80cc159890 2023-10-07T08:58:21.392 INFO:teuthology.orchestra.run.smithi133.stdout:2 2023-10-07T08:58:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 msgr2=0x7f80cc0c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 0x7f80cc0c6600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c590 tx=0x7f80c0007ec0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 shutdown_connections 2023-10-07T08:58:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80cc15db10 0x7f80cc0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80cc159890 0x7f80cc0c6600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 --2- 172.21.15.133:0/2321979251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80cc159c60 0x7f80cc0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 >> 172.21.15.133:0/2321979251 conn(0x7f80cc068e20 msgr2=0x7f80cc14d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 shutdown_connections 2023-10-07T08:58:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.393+0000 7f80d23ab700 1 -- 172.21.15.133:0/2321979251 wait complete. 2023-10-07T08:58:21.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0dcea128-967c-45b2-a95c-11e4f367e369 3 2023-10-07T08:58:21.503 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:21.503+0000 7f4796283180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T08:58:21.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.521+0000 7f03e8ab5700 1 Processor -- start 2023-10-07T08:58:21.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.521+0000 7f03e8ab5700 1 -- start start 2023-10-07T08:58:21.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e8ab5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03e40aca80 0x7f03e406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e8ab5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03e40c83c0 0x7f03e40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e8ab5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e406bdb0 con 0x7f03e4069d60 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e8ab5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e40cb370 con 0x7f03e40aca80 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e8ab5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e4159f60 con 0x7f03e40c83c0 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03e40c83c0 0x7f03e40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e1d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f03e4069d60 0x7f03e40c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54680/0 (socket says 172.21.15.133:54680) 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e1d9b700 1 -- 172.21.15.133:0/3019094956 learned_addr learned my addr 172.21.15.133:0/3019094956 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e259c700 1 --2- 172.21.15.133:0/3019094956 >> v2:172.21.15.46:3300/0 conn(0x7f03e40aca80 0x7f03e406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e159a700 1 -- 172.21.15.133:0/3019094956 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187879100 0 0) 0x7f03e406bdb0 con 0x7f03e4069d60 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e159a700 1 -- 172.21.15.133:0/3019094956 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc003570 con 0x7f03e4069d60 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 -- 172.21.15.133:0/3019094956 >> v2:172.21.15.46:3300/0 conn(0x7f03e40aca80 msgr2=0x7f03e406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 --2- 172.21.15.133:0/3019094956 >> v2:172.21.15.46:3300/0 conn(0x7f03e40aca80 0x7f03e406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 -- 172.21.15.133:0/3019094956 >> v1:172.21.15.133:6789/0 conn(0x7f03e4069d60 legacy=0x7f03e40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 -- 172.21.15.133:0/3019094956 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e406b510 con 0x7f03e40c83c0 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e2d9d700 1 --2- 172.21.15.133:0/3019094956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40c83c0 0x7f03e40cb800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03e40b0190 tx=0x7f03dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb73545353807bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e159a700 1 -- 172.21.15.133:0/3019094956 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00e070 con 0x7f03e40c83c0 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e159a700 1 -- 172.21.15.133:0/3019094956 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00bab0 con 0x7f03e40c83c0 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.522+0000 7f03e159a700 1 -- 172.21.15.133:0/3019094956 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00be70 con 0x7f03e40c83c0 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 -- 172.21.15.133:0/3019094956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40c83c0 msgr2=0x7f03e40cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/3019094956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40c83c0 0x7f03e40cb800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03e40b0190 tx=0x7f03dc009780 comp rx=0 tx=0).stop 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 -- 172.21.15.133:0/3019094956 shutdown_connections 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/3019094956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40c83c0 0x7f03e40cb800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/3019094956 >> v2:172.21.15.46:3300/0 conn(0x7f03e40aca80 0x7f03e406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 -- 172.21.15.133:0/3019094956 >> 172.21.15.133:0/3019094956 conn(0x7f03e40cd670 msgr2=0x7f03e40cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 -- 172.21.15.133:0/3019094956 shutdown_connections 2023-10-07T08:58:21.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.523+0000 7f03e8ab5700 1 -- 172.21.15.133:0/3019094956 wait complete. 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.524+0000 7f03e8ab5700 1 Processor -- start 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.524+0000 7f03e8ab5700 1 -- start start 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40aca80 0x7f03e40ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03e40c83c0 0x7f03e40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e415efe0 con 0x7f03e40c83c0 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e415e3d0 con 0x7f03e40aca80 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e8ab5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e415e6b0 con 0x7f03e4069d60 2023-10-07T08:58:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40aca80 0x7f03e40ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35874/0 (socket says 172.21.15.133:35874) 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 -- 172.21.15.133:0/976179539 learned_addr learned my addr 172.21.15.133:0/976179539 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e2d9d700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03e40c83c0 0x7f03e40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 -- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40aca80 msgr2=0x7f03e40ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40aca80 0x7f03e40ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 -- 172.21.15.133:0/976179539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03e40c83c0 msgr2=0x7f03e40b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03e40c83c0 0x7f03e40b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 -- 172.21.15.133:0/976179539 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009a20 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.525+0000 7f03e259c700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03d400ec80 tx=0x7f03d4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400c850 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400c9b0 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e415e990 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400cd30 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e4155a30 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f03d4013900 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.526+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f03d401ca30 con 0x7f03e4069d60 2023-10-07T08:58:21.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.527+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e415f2c0 con 0x7f03e4069d60 2023-10-07T08:58:21.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.529+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f03d403b6d0 con 0x7f03e4069d60 2023-10-07T08:58:21.582 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:21.582+0000 7f4796283180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T08:58:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.610+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0dcea128-967c-45b2-a95c-11e4f367e369", "id": 3} v 0) v1 -- 0x7f03e406dee0 con 0x7f03e4069d60 2023-10-07T08:58:21.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.618+0000 7f03d27fc700 1 -- 172.21.15.133:0/976179539 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0dcea128-967c-45b2-a95c-11e4f367e369", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03d402a030 con 0x7f03e4069d60 2023-10-07T08:58:21.619 INFO:teuthology.orchestra.run.smithi133.stdout:3 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.619+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 msgr2=0x7f03e415f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.619+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03d400ec80 tx=0x7f03d4009120 comp rx=0 tx=0).stop 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.619+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 shutdown_connections 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.619+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03e40c83c0 0x7f03e40b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.620+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03e4069d60 0x7f03e415f470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.620+0000 7f03e8ab5700 1 --2- 172.21.15.133:0/976179539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03e40aca80 0x7f03e40ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.620+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 >> 172.21.15.133:0/976179539 conn(0x7f03e40cd670 msgr2=0x7f03e406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.620+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 shutdown_connections 2023-10-07T08:58:21.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.620+0000 7f03e8ab5700 1 -- 172.21.15.133:0/976179539 wait complete. 2023-10-07T08:58:21.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new caae2971-c367-4899-ba56-194832b7f8fb 4 2023-10-07T08:58:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.748+0000 7f45a359e700 1 Processor -- start 2023-10-07T08:58:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.748+0000 7f45a359e700 1 -- start start 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45a41575a0 0x7f45a40cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a40b1100 con 0x7f45a4063580 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a40c3ae0 con 0x7f45a41575a0 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40cbe60 con 0x7f45a406eb80 2023-10-07T08:58:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35876/0 (socket says 172.21.15.133:35876) 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 -- 172.21.15.133:0/657907411 learned_addr learned my addr 172.21.15.133:0/657907411 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a259c700 1 --2- 172.21.15.133:0/657907411 >> v2:172.21.15.46:3300/0 conn(0x7f45a41575a0 0x7f45a40cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 -- 172.21.15.133:0/657907411 >> v2:172.21.15.46:3300/0 conn(0x7f45a41575a0 msgr2=0x7f45a40cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 --2- 172.21.15.133:0/657907411 >> v2:172.21.15.46:3300/0 conn(0x7f45a41575a0 0x7f45a40cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 -- 172.21.15.133:0/657907411 >> v1:172.21.15.46:6789/0 conn(0x7f45a4063580 legacy=0x7f45a406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.749+0000 7f45a2d9d700 1 -- 172.21.15.133:0/657907411 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40cc140 con 0x7f45a406eb80 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a2d9d700 1 --2- 172.21.15.133:0/657907411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f459c009f20 tx=0x7f459c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82be045c072aa83f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a159a700 1 -- 172.21.15.133:0/657907411 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00e070 con 0x7f45a406eb80 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a159a700 1 -- 172.21.15.133:0/657907411 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00b9d0 con 0x7f45a406eb80 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a159a700 1 -- 172.21.15.133:0/657907411 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0092e0 con 0x7f45a406eb80 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 -- 172.21.15.133:0/657907411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 msgr2=0x7f45a40b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 --2- 172.21.15.133:0/657907411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f459c009f20 tx=0x7f459c009840 comp rx=0 tx=0).stop 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 -- 172.21.15.133:0/657907411 shutdown_connections 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 --2- 172.21.15.133:0/657907411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a40b1590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 --2- 172.21.15.133:0/657907411 >> v2:172.21.15.46:3300/0 conn(0x7f45a41575a0 0x7f45a40cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 -- 172.21.15.133:0/657907411 >> 172.21.15.133:0/657907411 conn(0x7f45a40c9f70 msgr2=0x7f45a406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 -- 172.21.15.133:0/657907411 shutdown_connections 2023-10-07T08:58:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.750+0000 7f45a359e700 1 -- 172.21.15.133:0/657907411 wait complete. 2023-10-07T08:58:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 Processor -- start 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 -- start start 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a4154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a41575a0 0x7f45a4145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40ab440 con 0x7f45a41575a0 2023-10-07T08:58:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40c87b0 con 0x7f45a4063580 2023-10-07T08:58:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40aadf0 con 0x7f45a406eb80 2023-10-07T08:58:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53434/0 (socket says 172.21.15.133:53434) 2023-10-07T08:58:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a259c700 1 -- 172.21.15.133:0/3665973485 learned_addr learned my addr 172.21.15.133:0/3665973485 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a1d9b700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a4154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.752+0000 7f45a2d9d700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a41575a0 0x7f45a4145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 -- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 msgr2=0x7f45a40c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 -- 172.21.15.133:0/3665973485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a41575a0 msgr2=0x7f45a4145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a41575a0 0x7f45a4145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 -- 172.21.15.133:0/3665973485 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009ae0 con 0x7f45a406eb80 2023-10-07T08:58:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a259c700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a1d9b700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a4154960 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f459800c590 tx=0x7f4598007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598011590 con 0x7f45a406eb80 2023-10-07T08:58:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598011710 con 0x7f45a406eb80 2023-10-07T08:58:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a40ab0d0 con 0x7f45a406eb80 2023-10-07T08:58:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598011ad0 con 0x7f45a406eb80 2023-10-07T08:58:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a40aaa10 con 0x7f45a406eb80 2023-10-07T08:58:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f459801c6c0 con 0x7f45a406eb80 2023-10-07T08:58:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.753+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4598012420 con 0x7f45a406eb80 2023-10-07T08:58:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.754+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a40aac00 con 0x7f45a406eb80 2023-10-07T08:58:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.756+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4598017070 con 0x7f45a406eb80 2023-10-07T08:58:21.790 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:21.790+0000 7f4796283180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:58:21.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.856+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "caae2971-c367-4899-ba56-194832b7f8fb", "id": 4} v 0) v1 -- 0x7f45a40ab580 con 0x7f45a406eb80 2023-10-07T08:58:21.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.864+0000 7f45927fc700 1 -- 172.21.15.133:0/3665973485 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "caae2971-c367-4899-ba56-194832b7f8fb", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f459801c970 con 0x7f45a406eb80 2023-10-07T08:58:21.864 INFO:teuthology.orchestra.run.smithi133.stdout:4 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 msgr2=0x7f45a4154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a4154960 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f459800c590 tx=0x7f4598007ec0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 shutdown_connections 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a41575a0 0x7f45a4145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4063580 0x7f45a40c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 --2- 172.21.15.133:0/3665973485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45a406eb80 0x7f45a4154960 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 >> 172.21.15.133:0/3665973485 conn(0x7f45a40c9f70 msgr2=0x7f45a4150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 shutdown_connections 2023-10-07T08:58:21.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.865+0000 7f45a359e700 1 -- 172.21.15.133:0/3665973485 wait complete. 2023-10-07T08:58:21.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0f3b551a-d190-4c7b-8833-ccd5e4699884 5 2023-10-07T08:58:21.971 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:21.971+0000 7f4796283180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T08:58:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.993+0000 7ffb09808700 1 Processor -- start 2023-10-07T08:58:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.993+0000 7ffb09808700 1 -- start start 2023-10-07T08:58:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09808700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09808700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09808700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb040cfb00 con 0x7ffb040b16d0 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09808700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb040b5c40 con 0x7ffb040b1b40 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09808700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040b5f20 con 0x7ffb040b4e70 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09007700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09007700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53442/0 (socket says 172.21.15.133:53442) 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35882/0 (socket says 172.21.15.133:35882) 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09007700 1 -- 172.21.15.133:0/3338431431 learned_addr learned my addr 172.21.15.133:0/3338431431 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 -- 172.21.15.133:0/3338431431 >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 msgr2=0x7ffb0415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 --2- 172.21.15.133:0/3338431431 >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 -- 172.21.15.133:0/3338431431 >> v1:172.21.15.46:6789/0 conn(0x7ffb040b16d0 legacy=0x7ffb0415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 -- 172.21.15.133:0/3338431431 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040b6200 con 0x7ffb040b4e70 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb09007700 1 --2- 172.21.15.133:0/3338431431 >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.994+0000 7ffb08806700 1 --2- 172.21.15.133:0/3338431431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098e0 tx=0x7ffaf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22688ce3728c011 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb037fe700 1 -- 172.21.15.133:0/3338431431 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800b640 con 0x7ffb040b4e70 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb037fe700 1 -- 172.21.15.133:0/3338431431 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf800b7a0 con 0x7ffb040b4e70 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb037fe700 1 -- 172.21.15.133:0/3338431431 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800bb40 con 0x7ffb040b4e70 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 -- 172.21.15.133:0/3338431431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 msgr2=0x7ffb040ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 --2- 172.21.15.133:0/3338431431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098e0 tx=0x7ffaf80091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 -- 172.21.15.133:0/3338431431 shutdown_connections 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 --2- 172.21.15.133:0/3338431431 >> v2:172.21.15.133:3300/0 conn(0x7ffb040b1b40 0x7ffb0415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 --2- 172.21.15.133:0/3338431431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040ccff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 -- 172.21.15.133:0/3338431431 >> 172.21.15.133:0/3338431431 conn(0x7ffb040d10c0 msgr2=0x7ffb040affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 -- 172.21.15.133:0/3338431431 shutdown_connections 2023-10-07T08:58:21.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.995+0000 7ffb09808700 1 -- 172.21.15.133:0/3338431431 wait complete. 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.996+0000 7ffb09808700 1 Processor -- start 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.996+0000 7ffb09808700 1 -- start start 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb040b16d0 0x7ffb040c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 0x7ffb0416a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0416aee0 con 0x7ffb040b16d0 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c7bc0 con 0x7ffb040b1b40 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09808700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c7ea0 con 0x7ffb040b4e70 2023-10-07T08:58:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb03fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 0x7ffb0416a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09007700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09007700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:35892/0 (socket says 172.21.15.133:35892) 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb03fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 0x7ffb0416a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53452/0 (socket says 172.21.15.133:53452) 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb09007700 1 -- 172.21.15.133:0/1674961812 learned_addr learned my addr 172.21.15.133:0/1674961812 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.997+0000 7ffb08806700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb040b16d0 0x7ffb040c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 -- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 msgr2=0x7ffb0416a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 0x7ffb0416a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 -- 172.21.15.133:0/1674961812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb040b16d0 msgr2=0x7ffb040c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb040b16d0 0x7ffb040c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 -- 172.21.15.133:0/1674961812 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009ae0 con 0x7ffb040b4e70 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09007700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009fd0 tx=0x7ffafc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc018070 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00f040 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf8009420 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00cbd0 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb040c8460 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ffafc003020 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.998+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7ffafc01d410 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:21.999+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb04088990 con 0x7ffb040b4e70 2023-10-07T08:58:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.001+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ffafc023060 con 0x7ffb040b4e70 2023-10-07T08:58:22.052 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:22.052+0000 7f4796283180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T08:58:22.083 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.081+0000 7f8be2e7a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T08:58:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.083+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f3b551a-d190-4c7b-8833-ccd5e4699884", "id": 5} v 0) v1 -- 0x7ffb0404bb80 con 0x7ffb040b4e70 2023-10-07T08:58:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.091+0000 7ffb00ff9700 1 -- 172.21.15.133:0/1674961812 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f3b551a-d190-4c7b-8833-ccd5e4699884", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffafc02c0b0 con 0x7ffb040b4e70 2023-10-07T08:58:22.091 INFO:teuthology.orchestra.run.smithi133.stdout:5 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 msgr2=0x7ffb040af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009fd0 tx=0x7ffafc00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 shutdown_connections 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb040b4e70 0x7ffb040af340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb040b16d0 0x7ffb040c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 --2- 172.21.15.133:0/1674961812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb040b1b40 0x7ffb0416a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 >> 172.21.15.133:0/1674961812 conn(0x7ffb040d10c0 msgr2=0x7ffb04068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 shutdown_connections 2023-10-07T08:58:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.092+0000 7ffb09808700 1 -- 172.21.15.133:0/1674961812 wait complete. 2023-10-07T08:58:22.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 34e8988a-6aba-4aba-b0d8-b8f660de39b6 6 2023-10-07T08:58:22.194 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:22.194+0000 7f4796283180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T08:58:22.221 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.220+0000 7f8be2e7a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T08:58:22.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.221+0000 7f5504c84700 1 Processor -- start 2023-10-07T08:58:22.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.221+0000 7f5504c84700 1 -- start start 2023-10-07T08:58:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f5504c84700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5500069560 0x7f55000699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f5504c84700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5500069ee0 con 0x7f5500159890 2023-10-07T08:58:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f5504c84700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550015a160 con 0x7f5500159c60 2023-10-07T08:58:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f5504c84700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000d13a0 con 0x7f5500069560 2023-10-07T08:58:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f54fdd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5500159c60 0x7f550015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54696/0 (socket says 172.21.15.133:54696) 2023-10-07T08:58:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f54fdd9b700 1 -- 172.21.15.133:0/439356192 learned_addr learned my addr 172.21.15.133:0/439356192 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.222+0000 7f54fed9d700 1 --2- 172.21.15.133:0/439356192 >> v2:172.21.15.46:3300/0 conn(0x7f5500069560 0x7f55000699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039100955 0 0) 0x7f550015a160 con 0x7f5500159c60 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e8003570 con 0x7f5500159c60 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576887656 0 0) 0x7f5500069ee0 con 0x7f5500159890 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f550015a160 con 0x7f5500159890 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fed9d700 1 -- 172.21.15.133:0/439356192 >> v1:172.21.15.133:6789/0 conn(0x7f5500159c60 legacy=0x7f550015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fed9d700 1 -- 172.21.15.133:0/439356192 >> v1:172.21.15.46:6789/0 conn(0x7f5500159890 legacy=0x7f550015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fed9d700 1 -- 172.21.15.133:0/439356192 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550015e140 con 0x7f5500069560 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fed9d700 1 --2- 172.21.15.133:0/439356192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000699a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009e60 tx=0x7f54f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2e4d1074d27c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800e070 con 0x7f5500069560 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f800bab0 con 0x7f5500069560 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.223+0000 7f54fd59a700 1 -- 172.21.15.133:0/439356192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800be70 con 0x7f5500069560 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 -- 172.21.15.133:0/439356192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 msgr2=0x7f55000699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 --2- 172.21.15.133:0/439356192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000699a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009e60 tx=0x7f54f8009780 comp rx=0 tx=0).stop 2023-10-07T08:58:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 -- 172.21.15.133:0/439356192 shutdown_connections 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 --2- 172.21.15.133:0/439356192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000699a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 -- 172.21.15.133:0/439356192 >> 172.21.15.133:0/439356192 conn(0x7f5500068e20 msgr2=0x7f55000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 -- 172.21.15.133:0/439356192 shutdown_connections 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.224+0000 7f5504c84700 1 -- 172.21.15.133:0/439356192 wait complete. 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.225+0000 7f5504c84700 1 Processor -- start 2023-10-07T08:58:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.225+0000 7f5504c84700 1 -- start start 2023-10-07T08:58:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5500159c60 0x7f55000b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000cdbe0 con 0x7f5500069560 2023-10-07T08:58:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000cde80 con 0x7f5500159890 2023-10-07T08:58:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f5504c84700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000ce160 con 0x7f5500159c60 2023-10-07T08:58:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fed9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5500159c60 0x7f55000b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53466/0 (socket says 172.21.15.133:53466) 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fdd9b700 1 -- 172.21.15.133:0/695995652 learned_addr learned my addr 172.21.15.133:0/695995652 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 -- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5500159c60 msgr2=0x7f55000b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5500159c60 0x7f55000b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 -- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 msgr2=0x7f5500155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 -- 172.21.15.133:0/695995652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009a20 con 0x7f5500069560 2023-10-07T08:58:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fdd9b700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54fe59c700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000c78a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c560 tx=0x7f54f4007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.226+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4011590 con 0x7f5500069560 2023-10-07T08:58:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40116f0 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000b3ee0 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4011ab0 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5500155940 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f54f401c460 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.227+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f54f4012420 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.228+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550004c3c0 con 0x7f5500069560 2023-10-07T08:58:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.230+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f54f401c710 con 0x7f5500069560 2023-10-07T08:58:22.294 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:22.294+0000 7f4796283180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T08:58:22.300 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.298+0000 7f8be2e7a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T08:58:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.313+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34e8988a-6aba-4aba-b0d8-b8f660de39b6", "id": 6} v 0) v1 -- 0x7f55000b4380 con 0x7f5500069560 2023-10-07T08:58:22.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.315+0000 7f54ee7fc700 1 -- 172.21.15.133:0/695995652 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34e8988a-6aba-4aba-b0d8-b8f660de39b6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54f401c8b0 con 0x7f5500069560 2023-10-07T08:58:22.315 INFO:teuthology.orchestra.run.smithi133.stdout:6 2023-10-07T08:58:22.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 msgr2=0x7f55000c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000c78a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c560 tx=0x7f54f4007d50 comp rx=0 tx=0).stop 2023-10-07T08:58:22.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 shutdown_connections 2023-10-07T08:58:22.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5500159c60 0x7f55000b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5500069560 0x7f55000c78a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 --2- 172.21.15.133:0/695995652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5500159890 0x7f5500155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 >> 172.21.15.133:0/695995652 conn(0x7f5500068e20 msgr2=0x7f5500158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 shutdown_connections 2023-10-07T08:58:22.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.316+0000 7f5504c84700 1 -- 172.21.15.133:0/695995652 wait complete. 2023-10-07T08:58:22.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 777ffe16-a7f3-4f7e-94b6-09d1014bc1a9 7 2023-10-07T08:58:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.442+0000 7f16f222c700 1 Processor -- start 2023-10-07T08:58:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.442+0000 7f16f222c700 1 -- start start 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16f222c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16ec069560 0x7f16ec0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16f222c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec069ee0 con 0x7f16ec159890 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16f222c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec15a160 con 0x7f16ec159c60 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16f222c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0d13a0 con 0x7f16ec069560 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16ebfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16ec069560 0x7f16ec0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16eaffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16ec159c60 0x7f16ec15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54710/0 (socket says 172.21.15.133:54710) 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.443+0000 7f16eaffd700 1 -- 172.21.15.133:0/673006058 learned_addr learned my addr 172.21.15.133:0/673006058 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-07T08:58:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ebfff700 1 -- 172.21.15.133:0/673006058 >> v1:172.21.15.133:6789/0 conn(0x7f16ec159c60 legacy=0x7f16ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ebfff700 1 -- 172.21.15.133:0/673006058 >> v1:172.21.15.46:6789/0 conn(0x7f16ec159890 legacy=0x7f16ec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ebfff700 1 -- 172.21.15.133:0/673006058 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec15e140 con 0x7f16ec069560 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ebfff700 1 --2- 172.21.15.133:0/673006058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec069560 0x7f16ec0699a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009e60 tx=0x7f16e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8eb52387f2482d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ea7fc700 1 -- 172.21.15.133:0/673006058 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400e070 con 0x7f16ec069560 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ea7fc700 1 -- 172.21.15.133:0/673006058 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e400bc30 con 0x7f16ec069560 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16ea7fc700 1 -- 172.21.15.133:0/673006058 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4012430 con 0x7f16ec069560 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 -- 172.21.15.133:0/673006058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec069560 msgr2=0x7f16ec0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 --2- 172.21.15.133:0/673006058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec069560 0x7f16ec0699a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009e60 tx=0x7f16e4009780 comp rx=0 tx=0).stop 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 -- 172.21.15.133:0/673006058 shutdown_connections 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 --2- 172.21.15.133:0/673006058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec069560 0x7f16ec0699a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 -- 172.21.15.133:0/673006058 >> 172.21.15.133:0/673006058 conn(0x7f16ec068e20 msgr2=0x7f16ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 -- 172.21.15.133:0/673006058 shutdown_connections 2023-10-07T08:58:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.444+0000 7f16f222c700 1 -- 172.21.15.133:0/673006058 wait complete. 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 Processor -- start 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 -- start start 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16ec069560 0x7f16ec0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 0x7f16ec15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0cd3b0 con 0x7f16ec069560 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0cd690 con 0x7f16ec159c60 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16f222c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec15c6f0 con 0x7f16ec159890 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.446+0000 7f16ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53478/0 (socket says 172.21.15.133:53478) 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 0x7f16ec15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16ebfff700 1 -- 172.21.15.133:0/3829153568 learned_addr learned my addr 172.21.15.133:0/3829153568 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eb7fe700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16ec069560 0x7f16ec0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 -- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 msgr2=0x7f16ec0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 -- 172.21.15.133:0/3829153568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16ec069560 msgr2=0x7f16ec0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16ec069560 0x7f16ec0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 -- 172.21.15.133:0/3829153568 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009a20 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16ebfff700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16eaffd700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 0x7f16ec15be90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c4d0 tx=0x7f16e0007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000ce40 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0005b30 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00070d0 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec15c9d0 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec15c3d0 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f16e001c440 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.447+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f16e0007700 con 0x7f16ec159890 2023-10-07T08:58:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.448+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec04c3c0 con 0x7f16ec159890 2023-10-07T08:58:22.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.450+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f16e0017070 con 0x7f16ec159890 2023-10-07T08:58:22.492 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.490+0000 7f8be2e7a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:58:22.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.532+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "777ffe16-a7f3-4f7e-94b6-09d1014bc1a9", "id": 7} v 0) v1 -- 0x7f16ec0cd7d0 con 0x7f16ec159890 2023-10-07T08:58:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.540+0000 7f16d37fe700 1 -- 172.21.15.133:0/3829153568 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "777ffe16-a7f3-4f7e-94b6-09d1014bc1a9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16e001c920 con 0x7f16ec159890 2023-10-07T08:58:22.541 INFO:teuthology.orchestra.run.smithi133.stdout:7 2023-10-07T08:58:22.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 msgr2=0x7f16ec15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 0x7f16ec15be90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c4d0 tx=0x7f16e0007f10 comp rx=0 tx=0).stop 2023-10-07T08:58:22.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 shutdown_connections 2023-10-07T08:58:22.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec159c60 0x7f16ec0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16ec069560 0x7f16ec0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 --2- 172.21.15.133:0/3829153568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16ec159890 0x7f16ec15be90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 >> 172.21.15.133:0/3829153568 conn(0x7f16ec068e20 msgr2=0x7f16ec152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 shutdown_connections 2023-10-07T08:58:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-07T08:58:22.541+0000 7f16f222c700 1 -- 172.21.15.133:0/3829153568 wait complete. 2023-10-07T08:58:22.553 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-07T08:58:22.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-07T08:58:22.556 INFO:tasks.ceph.osd.0:Started 2023-10-07T08:58:22.556 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-07T08:58:22.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-07T08:58:22.558 INFO:tasks.ceph.osd.1:Started 2023-10-07T08:58:22.558 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-07T08:58:22.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-07T08:58:22.560 INFO:tasks.ceph.osd.2:Started 2023-10-07T08:58:22.560 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-07T08:58:22.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-07T08:58:22.562 INFO:tasks.ceph.osd.3:Started 2023-10-07T08:58:22.563 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-07T08:58:22.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-07T08:58:22.566 INFO:tasks.ceph.osd.4:Started 2023-10-07T08:58:22.566 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-07T08:58:22.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-07T08:58:22.568 INFO:tasks.ceph.osd.5:Started 2023-10-07T08:58:22.568 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-07T08:58:22.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-07T08:58:22.570 INFO:tasks.ceph.osd.6:Started 2023-10-07T08:58:22.570 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-07T08:58:22.571 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-07T08:58:22.572 INFO:tasks.ceph.osd.7:Started 2023-10-07T08:58:22.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:22.712 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.710+0000 7f8be2e7a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T08:58:22.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.719+0000 7f33a5876700 1 Processor -- start 2023-10-07T08:58:22.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.719+0000 7f33a5876700 1 -- start start 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5876700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33a0157380 0x7f33a0157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5876700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00c6b30 0x7f33a015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5876700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a015c110 con 0x7f33a00ae840 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5876700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a006ea60 con 0x7f33a0157380 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5876700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a006ed40 con 0x7f33a00c6b30 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a4874700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33a0157380 0x7f33a0157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5075700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f33a00ae840 0x7f33a00aec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55182/0 (socket says 172.21.15.46:55182) 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a5075700 1 -- 172.21.15.46:0/2204869753 learned_addr learned my addr 172.21.15.46:0/2204869753 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f339ffff700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00c6b30 0x7f33a015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a4874700 1 -- 172.21.15.46:0/2204869753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00c6b30 msgr2=0x7f33a015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a4874700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00c6b30 0x7f33a015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a4874700 1 -- 172.21.15.46:0/2204869753 >> v1:172.21.15.46:6789/0 conn(0x7f33a00ae840 legacy=0x7f33a00aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f339f7fe700 1 -- 172.21.15.46:0/2204869753 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149129943 0 0) 0x7f33a015c110 con 0x7f33a00ae840 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.720+0000 7f33a4874700 1 -- 172.21.15.46:0/2204869753 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00afe60 con 0x7f33a0157380 2023-10-07T08:58:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a4874700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a0157380 0x7f33a0157750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33940098e0 tx=0x7f33940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d0f33f90e17e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f339f7fe700 1 -- 172.21.15.46:0/2204869753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400b640 con 0x7f33a0157380 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f339f7fe700 1 -- 172.21.15.46:0/2204869753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339400b7a0 con 0x7f33a0157380 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f339f7fe700 1 -- 172.21.15.46:0/2204869753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400bb40 con 0x7f33a0157380 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 -- 172.21.15.46:0/2204869753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a0157380 msgr2=0x7f33a0157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a0157380 0x7f33a0157750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33940098e0 tx=0x7f33940091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 -- 172.21.15.46:0/2204869753 shutdown_connections 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a0157380 0x7f33a0157750 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 --2- 172.21.15.46:0/2204869753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00c6b30 0x7f33a015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 -- 172.21.15.46:0/2204869753 >> 172.21.15.46:0/2204869753 conn(0x7f33a006ddb0 msgr2=0x7f33a006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.721+0000 7f33a5876700 1 -- 172.21.15.46:0/2204869753 shutdown_connections 2023-10-07T08:58:22.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.722+0000 7f33a5876700 1 -- 172.21.15.46:0/2204869753 wait complete. 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 Processor -- start 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 -- start start 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00ae840 0x7f33a00c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33a0157380 0x7f33a014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:22.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a014d0f0 con 0x7f33a00c6b30 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a014de60 con 0x7f33a0157380 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.723+0000 7f33a5876700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a014db20 con 0x7f33a00ae840 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51004/0 (socket says 172.21.15.46:51004) 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 -- 172.21.15.46:0/3966042310 learned_addr learned my addr 172.21.15.46:0/3966042310 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f33a4874700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00ae840 0x7f33a00c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f33a5075700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33a0157380 0x7f33a014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 -- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00ae840 msgr2=0x7f33a00c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00ae840 0x7f33a00c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 -- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33a0157380 msgr2=0x7f33a014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33a0157380 0x7f33a014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 -- 172.21.15.46:0/3966042310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394009420 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339ffff700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f338c00ec50 tx=0x7f338c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00c850 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00c9b0 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01528b0 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00cd70 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a014e100 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f338c005c80 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.724+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f338c006700 con 0x7f33a00c6b30 2023-10-07T08:58:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.725+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a014e2f0 con 0x7f33a00c6b30 2023-10-07T08:58:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.727+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f338c021060 con 0x7f33a00c6b30 2023-10-07T08:58:22.795 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.793+0000 7f8be2e7a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T08:58:22.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.798+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33a004c3c0 con 0x7f33a00c6b30 2023-10-07T08:58:22.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.799+0000 7f339cff9700 1 -- 172.21.15.46:0/3966042310 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f338c029020 con 0x7f33a00c6b30 2023-10-07T08:58:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:22.801 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:22.533842+0000","last_up_change":"0.000000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:22.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 msgr2=0x7f33a016a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f338c00ec50 tx=0x7f338c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 shutdown_connections 2023-10-07T08:58:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33a0157380 0x7f33a014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33a00ae840 0x7f33a00c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 --2- 172.21.15.46:0/3966042310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33a00c6b30 0x7f33a016a4d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 >> 172.21.15.46:0/3966042310 conn(0x7f33a006ddb0 msgr2=0x7f33a00aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 shutdown_connections 2023-10-07T08:58:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:22.800+0000 7f33a5876700 1 -- 172.21.15.46:0/3966042310 wait complete. 2023-10-07T08:58:22.814 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-07T08:58:22.814 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-07T08:58:22.850 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:22.850+0000 7f4796283180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T08:58:22.928 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:22.928+0000 7f4796283180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T08:58:22.934 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:22.932+0000 7f8be2e7a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T08:58:23.006 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:23.006+0000 7f4796283180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T08:58:23.033 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:23.032+0000 7f8be2e7a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T08:58:23.159 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-10-07T08:58:23.159+0000 7fa323085540 -1 Falling back to public interface 2023-10-07T08:58:23.164 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-10-07T08:58:23.164+0000 7fcc2e22d540 -1 Falling back to public interface 2023-10-07T08:58:23.166 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-10-07T08:58:23.164+0000 7fac4e3e6540 -1 Falling back to public interface 2023-10-07T08:58:23.169 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-10-07T08:58:23.167+0000 7fb09c2d5540 -1 Falling back to public interface 2023-10-07T08:58:23.173 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-10-07T08:58:23.171+0000 7f18fd275540 -1 Falling back to public interface 2023-10-07T08:58:23.181 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-10-07T08:58:23.179+0000 7f5627a29540 -1 Falling back to public interface 2023-10-07T08:58:23.188 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-10-07T08:58:23.188+0000 7fc855995540 -1 Falling back to public interface 2023-10-07T08:58:23.189 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-10-07T08:58:23.188+0000 7fa3aa551540 -1 Falling back to public interface 2023-10-07T08:58:23.574 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:23.572+0000 7f8be2e7a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T08:58:23.592 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:23.592+0000 7f4796283180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T08:58:23.619 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:23.655 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:23.654+0000 7f8be2e7a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T08:58:23.730 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:23.730+0000 7f4796283180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:58:23.730 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 Processor -- start 2023-10-07T08:58:23.731 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 -- start start 2023-10-07T08:58:23.732 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56e0157960 0x7f56e00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00cdf90 con 0x7f56e00cb850 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00b11b0 con 0x7f56e00cccd0 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.729+0000 7f56e60f4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00cd170 con 0x7f56e0157960 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56e0157960 0x7f56e00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56e0157960 0x7f56e00cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51016/0 (socket says 172.21.15.46:51016) 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56dffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f56e00cb850 0x7f56e00ae190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55186/0 (socket says 172.21.15.46:55186) 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 -- 172.21.15.46:0/4089207533 learned_addr learned my addr 172.21.15.46:0/4089207533 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 -- 172.21.15.46:0/4089207533 >> v1:172.21.15.133:6789/0 conn(0x7f56e00cccd0 legacy=0x7f56e00cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 -- 172.21.15.46:0/4089207533 >> v1:172.21.15.46:6789/0 conn(0x7f56e00cb850 legacy=0x7f56e00ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.733 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 -- 172.21.15.46:0/4089207533 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00cd380 con 0x7f56e0157960 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56de7fc700 1 -- 172.21.15.46:0/4089207533 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920382675 0 0) 0x7f56e00cdf90 con 0x7f56e00cb850 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56df7fe700 1 --2- 172.21.15.46:0/4089207533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e0157960 0x7f56e00cc790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009f20 tx=0x7f56d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1556455ed0700200 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56de7fc700 1 -- 172.21.15.46:0/4089207533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000e070 con 0x7f56e0157960 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56de7fc700 1 -- 172.21.15.46:0/4089207533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000ba80 con 0x7f56e0157960 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.730+0000 7f56de7fc700 1 -- 172.21.15.46:0/4089207533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00092e0 con 0x7f56e0157960 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 -- 172.21.15.46:0/4089207533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e0157960 msgr2=0x7f56e00cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 --2- 172.21.15.46:0/4089207533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e0157960 0x7f56e00cc790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009f20 tx=0x7f56d0009840 comp rx=0 tx=0).stop 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 -- 172.21.15.46:0/4089207533 shutdown_connections 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 --2- 172.21.15.46:0/4089207533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e0157960 0x7f56e00cc790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 -- 172.21.15.46:0/4089207533 >> 172.21.15.46:0/4089207533 conn(0x7f56e00681a0 msgr2=0x7f56e00685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:23.734 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 -- 172.21.15.46:0/4089207533 shutdown_connections 2023-10-07T08:58:23.735 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.731+0000 7f56e60f4700 1 -- 172.21.15.46:0/4089207533 wait complete. 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.732+0000 7f56e60f4700 1 Processor -- start 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.732+0000 7f56e60f4700 1 -- start start 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e00cccd0 0x7f56e0151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e0157960 0x7f56e00cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e006e360 con 0x7f56e00cb850 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e006e640 con 0x7f56e00cccd0 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56e60f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e006e920 con 0x7f56e0157960 2023-10-07T08:58:23.738 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51028/0 (socket says 172.21.15.46:51028) 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 -- 172.21.15.46:0/345191115 learned_addr learned my addr 172.21.15.46:0/345191115 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56dffff700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e0157960 0x7f56e00cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56deffd700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e00cccd0 0x7f56e0151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 -- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e0157960 msgr2=0x7f56e00cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e0157960 0x7f56e00cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 -- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e00cccd0 msgr2=0x7f56e0151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e00cccd0 0x7f56e0151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 -- 172.21.15.46:0/345191115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009ae0 con 0x7f56e00cb850 2023-10-07T08:58:23.739 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.733+0000 7f56df7fe700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009ab0 tx=0x7f56d0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:23.740 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0007a70 con 0x7f56e00cb850 2023-10-07T08:58:23.740 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0007bf0 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e006ec00 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0026460 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e006f940 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f56d0026850 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.734+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f56d001db00 con 0x7f56e00cb850 2023-10-07T08:58:23.741 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.735+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e006f0a0 con 0x7f56e00cb850 2023-10-07T08:58:23.742 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.737+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f56d0021070 con 0x7f56e00cb850 2023-10-07T08:58:23.742 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:23.737+0000 7f8be2e7a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T08:58:23.809 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.807+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e00cd660 con 0x7f56e00cb850 2023-10-07T08:58:23.810 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.808+0000 7f56d77fe700 1 -- 172.21.15.46:0/345191115 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f56d001dd60 con 0x7f56e00cb850 2023-10-07T08:58:23.810 INFO:teuthology.misc.health.smithi046.stdout: 2023-10-07T08:58:23.810 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:22.533842+0000","last_up_change":"0.000000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:23.811 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.808+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 msgr2=0x7f56e006f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:23.811 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.808+0000 7f56e60f4700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009ab0 tx=0x7f56d0018000 comp rx=0 tx=0).stop 2023-10-07T08:58:23.811 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 shutdown_connections 2023-10-07T08:58:23.811 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e0157960 0x7f56e00cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.811 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56e00cb850 0x7f56e006f400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.812 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 --2- 172.21.15.46:0/345191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e00cccd0 0x7f56e0151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:23.812 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 >> 172.21.15.46:0/345191115 conn(0x7f56e00681a0 msgr2=0x7f56e006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:23.812 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 shutdown_connections 2023-10-07T08:58:23.812 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:23.809+0000 7f56e60f4700 1 -- 172.21.15.46:0/345191115 wait complete. 2023-10-07T08:58:23.821 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-07T08:58:23.821 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:23.821+0000 7f4796283180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T08:58:24.071 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:24.071+0000 7f4796283180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T08:58:24.149 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:24.149+0000 7f4796283180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T08:58:24.348 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:24.347+0000 7f8be2e7a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T08:58:24.491 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:24.490+0000 7f8be2e7a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:58:24.589 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:24.588+0000 7f8be2e7a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T08:58:24.846 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:24.845+0000 7f8be2e7a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T08:58:24.927 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:24.925+0000 7f8be2e7a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T08:58:24.976 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:24.976+0000 7f4796283180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T08:58:25.049 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.049+0000 7f4796283180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T08:58:25.124 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.124+0000 7f4796283180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T08:58:25.254 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.254+0000 7f4796283180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T08:58:25.339 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.339+0000 7f4796283180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T08:58:25.493 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.493+0000 7f4796283180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T08:58:25.568 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.568+0000 7f4796283180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T08:58:25.648 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.648+0000 7f4796283180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T08:58:25.737 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:25.736+0000 7f4796283180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T08:58:25.792 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:25.790+0000 7f8be2e7a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T08:58:25.869 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:25.867+0000 7f8be2e7a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T08:58:25.957 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:25.955+0000 7f8be2e7a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T08:58:26.137 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.135+0000 7f8be2e7a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T08:58:26.224 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.223+0000 7f8be2e7a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T08:58:26.382 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.380+0000 7f8be2e7a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T08:58:26.435 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-10-07T08:58:26.435+0000 7fc855995540 -1 osd.5 0 log_to_monitors true 2023-10-07T08:58:26.469 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.467+0000 7f8be2e7a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T08:58:26.546 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.544+0000 7f8be2e7a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T08:58:26.624 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-10-07T08:58:26.622+0000 7f8be2e7a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T08:58:26.638 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-10-07T08:58:26.638+0000 7fa323085540 -1 osd.4 0 log_to_monitors true 2023-10-07T08:58:26.675 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-10-07T08:58:26.675+0000 7fcc2e22d540 -1 osd.6 0 log_to_monitors true 2023-10-07T08:58:26.686 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-10-07T08:58:26.684+0000 7fa3aa551540 -1 osd.7 0 log_to_monitors true 2023-10-07T08:58:26.687 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-10-07T08:58:26.685+0000 7fb09c2d5540 -1 osd.0 0 log_to_monitors true 2023-10-07T08:58:26.716 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-10-07T08:58:26.714+0000 7fac4e3e6540 -1 osd.3 0 log_to_monitors true 2023-10-07T08:58:26.716 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-10-07T08:58:26.714+0000 7f5627a29540 -1 osd.2 0 log_to_monitors true 2023-10-07T08:58:26.717 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-10-07T08:58:26.715+0000 7f18fd275540 -1 osd.1 0 log_to_monitors true 2023-10-07T08:58:26.763 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:26.763+0000 7f474f684700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-07T08:58:26.763 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T08:58:26.763+0000 7f474f684700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-07T08:58:29.217 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-10-07T08:58:29.215+0000 7f18f3e97700 -1 osd.1 0 waiting for initial osdmap 2023-10-07T08:58:29.222 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-10-07T08:58:29.221+0000 7f18ecc8e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.253 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-10-07T08:58:29.252+0000 7fac45008700 -1 osd.3 0 waiting for initial osdmap 2023-10-07T08:58:29.258 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-10-07T08:58:29.256+0000 7fac3ddff700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.279 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-10-07T08:58:29.277+0000 7fb092ef7700 -1 osd.0 0 waiting for initial osdmap 2023-10-07T08:58:29.282 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-10-07T08:58:29.281+0000 7fb08bcee700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.294 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-10-07T08:58:29.292+0000 7f561e64b700 -1 osd.2 0 waiting for initial osdmap 2023-10-07T08:58:29.298 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-10-07T08:58:29.296+0000 7f5617442700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.782 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-10-07T08:58:29.781+0000 7fa319ca7700 -1 osd.4 0 waiting for initial osdmap 2023-10-07T08:58:29.789 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-10-07T08:58:29.787+0000 7fa312a9e700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.796 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-10-07T08:58:29.795+0000 7fc84c5b7700 -1 osd.5 0 waiting for initial osdmap 2023-10-07T08:58:29.802 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-10-07T08:58:29.800+0000 7fc8453ae700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.867 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-10-07T08:58:29.865+0000 7fcc24e4f700 -1 osd.6 0 waiting for initial osdmap 2023-10-07T08:58:29.871 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-10-07T08:58:29.870+0000 7fcc1dc46700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:29.943 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-10-07T08:58:29.941+0000 7fa3a1173700 -1 osd.7 0 waiting for initial osdmap 2023-10-07T08:58:29.946 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-10-07T08:58:29.945+0000 7fa399f6a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:58:30.628 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:30.750 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.749+0000 7f42a4f36700 1 Processor -- start 2023-10-07T08:58:30.751 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.749+0000 7f42a4f36700 1 -- start start 2023-10-07T08:58:30.752 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f42a4f36700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42a00af350 0x7f42a00ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.752 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f42a4f36700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42a00ad420 0x7f42a00b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f42a4f36700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00ae560 con 0x7f42a00af720 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f42a4f36700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00ad950 con 0x7f42a00af350 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f42a4f36700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00adc30 con 0x7f42a00ad420 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42a00af350 0x7f42a00ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f42a00af720 0x7f42a00afb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48632/0 (socket says 172.21.15.46:48632) 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429ed9d700 1 -- 172.21.15.46:0/479735118 learned_addr learned my addr 172.21.15.46:0/479735118 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429dd9b700 1 --2- 172.21.15.46:0/479735118 >> v2:172.21.15.133:3300/0 conn(0x7f42a00ad420 0x7f42a00b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429e59c700 1 -- 172.21.15.46:0/479735118 >> v2:172.21.15.133:3300/0 conn(0x7f42a00ad420 msgr2=0x7f42a00b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429e59c700 1 --2- 172.21.15.46:0/479735118 >> v2:172.21.15.133:3300/0 conn(0x7f42a00ad420 0x7f42a00b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429e59c700 1 -- 172.21.15.46:0/479735118 >> v1:172.21.15.46:6789/0 conn(0x7f42a00af720 legacy=0x7f42a00afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.753 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.750+0000 7f429e59c700 1 -- 172.21.15.46:0/479735118 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00adf10 con 0x7f42a00af350 2023-10-07T08:58:30.754 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f429e59c700 1 --2- 172.21.15.46:0/479735118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a00ae9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42a0088950 tx=0x7f42900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcfdc8c9bf56c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:30.754 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f429d59a700 1 -- 172.21.15.46:0/479735118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000b6b0 con 0x7f42a00af350 2023-10-07T08:58:30.754 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f429d59a700 1 -- 172.21.15.46:0/479735118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000b810 con 0x7f42a00af350 2023-10-07T08:58:30.754 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f429d59a700 1 -- 172.21.15.46:0/479735118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000bbb0 con 0x7f42a00af350 2023-10-07T08:58:30.757 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 -- 172.21.15.46:0/479735118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 msgr2=0x7f42a00ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.757 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 --2- 172.21.15.46:0/479735118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a00ae9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42a0088950 tx=0x7f42900091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 -- 172.21.15.46:0/479735118 shutdown_connections 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 --2- 172.21.15.46:0/479735118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a00ae9f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 --2- 172.21.15.46:0/479735118 >> v2:172.21.15.133:3300/0 conn(0x7f42a00ad420 0x7f42a00b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 -- 172.21.15.46:0/479735118 >> 172.21.15.46:0/479735118 conn(0x7f42a0099ab0 msgr2=0x7f42a006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 -- 172.21.15.46:0/479735118 shutdown_connections 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.751+0000 7f42a4f36700 1 -- 172.21.15.46:0/479735118 wait complete. 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.752+0000 7f42a4f36700 1 Processor -- start 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 -- start start 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42a00ad420 0x7f42a0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.758 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42a00af720 0x7f42a0158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a015f070 con 0x7f42a00af350 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0157310 con 0x7f42a00ad420 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f42a4f36700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01575f0 con 0x7f42a00af720 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f429dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f429dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41582/0 (socket says 172.21.15.46:41582) 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f429dd9b700 1 -- 172.21.15.46:0/1870523442 learned_addr learned my addr 172.21.15.46:0/1870523442 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.753+0000 7f429e59c700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42a00ad420 0x7f42a0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429ed9d700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42a00af720 0x7f42a0158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 -- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42a00af720 msgr2=0x7f42a0158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.759 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42a00af720 0x7f42a0158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 -- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42a00ad420 msgr2=0x7f42a0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42a00ad420 0x7f42a0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 -- 172.21.15.46:0/1870523442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290009420 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f429dd9b700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f429400d860 tx=0x7f4294008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42940125f0 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4294012750 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a01578d0 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294012af0 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.754+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a0157e90 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.755+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a015b080 con 0x7f42a00af350 2023-10-07T08:58:30.760 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.755+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f429401e460 con 0x7f42a00af350 2023-10-07T08:58:30.761 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.756+0000 7f428e7fc700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 0x7f4280069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:30.761 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.756+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f4294084530 con 0x7f42a00af350 2023-10-07T08:58:30.761 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.756+0000 7f429e59c700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 0x7f4280069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:30.761 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.757+0000 7f429e59c700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 0x7f4280069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42900093f0 tx=0x7f4290017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:30.762 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.760+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4294051d50 con 0x7f42a00af350 2023-10-07T08:58:30.962 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.960+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42a00ae1f0 con 0x7f42a00af350 2023-10-07T08:58:30.962 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.961+0000 7f428e7fc700 1 -- 172.21.15.46:0/1870523442 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f4294055370 con 0x7f42a00af350 2023-10-07T08:58:30.963 INFO:teuthology.misc.health.smithi046.stdout: 2023-10-07T08:58:30.963 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":13,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:30.223741+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 msgr2=0x7f4280069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 0x7f4280069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42900093f0 tx=0x7f4290017000 comp rx=0 tx=0).stop 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 msgr2=0x7f42a015eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f429400d860 tx=0x7f4294008040 comp rx=0 tx=0).stop 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 shutdown_connections 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4280066ea0 0x7f4280069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42a00af720 0x7f42a0158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.965 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42a00ad420 0x7f42a0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.966 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 --2- 172.21.15.46:0/1870523442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42a00af350 0x7f42a015eb30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:30.966 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 >> 172.21.15.46:0/1870523442 conn(0x7f42a0099ab0 msgr2=0x7f42a0152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:30.966 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 shutdown_connections 2023-10-07T08:58:30.966 INFO:teuthology.misc.health.smithi046.stderr:2023-10-07T08:58:30.963+0000 7f42a4f36700 1 -- 172.21.15.46:0/1870523442 wait complete. 2023-10-07T08:58:30.978 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-07T08:58:30.978 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-07T08:58:30.979 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:58:30.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:58:30.981 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:58:30.981 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:58:30.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:58:30.983 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:58:30.983 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:58:30.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:58:30.986 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:58:30.986 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:58:30.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:58:30.988 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:58:30.988 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-07T08:58:30.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:31.057 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T08:58:31.057 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T08:58:31.059 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T08:58:31.060 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T08:58:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.112+0000 7f10783ea700 1 Processor -- start 2023-10-07T08:58:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.112+0000 7f10783ea700 1 -- start start 2023-10-07T08:58:31.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f10783ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f107006bcd0 0x7f1070140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f10783ea700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f107006c0a0 0x7f1070141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f10783ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107015c2a0 con 0x7f10700c8e00 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f10783ea700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700c9900 con 0x7f107006c0a0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f10783ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107015b690 con 0x7f107006bcd0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f1075985700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f107006c0a0 0x7f1070141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f1075985700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f107006c0a0 0x7f1070141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41638/0 (socket says 172.21.15.46:41638) 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f1075985700 1 -- 172.21.15.46:0/1217219846 learned_addr learned my addr 172.21.15.46:0/1217219846 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.113+0000 7f1076186700 1 --2- 172.21.15.46:0/1217219846 >> v2:172.21.15.133:3300/0 conn(0x7f107006bcd0 0x7f1070140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075985700 1 -- 172.21.15.46:0/1217219846 >> v2:172.21.15.133:3300/0 conn(0x7f107006bcd0 msgr2=0x7f1070140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075985700 1 --2- 172.21.15.46:0/1217219846 >> v2:172.21.15.133:3300/0 conn(0x7f107006bcd0 0x7f1070140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075985700 1 -- 172.21.15.46:0/1217219846 >> v1:172.21.15.133:6789/0 conn(0x7f10700c8e00 legacy=0x7f10700c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075985700 1 -- 172.21.15.46:0/1217219846 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107015b970 con 0x7f107006c0a0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075985700 1 --2- 172.21.15.46:0/1217219846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006c0a0 0x7f1070141330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10700cafd0 tx=0x7f106c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57069d4f8a8daa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075184700 1 -- 172.21.15.46:0/1217219846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c009e70 con 0x7f107006c0a0 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075184700 1 -- 172.21.15.46:0/1217219846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c00b860 con 0x7f107006c0a0 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f1075184700 1 -- 172.21.15.46:0/1217219846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00bc00 con 0x7f107006c0a0 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f10783ea700 1 -- 172.21.15.46:0/1217219846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006c0a0 msgr2=0x7f1070141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.114+0000 7f10783ea700 1 --2- 172.21.15.46:0/1217219846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006c0a0 0x7f1070141330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10700cafd0 tx=0x7f106c009250 comp rx=0 tx=0).stop 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 -- 172.21.15.46:0/1217219846 shutdown_connections 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 --2- 172.21.15.46:0/1217219846 >> v2:172.21.15.133:3300/0 conn(0x7f107006bcd0 0x7f1070140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 --2- 172.21.15.46:0/1217219846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006c0a0 0x7f1070141330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 -- 172.21.15.46:0/1217219846 >> 172.21.15.46:0/1217219846 conn(0x7f10700ce600 msgr2=0x7f10700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 -- 172.21.15.46:0/1217219846 shutdown_connections 2023-10-07T08:58:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.115+0000 7f10783ea700 1 -- 172.21.15.46:0/1217219846 wait complete. 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 Processor -- start 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 -- start start 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107006c0a0 0x7f10701562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10700c8e00 0x7f10700cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107006a2b0 con 0x7f107006bcd0 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107006b0a0 con 0x7f107006c0a0 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f10783ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107006a490 con 0x7f10700c8e00 2023-10-07T08:58:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.116+0000 7f1076186700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41640/0 (socket says 172.21.15.46:41640) 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 -- 172.21.15.46:0/254628918 learned_addr learned my addr 172.21.15.46:0/254628918 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076987700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10700c8e00 0x7f10700cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1075985700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107006c0a0 0x7f10701562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 -- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10700c8e00 msgr2=0x7f10700cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10700c8e00 0x7f10700cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 -- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107006c0a0 msgr2=0x7f10701562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107006c0a0 0x7f10701562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 -- 172.21.15.46:0/254628918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c0094f0 con 0x7f107006bcd0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f1076186700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f106400ec80 tx=0x7f10640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106400c9d0 con 0x7f107006bcd0 2023-10-07T08:58:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106400cb30 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107006a770 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064013470 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.117+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107006ad30 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.118+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107004c3c0 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.119+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f1064013820 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.119+0000 7f10627fc700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 0x7f1054069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.119+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f1064084330 con 0x7f107006bcd0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.119+0000 7f1075985700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 0x7f1054069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.119+0000 7f1075985700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 0x7f1054069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10700cafd0 tx=0x7f106c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.123+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1064051b50 con 0x7f107006bcd0 2023-10-07T08:58:31.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.320+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f107006c9d0 con 0x7f107006bcd0 2023-10-07T08:58:31.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.321+0000 7f10627fc700 1 -- 172.21.15.46:0/254628918 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10580 (secure 0 0 0) 0x7f1064055170 con 0x7f107006bcd0 2023-10-07T08:58:31.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:31.323 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:31.225092+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 msgr2=0x7f1054069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 0x7f1054069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10700cafd0 tx=0x7f106c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 msgr2=0x7f107013c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f106400ec80 tx=0x7f10640091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 shutdown_connections 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1054066ea0 0x7f1054069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10700c8e00 0x7f10700cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f107006bcd0 0x7f107013c1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 --2- 172.21.15.46:0/254628918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107006c0a0 0x7f10701562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 >> 172.21.15.46:0/254628918 conn(0x7f10700ce600 msgr2=0x7f10700c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:31.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 shutdown_connections 2023-10-07T08:58:31.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.323+0000 7f10783ea700 1 -- 172.21.15.46:0/254628918 wait complete. 2023-10-07T08:58:31.336 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-07T08:58:31.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:31.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.454+0000 7ff96510b700 1 Processor -- start 2023-10-07T08:58:31.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.454+0000 7ff96510b700 1 -- start start 2023-10-07T08:58:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96510b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff96015d230 0x7ff96015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96510b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600b2980 con 0x7ff960159420 2023-10-07T08:58:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96510b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96015db70 con 0x7ff9601597f0 2023-10-07T08:58:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96510b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600b11d0 con 0x7ff96015d230 2023-10-07T08:58:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96490a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff96015d230 0x7ff96015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff95ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff960159420 0x7ff9600b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48658/0 (socket says 172.21.15.46:48658) 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff95ffff700 1 -- 172.21.15.46:0/833094072 learned_addr learned my addr 172.21.15.46:0/833094072 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96490a700 1 -- 172.21.15.46:0/833094072 >> v1:172.21.15.133:6789/0 conn(0x7ff9601597f0 legacy=0x7ff9600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96490a700 1 -- 172.21.15.46:0/833094072 >> v1:172.21.15.46:6789/0 conn(0x7ff960159420 legacy=0x7ff9600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96490a700 1 -- 172.21.15.46:0/833094072 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600b14b0 con 0x7ff96015d230 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff95effd700 1 -- 172.21.15.46:0/833094072 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176828905 0 0) 0x7ff9600b2980 con 0x7ff960159420 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.455+0000 7ff96490a700 1 --2- 172.21.15.46:0/833094072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff96015d230 0x7ff96015d630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e60 tx=0x7ff958009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee21044ebac33096 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff95effd700 1 -- 172.21.15.46:0/833094072 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800e070 con 0x7ff96015d230 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff95effd700 1 -- 172.21.15.46:0/833094072 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800bbf0 con 0x7ff96015d230 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff95effd700 1 -- 172.21.15.46:0/833094072 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958012430 con 0x7ff96015d230 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 -- 172.21.15.46:0/833094072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff96015d230 msgr2=0x7ff96015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 --2- 172.21.15.46:0/833094072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff96015d230 0x7ff96015d630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e60 tx=0x7ff958009780 comp rx=0 tx=0).stop 2023-10-07T08:58:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 -- 172.21.15.46:0/833094072 shutdown_connections 2023-10-07T08:58:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 --2- 172.21.15.46:0/833094072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff96015d230 0x7ff96015d630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 -- 172.21.15.46:0/833094072 >> 172.21.15.46:0/833094072 conn(0x7ff9600d0660 msgr2=0x7ff9600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 -- 172.21.15.46:0/833094072 shutdown_connections 2023-10-07T08:58:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.456+0000 7ff96510b700 1 -- 172.21.15.46:0/833094072 wait complete. 2023-10-07T08:58:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.457+0000 7ff96510b700 1 Processor -- start 2023-10-07T08:58:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.457+0000 7ff96510b700 1 -- start start 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9601597f0 0x7ff960159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96015d230 0x7ff960169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96014f840 con 0x7ff960159420 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96015f1c0 con 0x7ff96015d230 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96510b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96015a1e0 con 0x7ff9601597f0 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41658/0 (socket says 172.21.15.46:41658) 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff95ffff700 1 -- 172.21.15.46:0/2964974125 learned_addr learned my addr 172.21.15.46:0/2964974125 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff95f7fe700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9601597f0 0x7ff960159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.458+0000 7ff96490a700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96015d230 0x7ff960169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 -- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9601597f0 msgr2=0x7ff960159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9601597f0 0x7ff960159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 -- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96015d230 msgr2=0x7ff960169770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96015d230 0x7ff960169770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 -- 172.21.15.46:0/2964974125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009a20 con 0x7ff960159420 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff95ffff700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c7e0 tx=0x7ff954007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954005b30 con 0x7ff960159420 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954005c90 con 0x7ff960159420 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954007300 con 0x7ff960159420 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff960155420 con 0x7ff960159420 2023-10-07T08:58:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.459+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96015eb70 con 0x7ff960159420 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.460+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96004c3c0 con 0x7ff960159420 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.460+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff95401b3b0 con 0x7ff960159420 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.460+0000 7ff947fff700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 0x7ff94c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.461+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7ff954083460 con 0x7ff960159420 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.461+0000 7ff95f7fe700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 0x7ff94c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.461+0000 7ff95f7fe700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 0x7ff94c069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff960152cd0 tx=0x7ff950007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.465+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff954050c80 con 0x7ff960159420 2023-10-07T08:58:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.701+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9600b1790 con 0x7ff960159420 2023-10-07T08:58:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.702+0000 7ff947fff700 1 -- 172.21.15.46:0/2964974125 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7ff954017090 con 0x7ff960159420 2023-10-07T08:58:31.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:31.704 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-07T08:58:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 msgr2=0x7ff94c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 0x7ff94c069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff960152cd0 tx=0x7ff950007ea0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 msgr2=0x7ff960154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c7e0 tx=0x7ff954007df0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 shutdown_connections 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff94c066ea0 0x7ff94c069350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96015d230 0x7ff960169770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960159420 0x7ff960154d20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 --2- 172.21.15.46:0/2964974125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9601597f0 0x7ff960159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 >> 172.21.15.46:0/2964974125 conn(0x7ff9600d0660 msgr2=0x7ff9600cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 shutdown_connections 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:31.704+0000 7ff96510b700 1 -- 172.21.15.46:0/2964974125 wait complete. 2023-10-07T08:58:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2023-10-07T08:58:33.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:33.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.841+0000 7fbd79f21700 1 Processor -- start 2023-10-07T08:58:33.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.841+0000 7fbd79f21700 1 -- start start 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.841+0000 7fbd79f21700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd74157960 0x7fbd740af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd79f21700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b4d0 0x7fbd74068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd79f21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd7406b940 0x7fbd740688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd79f21700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740ac760 con 0x7fbd74157960 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd79f21700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740af830 con 0x7fbd7406b940 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd79f21700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74068e10 con 0x7fbd7406b4d0 2023-10-07T08:58:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd74157960 0x7fbd740af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd74157960 0x7fbd740af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41660/0 (socket says 172.21.15.46:41660) 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 -- 172.21.15.46:0/1246333054 learned_addr learned my addr 172.21.15.46:0/1246333054 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd72ffd700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b4d0 0x7fbd74068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd73fff700 1 --2- 172.21.15.46:0/1246333054 >> v2:172.21.15.133:3300/0 conn(0x7fbd7406b940 0x7fbd740688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 -- 172.21.15.46:0/1246333054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b4d0 msgr2=0x7fbd74068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b4d0 0x7fbd74068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 -- 172.21.15.46:0/1246333054 >> v2:172.21.15.133:3300/0 conn(0x7fbd7406b940 msgr2=0x7fbd740688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 --2- 172.21.15.46:0/1246333054 >> v2:172.21.15.133:3300/0 conn(0x7fbd7406b940 0x7fbd740688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 -- 172.21.15.46:0/1246333054 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7406b030 con 0x7fbd74157960 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd737fe700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740af250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406e0c0 tx=0x7fbd64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c49184e9491d281 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd727fc700 1 -- 172.21.15.46:0/1246333054 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400b640 con 0x7fbd74157960 2023-10-07T08:58:33.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd727fc700 1 -- 172.21.15.46:0/1246333054 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6400b7a0 con 0x7fbd74157960 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.842+0000 7fbd727fc700 1 -- 172.21.15.46:0/1246333054 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400bb60 con 0x7fbd74157960 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 -- 172.21.15.46:0/1246333054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 msgr2=0x7fbd740af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740af250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406e0c0 tx=0x7fbd64009250 comp rx=0 tx=0).stop 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 -- 172.21.15.46:0/1246333054 shutdown_connections 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 --2- 172.21.15.46:0/1246333054 >> v2:172.21.15.133:3300/0 conn(0x7fbd7406b940 0x7fbd740688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740af250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 --2- 172.21.15.46:0/1246333054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b4d0 0x7fbd74068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 -- 172.21.15.46:0/1246333054 >> 172.21.15.46:0/1246333054 conn(0x7fbd740c9870 msgr2=0x7fbd740c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 -- 172.21.15.46:0/1246333054 shutdown_connections 2023-10-07T08:58:33.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.843+0000 7fbd79f21700 1 -- 172.21.15.46:0/1246333054 wait complete. 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.844+0000 7fbd79f21700 1 Processor -- start 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.844+0000 7fbd79f21700 1 -- start start 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd7406b4d0 0x7fbd74159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b940 0x7fbd740c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74151670 con 0x7fbd74157960 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74150d80 con 0x7fbd7406b4d0 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd79f21700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74151020 con 0x7fbd7406b940 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd7406b4d0 0x7fbd74159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41662/0 (socket says 172.21.15.46:41662) 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd73fff700 1 -- 172.21.15.46:0/111589992 learned_addr learned my addr 172.21.15.46:0/111589992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.845+0000 7fbd72ffd700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b940 0x7fbd740c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 -- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b940 msgr2=0x7fbd740c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b940 0x7fbd740c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 -- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd7406b4d0 msgr2=0x7fbd74159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd7406b4d0 0x7fbd74159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 -- 172.21.15.46:0/111589992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640094f0 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd73fff700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009e90 tx=0x7fbd6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00cb70 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd74151300 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00f040 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c014480 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.846+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74159840 con 0x7fbd74157960 2023-10-07T08:58:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.847+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd740ca5f0 con 0x7fbd74157960 2023-10-07T08:58:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.848+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fbd6c014830 con 0x7fbd74157960 2023-10-07T08:58:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.848+0000 7fbd5b7fe700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 0x7fbd60069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.848+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd6c084a40 con 0x7fbd74157960 2023-10-07T08:58:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.849+0000 7fbd737fe700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 0x7fbd60069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.849+0000 7fbd737fe700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 0x7fbd60069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406e0c0 tx=0x7fbd64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:33.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:33.853+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd6c0520e0 con 0x7fbd74157960 2023-10-07T08:58:34.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.097+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd74151820 con 0x7fbd74157960 2023-10-07T08:58:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.098+0000 7fbd5b7fe700 1 -- 172.21.15.46:0/111589992 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fbd6c018de0 con 0x7fbd74157960 2023-10-07T08:58:34.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:34.100 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 msgr2=0x7fbd60069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 0x7fbd60069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406e0c0 tx=0x7fbd64017000 comp rx=0 tx=0).stop 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 msgr2=0x7fbd740c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009e90 tx=0x7fbd6c00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 shutdown_connections 2023-10-07T08:58:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd60066ea0 0x7fbd60069350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd74157960 0x7fbd740c4620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd7406b4d0 0x7fbd74159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 --2- 172.21.15.46:0/111589992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd7406b940 0x7fbd740c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 >> 172.21.15.46:0/111589992 conn(0x7fbd740c9870 msgr2=0x7fbd741557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 shutdown_connections 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.101+0000 7fbd79f21700 1 -- 172.21.15.46:0/111589992 wait complete. 2023-10-07T08:58:34.104 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2023-10-07T08:58:34.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:34.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.235+0000 7f1be7488700 1 Processor -- start 2023-10-07T08:58:34.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.235+0000 7f1be7488700 1 -- start start 2023-10-07T08:58:34.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be7488700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be7488700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1be006a1c0 0x7f1be0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be7488700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00c7de0 con 0x7f1be0140720 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be7488700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be0140c10 con 0x7f1be006a1c0 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be7488700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0141490 con 0x7f1be0140350 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49388/0 (socket says 172.21.15.46:49388) 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 -- 172.21.15.46:0/3783975464 learned_addr learned my addr 172.21.15.46:0/3783975464 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be4a23700 1 --2- 172.21.15.46:0/3783975464 >> v2:172.21.15.133:3300/0 conn(0x7f1be006a1c0 0x7f1be0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 -- 172.21.15.46:0/3783975464 >> v2:172.21.15.133:3300/0 conn(0x7f1be006a1c0 msgr2=0x7f1be0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 --2- 172.21.15.46:0/3783975464 >> v2:172.21.15.133:3300/0 conn(0x7f1be006a1c0 0x7f1be0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 -- 172.21.15.46:0/3783975464 >> v1:172.21.15.133:6789/0 conn(0x7f1be0140720 legacy=0x7f1be015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:34.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.237+0000 7f1be5224700 1 -- 172.21.15.46:0/3783975464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0140ed0 con 0x7f1be0140350 2023-10-07T08:58:34.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.238+0000 7f1be5224700 1 --2- 172.21.15.46:0/3783975464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009990 tx=0x7f1bdc009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce94cc325b84427d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.244+0000 7f1bd7fff700 1 -- 172.21.15.46:0/3783975464 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc009e80 con 0x7f1be0140350 2023-10-07T08:58:34.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.244+0000 7f1bd7fff700 1 -- 172.21.15.46:0/3783975464 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc005c10 con 0x7f1be0140350 2023-10-07T08:58:34.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.244+0000 7f1bd7fff700 1 -- 172.21.15.46:0/3783975464 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc014960 con 0x7f1be0140350 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 -- 172.21.15.46:0/3783975464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 msgr2=0x7f1be0069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 --2- 172.21.15.46:0/3783975464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009990 tx=0x7f1bdc009220 comp rx=0 tx=0).stop 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 -- 172.21.15.46:0/3783975464 shutdown_connections 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 --2- 172.21.15.46:0/3783975464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be0069c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 --2- 172.21.15.46:0/3783975464 >> v2:172.21.15.133:3300/0 conn(0x7f1be006a1c0 0x7f1be0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 -- 172.21.15.46:0/3783975464 >> 172.21.15.46:0/3783975464 conn(0x7f1be00cd670 msgr2=0x7f1be00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 -- 172.21.15.46:0/3783975464 shutdown_connections 2023-10-07T08:58:34.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.245+0000 7f1be7488700 1 -- 172.21.15.46:0/3783975464 wait complete. 2023-10-07T08:58:34.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 Processor -- start 2023-10-07T08:58:34.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 -- start start 2023-10-07T08:58:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be006a1c0 0x7f1be00b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0166c70 con 0x7f1be0140720 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00c5c00 con 0x7f1be006a1c0 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.247+0000 7f1be7488700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01666b0 con 0x7f1be0140350 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41676/0 (socket says 172.21.15.46:41676) 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be4a23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 -- 172.21.15.46:0/734786897 learned_addr learned my addr 172.21.15.46:0/734786897 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5224700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be006a1c0 0x7f1be00b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 -- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 msgr2=0x7f1be00c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be00c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 -- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be006a1c0 msgr2=0x7f1be00b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be006a1c0 0x7f1be00b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 -- 172.21.15.46:0/734786897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009480 con 0x7f1be0140720 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be5a25700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800bbb0 tx=0x7f1bd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800c630 con 0x7f1be0140720 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800c7b0 con 0x7f1be0140720 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be0166990 con 0x7f1be0140720 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800cb70 con 0x7f1be0140720 2023-10-07T08:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.248+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be00b3350 con 0x7f1be0140720 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.249+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be00c56f0 con 0x7f1be0140720 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.250+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bd8012070 con 0x7f1be0140720 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.250+0000 7f1bd57fa700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 0x7f1bc4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.250+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1bd8083d30 con 0x7f1be0140720 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.250+0000 7f1be5224700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 0x7f1bc4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.251+0000 7f1be5224700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 0x7f1bc4069410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc003080 tx=0x7f1bdc01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.255+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1be00c56f0 con 0x7f1be0140720 2023-10-07T08:58:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.450+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1be00c56f0 con 0x7f1be0140720 2023-10-07T08:58:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.451+0000 7f1bd57fa700 1 -- 172.21.15.46:0/734786897 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f1be00c56f0 con 0x7f1be0140720 2023-10-07T08:58:34.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:34.453 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:34.232561+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 msgr2=0x7f1bc4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 0x7f1bc4069410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc003080 tx=0x7f1bdc01a000 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 msgr2=0x7f1be0165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800bbb0 tx=0x7f1bd8009840 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 shutdown_connections 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1bc4066f60 0x7f1bc4069410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1be0140720 0x7f1be0165c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be006a1c0 0x7f1be00b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 --2- 172.21.15.46:0/734786897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1be0140350 0x7f1be00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 >> 172.21.15.46:0/734786897 conn(0x7f1be00cd670 msgr2=0x7f1be00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 shutdown_connections 2023-10-07T08:58:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.453+0000 7f1be7488700 1 -- 172.21.15.46:0/734786897 wait complete. 2023-10-07T08:58:34.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:58:34.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:58:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.595+0000 7f46b1924700 1 Processor -- start 2023-10-07T08:58:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.595+0000 7f46b1924700 1 -- start start 2023-10-07T08:58:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b1924700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b1924700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46ac06cca0 0x7f46ac068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b1924700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac06c810 con 0x7f46ac0688d0 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b1924700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac068d50 con 0x7f46ac06cca0 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b1924700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac06bc00 con 0x7f46ac15dbe0 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b0922700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b0922700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49410/0 (socket says 172.21.15.46:49410) 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46b0922700 1 -- 172.21.15.46:0/446555805 learned_addr learned my addr 172.21.15.46:0/446555805 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.596+0000 7f46abfff700 1 --2- 172.21.15.46:0/446555805 >> v2:172.21.15.133:3300/0 conn(0x7f46ac06cca0 0x7f46ac068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b0922700 1 -- 172.21.15.46:0/446555805 >> v2:172.21.15.133:3300/0 conn(0x7f46ac06cca0 msgr2=0x7f46ac068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b0922700 1 --2- 172.21.15.46:0/446555805 >> v2:172.21.15.133:3300/0 conn(0x7f46ac06cca0 0x7f46ac068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b0922700 1 -- 172.21.15.46:0/446555805 >> v1:172.21.15.133:6789/0 conn(0x7f46ac0688d0 legacy=0x7f46ac06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b0922700 1 -- 172.21.15.46:0/446555805 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac06bee0 con 0x7f46ac15dbe0 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b0922700 1 --2- 172.21.15.46:0/446555805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46940099b0 tx=0x7f4694009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10b390fcb7525f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46ab7fe700 1 -- 172.21.15.46:0/446555805 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400b860 con 0x7f46ac15dbe0 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46ab7fe700 1 -- 172.21.15.46:0/446555805 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400b9c0 con 0x7f46ac15dbe0 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46ab7fe700 1 -- 172.21.15.46:0/446555805 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400bd80 con 0x7f46ac15dbe0 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 -- 172.21.15.46:0/446555805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 msgr2=0x7f46ac15dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 --2- 172.21.15.46:0/446555805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46940099b0 tx=0x7f4694009250 comp rx=0 tx=0).stop 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 -- 172.21.15.46:0/446555805 shutdown_connections 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 --2- 172.21.15.46:0/446555805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac15dbe0 0x7f46ac15dfb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 --2- 172.21.15.46:0/446555805 >> v2:172.21.15.133:3300/0 conn(0x7f46ac06cca0 0x7f46ac068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.597+0000 7f46b1924700 1 -- 172.21.15.46:0/446555805 >> 172.21.15.46:0/446555805 conn(0x7f46ac0cddc0 msgr2=0x7f46ac0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.598+0000 7f46b1924700 1 -- 172.21.15.46:0/446555805 shutdown_connections 2023-10-07T08:58:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.598+0000 7f46b1924700 1 -- 172.21.15.46:0/446555805 wait complete. 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.599+0000 7f46b1924700 1 Processor -- start 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.599+0000 7f46b1924700 1 -- start start 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 0x7f46ac14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46ac15dbe0 0x7f46ac0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac161410 con 0x7f46ac06cca0 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac14c380 con 0x7f46ac15dbe0 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1621d0 con 0x7f46ac0688d0 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41688/0 (socket says 172.21.15.46:41688) 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 -- 172.21.15.46:0/246186522 learned_addr learned my addr 172.21.15.46:0/246186522 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b0922700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 0x7f46ac14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1123700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46ac15dbe0 0x7f46ac0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 -- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 msgr2=0x7f46ac14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 0x7f46ac14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 -- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46ac15dbe0 msgr2=0x7f46ac0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46ac15dbe0 0x7f46ac0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 -- 172.21.15.46:0/246186522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940094f0 con 0x7f46ac06cca0 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b0922700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 0x7f46ac14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46abfff700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f469c00e1c0 tx=0x7f469c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00ed00 con 0x7f46ac06cca0 2023-10-07T08:58:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac149520 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00ee80 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c014670 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.600+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac1618a0 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.601+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac06d560 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.602+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f469c0149e0 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.602+0000 7f46a8ff9700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.602+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f469c084950 con 0x7f46ac06cca0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.603+0000 7f46b0922700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.603+0000 7f46b0922700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46940099b0 tx=0x7f4694017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.607+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f469c051f10 con 0x7f46ac06cca0 2023-10-07T08:58:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.798+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46ac04bb80 con 0x7f46ac06cca0 2023-10-07T08:58:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.799+0000 7f46a8ff9700 1 -- 172.21.15.46:0/246186522 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f469c055530 con 0x7f46ac06cca0 2023-10-07T08:58:34.801 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 msgr2=0x7f468c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46940099b0 tx=0x7f4694017000 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 msgr2=0x7f46ac1600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f469c00e1c0 tx=0x7f469c009950 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 shutdown_connections 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46ac15dbe0 0x7f46ac0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46ac0688d0 0x7f46ac14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 --2- 172.21.15.46:0/246186522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ac06cca0 0x7f46ac1600c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 >> 172.21.15.46:0/246186522 conn(0x7f46ac0cddc0 msgr2=0x7f46ac0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 shutdown_connections 2023-10-07T08:58:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.801+0000 7f46b1924700 1 -- 172.21.15.46:0/246186522 wait complete. 2023-10-07T08:58:34.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:58:34.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.932+0000 7f6004985700 1 Processor -- start 2023-10-07T08:58:34.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.932+0000 7f6004985700 1 -- start start 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f6004985700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f600006bcd0 0x7f60000caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f6004985700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f600006c0a0 0x7f600015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f6004985700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600015d7e0 con 0x7f600015df50 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f6004985700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600015dac0 con 0x7f600006c0a0 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f6004985700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600015aa30 con 0x7f600006bcd0 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f600006c0a0 0x7f600015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f600006c0a0 0x7f600015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41698/0 (socket says 172.21.15.46:41698) 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 -- 172.21.15.46:0/4148801179 learned_addr learned my addr 172.21.15.46:0/4148801179 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffe59c700 1 --2- 172.21.15.46:0/4148801179 >> v2:172.21.15.133:3300/0 conn(0x7f600006bcd0 0x7f60000caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 -- 172.21.15.46:0/4148801179 >> v2:172.21.15.133:3300/0 conn(0x7f600006bcd0 msgr2=0x7f60000caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 --2- 172.21.15.46:0/4148801179 >> v2:172.21.15.133:3300/0 conn(0x7f600006bcd0 0x7f60000caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 -- 172.21.15.46:0/4148801179 >> v1:172.21.15.133:6789/0 conn(0x7f600015df50 legacy=0x7f60000c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 -- 172.21.15.46:0/4148801179 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600015ad10 con 0x7f600006c0a0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffdd9b700 1 --2- 172.21.15.46:0/4148801179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006c0a0 0x7f600015a1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60000691a0 tx=0x7f5fe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516c2aa26316d497 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.933+0000 7f5ffd59a700 1 -- 172.21.15.46:0/4148801179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800b820 con 0x7f600006c0a0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f5ffd59a700 1 -- 172.21.15.46:0/4148801179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800b980 con 0x7f600006c0a0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f5ffd59a700 1 -- 172.21.15.46:0/4148801179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800bd40 con 0x7f600006c0a0 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 -- 172.21.15.46:0/4148801179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006c0a0 msgr2=0x7f600015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 --2- 172.21.15.46:0/4148801179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006c0a0 0x7f600015a1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60000691a0 tx=0x7f5fe8009250 comp rx=0 tx=0).stop 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 -- 172.21.15.46:0/4148801179 shutdown_connections 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 --2- 172.21.15.46:0/4148801179 >> v2:172.21.15.133:3300/0 conn(0x7f600006bcd0 0x7f60000caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 --2- 172.21.15.46:0/4148801179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006c0a0 0x7f600015a1e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 -- 172.21.15.46:0/4148801179 >> 172.21.15.46:0/4148801179 conn(0x7f60000ce600 msgr2=0x7f60000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 -- 172.21.15.46:0/4148801179 shutdown_connections 2023-10-07T08:58:34.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.934+0000 7f6004985700 1 -- 172.21.15.46:0/4148801179 wait complete. 2023-10-07T08:58:34.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.935+0000 7f6004985700 1 Processor -- start 2023-10-07T08:58:34.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.935+0000 7f6004985700 1 -- start start 2023-10-07T08:58:34.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600006c0a0 0x7f60000b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f600015df50 0x7f600014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b4120 con 0x7f600006bcd0 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b2b30 con 0x7f600006c0a0 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f6004985700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600014a830 con 0x7f600015df50 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41712/0 (socket says 172.21.15.46:41712) 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 -- 172.21.15.46:0/579327057 learned_addr learned my addr 172.21.15.46:0/579327057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffdd9b700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600006c0a0 0x7f60000b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffed9d700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f600015df50 0x7f600014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 -- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f600015df50 msgr2=0x7f600014a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f600015df50 0x7f600014a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 -- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600006c0a0 msgr2=0x7f60000b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600006c0a0 0x7f60000b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.936+0000 7f5ffe59c700 1 -- 172.21.15.46:0/579327057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80094f0 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f5ffe59c700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009fd0 tx=0x7f5ff0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000eb90 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000ecf0 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000b3510 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0014670 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.937+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000b3ad0 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.938+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600004c3c0 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.938+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ff00149e0 con 0x7f600006bcd0 2023-10-07T08:58:34.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.939+0000 7f5ff67fc700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:34.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.939+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5ff00847d0 con 0x7f600006bcd0 2023-10-07T08:58:34.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.939+0000 7f5ffdd9b700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:34.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.939+0000 7f5ffdd9b700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60000691a0 tx=0x7f5fe8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:34.943+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff0051d90 con 0x7f600006bcd0 2023-10-07T08:58:35.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.137+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f600015aff0 con 0x7f600006bcd0 2023-10-07T08:58:35.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.137+0000 7f5ff67fc700 1 -- 172.21.15.46:0/579327057 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5ff00553b0 con 0x7f600006bcd0 2023-10-07T08:58:35.139 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:35.139 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T08:58:35.140 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:58:35.140 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T08:58:35.140 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T08:58:35.140 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:58:35.140 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.139+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 msgr2=0x7f5fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.139+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60000691a0 tx=0x7f5fe8016000 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.139+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 msgr2=0x7f60000b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.139+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009fd0 tx=0x7f5ff0009880 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 shutdown_connections 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f600015df50 0x7f600014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f600006bcd0 0x7f60000b2e80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 --2- 172.21.15.46:0/579327057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600006c0a0 0x7f60000b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 >> 172.21.15.46:0/579327057 conn(0x7f60000ce600 msgr2=0x7f600015c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 shutdown_connections 2023-10-07T08:58:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.140+0000 7f6004985700 1 -- 172.21.15.46:0/579327057 wait complete. 2023-10-07T08:58:35.153 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:58:35.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:58:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.274+0000 7fa067391700 1 Processor -- start 2023-10-07T08:58:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 -- start start 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa06006ab40 0x7fa0600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa060068390 0x7fa0600c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa060068900 con 0x7fa0600af8c0 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa060068be0 con 0x7fa060068390 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa067391700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa060068ec0 con 0x7fa06006ab40 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa06492c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa060068390 0x7fa0600c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.275+0000 7fa06592e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa0600af8c0 0x7fa060159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48670/0 (socket says 172.21.15.46:48670) 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06592e700 1 -- 172.21.15.46:0/3260074445 learned_addr learned my addr 172.21.15.46:0/3260074445 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06512d700 1 --2- 172.21.15.46:0/3260074445 >> v2:172.21.15.133:3300/0 conn(0x7fa06006ab40 0x7fa0600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa05ffff700 1 -- 172.21.15.46:0/3260074445 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767703193 0 0) 0x7fa060068900 con 0x7fa0600af8c0 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa05ffff700 1 -- 172.21.15.46:0/3260074445 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa048003570 con 0x7fa0600af8c0 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06492c700 1 -- 172.21.15.46:0/3260074445 >> v2:172.21.15.133:3300/0 conn(0x7fa06006ab40 msgr2=0x7fa0600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06492c700 1 --2- 172.21.15.46:0/3260074445 >> v2:172.21.15.133:3300/0 conn(0x7fa06006ab40 0x7fa0600699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06492c700 1 -- 172.21.15.46:0/3260074445 >> v1:172.21.15.46:6789/0 conn(0x7fa0600af8c0 legacy=0x7fa060159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06492c700 1 -- 172.21.15.46:0/3260074445 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600691a0 con 0x7fa060068390 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa06492c700 1 --2- 172.21.15.46:0/3260074445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa060068390 0x7fa0600c10c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0600ce6b0 tx=0x7fa0540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe797414b586243c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa05ffff700 1 -- 172.21.15.46:0/3260074445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011630 con 0x7fa060068390 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa05ffff700 1 -- 172.21.15.46:0/3260074445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054011790 con 0x7fa060068390 2023-10-07T08:58:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.276+0000 7fa05ffff700 1 -- 172.21.15.46:0/3260074445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011b30 con 0x7fa060068390 2023-10-07T08:58:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 -- 172.21.15.46:0/3260074445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa060068390 msgr2=0x7fa0600c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 --2- 172.21.15.46:0/3260074445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa060068390 0x7fa0600c10c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0600ce6b0 tx=0x7fa0540091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 -- 172.21.15.46:0/3260074445 shutdown_connections 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 --2- 172.21.15.46:0/3260074445 >> v2:172.21.15.133:3300/0 conn(0x7fa06006ab40 0x7fa0600699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 --2- 172.21.15.46:0/3260074445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa060068390 0x7fa0600c10c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 -- 172.21.15.46:0/3260074445 >> 172.21.15.46:0/3260074445 conn(0x7fa0600cd640 msgr2=0x7fa0600cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 -- 172.21.15.46:0/3260074445 shutdown_connections 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.277+0000 7fa067391700 1 -- 172.21.15.46:0/3260074445 wait complete. 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.278+0000 7fa067391700 1 Processor -- start 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.278+0000 7fa067391700 1 -- start start 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 0x7fa060145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 0x7fa060153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601533e0 con 0x7fa0600af8c0 2023-10-07T08:58:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015e830 con 0x7fa06006ab40 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa067391700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c6c10 con 0x7fa060068390 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06492c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 0x7fa060153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06512d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 0x7fa060145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41740/0 (socket says 172.21.15.46:41740) 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 -- 172.21.15.46:0/2420650363 learned_addr learned my addr 172.21.15.46:0/2420650363 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 -- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 msgr2=0x7fa060145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 0x7fa060145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 -- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 msgr2=0x7fa060153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 0x7fa060153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06592e700 1 -- 172.21.15.46:0/2420650363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009420 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06512d700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 0x7fa060145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.279+0000 7fa06492c700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 0x7fa060153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa06592e700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa050001460 tx=0x7fa050001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000a870 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000a9d0 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600c6ef0 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000ad50 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.280+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06015e4c0 con 0x7fa0600af8c0 2023-10-07T08:58:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.281+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600718b0 con 0x7fa0600af8c0 2023-10-07T08:58:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.281+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa050007300 con 0x7fa0600af8c0 2023-10-07T08:58:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.281+0000 7fa05d7fa700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.282+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa0500844d0 con 0x7fa0600af8c0 2023-10-07T08:58:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.282+0000 7fa06512d700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.282+0000 7fa06512d700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 0x7fa04c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa058011480 tx=0x7fa0580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:35.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.286+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa050051a80 con 0x7fa0600af8c0 2023-10-07T08:58:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:35.478+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa060069480 con 0x7fa0600af8c0 2023-10-07T08:58:36.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.242+0000 7fa05d7fa700 1 -- 172.21.15.46:0/2420650363 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa0500550a0 con 0x7fa0600af8c0 2023-10-07T08:58:36.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.247+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 msgr2=0x7fa04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.247+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 0x7fa04c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa058011480 tx=0x7fa0580091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.247+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 msgr2=0x7fa060153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.247+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa050001460 tx=0x7fa050001a40 comp rx=0 tx=0).stop 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 shutdown_connections 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0600af8c0 0x7fa060153c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060068390 0x7fa060145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 --2- 172.21.15.46:0/2420650363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006ab40 0x7fa060153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 >> 172.21.15.46:0/2420650363 conn(0x7fa0600cd640 msgr2=0x7fa0600b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.248+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 shutdown_connections 2023-10-07T08:58:36.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.249+0000 7fa067391700 1 -- 172.21.15.46:0/2420650363 wait complete. 2023-10-07T08:58:36.254 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T08:58:36.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:58:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.398+0000 7f09056ae700 1 Processor -- start 2023-10-07T08:58:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.398+0000 7f09056ae700 1 -- start start 2023-10-07T08:58:36.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f09056ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f09001645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f09056ae700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000b10f0 con 0x7f09000cf480 2023-10-07T08:58:36.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f09056ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090015e000 con 0x7f09001595d0 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f09056ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000cf990 con 0x7f090015d930 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f08ff7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f09000cf480 0x7f090015d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48674/0 (socket says 172.21.15.46:48674) 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f08ff7fe700 1 -- 172.21.15.46:0/3745473206 learned_addr learned my addr 172.21.15.46:0/3745473206 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583739905 0 0) 0x7f09000b10f0 con 0x7f09000cf480 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08ec003570 con 0x7f09000cf480 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.399+0000 7f0904ead700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f09001645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048576847 0 0) 0x7f08ec003570 con 0x7f09000cf480 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 msgr2=0x7f09001645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f09001645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 >> v1:172.21.15.133:6789/0 conn(0x7f09001595d0 legacy=0x7f09000ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000cfc70 con 0x7f09000cf480 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f08f0001470 con 0x7f09000cf480 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 >> v1:172.21.15.46:6789/0 conn(0x7f09000cf480 legacy=0x7f090015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f08ec003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08ec004810 0x7f08ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f08ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000cf990 con 0x7f08ec003a90 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec00bb10 con 0x7f08ec004810 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec00bcd0 con 0x7f090015d930 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f08ec003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08ff7fe700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08ec004810 0x7f08ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f0904ead700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f08ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 -- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 msgr2=0x7f08ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f090015d930 0x7f08ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 -- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08ec004810 msgr2=0x7f08ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08ec004810 0x7f08ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 -- 172.21.15.46:0/3745473206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec003570 con 0x7f08ec003a90 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.400+0000 7f08fffff700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f08ec003e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08e80019c0 tx=0x7f08e8007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9494d2b71d6819 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8001330 con 0x7f08ec003a90 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800c5d0 con 0x7f08ec003a90 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f08feffd700 1 -- 172.21.15.46:0/3745473206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800c970 con 0x7f08ec003a90 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 -- 172.21.15.46:0/3745473206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 msgr2=0x7f08ec003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 --2- 172.21.15.46:0/3745473206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f08ec003e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08e80019c0 tx=0x7f08e8007d60 comp rx=0 tx=0).stop 2023-10-07T08:58:36.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f0904ead700 1 -- 172.21.15.46:0/3745473206 reap_dead start 2023-10-07T08:58:36.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 -- 172.21.15.46:0/3745473206 shutdown_connections 2023-10-07T08:58:36.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 -- 172.21.15.46:0/3745473206 >> 172.21.15.46:0/3745473206 conn(0x7f09000d05f0 msgr2=0x7f09000d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:36.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 -- 172.21.15.46:0/3745473206 shutdown_connections 2023-10-07T08:58:36.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.401+0000 7f09056ae700 1 -- 172.21.15.46:0/3745473206 wait complete. 2023-10-07T08:58:36.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.402+0000 7f09056ae700 1 Processor -- start 2023-10-07T08:58:36.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.402+0000 7f09056ae700 1 -- start start 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f090016d4b0 0x7f090016ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09000b5740 0x7f0900153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090014d9b0 con 0x7f08ec003a90 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090014dc00 con 0x7f090016d4b0 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f09056ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090016d230 con 0x7f09000b5740 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41758/0 (socket says 172.21.15.46:41758) 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 -- 172.21.15.46:0/1224221956 learned_addr learned my addr 172.21.15.46:0/1224221956 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:36.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08ff7fe700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f090016d4b0 0x7f090016ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f0904ead700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09000b5740 0x7f0900153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 -- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09000b5740 msgr2=0x7f0900153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09000b5740 0x7f0900153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 -- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f090016d4b0 msgr2=0x7f090016ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f090016d4b0 0x7f090016ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.403+0000 7f08fffff700 1 -- 172.21.15.46:0/1224221956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090016da20 con 0x7f08ec003a90 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f08fffff700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c3c0 tx=0x7f08e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8001330 con 0x7f08ec003a90 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800cce0 con 0x7f08ec003a90 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090016dd00 con 0x7f08ec003a90 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800c950 con 0x7f08ec003a90 2023-10-07T08:58:36.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.404+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000b5bb0 con 0x7f08ec003a90 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.405+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090004c3c0 con 0x7f08ec003a90 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.405+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08e801f620 con 0x7f08ec003a90 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.406+0000 7f08f7fff700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 0x7f08e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.406+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f08e8085bf0 con 0x7f08ec003a90 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.406+0000 7f08ff7fe700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 0x7f08e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.406+0000 7f08ff7fe700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 0x7f08e0069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09000d0fd0 tx=0x7f08f0001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.410+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e8053040 con 0x7f08ec003a90 2023-10-07T08:58:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:36.602+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f09000cdfe0 con 0x7f08ec003a90 2023-10-07T08:58:37.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.247+0000 7f08f7fff700 1 -- 172.21.15.46:0/1224221956 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f08e802d0d0 con 0x7f08ec003a90 2023-10-07T08:58:37.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.253+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 msgr2=0x7f08e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.253+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 0x7f08e0069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09000d0fd0 tx=0x7f08f0001e70 comp rx=0 tx=0).stop 2023-10-07T08:58:37.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.253+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 msgr2=0x7f0900169f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.253+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c3c0 tx=0x7f08e8015000 comp rx=0 tx=0).stop 2023-10-07T08:58:37.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 shutdown_connections 2023-10-07T08:58:37.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08e0066f60 0x7f08e0069410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09000b5740 0x7f0900153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08ec003a90 0x7f0900169f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 --2- 172.21.15.46:0/1224221956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f090016d4b0 0x7f090016ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 >> 172.21.15.46:0/1224221956 conn(0x7f09000d05f0 msgr2=0x7f090015b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:37.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 shutdown_connections 2023-10-07T08:58:37.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.255+0000 7f09056ae700 1 -- 172.21.15.46:0/1224221956 wait complete. 2023-10-07T08:58:37.260 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T08:58:37.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:58:37.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.406+0000 7fb6f0857700 1 Processor -- start 2023-10-07T08:58:37.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.406+0000 7fb6f0857700 1 -- start start 2023-10-07T08:58:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.407+0000 7fb6f0857700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6ec068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.407+0000 7fb6f0857700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6ec068bb0 0x7fb6ec15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.407+0000 7fb6f0857700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec15c480 con 0x7fb6ec159c10 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.407+0000 7fb6f0857700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec0b2a40 con 0x7fb6ec068bb0 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.407+0000 7fb6f0857700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15b870 con 0x7fb6ec0b5ea0 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6ea59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6ec159c10 0x7fb6ec15b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48686/0 (socket says 172.21.15.46:48686) 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6ea59c700 1 -- 172.21.15.46:0/3253620209 learned_addr learned my addr 172.21.15.46:0/3253620209 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e9d9b700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6ec068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/3253620209 >> v2:172.21.15.133:3300/0 conn(0x7fb6ec068bb0 0x7fb6ec15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360609581 0 0) 0x7fb6ec15c480 con 0x7fb6ec159c10 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d8003570 con 0x7fb6ec159c10 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107053505 0 0) 0x7fb6d8003570 con 0x7fb6ec159c10 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 msgr2=0x7fb6ec068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6ec068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 >> v2:172.21.15.133:3300/0 conn(0x7fb6ec068bb0 msgr2=0x7fb6ec15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 --2- 172.21.15.46:0/3253620209 >> v2:172.21.15.133:3300/0 conn(0x7fb6ec068bb0 0x7fb6ec15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec15bb50 con 0x7fb6ec159c10 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb6e4001470 con 0x7fb6ec159c10 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 >> v1:172.21.15.46:6789/0 conn(0x7fb6ec159c10 legacy=0x7fb6ec15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6d8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d8003fe0 0x7fb6d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15b870 con 0x7fb6d8004d50 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d800ba60 con 0x7fb6d8003fe0 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d800bbd0 con 0x7fb6ec0b5ea0 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6ea59c700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6d8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.408+0000 7fb6e9d9b700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d8003fe0 0x7fb6d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 -- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 msgr2=0x7fb6d8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b5ea0 0x7fb6d8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 -- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d8003fe0 msgr2=0x7fb6d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d8003fe0 0x7fb6d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 -- 172.21.15.46:0/3253620209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8003570 con 0x7fb6d8004d50 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6d80051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00e210 tx=0x7fb6dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a21e484e5fa473 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00ea60 con 0x7fb6d8004d50 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00f040 con 0x7fb6d8004d50 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6e959a700 1 -- 172.21.15.46:0/3253620209 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00ee10 con 0x7fb6d8004d50 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6f0857700 1 -- 172.21.15.46:0/3253620209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 msgr2=0x7fb6d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6f0857700 1 --2- 172.21.15.46:0/3253620209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6d80051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00e210 tx=0x7fb6dc00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.409+0000 7fb6ead9d700 1 -- 172.21.15.46:0/3253620209 reap_dead start 2023-10-07T08:58:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.410+0000 7fb6f0857700 1 -- 172.21.15.46:0/3253620209 shutdown_connections 2023-10-07T08:58:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.410+0000 7fb6f0857700 1 -- 172.21.15.46:0/3253620209 >> 172.21.15.46:0/3253620209 conn(0x7fb6ec099a20 msgr2=0x7fb6ec0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.410+0000 7fb6f0857700 1 -- 172.21.15.46:0/3253620209 shutdown_connections 2023-10-07T08:58:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.410+0000 7fb6f0857700 1 -- 172.21.15.46:0/3253620209 wait complete. 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 Processor -- start 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 -- start start 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b0370 0x7fb6ec0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 0x7fb6ec0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0b0d20 con 0x7fb6d8004d50 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0c7a60 con 0x7fb6ec0c5640 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6f0857700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0c63e0 con 0x7fb6ec0b0370 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6ea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6ea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41778/0 (socket says 172.21.15.46:41778) 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.411+0000 7fb6ea59c700 1 -- 172.21.15.46:0/2265381327 learned_addr learned my addr 172.21.15.46:0/2265381327 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 0x7fb6ec0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6e9d9b700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b0370 0x7fb6ec0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 -- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b0370 msgr2=0x7fb6ec0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b0370 0x7fb6ec0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 -- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 msgr2=0x7fb6ec0c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:37.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 0x7fb6ec0c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 -- 172.21.15.46:0/2265381327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0c7130 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ead9d700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 0x7fb6ec0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6ea59c700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40073c0 tx=0x7fb6e4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4018030 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400f8d0 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec0c7410 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400fc90 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.412+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec169530 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.413+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec04c3c0 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.413+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6e401b070 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.414+0000 7fb6e27fc700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.414+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb6e4019070 con 0x7fb6d8004d50 2023-10-07T08:58:37.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.414+0000 7fb6e9d9b700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:37.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.415+0000 7fb6e9d9b700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 0x7fb6cc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec158aa0 tx=0x7fb6d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:37.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.419+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6e4051730 con 0x7fb6d8004d50 2023-10-07T08:58:37.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:37.654+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb6ec15be30 con 0x7fb6d8004d50 2023-10-07T08:58:38.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.264+0000 7fb6e27fc700 1 -- 172.21.15.46:0/2265381327 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb6e400fdf0 con 0x7fb6d8004d50 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.269+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 msgr2=0x7fb6cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.269+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 0x7fb6cc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec158aa0 tx=0x7fb6d4008040 comp rx=0 tx=0).stop 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.269+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 msgr2=0x7fb6ec168ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.269+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40073c0 tx=0x7fb6e4001e50 comp rx=0 tx=0).stop 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 shutdown_connections 2023-10-07T08:58:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6ec0c5640 0x7fb6ec0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d8004d50 0x7fb6ec168ff0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40073c0 tx=0x7fb6e4001e50 comp rx=0 tx=0).stop 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 --2- 172.21.15.46:0/2265381327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6ec0b0370 0x7fb6ec0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.270+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 >> 172.21.15.46:0/2265381327 conn(0x7fb6ec099a20 msgr2=0x7fb6ec09a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.271+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 shutdown_connections 2023-10-07T08:58:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.272+0000 7fb6f0857700 1 -- 172.21.15.46:0/2265381327 wait complete. 2023-10-07T08:58:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2023-10-07T08:58:38.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:38.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.415+0000 7f4219604700 1 Processor -- start 2023-10-07T08:58:38.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.415+0000 7f4219604700 1 -- start start 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.415+0000 7f4219604700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42141594d0 0x7f42140cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4219604700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42140d01f0 con 0x7f4214159fb0 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4219604700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42140cf5e0 con 0x7f42140b5fb0 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4219604700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42140cf8c0 con 0x7f42141594d0 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f42137fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4214159fb0 0x7f42140b1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48690/0 (socket says 172.21.15.46:48690) 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f42137fe700 1 -- 172.21.15.46:0/3934165625 learned_addr learned my addr 172.21.15.46:0/3934165625 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3934165625 >> v2:172.21.15.133:3300/0 conn(0x7f42141594d0 0x7f42140cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685003810 0 0) 0x7f42140d01f0 con 0x7f4214159fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4200003570 con 0x7f4214159fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226815078 0 0) 0x7f42140cf5e0 con 0x7f42140b5fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42140d01f0 con 0x7f42140b5fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994721135 0 0) 0x7f4200003570 con 0x7f4214159fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 >> v2:172.21.15.133:3300/0 conn(0x7f42141594d0 msgr2=0x7f42140cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 --2- 172.21.15.46:0/3934165625 >> v2:172.21.15.133:3300/0 conn(0x7f42141594d0 0x7f42140cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 >> v1:172.21.15.133:6789/0 conn(0x7f42140b5fb0 legacy=0x7f42141598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140cfba0 con 0x7f4214159fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f42040017f0 con 0x7f4214159fb0 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 >> v1:172.21.15.46:6789/0 conn(0x7f4214159fb0 legacy=0x7f42140b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 0x7f4200003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42140cf8c0 con 0x7f4200003bf0 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420000c160 con 0x7f42000051c0 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420000c320 con 0x7f4200004810 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.416+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 0x7f4200003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f42127fc700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f42137fe700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 -- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4200004810 msgr2=0x7f4200004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 -- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42000051c0 msgr2=0x7f420000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 -- 172.21.15.46:0/3934165625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200003570 con 0x7f4200003bf0 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f42137fe700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f42137fe700 1 -- 172.21.15.46:0/3934165625 reap_dead start 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 0x7f4200003fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f420c006f00 tx=0x7f420c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1746ee1c0659819f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00e710 con 0x7f4200003bf0 2023-10-07T08:58:38.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c00e870 con 0x7f4200003bf0 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4211ffb700 1 -- 172.21.15.46:0/3934165625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00ec30 con 0x7f4200003bf0 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4219604700 1 -- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 msgr2=0x7f4200003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.417+0000 7f4219604700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 0x7f4200003fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f420c006f00 tx=0x7f420c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.418+0000 7f4219604700 1 -- 172.21.15.46:0/3934165625 shutdown_connections 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.418+0000 7f4219604700 1 --2- 172.21.15.46:0/3934165625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4200003bf0 0x7f4200003fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.418+0000 7f4219604700 1 -- 172.21.15.46:0/3934165625 >> 172.21.15.46:0/3934165625 conn(0x7f42140d05f0 msgr2=0x7f42140d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.418+0000 7f4219604700 1 -- 172.21.15.46:0/3934165625 shutdown_connections 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.418+0000 7f4219604700 1 -- 172.21.15.46:0/3934165625 wait complete. 2023-10-07T08:58:38.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.419+0000 7f4219604700 1 Processor -- start 2023-10-07T08:58:38.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.419+0000 7f4219604700 1 -- start start 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 0x7f42140b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f421415ad80 0x7f421415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421415b730 con 0x7f4214151670 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214155520 con 0x7f4200003bf0 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4214155800 con 0x7f421415ad80 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41786/0 (socket says 172.21.15.46:41786) 2023-10-07T08:58:38.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 -- 172.21.15.46:0/3788527260 learned_addr learned my addr 172.21.15.46:0/3788527260 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:38.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42137fe700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f421415ad80 0x7f421415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 0x7f42140b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 -- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f421415ad80 msgr2=0x7f421415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f421415ad80 0x7f421415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 -- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 msgr2=0x7f42140b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 0x7f42140b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 -- 172.21.15.46:0/3788527260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214155ae0 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 0x7f42140b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f42127fc700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41fc002b80 tx=0x7f41fc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc006a30 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc006b90 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00f7f0 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421416ce20 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.420+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421416d3e0 con 0x7f4214151670 2023-10-07T08:58:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.421+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421404c3c0 con 0x7f4214151670 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.422+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41fc00fc20 con 0x7f4214151670 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.422+0000 7f420affd700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 0x7f41f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.422+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41fc084950 con 0x7f4214151670 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.422+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 0x7f41f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.423+0000 7f4212ffd700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 0x7f41f40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f420c0091e0 tx=0x7f420c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.427+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41fc051be0 con 0x7f4214151670 2023-10-07T08:58:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.620+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4214155cd0 con 0x7f4214151670 2023-10-07T08:58:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.620+0000 7f420affd700 1 -- 172.21.15.46:0/3788527260 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f41fc055200 con 0x7f4214151670 2023-10-07T08:58:38.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:38.622 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:37.656527+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:38.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 msgr2=0x7f41f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 0x7f41f40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f420c0091e0 tx=0x7f420c01a000 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 msgr2=0x7f4214143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41fc002b80 tx=0x7f41fc007d30 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 shutdown_connections 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f41f4066f30 0x7f41f40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f421415ad80 0x7f421415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4200003bf0 0x7f42140b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 --2- 172.21.15.46:0/3788527260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214151670 0x7f4214143f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 >> 172.21.15.46:0/3788527260 conn(0x7f42140d05f0 msgr2=0x7f421415bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 shutdown_connections 2023-10-07T08:58:38.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.622+0000 7f4219604700 1 -- 172.21.15.46:0/3788527260 wait complete. 2023-10-07T08:58:38.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.754+0000 7f65dbf20700 1 Processor -- start 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.754+0000 7f65dbf20700 1 -- start start 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65dbf20700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f65d4159c60 0x7f65d415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65dbf20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 0x7f65d4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65dbf20700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d415a160 con 0x7f65d4159890 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65dbf20700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d415df50 con 0x7f65d4159c60 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65dbf20700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40d13a0 con 0x7f65d415db10 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f65d4159c60 0x7f65d415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f65d4159c60 0x7f65d415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41794/0 (socket says 172.21.15.46:41794) 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 -- 172.21.15.46:0/3866141300 learned_addr learned my addr 172.21.15.46:0/3866141300 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65da4bd700 1 --2- 172.21.15.46:0/3866141300 >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 0x7f65d4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 -- 172.21.15.46:0/3866141300 >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 msgr2=0x7f65d4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 --2- 172.21.15.46:0/3866141300 >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 0x7f65d4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 -- 172.21.15.46:0/3866141300 >> v1:172.21.15.133:6789/0 conn(0x7f65d4159890 legacy=0x7f65d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 -- 172.21.15.46:0/3866141300 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d415e140 con 0x7f65d4159c60 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65da4bd700 1 --2- 172.21.15.46:0/3866141300 >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 0x7f65d4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d94bb700 1 --2- 172.21.15.46:0/3866141300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d415d5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65d406a890 tx=0x7f65c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34e3a825c907656 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d8cba700 1 -- 172.21.15.46:0/3866141300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400b820 con 0x7f65d4159c60 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d8cba700 1 -- 172.21.15.46:0/3866141300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400b980 con 0x7f65d4159c60 2023-10-07T08:58:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.755+0000 7f65d8cba700 1 -- 172.21.15.46:0/3866141300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400bd20 con 0x7f65d4159c60 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 -- 172.21.15.46:0/3866141300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 msgr2=0x7f65d415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 --2- 172.21.15.46:0/3866141300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d415d5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65d406a890 tx=0x7f65c4009250 comp rx=0 tx=0).stop 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 -- 172.21.15.46:0/3866141300 shutdown_connections 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 --2- 172.21.15.46:0/3866141300 >> v2:172.21.15.133:3300/0 conn(0x7f65d415db10 0x7f65d4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 --2- 172.21.15.46:0/3866141300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d415d5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 -- 172.21.15.46:0/3866141300 >> 172.21.15.46:0/3866141300 conn(0x7f65d4068e20 msgr2=0x7f65d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 -- 172.21.15.46:0/3866141300 shutdown_connections 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.756+0000 7f65dbf20700 1 -- 172.21.15.46:0/3866141300 wait complete. 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.757+0000 7f65dbf20700 1 Processor -- start 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.757+0000 7f65dbf20700 1 -- start start 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65d4159890 0x7f65d40ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65d415db10 0x7f65d40b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d414ce60 con 0x7f65d4159c60 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b1d90 con 0x7f65d4159890 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65dbf20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b6450 con 0x7f65d415db10 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41796/0 (socket says 172.21.15.46:41796) 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 -- 172.21.15.46:0/652716454 learned_addr learned my addr 172.21.15.46:0/652716454 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d9cbc700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65d4159890 0x7f65d40ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65da4bd700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65d415db10 0x7f65d40b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 -- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65d415db10 msgr2=0x7f65d40b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65d415db10 0x7f65d40b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 -- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65d4159890 msgr2=0x7f65d40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65d4159890 0x7f65d40ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 -- 172.21.15.46:0/652716454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40094f0 con 0x7f65d4159c60 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.758+0000 7f65d94bb700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65c40030c0 tx=0x7f65c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.759+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011d00 con 0x7f65d4159c60 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.759+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4020070 con 0x7f65d4159c60 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.759+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c401b6a0 con 0x7f65d4159c60 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.759+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40b1180 con 0x7f65d4159c60 2023-10-07T08:58:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.759+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40b1740 con 0x7f65d4159c60 2023-10-07T08:58:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.760+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40b1f00 con 0x7f65d4159c60 2023-10-07T08:58:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.760+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65c4022030 con 0x7f65d4159c60 2023-10-07T08:58:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.760+0000 7f65c9ffb700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.761+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65c40863e0 con 0x7f65d4159c60 2023-10-07T08:58:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.761+0000 7f65d9cbc700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:38.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.761+0000 7f65d9cbc700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 0x7f65b80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007fd0 tx=0x7f65d00026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:38.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.765+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65c4053650 con 0x7f65d4159c60 2023-10-07T08:58:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.959+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65d40b1f00 con 0x7f65d4159c60 2023-10-07T08:58:38.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.960+0000 7f65c9ffb700 1 -- 172.21.15.46:0/652716454 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f65c4011e60 con 0x7f65d4159c60 2023-10-07T08:58:38.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:38.963 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:37.656527+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:38.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 msgr2=0x7f65b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 0x7f65b80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007fd0 tx=0x7f65d00026a0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 msgr2=0x7f65d40b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65c40030c0 tx=0x7f65c4016000 comp rx=0 tx=0).stop 2023-10-07T08:58:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 shutdown_connections 2023-10-07T08:58:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65d415db10 0x7f65d40b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65d4159890 0x7f65d40ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 --2- 172.21.15.46:0/652716454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65d4159c60 0x7f65d40b5f10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 >> 172.21.15.46:0/652716454 conn(0x7f65d4068e20 msgr2=0x7f65d4157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 shutdown_connections 2023-10-07T08:58:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:38.962+0000 7f65dbf20700 1 -- 172.21.15.46:0/652716454 wait complete. 2023-10-07T08:58:38.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:58:39.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.097+0000 7f942f94e700 1 Processor -- start 2023-10-07T08:58:39.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.097+0000 7f942f94e700 1 -- start start 2023-10-07T08:58:39.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942f94e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 0x7f94280699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:39.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942f94e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9428069ee0 con 0x7f9428159c60 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942f94e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942815a160 con 0x7f9428159890 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942f94e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280d13a0 con 0x7f9428069560 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942cee9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9428159c60 0x7f942815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48692/0 (socket says 172.21.15.46:48692) 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942cee9700 1 -- 172.21.15.46:0/2137041986 learned_addr learned my addr 172.21.15.46:0/2137041986 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.098+0000 7f942deeb700 1 --2- 172.21.15.46:0/2137041986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 0x7f94280699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011399356 0 0) 0x7f9428069ee0 con 0x7f9428159c60 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9410003570 con 0x7f9428159c60 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765235343 0 0) 0x7f942815a160 con 0x7f9428159890 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9428069ee0 con 0x7f9428159890 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f942deeb700 1 -- 172.21.15.46:0/2137041986 >> v1:172.21.15.133:6789/0 conn(0x7f9428159890 legacy=0x7f942815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:39.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f942deeb700 1 -- 172.21.15.46:0/2137041986 >> v1:172.21.15.46:6789/0 conn(0x7f9428159c60 legacy=0x7f942815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f942deeb700 1 -- 172.21.15.46:0/2137041986 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942815e140 con 0x7f9428069560 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f942deeb700 1 --2- 172.21.15.46:0/2137041986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 0x7f94280699a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9420009910 tx=0x7f94200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725a74bed7e539c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420011630 con 0x7f9428069560 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420011790 con 0x7f9428069560 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.099+0000 7f9427fff700 1 -- 172.21.15.46:0/2137041986 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420011b10 con 0x7f9428069560 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 -- 172.21.15.46:0/2137041986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 msgr2=0x7f94280699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 --2- 172.21.15.46:0/2137041986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 0x7f94280699a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9420009910 tx=0x7f94200091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:39.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 -- 172.21.15.46:0/2137041986 shutdown_connections 2023-10-07T08:58:39.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 --2- 172.21.15.46:0/2137041986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428069560 0x7f94280699a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:39.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 -- 172.21.15.46:0/2137041986 >> 172.21.15.46:0/2137041986 conn(0x7f9428068e20 msgr2=0x7f94280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:39.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 -- 172.21.15.46:0/2137041986 shutdown_connections 2023-10-07T08:58:39.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.100+0000 7f942f94e700 1 -- 172.21.15.46:0/2137041986 wait complete. 2023-10-07T08:58:39.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.101+0000 7f942f94e700 1 Processor -- start 2023-10-07T08:58:39.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.101+0000 7f942f94e700 1 -- start start 2023-10-07T08:58:39.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9428069560 0x7f942814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:39.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428159c60 0x7f94281525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942815dc90 con 0x7f9428159890 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94280ce290 con 0x7f9428069560 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280cd680 con 0x7f9428159c60 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41802/0 (socket says 172.21.15.46:41802) 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 -- 172.21.15.46:0/265272324 learned_addr learned my addr 172.21.15.46:0/265272324 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942d6ea700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9428069560 0x7f942814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942deeb700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428159c60 0x7f94281525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 -- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428159c60 msgr2=0x7f94281525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:39.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428159c60 0x7f94281525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 -- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9428069560 msgr2=0x7f942814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9428069560 0x7f942814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 -- 172.21.15.46:0/265272324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420009420 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942cee9700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c790 tx=0x7f941c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c005b30 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c005c90 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0072e0 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94280cd960 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.102+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94280cdf20 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.103+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94280ce440 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.104+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f941c007690 con 0x7f9428159890 2023-10-07T08:58:39.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.104+0000 7f94257fa700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:39.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.104+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f941c083960 con 0x7f9428159890 2023-10-07T08:58:39.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.104+0000 7f942d6ea700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:39.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.105+0000 7f942d6ea700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 0x7f94140693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9418007fd0 tx=0x7f9418009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:39.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.108+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f941c04b5a0 con 0x7f9428159890 2023-10-07T08:58:39.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:39.352+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f942804c3c0 con 0x7f9428159890 2023-10-07T08:58:40.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.272+0000 7f94257fa700 1 -- 172.21.15.46:0/265272324 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f941c017020 con 0x7f9428159890 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 msgr2=0x7f94140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 0x7f94140693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9418007fd0 tx=0x7f9418009040 comp rx=0 tx=0).stop 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 msgr2=0x7f94280b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c790 tx=0x7f941c007ea0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 shutdown_connections 2023-10-07T08:58:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9428159c60 0x7f94281525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9428069560 0x7f942814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 --2- 172.21.15.46:0/265272324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9428159890 0x7f94280b53c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 >> 172.21.15.46:0/265272324 conn(0x7f9428068e20 msgr2=0x7f94280b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 shutdown_connections 2023-10-07T08:58:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.275+0000 7f942f94e700 1 -- 172.21.15.46:0/265272324 wait complete. 2023-10-07T08:58:40.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:58:40.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 Processor -- start 2023-10-07T08:58:40.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 -- start start 2023-10-07T08:58:40.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 0x7fa1c415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c415a160 con 0x7fa1c415db10 2023-10-07T08:58:40.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c40d13a0 con 0x7fa1c4159890 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.419+0000 7fa1c9b26700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c415e140 con 0x7fa1c4159c60 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1c37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 0x7fa1c415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1c37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33274/0 (socket says 172.21.15.46:33274) 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1c3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1c415db10 0x7fa1c4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39550/0 (socket says 172.21.15.46:39550) 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1c37fe700 1 -- 172.21.15.46:0/1379685269 learned_addr learned my addr 172.21.15.46:0/1379685269 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 -- 172.21.15.46:0/1379685269 >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 msgr2=0x7fa1c415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 --2- 172.21.15.46:0/1379685269 >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 -- 172.21.15.46:0/1379685269 >> v1:172.21.15.133:6789/0 conn(0x7fa1c415db10 legacy=0x7fa1c4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 -- 172.21.15.46:0/1379685269 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c415a3d0 con 0x7fa1c4159c60 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1c37fe700 1 --2- 172.21.15.46:0/1379685269 >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.420+0000 7fa1baffd700 1 --2- 172.21.15.46:0/1379685269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 0x7fa1c415d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0098e0 tx=0x7fa1ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a27b5c2017cfb51b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1379685269 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00b640 con 0x7fa1c4159c60 2023-10-07T08:58:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1379685269 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00b7a0 con 0x7fa1c4159c60 2023-10-07T08:58:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1379685269 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00bb40 con 0x7fa1c4159c60 2023-10-07T08:58:40.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1379685269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 msgr2=0x7fa1c415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1379685269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 0x7fa1c415d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0098e0 tx=0x7fa1ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1379685269 shutdown_connections 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1379685269 >> v2:172.21.15.133:3300/0 conn(0x7fa1c4159890 0x7fa1c415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1379685269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c4159c60 0x7fa1c415d5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1379685269 >> 172.21.15.46:0/1379685269 conn(0x7fa1c4068e20 msgr2=0x7fa1c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1379685269 shutdown_connections 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.421+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1379685269 wait complete. 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.422+0000 7fa1c9b26700 1 Processor -- start 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 -- start start 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4159c60 0x7fa1c415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c415db10 0x7fa1c4151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40cde70 con 0x7fa1c4159890 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c415d5f0 con 0x7fa1c4159c60 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c9b26700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40cd260 con 0x7fa1c415db10 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60226/0 (socket says 172.21.15.46:60226) 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c37fe700 1 -- 172.21.15.46:0/1794762057 learned_addr learned my addr 172.21.15.46:0/1794762057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1c3fff700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c415db10 0x7fa1c4151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.423+0000 7fa1baffd700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4159c60 0x7fa1c415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 -- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c415db10 msgr2=0x7fa1c4151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c415db10 0x7fa1c4151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 -- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4159c60 msgr2=0x7fa1c415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:40.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4159c60 0x7fa1c415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 -- 172.21.15.46:0/1794762057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40094f0 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c37fe700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ec50 tx=0x7fa1b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400c850 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400c9b0 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac009420 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400cd30 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.424+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c40cd820 con 0x7fa1c4159890 2023-10-07T08:58:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.425+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c404c3c0 con 0x7fa1c4159890 2023-10-07T08:58:40.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.425+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1b4013680 con 0x7fa1c4159890 2023-10-07T08:58:40.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.426+0000 7fa1bbfff700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 0x7fa1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:40.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.426+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1b4084910 con 0x7fa1c4159890 2023-10-07T08:58:40.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.426+0000 7fa1baffd700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 0x7fa1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:40.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.427+0000 7fa1baffd700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 0x7fa1a40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1c415a090 tx=0x7fa1ac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:40.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.430+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1b4051ae0 con 0x7fa1c4159890 2023-10-07T08:58:40.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:40.668+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa1c406a5b0 con 0x7fa1c4159890 2023-10-07T08:58:41.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:58:41.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:58:41.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.273+0000 7fa1bbfff700 1 -- 172.21.15.46:0/1794762057 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa1b4055100 con 0x7fa1c4159890 2023-10-07T08:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 msgr2=0x7fa1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 0x7fa1a40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1c415a090 tx=0x7fa1ac017000 comp rx=0 tx=0).stop 2023-10-07T08:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 msgr2=0x7fa1c4149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ec50 tx=0x7fa1b4009250 comp rx=0 tx=0).stop 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 shutdown_connections 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1a4066f30 0x7fa1a40693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1c415db10 0x7fa1c4151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1c4159890 0x7fa1c4149310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 --2- 172.21.15.46:0/1794762057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4159c60 0x7fa1c415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 >> 172.21.15.46:0/1794762057 conn(0x7fa1c4068e20 msgr2=0x7fa1c40d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 shutdown_connections 2023-10-07T08:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.276+0000 7fa1c9b26700 1 -- 172.21.15.46:0/1794762057 wait complete. 2023-10-07T08:58:41.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 Processor -- start 2023-10-07T08:58:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 -- start start 2023-10-07T08:58:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4738159c60 0x7f473815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473815a160 con 0x7f473815db10 2023-10-07T08:58:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380d13a0 con 0x7f4738159890 2023-10-07T08:58:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.413+0000 7f473db97700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473815df50 con 0x7f4738159c60 2023-10-07T08:58:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f4737fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f473815db10 0x7f4738069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54634/0 (socket says 172.21.15.46:54634) 2023-10-07T08:58:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f4737fff700 1 -- 172.21.15.46:0/1794319372 learned_addr learned my addr 172.21.15.46:0/1794319372 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f4736ffd700 1 --2- 172.21.15.46:0/1794319372 >> v2:172.21.15.133:3300/0 conn(0x7f4738159c60 0x7f473815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409974961 0 0) 0x7f473815a160 con 0x7f473815db10 2023-10-07T08:58:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4720003570 con 0x7f473815db10 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564009448 0 0) 0x7f47380d13a0 con 0x7f4738159890 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473815a160 con 0x7f4738159890 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696190634 0 0) 0x7f4720003570 con 0x7f473815db10 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 >> v2:172.21.15.133:3300/0 conn(0x7f4738159c60 msgr2=0x7f473815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 --2- 172.21.15.46:0/1794319372 >> v2:172.21.15.133:3300/0 conn(0x7f4738159c60 0x7f473815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 >> v1:172.21.15.133:6789/0 conn(0x7f4738159890 legacy=0x7f473815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473815e140 con 0x7f473815db10 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f47300017f0 con 0x7f473815db10 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 >> v1:172.21.15.46:6789/0 conn(0x7f473815db10 legacy=0x7f4738069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4720003c40 0x7f4720004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4720004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4720005210 0x7f472000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472000c130 con 0x7f4720004810 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472000c270 con 0x7f4720003c40 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472000c400 con 0x7f4720005210 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f4736ffd700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4720004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f47377fe700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4720003c40 0x7f4720004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.414+0000 7f4737fff700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4720005210 0x7f472000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 -- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4720005210 msgr2=0x7f472000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4720005210 0x7f472000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 -- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4720003c40 msgr2=0x7f4720004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4720003c40 0x7f4720004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4737fff700 1 -- 172.21.15.46:0/1794319372 reap_dead start 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 -- 172.21.15.46:0/1794319372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720003570 con 0x7f4720004810 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f4736ffd700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4720004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f472c006f00 tx=0x7f472c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c19d7d958ee1671 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00e710 con 0x7f4720004810 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00e870 con 0x7f4720004810 2023-10-07T08:58:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f47367fc700 1 -- 172.21.15.46:0/1794319372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00ec30 con 0x7f4720004810 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 -- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 msgr2=0x7f4720004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4720004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f472c006f00 tx=0x7f472c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 -- 172.21.15.46:0/1794319372 shutdown_connections 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 --2- 172.21.15.46:0/1794319372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4720004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 -- 172.21.15.46:0/1794319372 >> 172.21.15.46:0/1794319372 conn(0x7f4738068e20 msgr2=0x7f47380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 -- 172.21.15.46:0/1794319372 shutdown_connections 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.415+0000 7f473db97700 1 -- 172.21.15.46:0/1794319372 wait complete. 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.417+0000 7f473db97700 1 Processor -- start 2023-10-07T08:58:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.417+0000 7f473db97700 1 -- start start 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.417+0000 7f473db97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.417+0000 7f473db97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 0x7f4738157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47381580e0 0x7f47380c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738159170 con 0x7f4720004810 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47381588d0 con 0x7f4738142f70 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4738158bb0 con 0x7f47381580e0 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60246/0 (socket says 172.21.15.46:60246) 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 -- 172.21.15.46:0/859856293 learned_addr learned my addr 172.21.15.46:0/859856293 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f4736ffd700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 0x7f4738157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f4737fff700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47381580e0 0x7f47380c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 -- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47381580e0 msgr2=0x7f47380c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47381580e0 0x7f47380c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 -- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 msgr2=0x7f4738157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 0x7f4738157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 -- 172.21.15.46:0/859856293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738158e90 con 0x7f4720004810 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f4736ffd700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 0x7f4738157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f47377fe700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4728002b00 tx=0x7f4728007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800f940 con 0x7f4720004810 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472800fae0 con 0x7f4720004810 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47380c7a40 con 0x7f4720004810 2023-10-07T08:58:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800fea0 con 0x7f4720004810 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.418+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47380c84a0 con 0x7f4720004810 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.419+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47380c7880 con 0x7f4720004810 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.420+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4728013600 con 0x7f4720004810 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.420+0000 7f471f7fe700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 0x7f47240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.420+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4728084570 con 0x7f4720004810 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.420+0000 7f4736ffd700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 0x7f47240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.421+0000 7f4736ffd700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 0x7f47240693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47380cad90 tx=0x7f472c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.424+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47280517e0 con 0x7f4720004810 2023-10-07T08:58:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.664+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f473804c3c0 con 0x7f4720004810 2023-10-07T08:58:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.664+0000 7f471f7fe700 1 -- 172.21.15.46:0/859856293 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f4728054e00 con 0x7f4720004810 2023-10-07T08:58:41.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:41.666 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:58:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 msgr2=0x7f47240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 0x7f47240693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47380cad90 tx=0x7f472c01a000 comp rx=0 tx=0).stop 2023-10-07T08:58:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 msgr2=0x7f4738142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4728002b00 tx=0x7f4728007d30 comp rx=0 tx=0).stop 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 shutdown_connections 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4724066f30 0x7f47240693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47381580e0 0x7f47380c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4720004810 0x7f4738142a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 --2- 172.21.15.46:0/859856293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4738142f70 0x7f4738157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 >> 172.21.15.46:0/859856293 conn(0x7f4738068e20 msgr2=0x7f4738155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.666+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 shutdown_connections 2023-10-07T08:58:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.667+0000 7f473db97700 1 -- 172.21.15.46:0/859856293 wait complete. 2023-10-07T08:58:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:58:41.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.798+0000 7f5020a11700 1 Processor -- start 2023-10-07T08:58:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.798+0000 7f5020a11700 1 -- start start 2023-10-07T08:58:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f5020a11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 0x7f501c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f5020a11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f5020a11700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c0b11d0 con 0x7f501c15d230 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f5020a11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0b14b0 con 0x7f501c159420 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f5020a11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b1790 con 0x7f501c1597f0 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 0x7f501c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:56918/0 (socket says 172.21.15.46:56918) 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 0x7f501c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33320/0 (socket says 172.21.15.46:33320) 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 -- 172.21.15.46:0/131363796 learned_addr learned my addr 172.21.15.46:0/131363796 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501bfff700 1 --1- 172.21.15.46:0/131363796 >> v1:172.21.15.133:6789/0 conn(0x7f501c15d230 0x7f501c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39568/0 (socket says 172.21.15.46:39568) 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 -- 172.21.15.46:0/131363796 >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 msgr2=0x7f501c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:41.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 --2- 172.21.15.46:0/131363796 >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 0x7f501c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.799+0000 7f501affd700 1 -- 172.21.15.46:0/131363796 >> v1:172.21.15.133:6789/0 conn(0x7f501c15d230 legacy=0x7f501c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f501affd700 1 -- 172.21.15.46:0/131363796 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0b1a70 con 0x7f501c1597f0 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f501affd700 1 --2- 172.21.15.46:0/131363796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50100099b0 tx=0x7f5010009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970184ed6d785b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f501a7fc700 1 -- 172.21.15.46:0/131363796 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010009ea0 con 0x7f501c1597f0 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f501a7fc700 1 -- 172.21.15.46:0/131363796 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000b860 con 0x7f501c1597f0 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f501a7fc700 1 -- 172.21.15.46:0/131363796 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000bc00 con 0x7f501c1597f0 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 -- 172.21.15.46:0/131363796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 msgr2=0x7f501c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 --2- 172.21.15.46:0/131363796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50100099b0 tx=0x7f5010009250 comp rx=0 tx=0).stop 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 -- 172.21.15.46:0/131363796 shutdown_connections 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 --2- 172.21.15.46:0/131363796 >> v2:172.21.15.133:3300/0 conn(0x7f501c159420 0x7f501c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 --2- 172.21.15.46:0/131363796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c1597f0 0x7f501c0b2270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 -- 172.21.15.46:0/131363796 >> 172.21.15.46:0/131363796 conn(0x7f501c0d0660 msgr2=0x7f501c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.800+0000 7f5020a11700 1 -- 172.21.15.46:0/131363796 shutdown_connections 2023-10-07T08:58:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.801+0000 7f5020a11700 1 -- 172.21.15.46:0/131363796 wait complete. 2023-10-07T08:58:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 Processor -- start 2023-10-07T08:58:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 -- start start 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 0x7f501c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 0x7f501c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c16ae40 con 0x7f501c15d230 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15a0b0 con 0x7f501c1597f0 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.802+0000 7f5020a11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c151e70 con 0x7f501c159420 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60262/0 (socket says 172.21.15.46:60262) 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 -- 172.21.15.46:0/3437895233 learned_addr learned my addr 172.21.15.46:0/3437895233 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501affd700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 0x7f501c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501b7fe700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 0x7f501c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 -- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 msgr2=0x7f501c14d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 0x7f501c14d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 -- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 msgr2=0x7f501c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 0x7f501c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 -- 172.21.15.46:0/3437895233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100094f0 con 0x7f501c15d230 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501affd700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 0x7f501c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501b7fe700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 0x7f501c14d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f501bfff700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f501400cc70 tx=0x7f5014001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014005df0 con 0x7f501c15d230 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400a5b0 con 0x7f501c15d230 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c152150 con 0x7f501c15d230 2023-10-07T08:58:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400a930 con 0x7f501c15d230 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.803+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c159d40 con 0x7f501c15d230 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.804+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c04c3c0 con 0x7f501c15d230 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.805+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f501400aca0 con 0x7f501c15d230 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.805+0000 7f50037fe700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 0x7f50080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.805+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50140844a0 con 0x7f501c15d230 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.805+0000 7f501b7fe700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 0x7f50080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.806+0000 7f501b7fe700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 0x7f50080693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501c06a360 tx=0x7f500c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:41.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:41.810+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5014051840 con 0x7f501c15d230 2023-10-07T08:58:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.002+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f501c0b1d50 con 0x7f501c15d230 2023-10-07T08:58:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.003+0000 7f50037fe700 1 -- 172.21.15.46:0/3437895233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5014054e60 con 0x7f501c15d230 2023-10-07T08:58:42.005 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:42.005 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 msgr2=0x7f50080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 0x7f50080693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501c06a360 tx=0x7f500c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 msgr2=0x7f501c152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f501400cc70 tx=0x7f5014001a70 comp rx=0 tx=0).stop 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 shutdown_connections 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5008066f30 0x7f50080693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f501c15d230 0x7f501c152d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f501c159420 0x7f501c14d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 --2- 172.21.15.46:0/3437895233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c1597f0 0x7f501c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 >> 172.21.15.46:0/3437895233 conn(0x7f501c0d0660 msgr2=0x7f501c15d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 shutdown_connections 2023-10-07T08:58:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.005+0000 7f5020a11700 1 -- 172.21.15.46:0/3437895233 wait complete. 2023-10-07T08:58:42.019 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:58:42.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:58:42.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.137+0000 7ff4060d8700 1 Processor -- start 2023-10-07T08:58:42.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.137+0000 7ff4060d8700 1 -- start start 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.137+0000 7ff4060d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff40006bcd0 0x7ff400140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.137+0000 7ff4060d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff4060d8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40015c2a0 con 0x7ff4000c8e00 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff4060d8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40015b690 con 0x7ff40006bcd0 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff4060d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40015b970 con 0x7ff40006c0a0 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff40006bcd0 0x7ff400140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff4000c8e00 0x7ff4000c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54648/0 (socket says 172.21.15.46:54648) 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fffff700 1 -- 172.21.15.46:0/1991691302 learned_addr learned my addr 172.21.15.46:0/1991691302 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3feffd700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/1991691302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 msgr2=0x7ff400141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/1991691302 >> v1:172.21.15.46:6789/0 conn(0x7ff4000c8e00 legacy=0x7ff4000c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fe7fc700 1 -- 172.21.15.46:0/1991691302 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673582660 0 0) 0x7ff40015c2a0 con 0x7ff4000c8e00 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/1991691302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40015bc50 con 0x7ff40006bcd0 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3ff7fe700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff400140df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098e0 tx=0x7ff3f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2356d937a846b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fe7fc700 1 -- 172.21.15.46:0/1991691302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0009e80 con 0x7ff40006bcd0 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fe7fc700 1 -- 172.21.15.46:0/1991691302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f000b860 con 0x7ff40006bcd0 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.138+0000 7ff3fe7fc700 1 -- 172.21.15.46:0/1991691302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000bbe0 con 0x7ff40006bcd0 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 -- 172.21.15.46:0/1991691302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 msgr2=0x7ff400140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff400140df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098e0 tx=0x7ff3f00091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 -- 172.21.15.46:0/1991691302 shutdown_connections 2023-10-07T08:58:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff400140df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 --2- 172.21.15.46:0/1991691302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 -- 172.21.15.46:0/1991691302 >> 172.21.15.46:0/1991691302 conn(0x7ff4000ce600 msgr2=0x7ff4000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 -- 172.21.15.46:0/1991691302 shutdown_connections 2023-10-07T08:58:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.139+0000 7ff4060d8700 1 -- 172.21.15.46:0/1991691302 wait complete. 2023-10-07T08:58:42.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.140+0000 7ff4060d8700 1 Processor -- start 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.140+0000 7ff4060d8700 1 -- start start 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4000c8e00 0x7ff4001579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff400156730 con 0x7ff40006bcd0 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40013b1f0 con 0x7ff4000c8e00 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff4060d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40013b4d0 con 0x7ff40006c0a0 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60282/0 (socket says 172.21.15.46:60282) 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/3112873300 learned_addr learned my addr 172.21.15.46:0/3112873300 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3feffd700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3fffff700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4000c8e00 0x7ff4001579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 msgr2=0x7ff400157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4000c8e00 msgr2=0x7ff4001579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4000c8e00 0x7ff4001579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 -- 172.21.15.46:0/3112873300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009420 con 0x7ff40006bcd0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3feffd700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3ff7fe700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff400069220 tx=0x7ff3f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000bbe0 con 0x7ff40006bcd0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.141+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0011420 con 0x7ff40006bcd0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.142+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40013b7b0 con 0x7ff40006bcd0 2023-10-07T08:58:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.142+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00117c0 con 0x7ff40006bcd0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.142+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40013bd70 con 0x7ff40006bcd0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.143+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40004c3c0 con 0x7ff40006bcd0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.143+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3f0011bb0 con 0x7ff40006bcd0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.143+0000 7ff3e77fe700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 0x7ff3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.144+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3f0085ed0 con 0x7ff40006bcd0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.144+0000 7ff3feffd700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 0x7ff3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.144+0000 7ff3feffd700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 0x7ff3ec0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff400139cb0 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.148+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3f0053140 con 0x7ff40006bcd0 2023-10-07T08:58:42.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.339+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff40013b640 con 0x7ff3ec066f30 2023-10-07T08:58:42.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.348+0000 7ff3e77fe700 1 -- 172.21.15.46:0/3112873300 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264611 (secure 0 0 0) 0x7ff40013b640 con 0x7ff3ec066f30 2023-10-07T08:58:42.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:42.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 msgr2=0x7ff3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 0x7ff3ec0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff400139cb0 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 msgr2=0x7ff4001561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff400069220 tx=0x7ff3f0017000 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 shutdown_connections 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec066f30 0x7ff3ec0693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4000c8e00 0x7ff4001579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40006bcd0 0x7ff4001561f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 --2- 172.21.15.46:0/3112873300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40006c0a0 0x7ff400157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 >> 172.21.15.46:0/3112873300 conn(0x7ff4000ce600 msgr2=0x7ff4000c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 shutdown_connections 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.351+0000 7ff4060d8700 1 -- 172.21.15.46:0/3112873300 wait complete. 2023-10-07T08:58:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:58:42.365 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-07T08:58:41.762423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381176,"kb_used_data":2872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593544,"statfs":{"total":773094113280,"available":770655789056,"internally_reserved":0,"allocated":2940928,"data_stored":1762700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.518553"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269469+0000","last_change":"2023-10-07T08:58:38.267255+0000","last_active":"2023-10-07T08:58:38.269469+0000","last_peered":"2023-10-07T08:58:38.269469+0000","last_clean":"2023-10-07T08:58:38.269469+0000","last_became_active":"2023-10-07T08:58:38.266659+0000","last_became_peered":"2023-10-07T08:58:38.266659+0000","last_unstale":"2023-10-07T08:58:38.269469+0000","last_undegraded":"2023-10-07T08:58:38.269469+0000","last_fullsized":"2023-10-07T08:58:38.269469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271311+0000","last_change":"2023-10-07T08:58:38.267764+0000","last_active":"2023-10-07T08:58:38.271311+0000","last_peered":"2023-10-07T08:58:38.271311+0000","last_clean":"2023-10-07T08:58:38.271311+0000","last_became_active":"2023-10-07T08:58:38.267465+0000","last_became_peered":"2023-10-07T08:58:38.267465+0000","last_unstale":"2023-10-07T08:58:38.271311+0000","last_undegraded":"2023-10-07T08:58:38.271311+0000","last_fullsized":"2023-10-07T08:58:38.271311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277699+0000","last_change":"2023-10-07T08:58:38.266617+0000","last_active":"2023-10-07T08:58:38.277699+0000","last_peered":"2023-10-07T08:58:38.277699+0000","last_clean":"2023-10-07T08:58:38.277699+0000","last_became_active":"2023-10-07T08:58:38.266163+0000","last_became_peered":"2023-10-07T08:58:38.266163+0000","last_unstale":"2023-10-07T08:58:38.277699+0000","last_undegraded":"2023-10-07T08:58:38.277699+0000","last_fullsized":"2023-10-07T08:58:38.277699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263351+0000","last_change":"2023-10-07T08:58:38.263351+0000","last_active":"2023-10-07T08:58:38.263351+0000","last_peered":"2023-10-07T08:58:38.263351+0000","last_clean":"2023-10-07T08:58:38.263351+0000","last_became_active":"2023-10-07T08:58:38.262967+0000","last_became_peered":"2023-10-07T08:58:38.262967+0000","last_unstale":"2023-10-07T08:58:38.263351+0000","last_undegraded":"2023-10-07T08:58:38.263351+0000","last_fullsized":"2023-10-07T08:58:38.263351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268506+0000","last_change":"2023-10-07T08:58:38.266316+0000","last_active":"2023-10-07T08:58:38.268506+0000","last_peered":"2023-10-07T08:58:38.268506+0000","last_clean":"2023-10-07T08:58:38.268506+0000","last_became_active":"2023-10-07T08:58:38.266017+0000","last_became_peered":"2023-10-07T08:58:38.266017+0000","last_unstale":"2023-10-07T08:58:38.268506+0000","last_undegraded":"2023-10-07T08:58:38.268506+0000","last_fullsized":"2023-10-07T08:58:38.268506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278399+0000","last_change":"2023-10-07T08:58:38.278399+0000","last_active":"2023-10-07T08:58:38.278399+0000","last_peered":"2023-10-07T08:58:38.278399+0000","last_clean":"2023-10-07T08:58:38.278399+0000","last_became_active":"2023-10-07T08:58:38.278131+0000","last_became_peered":"2023-10-07T08:58:38.278131+0000","last_unstale":"2023-10-07T08:58:38.278399+0000","last_undegraded":"2023-10-07T08:58:38.278399+0000","last_fullsized":"2023-10-07T08:58:38.278399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278620+0000","last_change":"2023-10-07T08:58:38.274141+0000","last_active":"2023-10-07T08:58:38.278620+0000","last_peered":"2023-10-07T08:58:38.278620+0000","last_clean":"2023-10-07T08:58:38.278620+0000","last_became_active":"2023-10-07T08:58:38.273855+0000","last_became_peered":"2023-10-07T08:58:38.273855+0000","last_unstale":"2023-10-07T08:58:38.278620+0000","last_undegraded":"2023-10-07T08:58:38.278620+0000","last_fullsized":"2023-10-07T08:58:38.278620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270600+0000","last_change":"2023-10-07T08:58:38.270600+0000","last_active":"2023-10-07T08:58:38.270600+0000","last_peered":"2023-10-07T08:58:38.270600+0000","last_clean":"2023-10-07T08:58:38.270600+0000","last_became_active":"2023-10-07T08:58:38.270310+0000","last_became_peered":"2023-10-07T08:58:38.270310+0000","last_unstale":"2023-10-07T08:58:38.270600+0000","last_undegraded":"2023-10-07T08:58:38.270600+0000","last_fullsized":"2023-10-07T08:58:38.270600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269449+0000","last_change":"2023-10-07T08:58:38.267490+0000","last_active":"2023-10-07T08:58:38.269449+0000","last_peered":"2023-10-07T08:58:38.269449+0000","last_clean":"2023-10-07T08:58:38.269449+0000","last_became_active":"2023-10-07T08:58:38.267089+0000","last_became_peered":"2023-10-07T08:58:38.267089+0000","last_unstale":"2023-10-07T08:58:38.269449+0000","last_undegraded":"2023-10-07T08:58:38.269449+0000","last_fullsized":"2023-10-07T08:58:38.269449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267172+0000","last_change":"2023-10-07T08:58:38.267172+0000","last_active":"2023-10-07T08:58:38.267172+0000","last_peered":"2023-10-07T08:58:38.267172+0000","last_clean":"2023-10-07T08:58:38.267172+0000","last_became_active":"2023-10-07T08:58:38.266880+0000","last_became_peered":"2023-10-07T08:58:38.266880+0000","last_unstale":"2023-10-07T08:58:38.267172+0000","last_undegraded":"2023-10-07T08:58:38.267172+0000","last_fullsized":"2023-10-07T08:58:38.267172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267001+0000","last_change":"2023-10-07T08:58:38.267001+0000","last_active":"2023-10-07T08:58:38.267001+0000","last_peered":"2023-10-07T08:58:38.267001+0000","last_clean":"2023-10-07T08:58:38.267001+0000","last_became_active":"2023-10-07T08:58:38.266492+0000","last_became_peered":"2023-10-07T08:58:38.266492+0000","last_unstale":"2023-10-07T08:58:38.267001+0000","last_undegraded":"2023-10-07T08:58:38.267001+0000","last_fullsized":"2023-10-07T08:58:38.267001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273887+0000","last_change":"2023-10-07T08:58:38.264386+0000","last_active":"2023-10-07T08:58:38.273887+0000","last_peered":"2023-10-07T08:58:38.273887+0000","last_clean":"2023-10-07T08:58:38.273887+0000","last_became_active":"2023-10-07T08:58:38.264124+0000","last_became_peered":"2023-10-07T08:58:38.264124+0000","last_unstale":"2023-10-07T08:58:38.273887+0000","last_undegraded":"2023-10-07T08:58:38.273887+0000","last_fullsized":"2023-10-07T08:58:38.273887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:30.530699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263696+0000","last_change":"2023-10-07T08:58:38.263696+0000","last_active":"2023-10-07T08:58:38.263696+0000","last_peered":"2023-10-07T08:58:38.263696+0000","last_clean":"2023-10-07T08:58:38.263696+0000","last_became_active":"2023-10-07T08:58:38.263363+0000","last_became_peered":"2023-10-07T08:58:38.263363+0000","last_unstale":"2023-10-07T08:58:38.263696+0000","last_undegraded":"2023-10-07T08:58:38.263696+0000","last_fullsized":"2023-10-07T08:58:38.263696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277744+0000","last_change":"2023-10-07T08:58:38.267349+0000","last_active":"2023-10-07T08:58:38.277744+0000","last_peered":"2023-10-07T08:58:38.277744+0000","last_clean":"2023-10-07T08:58:38.277744+0000","last_became_active":"2023-10-07T08:58:38.266917+0000","last_became_peered":"2023-10-07T08:58:38.266917+0000","last_unstale":"2023-10-07T08:58:38.277744+0000","last_undegraded":"2023-10-07T08:58:38.277744+0000","last_fullsized":"2023-10-07T08:58:38.277744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:59.205812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.262424+0000","last_change":"2023-10-07T08:58:38.259339+0000","last_active":"2023-10-07T08:58:38.262424+0000","last_peered":"2023-10-07T08:58:38.262424+0000","last_clean":"2023-10-07T08:58:38.262424+0000","last_became_active":"2023-10-07T08:58:38.258971+0000","last_became_peered":"2023-10-07T08:58:38.258971+0000","last_unstale":"2023-10-07T08:58:38.262424+0000","last_undegraded":"2023-10-07T08:58:38.262424+0000","last_fullsized":"2023-10-07T08:58:38.262424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278767+0000","last_change":"2023-10-07T08:58:38.278767+0000","last_active":"2023-10-07T08:58:38.278767+0000","last_peered":"2023-10-07T08:58:38.278767+0000","last_clean":"2023-10-07T08:58:38.278767+0000","last_became_active":"2023-10-07T08:58:38.278528+0000","last_became_peered":"2023-10-07T08:58:38.278528+0000","last_unstale":"2023-10-07T08:58:38.278767+0000","last_undegraded":"2023-10-07T08:58:38.278767+0000","last_fullsized":"2023-10-07T08:58:38.278767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269363+0000","last_change":"2023-10-07T08:58:38.269363+0000","last_active":"2023-10-07T08:58:38.269363+0000","last_peered":"2023-10-07T08:58:38.269363+0000","last_clean":"2023-10-07T08:58:38.269363+0000","last_became_active":"2023-10-07T08:58:38.269065+0000","last_became_peered":"2023-10-07T08:58:38.269065+0000","last_unstale":"2023-10-07T08:58:38.269363+0000","last_undegraded":"2023-10-07T08:58:38.269363+0000","last_fullsized":"2023-10-07T08:58:38.269363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269575+0000","last_change":"2023-10-07T08:58:38.269575+0000","last_active":"2023-10-07T08:58:38.269575+0000","last_peered":"2023-10-07T08:58:38.269575+0000","last_clean":"2023-10-07T08:58:38.269575+0000","last_became_active":"2023-10-07T08:58:38.268895+0000","last_became_peered":"2023-10-07T08:58:38.268895+0000","last_unstale":"2023-10-07T08:58:38.269575+0000","last_undegraded":"2023-10-07T08:58:38.269575+0000","last_fullsized":"2023-10-07T08:58:38.269575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:32.828536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269484+0000","last_change":"2023-10-07T08:58:38.267862+0000","last_active":"2023-10-07T08:58:38.269484+0000","last_peered":"2023-10-07T08:58:38.269484+0000","last_clean":"2023-10-07T08:58:38.269484+0000","last_became_active":"2023-10-07T08:58:38.267577+0000","last_became_peered":"2023-10-07T08:58:38.267577+0000","last_unstale":"2023-10-07T08:58:38.269484+0000","last_undegraded":"2023-10-07T08:58:38.269484+0000","last_fullsized":"2023-10-07T08:58:38.269484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284044+0000","last_change":"2023-10-07T08:58:37.268088+0000","last_active":"2023-10-07T08:58:38.284044+0000","last_peered":"2023-10-07T08:58:38.284044+0000","last_clean":"2023-10-07T08:58:38.284044+0000","last_became_active":"2023-10-07T08:58:37.267728+0000","last_became_peered":"2023-10-07T08:58:37.267728+0000","last_unstale":"2023-10-07T08:58:38.284044+0000","last_undegraded":"2023-10-07T08:58:38.284044+0000","last_fullsized":"2023-10-07T08:58:38.284044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:45.288025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268443+0000","last_change":"2023-10-07T08:58:38.268443+0000","last_active":"2023-10-07T08:58:38.268443+0000","last_peered":"2023-10-07T08:58:38.268443+0000","last_clean":"2023-10-07T08:58:38.268443+0000","last_became_active":"2023-10-07T08:58:38.268155+0000","last_became_peered":"2023-10-07T08:58:38.268155+0000","last_unstale":"2023-10-07T08:58:38.268443+0000","last_undegraded":"2023-10-07T08:58:38.268443+0000","last_fullsized":"2023-10-07T08:58:38.268443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.255494+0000","last_change":"2023-10-07T08:58:37.269548+0000","last_active":"2023-10-07T08:58:38.255494+0000","last_peered":"2023-10-07T08:58:38.255494+0000","last_clean":"2023-10-07T08:58:38.255494+0000","last_became_active":"2023-10-07T08:58:37.266826+0000","last_became_peered":"2023-10-07T08:58:37.266826+0000","last_unstale":"2023-10-07T08:58:38.255494+0000","last_undegraded":"2023-10-07T08:58:38.255494+0000","last_fullsized":"2023-10-07T08:58:38.255494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:35.767431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279027+0000","last_change":"2023-10-07T08:58:38.272914+0000","last_active":"2023-10-07T08:58:38.279027+0000","last_peered":"2023-10-07T08:58:38.279027+0000","last_clean":"2023-10-07T08:58:38.279027+0000","last_became_active":"2023-10-07T08:58:38.269972+0000","last_became_peered":"2023-10-07T08:58:38.269972+0000","last_unstale":"2023-10-07T08:58:38.279027+0000","last_undegraded":"2023-10-07T08:58:38.279027+0000","last_fullsized":"2023-10-07T08:58:38.279027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283986+0000","last_change":"2023-10-07T08:58:37.266654+0000","last_active":"2023-10-07T08:58:38.283986+0000","last_peered":"2023-10-07T08:58:38.283986+0000","last_clean":"2023-10-07T08:58:38.283986+0000","last_became_active":"2023-10-07T08:58:37.266400+0000","last_became_peered":"2023-10-07T08:58:37.266400+0000","last_unstale":"2023-10-07T08:58:38.283986+0000","last_undegraded":"2023-10-07T08:58:38.283986+0000","last_fullsized":"2023-10-07T08:58:38.283986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.824130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266906+0000","last_change":"2023-10-07T08:58:38.266906+0000","last_active":"2023-10-07T08:58:38.266906+0000","last_peered":"2023-10-07T08:58:38.266906+0000","last_clean":"2023-10-07T08:58:38.266906+0000","last_became_active":"2023-10-07T08:58:38.266625+0000","last_became_peered":"2023-10-07T08:58:38.266625+0000","last_unstale":"2023-10-07T08:58:38.266906+0000","last_undegraded":"2023-10-07T08:58:38.266906+0000","last_fullsized":"2023-10-07T08:58:38.266906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283998+0000","last_change":"2023-10-07T08:58:37.270622+0000","last_active":"2023-10-07T08:58:38.283998+0000","last_peered":"2023-10-07T08:58:38.283998+0000","last_clean":"2023-10-07T08:58:38.283998+0000","last_became_active":"2023-10-07T08:58:37.270351+0000","last_became_peered":"2023-10-07T08:58:37.270351+0000","last_unstale":"2023-10-07T08:58:38.283998+0000","last_undegraded":"2023-10-07T08:58:38.283998+0000","last_fullsized":"2023-10-07T08:58:38.283998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273162+0000","last_change":"2023-10-07T08:58:38.273162+0000","last_active":"2023-10-07T08:58:38.273162+0000","last_peered":"2023-10-07T08:58:38.273162+0000","last_clean":"2023-10-07T08:58:38.273162+0000","last_became_active":"2023-10-07T08:58:38.272826+0000","last_became_peered":"2023-10-07T08:58:38.272826+0000","last_unstale":"2023-10-07T08:58:38.273162+0000","last_undegraded":"2023-10-07T08:58:38.273162+0000","last_fullsized":"2023-10-07T08:58:38.273162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.254600+0000","last_change":"2023-10-07T08:58:37.271548+0000","last_active":"2023-10-07T08:58:38.254600+0000","last_peered":"2023-10-07T08:58:38.254600+0000","last_clean":"2023-10-07T08:58:38.254600+0000","last_became_active":"2023-10-07T08:58:37.271240+0000","last_became_peered":"2023-10-07T08:58:37.271240+0000","last_unstale":"2023-10-07T08:58:38.254600+0000","last_undegraded":"2023-10-07T08:58:38.254600+0000","last_fullsized":"2023-10-07T08:58:38.254600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269827+0000","last_change":"2023-10-07T08:58:38.260549+0000","last_active":"2023-10-07T08:58:38.269827+0000","last_peered":"2023-10-07T08:58:38.269827+0000","last_clean":"2023-10-07T08:58:38.269827+0000","last_became_active":"2023-10-07T08:58:38.260271+0000","last_became_peered":"2023-10-07T08:58:38.260271+0000","last_unstale":"2023-10-07T08:58:38.269827+0000","last_undegraded":"2023-10-07T08:58:38.269827+0000","last_fullsized":"2023-10-07T08:58:38.269827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:53.298964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260298+0000","last_change":"2023-10-07T08:58:37.263334+0000","last_active":"2023-10-07T08:58:38.260298+0000","last_peered":"2023-10-07T08:58:38.260298+0000","last_clean":"2023-10-07T08:58:38.260298+0000","last_became_active":"2023-10-07T08:58:37.263022+0000","last_became_peered":"2023-10-07T08:58:37.263022+0000","last_unstale":"2023-10-07T08:58:38.260298+0000","last_undegraded":"2023-10-07T08:58:38.260298+0000","last_fullsized":"2023-10-07T08:58:38.260298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279664+0000","last_change":"2023-10-07T08:58:38.274587+0000","last_active":"2023-10-07T08:58:38.279664+0000","last_peered":"2023-10-07T08:58:38.279664+0000","last_clean":"2023-10-07T08:58:38.279664+0000","last_became_active":"2023-10-07T08:58:38.273574+0000","last_became_peered":"2023-10-07T08:58:38.273574+0000","last_unstale":"2023-10-07T08:58:38.279664+0000","last_undegraded":"2023-10-07T08:58:38.279664+0000","last_fullsized":"2023-10-07T08:58:38.279664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.272027+0000","last_change":"2023-10-07T08:58:37.267552+0000","last_active":"2023-10-07T08:58:37.272027+0000","last_peered":"2023-10-07T08:58:37.272027+0000","last_clean":"2023-10-07T08:58:37.272027+0000","last_became_active":"2023-10-07T08:58:37.266917+0000","last_became_peered":"2023-10-07T08:58:37.266917+0000","last_unstale":"2023-10-07T08:58:37.272027+0000","last_undegraded":"2023-10-07T08:58:37.272027+0000","last_fullsized":"2023-10-07T08:58:37.272027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264169+0000","last_change":"2023-10-07T08:58:38.264169+0000","last_active":"2023-10-07T08:58:38.264169+0000","last_peered":"2023-10-07T08:58:38.264169+0000","last_clean":"2023-10-07T08:58:38.264169+0000","last_became_active":"2023-10-07T08:58:38.263551+0000","last_became_peered":"2023-10-07T08:58:38.263551+0000","last_unstale":"2023-10-07T08:58:38.264169+0000","last_undegraded":"2023-10-07T08:58:38.264169+0000","last_fullsized":"2023-10-07T08:58:38.264169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.262007+0000","last_change":"2023-10-07T08:58:37.259060+0000","last_active":"2023-10-07T08:58:37.262007+0000","last_peered":"2023-10-07T08:58:37.262007+0000","last_clean":"2023-10-07T08:58:37.262007+0000","last_became_active":"2023-10-07T08:58:37.258771+0000","last_became_peered":"2023-10-07T08:58:37.258771+0000","last_unstale":"2023-10-07T08:58:37.262007+0000","last_undegraded":"2023-10-07T08:58:37.262007+0000","last_fullsized":"2023-10-07T08:58:37.262007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265345+0000","last_change":"2023-10-07T08:58:38.262529+0000","last_active":"2023-10-07T08:58:38.265345+0000","last_peered":"2023-10-07T08:58:38.265345+0000","last_clean":"2023-10-07T08:58:38.265345+0000","last_became_active":"2023-10-07T08:58:38.262257+0000","last_became_peered":"2023-10-07T08:58:38.262257+0000","last_unstale":"2023-10-07T08:58:38.265345+0000","last_undegraded":"2023-10-07T08:58:38.265345+0000","last_fullsized":"2023-10-07T08:58:38.265345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.271009+0000","last_change":"2023-10-07T08:58:37.269527+0000","last_active":"2023-10-07T08:58:37.271009+0000","last_peered":"2023-10-07T08:58:37.271009+0000","last_clean":"2023-10-07T08:58:37.271009+0000","last_became_active":"2023-10-07T08:58:37.269253+0000","last_became_peered":"2023-10-07T08:58:37.269253+0000","last_unstale":"2023-10-07T08:58:37.271009+0000","last_undegraded":"2023-10-07T08:58:37.271009+0000","last_fullsized":"2023-10-07T08:58:37.271009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268883+0000","last_change":"2023-10-07T08:58:38.268883+0000","last_active":"2023-10-07T08:58:38.268883+0000","last_peered":"2023-10-07T08:58:38.268883+0000","last_clean":"2023-10-07T08:58:38.268883+0000","last_became_active":"2023-10-07T08:58:38.268618+0000","last_became_peered":"2023-10-07T08:58:38.268618+0000","last_unstale":"2023-10-07T08:58:38.268883+0000","last_undegraded":"2023-10-07T08:58:38.268883+0000","last_fullsized":"2023-10-07T08:58:38.268883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270033+0000","last_change":"2023-10-07T08:58:37.268203+0000","last_active":"2023-10-07T08:58:37.270033+0000","last_peered":"2023-10-07T08:58:37.270033+0000","last_clean":"2023-10-07T08:58:37.270033+0000","last_became_active":"2023-10-07T08:58:37.267942+0000","last_became_peered":"2023-10-07T08:58:37.267942+0000","last_unstale":"2023-10-07T08:58:37.270033+0000","last_undegraded":"2023-10-07T08:58:37.270033+0000","last_fullsized":"2023-10-07T08:58:37.270033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279006+0000","last_change":"2023-10-07T08:58:38.272764+0000","last_active":"2023-10-07T08:58:38.279006+0000","last_peered":"2023-10-07T08:58:38.279006+0000","last_clean":"2023-10-07T08:58:38.279006+0000","last_became_active":"2023-10-07T08:58:38.267664+0000","last_became_peered":"2023-10-07T08:58:38.267664+0000","last_unstale":"2023-10-07T08:58:38.279006+0000","last_undegraded":"2023-10-07T08:58:38.279006+0000","last_fullsized":"2023-10-07T08:58:38.279006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284633+0000","last_change":"2023-10-07T08:58:37.263922+0000","last_active":"2023-10-07T08:58:38.284633+0000","last_peered":"2023-10-07T08:58:38.284633+0000","last_clean":"2023-10-07T08:58:38.284633+0000","last_became_active":"2023-10-07T08:58:37.263582+0000","last_became_peered":"2023-10-07T08:58:37.263582+0000","last_unstale":"2023-10-07T08:58:38.284633+0000","last_undegraded":"2023-10-07T08:58:38.284633+0000","last_fullsized":"2023-10-07T08:58:38.284633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273905+0000","last_change":"2023-10-07T08:58:38.265834+0000","last_active":"2023-10-07T08:58:38.273905+0000","last_peered":"2023-10-07T08:58:38.273905+0000","last_clean":"2023-10-07T08:58:38.273905+0000","last_became_active":"2023-10-07T08:58:38.265379+0000","last_became_peered":"2023-10-07T08:58:38.265379+0000","last_unstale":"2023-10-07T08:58:38.273905+0000","last_undegraded":"2023-10-07T08:58:38.273905+0000","last_fullsized":"2023-10-07T08:58:38.273905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:15.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284062+0000","last_change":"2023-10-07T08:58:37.268160+0000","last_active":"2023-10-07T08:58:38.284062+0000","last_peered":"2023-10-07T08:58:38.284062+0000","last_clean":"2023-10-07T08:58:38.284062+0000","last_became_active":"2023-10-07T08:58:37.267825+0000","last_became_peered":"2023-10-07T08:58:37.267825+0000","last_unstale":"2023-10-07T08:58:38.284062+0000","last_undegraded":"2023-10-07T08:58:38.284062+0000","last_fullsized":"2023-10-07T08:58:38.284062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276370+0000","last_change":"2023-10-07T08:58:38.271252+0000","last_active":"2023-10-07T08:58:38.276370+0000","last_peered":"2023-10-07T08:58:38.276370+0000","last_clean":"2023-10-07T08:58:38.276370+0000","last_became_active":"2023-10-07T08:58:38.270444+0000","last_became_peered":"2023-10-07T08:58:38.270444+0000","last_unstale":"2023-10-07T08:58:38.276370+0000","last_undegraded":"2023-10-07T08:58:38.276370+0000","last_fullsized":"2023-10-07T08:58:38.276370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284697+0000","last_change":"2023-10-07T08:58:37.265067+0000","last_active":"2023-10-07T08:58:38.284697+0000","last_peered":"2023-10-07T08:58:38.284697+0000","last_clean":"2023-10-07T08:58:38.284697+0000","last_became_active":"2023-10-07T08:58:37.264758+0000","last_became_peered":"2023-10-07T08:58:37.264758+0000","last_unstale":"2023-10-07T08:58:38.284697+0000","last_undegraded":"2023-10-07T08:58:38.284697+0000","last_fullsized":"2023-10-07T08:58:38.284697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.165187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278973+0000","last_change":"2023-10-07T08:58:38.273936+0000","last_active":"2023-10-07T08:58:38.278973+0000","last_peered":"2023-10-07T08:58:38.278973+0000","last_clean":"2023-10-07T08:58:38.278973+0000","last_became_active":"2023-10-07T08:58:38.267851+0000","last_became_peered":"2023-10-07T08:58:38.267851+0000","last_unstale":"2023-10-07T08:58:38.278973+0000","last_undegraded":"2023-10-07T08:58:38.278973+0000","last_fullsized":"2023-10-07T08:58:38.278973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:27.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270652+0000","last_change":"2023-10-07T08:58:37.266407+0000","last_active":"2023-10-07T08:58:37.270652+0000","last_peered":"2023-10-07T08:58:37.270652+0000","last_clean":"2023-10-07T08:58:37.270652+0000","last_became_active":"2023-10-07T08:58:37.266126+0000","last_became_peered":"2023-10-07T08:58:37.266126+0000","last_unstale":"2023-10-07T08:58:37.270652+0000","last_undegraded":"2023-10-07T08:58:37.270652+0000","last_fullsized":"2023-10-07T08:58:37.270652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280719+0000","last_change":"2023-10-07T08:58:38.278017+0000","last_active":"2023-10-07T08:58:38.280719+0000","last_peered":"2023-10-07T08:58:38.280719+0000","last_clean":"2023-10-07T08:58:38.280719+0000","last_became_active":"2023-10-07T08:58:38.277742+0000","last_became_peered":"2023-10-07T08:58:38.277742+0000","last_unstale":"2023-10-07T08:58:38.280719+0000","last_undegraded":"2023-10-07T08:58:38.280719+0000","last_fullsized":"2023-10-07T08:58:38.280719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.264976+0000","last_change":"2023-10-07T08:58:37.264042+0000","last_active":"2023-10-07T08:58:37.264976+0000","last_peered":"2023-10-07T08:58:37.264976+0000","last_clean":"2023-10-07T08:58:37.264976+0000","last_became_active":"2023-10-07T08:58:37.263461+0000","last_became_peered":"2023-10-07T08:58:37.263461+0000","last_unstale":"2023-10-07T08:58:37.264976+0000","last_undegraded":"2023-10-07T08:58:37.264976+0000","last_fullsized":"2023-10-07T08:58:37.264976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276672+0000","last_change":"2023-10-07T08:58:38.276672+0000","last_active":"2023-10-07T08:58:38.276672+0000","last_peered":"2023-10-07T08:58:38.276672+0000","last_clean":"2023-10-07T08:58:38.276672+0000","last_became_active":"2023-10-07T08:58:38.275867+0000","last_became_peered":"2023-10-07T08:58:38.275867+0000","last_unstale":"2023-10-07T08:58:38.276672+0000","last_undegraded":"2023-10-07T08:58:38.276672+0000","last_fullsized":"2023-10-07T08:58:38.276672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276567+0000","last_change":"2023-10-07T08:58:37.259625+0000","last_active":"2023-10-07T08:58:38.276567+0000","last_peered":"2023-10-07T08:58:38.276567+0000","last_clean":"2023-10-07T08:58:38.276567+0000","last_became_active":"2023-10-07T08:58:37.259284+0000","last_became_peered":"2023-10-07T08:58:37.259284+0000","last_unstale":"2023-10-07T08:58:38.276567+0000","last_undegraded":"2023-10-07T08:58:38.276567+0000","last_fullsized":"2023-10-07T08:58:38.276567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274030+0000","last_change":"2023-10-07T08:58:38.271932+0000","last_active":"2023-10-07T08:58:38.274030+0000","last_peered":"2023-10-07T08:58:38.274030+0000","last_clean":"2023-10-07T08:58:38.274030+0000","last_became_active":"2023-10-07T08:58:38.271668+0000","last_became_peered":"2023-10-07T08:58:38.271668+0000","last_unstale":"2023-10-07T08:58:38.274030+0000","last_undegraded":"2023-10-07T08:58:38.274030+0000","last_fullsized":"2023-10-07T08:58:38.274030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284462+0000","last_change":"2023-10-07T08:58:37.262301+0000","last_active":"2023-10-07T08:58:38.284462+0000","last_peered":"2023-10-07T08:58:38.284462+0000","last_clean":"2023-10-07T08:58:38.284462+0000","last_became_active":"2023-10-07T08:58:37.262025+0000","last_became_peered":"2023-10-07T08:58:37.262025+0000","last_unstale":"2023-10-07T08:58:38.284462+0000","last_undegraded":"2023-10-07T08:58:38.284462+0000","last_fullsized":"2023-10-07T08:58:38.284462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:08.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275951+0000","last_change":"2023-10-07T08:58:38.272054+0000","last_active":"2023-10-07T08:58:38.275951+0000","last_peered":"2023-10-07T08:58:38.275951+0000","last_clean":"2023-10-07T08:58:38.275951+0000","last_became_active":"2023-10-07T08:58:38.271783+0000","last_became_peered":"2023-10-07T08:58:38.271783+0000","last_unstale":"2023-10-07T08:58:38.275951+0000","last_undegraded":"2023-10-07T08:58:38.275951+0000","last_fullsized":"2023-10-07T08:58:38.275951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251812+0000","last_change":"2023-10-07T08:58:37.270177+0000","last_active":"2023-10-07T08:58:38.251812+0000","last_peered":"2023-10-07T08:58:38.251812+0000","last_clean":"2023-10-07T08:58:38.251812+0000","last_became_active":"2023-10-07T08:58:37.269889+0000","last_became_peered":"2023-10-07T08:58:37.269889+0000","last_unstale":"2023-10-07T08:58:38.251812+0000","last_undegraded":"2023-10-07T08:58:38.251812+0000","last_fullsized":"2023-10-07T08:58:38.251812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265632+0000","last_change":"2023-10-07T08:58:38.265632+0000","last_active":"2023-10-07T08:58:38.265632+0000","last_peered":"2023-10-07T08:58:38.265632+0000","last_clean":"2023-10-07T08:58:38.265632+0000","last_became_active":"2023-10-07T08:58:38.265352+0000","last_became_peered":"2023-10-07T08:58:38.265352+0000","last_unstale":"2023-10-07T08:58:38.265632+0000","last_undegraded":"2023-10-07T08:58:38.265632+0000","last_fullsized":"2023-10-07T08:58:38.265632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.271456+0000","last_change":"2023-10-07T08:58:37.270333+0000","last_active":"2023-10-07T08:58:37.271456+0000","last_peered":"2023-10-07T08:58:37.271456+0000","last_clean":"2023-10-07T08:58:37.271456+0000","last_became_active":"2023-10-07T08:58:37.270099+0000","last_became_peered":"2023-10-07T08:58:37.270099+0000","last_unstale":"2023-10-07T08:58:37.271456+0000","last_undegraded":"2023-10-07T08:58:37.271456+0000","last_fullsized":"2023-10-07T08:58:37.271456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275565+0000","last_change":"2023-10-07T08:58:38.272196+0000","last_active":"2023-10-07T08:58:38.275565+0000","last_peered":"2023-10-07T08:58:38.275565+0000","last_clean":"2023-10-07T08:58:38.275565+0000","last_became_active":"2023-10-07T08:58:38.268871+0000","last_became_peered":"2023-10-07T08:58:38.268871+0000","last_unstale":"2023-10-07T08:58:38.275565+0000","last_undegraded":"2023-10-07T08:58:38.275565+0000","last_fullsized":"2023-10-07T08:58:38.275565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272269+0000","last_change":"2023-10-07T08:58:38.265483+0000","last_active":"2023-10-07T08:58:38.272269+0000","last_peered":"2023-10-07T08:58:38.272269+0000","last_clean":"2023-10-07T08:58:38.272269+0000","last_became_active":"2023-10-07T08:58:38.265225+0000","last_became_peered":"2023-10-07T08:58:38.265225+0000","last_unstale":"2023-10-07T08:58:38.272269+0000","last_undegraded":"2023-10-07T08:58:38.272269+0000","last_fullsized":"2023-10-07T08:58:38.272269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.267966+0000","last_change":"2023-10-07T08:58:37.265772+0000","last_active":"2023-10-07T08:58:37.267966+0000","last_peered":"2023-10-07T08:58:37.267966+0000","last_clean":"2023-10-07T08:58:37.267966+0000","last_became_active":"2023-10-07T08:58:37.265480+0000","last_became_peered":"2023-10-07T08:58:37.265480+0000","last_unstale":"2023-10-07T08:58:37.267966+0000","last_undegraded":"2023-10-07T08:58:37.267966+0000","last_fullsized":"2023-10-07T08:58:37.267966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267707+0000","last_change":"2023-10-07T08:58:38.267707+0000","last_active":"2023-10-07T08:58:38.267707+0000","last_peered":"2023-10-07T08:58:38.267707+0000","last_clean":"2023-10-07T08:58:38.267707+0000","last_became_active":"2023-10-07T08:58:38.267397+0000","last_became_peered":"2023-10-07T08:58:38.267397+0000","last_unstale":"2023-10-07T08:58:38.267707+0000","last_undegraded":"2023-10-07T08:58:38.267707+0000","last_fullsized":"2023-10-07T08:58:38.267707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270001+0000","last_change":"2023-10-07T08:58:37.266816+0000","last_active":"2023-10-07T08:58:37.270001+0000","last_peered":"2023-10-07T08:58:37.270001+0000","last_clean":"2023-10-07T08:58:37.270001+0000","last_became_active":"2023-10-07T08:58:37.266529+0000","last_became_peered":"2023-10-07T08:58:37.266529+0000","last_unstale":"2023-10-07T08:58:37.270001+0000","last_undegraded":"2023-10-07T08:58:37.270001+0000","last_fullsized":"2023-10-07T08:58:37.270001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259526+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:58:38.259526+0000","last_peered":"2023-10-07T08:58:38.259526+0000","last_clean":"2023-10-07T08:58:38.259526+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:58:38.259526+0000","last_undegraded":"2023-10-07T08:58:38.259526+0000","last_fullsized":"2023-10-07T08:58:38.259526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278929+0000","last_change":"2023-10-07T08:58:38.274743+0000","last_active":"2023-10-07T08:58:38.278929+0000","last_peered":"2023-10-07T08:58:38.278929+0000","last_clean":"2023-10-07T08:58:38.278929+0000","last_became_active":"2023-10-07T08:58:38.273665+0000","last_became_peered":"2023-10-07T08:58:38.273665+0000","last_unstale":"2023-10-07T08:58:38.278929+0000","last_undegraded":"2023-10-07T08:58:38.278929+0000","last_fullsized":"2023-10-07T08:58:38.278929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259654+0000","last_change":"2023-10-07T08:58:37.267054+0000","last_active":"2023-10-07T08:58:38.259654+0000","last_peered":"2023-10-07T08:58:38.259654+0000","last_clean":"2023-10-07T08:58:38.259654+0000","last_became_active":"2023-10-07T08:58:37.266737+0000","last_became_peered":"2023-10-07T08:58:37.266737+0000","last_unstale":"2023-10-07T08:58:38.259654+0000","last_undegraded":"2023-10-07T08:58:38.259654+0000","last_fullsized":"2023-10-07T08:58:38.259654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:21.835890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.261600+0000","last_change":"2023-10-07T08:58:37.265472+0000","last_active":"2023-10-07T08:58:38.261600+0000","last_peered":"2023-10-07T08:58:38.261600+0000","last_clean":"2023-10-07T08:58:38.261600+0000","last_became_active":"2023-10-07T08:58:37.264985+0000","last_became_peered":"2023-10-07T08:58:37.264985+0000","last_unstale":"2023-10-07T08:58:38.261600+0000","last_undegraded":"2023-10-07T08:58:38.261600+0000","last_fullsized":"2023-10-07T08:58:38.261600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269942+0000","last_change":"2023-10-07T08:58:38.264926+0000","last_active":"2023-10-07T08:58:38.269942+0000","last_peered":"2023-10-07T08:58:38.269942+0000","last_clean":"2023-10-07T08:58:38.269942+0000","last_became_active":"2023-10-07T08:58:38.264654+0000","last_became_peered":"2023-10-07T08:58:38.264654+0000","last_unstale":"2023-10-07T08:58:38.269942+0000","last_undegraded":"2023-10-07T08:58:38.269942+0000","last_fullsized":"2023-10-07T08:58:38.269942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252104+0000","last_change":"2023-10-07T08:58:37.261664+0000","last_active":"2023-10-07T08:58:38.252104+0000","last_peered":"2023-10-07T08:58:38.252104+0000","last_clean":"2023-10-07T08:58:38.252104+0000","last_became_active":"2023-10-07T08:58:37.261370+0000","last_became_peered":"2023-10-07T08:58:37.261370+0000","last_unstale":"2023-10-07T08:58:38.252104+0000","last_undegraded":"2023-10-07T08:58:38.252104+0000","last_fullsized":"2023-10-07T08:58:38.252104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264474+0000","last_change":"2023-10-07T08:58:38.264474+0000","last_active":"2023-10-07T08:58:38.264474+0000","last_peered":"2023-10-07T08:58:38.264474+0000","last_clean":"2023-10-07T08:58:38.264474+0000","last_became_active":"2023-10-07T08:58:38.264205+0000","last_became_peered":"2023-10-07T08:58:38.264205+0000","last_unstale":"2023-10-07T08:58:38.264474+0000","last_undegraded":"2023-10-07T08:58:38.264474+0000","last_fullsized":"2023-10-07T08:58:38.264474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280502+0000","last_change":"2023-10-07T08:58:37.265911+0000","last_active":"2023-10-07T08:58:38.280502+0000","last_peered":"2023-10-07T08:58:38.280502+0000","last_clean":"2023-10-07T08:58:38.280502+0000","last_became_active":"2023-10-07T08:58:37.265641+0000","last_became_peered":"2023-10-07T08:58:37.265641+0000","last_unstale":"2023-10-07T08:58:38.280502+0000","last_undegraded":"2023-10-07T08:58:38.280502+0000","last_fullsized":"2023-10-07T08:58:38.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277871+0000","last_change":"2023-10-07T08:58:38.270356+0000","last_active":"2023-10-07T08:58:38.277871+0000","last_peered":"2023-10-07T08:58:38.277871+0000","last_clean":"2023-10-07T08:58:38.277871+0000","last_became_active":"2023-10-07T08:58:38.270083+0000","last_became_peered":"2023-10-07T08:58:38.270083+0000","last_unstale":"2023-10-07T08:58:38.277871+0000","last_undegraded":"2023-10-07T08:58:38.277871+0000","last_fullsized":"2023-10-07T08:58:38.277871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:14:21.759445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259621+0000","last_change":"2023-10-07T08:58:37.271336+0000","last_active":"2023-10-07T08:58:38.259621+0000","last_peered":"2023-10-07T08:58:38.259621+0000","last_clean":"2023-10-07T08:58:38.259621+0000","last_became_active":"2023-10-07T08:58:37.271057+0000","last_became_peered":"2023-10-07T08:58:37.271057+0000","last_unstale":"2023-10-07T08:58:38.259621+0000","last_undegraded":"2023-10-07T08:58:38.259621+0000","last_fullsized":"2023-10-07T08:58:38.259621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274310+0000","last_change":"2023-10-07T08:58:38.266393+0000","last_active":"2023-10-07T08:58:38.274310+0000","last_peered":"2023-10-07T08:58:38.274310+0000","last_clean":"2023-10-07T08:58:38.274310+0000","last_became_active":"2023-10-07T08:58:38.266131+0000","last_became_peered":"2023-10-07T08:58:38.266131+0000","last_unstale":"2023-10-07T08:58:38.274310+0000","last_undegraded":"2023-10-07T08:58:38.274310+0000","last_fullsized":"2023-10-07T08:58:38.274310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:57.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252634+0000","last_change":"2023-10-07T08:58:37.265724+0000","last_active":"2023-10-07T08:58:38.252634+0000","last_peered":"2023-10-07T08:58:38.252634+0000","last_clean":"2023-10-07T08:58:38.252634+0000","last_became_active":"2023-10-07T08:58:37.265218+0000","last_became_peered":"2023-10-07T08:58:37.265218+0000","last_unstale":"2023-10-07T08:58:38.252634+0000","last_undegraded":"2023-10-07T08:58:38.252634+0000","last_fullsized":"2023-10-07T08:58:38.252634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259788+0000","last_change":"2023-10-07T08:58:38.259788+0000","last_active":"2023-10-07T08:58:38.259788+0000","last_peered":"2023-10-07T08:58:38.259788+0000","last_clean":"2023-10-07T08:58:38.259788+0000","last_became_active":"2023-10-07T08:58:38.259490+0000","last_became_peered":"2023-10-07T08:58:38.259490+0000","last_unstale":"2023-10-07T08:58:38.259788+0000","last_undegraded":"2023-10-07T08:58:38.259788+0000","last_fullsized":"2023-10-07T08:58:38.259788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251753+0000","last_change":"2023-10-07T08:58:37.269182+0000","last_active":"2023-10-07T08:58:38.251753+0000","last_peered":"2023-10-07T08:58:38.251753+0000","last_clean":"2023-10-07T08:58:38.251753+0000","last_became_active":"2023-10-07T08:58:37.268876+0000","last_became_peered":"2023-10-07T08:58:37.268876+0000","last_unstale":"2023-10-07T08:58:38.251753+0000","last_undegraded":"2023-10-07T08:58:38.251753+0000","last_fullsized":"2023-10-07T08:58:38.251753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:47.176445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277598+0000","last_change":"2023-10-07T08:58:38.277598+0000","last_active":"2023-10-07T08:58:38.277598+0000","last_peered":"2023-10-07T08:58:38.277598+0000","last_clean":"2023-10-07T08:58:38.277598+0000","last_became_active":"2023-10-07T08:58:38.277298+0000","last_became_peered":"2023-10-07T08:58:38.277298+0000","last_unstale":"2023-10-07T08:58:38.277598+0000","last_undegraded":"2023-10-07T08:58:38.277598+0000","last_fullsized":"2023-10-07T08:58:38.277598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284373+0000","last_change":"2023-10-07T08:58:37.267496+0000","last_active":"2023-10-07T08:58:38.284373+0000","last_peered":"2023-10-07T08:58:38.284373+0000","last_clean":"2023-10-07T08:58:38.284373+0000","last_became_active":"2023-10-07T08:58:37.267211+0000","last_became_peered":"2023-10-07T08:58:37.267211+0000","last_unstale":"2023-10-07T08:58:38.284373+0000","last_undegraded":"2023-10-07T08:58:38.284373+0000","last_fullsized":"2023-10-07T08:58:38.284373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270706+0000","last_change":"2023-10-07T08:58:38.270706+0000","last_active":"2023-10-07T08:58:38.270706+0000","last_peered":"2023-10-07T08:58:38.270706+0000","last_clean":"2023-10-07T08:58:38.270706+0000","last_became_active":"2023-10-07T08:58:38.270439+0000","last_became_peered":"2023-10-07T08:58:38.270439+0000","last_unstale":"2023-10-07T08:58:38.270706+0000","last_undegraded":"2023-10-07T08:58:38.270706+0000","last_fullsized":"2023-10-07T08:58:38.270706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.268772+0000","last_change":"2023-10-07T08:58:37.266819+0000","last_active":"2023-10-07T08:58:37.268772+0000","last_peered":"2023-10-07T08:58:37.268772+0000","last_clean":"2023-10-07T08:58:37.268772+0000","last_became_active":"2023-10-07T08:58:37.266526+0000","last_became_peered":"2023-10-07T08:58:37.266526+0000","last_unstale":"2023-10-07T08:58:37.268772+0000","last_undegraded":"2023-10-07T08:58:37.268772+0000","last_fullsized":"2023-10-07T08:58:37.268772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279068+0000","last_change":"2023-10-07T08:58:38.274546+0000","last_active":"2023-10-07T08:58:38.279068+0000","last_peered":"2023-10-07T08:58:38.279068+0000","last_clean":"2023-10-07T08:58:38.279068+0000","last_became_active":"2023-10-07T08:58:38.274288+0000","last_became_peered":"2023-10-07T08:58:38.274288+0000","last_unstale":"2023-10-07T08:58:38.279068+0000","last_undegraded":"2023-10-07T08:58:38.279068+0000","last_fullsized":"2023-10-07T08:58:38.279068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284614+0000","last_change":"2023-10-07T08:58:37.261183+0000","last_active":"2023-10-07T08:58:38.284614+0000","last_peered":"2023-10-07T08:58:38.284614+0000","last_clean":"2023-10-07T08:58:38.284614+0000","last_became_active":"2023-10-07T08:58:37.260954+0000","last_became_peered":"2023-10-07T08:58:37.260954+0000","last_unstale":"2023-10-07T08:58:38.284614+0000","last_undegraded":"2023-10-07T08:58:38.284614+0000","last_fullsized":"2023-10-07T08:58:38.284614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264621+0000","last_change":"2023-10-07T08:58:38.264621+0000","last_active":"2023-10-07T08:58:38.264621+0000","last_peered":"2023-10-07T08:58:38.264621+0000","last_clean":"2023-10-07T08:58:38.264621+0000","last_became_active":"2023-10-07T08:58:38.264344+0000","last_became_peered":"2023-10-07T08:58:38.264344+0000","last_unstale":"2023-10-07T08:58:38.264621+0000","last_undegraded":"2023-10-07T08:58:38.264621+0000","last_fullsized":"2023-10-07T08:58:38.264621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.281389+0000","last_change":"2023-10-07T08:58:37.267477+0000","last_active":"2023-10-07T08:58:38.281389+0000","last_peered":"2023-10-07T08:58:38.281389+0000","last_clean":"2023-10-07T08:58:38.281389+0000","last_became_active":"2023-10-07T08:58:37.267186+0000","last_became_peered":"2023-10-07T08:58:37.267186+0000","last_unstale":"2023-10-07T08:58:38.281389+0000","last_undegraded":"2023-10-07T08:58:38.281389+0000","last_fullsized":"2023-10-07T08:58:38.281389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283571+0000","last_change":"2023-10-07T08:58:38.278356+0000","last_active":"2023-10-07T08:58:38.283571+0000","last_peered":"2023-10-07T08:58:38.283571+0000","last_clean":"2023-10-07T08:58:38.283571+0000","last_became_active":"2023-10-07T08:58:38.277900+0000","last_became_peered":"2023-10-07T08:58:38.277900+0000","last_unstale":"2023-10-07T08:58:38.283571+0000","last_undegraded":"2023-10-07T08:58:38.283571+0000","last_fullsized":"2023-10-07T08:58:38.283571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276244+0000","last_change":"2023-10-07T08:58:38.276244+0000","last_active":"2023-10-07T08:58:38.276244+0000","last_peered":"2023-10-07T08:58:38.276244+0000","last_clean":"2023-10-07T08:58:38.276244+0000","last_became_active":"2023-10-07T08:58:38.275899+0000","last_became_peered":"2023-10-07T08:58:38.275899+0000","last_unstale":"2023-10-07T08:58:38.276244+0000","last_undegraded":"2023-10-07T08:58:38.276244+0000","last_fullsized":"2023-10-07T08:58:38.276244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269027+0000","last_change":"2023-10-07T08:58:38.269027+0000","last_active":"2023-10-07T08:58:38.269027+0000","last_peered":"2023-10-07T08:58:38.269027+0000","last_clean":"2023-10-07T08:58:38.269027+0000","last_became_active":"2023-10-07T08:58:38.268305+0000","last_became_peered":"2023-10-07T08:58:38.268305+0000","last_unstale":"2023-10-07T08:58:38.269027+0000","last_undegraded":"2023-10-07T08:58:38.269027+0000","last_fullsized":"2023-10-07T08:58:38.269027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:39.609895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263865+0000","last_change":"2023-10-07T08:58:38.263865+0000","last_active":"2023-10-07T08:58:38.263865+0000","last_peered":"2023-10-07T08:58:38.263865+0000","last_clean":"2023-10-07T08:58:38.263865+0000","last_became_active":"2023-10-07T08:58:38.263605+0000","last_became_peered":"2023-10-07T08:58:38.263605+0000","last_unstale":"2023-10-07T08:58:38.263865+0000","last_undegraded":"2023-10-07T08:58:38.263865+0000","last_fullsized":"2023-10-07T08:58:38.263865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277986+0000","last_change":"2023-10-07T08:58:38.272673+0000","last_active":"2023-10-07T08:58:38.277986+0000","last_peered":"2023-10-07T08:58:38.277986+0000","last_clean":"2023-10-07T08:58:38.277986+0000","last_became_active":"2023-10-07T08:58:38.272332+0000","last_became_peered":"2023-10-07T08:58:38.272332+0000","last_unstale":"2023-10-07T08:58:38.277986+0000","last_undegraded":"2023-10-07T08:58:38.277986+0000","last_fullsized":"2023-10-07T08:58:38.277986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266586+0000","last_change":"2023-10-07T08:58:38.266586+0000","last_active":"2023-10-07T08:58:38.266586+0000","last_peered":"2023-10-07T08:58:38.266586+0000","last_clean":"2023-10-07T08:58:38.266586+0000","last_became_active":"2023-10-07T08:58:38.266197+0000","last_became_peered":"2023-10-07T08:58:38.266197+0000","last_unstale":"2023-10-07T08:58:38.266586+0000","last_undegraded":"2023-10-07T08:58:38.266586+0000","last_fullsized":"2023-10-07T08:58:38.266586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260868+0000","last_change":"2023-10-07T08:58:38.259089+0000","last_active":"2023-10-07T08:58:38.260868+0000","last_peered":"2023-10-07T08:58:38.260868+0000","last_clean":"2023-10-07T08:58:38.260868+0000","last_became_active":"2023-10-07T08:58:38.258801+0000","last_became_peered":"2023-10-07T08:58:38.258801+0000","last_unstale":"2023-10-07T08:58:38.260868+0000","last_undegraded":"2023-10-07T08:58:38.260868+0000","last_fullsized":"2023-10-07T08:58:38.260868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271464+0000","last_change":"2023-10-07T08:58:38.271464+0000","last_active":"2023-10-07T08:58:38.271464+0000","last_peered":"2023-10-07T08:58:38.271464+0000","last_clean":"2023-10-07T08:58:38.271464+0000","last_became_active":"2023-10-07T08:58:38.271181+0000","last_became_peered":"2023-10-07T08:58:38.271181+0000","last_unstale":"2023-10-07T08:58:38.271464+0000","last_undegraded":"2023-10-07T08:58:38.271464+0000","last_fullsized":"2023-10-07T08:58:38.271464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265753+0000","last_change":"2023-10-07T08:58:38.265753+0000","last_active":"2023-10-07T08:58:38.265753+0000","last_peered":"2023-10-07T08:58:38.265753+0000","last_clean":"2023-10-07T08:58:38.265753+0000","last_became_active":"2023-10-07T08:58:38.265442+0000","last_became_peered":"2023-10-07T08:58:38.265442+0000","last_unstale":"2023-10-07T08:58:38.265753+0000","last_undegraded":"2023-10-07T08:58:38.265753+0000","last_fullsized":"2023-10-07T08:58:38.265753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263382+0000","last_change":"2023-10-07T08:58:38.263382+0000","last_active":"2023-10-07T08:58:38.263382+0000","last_peered":"2023-10-07T08:58:38.263382+0000","last_clean":"2023-10-07T08:58:38.263382+0000","last_became_active":"2023-10-07T08:58:38.263121+0000","last_became_peered":"2023-10-07T08:58:38.263121+0000","last_unstale":"2023-10-07T08:58:38.263382+0000","last_undegraded":"2023-10-07T08:58:38.263382+0000","last_fullsized":"2023-10-07T08:58:38.263382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265927+0000","last_change":"2023-10-07T08:58:38.265927+0000","last_active":"2023-10-07T08:58:38.265927+0000","last_peered":"2023-10-07T08:58:38.265927+0000","last_clean":"2023-10-07T08:58:38.265927+0000","last_became_active":"2023-10-07T08:58:38.265607+0000","last_became_peered":"2023-10-07T08:58:38.265607+0000","last_unstale":"2023-10-07T08:58:38.265927+0000","last_undegraded":"2023-10-07T08:58:38.265927+0000","last_fullsized":"2023-10-07T08:58:38.265927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264874+0000","last_change":"2023-10-07T08:58:38.264874+0000","last_active":"2023-10-07T08:58:38.264874+0000","last_peered":"2023-10-07T08:58:38.264874+0000","last_clean":"2023-10-07T08:58:38.264874+0000","last_became_active":"2023-10-07T08:58:38.264577+0000","last_became_peered":"2023-10-07T08:58:38.264577+0000","last_unstale":"2023-10-07T08:58:38.264874+0000","last_undegraded":"2023-10-07T08:58:38.264874+0000","last_fullsized":"2023-10-07T08:58:38.264874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277961+0000","last_change":"2023-10-07T08:58:38.270592+0000","last_active":"2023-10-07T08:58:38.277961+0000","last_peered":"2023-10-07T08:58:38.277961+0000","last_clean":"2023-10-07T08:58:38.277961+0000","last_became_active":"2023-10-07T08:58:38.270016+0000","last_became_peered":"2023-10-07T08:58:38.270016+0000","last_unstale":"2023-10-07T08:58:38.277961+0000","last_undegraded":"2023-10-07T08:58:38.277961+0000","last_fullsized":"2023-10-07T08:58:38.277961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271588+0000","last_change":"2023-10-07T08:58:38.271588+0000","last_active":"2023-10-07T08:58:38.271588+0000","last_peered":"2023-10-07T08:58:38.271588+0000","last_clean":"2023-10-07T08:58:38.271588+0000","last_became_active":"2023-10-07T08:58:38.271197+0000","last_became_peered":"2023-10-07T08:58:38.271197+0000","last_unstale":"2023-10-07T08:58:38.271588+0000","last_undegraded":"2023-10-07T08:58:38.271588+0000","last_fullsized":"2023-10-07T08:58:38.271588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":69115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:58:42.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:58:42.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.523+0000 7f55fada0700 1 Processor -- start 2023-10-07T08:58:42.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.523+0000 7f55fada0700 1 -- start start 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fada0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f4159420 0x7f55f40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fada0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f41597f0 0x7f55f40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fada0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f40b11d0 con 0x7f55f415d230 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fada0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40b14b0 con 0x7f55f4159420 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fada0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b1790 con 0x7f55f41597f0 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f4159420 0x7f55f40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fa59f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f55f415d230 0x7f55f40b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54664/0 (socket says 172.21.15.46:54664) 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f4159420 0x7f55f40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60298/0 (socket says 172.21.15.46:60298) 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55fa59f700 1 -- 172.21.15.46:0/194328688 learned_addr learned my addr 172.21.15.46:0/194328688 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f959d700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f41597f0 0x7f55f40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 -- 172.21.15.46:0/194328688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f41597f0 msgr2=0x7f55f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f41597f0 0x7f55f40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 -- 172.21.15.46:0/194328688 >> v1:172.21.15.46:6789/0 conn(0x7f55f415d230 legacy=0x7f55f40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f8d9c700 1 -- 172.21.15.46:0/194328688 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336091521 0 0) 0x7f55f40b11d0 con 0x7f55f415d230 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 -- 172.21.15.46:0/194328688 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40b1a70 con 0x7f55f4159420 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f9d9e700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4159420 0x7f55f40b5f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0098e0 tx=0x7f55ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd01dc015621d01f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f8d9c700 1 -- 172.21.15.46:0/194328688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec009e80 con 0x7f55f4159420 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f8d9c700 1 -- 172.21.15.46:0/194328688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec00b860 con 0x7f55f4159420 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.524+0000 7f55f8d9c700 1 -- 172.21.15.46:0/194328688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00bbe0 con 0x7f55f4159420 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 -- 172.21.15.46:0/194328688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4159420 msgr2=0x7f55f40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4159420 0x7f55f40b5f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0098e0 tx=0x7f55ec0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 -- 172.21.15.46:0/194328688 shutdown_connections 2023-10-07T08:58:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4159420 0x7f55f40b5f40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 --2- 172.21.15.46:0/194328688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f41597f0 0x7f55f40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 -- 172.21.15.46:0/194328688 >> 172.21.15.46:0/194328688 conn(0x7f55f40d0660 msgr2=0x7f55f40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 -- 172.21.15.46:0/194328688 shutdown_connections 2023-10-07T08:58:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.525+0000 7f55fada0700 1 -- 172.21.15.46:0/194328688 wait complete. 2023-10-07T08:58:42.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.526+0000 7f55fada0700 1 Processor -- start 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.526+0000 7f55fada0700 1 -- start start 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f4159420 0x7f55f40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f41597f0 0x7f55f40cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c8090 con 0x7f55f415d230 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c7480 con 0x7f55f41597f0 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fada0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c7760 con 0x7f55f4159420 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60306/0 (socket says 172.21.15.46:60306) 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 -- 172.21.15.46:0/2474701679 learned_addr learned my addr 172.21.15.46:0/2474701679 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:42.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55f959d700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f41597f0 0x7f55f40cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55f9d9e700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f4159420 0x7f55f40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 -- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f4159420 msgr2=0x7f55f40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f4159420 0x7f55f40c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 -- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f41597f0 msgr2=0x7f55f40cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f41597f0 0x7f55f40cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 -- 172.21.15.46:0/2474701679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009420 con 0x7f55f415d230 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.527+0000 7f55fa59f700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55e400cbf0 tx=0x7f55e40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.528+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400a8b0 con 0x7f55f415d230 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.528+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400aa10 con 0x7f55f415d230 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.528+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f40c7a40 con 0x7f55f415d230 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.528+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400add0 con 0x7f55f415d230 2023-10-07T08:58:42.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.528+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f40c5d00 con 0x7f55f415d230 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.529+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f40c8200 con 0x7f55f415d230 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.529+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55e4007300 con 0x7f55f415d230 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.529+0000 7f55f1ffb700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 0x7f55e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.530+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55e4084800 con 0x7f55f415d230 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.530+0000 7f55f9d9e700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 0x7f55e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.530+0000 7f55f9d9e700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 0x7f55e00693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0091e0 tx=0x7f55ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.534+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55e4051af0 con 0x7f55f415d230 2023-10-07T08:58:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.722+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55f404c3c0 con 0x7f55e0066f30 2023-10-07T08:58:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.730+0000 7f55f1ffb700 1 -- 172.21.15.46:0/2474701679 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264611 (secure 0 0 0) 0x7f55f404c3c0 con 0x7f55e0066f30 2023-10-07T08:58:42.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 msgr2=0x7f55e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 0x7f55e00693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0091e0 tx=0x7f55ec017000 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 msgr2=0x7f55f40c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55e400cbf0 tx=0x7f55e40019b0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 shutdown_connections 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55e0066f30 0x7f55e00693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f415d230 0x7f55f40c8520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f4159420 0x7f55f40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 --2- 172.21.15.46:0/2474701679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f41597f0 0x7f55f40cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 >> 172.21.15.46:0/2474701679 conn(0x7f55f40d0660 msgr2=0x7f55f40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 shutdown_connections 2023-10-07T08:58:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.733+0000 7f55fada0700 1 -- 172.21.15.46:0/2474701679 wait complete. 2023-10-07T08:58:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:58:42.746 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-07T08:58:41.762423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381176,"kb_used_data":2872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593544,"statfs":{"total":773094113280,"available":770655789056,"internally_reserved":0,"allocated":2940928,"data_stored":1762700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.518553"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269469+0000","last_change":"2023-10-07T08:58:38.267255+0000","last_active":"2023-10-07T08:58:38.269469+0000","last_peered":"2023-10-07T08:58:38.269469+0000","last_clean":"2023-10-07T08:58:38.269469+0000","last_became_active":"2023-10-07T08:58:38.266659+0000","last_became_peered":"2023-10-07T08:58:38.266659+0000","last_unstale":"2023-10-07T08:58:38.269469+0000","last_undegraded":"2023-10-07T08:58:38.269469+0000","last_fullsized":"2023-10-07T08:58:38.269469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271311+0000","last_change":"2023-10-07T08:58:38.267764+0000","last_active":"2023-10-07T08:58:38.271311+0000","last_peered":"2023-10-07T08:58:38.271311+0000","last_clean":"2023-10-07T08:58:38.271311+0000","last_became_active":"2023-10-07T08:58:38.267465+0000","last_became_peered":"2023-10-07T08:58:38.267465+0000","last_unstale":"2023-10-07T08:58:38.271311+0000","last_undegraded":"2023-10-07T08:58:38.271311+0000","last_fullsized":"2023-10-07T08:58:38.271311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277699+0000","last_change":"2023-10-07T08:58:38.266617+0000","last_active":"2023-10-07T08:58:38.277699+0000","last_peered":"2023-10-07T08:58:38.277699+0000","last_clean":"2023-10-07T08:58:38.277699+0000","last_became_active":"2023-10-07T08:58:38.266163+0000","last_became_peered":"2023-10-07T08:58:38.266163+0000","last_unstale":"2023-10-07T08:58:38.277699+0000","last_undegraded":"2023-10-07T08:58:38.277699+0000","last_fullsized":"2023-10-07T08:58:38.277699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263351+0000","last_change":"2023-10-07T08:58:38.263351+0000","last_active":"2023-10-07T08:58:38.263351+0000","last_peered":"2023-10-07T08:58:38.263351+0000","last_clean":"2023-10-07T08:58:38.263351+0000","last_became_active":"2023-10-07T08:58:38.262967+0000","last_became_peered":"2023-10-07T08:58:38.262967+0000","last_unstale":"2023-10-07T08:58:38.263351+0000","last_undegraded":"2023-10-07T08:58:38.263351+0000","last_fullsized":"2023-10-07T08:58:38.263351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268506+0000","last_change":"2023-10-07T08:58:38.266316+0000","last_active":"2023-10-07T08:58:38.268506+0000","last_peered":"2023-10-07T08:58:38.268506+0000","last_clean":"2023-10-07T08:58:38.268506+0000","last_became_active":"2023-10-07T08:58:38.266017+0000","last_became_peered":"2023-10-07T08:58:38.266017+0000","last_unstale":"2023-10-07T08:58:38.268506+0000","last_undegraded":"2023-10-07T08:58:38.268506+0000","last_fullsized":"2023-10-07T08:58:38.268506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278399+0000","last_change":"2023-10-07T08:58:38.278399+0000","last_active":"2023-10-07T08:58:38.278399+0000","last_peered":"2023-10-07T08:58:38.278399+0000","last_clean":"2023-10-07T08:58:38.278399+0000","last_became_active":"2023-10-07T08:58:38.278131+0000","last_became_peered":"2023-10-07T08:58:38.278131+0000","last_unstale":"2023-10-07T08:58:38.278399+0000","last_undegraded":"2023-10-07T08:58:38.278399+0000","last_fullsized":"2023-10-07T08:58:38.278399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278620+0000","last_change":"2023-10-07T08:58:38.274141+0000","last_active":"2023-10-07T08:58:38.278620+0000","last_peered":"2023-10-07T08:58:38.278620+0000","last_clean":"2023-10-07T08:58:38.278620+0000","last_became_active":"2023-10-07T08:58:38.273855+0000","last_became_peered":"2023-10-07T08:58:38.273855+0000","last_unstale":"2023-10-07T08:58:38.278620+0000","last_undegraded":"2023-10-07T08:58:38.278620+0000","last_fullsized":"2023-10-07T08:58:38.278620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270600+0000","last_change":"2023-10-07T08:58:38.270600+0000","last_active":"2023-10-07T08:58:38.270600+0000","last_peered":"2023-10-07T08:58:38.270600+0000","last_clean":"2023-10-07T08:58:38.270600+0000","last_became_active":"2023-10-07T08:58:38.270310+0000","last_became_peered":"2023-10-07T08:58:38.270310+0000","last_unstale":"2023-10-07T08:58:38.270600+0000","last_undegraded":"2023-10-07T08:58:38.270600+0000","last_fullsized":"2023-10-07T08:58:38.270600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269449+0000","last_change":"2023-10-07T08:58:38.267490+0000","last_active":"2023-10-07T08:58:38.269449+0000","last_peered":"2023-10-07T08:58:38.269449+0000","last_clean":"2023-10-07T08:58:38.269449+0000","last_became_active":"2023-10-07T08:58:38.267089+0000","last_became_peered":"2023-10-07T08:58:38.267089+0000","last_unstale":"2023-10-07T08:58:38.269449+0000","last_undegraded":"2023-10-07T08:58:38.269449+0000","last_fullsized":"2023-10-07T08:58:38.269449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267172+0000","last_change":"2023-10-07T08:58:38.267172+0000","last_active":"2023-10-07T08:58:38.267172+0000","last_peered":"2023-10-07T08:58:38.267172+0000","last_clean":"2023-10-07T08:58:38.267172+0000","last_became_active":"2023-10-07T08:58:38.266880+0000","last_became_peered":"2023-10-07T08:58:38.266880+0000","last_unstale":"2023-10-07T08:58:38.267172+0000","last_undegraded":"2023-10-07T08:58:38.267172+0000","last_fullsized":"2023-10-07T08:58:38.267172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267001+0000","last_change":"2023-10-07T08:58:38.267001+0000","last_active":"2023-10-07T08:58:38.267001+0000","last_peered":"2023-10-07T08:58:38.267001+0000","last_clean":"2023-10-07T08:58:38.267001+0000","last_became_active":"2023-10-07T08:58:38.266492+0000","last_became_peered":"2023-10-07T08:58:38.266492+0000","last_unstale":"2023-10-07T08:58:38.267001+0000","last_undegraded":"2023-10-07T08:58:38.267001+0000","last_fullsized":"2023-10-07T08:58:38.267001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273887+0000","last_change":"2023-10-07T08:58:38.264386+0000","last_active":"2023-10-07T08:58:38.273887+0000","last_peered":"2023-10-07T08:58:38.273887+0000","last_clean":"2023-10-07T08:58:38.273887+0000","last_became_active":"2023-10-07T08:58:38.264124+0000","last_became_peered":"2023-10-07T08:58:38.264124+0000","last_unstale":"2023-10-07T08:58:38.273887+0000","last_undegraded":"2023-10-07T08:58:38.273887+0000","last_fullsized":"2023-10-07T08:58:38.273887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:30.530699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263696+0000","last_change":"2023-10-07T08:58:38.263696+0000","last_active":"2023-10-07T08:58:38.263696+0000","last_peered":"2023-10-07T08:58:38.263696+0000","last_clean":"2023-10-07T08:58:38.263696+0000","last_became_active":"2023-10-07T08:58:38.263363+0000","last_became_peered":"2023-10-07T08:58:38.263363+0000","last_unstale":"2023-10-07T08:58:38.263696+0000","last_undegraded":"2023-10-07T08:58:38.263696+0000","last_fullsized":"2023-10-07T08:58:38.263696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277744+0000","last_change":"2023-10-07T08:58:38.267349+0000","last_active":"2023-10-07T08:58:38.277744+0000","last_peered":"2023-10-07T08:58:38.277744+0000","last_clean":"2023-10-07T08:58:38.277744+0000","last_became_active":"2023-10-07T08:58:38.266917+0000","last_became_peered":"2023-10-07T08:58:38.266917+0000","last_unstale":"2023-10-07T08:58:38.277744+0000","last_undegraded":"2023-10-07T08:58:38.277744+0000","last_fullsized":"2023-10-07T08:58:38.277744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:59.205812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.262424+0000","last_change":"2023-10-07T08:58:38.259339+0000","last_active":"2023-10-07T08:58:38.262424+0000","last_peered":"2023-10-07T08:58:38.262424+0000","last_clean":"2023-10-07T08:58:38.262424+0000","last_became_active":"2023-10-07T08:58:38.258971+0000","last_became_peered":"2023-10-07T08:58:38.258971+0000","last_unstale":"2023-10-07T08:58:38.262424+0000","last_undegraded":"2023-10-07T08:58:38.262424+0000","last_fullsized":"2023-10-07T08:58:38.262424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278767+0000","last_change":"2023-10-07T08:58:38.278767+0000","last_active":"2023-10-07T08:58:38.278767+0000","last_peered":"2023-10-07T08:58:38.278767+0000","last_clean":"2023-10-07T08:58:38.278767+0000","last_became_active":"2023-10-07T08:58:38.278528+0000","last_became_peered":"2023-10-07T08:58:38.278528+0000","last_unstale":"2023-10-07T08:58:38.278767+0000","last_undegraded":"2023-10-07T08:58:38.278767+0000","last_fullsized":"2023-10-07T08:58:38.278767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269363+0000","last_change":"2023-10-07T08:58:38.269363+0000","last_active":"2023-10-07T08:58:38.269363+0000","last_peered":"2023-10-07T08:58:38.269363+0000","last_clean":"2023-10-07T08:58:38.269363+0000","last_became_active":"2023-10-07T08:58:38.269065+0000","last_became_peered":"2023-10-07T08:58:38.269065+0000","last_unstale":"2023-10-07T08:58:38.269363+0000","last_undegraded":"2023-10-07T08:58:38.269363+0000","last_fullsized":"2023-10-07T08:58:38.269363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269575+0000","last_change":"2023-10-07T08:58:38.269575+0000","last_active":"2023-10-07T08:58:38.269575+0000","last_peered":"2023-10-07T08:58:38.269575+0000","last_clean":"2023-10-07T08:58:38.269575+0000","last_became_active":"2023-10-07T08:58:38.268895+0000","last_became_peered":"2023-10-07T08:58:38.268895+0000","last_unstale":"2023-10-07T08:58:38.269575+0000","last_undegraded":"2023-10-07T08:58:38.269575+0000","last_fullsized":"2023-10-07T08:58:38.269575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:32.828536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269484+0000","last_change":"2023-10-07T08:58:38.267862+0000","last_active":"2023-10-07T08:58:38.269484+0000","last_peered":"2023-10-07T08:58:38.269484+0000","last_clean":"2023-10-07T08:58:38.269484+0000","last_became_active":"2023-10-07T08:58:38.267577+0000","last_became_peered":"2023-10-07T08:58:38.267577+0000","last_unstale":"2023-10-07T08:58:38.269484+0000","last_undegraded":"2023-10-07T08:58:38.269484+0000","last_fullsized":"2023-10-07T08:58:38.269484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284044+0000","last_change":"2023-10-07T08:58:37.268088+0000","last_active":"2023-10-07T08:58:38.284044+0000","last_peered":"2023-10-07T08:58:38.284044+0000","last_clean":"2023-10-07T08:58:38.284044+0000","last_became_active":"2023-10-07T08:58:37.267728+0000","last_became_peered":"2023-10-07T08:58:37.267728+0000","last_unstale":"2023-10-07T08:58:38.284044+0000","last_undegraded":"2023-10-07T08:58:38.284044+0000","last_fullsized":"2023-10-07T08:58:38.284044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:45.288025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268443+0000","last_change":"2023-10-07T08:58:38.268443+0000","last_active":"2023-10-07T08:58:38.268443+0000","last_peered":"2023-10-07T08:58:38.268443+0000","last_clean":"2023-10-07T08:58:38.268443+0000","last_became_active":"2023-10-07T08:58:38.268155+0000","last_became_peered":"2023-10-07T08:58:38.268155+0000","last_unstale":"2023-10-07T08:58:38.268443+0000","last_undegraded":"2023-10-07T08:58:38.268443+0000","last_fullsized":"2023-10-07T08:58:38.268443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.255494+0000","last_change":"2023-10-07T08:58:37.269548+0000","last_active":"2023-10-07T08:58:38.255494+0000","last_peered":"2023-10-07T08:58:38.255494+0000","last_clean":"2023-10-07T08:58:38.255494+0000","last_became_active":"2023-10-07T08:58:37.266826+0000","last_became_peered":"2023-10-07T08:58:37.266826+0000","last_unstale":"2023-10-07T08:58:38.255494+0000","last_undegraded":"2023-10-07T08:58:38.255494+0000","last_fullsized":"2023-10-07T08:58:38.255494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:35.767431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279027+0000","last_change":"2023-10-07T08:58:38.272914+0000","last_active":"2023-10-07T08:58:38.279027+0000","last_peered":"2023-10-07T08:58:38.279027+0000","last_clean":"2023-10-07T08:58:38.279027+0000","last_became_active":"2023-10-07T08:58:38.269972+0000","last_became_peered":"2023-10-07T08:58:38.269972+0000","last_unstale":"2023-10-07T08:58:38.279027+0000","last_undegraded":"2023-10-07T08:58:38.279027+0000","last_fullsized":"2023-10-07T08:58:38.279027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283986+0000","last_change":"2023-10-07T08:58:37.266654+0000","last_active":"2023-10-07T08:58:38.283986+0000","last_peered":"2023-10-07T08:58:38.283986+0000","last_clean":"2023-10-07T08:58:38.283986+0000","last_became_active":"2023-10-07T08:58:37.266400+0000","last_became_peered":"2023-10-07T08:58:37.266400+0000","last_unstale":"2023-10-07T08:58:38.283986+0000","last_undegraded":"2023-10-07T08:58:38.283986+0000","last_fullsized":"2023-10-07T08:58:38.283986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.824130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266906+0000","last_change":"2023-10-07T08:58:38.266906+0000","last_active":"2023-10-07T08:58:38.266906+0000","last_peered":"2023-10-07T08:58:38.266906+0000","last_clean":"2023-10-07T08:58:38.266906+0000","last_became_active":"2023-10-07T08:58:38.266625+0000","last_became_peered":"2023-10-07T08:58:38.266625+0000","last_unstale":"2023-10-07T08:58:38.266906+0000","last_undegraded":"2023-10-07T08:58:38.266906+0000","last_fullsized":"2023-10-07T08:58:38.266906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283998+0000","last_change":"2023-10-07T08:58:37.270622+0000","last_active":"2023-10-07T08:58:38.283998+0000","last_peered":"2023-10-07T08:58:38.283998+0000","last_clean":"2023-10-07T08:58:38.283998+0000","last_became_active":"2023-10-07T08:58:37.270351+0000","last_became_peered":"2023-10-07T08:58:37.270351+0000","last_unstale":"2023-10-07T08:58:38.283998+0000","last_undegraded":"2023-10-07T08:58:38.283998+0000","last_fullsized":"2023-10-07T08:58:38.283998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273162+0000","last_change":"2023-10-07T08:58:38.273162+0000","last_active":"2023-10-07T08:58:38.273162+0000","last_peered":"2023-10-07T08:58:38.273162+0000","last_clean":"2023-10-07T08:58:38.273162+0000","last_became_active":"2023-10-07T08:58:38.272826+0000","last_became_peered":"2023-10-07T08:58:38.272826+0000","last_unstale":"2023-10-07T08:58:38.273162+0000","last_undegraded":"2023-10-07T08:58:38.273162+0000","last_fullsized":"2023-10-07T08:58:38.273162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.254600+0000","last_change":"2023-10-07T08:58:37.271548+0000","last_active":"2023-10-07T08:58:38.254600+0000","last_peered":"2023-10-07T08:58:38.254600+0000","last_clean":"2023-10-07T08:58:38.254600+0000","last_became_active":"2023-10-07T08:58:37.271240+0000","last_became_peered":"2023-10-07T08:58:37.271240+0000","last_unstale":"2023-10-07T08:58:38.254600+0000","last_undegraded":"2023-10-07T08:58:38.254600+0000","last_fullsized":"2023-10-07T08:58:38.254600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269827+0000","last_change":"2023-10-07T08:58:38.260549+0000","last_active":"2023-10-07T08:58:38.269827+0000","last_peered":"2023-10-07T08:58:38.269827+0000","last_clean":"2023-10-07T08:58:38.269827+0000","last_became_active":"2023-10-07T08:58:38.260271+0000","last_became_peered":"2023-10-07T08:58:38.260271+0000","last_unstale":"2023-10-07T08:58:38.269827+0000","last_undegraded":"2023-10-07T08:58:38.269827+0000","last_fullsized":"2023-10-07T08:58:38.269827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:53.298964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260298+0000","last_change":"2023-10-07T08:58:37.263334+0000","last_active":"2023-10-07T08:58:38.260298+0000","last_peered":"2023-10-07T08:58:38.260298+0000","last_clean":"2023-10-07T08:58:38.260298+0000","last_became_active":"2023-10-07T08:58:37.263022+0000","last_became_peered":"2023-10-07T08:58:37.263022+0000","last_unstale":"2023-10-07T08:58:38.260298+0000","last_undegraded":"2023-10-07T08:58:38.260298+0000","last_fullsized":"2023-10-07T08:58:38.260298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279664+0000","last_change":"2023-10-07T08:58:38.274587+0000","last_active":"2023-10-07T08:58:38.279664+0000","last_peered":"2023-10-07T08:58:38.279664+0000","last_clean":"2023-10-07T08:58:38.279664+0000","last_became_active":"2023-10-07T08:58:38.273574+0000","last_became_peered":"2023-10-07T08:58:38.273574+0000","last_unstale":"2023-10-07T08:58:38.279664+0000","last_undegraded":"2023-10-07T08:58:38.279664+0000","last_fullsized":"2023-10-07T08:58:38.279664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.272027+0000","last_change":"2023-10-07T08:58:37.267552+0000","last_active":"2023-10-07T08:58:37.272027+0000","last_peered":"2023-10-07T08:58:37.272027+0000","last_clean":"2023-10-07T08:58:37.272027+0000","last_became_active":"2023-10-07T08:58:37.266917+0000","last_became_peered":"2023-10-07T08:58:37.266917+0000","last_unstale":"2023-10-07T08:58:37.272027+0000","last_undegraded":"2023-10-07T08:58:37.272027+0000","last_fullsized":"2023-10-07T08:58:37.272027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264169+0000","last_change":"2023-10-07T08:58:38.264169+0000","last_active":"2023-10-07T08:58:38.264169+0000","last_peered":"2023-10-07T08:58:38.264169+0000","last_clean":"2023-10-07T08:58:38.264169+0000","last_became_active":"2023-10-07T08:58:38.263551+0000","last_became_peered":"2023-10-07T08:58:38.263551+0000","last_unstale":"2023-10-07T08:58:38.264169+0000","last_undegraded":"2023-10-07T08:58:38.264169+0000","last_fullsized":"2023-10-07T08:58:38.264169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.262007+0000","last_change":"2023-10-07T08:58:37.259060+0000","last_active":"2023-10-07T08:58:37.262007+0000","last_peered":"2023-10-07T08:58:37.262007+0000","last_clean":"2023-10-07T08:58:37.262007+0000","last_became_active":"2023-10-07T08:58:37.258771+0000","last_became_peered":"2023-10-07T08:58:37.258771+0000","last_unstale":"2023-10-07T08:58:37.262007+0000","last_undegraded":"2023-10-07T08:58:37.262007+0000","last_fullsized":"2023-10-07T08:58:37.262007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265345+0000","last_change":"2023-10-07T08:58:38.262529+0000","last_active":"2023-10-07T08:58:38.265345+0000","last_peered":"2023-10-07T08:58:38.265345+0000","last_clean":"2023-10-07T08:58:38.265345+0000","last_became_active":"2023-10-07T08:58:38.262257+0000","last_became_peered":"2023-10-07T08:58:38.262257+0000","last_unstale":"2023-10-07T08:58:38.265345+0000","last_undegraded":"2023-10-07T08:58:38.265345+0000","last_fullsized":"2023-10-07T08:58:38.265345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.271009+0000","last_change":"2023-10-07T08:58:37.269527+0000","last_active":"2023-10-07T08:58:37.271009+0000","last_peered":"2023-10-07T08:58:37.271009+0000","last_clean":"2023-10-07T08:58:37.271009+0000","last_became_active":"2023-10-07T08:58:37.269253+0000","last_became_peered":"2023-10-07T08:58:37.269253+0000","last_unstale":"2023-10-07T08:58:37.271009+0000","last_undegraded":"2023-10-07T08:58:37.271009+0000","last_fullsized":"2023-10-07T08:58:37.271009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268883+0000","last_change":"2023-10-07T08:58:38.268883+0000","last_active":"2023-10-07T08:58:38.268883+0000","last_peered":"2023-10-07T08:58:38.268883+0000","last_clean":"2023-10-07T08:58:38.268883+0000","last_became_active":"2023-10-07T08:58:38.268618+0000","last_became_peered":"2023-10-07T08:58:38.268618+0000","last_unstale":"2023-10-07T08:58:38.268883+0000","last_undegraded":"2023-10-07T08:58:38.268883+0000","last_fullsized":"2023-10-07T08:58:38.268883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270033+0000","last_change":"2023-10-07T08:58:37.268203+0000","last_active":"2023-10-07T08:58:37.270033+0000","last_peered":"2023-10-07T08:58:37.270033+0000","last_clean":"2023-10-07T08:58:37.270033+0000","last_became_active":"2023-10-07T08:58:37.267942+0000","last_became_peered":"2023-10-07T08:58:37.267942+0000","last_unstale":"2023-10-07T08:58:37.270033+0000","last_undegraded":"2023-10-07T08:58:37.270033+0000","last_fullsized":"2023-10-07T08:58:37.270033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279006+0000","last_change":"2023-10-07T08:58:38.272764+0000","last_active":"2023-10-07T08:58:38.279006+0000","last_peered":"2023-10-07T08:58:38.279006+0000","last_clean":"2023-10-07T08:58:38.279006+0000","last_became_active":"2023-10-07T08:58:38.267664+0000","last_became_peered":"2023-10-07T08:58:38.267664+0000","last_unstale":"2023-10-07T08:58:38.279006+0000","last_undegraded":"2023-10-07T08:58:38.279006+0000","last_fullsized":"2023-10-07T08:58:38.279006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284633+0000","last_change":"2023-10-07T08:58:37.263922+0000","last_active":"2023-10-07T08:58:38.284633+0000","last_peered":"2023-10-07T08:58:38.284633+0000","last_clean":"2023-10-07T08:58:38.284633+0000","last_became_active":"2023-10-07T08:58:37.263582+0000","last_became_peered":"2023-10-07T08:58:37.263582+0000","last_unstale":"2023-10-07T08:58:38.284633+0000","last_undegraded":"2023-10-07T08:58:38.284633+0000","last_fullsized":"2023-10-07T08:58:38.284633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273905+0000","last_change":"2023-10-07T08:58:38.265834+0000","last_active":"2023-10-07T08:58:38.273905+0000","last_peered":"2023-10-07T08:58:38.273905+0000","last_clean":"2023-10-07T08:58:38.273905+0000","last_became_active":"2023-10-07T08:58:38.265379+0000","last_became_peered":"2023-10-07T08:58:38.265379+0000","last_unstale":"2023-10-07T08:58:38.273905+0000","last_undegraded":"2023-10-07T08:58:38.273905+0000","last_fullsized":"2023-10-07T08:58:38.273905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:15.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284062+0000","last_change":"2023-10-07T08:58:37.268160+0000","last_active":"2023-10-07T08:58:38.284062+0000","last_peered":"2023-10-07T08:58:38.284062+0000","last_clean":"2023-10-07T08:58:38.284062+0000","last_became_active":"2023-10-07T08:58:37.267825+0000","last_became_peered":"2023-10-07T08:58:37.267825+0000","last_unstale":"2023-10-07T08:58:38.284062+0000","last_undegraded":"2023-10-07T08:58:38.284062+0000","last_fullsized":"2023-10-07T08:58:38.284062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276370+0000","last_change":"2023-10-07T08:58:38.271252+0000","last_active":"2023-10-07T08:58:38.276370+0000","last_peered":"2023-10-07T08:58:38.276370+0000","last_clean":"2023-10-07T08:58:38.276370+0000","last_became_active":"2023-10-07T08:58:38.270444+0000","last_became_peered":"2023-10-07T08:58:38.270444+0000","last_unstale":"2023-10-07T08:58:38.276370+0000","last_undegraded":"2023-10-07T08:58:38.276370+0000","last_fullsized":"2023-10-07T08:58:38.276370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284697+0000","last_change":"2023-10-07T08:58:37.265067+0000","last_active":"2023-10-07T08:58:38.284697+0000","last_peered":"2023-10-07T08:58:38.284697+0000","last_clean":"2023-10-07T08:58:38.284697+0000","last_became_active":"2023-10-07T08:58:37.264758+0000","last_became_peered":"2023-10-07T08:58:37.264758+0000","last_unstale":"2023-10-07T08:58:38.284697+0000","last_undegraded":"2023-10-07T08:58:38.284697+0000","last_fullsized":"2023-10-07T08:58:38.284697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.165187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278973+0000","last_change":"2023-10-07T08:58:38.273936+0000","last_active":"2023-10-07T08:58:38.278973+0000","last_peered":"2023-10-07T08:58:38.278973+0000","last_clean":"2023-10-07T08:58:38.278973+0000","last_became_active":"2023-10-07T08:58:38.267851+0000","last_became_peered":"2023-10-07T08:58:38.267851+0000","last_unstale":"2023-10-07T08:58:38.278973+0000","last_undegraded":"2023-10-07T08:58:38.278973+0000","last_fullsized":"2023-10-07T08:58:38.278973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:27.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270652+0000","last_change":"2023-10-07T08:58:37.266407+0000","last_active":"2023-10-07T08:58:37.270652+0000","last_peered":"2023-10-07T08:58:37.270652+0000","last_clean":"2023-10-07T08:58:37.270652+0000","last_became_active":"2023-10-07T08:58:37.266126+0000","last_became_peered":"2023-10-07T08:58:37.266126+0000","last_unstale":"2023-10-07T08:58:37.270652+0000","last_undegraded":"2023-10-07T08:58:37.270652+0000","last_fullsized":"2023-10-07T08:58:37.270652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280719+0000","last_change":"2023-10-07T08:58:38.278017+0000","last_active":"2023-10-07T08:58:38.280719+0000","last_peered":"2023-10-07T08:58:38.280719+0000","last_clean":"2023-10-07T08:58:38.280719+0000","last_became_active":"2023-10-07T08:58:38.277742+0000","last_became_peered":"2023-10-07T08:58:38.277742+0000","last_unstale":"2023-10-07T08:58:38.280719+0000","last_undegraded":"2023-10-07T08:58:38.280719+0000","last_fullsized":"2023-10-07T08:58:38.280719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.264976+0000","last_change":"2023-10-07T08:58:37.264042+0000","last_active":"2023-10-07T08:58:37.264976+0000","last_peered":"2023-10-07T08:58:37.264976+0000","last_clean":"2023-10-07T08:58:37.264976+0000","last_became_active":"2023-10-07T08:58:37.263461+0000","last_became_peered":"2023-10-07T08:58:37.263461+0000","last_unstale":"2023-10-07T08:58:37.264976+0000","last_undegraded":"2023-10-07T08:58:37.264976+0000","last_fullsized":"2023-10-07T08:58:37.264976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276672+0000","last_change":"2023-10-07T08:58:38.276672+0000","last_active":"2023-10-07T08:58:38.276672+0000","last_peered":"2023-10-07T08:58:38.276672+0000","last_clean":"2023-10-07T08:58:38.276672+0000","last_became_active":"2023-10-07T08:58:38.275867+0000","last_became_peered":"2023-10-07T08:58:38.275867+0000","last_unstale":"2023-10-07T08:58:38.276672+0000","last_undegraded":"2023-10-07T08:58:38.276672+0000","last_fullsized":"2023-10-07T08:58:38.276672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276567+0000","last_change":"2023-10-07T08:58:37.259625+0000","last_active":"2023-10-07T08:58:38.276567+0000","last_peered":"2023-10-07T08:58:38.276567+0000","last_clean":"2023-10-07T08:58:38.276567+0000","last_became_active":"2023-10-07T08:58:37.259284+0000","last_became_peered":"2023-10-07T08:58:37.259284+0000","last_unstale":"2023-10-07T08:58:38.276567+0000","last_undegraded":"2023-10-07T08:58:38.276567+0000","last_fullsized":"2023-10-07T08:58:38.276567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274030+0000","last_change":"2023-10-07T08:58:38.271932+0000","last_active":"2023-10-07T08:58:38.274030+0000","last_peered":"2023-10-07T08:58:38.274030+0000","last_clean":"2023-10-07T08:58:38.274030+0000","last_became_active":"2023-10-07T08:58:38.271668+0000","last_became_peered":"2023-10-07T08:58:38.271668+0000","last_unstale":"2023-10-07T08:58:38.274030+0000","last_undegraded":"2023-10-07T08:58:38.274030+0000","last_fullsized":"2023-10-07T08:58:38.274030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284462+0000","last_change":"2023-10-07T08:58:37.262301+0000","last_active":"2023-10-07T08:58:38.284462+0000","last_peered":"2023-10-07T08:58:38.284462+0000","last_clean":"2023-10-07T08:58:38.284462+0000","last_became_active":"2023-10-07T08:58:37.262025+0000","last_became_peered":"2023-10-07T08:58:37.262025+0000","last_unstale":"2023-10-07T08:58:38.284462+0000","last_undegraded":"2023-10-07T08:58:38.284462+0000","last_fullsized":"2023-10-07T08:58:38.284462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:08.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275951+0000","last_change":"2023-10-07T08:58:38.272054+0000","last_active":"2023-10-07T08:58:38.275951+0000","last_peered":"2023-10-07T08:58:38.275951+0000","last_clean":"2023-10-07T08:58:38.275951+0000","last_became_active":"2023-10-07T08:58:38.271783+0000","last_became_peered":"2023-10-07T08:58:38.271783+0000","last_unstale":"2023-10-07T08:58:38.275951+0000","last_undegraded":"2023-10-07T08:58:38.275951+0000","last_fullsized":"2023-10-07T08:58:38.275951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251812+0000","last_change":"2023-10-07T08:58:37.270177+0000","last_active":"2023-10-07T08:58:38.251812+0000","last_peered":"2023-10-07T08:58:38.251812+0000","last_clean":"2023-10-07T08:58:38.251812+0000","last_became_active":"2023-10-07T08:58:37.269889+0000","last_became_peered":"2023-10-07T08:58:37.269889+0000","last_unstale":"2023-10-07T08:58:38.251812+0000","last_undegraded":"2023-10-07T08:58:38.251812+0000","last_fullsized":"2023-10-07T08:58:38.251812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265632+0000","last_change":"2023-10-07T08:58:38.265632+0000","last_active":"2023-10-07T08:58:38.265632+0000","last_peered":"2023-10-07T08:58:38.265632+0000","last_clean":"2023-10-07T08:58:38.265632+0000","last_became_active":"2023-10-07T08:58:38.265352+0000","last_became_peered":"2023-10-07T08:58:38.265352+0000","last_unstale":"2023-10-07T08:58:38.265632+0000","last_undegraded":"2023-10-07T08:58:38.265632+0000","last_fullsized":"2023-10-07T08:58:38.265632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.271456+0000","last_change":"2023-10-07T08:58:37.270333+0000","last_active":"2023-10-07T08:58:37.271456+0000","last_peered":"2023-10-07T08:58:37.271456+0000","last_clean":"2023-10-07T08:58:37.271456+0000","last_became_active":"2023-10-07T08:58:37.270099+0000","last_became_peered":"2023-10-07T08:58:37.270099+0000","last_unstale":"2023-10-07T08:58:37.271456+0000","last_undegraded":"2023-10-07T08:58:37.271456+0000","last_fullsized":"2023-10-07T08:58:37.271456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275565+0000","last_change":"2023-10-07T08:58:38.272196+0000","last_active":"2023-10-07T08:58:38.275565+0000","last_peered":"2023-10-07T08:58:38.275565+0000","last_clean":"2023-10-07T08:58:38.275565+0000","last_became_active":"2023-10-07T08:58:38.268871+0000","last_became_peered":"2023-10-07T08:58:38.268871+0000","last_unstale":"2023-10-07T08:58:38.275565+0000","last_undegraded":"2023-10-07T08:58:38.275565+0000","last_fullsized":"2023-10-07T08:58:38.275565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272269+0000","last_change":"2023-10-07T08:58:38.265483+0000","last_active":"2023-10-07T08:58:38.272269+0000","last_peered":"2023-10-07T08:58:38.272269+0000","last_clean":"2023-10-07T08:58:38.272269+0000","last_became_active":"2023-10-07T08:58:38.265225+0000","last_became_peered":"2023-10-07T08:58:38.265225+0000","last_unstale":"2023-10-07T08:58:38.272269+0000","last_undegraded":"2023-10-07T08:58:38.272269+0000","last_fullsized":"2023-10-07T08:58:38.272269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.267966+0000","last_change":"2023-10-07T08:58:37.265772+0000","last_active":"2023-10-07T08:58:37.267966+0000","last_peered":"2023-10-07T08:58:37.267966+0000","last_clean":"2023-10-07T08:58:37.267966+0000","last_became_active":"2023-10-07T08:58:37.265480+0000","last_became_peered":"2023-10-07T08:58:37.265480+0000","last_unstale":"2023-10-07T08:58:37.267966+0000","last_undegraded":"2023-10-07T08:58:37.267966+0000","last_fullsized":"2023-10-07T08:58:37.267966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267707+0000","last_change":"2023-10-07T08:58:38.267707+0000","last_active":"2023-10-07T08:58:38.267707+0000","last_peered":"2023-10-07T08:58:38.267707+0000","last_clean":"2023-10-07T08:58:38.267707+0000","last_became_active":"2023-10-07T08:58:38.267397+0000","last_became_peered":"2023-10-07T08:58:38.267397+0000","last_unstale":"2023-10-07T08:58:38.267707+0000","last_undegraded":"2023-10-07T08:58:38.267707+0000","last_fullsized":"2023-10-07T08:58:38.267707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.270001+0000","last_change":"2023-10-07T08:58:37.266816+0000","last_active":"2023-10-07T08:58:37.270001+0000","last_peered":"2023-10-07T08:58:37.270001+0000","last_clean":"2023-10-07T08:58:37.270001+0000","last_became_active":"2023-10-07T08:58:37.266529+0000","last_became_peered":"2023-10-07T08:58:37.266529+0000","last_unstale":"2023-10-07T08:58:37.270001+0000","last_undegraded":"2023-10-07T08:58:37.270001+0000","last_fullsized":"2023-10-07T08:58:37.270001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259526+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:58:38.259526+0000","last_peered":"2023-10-07T08:58:38.259526+0000","last_clean":"2023-10-07T08:58:38.259526+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:58:38.259526+0000","last_undegraded":"2023-10-07T08:58:38.259526+0000","last_fullsized":"2023-10-07T08:58:38.259526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278929+0000","last_change":"2023-10-07T08:58:38.274743+0000","last_active":"2023-10-07T08:58:38.278929+0000","last_peered":"2023-10-07T08:58:38.278929+0000","last_clean":"2023-10-07T08:58:38.278929+0000","last_became_active":"2023-10-07T08:58:38.273665+0000","last_became_peered":"2023-10-07T08:58:38.273665+0000","last_unstale":"2023-10-07T08:58:38.278929+0000","last_undegraded":"2023-10-07T08:58:38.278929+0000","last_fullsized":"2023-10-07T08:58:38.278929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259654+0000","last_change":"2023-10-07T08:58:37.267054+0000","last_active":"2023-10-07T08:58:38.259654+0000","last_peered":"2023-10-07T08:58:38.259654+0000","last_clean":"2023-10-07T08:58:38.259654+0000","last_became_active":"2023-10-07T08:58:37.266737+0000","last_became_peered":"2023-10-07T08:58:37.266737+0000","last_unstale":"2023-10-07T08:58:38.259654+0000","last_undegraded":"2023-10-07T08:58:38.259654+0000","last_fullsized":"2023-10-07T08:58:38.259654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:21.835890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.261600+0000","last_change":"2023-10-07T08:58:37.265472+0000","last_active":"2023-10-07T08:58:38.261600+0000","last_peered":"2023-10-07T08:58:38.261600+0000","last_clean":"2023-10-07T08:58:38.261600+0000","last_became_active":"2023-10-07T08:58:37.264985+0000","last_became_peered":"2023-10-07T08:58:37.264985+0000","last_unstale":"2023-10-07T08:58:38.261600+0000","last_undegraded":"2023-10-07T08:58:38.261600+0000","last_fullsized":"2023-10-07T08:58:38.261600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269942+0000","last_change":"2023-10-07T08:58:38.264926+0000","last_active":"2023-10-07T08:58:38.269942+0000","last_peered":"2023-10-07T08:58:38.269942+0000","last_clean":"2023-10-07T08:58:38.269942+0000","last_became_active":"2023-10-07T08:58:38.264654+0000","last_became_peered":"2023-10-07T08:58:38.264654+0000","last_unstale":"2023-10-07T08:58:38.269942+0000","last_undegraded":"2023-10-07T08:58:38.269942+0000","last_fullsized":"2023-10-07T08:58:38.269942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252104+0000","last_change":"2023-10-07T08:58:37.261664+0000","last_active":"2023-10-07T08:58:38.252104+0000","last_peered":"2023-10-07T08:58:38.252104+0000","last_clean":"2023-10-07T08:58:38.252104+0000","last_became_active":"2023-10-07T08:58:37.261370+0000","last_became_peered":"2023-10-07T08:58:37.261370+0000","last_unstale":"2023-10-07T08:58:38.252104+0000","last_undegraded":"2023-10-07T08:58:38.252104+0000","last_fullsized":"2023-10-07T08:58:38.252104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264474+0000","last_change":"2023-10-07T08:58:38.264474+0000","last_active":"2023-10-07T08:58:38.264474+0000","last_peered":"2023-10-07T08:58:38.264474+0000","last_clean":"2023-10-07T08:58:38.264474+0000","last_became_active":"2023-10-07T08:58:38.264205+0000","last_became_peered":"2023-10-07T08:58:38.264205+0000","last_unstale":"2023-10-07T08:58:38.264474+0000","last_undegraded":"2023-10-07T08:58:38.264474+0000","last_fullsized":"2023-10-07T08:58:38.264474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280502+0000","last_change":"2023-10-07T08:58:37.265911+0000","last_active":"2023-10-07T08:58:38.280502+0000","last_peered":"2023-10-07T08:58:38.280502+0000","last_clean":"2023-10-07T08:58:38.280502+0000","last_became_active":"2023-10-07T08:58:37.265641+0000","last_became_peered":"2023-10-07T08:58:37.265641+0000","last_unstale":"2023-10-07T08:58:38.280502+0000","last_undegraded":"2023-10-07T08:58:38.280502+0000","last_fullsized":"2023-10-07T08:58:38.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277871+0000","last_change":"2023-10-07T08:58:38.270356+0000","last_active":"2023-10-07T08:58:38.277871+0000","last_peered":"2023-10-07T08:58:38.277871+0000","last_clean":"2023-10-07T08:58:38.277871+0000","last_became_active":"2023-10-07T08:58:38.270083+0000","last_became_peered":"2023-10-07T08:58:38.270083+0000","last_unstale":"2023-10-07T08:58:38.277871+0000","last_undegraded":"2023-10-07T08:58:38.277871+0000","last_fullsized":"2023-10-07T08:58:38.277871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:14:21.759445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259621+0000","last_change":"2023-10-07T08:58:37.271336+0000","last_active":"2023-10-07T08:58:38.259621+0000","last_peered":"2023-10-07T08:58:38.259621+0000","last_clean":"2023-10-07T08:58:38.259621+0000","last_became_active":"2023-10-07T08:58:37.271057+0000","last_became_peered":"2023-10-07T08:58:37.271057+0000","last_unstale":"2023-10-07T08:58:38.259621+0000","last_undegraded":"2023-10-07T08:58:38.259621+0000","last_fullsized":"2023-10-07T08:58:38.259621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274310+0000","last_change":"2023-10-07T08:58:38.266393+0000","last_active":"2023-10-07T08:58:38.274310+0000","last_peered":"2023-10-07T08:58:38.274310+0000","last_clean":"2023-10-07T08:58:38.274310+0000","last_became_active":"2023-10-07T08:58:38.266131+0000","last_became_peered":"2023-10-07T08:58:38.266131+0000","last_unstale":"2023-10-07T08:58:38.274310+0000","last_undegraded":"2023-10-07T08:58:38.274310+0000","last_fullsized":"2023-10-07T08:58:38.274310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:57.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252634+0000","last_change":"2023-10-07T08:58:37.265724+0000","last_active":"2023-10-07T08:58:38.252634+0000","last_peered":"2023-10-07T08:58:38.252634+0000","last_clean":"2023-10-07T08:58:38.252634+0000","last_became_active":"2023-10-07T08:58:37.265218+0000","last_became_peered":"2023-10-07T08:58:37.265218+0000","last_unstale":"2023-10-07T08:58:38.252634+0000","last_undegraded":"2023-10-07T08:58:38.252634+0000","last_fullsized":"2023-10-07T08:58:38.252634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259788+0000","last_change":"2023-10-07T08:58:38.259788+0000","last_active":"2023-10-07T08:58:38.259788+0000","last_peered":"2023-10-07T08:58:38.259788+0000","last_clean":"2023-10-07T08:58:38.259788+0000","last_became_active":"2023-10-07T08:58:38.259490+0000","last_became_peered":"2023-10-07T08:58:38.259490+0000","last_unstale":"2023-10-07T08:58:38.259788+0000","last_undegraded":"2023-10-07T08:58:38.259788+0000","last_fullsized":"2023-10-07T08:58:38.259788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251753+0000","last_change":"2023-10-07T08:58:37.269182+0000","last_active":"2023-10-07T08:58:38.251753+0000","last_peered":"2023-10-07T08:58:38.251753+0000","last_clean":"2023-10-07T08:58:38.251753+0000","last_became_active":"2023-10-07T08:58:37.268876+0000","last_became_peered":"2023-10-07T08:58:37.268876+0000","last_unstale":"2023-10-07T08:58:38.251753+0000","last_undegraded":"2023-10-07T08:58:38.251753+0000","last_fullsized":"2023-10-07T08:58:38.251753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:47.176445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277598+0000","last_change":"2023-10-07T08:58:38.277598+0000","last_active":"2023-10-07T08:58:38.277598+0000","last_peered":"2023-10-07T08:58:38.277598+0000","last_clean":"2023-10-07T08:58:38.277598+0000","last_became_active":"2023-10-07T08:58:38.277298+0000","last_became_peered":"2023-10-07T08:58:38.277298+0000","last_unstale":"2023-10-07T08:58:38.277598+0000","last_undegraded":"2023-10-07T08:58:38.277598+0000","last_fullsized":"2023-10-07T08:58:38.277598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284373+0000","last_change":"2023-10-07T08:58:37.267496+0000","last_active":"2023-10-07T08:58:38.284373+0000","last_peered":"2023-10-07T08:58:38.284373+0000","last_clean":"2023-10-07T08:58:38.284373+0000","last_became_active":"2023-10-07T08:58:37.267211+0000","last_became_peered":"2023-10-07T08:58:37.267211+0000","last_unstale":"2023-10-07T08:58:38.284373+0000","last_undegraded":"2023-10-07T08:58:38.284373+0000","last_fullsized":"2023-10-07T08:58:38.284373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270706+0000","last_change":"2023-10-07T08:58:38.270706+0000","last_active":"2023-10-07T08:58:38.270706+0000","last_peered":"2023-10-07T08:58:38.270706+0000","last_clean":"2023-10-07T08:58:38.270706+0000","last_became_active":"2023-10-07T08:58:38.270439+0000","last_became_peered":"2023-10-07T08:58:38.270439+0000","last_unstale":"2023-10-07T08:58:38.270706+0000","last_undegraded":"2023-10-07T08:58:38.270706+0000","last_fullsized":"2023-10-07T08:58:38.270706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-07T08:58:37.268772+0000","last_change":"2023-10-07T08:58:37.266819+0000","last_active":"2023-10-07T08:58:37.268772+0000","last_peered":"2023-10-07T08:58:37.268772+0000","last_clean":"2023-10-07T08:58:37.268772+0000","last_became_active":"2023-10-07T08:58:37.266526+0000","last_became_peered":"2023-10-07T08:58:37.266526+0000","last_unstale":"2023-10-07T08:58:37.268772+0000","last_undegraded":"2023-10-07T08:58:37.268772+0000","last_fullsized":"2023-10-07T08:58:37.268772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279068+0000","last_change":"2023-10-07T08:58:38.274546+0000","last_active":"2023-10-07T08:58:38.279068+0000","last_peered":"2023-10-07T08:58:38.279068+0000","last_clean":"2023-10-07T08:58:38.279068+0000","last_became_active":"2023-10-07T08:58:38.274288+0000","last_became_peered":"2023-10-07T08:58:38.274288+0000","last_unstale":"2023-10-07T08:58:38.279068+0000","last_undegraded":"2023-10-07T08:58:38.279068+0000","last_fullsized":"2023-10-07T08:58:38.279068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284614+0000","last_change":"2023-10-07T08:58:37.261183+0000","last_active":"2023-10-07T08:58:38.284614+0000","last_peered":"2023-10-07T08:58:38.284614+0000","last_clean":"2023-10-07T08:58:38.284614+0000","last_became_active":"2023-10-07T08:58:37.260954+0000","last_became_peered":"2023-10-07T08:58:37.260954+0000","last_unstale":"2023-10-07T08:58:38.284614+0000","last_undegraded":"2023-10-07T08:58:38.284614+0000","last_fullsized":"2023-10-07T08:58:38.284614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264621+0000","last_change":"2023-10-07T08:58:38.264621+0000","last_active":"2023-10-07T08:58:38.264621+0000","last_peered":"2023-10-07T08:58:38.264621+0000","last_clean":"2023-10-07T08:58:38.264621+0000","last_became_active":"2023-10-07T08:58:38.264344+0000","last_became_peered":"2023-10-07T08:58:38.264344+0000","last_unstale":"2023-10-07T08:58:38.264621+0000","last_undegraded":"2023-10-07T08:58:38.264621+0000","last_fullsized":"2023-10-07T08:58:38.264621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.281389+0000","last_change":"2023-10-07T08:58:37.267477+0000","last_active":"2023-10-07T08:58:38.281389+0000","last_peered":"2023-10-07T08:58:38.281389+0000","last_clean":"2023-10-07T08:58:38.281389+0000","last_became_active":"2023-10-07T08:58:37.267186+0000","last_became_peered":"2023-10-07T08:58:37.267186+0000","last_unstale":"2023-10-07T08:58:38.281389+0000","last_undegraded":"2023-10-07T08:58:38.281389+0000","last_fullsized":"2023-10-07T08:58:38.281389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283571+0000","last_change":"2023-10-07T08:58:38.278356+0000","last_active":"2023-10-07T08:58:38.283571+0000","last_peered":"2023-10-07T08:58:38.283571+0000","last_clean":"2023-10-07T08:58:38.283571+0000","last_became_active":"2023-10-07T08:58:38.277900+0000","last_became_peered":"2023-10-07T08:58:38.277900+0000","last_unstale":"2023-10-07T08:58:38.283571+0000","last_undegraded":"2023-10-07T08:58:38.283571+0000","last_fullsized":"2023-10-07T08:58:38.283571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276244+0000","last_change":"2023-10-07T08:58:38.276244+0000","last_active":"2023-10-07T08:58:38.276244+0000","last_peered":"2023-10-07T08:58:38.276244+0000","last_clean":"2023-10-07T08:58:38.276244+0000","last_became_active":"2023-10-07T08:58:38.275899+0000","last_became_peered":"2023-10-07T08:58:38.275899+0000","last_unstale":"2023-10-07T08:58:38.276244+0000","last_undegraded":"2023-10-07T08:58:38.276244+0000","last_fullsized":"2023-10-07T08:58:38.276244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269027+0000","last_change":"2023-10-07T08:58:38.269027+0000","last_active":"2023-10-07T08:58:38.269027+0000","last_peered":"2023-10-07T08:58:38.269027+0000","last_clean":"2023-10-07T08:58:38.269027+0000","last_became_active":"2023-10-07T08:58:38.268305+0000","last_became_peered":"2023-10-07T08:58:38.268305+0000","last_unstale":"2023-10-07T08:58:38.269027+0000","last_undegraded":"2023-10-07T08:58:38.269027+0000","last_fullsized":"2023-10-07T08:58:38.269027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:39.609895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263865+0000","last_change":"2023-10-07T08:58:38.263865+0000","last_active":"2023-10-07T08:58:38.263865+0000","last_peered":"2023-10-07T08:58:38.263865+0000","last_clean":"2023-10-07T08:58:38.263865+0000","last_became_active":"2023-10-07T08:58:38.263605+0000","last_became_peered":"2023-10-07T08:58:38.263605+0000","last_unstale":"2023-10-07T08:58:38.263865+0000","last_undegraded":"2023-10-07T08:58:38.263865+0000","last_fullsized":"2023-10-07T08:58:38.263865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277986+0000","last_change":"2023-10-07T08:58:38.272673+0000","last_active":"2023-10-07T08:58:38.277986+0000","last_peered":"2023-10-07T08:58:38.277986+0000","last_clean":"2023-10-07T08:58:38.277986+0000","last_became_active":"2023-10-07T08:58:38.272332+0000","last_became_peered":"2023-10-07T08:58:38.272332+0000","last_unstale":"2023-10-07T08:58:38.277986+0000","last_undegraded":"2023-10-07T08:58:38.277986+0000","last_fullsized":"2023-10-07T08:58:38.277986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266586+0000","last_change":"2023-10-07T08:58:38.266586+0000","last_active":"2023-10-07T08:58:38.266586+0000","last_peered":"2023-10-07T08:58:38.266586+0000","last_clean":"2023-10-07T08:58:38.266586+0000","last_became_active":"2023-10-07T08:58:38.266197+0000","last_became_peered":"2023-10-07T08:58:38.266197+0000","last_unstale":"2023-10-07T08:58:38.266586+0000","last_undegraded":"2023-10-07T08:58:38.266586+0000","last_fullsized":"2023-10-07T08:58:38.266586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260868+0000","last_change":"2023-10-07T08:58:38.259089+0000","last_active":"2023-10-07T08:58:38.260868+0000","last_peered":"2023-10-07T08:58:38.260868+0000","last_clean":"2023-10-07T08:58:38.260868+0000","last_became_active":"2023-10-07T08:58:38.258801+0000","last_became_peered":"2023-10-07T08:58:38.258801+0000","last_unstale":"2023-10-07T08:58:38.260868+0000","last_undegraded":"2023-10-07T08:58:38.260868+0000","last_fullsized":"2023-10-07T08:58:38.260868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271464+0000","last_change":"2023-10-07T08:58:38.271464+0000","last_active":"2023-10-07T08:58:38.271464+0000","last_peered":"2023-10-07T08:58:38.271464+0000","last_clean":"2023-10-07T08:58:38.271464+0000","last_became_active":"2023-10-07T08:58:38.271181+0000","last_became_peered":"2023-10-07T08:58:38.271181+0000","last_unstale":"2023-10-07T08:58:38.271464+0000","last_undegraded":"2023-10-07T08:58:38.271464+0000","last_fullsized":"2023-10-07T08:58:38.271464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265753+0000","last_change":"2023-10-07T08:58:38.265753+0000","last_active":"2023-10-07T08:58:38.265753+0000","last_peered":"2023-10-07T08:58:38.265753+0000","last_clean":"2023-10-07T08:58:38.265753+0000","last_became_active":"2023-10-07T08:58:38.265442+0000","last_became_peered":"2023-10-07T08:58:38.265442+0000","last_unstale":"2023-10-07T08:58:38.265753+0000","last_undegraded":"2023-10-07T08:58:38.265753+0000","last_fullsized":"2023-10-07T08:58:38.265753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.263382+0000","last_change":"2023-10-07T08:58:38.263382+0000","last_active":"2023-10-07T08:58:38.263382+0000","last_peered":"2023-10-07T08:58:38.263382+0000","last_clean":"2023-10-07T08:58:38.263382+0000","last_became_active":"2023-10-07T08:58:38.263121+0000","last_became_peered":"2023-10-07T08:58:38.263121+0000","last_unstale":"2023-10-07T08:58:38.263382+0000","last_undegraded":"2023-10-07T08:58:38.263382+0000","last_fullsized":"2023-10-07T08:58:38.263382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265927+0000","last_change":"2023-10-07T08:58:38.265927+0000","last_active":"2023-10-07T08:58:38.265927+0000","last_peered":"2023-10-07T08:58:38.265927+0000","last_clean":"2023-10-07T08:58:38.265927+0000","last_became_active":"2023-10-07T08:58:38.265607+0000","last_became_peered":"2023-10-07T08:58:38.265607+0000","last_unstale":"2023-10-07T08:58:38.265927+0000","last_undegraded":"2023-10-07T08:58:38.265927+0000","last_fullsized":"2023-10-07T08:58:38.265927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.264874+0000","last_change":"2023-10-07T08:58:38.264874+0000","last_active":"2023-10-07T08:58:38.264874+0000","last_peered":"2023-10-07T08:58:38.264874+0000","last_clean":"2023-10-07T08:58:38.264874+0000","last_became_active":"2023-10-07T08:58:38.264577+0000","last_became_peered":"2023-10-07T08:58:38.264577+0000","last_unstale":"2023-10-07T08:58:38.264874+0000","last_undegraded":"2023-10-07T08:58:38.264874+0000","last_fullsized":"2023-10-07T08:58:38.264874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277961+0000","last_change":"2023-10-07T08:58:38.270592+0000","last_active":"2023-10-07T08:58:38.277961+0000","last_peered":"2023-10-07T08:58:38.277961+0000","last_clean":"2023-10-07T08:58:38.277961+0000","last_became_active":"2023-10-07T08:58:38.270016+0000","last_became_peered":"2023-10-07T08:58:38.270016+0000","last_unstale":"2023-10-07T08:58:38.277961+0000","last_undegraded":"2023-10-07T08:58:38.277961+0000","last_fullsized":"2023-10-07T08:58:38.277961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271588+0000","last_change":"2023-10-07T08:58:38.271588+0000","last_active":"2023-10-07T08:58:38.271588+0000","last_peered":"2023-10-07T08:58:38.271588+0000","last_clean":"2023-10-07T08:58:38.271588+0000","last_became_active":"2023-10-07T08:58:38.271197+0000","last_became_peered":"2023-10-07T08:58:38.271197+0000","last_unstale":"2023-10-07T08:58:38.271588+0000","last_undegraded":"2023-10-07T08:58:38.271588+0000","last_fullsized":"2023-10-07T08:58:38.271588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":69115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:58:42.753 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:58:42.753 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-07T08:58:42.753 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-07T08:58:42.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-07T08:58:42.754 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-07T08:58:42.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.903+0000 7f0ea0a73700 1 Processor -- start 2023-10-07T08:58:42.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.903+0000 7f0ea0a73700 1 -- start start 2023-10-07T08:58:42.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0ea0a73700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0e9c159420 0x7f0e9c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0ea0a73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e9c15d230 0x7f0e9c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0ea0a73700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c0b2980 con 0x7f0e9c1597f0 2023-10-07T08:58:42.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0ea0a73700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c15db70 con 0x7f0e9c159420 2023-10-07T08:58:42.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0ea0a73700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c0b11d0 con 0x7f0e9c15d230 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0e9c159420 0x7f0e9c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0e9c159420 0x7f0e9c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60316/0 (socket says 172.21.15.46:60316) 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 -- 172.21.15.46:0/379508883 learned_addr learned my addr 172.21.15.46:0/379508883 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9bfff700 1 --2- 172.21.15.46:0/379508883 >> v2:172.21.15.133:3300/0 conn(0x7f0e9c15d230 0x7f0e9c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 -- 172.21.15.46:0/379508883 >> v2:172.21.15.133:3300/0 conn(0x7f0e9c15d230 msgr2=0x7f0e9c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/379508883 >> v2:172.21.15.133:3300/0 conn(0x7f0e9c15d230 0x7f0e9c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 -- 172.21.15.46:0/379508883 >> v1:172.21.15.133:6789/0 conn(0x7f0e9c1597f0 legacy=0x7f0e9c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.904+0000 7f0e9b7fe700 1 -- 172.21.15.46:0/379508883 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0b14b0 con 0x7f0e9c159420 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/379508883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c159420 0x7f0e9c0b5f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c15d170 tx=0x7f0e8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8702c3cd710094b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0e9a7fc700 1 -- 172.21.15.46:0/379508883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00b820 con 0x7f0e9c159420 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0e9a7fc700 1 -- 172.21.15.46:0/379508883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00b980 con 0x7f0e9c159420 2023-10-07T08:58:42.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0e9a7fc700 1 -- 172.21.15.46:0/379508883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bd20 con 0x7f0e9c159420 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 -- 172.21.15.46:0/379508883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c159420 msgr2=0x7f0e9c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/379508883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c159420 0x7f0e9c0b5f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c15d170 tx=0x7f0e8c009250 comp rx=0 tx=0).stop 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 -- 172.21.15.46:0/379508883 shutdown_connections 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/379508883 >> v2:172.21.15.133:3300/0 conn(0x7f0e9c15d230 0x7f0e9c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/379508883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c159420 0x7f0e9c0b5f40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 -- 172.21.15.46:0/379508883 >> 172.21.15.46:0/379508883 conn(0x7f0e9c0d0660 msgr2=0x7f0e9c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 -- 172.21.15.46:0/379508883 shutdown_connections 2023-10-07T08:58:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.905+0000 7f0ea0a73700 1 -- 172.21.15.46:0/379508883 wait complete. 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 Processor -- start 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 -- start start 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 0x7f0e9c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 0x7f0e9c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cb780 con 0x7f0e9c15d230 2023-10-07T08:58:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cab70 con 0x7f0e9c159420 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0ea0a73700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cae50 con 0x7f0e9c1597f0 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60328/0 (socket says 172.21.15.46:60328) 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.907+0000 7f0e9bfff700 1 -- 172.21.15.46:0/4278266286 learned_addr learned my addr 172.21.15.46:0/4278266286 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 0x7f0e9c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9affd700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 0x7f0e9c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 -- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 msgr2=0x7f0e9c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 0x7f0e9c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 -- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 msgr2=0x7f0e9c0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 0x7f0e9c0c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 -- 172.21.15.46:0/4278266286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0094f0 con 0x7f0e9c15d230 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 0x7f0e9c0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9affd700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 0x7f0e9c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e9bfff700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400cdb0 tx=0x7f0e940077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400aa80 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400abe0 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c0cb130 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94017430 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.908+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c0cc150 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.909+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c04c3c0 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.909+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e94003020 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.910+0000 7f0e837fe700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.910+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e94013070 con 0x7f0e9c15d230 2023-10-07T08:58:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.910+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.911+0000 7f0e9b7fe700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c15d170 tx=0x7f0e8c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:42.914+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e94051cf0 con 0x7f0e9c15d230 2023-10-07T08:58:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.163+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0e9c0b1790 con 0x7f0e9c15d230 2023-10-07T08:58:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.166+0000 7f0e837fe700 1 -- 172.21.15.46:0/4278266286 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163702 (secure 0 0 0) 0x7f0e94055310 con 0x7f0e9c15d230 2023-10-07T08:58:43.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 msgr2=0x7f0e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c15d170 tx=0x7f0e8c016000 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 msgr2=0x7f0e9c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400cdb0 tx=0x7f0e940077d0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 shutdown_connections 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e9c15d230 0x7f0e9c0cc630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c159420 0x7f0e9c0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.168+0000 7f0ea0a73700 1 --2- 172.21.15.46:0/4278266286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e9c1597f0 0x7f0e9c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.169+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 >> 172.21.15.46:0/4278266286 conn(0x7f0e9c0d0660 msgr2=0x7f0e9c0b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.169+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 shutdown_connections 2023-10-07T08:58:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.169+0000 7f0ea0a73700 1 -- 172.21.15.46:0/4278266286 wait complete. 2023-10-07T08:58:43.182 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":90477},{"type":"v1","addr":"172.21.15.133:6833","nonce":90477}]},"active_addr":"172.21.15.133:6833/90477","active_change":"2023-10-07T08:58:25.750934+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":4263982118}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":27376353}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":39620447}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":4274793432}]}]} 2023-10-07T08:58:43.187 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-07T08:58:43.187 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-07T08:58:43.187 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:43.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.304+0000 7f1763703700 1 Processor -- start 2023-10-07T08:58:43.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.304+0000 7f1763703700 1 -- start start 2023-10-07T08:58:43.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f1763703700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f175c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f1763703700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f175c15db10 0x7f175c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f1763703700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c15a160 con 0x7f175c159890 2023-10-07T08:58:43.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f1763703700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0d13a0 con 0x7f175c15db10 2023-10-07T08:58:43.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f1763703700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c15e140 con 0x7f175c159c60 2023-10-07T08:58:43.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f176149f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f175c159890 0x7f175c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54672/0 (socket says 172.21.15.46:54672) 2023-10-07T08:58:43.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.305+0000 7f176149f700 1 -- 172.21.15.46:0/698794292 learned_addr learned my addr 172.21.15.46:0/698794292 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:43.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1760c9e700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f175c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 --2- 172.21.15.46:0/698794292 >> v2:172.21.15.133:3300/0 conn(0x7f175c15db10 0x7f175c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594267946 0 0) 0x7f175c15a160 con 0x7f175c159890 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1744003570 con 0x7f175c159890 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1540995088 0 0) 0x7f1744003570 con 0x7f175c159890 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 msgr2=0x7f175c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f175c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 >> v2:172.21.15.133:3300/0 conn(0x7f175c15db10 msgr2=0x7f175c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:43.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 --2- 172.21.15.46:0/698794292 >> v2:172.21.15.133:3300/0 conn(0x7f175c15db10 0x7f175c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c15a3d0 con 0x7f175c159890 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f1754001470 con 0x7f175c159890 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 >> v1:172.21.15.46:6789/0 conn(0x7f175c159890 legacy=0x7f175c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f1744003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744003fe0 0x7f1744004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1744004d50 0x7f17440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0d13a0 con 0x7f1744004d50 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c15e140 con 0x7f1744003fe0 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174400ba90 con 0x7f175c159c60 2023-10-07T08:58:43.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f176149f700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f1744003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1744004d50 0x7f17440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1760c9e700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744003fe0 0x7f1744004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 -- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 msgr2=0x7f1744003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159c60 0x7f1744003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 -- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744003fe0 msgr2=0x7f1744004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744003fe0 0x7f1744004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1761ca0700 1 -- 172.21.15.46:0/698794292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744003570 con 0x7f1744004d50 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.306+0000 7f1760c9e700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744003fe0 0x7f1744004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1761ca0700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1744004d50 0x7f17440051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e210 tx=0x7f174c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdca26b9ce4998e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00ea60 con 0x7f1744004d50 2023-10-07T08:58:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00f040 con 0x7f1744004d50 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f175bfff700 1 -- 172.21.15.46:0/698794292 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00ee10 con 0x7f1744004d50 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 -- 172.21.15.46:0/698794292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1744004d50 msgr2=0x7f17440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 --2- 172.21.15.46:0/698794292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1744004d50 0x7f17440051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e210 tx=0x7f174c00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1761ca0700 1 -- 172.21.15.46:0/698794292 reap_dead start 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 -- 172.21.15.46:0/698794292 shutdown_connections 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 -- 172.21.15.46:0/698794292 >> 172.21.15.46:0/698794292 conn(0x7f175c068e20 msgr2=0x7f175c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 -- 172.21.15.46:0/698794292 shutdown_connections 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.307+0000 7f1763703700 1 -- 172.21.15.46:0/698794292 wait complete. 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.308+0000 7f1763703700 1 Processor -- start 2023-10-07T08:58:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 -- start start 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 0x7f175c16d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 0x7f175c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c16dde0 con 0x7f175c145130 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0c7e80 con 0x7f175c145500 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f1763703700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0c8290 con 0x7f175c16d960 2023-10-07T08:58:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f176149f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.309+0000 7f176149f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60348/0 (socket says 172.21.15.46:60348) 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 -- 172.21.15.46:0/1762290154 learned_addr learned my addr 172.21.15.46:0/1762290154 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1760c9e700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 0x7f175c16d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1761ca0700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 0x7f175c0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 -- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 msgr2=0x7f175c0b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 0x7f175c0b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 -- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 msgr2=0x7f175c16d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 0x7f175c16d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 -- 172.21.15.46:0/1762290154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0c8570 con 0x7f175c145130 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1760c9e700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 0x7f175c16d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1761ca0700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 0x7f175c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f176149f700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1754001d20 tx=0x7f1754001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754018030 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400f8a0 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c0c8850 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400fc40 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.310+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0ca4d0 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.311+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c0ca6f0 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.312+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f175401b070 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.312+0000 7f17597fa700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.312+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1754019070 con 0x7f175c145130 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.312+0000 7f1760c9e700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.313+0000 7f1760c9e700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 0x7f17480693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1750006eb0 tx=0x7f1750008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.316+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1754051800 con 0x7f175c145130 2023-10-07T08:58:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.510+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f175c0c9e10 con 0x7f175c145130 2023-10-07T08:58:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.511+0000 7f17597fa700 1 -- 172.21.15.46:0/1762290154 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f175c0c9e10 con 0x7f175c145130 2023-10-07T08:58:43.512 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:43.512 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 msgr2=0x7f17480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 0x7f17480693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1750006eb0 tx=0x7f1750008040 comp rx=0 tx=0).stop 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 msgr2=0x7f175c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1754001d20 tx=0x7f1754001e90 comp rx=0 tx=0).stop 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 shutdown_connections 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c16d960 0x7f175c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f175c145130 0x7f175c0c78a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 --2- 172.21.15.46:0/1762290154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c145500 0x7f175c16d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 >> 172.21.15.46:0/1762290154 conn(0x7f175c068e20 msgr2=0x7f175c156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:43.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 shutdown_connections 2023-10-07T08:58:43.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.513+0000 7f1763703700 1 -- 172.21.15.46:0/1762290154 wait complete. 2023-10-07T08:58:43.527 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-07T08:58:43.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.644+0000 7f2fc6cf0700 1 Processor -- start 2023-10-07T08:58:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.644+0000 7f2fc6cf0700 1 -- start start 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.644+0000 7f2fc6cf0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fc0159890 0x7f2fc015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc6cf0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc015a160 con 0x7f2fc0069560 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc6cf0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00d13a0 con 0x7f2fc0159c60 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc6cf0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc015e140 con 0x7f2fc0159890 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fc0159890 0x7f2fc015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc528d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2fc0069560 0x7f2fc00ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54674/0 (socket says 172.21.15.46:54674) 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fc0159890 0x7f2fc015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60360/0 (socket says 172.21.15.46:60360) 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc528d700 1 -- 172.21.15.46:0/1111736756 learned_addr learned my addr 172.21.15.46:0/1111736756 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 -- 172.21.15.46:0/1111736756 >> v1:172.21.15.133:6789/0 conn(0x7f2fc0159c60 legacy=0x7f2fc015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 -- 172.21.15.46:0/1111736756 >> v1:172.21.15.46:6789/0 conn(0x7f2fc0069560 legacy=0x7f2fc00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 -- 172.21.15.46:0/1111736756 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc015a3d0 con 0x7f2fc0159890 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fbf7fe700 1 -- 172.21.15.46:0/1111736756 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464272894 0 0) 0x7f2fc015a160 con 0x7f2fc0069560 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fc4a8c700 1 --2- 172.21.15.46:0/1111736756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159890 0x7f2fc015abd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00098e0 tx=0x7f2fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123a1e1d0235dfbb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fbf7fe700 1 -- 172.21.15.46:0/1111736756 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0009e80 con 0x7f2fc0159890 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fbf7fe700 1 -- 172.21.15.46:0/1111736756 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000b820 con 0x7f2fc0159890 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.645+0000 7f2fbf7fe700 1 -- 172.21.15.46:0/1111736756 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000bba0 con 0x7f2fc0159890 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/1111736756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159890 msgr2=0x7f2fc015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/1111736756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159890 0x7f2fc015abd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00098e0 tx=0x7f2fb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/1111736756 shutdown_connections 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/1111736756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159890 0x7f2fc015abd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/1111736756 >> 172.21.15.46:0/1111736756 conn(0x7f2fc0068e20 msgr2=0x7f2fc00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/1111736756 shutdown_connections 2023-10-07T08:58:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.646+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/1111736756 wait complete. 2023-10-07T08:58:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.647+0000 7f2fc6cf0700 1 Processor -- start 2023-10-07T08:58:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.647+0000 7f2fc6cf0700 1 -- start start 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 0x7f2fc015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc0159890 0x7f2fc00ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00ca750 con 0x7f2fc0159c60 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc016e2b0 con 0x7f2fc0069560 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc6cf0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc015c030 con 0x7f2fc0159890 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60362/0 (socket says 172.21.15.46:60362) 2023-10-07T08:58:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 -- 172.21.15.46:0/289838422 learned_addr learned my addr 172.21.15.46:0/289838422 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc4a8c700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 0x7f2fc015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fbffff700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc0159890 0x7f2fc00ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 -- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc0159890 msgr2=0x7f2fc00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc0159890 0x7f2fc00ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 -- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 msgr2=0x7f2fc015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 0x7f2fc015ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 -- 172.21.15.46:0/289838422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009420 con 0x7f2fc0159c60 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc4a8c700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 0x7f2fc015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:43.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.648+0000 7f2fc528d700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cbf0 tx=0x7f2fb80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.649+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800a9c0 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.649+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800ab20 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.649+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc015c310 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.649+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80070f0 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.649+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc015c8d0 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.650+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc004c3c0 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.650+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fb8007520 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.650+0000 7f2fbcff9700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 0x7f2fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.650+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fb8084910 con 0x7f2fc0159c60 2023-10-07T08:58:43.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.651+0000 7f2fc4a8c700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 0x7f2fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:43.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.651+0000 7f2fc4a8c700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 0x7f2fac0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00030c0 tx=0x7f2fb0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:43.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.655+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb8051c00 con 0x7f2fc0159c60 2023-10-07T08:58:43.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.848+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc0069ad0 con 0x7f2fc0159c60 2023-10-07T08:58:43.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.849+0000 7f2fbcff9700 1 -- 172.21.15.46:0/289838422 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2fb8055220 con 0x7f2fc0159c60 2023-10-07T08:58:43.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:43.851 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:43.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 msgr2=0x7f2fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 0x7f2fac0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00030c0 tx=0x7f2fb0016000 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 msgr2=0x7f2fc016dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cbf0 tx=0x7f2fb80019b0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 shutdown_connections 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fac066f30 0x7f2fac0693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc0159c60 0x7f2fc016dd70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc0069560 0x7f2fc015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 --2- 172.21.15.46:0/289838422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc0159890 0x7f2fc00ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 >> 172.21.15.46:0/289838422 conn(0x7f2fc0068e20 msgr2=0x7f2fc00b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 shutdown_connections 2023-10-07T08:58:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:43.851+0000 7f2fc6cf0700 1 -- 172.21.15.46:0/289838422 wait complete. 2023-10-07T08:58:43.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-07T08:58:43.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-07T08:58:43.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-07T08:58:43.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-07T08:58:43.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-07T08:58:43.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-07T08:58:43.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-07T08:58:43.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-07T08:58:44.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.070+0000 7f1453484700 1 Processor -- start 2023-10-07T08:58:44.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.070+0000 7f1453484700 1 -- start start 2023-10-07T08:58:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.071+0000 7f1453484700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f144c15d730 0x7f144c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.071+0000 7f1453484700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f144c06a410 0x7f144c06a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.071+0000 7f1453484700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144c0c74b0 con 0x7f144c159b10 2023-10-07T08:58:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.071+0000 7f1453484700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c0c8700 con 0x7f144c15d730 2023-10-07T08:58:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.071+0000 7f1453484700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c0c9070 con 0x7f144c06a410 2023-10-07T08:58:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1451220700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f144c159b10 0x7f144c0cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54678/0 (socket says 172.21.15.46:54678) 2023-10-07T08:58:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1451a21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f144c06a410 0x7f144c06a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1451220700 1 -- 172.21.15.46:0/3777134119 learned_addr learned my addr 172.21.15.46:0/3777134119 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1450a1f700 1 --2- 172.21.15.46:0/3777134119 >> v2:172.21.15.46:3300/0 conn(0x7f144c15d730 0x7f144c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1443fff700 1 -- 172.21.15.46:0/3777134119 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902931606 0 0) 0x7f144c0c74b0 con 0x7f144c159b10 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1450a1f700 1 -- 172.21.15.46:0/3777134119 >> v2:172.21.15.133:3300/0 conn(0x7f144c06a410 msgr2=0x7f144c06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1450a1f700 1 --2- 172.21.15.46:0/3777134119 >> v2:172.21.15.133:3300/0 conn(0x7f144c06a410 0x7f144c06a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1450a1f700 1 -- 172.21.15.46:0/3777134119 >> v1:172.21.15.46:6789/0 conn(0x7f144c159b10 legacy=0x7f144c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.072+0000 7f1450a1f700 1 -- 172.21.15.46:0/3777134119 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c15e0e0 con 0x7f144c15d730 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1450a1f700 1 --2- 172.21.15.46:0/3777134119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c15d730 0x7f144c15dba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f144c0cb170 tx=0x7f14480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74a5d4de9409b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1443fff700 1 -- 172.21.15.46:0/3777134119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800b690 con 0x7f144c15d730 2023-10-07T08:58:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1443fff700 1 -- 172.21.15.46:0/3777134119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800b7f0 con 0x7f144c15d730 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1443fff700 1 -- 172.21.15.46:0/3777134119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800bb90 con 0x7f144c15d730 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1453484700 1 -- 172.21.15.46:0/3777134119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c15d730 msgr2=0x7f144c15dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.073+0000 7f1453484700 1 --2- 172.21.15.46:0/3777134119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c15d730 0x7f144c15dba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f144c0cb170 tx=0x7f14480091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.074+0000 7f1453484700 1 -- 172.21.15.46:0/3777134119 shutdown_connections 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.074+0000 7f1453484700 1 --2- 172.21.15.46:0/3777134119 >> v2:172.21.15.133:3300/0 conn(0x7f144c06a410 0x7f144c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.074+0000 7f1453484700 1 --2- 172.21.15.46:0/3777134119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c15d730 0x7f144c15dba0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f144c0cb170 tx=0x7f14480091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.074+0000 7f1453484700 1 -- 172.21.15.46:0/3777134119 >> 172.21.15.46:0/3777134119 conn(0x7f144c0c9870 msgr2=0x7f144c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.075+0000 7fbc4eda9700 1 Processor -- start 2023-10-07T08:58:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.075+0000 7f1453484700 1 -- 172.21.15.46:0/3777134119 shutdown_connections 2023-10-07T08:58:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.075+0000 7f1453484700 1 -- 172.21.15.46:0/3777134119 wait complete. 2023-10-07T08:58:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.075+0000 7fbc4eda9700 1 -- start start 2023-10-07T08:58:44.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7f88c4e26700 1 Processor -- start 2023-10-07T08:58:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc48158440 0x7fbc48068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc48068fe0 0x7fbc480b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc480b1fe0 0x7fbc481619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480aef20 con 0x7fbc48158440 2023-10-07T08:58:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4815f260 con 0x7fbc48068fe0 2023-10-07T08:58:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4eda9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48069430 con 0x7fbc480b1fe0 2023-10-07T08:58:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4cb45700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc48158440 0x7fbc48068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4cb45700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc48158440 0x7fbc48068aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60378/0 (socket says 172.21.15.46:60378) 2023-10-07T08:58:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4cb45700 1 -- 172.21.15.46:0/222006008 learned_addr learned my addr 172.21.15.46:0/222006008 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc47fff700 1 --2- 172.21.15.46:0/222006008 >> v2:172.21.15.133:3300/0 conn(0x7fbc48068fe0 0x7fbc480b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7fbc4d346700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc480b1fe0 0x7fbc481619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f1453484700 1 Processor -- start 2023-10-07T08:58:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f1453484700 1 -- start start 2023-10-07T08:58:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.076+0000 7f88c4e26700 1 -- start start 2023-10-07T08:58:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f88c4e26700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c0156fb0 0x7f88c006a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f88c4e26700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88c00cbcb0 0x7f88c00c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f88c4e26700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c0069d30 con 0x7f88c006ab20 2023-10-07T08:58:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f88c4e26700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00c8110 con 0x7f88c00cbcb0 2023-10-07T08:58:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7f88c4e26700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01568e0 con 0x7f88c0156fb0 2023-10-07T08:58:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bdd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f88c006ab20 0x7f88c00cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39594/0 (socket says 172.21.15.46:39594) 2023-10-07T08:58:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bdd9b700 1 -- 172.21.15.46:0/3500001746 learned_addr learned my addr 172.21.15.46:0/3500001746 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773677428 0 0) 0x7f88c0069d30 con 0x7f88c006ab20 2023-10-07T08:58:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac003570 con 0x7f88c006ab20 2023-10-07T08:58:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f144c06a410 0x7f144c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 0x7f144c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f144c15b330 0x7f144c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c0c6a70 con 0x7f144c159b10 2023-10-07T08:58:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c15a410 con 0x7f144c06a410 2023-10-07T08:58:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f1453484700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c15a6f0 con 0x7f144c15b330 2023-10-07T08:58:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272777800 0 0) 0x7f88ac003570 con 0x7f88c006ab20 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c0156fb0 msgr2=0x7f88c006a5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c0156fb0 0x7f88c006a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 >> v2:172.21.15.46:3300/0 conn(0x7f88c00cbcb0 msgr2=0x7f88c00c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 --2- 172.21.15.46:0/3500001746 >> v2:172.21.15.46:3300/0 conn(0x7f88c00cbcb0 0x7f88c00c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c7e00 con 0x7f88c006ab20 2023-10-07T08:58:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f88b0001470 con 0x7f88c006ab20 2023-10-07T08:58:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 >> v1:172.21.15.133:6789/0 conn(0x7f88c006ab20 legacy=0x7f88c00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac003ae0 0x7f88ac003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88ac004810 0x7f88ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.078+0000 7f88bd59a700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88ac0053c0 0x7f88ac00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00c8110 con 0x7f88ac004810 2023-10-07T08:58:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01568e0 con 0x7f88ac003ae0 2023-10-07T08:58:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00c2f0 con 0x7f88ac0053c0 2023-10-07T08:58:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 -- 172.21.15.46:0/222006008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc480b1fe0 msgr2=0x7fbc481619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc480b1fe0 0x7fbc481619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 -- 172.21.15.46:0/222006008 >> v2:172.21.15.133:3300/0 conn(0x7fbc48068fe0 msgr2=0x7fbc480b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/222006008 >> v2:172.21.15.133:3300/0 conn(0x7fbc48068fe0 0x7fbc480b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 -- 172.21.15.46:0/222006008 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480b2420 con 0x7fbc48158440 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.077+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48158440 0x7fbc48068aa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c270 tx=0x7fbc3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d02cc20b169a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1450a1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 0x7f144c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1450a1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 0x7f144c0c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60410/0 (socket says 172.21.15.46:60410) 2023-10-07T08:58:44.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1450a1f700 1 -- 172.21.15.46:0/4114590270 learned_addr learned my addr 172.21.15.46:0/4114590270 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f144c15b330 0x7f144c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88ac0053c0 0x7f88ac00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bdd9b700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88ac004810 0x7f88ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 -- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f144c06a410 msgr2=0x7f144c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f144c06a410 0x7f144c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 -- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 msgr2=0x7f144c0c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 0x7f144c0c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88be59c700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac003ae0 0x7f88ac003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 -- 172.21.15.46:0/4114590270 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009420 con 0x7f144c15b330 2023-10-07T08:58:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1450a1f700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f144c159b10 0x7f144c0c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 -- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac003ae0 msgr2=0x7f88ac003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac003ae0 0x7f88ac003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 -- 172.21.15.46:0/3500001746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88ac004810 msgr2=0x7f88ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88ac004810 0x7f88ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 -- 172.21.15.46:0/3500001746 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac003570 con 0x7f88ac0053c0 2023-10-07T08:58:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88be59c700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac003ae0 0x7f88ac003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f1451a21700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f144c15b330 0x7f144c0b1cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1444009e50 tx=0x7f144400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.079+0000 7f88bed9d700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88ac0053c0 0x7f88ac00ba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88c00cc0b0 tx=0x7f88b80095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb07f7ef24387d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80098e0 con 0x7f88ac0053c0 2023-10-07T08:58:44.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800cca0 con 0x7f88ac0053c0 2023-10-07T08:58:44.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88bd59a700 1 -- 172.21.15.46:0/3500001746 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8014660 con 0x7f88ac0053c0 2023-10-07T08:58:44.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f08c47d9700 1 Processor -- start 2023-10-07T08:58:44.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88c4e26700 1 -- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88ac0053c0 msgr2=0x7f88ac00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88c4e26700 1 --2- 172.21.15.46:0/3500001746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88ac0053c0 0x7f88ac00ba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88c00cc0b0 tx=0x7f88b80095f0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88bed9d700 1 -- 172.21.15.46:0/3500001746 reap_dead start 2023-10-07T08:58:44.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f08c47d9700 1 -- start start 2023-10-07T08:58:44.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88c4e26700 1 -- 172.21.15.46:0/3500001746 shutdown_connections 2023-10-07T08:58:44.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f88c4e26700 1 -- 172.21.15.46:0/3500001746 >> 172.21.15.46:0/3500001746 conn(0x7f88c00c9870 msgr2=0x7f88c00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.080+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400cb50 con 0x7f144c15b330 2023-10-07T08:58:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144400f040 con 0x7f144c15b330 2023-10-07T08:58:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c15a9d0 con 0x7f144c15b330 2023-10-07T08:58:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444014480 con 0x7f144c15b330 2023-10-07T08:58:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f88c4e26700 1 -- 172.21.15.46:0/3500001746 shutdown_connections 2023-10-07T08:58:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7fa24b536700 1 Processor -- start 2023-10-07T08:58:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f88c4e26700 1 -- 172.21.15.46:0/3500001746 wait complete. 2023-10-07T08:58:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7fa24b536700 1 -- start start 2023-10-07T08:58:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.081+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c155a30 con 0x7f144c15b330 2023-10-07T08:58:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f88c4e26700 1 Processor -- start 2023-10-07T08:58:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7fa24b536700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa24b536700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa244063230 0x7fa244156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa24b536700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa244159a70 con 0x7fa244063680 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa24b536700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24415aa00 con 0x7fa244063230 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa24b536700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415a030 con 0x7fa24413f890 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57048/0 (socket says 172.21.15.46:57048) 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 -- 172.21.15.46:0/970710849 learned_addr learned my addr 172.21.15.46:0/970710849 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa249ad3700 1 --1- 172.21.15.46:0/970710849 >> v1:172.21.15.133:6789/0 conn(0x7fa244063680 0x7fa2440ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39596/0 (socket says 172.21.15.46:39596) 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 -- 172.21.15.46:0/970710849 >> v2:172.21.15.133:3300/0 conn(0x7fa244063230 msgr2=0x7fa244156420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 --2- 172.21.15.46:0/970710849 >> v2:172.21.15.133:3300/0 conn(0x7fa244063230 0x7fa244156420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 -- 172.21.15.46:0/970710849 >> v1:172.21.15.133:6789/0 conn(0x7fa244063680 legacy=0x7fa2440ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa23bfff700 1 -- 172.21.15.46:0/970710849 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6951008 0 0) 0x7fa244159a70 con 0x7fa244063680 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 -- 172.21.15.46:0/970710849 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244156fa0 con 0x7fa24413f890 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fa2492d2700 1 --2- 172.21.15.46:0/970710849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009f20 tx=0x7fa23c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c027e649f941b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14440147f0 con 0x7f144c15b330 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f14417fa700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1430067000 0x7f14300694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1444085140 con 0x7f144c15b330 2023-10-07T08:58:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f1451220700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1430067000 0x7f14300694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7ff590911700 1 Processor -- start 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7ff590911700 1 -- start start 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fbc477fe700 1 -- 172.21.15.46:0/222006008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c009e70 con 0x7fbc48158440 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fbc477fe700 1 -- 172.21.15.46:0/222006008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00b860 con 0x7fbc48158440 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7fbc477fe700 1 -- 172.21.15.46:0/222006008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00bc00 con 0x7fbc48158440 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7fbc4eda9700 1 -- 172.21.15.46:0/222006008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48158440 msgr2=0x7fbc48068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48158440 0x7fbc48068aa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c270 tx=0x7fbc3c009250 comp rx=0 tx=0).stop 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 0x7f08bc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f08bc140720 0x7f08bc0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0c7de0 con 0x7f08bc140720 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0cd250 con 0x7f08bc06a1c0 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c47d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc140c10 con 0x7f08bc140350 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c2575700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c1d74700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 0x7f08bc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c2575700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57040/0 (socket says 172.21.15.46:57040) 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c1d74700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 0x7f08bc068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33464/0 (socket says 172.21.15.46:33464) 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c2575700 1 -- 172.21.15.46:0/467875151 learned_addr learned my addr 172.21.15.46:0/467875151 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.082+0000 7f08c2d76700 1 --2- 172.21.15.46:0/467875151 >> v2:172.21.15.46:3300/0 conn(0x7f08bc140720 0x7f08bc0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 -- 172.21.15.46:0/467875151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 msgr2=0x7f08bc069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 -- 172.21.15.46:0/467875151 >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 msgr2=0x7f08bc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 --2- 172.21.15.46:0/467875151 >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 0x7f08bc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 -- 172.21.15.46:0/467875151 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc141490 con 0x7f08bc140720 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2575700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c2d76700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc0688d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08bc06e0a0 tx=0x7f08b401a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8205879a6d01eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c1573700 1 -- 172.21.15.46:0/467875151 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b401f070 con 0x7f08bc140720 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c1573700 1 -- 172.21.15.46:0/467875151 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b401cb60 con 0x7f08bc140720 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f08c1573700 1 -- 172.21.15.46:0/467875151 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4023430 con 0x7f08bc140720 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.083+0000 7f88c4e26700 1 -- start start 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0053c0 0x7f88c014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 0x7f88c00b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c00afba0 0x7f88c00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00b2b60 con 0x7f88c00ae970 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00c6060 con 0x7f88ac0053c0 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88c4e26700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00c5490 con 0x7f88c00afba0 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 0x7f88c00b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 0x7f88c00b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60430/0 (socket says 172.21.15.46:60430) 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 -- 172.21.15.46:0/984187899 learned_addr learned my addr 172.21.15.46:0/984187899 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bed9d700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c00afba0 0x7f88c00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f5d80255700 1 Processor -- start 2023-10-07T08:58:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f5d80255700 1 -- start start 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7ff590911700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 0x7ff58c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7ff590911700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0b2490 con 0x7ff58c156760 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7ff590911700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0ac4e0 con 0x7ff58c068aa0 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7ff590911700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0aceb0 con 0x7ff58c0cba20 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f34d5414700 1 Processor -- start 2023-10-07T08:58:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f34d5414700 1 -- start start 2023-10-07T08:58:44.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f1451220700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1430067000 0x7f14300694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c0016f0 tx=0x7f143c0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff58c156760 0x7ff58c0ad630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54690/0 (socket says 172.21.15.46:54690) 2023-10-07T08:58:44.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58ad9d700 1 -- 172.21.15.46:0/2085521079 learned_addr learned my addr 172.21.15.46:0/2085521079 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f08c47d9700 1 -- 172.21.15.46:0/467875151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 msgr2=0x7f08bc0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f08c47d9700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc0688d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08bc06e0a0 tx=0x7f08b401a780 comp rx=0 tx=0).stop 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 -- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c00afba0 msgr2=0x7f88c00b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c00afba0 0x7f88c00b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 -- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0053c0 msgr2=0x7f88c014aa10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0053c0 0x7f88c014aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7f88bdd9b700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c5730 con 0x7f88c00ae970 2023-10-07T08:58:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f88bdd9b700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 0x7f88c00b2260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b0007fd0 tx=0x7f88b0001e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 -- 172.21.15.46:0/467875151 shutdown_connections 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc0688d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 --2- 172.21.15.46:0/467875151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc140350 0x7f08bc069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 --2- 172.21.15.46:0/467875151 >> v2:172.21.15.133:3300/0 conn(0x7f08bc06a1c0 0x7f08bc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 -- 172.21.15.46:0/467875151 >> 172.21.15.46:0/467875151 conn(0x7f08bc0cd670 msgr2=0x7f08bc0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 -- 172.21.15.46:0/467875151 shutdown_connections 2023-10-07T08:58:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f08c47d9700 1 -- 172.21.15.46:0/467875151 wait complete. 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58a59c700 1 --2- 172.21.15.46:0/2085521079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 0x7ff58c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34d5414700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34d5414700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d00b1b50 0x7f34d00afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34d5414700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d0157be0 con 0x7f34d006b5e0 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34d5414700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d0156bd0 con 0x7f34d00b1b50 2023-10-07T08:58:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34d5414700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0156fd0 con 0x7f34d014fbe0 2023-10-07T08:58:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.084+0000 7fa23bfff700 1 -- 172.21.15.46:0/970710849 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00e070 con 0x7fa24413f890 2023-10-07T08:58:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34cffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34cffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57078/0 (socket says 172.21.15.46:57078) 2023-10-07T08:58:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34cffff700 1 -- 172.21.15.46:0/2867157367 learned_addr learned my addr 172.21.15.46:0/2867157367 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f34cf7fe700 1 --2- 172.21.15.46:0/2867157367 >> v2:172.21.15.133:3300/0 conn(0x7f34d00b1b50 0x7f34d00afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f5d80255700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f5d80255700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d780afe00 0x7f5d780abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f5d80255700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780ad400 con 0x7f5d78068aa0 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f5d80255700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d78087e70 con 0x7f5d780afe00 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f5d80255700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780ac340 con 0x7f5d78166960 2023-10-07T08:58:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58a59c700 1 -- 172.21.15.46:0/2085521079 >> v1:172.21.15.133:6789/0 conn(0x7ff58c068aa0 legacy=0x7ff58c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58a59c700 1 -- 172.21.15.46:0/2085521079 >> v1:172.21.15.46:6789/0 conn(0x7ff58c156760 legacy=0x7ff58c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7ff58a59c700 1 -- 172.21.15.46:0/2085521079 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c156cd0 con 0x7ff58c0cba20 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7fbc4eda9700 1 -- 172.21.15.46:0/222006008 shutdown_connections 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc480b1fe0 0x7fbc481619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/222006008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48158440 0x7fbc48068aa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/222006008 >> v2:172.21.15.133:3300/0 conn(0x7fbc48068fe0 0x7fbc480b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7fbc4eda9700 1 -- 172.21.15.46:0/222006008 >> 172.21.15.46:0/222006008 conn(0x7fbc480cd000 msgr2=0x7fbc48068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f1453484700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7f144c159ee0 0x7f144c068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.085+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 --> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f144c04c3c0 con 0x7f144c159ee0 2023-10-07T08:58:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7ff58a59c700 1 --2- 172.21.15.46:0/2085521079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 0x7ff58c0ac970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff58000bb40 tx=0x7ff58000b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7966702e8340f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fa23bfff700 1 -- 172.21.15.46:0/970710849 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00ba80 con 0x7fa24413f890 2023-10-07T08:58:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fa23bfff700 1 -- 172.21.15.46:0/970710849 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0092e0 con 0x7fa24413f890 2023-10-07T08:58:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fbc4eda9700 1 -- 172.21.15.46:0/222006008 shutdown_connections 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fbc4eda9700 1 -- 172.21.15.46:0/222006008 wait complete. 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f1450a1f700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7f144c159ee0 0x7f144c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7d7f0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d780afe00 0x7f5d780abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57084/0 (socket says 172.21.15.46:57084) 2023-10-07T08:58:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 -- 172.21.15.46:0/3578253528 learned_addr learned my addr 172.21.15.46:0/3578253528 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34cffff700 1 -- 172.21.15.46:0/2867157367 >> v2:172.21.15.133:3300/0 conn(0x7f34d00b1b50 msgr2=0x7f34d00afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34cffff700 1 --2- 172.21.15.46:0/2867157367 >> v2:172.21.15.133:3300/0 conn(0x7f34d00b1b50 0x7f34d00afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34cffff700 1 -- 172.21.15.46:0/2867157367 >> v1:172.21.15.46:6789/0 conn(0x7f34d006b5e0 legacy=0x7f34d0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34cffff700 1 -- 172.21.15.46:0/2867157367 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d01572b0 con 0x7f34d014fbe0 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34cffff700 1 --2- 172.21.15.46:0/2867157367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009990 tx=0x7f34c8009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fc5c67de3cfacd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7ff58959a700 1 -- 172.21.15.46:0/2085521079 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58000dc20 con 0x7ff58c0cba20 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7ff58959a700 1 -- 172.21.15.46:0/2085521079 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58000dd80 con 0x7ff58c0cba20 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7ff58959a700 1 -- 172.21.15.46:0/2085521079 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580017640 con 0x7ff58c0cba20 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fa24b536700 1 -- 172.21.15.46:0/970710849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 msgr2=0x7fa24415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7fa24b536700 1 --2- 172.21.15.46:0/970710849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009f20 tx=0x7fa23c009840 comp rx=0 tx=0).stop 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fa24b536700 1 -- 172.21.15.46:0/970710849 shutdown_connections 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fa24b536700 1 --2- 172.21.15.46:0/970710849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24415a4c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fa24b536700 1 --2- 172.21.15.46:0/970710849 >> v2:172.21.15.133:3300/0 conn(0x7fa244063230 0x7fa244156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fa24b536700 1 -- 172.21.15.46:0/970710849 >> 172.21.15.46:0/970710849 conn(0x7fa24406ded0 msgr2=0x7fa24406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f1450a1f700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7f144c159ee0 0x7f144c068390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 -- 172.21.15.46:0/3578253528 >> v2:172.21.15.133:3300/0 conn(0x7f5d780afe00 msgr2=0x7f5d780abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 --2- 172.21.15.46:0/3578253528 >> v2:172.21.15.133:3300/0 conn(0x7f5d780afe00 0x7f5d780abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 -- 172.21.15.46:0/3578253528 >> v1:172.21.15.133:6789/0 conn(0x7f5d78068aa0 legacy=0x7f5d7816a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f5d7dff1700 1 -- 172.21.15.46:0/3578253528 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780ac610 con 0x7f5d78166960 2023-10-07T08:58:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7ff590911700 1 -- 172.21.15.46:0/2085521079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 msgr2=0x7ff58c0ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7ff590911700 1 --2- 172.21.15.46:0/2085521079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 0x7ff58c0ac970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff58000bb40 tx=0x7ff58000b430 comp rx=0 tx=0).stop 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0018030 con 0x7f88c00ae970 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000f9e0 con 0x7f88c00ae970 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000fd80 con 0x7f88c00ae970 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c00c5a10 con 0x7f88c00ae970 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c00b27a0 con 0x7f88c00ae970 2023-10-07T08:58:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34ceffd700 1 -- 172.21.15.46:0/2867157367 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8005c10 con 0x7f34d014fbe0 2023-10-07T08:58:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34ceffd700 1 -- 172.21.15.46:0/2867157367 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8005d70 con 0x7f34d014fbe0 2023-10-07T08:58:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.086+0000 7f34ceffd700 1 -- 172.21.15.46:0/2867157367 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800b840 con 0x7f34d014fbe0 2023-10-07T08:58:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fbc4eda9700 1 Processor -- start 2023-10-07T08:58:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== osd.1 v2:172.21.15.46:6816/90817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f144c04c3c0 con 0x7f144c159ee0 2023-10-07T08:58:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7ff590911700 1 -- 172.21.15.46:0/2085521079 shutdown_connections 2023-10-07T08:58:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7ff590911700 1 --2- 172.21.15.46:0/2085521079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c0cba20 0x7ff58c0ac970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7ff590911700 1 -- 172.21.15.46:0/2085521079 >> 172.21.15.46:0/2085521079 conn(0x7ff58c0cd000 msgr2=0x7ff58c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7f5d7dff1700 1 --2- 172.21.15.46:0/3578253528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009f20 tx=0x7f5d6c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d875b210cc279a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7fa24b536700 1 -- 172.21.15.46:0/970710849 shutdown_connections 2023-10-07T08:58:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88a4000fd0 con 0x7f88c00ae970 2023-10-07T08:58:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f5d7cfef700 1 -- 172.21.15.46:0/3578253528 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00e070 con 0x7f5d78166960 2023-10-07T08:58:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7f08c47d9700 1 Processor -- start 2023-10-07T08:58:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7f08c47d9700 1 -- start start 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f5d7cfef700 1 -- 172.21.15.46:0/3578253528 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c00b990 con 0x7f5d78166960 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f5d7cfef700 1 -- 172.21.15.46:0/3578253528 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0092e0 con 0x7f5d78166960 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc06a1c0 0x7f08bc168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc140350 0x7f08bc166510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc154f90 con 0x7f08bc140720 2023-10-07T08:58:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc156360 con 0x7f08bc140350 2023-10-07T08:58:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 -- 172.21.15.46:0/2867157367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 msgr2=0x7f34d0156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 --2- 172.21.15.46:0/2867157367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009990 tx=0x7f34c8009220 comp rx=0 tx=0).stop 2023-10-07T08:58:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c47d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1662e0 con 0x7f08bc06a1c0 2023-10-07T08:58:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7fa24b536700 1 -- 172.21.15.46:0/970710849 wait complete. 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 -- 172.21.15.46:0/2867157367 shutdown_connections 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 --2- 172.21.15.46:0/2867157367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0156690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 --2- 172.21.15.46:0/2867157367 >> v2:172.21.15.133:3300/0 conn(0x7f34d00b1b50 0x7f34d00afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 -- 172.21.15.46:0/2867157367 >> 172.21.15.46:0/2867157367 conn(0x7f34d00ccc40 msgr2=0x7f34d0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c1d74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc140350 0x7f08bc166510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c1d74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc140350 0x7f08bc166510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33526/0 (socket says 172.21.15.46:33526) 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c2d76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c1d74700 1 -- 172.21.15.46:0/3141338017 learned_addr learned my addr 172.21.15.46:0/3141338017 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f08c2575700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc06a1c0 0x7f08bc168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.087+0000 7fbc4eda9700 1 -- start start 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48068fe0 0x7fbc4814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480b1fe0 0x7fbc48162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 0x7fbc4814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48150060 con 0x7fbc48068fe0 2023-10-07T08:58:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814c0b0 con 0x7fbc480b1fe0 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7fbc4eda9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814f730 con 0x7fbc48158440 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7ff590911700 1 -- 172.21.15.46:0/2085521079 shutdown_connections 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88b001b070 con 0x7f88c00ae970 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f88b67fc700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f88a0067000 0x7f88a00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88b0019070 con 0x7f88c00ae970 2023-10-07T08:58:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f88b67fc700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f88a006f190 0x7f88a00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88a0071c50 con 0x7f88a006f190 2023-10-07T08:58:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 -- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc06a1c0 msgr2=0x7f08bc168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc06a1c0 0x7f08bc168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 -- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc140350 msgr2=0x7f08bc166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc140350 0x7f08bc166510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009480 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2575700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08bc06a1c0 0x7f08bc168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c2d76700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc165340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08b4027000 tx=0x7f08b402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4023de0 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4038470 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b401aa20 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4038830 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.089+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc165d20 con 0x7f08bc140720 2023-10-07T08:58:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f88bed9d700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f88a006f190 0x7f88a00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 -- 172.21.15.46:0/3578253528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 msgr2=0x7f5d780ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 --2- 172.21.15.46:0/3578253528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009f20 tx=0x7f5d6c009840 comp rx=0 tx=0).stop 2023-10-07T08:58:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fa24b536700 1 Processor -- start 2023-10-07T08:58:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 -- 172.21.15.46:0/3578253528 shutdown_connections 2023-10-07T08:58:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 --2- 172.21.15.46:0/3578253528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78166960 0x7f5d780ab8c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 --2- 172.21.15.46:0/3578253528 >> v2:172.21.15.133:3300/0 conn(0x7f5d780afe00 0x7f5d780abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f5d80255700 1 -- 172.21.15.46:0/3578253528 >> 172.21.15.46:0/3578253528 conn(0x7f5d780cd000 msgr2=0x7f5d78068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fa24b536700 1 -- start start 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 0x7fbc4814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 0x7fbc4814c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57090/0 (socket says 172.21.15.46:57090) 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 -- 172.21.15.46:0/3635394499 learned_addr learned my addr 172.21.15.46:0/3635394499 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48068fe0 0x7fbc4814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 -- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480b1fe0 msgr2=0x7fbc48162990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480b1fe0 0x7fbc48162990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 -- 172.21.15.46:0/3635394499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48068fe0 msgr2=0x7fbc4814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc48068fe0 0x7fbc4814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7fbc4d346700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0094f0 con 0x7fbc48158440 2023-10-07T08:58:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08bc04c3c0 con 0x7f08bc140720 2023-10-07T08:58:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f88bed9d700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f88a006f190 0x7f88a00715a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa244063230 0x7fa244169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 0x7fa24414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24416a7e0 con 0x7fa244063230 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244150b60 con 0x7fa244063680 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa24b536700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24414c0d0 con 0x7fa24413f890 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa248ad1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 0x7fa24414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa248ad1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 0x7fa24414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33540/0 (socket says 172.21.15.46:33540) 2023-10-07T08:58:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa248ad1700 1 -- 172.21.15.46:0/2803859038 learned_addr learned my addr 172.21.15.46:0/2803859038 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa2492d2700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa244063230 0x7fa244169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7fa249ad3700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b000fee0 con 0x7f88c00ae970 2023-10-07T08:58:44.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== osd.7 v2:172.21.15.133:6816/91093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f88a0071c50 con 0x7f88a006f190 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 -- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 msgr2=0x7fa24414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24413f890 0x7fa24414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 -- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa244063230 msgr2=0x7fa244169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa244063230 0x7fa244169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 -- 172.21.15.46:0/2803859038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009ae0 con 0x7fa244063680 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa248ad1700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 0x7fa24414b650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b600 tx=0x7fa2340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400f510 con 0x7fa244063680 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23400f670 con 0x7fa244063680 2023-10-07T08:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400fa30 con 0x7fa244063680 2023-10-07T08:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08b4035070 con 0x7f08bc140720 2023-10-07T08:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08b27fc700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08a0067000 0x7f08a00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08b4097e40 con 0x7f08bc140720 2023-10-07T08:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08c2575700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08a0067000 0x7f08a00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08b27fc700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7f08a006f210 0x7f08a0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08a0071cd0 con 0x7f08a006f210 2023-10-07T08:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b4098210 con 0x7f08bc140720 2023-10-07T08:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24416a440 con 0x7fa244063680 2023-10-07T08:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24416afb0 con 0x7fa244063680 2023-10-07T08:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7ff590911700 1 -- 172.21.15.46:0/2085521079 wait complete. 2023-10-07T08:58:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7ff590911700 1 Processor -- start 2023-10-07T08:58:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7ff590911700 1 -- start start 2023-10-07T08:58:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f5d80255700 1 -- 172.21.15.46:0/3578253528 shutdown_connections 2023-10-07T08:58:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f5d80255700 1 -- 172.21.15.46:0/3578253528 wait complete. 2023-10-07T08:58:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 -- 172.21.15.46:0/2867157367 shutdown_connections 2023-10-07T08:58:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.088+0000 7f34d5414700 1 -- 172.21.15.46:0/2867157367 wait complete. 2023-10-07T08:58:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.090+0000 7f34d5414700 1 Processor -- start 2023-10-07T08:58:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 -- start start 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 0x7f34d014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34d00b1b50 0x7f34d0152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0150c50 con 0x7f34d00b1b50 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0150f30 con 0x7f34d006b5e0 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.091+0000 7f34d5414700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0151210 con 0x7f34d014fbe0 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 0x7f34d014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 0x7f34d014eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33556/0 (socket says 172.21.15.46:33556) 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 -- 172.21.15.46:0/2823654571 learned_addr learned my addr 172.21.15.46:0/2823654571 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34d4c13700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cf7fe700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34d00b1b50 0x7f34d0152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 -- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 msgr2=0x7f34d0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34d014fbe0 0x7f34d0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 -- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34d00b1b50 msgr2=0x7f34d0152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34d00b1b50 0x7f34d0152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.092+0000 7f34cffff700 1 -- 172.21.15.46:0/2823654571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8009480 con 0x7f34d006b5e0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34cffff700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 0x7f34d014eca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009260 tx=0x7f34c8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8006410 con 0x7f34d006b5e0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c801c040 con 0x7f34d006b5e0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8006780 con 0x7f34d006b5e0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d01514f0 con 0x7f34d006b5e0 2023-10-07T08:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.093+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d014f1e0 con 0x7f34d006b5e0 2023-10-07T08:58:44.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc4d346700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 0x7fbc4814c870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009ec0 tx=0x7fbc4000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7f88be59c700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f88a0067000 0x7f88a00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 0x7ff58c1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c0cba20 0x7ff58c14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff58c156760 0x7ff58c150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c087c40 con 0x7ff58c0cba20 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c148cd0 con 0x7ff58c156760 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff590911700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15a020 con 0x7ff58c068aa0 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 0x7ff58c1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 0x7ff58c1490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57108/0 (socket says 172.21.15.46:57108) 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 -- 172.21.15.46:0/3287088380 learned_addr learned my addr 172.21.15.46:0/3287088380 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58ad9d700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff58c156760 0x7ff58c150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000cc20 con 0x7fbc48158440 2023-10-07T08:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000f040 con 0x7fbc48158440 2023-10-07T08:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40014480 con 0x7fbc48158440 2023-10-07T08:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4814fa10 con 0x7fbc48158440 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 -- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff58c156760 msgr2=0x7ff58c150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff58c156760 0x7ff58c150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 -- 172.21.15.46:0/3287088380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c0cba20 msgr2=0x7ff58c14e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c0cba20 0x7ff58c14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7ff58a59c700 1 -- 172.21.15.46:0/3287088380 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58000b6d0 con 0x7ff58c068aa0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff58a59c700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 0x7ff58c1490a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06cea0 tx=0x7ff580018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580009040 con 0x7ff58c068aa0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580017af0 con 0x7ff58c068aa0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580017e90 con 0x7ff58c068aa0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c151a00 con 0x7ff58c068aa0 2023-10-07T08:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c1596f0 con 0x7ff58c068aa0 2023-10-07T08:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7f5d80255700 1 Processor -- start 2023-10-07T08:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7f5d80255700 1 -- start start 2023-10-07T08:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7f88be59c700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f88a0067000 0x7f88a00694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006c40 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.094+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4814f3e0 con 0x7fbc48158440 2023-10-07T08:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc28000fd0 con 0x7fbc48158440 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78068aa0 0x7f5d78086bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d780afe00 0x7f5d7815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d78166960 0x7f5d7815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78167490 con 0x7f5d780afe00 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78087100 con 0x7f5d78166960 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d80255700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7815ded0 con 0x7f5d78068aa0 2023-10-07T08:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d7d7f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d780afe00 0x7f5d7815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa23401a400 con 0x7fa244063680 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7fa2397fa700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa228066fb0 0x7fa228069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa234083e90 con 0x7fa244063680 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7fa2492d2700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa228066fb0 0x7fa228069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7fa24b536700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7fa24414e770 0x7fa24414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 --> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa244159c20 con 0x7fa24414e770 2023-10-07T08:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fa249ad3700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7fa24414e770 0x7fa24414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d7dff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78068aa0 0x7f5d78086bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d7e7f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d78166960 0x7f5d7815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d7dff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78068aa0 0x7f5d78086bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57120/0 (socket says 172.21.15.46:57120) 2023-10-07T08:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f5d7dff1700 1 -- 172.21.15.46:0/3453788956 learned_addr learned my addr 172.21.15.46:0/3453788956 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc40014830 con 0x7fbc48158440 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 -- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78068aa0 msgr2=0x7f5d78086bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d78068aa0 0x7f5d78086bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 -- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d780afe00 msgr2=0x7f5d7815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d780afe00 0x7f5d7815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 -- 172.21.15.46:0/3453788956 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009ae0 con 0x7f5d78166960 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7d7f0700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d780afe00 0x7f5d7815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fa2492d2700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa228066fb0 0x7fa228069460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009ab0 tx=0x7fa23c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fbc44ff9700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc2c066f30 0x7fbc2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d7e7f2700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d78166960 0x7f5d7815ea30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000b460 tx=0x7f5d70006f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc40085ac0 con 0x7fbc48158440 2023-10-07T08:58:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011400 con 0x7f5d78166960 2023-10-07T08:58:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7fa249ad3700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7fa24414e770 0x7fa24414eb40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70011560 con 0x7f5d78166960 2023-10-07T08:58:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7815e1b0 con 0x7f5d78166960 2023-10-07T08:58:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011920 con 0x7f5d78166960 2023-10-07T08:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7fbc44ff9700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fbc2c06f140 0x7fbc2c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc2c071c00 con 0x7fbc2c06f140 2023-10-07T08:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc40085e90 con 0x7fbc48158440 2023-10-07T08:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d781670b0 con 0x7f5d78166960 2023-10-07T08:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7fbc47fff700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fbc2c06f140 0x7fbc2c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff580020600 con 0x7ff58c068aa0 2023-10-07T08:58:44.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.098+0000 7fbc47fff700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fbc2c06f140 0x7fbc2c071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== osd.0 v2:172.21.15.46:6808/90815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa244159c20 con 0x7fa24414e770 2023-10-07T08:58:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7ff57a7fc700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff56c067000 0x7ff56c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff580085a80 con 0x7ff58c068aa0 2023-10-07T08:58:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7ff589d9b700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff56c067000 0x7ff56c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== osd.5 v2:172.21.15.133:6817/91092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbc2c071c00 con 0x7fbc2c06f140 2023-10-07T08:58:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7ff589d9b700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff56c067000 0x7ff56c0694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff57c000f80 tx=0x7ff57c007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d70011cd0 con 0x7f5d78166960 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f5d75ffb700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d5c066f30 0x7f5d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d70083e00 con 0x7f5d78166960 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f5d7dff1700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d5c066f30 0x7f5d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.101+0000 7f5d7dff1700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d5c066f30 0x7f5d5c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00bd60 tx=0x7f5d6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7ff590911700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7ff5700015f0 0x7ff570003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 --> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff570006b90 con 0x7ff5700015f0 2023-10-07T08:58:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc2c066f30 0x7fbc2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7ff58ad9d700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7ff5700015f0 0x7ff570003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7ff58ad9d700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7ff5700015f0 0x7ff570003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7f5d80255700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f5d7815d170 0x7f5d7815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 --> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d78150970 con 0x7f5d7815d170 2023-10-07T08:58:44.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7f08c1d74700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7f08a006f210 0x7f08a0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.106+0000 7f08c2575700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08a0067000 0x7f08a00694b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08b800f580 tx=0x7f08b8009220 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.095+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34c8017630 con 0x7f34d006b5e0 2023-10-07T08:58:44.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f34b7fff700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34c8013070 con 0x7f34d006b5e0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.105+0000 7fbc4cb45700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc2c066f30 0x7fbc2c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c270 tx=0x7fbc3c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.096+0000 7f34cf7fe700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.097+0000 7f34cf7fe700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009fd0 tx=0x7f34c0009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7f34d5414700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f34d014ffb0 0x7f34d0150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.099+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 --> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34d006c730 con 0x7f34d014ffb0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f34d4c13700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f34d014ffb0 0x7f34d0150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.100+0000 7f34d4c13700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f34d014ffb0 0x7f34d0150380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.102+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== osd.2 v2:172.21.15.46:6824/90828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34d006c730 con 0x7f34d014ffb0 2023-10-07T08:58:44.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.106+0000 7f5d7d7f0700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f5d7815d170 0x7f5d7815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.106+0000 7f5d7d7f0700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f5d7815d170 0x7f5d7815d540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.107+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== osd.4 v2:172.21.15.133:6800/91062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff570006b90 con 0x7ff5700015f0 2023-10-07T08:58:44.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.107+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== osd.3 v2:172.21.15.46:6800/90816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5d78150970 con 0x7f5d7815d170 2023-10-07T08:58:44.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.106+0000 7f08c1d74700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7f08a006f210 0x7f08a0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.115+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== osd.6 v2:172.21.15.133:6808/91063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f08a0071cd0 con 0x7f08a006f210 2023-10-07T08:58:44.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.115+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 --> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f144c0633e0 con 0x7f144c159ee0 2023-10-07T08:58:44.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.115+0000 7f14417fa700 1 -- 172.21.15.46:0/4114590270 <== osd.1 v2:172.21.15.46:6816/90817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f144c0633e0 con 0x7f144c159ee0 2023-10-07T08:58:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.118+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 --> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f34d006f730 con 0x7f34d014ffb0 2023-10-07T08:58:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.118+0000 7f34b7fff700 1 -- 172.21.15.46:0/2823654571 <== osd.2 v2:172.21.15.46:6824/90828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34d006f730 con 0x7f34d014ffb0 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.118+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f34d014ffb0 msgr2=0x7f34d0150380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.119+0000 7f34d5414700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f34d014ffb0 0x7f34d0150380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34bc066f30 msgr2=0x7f34bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009fd0 tx=0x7f34c0009880 comp rx=0 tx=0).stop 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 msgr2=0x7f34d014eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 --2- 172.21.15.46:0/2823654571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d006b5e0 0x7f34d014eca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009260 tx=0x7f34c8017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d4c13700 1 -- 172.21.15.46:0/2823654571 reap_dead start 2023-10-07T08:58:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 shutdown_connections 2023-10-07T08:58:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.120+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 >> 172.21.15.46:0/2823654571 conn(0x7f34d00ccc40 msgr2=0x7f34d006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.121+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 shutdown_connections 2023-10-07T08:58:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.124+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7f144c159ee0 msgr2=0x7f144c068390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.124+0000 7f1453484700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7f144c159ee0 0x7f144c068390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.125+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 --> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc28002d30 con 0x7fbc2c06f140 2023-10-07T08:58:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.125+0000 7fbc44ff9700 1 -- 172.21.15.46:0/3635394499 <== osd.5 v2:172.21.15.133:6817/91092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc28002d30 con 0x7fbc2c06f140 2023-10-07T08:58:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f34d5414700 1 -- 172.21.15.46:0/2823654571 wait complete. 2023-10-07T08:58:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 --> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88a4002d30 con 0x7f88a006f190 2023-10-07T08:58:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1430067000 msgr2=0x7f14300694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f1453484700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1430067000 0x7f14300694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c0016f0 tx=0x7f143c0079d0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f144c15b330 msgr2=0x7f144c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f1453484700 1 --2- 172.21.15.46:0/4114590270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f144c15b330 0x7f144c0b1cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1444009e50 tx=0x7f144400b040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.126+0000 7f1451a21700 1 -- 172.21.15.46:0/4114590270 reap_dead start 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7f88b67fc700 1 -- 172.21.15.46:0/984187899 <== osd.7 v2:172.21.15.133:6816/91093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88a4002d30 con 0x7f88a006f190 2023-10-07T08:58:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 shutdown_connections 2023-10-07T08:58:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 >> 172.21.15.46:0/4114590270 conn(0x7f144c0c9870 msgr2=0x7f144c069460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 shutdown_connections 2023-10-07T08:58:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7f1453484700 1 -- 172.21.15.46:0/4114590270 wait complete. 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fbc2c06f140 msgr2=0x7fbc2c071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fbc2c06f140 0x7fbc2c071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc2c066f30 msgr2=0x7fbc2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc2c066f30 0x7fbc2c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c270 tx=0x7fbc3c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 msgr2=0x7fbc4814c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4eda9700 1 --2- 172.21.15.46:0/3635394499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc48158440 0x7fbc4814c870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009ec0 tx=0x7fbc4000b040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.127+0000 7fbc4d346700 1 -- 172.21.15.46:0/3635394499 reap_dead start 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 shutdown_connections 2023-10-07T08:58:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 >> 172.21.15.46:0/3635394499 conn(0x7fbc480cd000 msgr2=0x7fbc4814d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f88a006f190 msgr2=0x7f88a00715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f88a006f190 0x7f88a00715a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 shutdown_connections 2023-10-07T08:58:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f88a0067000 msgr2=0x7f88a00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f88a0067000 0x7f88a00694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006c40 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 msgr2=0x7f88c00b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 --2- 172.21.15.46:0/984187899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88c00ae970 0x7f88c00b2260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b0007fd0 tx=0x7f88b0001e00 comp rx=0 tx=0).stop 2023-10-07T08:58:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88bed9d700 1 -- 172.21.15.46:0/984187899 reap_dead start 2023-10-07T08:58:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7fbc4eda9700 1 -- 172.21.15.46:0/3635394499 wait complete. 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 shutdown_connections 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.128+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 >> 172.21.15.46:0/984187899 conn(0x7f88c00c9870 msgr2=0x7f88c00c1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.129+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 shutdown_connections 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.129+0000 7f88c4e26700 1 -- 172.21.15.46:0/984187899 wait complete. 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.130+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 --> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa244069cc0 con 0x7fa24414e770 2023-10-07T08:58:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.131+0000 7fa2397fa700 1 -- 172.21.15.46:0/2803859038 <== osd.0 v2:172.21.15.46:6808/90815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa244069cc0 con 0x7fa24414e770 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7fa24414e770 msgr2=0x7fa24414eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7fa24414e770 0x7fa24414eb40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa228066fb0 msgr2=0x7fa228069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa228066fb0 0x7fa228069460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009ab0 tx=0x7fa23c018000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 msgr2=0x7fa24414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa24b536700 1 --2- 172.21.15.46:0/2803859038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244063680 0x7fa24414b650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b600 tx=0x7fa2340091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.133+0000 7fa249ad3700 1 -- 172.21.15.46:0/2803859038 reap_dead start 2023-10-07T08:58:44.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.135+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 shutdown_connections 2023-10-07T08:58:44.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.135+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 >> 172.21.15.46:0/2803859038 conn(0x7fa24406ded0 msgr2=0x7fa2440ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.138+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 shutdown_connections 2023-10-07T08:58:44.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.138+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 --> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d7804c3c0 con 0x7f5d7815d170 2023-10-07T08:58:44.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.138+0000 7fa24b536700 1 -- 172.21.15.46:0/2803859038 wait complete. 2023-10-07T08:58:44.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.139+0000 7f5d75ffb700 1 -- 172.21.15.46:0/3453788956 <== osd.3 v2:172.21.15.46:6800/90816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d7804c3c0 con 0x7f5d7815d170 2023-10-07T08:58:44.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.139+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f5d7815d170 msgr2=0x7f5d7815d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.139+0000 7f5d80255700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f5d7815d170 0x7f5d7815d540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d5c066f30 msgr2=0x7f5d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d5c066f30 0x7f5d5c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00bd60 tx=0x7f5d6c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d78166960 msgr2=0x7f5d7815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 --2- 172.21.15.46:0/3453788956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d78166960 0x7f5d7815ea30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000b460 tx=0x7f5d70006f40 comp rx=0 tx=0).stop 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d7e7f2700 1 -- 172.21.15.46:0/3453788956 reap_dead start 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 shutdown_connections 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 >> 172.21.15.46:0/3453788956 conn(0x7f5d780cd000 msgr2=0x7f5d780ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 shutdown_connections 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.140+0000 7f5d80255700 1 -- 172.21.15.46:0/3453788956 wait complete. 2023-10-07T08:58:44.184 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.145+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 --> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff570005c80 con 0x7ff5700015f0 2023-10-07T08:58:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.145+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 --> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08bc140ed0 con 0x7f08a006f210 2023-10-07T08:58:44.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-07T08:58:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.146+0000 7ff57a7fc700 1 -- 172.21.15.46:0/3287088380 <== osd.4 v2:172.21.15.133:6800/91062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff570005c80 con 0x7ff5700015f0 2023-10-07T08:58:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.146+0000 7f08b27fc700 1 -- 172.21.15.46:0/3141338017 <== osd.6 v2:172.21.15.133:6808/91063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08bc140ed0 con 0x7f08a006f210 2023-10-07T08:58:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7ff5700015f0 msgr2=0x7ff570003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7ff590911700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7ff5700015f0 0x7ff570003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.188 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7f08a006f210 msgr2=0x7f08a0071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7f08a006f210 0x7f08a0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08a0067000 msgr2=0x7f08a00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f08a0067000 0x7f08a00694b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08b800f580 tx=0x7f08b8009220 comp rx=0 tx=0).stop 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 msgr2=0x7f08bc165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.147+0000 7f08c47d9700 1 --2- 172.21.15.46:0/3141338017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08bc140720 0x7f08bc165340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08b4027000 tx=0x7f08b402a000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.148+0000 7f08c2d76700 1 -- 172.21.15.46:0/3141338017 reap_dead start 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.148+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 shutdown_connections 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.148+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 >> 172.21.15.46:0/3141338017 conn(0x7f08bc0cd670 msgr2=0x7f08bc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.148+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 shutdown_connections 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.148+0000 7f08c47d9700 1 -- 172.21.15.46:0/3141338017 wait complete. 2023-10-07T08:58:44.190 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff56c067000 msgr2=0x7ff56c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff56c067000 0x7ff56c0694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff57c000f80 tx=0x7ff57c007b60 comp rx=0 tx=0).stop 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 msgr2=0x7ff58c1490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 --2- 172.21.15.46:0/3287088380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff58c068aa0 0x7ff58c1490a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06cea0 tx=0x7ff580018000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff58ad9d700 1 -- 172.21.15.46:0/3287088380 reap_dead start 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 shutdown_connections 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 >> 172.21.15.46:0/3287088380 conn(0x7ff58c0cd000 msgr2=0x7ff58c153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 shutdown_connections 2023-10-07T08:58:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.150+0000 7ff590911700 1 -- 172.21.15.46:0/3287088380 wait complete. 2023-10-07T08:58:44.193 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:44.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-07T08:58:44.194 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:44.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-07T08:58:44.195 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:44.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-07T08:58:44.196 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:44.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-07T08:58:44.197 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-07T08:58:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.427+0000 7fd332124700 1 Processor -- start 2023-10-07T08:58:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.427+0000 7fd332124700 1 -- start start 2023-10-07T08:58:44.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.428+0000 7fd332124700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd32c15dd70 0x7fd32c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.428+0000 7fd332124700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd32c068390 0x7fd32c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.428+0000 7fd332124700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c068d20 con 0x7fd32c161a50 2023-10-07T08:58:44.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.428+0000 7fd332124700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0b3380 con 0x7fd32c068390 2023-10-07T08:58:44.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.428+0000 7fd332124700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c06fb50 con 0x7fd32c15dd70 2023-10-07T08:58:44.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd32c161a50 0x7fd32c0b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39622/0 (socket says 172.21.15.46:39622) 2023-10-07T08:58:44.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32affd700 1 -- 172.21.15.46:0/3933482929 learned_addr learned my addr 172.21.15.46:0/3933482929 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950264728 0 0) 0x7fd32c068d20 con 0x7fd32c161a50 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd314003570 con 0x7fd32c161a50 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971042824 0 0) 0x7fd314003570 con 0x7fd32c161a50 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.429+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 >> v2:172.21.15.133:3300/0 conn(0x7fd32c15dd70 msgr2=0x7fd32c15e140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 --2- 172.21.15.46:0/3933482929 >> v2:172.21.15.133:3300/0 conn(0x7fd32c15dd70 0x7fd32c15e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 >> v2:172.21.15.46:3300/0 conn(0x7fd32c068390 msgr2=0x7fd32c0687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 --2- 172.21.15.46:0/3933482929 >> v2:172.21.15.46:3300/0 conn(0x7fd32c068390 0x7fd32c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c161ee0 con 0x7fd32c161a50 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd31c001470 con 0x7fd32c161a50 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 >> v1:172.21.15.133:6789/0 conn(0x7fd32c161a50 legacy=0x7fd32c0b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd314003a60 0x7fd314003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd314004810 0x7fd314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd31400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0b3380 con 0x7fd314004810 2023-10-07T08:58:44.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c06fb50 con 0x7fd314003a60 2023-10-07T08:58:44.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31400c320 con 0x7fd3140052e0 2023-10-07T08:58:44.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32bfff700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd31400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.430+0000 7fd32affd700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd314004810 0x7fd314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 -- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd314003a60 msgr2=0x7fd314003e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:44.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd314003a60 0x7fd314003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 -- 172.21.15.46:0/3933482929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd314004810 msgr2=0x7fd314004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd314004810 0x7fd314004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 -- 172.21.15.46:0/3933482929 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c161ee0 con 0x7fd3140052e0 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 -- 172.21.15.46:0/3933482929 reap_dead start 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32bfff700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd31400ba60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd324009df0 tx=0x7fd3240095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47f04d1042e6c703 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400bb90 con 0x7fd3140052e0 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400bd10 con 0x7fd3140052e0 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.431+0000 7fd32a7fc700 1 -- 172.21.15.46:0/3933482929 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400c680 con 0x7fd3140052e0 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.432+0000 7fd332124700 1 -- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 msgr2=0x7fd31400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.432+0000 7fd332124700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd31400ba60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd324009df0 tx=0x7fd3240095f0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.432+0000 7fd332124700 1 -- 172.21.15.46:0/3933482929 shutdown_connections 2023-10-07T08:58:44.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.432+0000 7fd332124700 1 --2- 172.21.15.46:0/3933482929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd31400ba60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.432+0000 7fd332124700 1 -- 172.21.15.46:0/3933482929 >> 172.21.15.46:0/3933482929 conn(0x7fd32c0cd480 msgr2=0x7fd32c0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.433+0000 7fd332124700 1 -- 172.21.15.46:0/3933482929 shutdown_connections 2023-10-07T08:58:44.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.433+0000 7ff23570e700 1 Processor -- start 2023-10-07T08:58:44.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.433+0000 7ff23570e700 1 -- start start 2023-10-07T08:58:44.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff23570e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff23006aa40 0x7ff2300cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff23570e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff2300c91e0 0x7ff230160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff23570e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300cc210 con 0x7ff23006bac0 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff23570e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300cc4f0 con 0x7ff2300c91e0 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff23570e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300cc7d0 con 0x7ff23006aa40 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.434+0000 7ff22effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff23006aa40 0x7ff2300cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22e7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff23006bac0 0x7ff23006ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54712/0 (socket says 172.21.15.46:54712) 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22e7fc700 1 -- 172.21.15.46:0/651079647 learned_addr learned my addr 172.21.15.46:0/651079647 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22effd700 1 -- 172.21.15.46:0/651079647 >> v2:172.21.15.46:3300/0 conn(0x7ff2300c91e0 msgr2=0x7ff230160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22effd700 1 --2- 172.21.15.46:0/651079647 >> v2:172.21.15.46:3300/0 conn(0x7ff2300c91e0 0x7ff230160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22effd700 1 -- 172.21.15.46:0/651079647 >> v1:172.21.15.46:6789/0 conn(0x7ff23006bac0 legacy=0x7ff23006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22effd700 1 -- 172.21.15.46:0/651079647 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300ccab0 con 0x7ff23006aa40 2023-10-07T08:58:44.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22effd700 1 --2- 172.21.15.46:0/651079647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006aa40 0x7ff2300cbc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff23006e570 tx=0x7ff22400b3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c9c8bc300c5e06d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22dffb700 1 -- 172.21.15.46:0/651079647 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005c10 con 0x7ff23006aa40 2023-10-07T08:58:44.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22dffb700 1 -- 172.21.15.46:0/651079647 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224005d70 con 0x7ff23006aa40 2023-10-07T08:58:44.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.435+0000 7ff22dffb700 1 -- 172.21.15.46:0/651079647 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400dbc0 con 0x7ff23006aa40 2023-10-07T08:58:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 -- 172.21.15.46:0/651079647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006aa40 msgr2=0x7ff2300cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 --2- 172.21.15.46:0/651079647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006aa40 0x7ff2300cbc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff23006e570 tx=0x7ff22400b3e0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 -- 172.21.15.46:0/651079647 shutdown_connections 2023-10-07T08:58:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 --2- 172.21.15.46:0/651079647 >> v2:172.21.15.46:3300/0 conn(0x7ff2300c91e0 0x7ff230160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 --2- 172.21.15.46:0/651079647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006aa40 0x7ff2300cbc00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 -- 172.21.15.46:0/651079647 >> 172.21.15.46:0/651079647 conn(0x7ff2300cd670 msgr2=0x7ff2300cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 -- 172.21.15.46:0/651079647 shutdown_connections 2023-10-07T08:58:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.436+0000 7ff23570e700 1 -- 172.21.15.46:0/651079647 wait complete. 2023-10-07T08:58:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.437+0000 7f855cced700 1 Processor -- start 2023-10-07T08:58:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.437+0000 7f5758156700 1 Processor -- start 2023-10-07T08:58:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.437+0000 7f855cced700 1 -- start start 2023-10-07T08:58:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7ff23570e700 1 Processor -- start 2023-10-07T08:58:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7ff23570e700 1 -- start start 2023-10-07T08:58:44.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7f855cced700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 0x7f855815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7f855cced700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f855806a410 0x7f855806a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7f855cced700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85580c74b0 con 0x7f8558159b10 2023-10-07T08:58:44.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7f855cced700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580c8700 con 0x7f855806a410 2023-10-07T08:58:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.438+0000 7f855cced700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580c9070 con 0x7f855815d730 2023-10-07T08:58:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f855659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8558159b10 0x7f85580cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54720/0 (socket says 172.21.15.46:54720) 2023-10-07T08:58:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f855659c700 1 -- 172.21.15.46:0/2279445242 learned_addr learned my addr 172.21.15.46:0/2279445242 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 --2- 172.21.15.46:0/2279445242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 0x7f855815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23006aa40 0x7ff2301512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2300c91e0 0x7ff2300972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b1c20 con 0x7ff23006aa40 2023-10-07T08:58:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23009a270 con 0x7ff23006bac0 2023-10-07T08:58:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff23570e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230151810 con 0x7ff2300c91e0 2023-10-07T08:58:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 -- 172.21.15.46:0/2279445242 >> v2:172.21.15.46:3300/0 conn(0x7f855806a410 msgr2=0x7f855806a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 --2- 172.21.15.46:0/2279445242 >> v2:172.21.15.46:3300/0 conn(0x7f855806a410 0x7f855806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 -- 172.21.15.46:0/2279445242 >> v1:172.21.15.46:6789/0 conn(0x7f8558159b10 legacy=0x7f85580cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 -- 172.21.15.46:0/2279445242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855815e0e0 con 0x7f855815d730 2023-10-07T08:58:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff22e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff22f7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2300c91e0 0x7ff2300972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff22e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33626/0 (socket says 172.21.15.46:33626) 2023-10-07T08:58:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7ff22e7fc700 1 -- 172.21.15.46:0/3533932594 learned_addr learned my addr 172.21.15.46:0/3533932594 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.439+0000 7f8555d9b700 1 --2- 172.21.15.46:0/2279445242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 0x7f855815dba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f854c0098e0 tx=0x7f854c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c2b508baef770d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 -- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2300c91e0 msgr2=0x7ff2300972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2300c91e0 0x7ff2300972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 -- 172.21.15.46:0/3533932594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23006aa40 msgr2=0x7ff2301512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23006aa40 0x7ff2301512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 -- 172.21.15.46:0/3533932594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22400b660 con 0x7ff23006bac0 2023-10-07T08:58:44.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f855559a700 1 -- 172.21.15.46:0/2279445242 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c009e80 con 0x7f855815d730 2023-10-07T08:58:44.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f855559a700 1 -- 172.21.15.46:0/2279445242 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00b8f0 con 0x7f855815d730 2023-10-07T08:58:44.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f855559a700 1 -- 172.21.15.46:0/2279445242 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00bc70 con 0x7f855815d730 2023-10-07T08:58:44.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f5758156700 1 -- start start 2023-10-07T08:58:44.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff22e7fc700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c7f0 tx=0x7ff220007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220005b30 con 0x7ff23006bac0 2023-10-07T08:58:44.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220005cb0 con 0x7ff23006bac0 2023-10-07T08:58:44.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220004a80 con 0x7ff23006bac0 2023-10-07T08:58:44.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f93d24f0700 1 Processor -- start 2023-10-07T08:58:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7f93d24f0700 1 -- start start 2023-10-07T08:58:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 -- 172.21.15.46:0/2279445242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 msgr2=0x7f855815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 --2- 172.21.15.46:0/2279445242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 0x7f855815dba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f854c0098e0 tx=0x7f854c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 -- 172.21.15.46:0/2279445242 shutdown_connections 2023-10-07T08:58:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 --2- 172.21.15.46:0/2279445242 >> v2:172.21.15.46:3300/0 conn(0x7f855806a410 0x7f855806a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 --2- 172.21.15.46:0/2279445242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855815d730 0x7f855815dba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 -- 172.21.15.46:0/2279445242 >> 172.21.15.46:0/2279445242 conn(0x7f85580c9870 msgr2=0x7f85580c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 -- 172.21.15.46:0/2279445242 shutdown_connections 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f575006bcd0 0x7f57500caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f575015df50 0x7f575015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575015d7e0 con 0x7f575015df50 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575015dac0 con 0x7f575006bcd0 2023-10-07T08:58:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f5758156700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575015aa30 con 0x7f575006c0a0 2023-10-07T08:58:44.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f855cced700 1 -- 172.21.15.46:0/2279445242 wait complete. 2023-10-07T08:58:44.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230099940 con 0x7ff23006bac0 2023-10-07T08:58:44.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff230099f00 con 0x7ff23006bac0 2023-10-07T08:58:44.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.440+0000 7fd332124700 1 -- 172.21.15.46:0/3933482929 wait complete. 2023-10-07T08:58:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.441+0000 7f57556f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fdd5f0c2700 1 Processor -- start 2023-10-07T08:58:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57158/0 (socket says 172.21.15.46:57158) 2023-10-07T08:58:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 -- 172.21.15.46:0/3367036159 learned_addr learned my addr 172.21.15.46:0/3367036159 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fdd5f0c2700 1 -- start start 2023-10-07T08:58:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d24f0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93cc159890 0x7f93cc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d24f0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d24f0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc069ee0 con 0x7f93cc159c60 2023-10-07T08:58:44.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d24f0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc15a160 con 0x7f93cc159890 2023-10-07T08:58:44.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d24f0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0d13a0 con 0x7f93cc069560 2023-10-07T08:58:44.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 -- 172.21.15.46:0/3367036159 >> v2:172.21.15.133:3300/0 conn(0x7f575006bcd0 msgr2=0x7f57500caa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:44.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 --2- 172.21.15.46:0/3367036159 >> v2:172.21.15.133:3300/0 conn(0x7f575006bcd0 0x7f57500caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 -- 172.21.15.46:0/3367036159 >> v2:172.21.15.46:3300/0 conn(0x7f575015df50 msgr2=0x7f575015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 --2- 172.21.15.46:0/3367036159 >> v2:172.21.15.46:3300/0 conn(0x7f575015df50 0x7f575015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 -- 172.21.15.46:0/3367036159 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575015ad10 con 0x7f575006c0a0 2023-10-07T08:58:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93cbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93cc159890 0x7f93cc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57162/0 (socket says 172.21.15.46:57162) 2023-10-07T08:58:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 -- 172.21.15.46:0/1431560238 learned_addr learned my addr 172.21.15.46:0/1431560238 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fb5795d8700 1 Processor -- start 2023-10-07T08:58:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fd332124700 1 Processor -- start 2023-10-07T08:58:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f57556f1700 1 --2- 172.21.15.46:0/3367036159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f57500691a0 tx=0x7f5740009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712b7ca9f7608f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd58159c60 0x7fdd5815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd5815db10 0x7fdd58069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5815df50 con 0x7fdd58159c60 2023-10-07T08:58:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5815a160 con 0x7fdd58159890 2023-10-07T08:58:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5f0c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580d13a0 con 0x7fdd5815db10 2023-10-07T08:58:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5ce5e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd58159c60 0x7fdd5815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd58159c60 0x7fdd5815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60528/0 (socket says 172.21.15.46:60528) 2023-10-07T08:58:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd5ce5e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33642/0 (socket says 172.21.15.46:33642) 2023-10-07T08:58:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 -- 172.21.15.46:0/2251499608 learned_addr learned my addr 172.21.15.46:0/2251499608 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 -- 172.21.15.46:0/2251499608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd5815db10 msgr2=0x7fdd58069560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 --2- 172.21.15.46:0/2251499608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd5815db10 0x7fdd58069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 -- 172.21.15.46:0/2251499608 >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 msgr2=0x7fdd5815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 --2- 172.21.15.46:0/2251499608 >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fdd57fff700 1 -- 172.21.15.46:0/2251499608 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5815e140 con 0x7fdd58159c60 2023-10-07T08:58:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fdd5ce5e700 1 --2- 172.21.15.46:0/2251499608 >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f5754ef0700 1 -- 172.21.15.46:0/3367036159 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000b860 con 0x7f575006c0a0 2023-10-07T08:58:44.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f5754ef0700 1 -- 172.21.15.46:0/3367036159 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000b9c0 con 0x7f575006c0a0 2023-10-07T08:58:44.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f5754ef0700 1 -- 172.21.15.46:0/3367036159 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000bd80 con 0x7f575006c0a0 2023-10-07T08:58:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7f5758156700 1 -- 172.21.15.46:0/3367036159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 msgr2=0x7f575015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7f5758156700 1 --2- 172.21.15.46:0/3367036159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f57500691a0 tx=0x7f5740009250 comp rx=0 tx=0).stop 2023-10-07T08:58:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fb5795d8700 1 -- start start 2023-10-07T08:58:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fb5795d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb574159890 0x7fb57415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fb5795d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb574159c60 0x7fb57415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fb5795d8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57415a160 con 0x7fb57415db10 2023-10-07T08:58:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fb5795d8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57415df50 con 0x7fb574159890 2023-10-07T08:58:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fb5795d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740d13a0 con 0x7fb574159c60 2023-10-07T08:58:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fb5737fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb57415db10 0x7fb574069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54740/0 (socket says 172.21.15.46:54740) 2023-10-07T08:58:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fb5737fe700 1 -- 172.21.15.46:0/3400991147 learned_addr learned my addr 172.21.15.46:0/3400991147 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7f855cced700 1 Processor -- start 2023-10-07T08:58:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7fd332124700 1 -- start start 2023-10-07T08:58:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7fd332124700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd32c15fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd332124700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd332124700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd32c17a550 0x7fd32c17a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd332124700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c152ca0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd332124700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c152090 con 0x7fd32c17a550 2023-10-07T08:58:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd332124700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c152370 con 0x7fd3140052e0 2023-10-07T08:58:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 -- 172.21.15.46:0/1431560238 >> v2:172.21.15.133:3300/0 conn(0x7f93cc159890 msgr2=0x7f93cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 --2- 172.21.15.46:0/1431560238 >> v2:172.21.15.133:3300/0 conn(0x7f93cc159890 0x7f93cc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 -- 172.21.15.46:0/1431560238 >> v1:172.21.15.46:6789/0 conn(0x7f93cc159c60 legacy=0x7f93cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.442+0000 7f93d0a8d700 1 -- 172.21.15.46:0/1431560238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc15e140 con 0x7f93cc069560 2023-10-07T08:58:44.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.443+0000 7f93d0a8d700 1 --2- 172.21.15.46:0/1431560238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93c00099b0 tx=0x7f93c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e761024f86563a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 -- 172.21.15.46:0/3367036159 shutdown_connections 2023-10-07T08:58:44.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 --2- 172.21.15.46:0/3367036159 >> v2:172.21.15.46:3300/0 conn(0x7f575015df50 0x7f575015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 --2- 172.21.15.46:0/3367036159 >> v2:172.21.15.133:3300/0 conn(0x7f575006bcd0 0x7f57500caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 --2- 172.21.15.46:0/3367036159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f575006c0a0 0x7f575015a1e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 -- 172.21.15.46:0/3367036159 >> 172.21.15.46:0/3367036159 conn(0x7f57500ce600 msgr2=0x7f57500cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd32affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd32affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60552/0 (socket says 172.21.15.46:60552) 2023-10-07T08:58:44.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd32affd700 1 -- 172.21.15.46:0/773499595 learned_addr learned my addr 172.21.15.46:0/773499595 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f93caffd700 1 -- 172.21.15.46:0/1431560238 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0009ea0 con 0x7f93cc069560 2023-10-07T08:58:44.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd32bfff700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd32c17a550 0x7fd32c17a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f93caffd700 1 -- 172.21.15.46:0/1431560238 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000b860 con 0x7f93cc069560 2023-10-07T08:58:44.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f93caffd700 1 -- 172.21.15.46:0/1431560238 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000bc00 con 0x7f93cc069560 2023-10-07T08:58:44.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fd32b7fe700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd32c15fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fdd57fff700 1 --2- 172.21.15.46:0/2251499608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd58159c60 0x7fdd5815d5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d1090 tx=0x7fdd44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3806c3ddab0ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fdd577fe700 1 -- 172.21.15.46:0/2251499608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44009e70 con 0x7fdd58159c60 2023-10-07T08:58:44.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 -- 172.21.15.46:0/3367036159 shutdown_connections 2023-10-07T08:58:44.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f5758156700 1 -- 172.21.15.46:0/3367036159 wait complete. 2023-10-07T08:58:44.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194773502 0 0) 0x7fb57415a160 con 0x7fb57415db10 2023-10-07T08:58:44.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb572ffd700 1 --2- 172.21.15.46:0/3400991147 >> v2:172.21.15.46:3300/0 conn(0x7fb574159890 0x7fb57415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c003570 con 0x7fb57415db10 2023-10-07T08:58:44.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 -- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 msgr2=0x7fd32c15fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd32c15fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 -- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd32c17a550 msgr2=0x7fd32c17a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd32c17a550 0x7fd32c17a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 -- 172.21.15.46:0/773499595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c152650 con 0x7fd32c0b0c00 2023-10-07T08:58:44.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7f855cced700 1 -- start start 2023-10-07T08:58:44.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23006b900 con 0x7ff23006bac0 2023-10-07T08:58:44.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2200070d0 con 0x7ff23006bac0 2023-10-07T08:58:44.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299178208 0 0) 0x7fb55c003570 con 0x7fb57415db10 2023-10-07T08:58:44.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 >> v2:172.21.15.133:3300/0 conn(0x7fb574159c60 msgr2=0x7fb57415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 --2- 172.21.15.46:0/3400991147 >> v2:172.21.15.133:3300/0 conn(0x7fb574159c60 0x7fb57415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 >> v2:172.21.15.46:3300/0 conn(0x7fb574159890 msgr2=0x7fb57415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 --2- 172.21.15.46:0/3400991147 >> v2:172.21.15.46:3300/0 conn(0x7fb574159890 0x7fb57415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57415e140 con 0x7fb57415db10 2023-10-07T08:58:44.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb56c0017f0 con 0x7fb57415db10 2023-10-07T08:58:44.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 >> v1:172.21.15.46:6789/0 conn(0x7fb57415db10 legacy=0x7fb574069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c003ae0 0x7fb55c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 0x7fb55c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55c0052e0 0x7fb55c014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740d13a0 con 0x7fb55c004810 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c014a10 con 0x7fb55c003ae0 2023-10-07T08:58:44.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c014bd0 con 0x7fb55c0052e0 2023-10-07T08:58:44.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd32affd700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ecc0 tx=0x7fd31c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 -- 172.21.15.46:0/1431560238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 msgr2=0x7f93cc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 --2- 172.21.15.46:0/1431560238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93c00099b0 tx=0x7f93c0009250 comp rx=0 tx=0).stop 2023-10-07T08:58:44.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 -- 172.21.15.46:0/1431560238 shutdown_connections 2023-10-07T08:58:44.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 --2- 172.21.15.46:0/1431560238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc0699a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 --2- 172.21.15.46:0/1431560238 >> v2:172.21.15.133:3300/0 conn(0x7f93cc159890 0x7f93cc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f93d24f0700 1 -- 172.21.15.46:0/1431560238 >> 172.21.15.46:0/1431560238 conn(0x7f93cc068e20 msgr2=0x7f93cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8558159b10 0x7f85580c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855815d730 0x7f855815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00a860 con 0x7fd32c0b0c00 2023-10-07T08:58:44.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580b0fb0 con 0x7f855815d730 2023-10-07T08:58:44.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580c67d0 con 0x7f8558159b10 2023-10-07T08:58:44.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7f855cced700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85581542c0 con 0x7f855806a410 2023-10-07T08:58:44.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c010040 con 0x7fd32c0b0c00 2023-10-07T08:58:44.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00abf0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57194/0 (socket says 172.21.15.46:57194) 2023-10-07T08:58:44.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 -- 172.21.15.46:0/4190368238 learned_addr learned my addr 172.21.15.46:0/4190368238 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f8556d9d700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855815d730 0x7f855815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 0x7fb55c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7ff216ffd700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 0x7ff21c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fdd577fe700 1 -- 172.21.15.46:0/2251499608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400b860 con 0x7fdd58159c60 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.444+0000 7fdd577fe700 1 -- 172.21.15.46:0/2251499608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400bc00 con 0x7fdd58159c60 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/2251499608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd58159c60 msgr2=0x7fdd5815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/2251499608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd58159c60 0x7fdd5815d5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d1090 tx=0x7fdd44009250 comp rx=0 tx=0).stop 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/2251499608 shutdown_connections 2023-10-07T08:58:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/2251499608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd5815db10 0x7fdd58069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/2251499608 >> v2:172.21.15.133:3300/0 conn(0x7fdd58159890 0x7fdd5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/2251499608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd58159c60 0x7fdd5815d5d0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d1090 tx=0x7fdd44009250 comp rx=0 tx=0).stop 2023-10-07T08:58:44.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.445+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/2251499608 >> 172.21.15.46:0/2251499608 conn(0x7fdd58068e20 msgr2=0x7fdd580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f5758156700 1 Processor -- start 2023-10-07T08:58:44.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5737fe700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55c0052e0 0x7fb55c014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 -- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8558159b10 msgr2=0x7f85580c6290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8558159b10 0x7f85580c6290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 -- 172.21.15.46:0/4190368238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855815d730 msgr2=0x7f855815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855815d730 0x7f855815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 -- 172.21.15.46:0/4190368238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009420 con 0x7f855806a410 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff220083880 con 0x7ff23006bac0 2023-10-07T08:58:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7ff22effd700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 0x7ff21c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 -- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55c0052e0 msgr2=0x7fb55c014270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55c0052e0 0x7fb55c014270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 -- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c003ae0 msgr2=0x7fb55c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c003ae0 0x7fb55c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 -- 172.21.15.46:0/3400991147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57415e140 con 0x7fb55c004810 2023-10-07T08:58:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5737fe700 1 -- 172.21.15.46:0/3400991147 reap_dead start 2023-10-07T08:58:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f855659c700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f854800c7c0 tx=0x7f8548007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7f5758156700 1 -- start start 2023-10-07T08:58:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c152930 con 0x7fd32c0b0c00 2023-10-07T08:58:44.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fb5727fc700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 0x7fb55c004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5640099e0 tx=0x7fb564009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0e2230ad966993 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.446+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c1604a0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548005b30 con 0x7f855806a410 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85580c51f0 con 0x7f855806a410 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548005c90 con 0x7f855806a410 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548007300 con 0x7f855806a410 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85580c57b0 con 0x7f855806a410 2023-10-07T08:58:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7ff22effd700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 0x7ff21c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff22400e010 tx=0x7ff22401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f5758156700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f5758156700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f575015df50 0x7f57500c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f5758156700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 0x7f5750156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.447+0000 7f5758156700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500c84a0 con 0x7f575015df50 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5758156700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500c7890 con 0x7f575006c0a0 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5758156700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500c7b70 con 0x7f5750154420 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33670/0 (socket says 172.21.15.46:33670) 2023-10-07T08:58:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 -- 172.21.15.46:0/3594537535 learned_addr learned my addr 172.21.15.46:0/3594537535 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f57566f3700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 0x7f5750156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c0690e0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/2251499608 shutdown_connections 2023-10-07T08:58:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855804c3c0 con 0x7f855806a410 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 -- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 msgr2=0x7f5750156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 0x7f5750156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 -- 172.21.15.46:0/3594537535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f575015df50 msgr2=0x7f57500c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f575015df50 0x7f57500c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 -- 172.21.15.46:0/3594537535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400094f0 con 0x7f575006c0a0 2023-10-07T08:58:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f57566f3700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 0x7f5750156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd31c0143f0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.448+0000 7f5755ef2700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f574c00b5e0 tx=0x7f574c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/2251499608 wait complete. 2023-10-07T08:58:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7f93d24f0700 1 -- 172.21.15.46:0/1431560238 shutdown_connections 2023-10-07T08:58:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8548007670 con 0x7f855806a410 2023-10-07T08:58:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564012480 con 0x7fb55c004810 2023-10-07T08:58:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7f85467fc700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8548083900 con 0x7f855806a410 2023-10-07T08:58:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7f8555d9b700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5640125e0 con 0x7fb55c004810 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fb571ffb700 1 -- 172.21.15.46:0/3400991147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564012980 con 0x7fb55c004810 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 -- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 msgr2=0x7fb55c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 0x7fb55c004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5640099e0 tx=0x7fb564009060 comp rx=0 tx=0).stop 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 -- 172.21.15.46:0/3400991147 shutdown_connections 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 --2- 172.21.15.46:0/3400991147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c004810 0x7fb55c004c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 -- 172.21.15.46:0/3400991147 >> 172.21.15.46:0/3400991147 conn(0x7fb574068e20 msgr2=0x7fb5740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7f8555d9b700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 0x7f85380693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85580c6eb0 tx=0x7f854c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 -- 172.21.15.46:0/3400991147 shutdown_connections 2023-10-07T08:58:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fb5795d8700 1 -- 172.21.15.46:0/3400991147 wait complete. 2023-10-07T08:58:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.450+0000 7fdd5f0c2700 1 Processor -- start 2023-10-07T08:58:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c00f510 con 0x7f575006c0a0 2023-10-07T08:58:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c00f670 con 0x7f575006c0a0 2023-10-07T08:58:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57500c7e50 con 0x7f575006c0a0 2023-10-07T08:58:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c00fa30 con 0x7f575006c0a0 2023-10-07T08:58:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57500c6950 con 0x7f575006c0a0 2023-10-07T08:58:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7fb5795d8700 1 Processor -- start 2023-10-07T08:58:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7fb5795d8700 1 -- start start 2023-10-07T08:58:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.451+0000 7fdd5f0c2700 1 -- start start 2023-10-07T08:58:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 0x7fdd5814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5813ebb0 con 0x7fdd5813f370 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580ce2b0 con 0x7fdd5815db10 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5f0c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5815c620 con 0x7fdd58159890 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd57fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 0x7fdd5814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5d65f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5ce5e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5ce5e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57224/0 (socket says 172.21.15.46:57224) 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5d65f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60584/0 (socket says 172.21.15.46:60584) 2023-10-07T08:58:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5ce5e700 1 -- 172.21.15.46:0/3082914117 learned_addr learned my addr 172.21.15.46:0/3082914117 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5ce5e700 1 -- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 msgr2=0x7fdd5814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7fdd5ce5e700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 0x7fdd5814ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd5ce5e700 1 -- 172.21.15.46:0/3082914117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 msgr2=0x7fdd5814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd5ce5e700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd5ce5e700 1 -- 172.21.15.46:0/3082914117 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009420 con 0x7fdd58159890 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd57fff700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 0x7fdd5814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd5d65f700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f574c01a400 con 0x7f575006c0a0 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c004810 0x7fb5740b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5740b4e80 0x7fb57414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740b49f0 con 0x7fb5740ce7c0 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740b3de0 con 0x7fb55c004810 2023-10-07T08:58:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5795d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740b40c0 con 0x7fb5740b4e80 2023-10-07T08:58:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fdd5ce5e700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00ec80 tx=0x7fdd4c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60586/0 (socket says 172.21.15.46:60586) 2023-10-07T08:58:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 -- 172.21.15.46:0/690857223 learned_addr learned my addr 172.21.15.46:0/690857223 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5727fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5740b4e80 0x7fb57414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575004c3c0 con 0x7f575006c0a0 2023-10-07T08:58:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f5745ffb700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 0x7f5734069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.452+0000 7f93d24f0700 1 -- 172.21.15.46:0/1431560238 wait complete. 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 -- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5740b4e80 msgr2=0x7fb57414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5740b4e80 0x7fb57414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 -- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c004810 msgr2=0x7fb5740b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c004810 0x7fb5740b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7fb5737fe700 1 -- 172.21.15.46:0/690857223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740b43a0 con 0x7fb5740ce7c0 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f574c083f20 con 0x7f575006c0a0 2023-10-07T08:58:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f57556f1700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 0x7f5734069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.453+0000 7f93d24f0700 1 Processor -- start 2023-10-07T08:58:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7fb5737fe700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb5740cadc0 tx=0x7fb56c004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f93d24f0700 1 -- start start 2023-10-07T08:58:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f57556f1700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 0x7f5734069460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57500691a0 tx=0x7f5740017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f026f043700 1 Processor -- start 2023-10-07T08:58:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f026f043700 1 -- start start 2023-10-07T08:58:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f93d24f0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00c920 con 0x7fdd58159890 2023-10-07T08:58:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fd3137fe700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 0x7fd318069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.449+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd31c083ab0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00ca80 con 0x7fdd58159890 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440094f0 con 0x7fdd58159890 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.454+0000 7f93d24f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc159890 0x7f93cc1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93d24f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93cc159c60 0x7f93cc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93d24f0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc152d80 con 0x7f93cc159c60 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93d24f0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc151ce0 con 0x7f93cc159890 2023-10-07T08:58:44.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93d24f0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc151fc0 con 0x7f93cc069560 2023-10-07T08:58:44.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7fd32b7fe700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 0x7fd318069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5815cbc0 con 0x7fdd58159890 2023-10-07T08:58:44.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00ce00 con 0x7fdd58159890 2023-10-07T08:58:44.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f854804b5a0 con 0x7f855806a410 2023-10-07T08:58:44.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57244/0 (socket says 172.21.15.46:57244) 2023-10-07T08:58:44.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 -- 172.21.15.46:0/734346031 learned_addr learned my addr 172.21.15.46:0/734346031 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cb7fe700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc159890 0x7f93cc1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026f043700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f026806ec80 0x7f02680cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026f043700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f026806bbe0 0x7f02680ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026f043700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680adcf0 con 0x7f0268156950 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026f043700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026806cbf0 con 0x7f026806bbe0 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026f043700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680aceb0 con 0x7f026806ec80 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026e041700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0268156950 0x7f026806e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54756/0 (socket says 172.21.15.46:54756) 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026e041700 1 -- 172.21.15.46:0/395596542 learned_addr learned my addr 172.21.15.46:0/395596542 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 --2- 172.21.15.46:0/395596542 >> v2:172.21.15.133:3300/0 conn(0x7f026806ec80 0x7f02680cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00abf0 con 0x7fb5740ce7c0 2023-10-07T08:58:44.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd380052b0 con 0x7fdd58159890 2023-10-07T08:58:44.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740b4680 con 0x7fb5740ce7c0 2023-10-07T08:58:44.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57414e960 con 0x7fb5740ce7c0 2023-10-07T08:58:44.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd31c04d5a0 con 0x7fd32c0b0c00 2023-10-07T08:58:44.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff22004b5a0 con 0x7ff23006bac0 2023-10-07T08:58:44.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 -- 172.21.15.46:0/395596542 >> v2:172.21.15.46:3300/0 conn(0x7f026806bbe0 msgr2=0x7f02680ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:44.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 --2- 172.21.15.46:0/395596542 >> v2:172.21.15.46:3300/0 conn(0x7f026806bbe0 0x7f02680ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 -- 172.21.15.46:0/395596542 >> v1:172.21.15.46:6789/0 conn(0x7f0268156950 legacy=0x7f026806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 -- 172.21.15.46:0/395596542 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680adfb0 con 0x7f026806ec80 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f026d840700 1 --2- 172.21.15.46:0/395596542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f02680cda10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f026815a3d0 tx=0x7f02580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec2aab911a248f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd4c013680 con 0x7fdd58159890 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fdd54ff9700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 0x7fdd3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd4c0848b0 con 0x7fdd58159890 2023-10-07T08:58:44.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fdd57fff700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 0x7fdd3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7fdd57fff700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 0x7fdd3c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d1090 tx=0x7fdd44017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c00ad90 con 0x7fb5740ce7c0 2023-10-07T08:58:44.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c013640 con 0x7fb5740ce7c0 2023-10-07T08:58:44.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57404c3c0 con 0x7fb5740ce7c0 2023-10-07T08:58:44.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7fd32b7fe700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 0x7fd318069410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0665c0 tx=0x7fd320009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 -- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc159890 msgr2=0x7f93cc1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc159890 0x7f93cc1512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 -- 172.21.15.46:0/734346031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93cc159c60 msgr2=0x7f93cc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93cc159c60 0x7f93cc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 -- 172.21.15.46:0/734346031 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00094f0 con 0x7f93cc069560 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93cbfff700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009ef0 tx=0x7f93c400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.455+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400cc20 con 0x7f93cc069560 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400f040 con 0x7f93cc069560 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4014480 con 0x7f93cc069560 2023-10-07T08:58:44.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.456+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc1522a0 con 0x7f93cc069560 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.457+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc152860 con 0x7f93cc069560 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc04c3c0 con 0x7f93cc069560 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7f026d03f700 1 -- 172.21.15.46:0/395596542 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800b740 con 0x7f026806ec80 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7f026d03f700 1 -- 172.21.15.46:0/395596542 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800b8a0 con 0x7f026806ec80 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.458+0000 7f026d03f700 1 -- 172.21.15.46:0/395596542 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800bc40 con 0x7f026806ec80 2023-10-07T08:58:44.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f574c054c00 con 0x7f575006c0a0 2023-10-07T08:58:44.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 -- 172.21.15.46:0/395596542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 msgr2=0x7f02680cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 --2- 172.21.15.46:0/395596542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f02680cda10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f026815a3d0 tx=0x7f02580091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 -- 172.21.15.46:0/395596542 shutdown_connections 2023-10-07T08:58:44.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 --2- 172.21.15.46:0/395596542 >> v2:172.21.15.46:3300/0 conn(0x7f026806bbe0 0x7f02680ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 --2- 172.21.15.46:0/395596542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f02680cda10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 -- 172.21.15.46:0/395596542 >> 172.21.15.46:0/395596542 conn(0x7f026806b490 msgr2=0x7f02680cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 -- 172.21.15.46:0/395596542 shutdown_connections 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.459+0000 7f026f043700 1 -- 172.21.15.46:0/395596542 wait complete. 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.460+0000 7f026f043700 1 Processor -- start 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.460+0000 7f026f043700 1 -- start start 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 0x7f02680c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f0268166a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680c81f0 con 0x7f0268156950 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681520b0 con 0x7f026806ec80 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026f043700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02681671a0 con 0x7f026806bbe0 2023-10-07T08:58:44.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026e842700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026e041700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 0x7f02680c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026e842700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60600/0 (socket says 172.21.15.46:60600) 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.461+0000 7f026e842700 1 -- 172.21.15.46:0/2192790779 learned_addr learned my addr 172.21.15.46:0/2192790779 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 -- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 msgr2=0x7f02680c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 0x7f02680c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 -- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 msgr2=0x7f0268166a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f0268166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 -- 172.21.15.46:0/2192790779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009420 con 0x7f0268156950 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e041700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 0x7f02680c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:44.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.462+0000 7f026e842700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f026000bc30 tx=0x7f0260009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.463+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93c40147f0 con 0x7f93cc069560 2023-10-07T08:58:44.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.464+0000 7f93b3fff700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 0x7f93b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.464+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93c40857c0 con 0x7f93cc069560 2023-10-07T08:58:44.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.464+0000 7f93cb7fe700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 0x7f93b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.464+0000 7f93cb7fe700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 0x7f93b80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0cf170 tx=0x7f93bc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.464+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb56c0139b0 con 0x7fb5740ce7c0 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.465+0000 7fb55affd700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 0x7fb560069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.465+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb56c085970 con 0x7fb5740ce7c0 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.467+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600092e0 con 0x7f0268156950 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.467+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000c6f0 con 0x7f0268156950 2023-10-07T08:58:44.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.467+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000cad0 con 0x7f0268156950 2023-10-07T08:58:44.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.467+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93c4052a10 con 0x7f93cc069560 2023-10-07T08:58:44.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.468+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268166f50 con 0x7f0268156950 2023-10-07T08:58:44.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.468+0000 7fb572ffd700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 0x7fb560069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.468+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268169da0 con 0x7f0268156950 2023-10-07T08:58:44.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.468+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd4c051b20 con 0x7fdd58159890 2023-10-07T08:58:44.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.469+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb56c052b40 con 0x7fb5740ce7c0 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.477+0000 7fb572ffd700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 0x7fb560069410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5740665c0 tx=0x7fb568008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.471+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0260012070 con 0x7f0268156950 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.471+0000 7f025e7fc700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 0x7f024c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.472+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02600841a0 con 0x7f0268156950 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.472+0000 7f026e041700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 0x7f024c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.472+0000 7f026e041700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 0x7f024c069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0264007110 tx=0x7f0264007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:44.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.482+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02500052b0 con 0x7f0268156950 2023-10-07T08:58:44.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.491+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02600513f0 con 0x7f0268156950 2023-10-07T08:58:44.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.838+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57500b2750 con 0x7f575006c0a0 2023-10-07T08:58:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.847+0000 7f5745ffb700 1 -- 172.21.15.46:0/3594537535 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f574c054790 con 0x7f575006c0a0 2023-10-07T08:58:44.857 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:44.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.858+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff23009a400 con 0x7ff23006bac0 2023-10-07T08:58:44.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7ff216ffd700 1 -- 172.21.15.46:0/3533932594 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff220050af0 con 0x7ff23006bac0 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.856+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 msgr2=0x7f5734069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.856+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 0x7f5734069460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57500691a0 tx=0x7f5740017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.856+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 msgr2=0x7f57500c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.856+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f574c00b5e0 tx=0x7f574c009120 comp rx=0 tx=0).stop 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 shutdown_connections 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5734066fb0 0x7f5734069460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5750154420 0x7f5750156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f575006c0a0 0x7f57500c72b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 --2- 172.21.15.46:0/3594537535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f575015df50 0x7f57500c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.859+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 >> 172.21.15.46:0/3594537535 conn(0x7f57500ce600 msgr2=0x7f5750155350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:44.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.860+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85580cab60 con 0x7f855806a410 2023-10-07T08:58:44.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.861+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 shutdown_connections 2023-10-07T08:58:44.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.861+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd32c0b0280 con 0x7fd32c0b0c00 2023-10-07T08:58:44.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.862+0000 7f5758156700 1 -- 172.21.15.46:0/3594537535 wait complete. 2023-10-07T08:58:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.864+0000 7fd3137fe700 1 -- 172.21.15.46:0/773499595 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd31c019090 con 0x7fd32c0b0c00 2023-10-07T08:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.864+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 msgr2=0x7ff21c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.864+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 0x7ff21c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff22400e010 tx=0x7ff22401a000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.864+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 msgr2=0x7ff2300c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.864+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c7f0 tx=0x7ff220007f70 comp rx=0 tx=0).stop 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 shutdown_connections 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff21c066f30 0x7ff21c0693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2300c91e0 0x7ff2300972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23006aa40 0x7ff2301512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 --2- 172.21.15.46:0/3533932594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23006bac0 0x7ff2300c5420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 >> 172.21.15.46:0/3533932594 conn(0x7ff2300cd670 msgr2=0x7ff230153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 shutdown_connections 2023-10-07T08:58:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.866+0000 7ff23570e700 1 -- 172.21.15.46:0/3533932594 wait complete. 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.868+0000 7f85467fc700 1 -- 172.21.15.46:0/4190368238 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8548050c20 con 0x7f855806a410 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.867+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 msgr2=0x7fd318069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.867+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 0x7fd318069410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0665c0 tx=0x7fd320009060 comp rx=0 tx=0).stop 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.867+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 msgr2=0x7fd32c17a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.867+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ecc0 tx=0x7fd31c005840 comp rx=0 tx=0).stop 2023-10-07T08:58:44.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.869+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f93cc06a5b0 con 0x7f93cc069560 2023-10-07T08:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 shutdown_connections 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd318066f60 0x7fd318069410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd32c17a550 0x7fd32c17a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3140052e0 0x7fd32c15fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 --2- 172.21.15.46:0/773499595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd32c0b0c00 0x7fd32c17a010 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 >> 172.21.15.46:0/773499595 conn(0x7fd32c0cd480 msgr2=0x7fd32c0705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 shutdown_connections 2023-10-07T08:58:44.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7fd332124700 1 -- 172.21.15.46:0/773499595 wait complete. 2023-10-07T08:58:44.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.872+0000 7f93b3fff700 1 -- 172.21.15.46:0/734346031 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c4056030 con 0x7f93cc069560 2023-10-07T08:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.878+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0250005560 con 0x7f0268156950 2023-10-07T08:58:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.878+0000 7f025e7fc700 1 -- 172.21.15.46:0/2192790779 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0260054a10 con 0x7f0268156950 2023-10-07T08:58:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:44.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-07T08:58:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.878+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd38005830 con 0x7fdd58159890 2023-10-07T08:58:44.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.879+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 msgr2=0x7f85380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.879+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 0x7f85380693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85580c6eb0 tx=0x7f854c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.879+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 msgr2=0x7f85580b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.879+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f854800c7c0 tx=0x7f8548007f30 comp rx=0 tx=0).stop 2023-10-07T08:58:44.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.879+0000 7fdd54ff9700 1 -- 172.21.15.46:0/3082914117 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd4c055140 con 0x7fdd58159890 2023-10-07T08:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:44.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 msgr2=0x7f93b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 0x7f93b80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0cf170 tx=0x7f93bc007ec0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 msgr2=0x7f93cc175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009ef0 tx=0x7f93c400b040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 shutdown_connections 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93b8066f30 0x7f93b80693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93cc159c60 0x7f93cc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93cc069560 0x7f93cc175d40 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009ef0 tx=0x7f93c400b040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 --2- 172.21.15.46:0/734346031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc159890 0x7f93cc1512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.880+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 >> 172.21.15.46:0/734346031 conn(0x7f93cc068e20 msgr2=0x7f93cc155520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 shutdown_connections 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855815d730 0x7f855815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f855806a410 0x7f85580b0a70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 --2- 172.21.15.46:0/4190368238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8558159b10 0x7f85580c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 >> 172.21.15.46:0/4190368238 conn(0x7f85580c9870 msgr2=0x7f8558157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.881+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5740b4b30 con 0x7fb5740ce7c0 2023-10-07T08:58:44.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 shutdown_connections 2023-10-07T08:58:44.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7f855cced700 1 -- 172.21.15.46:0/4190368238 wait complete. 2023-10-07T08:58:44.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fb55affd700 1 -- 172.21.15.46:0/690857223 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb56c056160 con 0x7fb5740ce7c0 2023-10-07T08:58:44.887 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 msgr2=0x7fdd3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 0x7fdd3c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d1090 tx=0x7fdd44017000 comp rx=0 tx=0).stop 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 msgr2=0x7fdd580cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00ec80 tx=0x7fdd4c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 shutdown_connections 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdd3c066f30 0x7fdd3c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5813f370 0x7fdd5814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd58159890 0x7fdd580cfa90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 --2- 172.21.15.46:0/3082914117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd5815db10 0x7fdd5814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.882+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 >> 172.21.15.46:0/3082914117 conn(0x7fdd58068e20 msgr2=0x7fdd58156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.883+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 shutdown_connections 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.883+0000 7fdd5f0c2700 1 -- 172.21.15.46:0/3082914117 wait complete. 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.884+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 shutdown_connections 2023-10-07T08:58:44.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.884+0000 7f93d24f0700 1 -- 172.21.15.46:0/734346031 wait complete. 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.885+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 msgr2=0x7fb560069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.885+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 0x7fb560069410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5740665c0 tx=0x7fb568008040 comp rx=0 tx=0).stop 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.885+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 msgr2=0x7fb57415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.885+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb5740cadc0 tx=0x7fb56c004f70 comp rx=0 tx=0).stop 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 shutdown_connections 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb560066f60 0x7fb560069410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5740ce7c0 0x7fb57415c800 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c004810 0x7fb5740b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 --2- 172.21.15.46:0/690857223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5740b4e80 0x7fb57414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 >> 172.21.15.46:0/690857223 conn(0x7fb574068e20 msgr2=0x7fb5740c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 msgr2=0x7f024c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 0x7f024c069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0264007110 tx=0x7f0264007f10 comp rx=0 tx=0).stop 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 msgr2=0x7f02680ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:44.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.886+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f026000bc30 tx=0x7f0260009840 comp rx=0 tx=0).stop 2023-10-07T08:58:44.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 shutdown_connections 2023-10-07T08:58:44.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 shutdown_connections 2023-10-07T08:58:44.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067080 0x7f024c069530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0268156950 0x7f02680ae440 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f026806bbe0 0x7f02680c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 --2- 172.21.15.46:0/2192790779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f026806ec80 0x7f0268166a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:44.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 >> 172.21.15.46:0/2192790779 conn(0x7f026806b490 msgr2=0x7f02680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:44.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7fb5795d8700 1 -- 172.21.15.46:0/690857223 wait complete. 2023-10-07T08:58:44.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 shutdown_connections 2023-10-07T08:58:44.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:44.887+0000 7f026f043700 1 -- 172.21.15.46:0/2192790779 wait complete. 2023-10-07T08:58:44.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-07T08:58:44.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-07T08:58:44.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-07T08:58:44.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-07T08:58:44.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-07T08:58:44.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-07T08:58:44.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-07T08:58:45.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-07T08:58:45.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-07T08:58:45.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-07T08:58:45.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-07T08:58:45.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-07T08:58:45.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-07T08:58:45.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-07T08:58:45.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-07T08:58:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.077+0000 7f17aae7f700 1 Processor -- start 2023-10-07T08:58:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.077+0000 7f17aae7f700 1 -- start start 2023-10-07T08:58:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17aae7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17a40691b0 0x7f17a40879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17aae7f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40acdf0 con 0x7f17a40875d0 2023-10-07T08:58:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17aae7f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40ac1e0 con 0x7f17a40b1c50 2023-10-07T08:58:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17aae7f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40abfd0 con 0x7f17a40691b0 2023-10-07T08:58:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17a941c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17a40691b0 0x7f17a40879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17a3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17a40b1c50 0x7f17a4068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39626/0 (socket says 172.21.15.46:39626) 2023-10-07T08:58:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.079+0000 7f17a3fff700 1 -- 172.21.15.46:0/3519740325 learned_addr learned my addr 172.21.15.46:0/3519740325 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.080+0000 7f17a941c700 1 -- 172.21.15.46:0/3519740325 >> v1:172.21.15.133:6789/0 conn(0x7f17a40b1c50 legacy=0x7f17a4068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.080+0000 7f17a941c700 1 -- 172.21.15.46:0/3519740325 >> v1:172.21.15.46:6789/0 conn(0x7f17a40875d0 legacy=0x7f17a40ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.080+0000 7f17a941c700 1 -- 172.21.15.46:0/3519740325 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40ac4c0 con 0x7f17a40691b0 2023-10-07T08:58:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.080+0000 7f17a941c700 1 --2- 172.21.15.46:0/3519740325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a40879a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f179800bca0 tx=0x7f179800b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbdce22795c0d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.081+0000 7f17a37fe700 1 -- 172.21.15.46:0/3519740325 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798015410 con 0x7f17a40691b0 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.081+0000 7f17a37fe700 1 -- 172.21.15.46:0/3519740325 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798015570 con 0x7f17a40691b0 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.081+0000 7f17a37fe700 1 -- 172.21.15.46:0/3519740325 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798015930 con 0x7f17a40691b0 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 -- 172.21.15.46:0/3519740325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 msgr2=0x7f17a40879a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 --2- 172.21.15.46:0/3519740325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a40879a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f179800bca0 tx=0x7f179800b560 comp rx=0 tx=0).stop 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 -- 172.21.15.46:0/3519740325 shutdown_connections 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 --2- 172.21.15.46:0/3519740325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a40879a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 -- 172.21.15.46:0/3519740325 >> 172.21.15.46:0/3519740325 conn(0x7f17a40cd000 msgr2=0x7f17a4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 -- 172.21.15.46:0/3519740325 shutdown_connections 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.082+0000 7f17aae7f700 1 -- 172.21.15.46:0/3519740325 wait complete. 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.084+0000 7f17aae7f700 1 Processor -- start 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.084+0000 7f17aae7f700 1 -- start start 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a4147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a40875d0 0x7f17a406b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 0x7f17a4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41637c0 con 0x7f17a40875d0 2023-10-07T08:58:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a415a4a0 con 0x7f17a40691b0 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17aae7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41634e0 con 0x7f17a4159b20 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17a8c1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a4147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a40875d0 0x7f17a406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17a941c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 0x7f17a4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17a8c1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a4147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33720/0 (socket says 172.21.15.46:33720) 2023-10-07T08:58:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.086+0000 7f17a8c1b700 1 -- 172.21.15.46:0/1676849798 learned_addr learned my addr 172.21.15.46:0/1676849798 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 -- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 msgr2=0x7f17a4147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a4147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 -- 172.21.15.46:0/1676849798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a40875d0 msgr2=0x7f17a406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a40875d0 0x7f17a406b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 -- 172.21.15.46:0/1676849798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179800b7e0 con 0x7f17a4159b20 2023-10-07T08:58:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a941c700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 0x7f17a4159f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1798018000 tx=0x7f1798019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.087+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798015ca0 con 0x7f17a4159b20 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.088+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798015e00 con 0x7f17a4159b20 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.088+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798015930 con 0x7f17a4159b20 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.088+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4163f90 con 0x7f17a4159b20 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.088+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a4164550 con 0x7f17a4159b20 2023-10-07T08:58:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.090+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17840052b0 con 0x7f17a4159b20 2023-10-07T08:58:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.092+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f179801e640 con 0x7f17a4159b20 2023-10-07T08:58:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.093+0000 7f17a0ff9700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 0x7f1790069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.093+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1798086750 con 0x7f17a4159b20 2023-10-07T08:58:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.095+0000 7f17a8c1b700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 0x7f1790069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.095+0000 7f17a8c1b700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 0x7f1790069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.096+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1798053a20 con 0x7f17a4159b20 2023-10-07T08:58:46.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.135+0000 7ffaa6866700 1 Processor -- start 2023-10-07T08:58:46.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.135+0000 7ffaa6866700 1 -- start start 2023-10-07T08:58:46.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffaa6866700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffaa00cba20 0x7ffaa00ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffaa6866700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffaa0068aa0 0x7ffaa0068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffaa6866700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa00b2490 con 0x7ffaa006f8a0 2023-10-07T08:58:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffaa6866700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00aceb0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffaa6866700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00ac4e0 con 0x7ffaa00cba20 2023-10-07T08:58:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffaa00cba20 0x7ffaa00ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffaa00cba20 0x7ffaa00ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33734/0 (socket says 172.21.15.46:33734) 2023-10-07T08:58:46.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9ffff700 1 -- 172.21.15.46:0/4060302351 learned_addr learned my addr 172.21.15.46:0/4060302351 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/4060302351 >> v2:172.21.15.46:3300/0 conn(0x7ffaa0068aa0 0x7ffaa0068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9effd700 1 -- 172.21.15.46:0/4060302351 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225525173 0 0) 0x7ffa94001110 con 0x7ffaa006f8a0 2023-10-07T08:58:46.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.137+0000 7ffa9effd700 1 -- 172.21.15.46:0/4060302351 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003570 con 0x7ffaa006f8a0 2023-10-07T08:58:46.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9ffff700 1 -- 172.21.15.46:0/4060302351 >> v2:172.21.15.46:3300/0 conn(0x7ffaa0068aa0 msgr2=0x7ffaa0068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9ffff700 1 --2- 172.21.15.46:0/4060302351 >> v2:172.21.15.46:3300/0 conn(0x7ffaa0068aa0 0x7ffaa0068ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9ffff700 1 -- 172.21.15.46:0/4060302351 >> v1:172.21.15.133:6789/0 conn(0x7ffaa006f8a0 legacy=0x7ffaa0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9ffff700 1 -- 172.21.15.46:0/4060302351 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0069430 con 0x7ffaa00cba20 2023-10-07T08:58:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9ffff700 1 --2- 172.21.15.46:0/4060302351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa00cba20 0x7ffaa00ac970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa006d420 tx=0x7ffa98009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2068d8ad056d593 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9effd700 1 -- 172.21.15.46:0/4060302351 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800e070 con 0x7ffaa00cba20 2023-10-07T08:58:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9effd700 1 -- 172.21.15.46:0/4060302351 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800b970 con 0x7ffaa00cba20 2023-10-07T08:58:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.138+0000 7ffa9effd700 1 -- 172.21.15.46:0/4060302351 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980092e0 con 0x7ffaa00cba20 2023-10-07T08:58:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 -- 172.21.15.46:0/4060302351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa00cba20 msgr2=0x7ffaa00ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 --2- 172.21.15.46:0/4060302351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa00cba20 0x7ffaa00ac970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa006d420 tx=0x7ffa98009840 comp rx=0 tx=0).stop 2023-10-07T08:58:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 -- 172.21.15.46:0/4060302351 shutdown_connections 2023-10-07T08:58:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 --2- 172.21.15.46:0/4060302351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa00cba20 0x7ffaa00ac970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 --2- 172.21.15.46:0/4060302351 >> v2:172.21.15.46:3300/0 conn(0x7ffaa0068aa0 0x7ffaa0068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 -- 172.21.15.46:0/4060302351 >> 172.21.15.46:0/4060302351 conn(0x7ffaa00cd000 msgr2=0x7ffaa0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 -- 172.21.15.46:0/4060302351 shutdown_connections 2023-10-07T08:58:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.139+0000 7ffaa6866700 1 -- 172.21.15.46:0/4060302351 wait complete. 2023-10-07T08:58:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.140+0000 7f8a6c50f700 1 Processor -- start 2023-10-07T08:58:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.140+0000 7f8a6c50f700 1 -- start start 2023-10-07T08:58:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.140+0000 7f5ca16ac700 1 Processor -- start 2023-10-07T08:58:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.140+0000 7f5ca16ac700 1 -- start start 2023-10-07T08:58:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.140+0000 7ffaa6866700 1 Processor -- start 2023-10-07T08:58:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7ffaa6866700 1 -- start start 2023-10-07T08:58:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a6c50f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a64159b10 0x7f8a640cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5ca16ac700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c9c159c60 0x7f5c9c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5ca16ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5ca16ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c15a160 con 0x7f5c9c159890 2023-10-07T08:58:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5ca16ac700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c15df50 con 0x7f5c9c159c60 2023-10-07T08:58:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5ca16ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0d13a0 con 0x7f5c9c15db10 2023-10-07T08:58:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a6c50f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 0x7f8a6415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a6c50f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a640c74b0 con 0x7f8a6415d730 2023-10-07T08:58:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a6c50f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a640c8700 con 0x7f8a64159b10 2023-10-07T08:58:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a6c50f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640c9070 con 0x7f8a6406b420 2023-10-07T08:58:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a69aaa700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8a6415d730 0x7f8a64159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54786/0 (socket says 172.21.15.46:54786) 2023-10-07T08:58:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f8a69aaa700 1 -- 172.21.15.46:0/3607178086 learned_addr learned my addr 172.21.15.46:0/3607178086 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5c9affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5c9c159890 0x7f5c9c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39644/0 (socket says 172.21.15.46:39644) 2023-10-07T08:58:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5c9affd700 1 -- 172.21.15.46:0/1281076670 learned_addr learned my addr 172.21.15.46:0/1281076670 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.141+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1281076670 >> v2:172.21.15.133:3300/0 conn(0x7f5c9c159c60 0x7f5c9c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 --2- 172.21.15.46:0/3607178086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 0x7f8a6415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c99ffb700 1 -- 172.21.15.46:0/1281076670 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449291499 0 0) 0x7f5c9c15a160 con 0x7f5c9c159890 2023-10-07T08:58:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c99ffb700 1 -- 172.21.15.46:0/1281076670 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c84003570 con 0x7f5c9c159890 2023-10-07T08:58:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 0x7ffaa00ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 -- 172.21.15.46:0/3607178086 >> v2:172.21.15.46:3300/0 conn(0x7f8a64159b10 msgr2=0x7f8a640cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 --2- 172.21.15.46:0/3607178086 >> v2:172.21.15.46:3300/0 conn(0x7f8a64159b10 0x7f8a640cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 -- 172.21.15.46:0/3607178086 >> v1:172.21.15.46:6789/0 conn(0x7f8a6415d730 legacy=0x7f8a64159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 -- 172.21.15.46:0/3607178086 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6415e0e0 con 0x7f8a6406b420 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 msgr2=0x7f5c9c069560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1281076670 >> v1:172.21.15.133:6789/0 conn(0x7f5c9c159890 legacy=0x7f5c9c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa00cba20 0x7ffaa00ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014a9b0 con 0x7ffaa006f8a0 2023-10-07T08:58:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0150f20 con 0x7ffaa0068aa0 2023-10-07T08:58:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa6866700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0150310 con 0x7ffaa00cba20 2023-10-07T08:58:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1281076670 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c15e140 con 0x7f5c9c159c60 2023-10-07T08:58:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffa9ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffa9ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33756/0 (socket says 172.21.15.46:33756) 2023-10-07T08:58:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffa9ffff700 1 -- 172.21.15.46:0/197060221 learned_addr learned my addr 172.21.15.46:0/197060221 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 0x7ffaa00ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159c60 0x7f5c9c15d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098e0 tx=0x7f5c8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470ea5ef09269392 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7ffaa4e03700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa00cba20 0x7ffaa00ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 -- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa00cba20 msgr2=0x7ffaa00ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa00cba20 0x7ffaa00ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f8a6aaac700 1 --2- 172.21.15.46:0/3607178086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 0x7f8a6415dba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009e60 tx=0x7f8a5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f04416a64b632d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 -- 172.21.15.46:0/197060221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 msgr2=0x7ffaa00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 0x7ffaa00ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 -- 172.21.15.46:0/197060221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009ae0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 0x7ffaa00ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.142+0000 7f5c99ffb700 1 -- 172.21.15.46:0/1281076670 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00b640 con 0x7f5c9c159c60 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f5c99ffb700 1 -- 172.21.15.46:0/1281076670 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b7c0 con 0x7f5c9c159c60 2023-10-07T08:58:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f5c99ffb700 1 -- 172.21.15.46:0/1281076670 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00bb80 con 0x7f5c9c159c60 2023-10-07T08:58:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f8a692a9700 1 -- 172.21.15.46:0/3607178086 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00e070 con 0x7f8a6406b420 2023-10-07T08:58:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f8a692a9700 1 -- 172.21.15.46:0/3607178086 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00bcc0 con 0x7f8a6406b420 2023-10-07T08:58:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f8a692a9700 1 -- 172.21.15.46:0/3607178086 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c012680 con 0x7f8a6406b420 2023-10-07T08:58:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f8a6c50f700 1 -- 172.21.15.46:0/3607178086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 msgr2=0x7f8a6415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/3607178086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 0x7f8a6415dba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009e60 tx=0x7f8a5c009780 comp rx=0 tx=0).stop 2023-10-07T08:58:46.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7ffa9ffff700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009880 tx=0x7ffa98018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159c60 msgr2=0x7f5c9c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159c60 0x7f5c9c15d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098e0 tx=0x7f5c8c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 -- 172.21.15.46:0/3607178086 shutdown_connections 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/3607178086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6406b420 0x7f8a6415dba0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/3607178086 >> v2:172.21.15.46:3300/0 conn(0x7f8a64159b10 0x7f8a640cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 -- 172.21.15.46:0/3607178086 >> 172.21.15.46:0/3607178086 conn(0x7f8a640c9870 msgr2=0x7f8a640c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f552ba61700 1 Processor -- start 2023-10-07T08:58:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.143+0000 7f552ba61700 1 -- start start 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98008920 con 0x7ffaa0068aa0 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1281076670 shutdown_connections 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1281076670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159c60 0x7f5c9c15d5d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1281076670 >> 172.21.15.46:0/1281076670 conn(0x7f5c9c068e20 msgr2=0x7f5c9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 -- 172.21.15.46:0/3607178086 shutdown_connections 2023-10-07T08:58:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98008aa0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98008e60 con 0x7ffaa0068aa0 2023-10-07T08:58:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f8a6c50f700 1 -- 172.21.15.46:0/3607178086 wait complete. 2023-10-07T08:58:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f9a3186f700 1 Processor -- start 2023-10-07T08:58:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f552ba61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f552ba61700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240cafd0 con 0x7f552406a400 2023-10-07T08:58:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f552ba61700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240cb2b0 con 0x7f5524069b80 2023-10-07T08:58:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f552ba61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55240cb590 con 0x7f55240697b0 2023-10-07T08:58:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f55297fd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f55297fd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57300/0 (socket says 172.21.15.46:57300) 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f55297fd700 1 -- 172.21.15.46:0/736162703 learned_addr learned my addr 172.21.15.46:0/736162703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa01505f0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f55297fd700 1 -- 172.21.15.46:0/736162703 >> v1:172.21.15.133:6789/0 conn(0x7f5524069b80 legacy=0x7f55240b0b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f55297fd700 1 -- 172.21.15.46:0/736162703 >> v1:172.21.15.46:6789/0 conn(0x7f552406a400 legacy=0x7f55240cc070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:58:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f55297fd700 1 -- 172.21.15.46:0/736162703 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240cb870 con 0x7f55240697b0 2023-10-07T08:58:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0150bb0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f55297fd700 1 --2- 172.21.15.46:0/736162703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55200099e0 tx=0x7f5520009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8698ed932b560 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1281076670 shutdown_connections 2023-10-07T08:58:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1281076670 wait complete. 2023-10-07T08:58:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f551bfff700 1 -- 172.21.15.46:0/736162703 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000b7e0 con 0x7f55240697b0 2023-10-07T08:58:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f551bfff700 1 -- 172.21.15.46:0/736162703 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000b940 con 0x7f55240697b0 2023-10-07T08:58:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f551bfff700 1 -- 172.21.15.46:0/736162703 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000bce0 con 0x7f55240697b0 2023-10-07T08:58:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f8a6c50f700 1 Processor -- start 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.145+0000 7f8a6c50f700 1 -- start start 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.144+0000 7f9a3186f700 1 -- start start 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a3186f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a2c0691b0 0x7f9a2c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a3186f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a3186f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0b2490 con 0x7f9a2c0cba20 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a3186f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0aceb0 con 0x7f9a2c0691b0 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a3186f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0ac4e0 con 0x7f9a2c156050 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a2c0691b0 0x7f9a2c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9a2c0cba20 0x7f9a2c068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39658/0 (socket says 172.21.15.46:39658) 2023-10-07T08:58:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2affd700 1 -- 172.21.15.46:0/3971650164 learned_addr learned my addr 172.21.15.46:0/3971650164 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa00cbdf0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 msgr2=0x7f9a2c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2a7fc700 1 --2- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/3971650164 >> v1:172.21.15.133:6789/0 conn(0x7f9a2c0cba20 legacy=0x7f9a2c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/3971650164 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c156cd0 con 0x7f9a2c0691b0 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 0x7f8a6415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 0x7f8a640c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6415d730 0x7f8a6415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a64147ca0 con 0x7f8a6406b420 2023-10-07T08:58:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640c34c0 con 0x7f8a64159b10 2023-10-07T08:58:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.146+0000 7f8a6c50f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640c2420 con 0x7f8a6415d730 2023-10-07T08:58:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f552ba61700 1 -- 172.21.15.46:0/736162703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 msgr2=0x7f55240cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f552ba61700 1 --2- 172.21.15.46:0/736162703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55200099e0 tx=0x7f5520009250 comp rx=0 tx=0).stop 2023-10-07T08:58:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a6a2ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 0x7f8a6415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa98003040 con 0x7ffaa0068aa0 2023-10-07T08:58:46.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f9a2a7fc700 1 --2- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0ac970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000bb90 tx=0x7f9a2000b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f018da08228d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a6a2ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 0x7f8a6415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60654/0 (socket says 172.21.15.46:60654) 2023-10-07T08:58:46.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a6a2ab700 1 -- 172.21.15.46:0/2152993023 learned_addr learned my addr 172.21.15.46:0/2152993023 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 0x7f8a640c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f9a29ffb700 1 -- 172.21.15.46:0/3971650164 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000daa0 con 0x7f9a2c0691b0 2023-10-07T08:58:46.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f5ca16ac700 1 Processor -- start 2023-10-07T08:58:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f9a29ffb700 1 -- 172.21.15.46:0/3971650164 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2000dc00 con 0x7f9a2c0691b0 2023-10-07T08:58:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f9a29ffb700 1 -- 172.21.15.46:0/3971650164 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20010470 con 0x7f9a2c0691b0 2023-10-07T08:58:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f5ca16ac700 1 -- start start 2023-10-07T08:58:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a6aaac700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6415d730 0x7f8a6415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7ffa87fff700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 0x7ffa8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 -- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6415d730 msgr2=0x7f8a6415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6415d730 0x7f8a6415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 -- 172.21.15.46:0/2152993023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 msgr2=0x7f8a6415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 0x7f8a6415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7f8a69aaa700 1 -- 172.21.15.46:0/2152993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c009a20 con 0x7f8a64159b10 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.147+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa98086290 con 0x7ffaa0068aa0 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 0x7ffa8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f8a69aaa700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 0x7f8a640c1ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c4a0 tx=0x7f8a54007f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 -- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 msgr2=0x7f9a2c0ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 --2- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0ac970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000bb90 tx=0x7f9a2000b430 comp rx=0 tx=0).stop 2023-10-07T08:58:46.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7efe8991b700 1 Processor -- start 2023-10-07T08:58:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f552ba61700 1 -- 172.21.15.46:0/736162703 shutdown_connections 2023-10-07T08:58:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f552ba61700 1 --2- 172.21.15.46:0/736162703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55240697b0 0x7f55240cfff0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f552ba61700 1 -- 172.21.15.46:0/736162703 >> 172.21.15.46:0/736162703 conn(0x7f55240d07f0 msgr2=0x7f55240d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7ff51ab71700 1 Processor -- start 2023-10-07T08:58:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 -- 172.21.15.46:0/3971650164 shutdown_connections 2023-10-07T08:58:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 --2- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 --2- 172.21.15.46:0/3971650164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0ac970 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 -- 172.21.15.46:0/3971650164 >> 172.21.15.46:0/3971650164 conn(0x7f9a2c0cd000 msgr2=0x7f9a2c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7efe8991b700 1 -- start start 2023-10-07T08:58:46.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f552ba61700 1 -- 172.21.15.46:0/736162703 shutdown_connections 2023-10-07T08:58:46.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f9a3186f700 1 -- 172.21.15.46:0/3971650164 shutdown_connections 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159890 0x7f5c9c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0caa30 con 0x7f5c9c159c60 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b3c50 con 0x7f5c9c159890 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5ca16ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c153890 con 0x7f5c9c15db10 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5c9a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5c9a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60666/0 (socket says 172.21.15.46:60666) 2023-10-07T08:58:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1698185940 learned_addr learned my addr 172.21.15.46:0/1698185940 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5c9affd700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159890 0x7f5c9c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7ff51ab71700 1 -- start start 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f5c9b7fe700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 msgr2=0x7f5c9c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159890 msgr2=0x7f5c9c153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159890 0x7f5c9c153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 -- 172.21.15.46:0/1698185940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009420 con 0x7f5c9c159c60 2023-10-07T08:58:46.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c9a7fc700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c013000 tx=0x7f5c8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe840afc40 0x7efe840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe840b2140 0x7efe8415d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe840b0010 0x7efe8415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840b0750 con 0x7efe840b0010 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840aca70 con 0x7efe840b2140 2023-10-07T08:58:46.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe8991b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840acd50 con 0x7efe840afc40 2023-10-07T08:58:46.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c01f070 con 0x7f5c9c159c60 2023-10-07T08:58:46.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe837fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe840b0010 0x7efe8415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe837fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe840b0010 0x7efe8415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60672/0 (socket says 172.21.15.46:60672) 2023-10-07T08:58:46.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe837fe700 1 -- 172.21.15.46:0/2874613502 learned_addr learned my addr 172.21.15.46:0/2874613502 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7efe82ffd700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe840afc40 0x7efe840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b930 con 0x7f5c9c159c60 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011420 con 0x7f5c9c159c60 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c0b3970 con 0x7f5c9c159c60 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c0cd820 con 0x7f5c9c159c60 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.148+0000 7f552ba61700 1 -- 172.21.15.46:0/736162703 wait complete. 2023-10-07T08:58:46.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.149+0000 7f552ba61700 1 Processor -- start 2023-10-07T08:58:46.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7f552ba61700 1 -- start start 2023-10-07T08:58:46.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7f9a3186f700 1 -- 172.21.15.46:0/3971650164 wait complete. 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51ab71700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5140b1f40 0x7ff5140ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51ab71700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51ab71700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140accf0 con 0x7ff514159fb0 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51ab71700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff514069460 con 0x7ff5140b1f40 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51ab71700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415a440 con 0x7ff514068aa0 2023-10-07T08:58:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51910e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51910e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57340/0 (socket says 172.21.15.46:57340) 2023-10-07T08:58:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51910e700 1 -- 172.21.15.46:0/3207565493 learned_addr learned my addr 172.21.15.46:0/3207565493 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7ff51890d700 1 --2- 172.21.15.46:0/3207565493 >> v2:172.21.15.46:3300/0 conn(0x7ff5140b1f40 0x7ff5140ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.150+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c06f900 con 0x7f5c9c159c60 2023-10-07T08:58:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff51910e700 1 -- 172.21.15.46:0/3207565493 >> v2:172.21.15.46:3300/0 conn(0x7ff5140b1f40 msgr2=0x7ff5140ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff51910e700 1 --2- 172.21.15.46:0/3207565493 >> v2:172.21.15.46:3300/0 conn(0x7ff5140b1f40 0x7ff5140ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff51910e700 1 -- 172.21.15.46:0/3207565493 >> v1:172.21.15.46:6789/0 conn(0x7ff514159fb0 legacy=0x7ff5140aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff51910e700 1 -- 172.21.15.46:0/3207565493 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51415a720 con 0x7ff514068aa0 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff51910e700 1 --2- 172.21.15.46:0/3207565493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009f20 tx=0x7ff50c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9297257437ddd316 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 -- 172.21.15.46:0/2874613502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe840afc40 msgr2=0x7efe840b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe840afc40 0x7efe840b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 -- 172.21.15.46:0/2874613502 >> v2:172.21.15.133:3300/0 conn(0x7efe840b2140 msgr2=0x7efe8415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 --2- 172.21.15.46:0/2874613502 >> v2:172.21.15.133:3300/0 conn(0x7efe840b2140 0x7efe8415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 -- 172.21.15.46:0/2874613502 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840ad030 con 0x7efe840b0010 2023-10-07T08:58:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff5137fe700 1 -- 172.21.15.46:0/3207565493 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00e070 con 0x7ff514068aa0 2023-10-07T08:58:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff5137fe700 1 -- 172.21.15.46:0/3207565493 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00ba40 con 0x7ff514068aa0 2023-10-07T08:58:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7ff5137fe700 1 -- 172.21.15.46:0/3207565493 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0092e0 con 0x7ff514068aa0 2023-10-07T08:58:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5524069b80 0x7f552417a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f552406a400 0x7f552417aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552406dd00 con 0x7f552406a400 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552406d0f0 con 0x7f55240697b0 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f552ba61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552406d3d0 con 0x7f5524069b80 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f55297fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f5528ffc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5524069b80 0x7f552417a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f55297fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33800/0 (socket says 172.21.15.46:33800) 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f55297fd700 1 -- 172.21.15.46:0/1358661871 learned_addr learned my addr 172.21.15.46:0/1358661871 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c8c011850 con 0x7f5c9c159c60 2023-10-07T08:58:46.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.151+0000 7efe837fe700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840b0010 0x7efe8415dd90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe84064210 tx=0x7efe7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c015281d59a7c4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7efe81ffb700 1 -- 172.21.15.46:0/2874613502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00e070 con 0x7efe840b0010 2023-10-07T08:58:46.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7efe81ffb700 1 -- 172.21.15.46:0/2874613502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00ba20 con 0x7efe840b0010 2023-10-07T08:58:46.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7efe81ffb700 1 -- 172.21.15.46:0/2874613502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0092e0 con 0x7efe840b0010 2023-10-07T08:58:46.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 -- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5524069b80 msgr2=0x7f552417a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5524069b80 0x7f552417a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 -- 172.21.15.46:0/1358661871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f552406a400 msgr2=0x7f552417aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f552406a400 0x7f552417aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 -- 172.21.15.46:0/1358661871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200094f0 con 0x7f55240697b0 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f5c82ffd700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 0x7f5c88069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c8c085740 con 0x7f5c9c159c60 2023-10-07T08:58:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f5c9affd700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 0x7f5c88069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7ff51ab71700 1 -- 172.21.15.46:0/3207565493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 msgr2=0x7ff514068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7ff51ab71700 1 --2- 172.21.15.46:0/3207565493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009f20 tx=0x7ff50c009840 comp rx=0 tx=0).stop 2023-10-07T08:58:46.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f9a3186f700 1 Processor -- start 2023-10-07T08:58:46.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f9a3186f700 1 -- start start 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7efe8991b700 1 -- 172.21.15.46:0/2874613502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840b0010 msgr2=0x7efe8415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7efe8991b700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840b0010 0x7efe8415dd90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe84064210 tx=0x7efe7c009840 comp rx=0 tx=0).stop 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa98053500 con 0x7ffaa0068aa0 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7efe8991b700 1 -- 172.21.15.46:0/2874613502 shutdown_connections 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7efe8991b700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840b0010 0x7efe8415dd90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7efe8991b700 1 --2- 172.21.15.46:0/2874613502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe840afc40 0x7efe840b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7efe8991b700 1 --2- 172.21.15.46:0/2874613502 >> v2:172.21.15.133:3300/0 conn(0x7efe840b2140 0x7efe8415d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7efe8991b700 1 -- 172.21.15.46:0/2874613502 >> 172.21.15.46:0/2874613502 conn(0x7efe8406a320 msgr2=0x7efe840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54005b30 con 0x7f8a64159b10 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54005cb0 con 0x7f8a64159b10 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54007320 con 0x7f8a64159b10 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a640c2700 con 0x7f8a64159b10 2023-10-07T08:58:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a640c2cc0 con 0x7f8a64159b10 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f5c9affd700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 0x7f5c88069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007fd0 tx=0x7f5c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1579c0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c157c10 con 0x7f9a2c0691b0 2023-10-07T08:58:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a3186f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c157ef0 con 0x7f9a2c156050 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60698/0 (socket says 172.21.15.46:60698) 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/1033147348 learned_addr learned my addr 172.21.15.46:0/1033147348 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2affd700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2b7fe700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 msgr2=0x7f9a2c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 msgr2=0x7f9a2c0a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2a7fc700 1 -- 172.21.15.46:0/1033147348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2000b6d0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f9a2b7fe700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.154+0000 7f9a2a7fc700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c06d510 tx=0x7f9a2001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.154+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6404c3c0 con 0x7f8a64159b10 2023-10-07T08:58:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7efe8991b700 1 -- 172.21.15.46:0/2874613502 shutdown_connections 2023-10-07T08:58:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7efe8991b700 1 -- 172.21.15.46:0/2874613502 wait complete. 2023-10-07T08:58:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a5401b3b0 con 0x7f8a64159b10 2023-10-07T08:58:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.152+0000 7f55297fd700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5520009930 tx=0x7f5520016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520011ce0 con 0x7f55240697b0 2023-10-07T08:58:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520020070 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.153+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552001b6a0 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.154+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552406d6b0 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.154+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552406b580 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.155+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552406b580 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5520022030 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7f55197fa700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 0x7f55080694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5520086300 con 0x7f55240697b0 2023-10-07T08:58:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.156+0000 7f5528ffc700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 0x7f55080694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.157+0000 7f8a5a7fc700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.157+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a54083d20 con 0x7f8a64159b10 2023-10-07T08:58:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.157+0000 7f8a6a2ab700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.157+0000 7f8a6a2ab700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 0x7f8a480693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009b30 tx=0x7f8a60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.158+0000 7efe8991b700 1 Processor -- start 2023-10-07T08:58:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.158+0000 7efe8991b700 1 -- start start 2023-10-07T08:58:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.158+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200194b0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.158+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20019610 con 0x7f9a2c0cba20 2023-10-07T08:58:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c1581d0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c8c0529c0 con 0x7f5c9c159c60 2023-10-07T08:58:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c0a8080 con 0x7f9a2c0cba20 2023-10-07T08:58:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200199d0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 -- 172.21.15.46:0/3207565493 shutdown_connections 2023-10-07T08:58:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 --2- 172.21.15.46:0/3207565493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff514068aa0 0x7ff514068f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 --2- 172.21.15.46:0/3207565493 >> v2:172.21.15.46:3300/0 conn(0x7ff5140b1f40 0x7ff5140ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 -- 172.21.15.46:0/3207565493 >> 172.21.15.46:0/3207565493 conn(0x7ff5140cd000 msgr2=0x7ff514068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 -- 172.21.15.46:0/3207565493 shutdown_connections 2023-10-07T08:58:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a54051010 con 0x7f8a64159b10 2023-10-07T08:58:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7efe8991b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe8991b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 0x7efe8406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe8991b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe8406f020 0x7efe8413f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe8991b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8406f4c0 con 0x7efe840afc40 2023-10-07T08:58:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe8991b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe841449e0 con 0x7efe840b0010 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe8991b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe841413a0 con 0x7efe8406f020 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60712/0 (socket says 172.21.15.46:60712) 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 -- 172.21.15.46:0/2055554678 learned_addr learned my addr 172.21.15.46:0/2055554678 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe827fc700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 0x7efe8406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe837fe700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe8406f020 0x7efe8413f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 -- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe8406f020 msgr2=0x7efe8413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe8406f020 0x7efe8413f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 -- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 msgr2=0x7efe8406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 0x7efe8406eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe82ffd700 1 -- 172.21.15.46:0/2055554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009ae0 con 0x7efe840afc40 2023-10-07T08:58:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7efe827fc700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 0x7efe8406eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.160+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a20021030 con 0x7f9a2c0cba20 2023-10-07T08:58:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 0x7ffa8c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad370 tx=0x7ffa9000b430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe82ffd700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe7400ec80 tx=0x7efe740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.159+0000 7ff51ab71700 1 -- 172.21.15.46:0/3207565493 wait complete. 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7ff51ab71700 1 Processor -- start 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400c850 con 0x7efe840afc40 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84140300 con 0x7efe840afc40 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400c9b0 con 0x7efe840afc40 2023-10-07T08:58:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400cd50 con 0x7efe840afc40 2023-10-07T08:58:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe841408c0 con 0x7efe840afc40 2023-10-07T08:58:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7ff51ab71700 1 -- start start 2023-10-07T08:58:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7f9a12ffd700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a20014070 con 0x7f9a2c0cba20 2023-10-07T08:58:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.161+0000 7f9a2affd700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7f9a2affd700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c005070 tx=0x7f9a1c000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8404c3c0 con 0x7efe840afc40 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 0x7ff51413f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5140b1f40 0x7ff514175d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514176270 con 0x7ff514159fb0 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514136a30 con 0x7ff514068aa0 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.162+0000 7ff51ab71700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51417a530 con 0x7ff5140b1f40 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51910e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 0x7ff51413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51910e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60714/0 (socket says 172.21.15.46:60714) 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51910e700 1 -- 172.21.15.46:0/1096716344 learned_addr learned my addr 172.21.15.46:0/1096716344 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe74013680 con 0x7efe840afc40 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7efe6affd700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 0x7efe700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe74084ad0 con 0x7efe840afc40 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7efe827fc700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 0x7efe700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff513fff700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5140b1f40 0x7ff514175d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 -- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5140b1f40 msgr2=0x7ff514175d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5140b1f40 0x7ff514175d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 -- 172.21.15.46:0/1096716344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 msgr2=0x7ff5141798c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 -- 172.21.15.46:0/1096716344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009ae0 con 0x7ff514068aa0 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51910e700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.163+0000 7ff51890d700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 0x7ff51413f400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff50000d890 tx=0x7ff500008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.164+0000 7efe827fc700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 0x7efe700693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe84171530 tx=0x7efe78009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.164+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000125f0 con 0x7ff514068aa0 2023-10-07T08:58:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.164+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500012770 con 0x7ff514068aa0 2023-10-07T08:58:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.164+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500012b30 con 0x7ff514068aa0 2023-10-07T08:58:46.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.165+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5141366c0 con 0x7ff514068aa0 2023-10-07T08:58:46.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.165+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c0052b0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.165+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55200535f0 con 0x7f55240697b0 2023-10-07T08:58:46.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.165+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5140ca8f0 con 0x7ff514068aa0 2023-10-07T08:58:46.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.166+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514136520 con 0x7ff514068aa0 2023-10-07T08:58:46.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.166+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff500013480 con 0x7ff514068aa0 2023-10-07T08:58:46.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.167+0000 7ff510ff9700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 0x7ff4f80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.167+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff500084910 con 0x7ff514068aa0 2023-10-07T08:58:46.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.167+0000 7ff513fff700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 0x7ff4f80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.168+0000 7ff513fff700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 0x7ff4f80693b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cc270 tx=0x7ff508009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.171+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe74051e00 con 0x7efe840afc40 2023-10-07T08:58:46.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.177+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff514136520 con 0x7ff514068aa0 2023-10-07T08:58:46.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.179+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a200550a0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.187+0000 7f5528ffc700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 0x7f55080694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5514006fd0 tx=0x7f5514000f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.493+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1784005830 con 0x7f17a4159b20 2023-10-07T08:58:46.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.494+0000 7f17a0ff9700 1 -- 172.21.15.46:0/1676849798 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1798057040 con 0x7f17a4159b20 2023-10-07T08:58:46.498 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 msgr2=0x7f1790069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 0x7f1790069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c009040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 msgr2=0x7f17a4159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 0x7f17a4159f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1798018000 tx=0x7f1798019000 comp rx=0 tx=0).stop 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 shutdown_connections 2023-10-07T08:58:46.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1790067080 0x7f1790069530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17a4159b20 0x7f17a4159f60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40691b0 0x7f17a4147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 --2- 172.21.15.46:0/1676849798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a40875d0 0x7f17a406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.497+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 >> 172.21.15.46:0/1676849798 conn(0x7f17a40cd000 msgr2=0x7f17a415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.498+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 shutdown_connections 2023-10-07T08:58:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.498+0000 7f17aae7f700 1 -- 172.21.15.46:0/1676849798 wait complete. 2023-10-07T08:58:46.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-07T08:58:46.517 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.547+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff514136520 con 0x7ff514068aa0 2023-10-07T08:58:46.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.547+0000 7ff510ff9700 1 -- 172.21.15.46:0/1096716344 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff514136520 con 0x7ff514068aa0 2023-10-07T08:58:46.549 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-10-07T08:58:46.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.550+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 msgr2=0x7ff4f80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.550+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 0x7ff4f80693b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cc270 tx=0x7ff508009060 comp rx=0 tx=0).stop 2023-10-07T08:58:46.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.550+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 msgr2=0x7ff51413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.550+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 0x7ff51413f400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff50000d890 tx=0x7ff500008040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 shutdown_connections 2023-10-07T08:58:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4f8066f00 0x7ff4f80693b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff514159fb0 0x7ff5141798c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff514068aa0 0x7ff51413f400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 --2- 172.21.15.46:0/1096716344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5140b1f40 0x7ff514175d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.551+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 >> 172.21.15.46:0/1096716344 conn(0x7ff5140cd000 msgr2=0x7ff5140aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.562+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f552406b580 con 0x7f55240697b0 2023-10-07T08:58:46.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.562+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 shutdown_connections 2023-10-07T08:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.562+0000 7f55197fa700 1 -- 172.21.15.46:0/1358661871 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5520056c10 con 0x7f55240697b0 2023-10-07T08:58:46.565 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7ff51ab71700 1 -- 172.21.15.46:0/1096716344 wait complete. 2023-10-07T08:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 msgr2=0x7f55080694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 0x7f55080694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5514006fd0 tx=0x7f5514000f90 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 msgr2=0x7f552406b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5520009930 tx=0x7f5520016000 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 shutdown_connections 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5508067000 0x7f55080694b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f552406a400 0x7f552417aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55240697b0 0x7f552406b040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 --2- 172.21.15.46:0/1358661871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5524069b80 0x7f552417a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 >> 172.21.15.46:0/1358661871 conn(0x7f55240d07f0 msgr2=0x7f55240b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 shutdown_connections 2023-10-07T08:58:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7f552ba61700 1 -- 172.21.15.46:0/1358661871 wait complete. 2023-10-07T08:58:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.566+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffaa004c3c0 con 0x7ffaa0068aa0 2023-10-07T08:58:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.567+0000 7ffa87fff700 1 -- 172.21.15.46:0/197060221 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa98056b20 con 0x7ffaa0068aa0 2023-10-07T08:58:46.570 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.571+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 msgr2=0x7ffa8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.571+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 0x7ffa8c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad370 tx=0x7ffa9000b430 comp rx=0 tx=0).stop 2023-10-07T08:58:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.571+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 msgr2=0x7ffaa014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.571+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009880 tx=0x7ffa98018000 comp rx=0 tx=0).stop 2023-10-07T08:58:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.572+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5c9c04c3c0 con 0x7f5c9c159c60 2023-10-07T08:58:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.572+0000 7f5c82ffd700 1 -- 172.21.15.46:0/1698185940 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c8c055fe0 con 0x7f5c9c159c60 2023-10-07T08:58:46.575 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 shutdown_connections 2023-10-07T08:58:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa8c066f30 0x7ffa8c0693e0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad370 tx=0x7ffa9000b430 comp rx=0 tx=0).stop 2023-10-07T08:58:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa00cba20 0x7ffaa00ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa0068aa0 0x7ffaa014a470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 --2- 172.21.15.46:0/197060221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa006f8a0 0x7ffaa00ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.573+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 >> 172.21.15.46:0/197060221 conn(0x7ffaa00cd000 msgr2=0x7ffaa006e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.574+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8a640638e0 con 0x7f8a64159b10 2023-10-07T08:58:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 shutdown_connections 2023-10-07T08:58:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7ffaa6866700 1 -- 172.21.15.46:0/197060221 wait complete. 2023-10-07T08:58:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7f8a5a7fc700 1 -- 172.21.15.46:0/2152993023 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a54054630 con 0x7f8a64159b10 2023-10-07T08:58:46.580 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-10-07T08:58:46.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 msgr2=0x7f5c88069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 0x7f5c88069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007fd0 tx=0x7f5c90009040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 msgr2=0x7f5c9c0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.575+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c013000 tx=0x7f5c8c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 shutdown_connections 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c88066fb0 0x7f5c88069460 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007fd0 tx=0x7f5c90009040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c15db10 0x7f5c9c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c159890 0x7f5c9c153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 --2- 172.21.15.46:0/1698185940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c9c159c60 0x7f5c9c0b3f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.576+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 >> 172.21.15.46:0/1698185940 conn(0x7f5c9c068e20 msgr2=0x7f5c9c0af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.578+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 msgr2=0x7f8a480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.579+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 0x7f8a480693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009b30 tx=0x7f8a60008040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.579+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 msgr2=0x7f8a640c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.579+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 0x7f8a640c1ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c4a0 tx=0x7f8a54007f10 comp rx=0 tx=0).stop 2023-10-07T08:58:46.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.580+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 shutdown_connections 2023-10-07T08:58:46.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.580+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efe840ad310 con 0x7efe840afc40 2023-10-07T08:58:46.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f5ca16ac700 1 -- 172.21.15.46:0/1698185940 wait complete. 2023-10-07T08:58:46.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 shutdown_connections 2023-10-07T08:58:46.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a6415d730 0x7f8a6415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a6406b420 0x7f8a6415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 --2- 172.21.15.46:0/2152993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a64159b10 0x7f8a640c1ba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 >> 172.21.15.46:0/2152993023 conn(0x7f8a640c9870 msgr2=0x7f8a640c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 shutdown_connections 2023-10-07T08:58:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7efe6affd700 1 -- 172.21.15.46:0/2055554678 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe74017090 con 0x7efe840afc40 2023-10-07T08:58:46.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.581+0000 7f8a6c50f700 1 -- 172.21.15.46:0/2152993023 wait complete. 2023-10-07T08:58:46.587 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.587+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a0c005560 con 0x7f9a2c0cba20 2023-10-07T08:58:46.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-07T08:58:46.590 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-07T08:58:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.589+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 msgr2=0x7efe700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.589+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 0x7efe700693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe84171530 tx=0x7efe78009120 comp rx=0 tx=0).stop 2023-10-07T08:58:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.589+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 msgr2=0x7efe841444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.589+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe7400ec80 tx=0x7efe740091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.592 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.590+0000 7f9a12ffd700 1 -- 172.21.15.46:0/1033147348 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a2005e0c0 con 0x7f9a2c0cba20 2023-10-07T08:58:46.592 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-10-07T08:58:46.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 shutdown_connections 2023-10-07T08:58:46.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe70066f30 0x7efe700693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe8406f020 0x7efe8413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe840afc40 0x7efe841444a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 --2- 172.21.15.46:0/2055554678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe840b0010 0x7efe8406eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 >> 172.21.15.46:0/2055554678 conn(0x7efe8406a320 msgr2=0x7efe840ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 shutdown_connections 2023-10-07T08:58:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7efe8991b700 1 -- 172.21.15.46:0/2055554678 wait complete. 2023-10-07T08:58:46.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 msgr2=0x7f9a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c005070 tx=0x7f9a1c000bc0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 msgr2=0x7f9a2c1507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c06d510 tx=0x7f9a2001a000 comp rx=0 tx=0).stop 2023-10-07T08:58:46.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 shutdown_connections 2023-10-07T08:58:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a2c156050 0x7f9a2c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a2c0691b0 0x7f9a2c0a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 --2- 172.21.15.46:0/1033147348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0cba20 0x7f9a2c1507d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 >> 172.21.15.46:0/1033147348 conn(0x7f9a2c0cd000 msgr2=0x7f9a2c154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 shutdown_connections 2023-10-07T08:58:46.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.594+0000 7f9a3186f700 1 -- 172.21.15.46:0/1033147348 wait complete. 2023-10-07T08:58:46.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-07T08:58:46.600 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-07T08:58:46.604 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-07T08:58:46.606 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-07T08:58:46.611 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-07T08:58:46.612 DEBUG:teuthology.parallel:result is None 2023-10-07T08:58:46.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-07T08:58:46.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:58:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.769+0000 7fe153097700 1 Processor -- start 2023-10-07T08:58:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.769+0000 7fe153097700 1 -- start start 2023-10-07T08:58:46.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe153097700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe14c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe153097700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c15d7e0 con 0x7fe14c06bcd0 2023-10-07T08:58:46.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe153097700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c15dac0 con 0x7fe14c15df50 2023-10-07T08:58:46.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe153097700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c15aa30 con 0x7fe14c06c0a0 2023-10-07T08:58:46.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe150e33700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe14c06bcd0 0x7fe14c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54800/0 (socket says 172.21.15.46:54800) 2023-10-07T08:58:46.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.770+0000 7fe150e33700 1 -- 172.21.15.46:0/3533259945 learned_addr learned my addr 172.21.15.46:0/3533259945 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:46.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395224856 0 0) 0x7fe14c15d7e0 con 0x7fe14c06bcd0 2023-10-07T08:58:46.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe138003570 con 0x7fe14c06bcd0 2023-10-07T08:58:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe14c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839534310 0 0) 0x7fe138003570 con 0x7fe14c06bcd0 2023-10-07T08:58:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 msgr2=0x7fe14c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe14c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 >> v1:172.21.15.133:6789/0 conn(0x7fe14c15df50 legacy=0x7fe14c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c15ad10 con 0x7fe14c06bcd0 2023-10-07T08:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fe144001470 con 0x7fe14c06bcd0 2023-10-07T08:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 >> v1:172.21.15.46:6789/0 conn(0x7fe14c06bcd0 legacy=0x7fe14c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe138003a90 0x7fe138003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe138004810 0x7fe138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe138005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c15aa30 con 0x7fe138004810 2023-10-07T08:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13800bc20 con 0x7fe138003a90 2023-10-07T08:58:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13800bde0 con 0x7fe14c06c0a0 2023-10-07T08:58:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe138004810 0x7fe138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe150e33700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe138003a90 0x7fe138003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe151634700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe138005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 -- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 msgr2=0x7fe138005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c06c0a0 0x7fe138005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 -- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe138003a90 msgr2=0x7fe138003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe138003a90 0x7fe138003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 -- 172.21.15.46:0/3533259945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138003570 con 0x7fe138004810 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.771+0000 7fe14bfff700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe138004810 0x7fe138004c80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0094d0 tx=0x7fe13c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85c7df87f3653d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00ea90 con 0x7fe138004810 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00f040 con 0x7fe138004810 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe14b7fe700 1 -- 172.21.15.46:0/3533259945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00ee40 con 0x7fe138004810 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 -- 172.21.15.46:0/3533259945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe138004810 msgr2=0x7fe138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 --2- 172.21.15.46:0/3533259945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe138004810 0x7fe138004c80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0094d0 tx=0x7fe13c00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe151634700 1 -- 172.21.15.46:0/3533259945 reap_dead start 2023-10-07T08:58:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 -- 172.21.15.46:0/3533259945 shutdown_connections 2023-10-07T08:58:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 -- 172.21.15.46:0/3533259945 >> 172.21.15.46:0/3533259945 conn(0x7fe14c0ce600 msgr2=0x7fe14c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 -- 172.21.15.46:0/3533259945 shutdown_connections 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.772+0000 7fe153097700 1 -- 172.21.15.46:0/3533259945 wait complete. 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.773+0000 7fe153097700 1 Processor -- start 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.773+0000 7fe153097700 1 -- start start 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe138004810 0x7fe14c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c0c8700 0x7fe14c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b3de0 con 0x7fe14c0c8b70 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b31d0 con 0x7fe14c0c8700 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe153097700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b34b0 con 0x7fe138004810 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60720/0 (socket says 172.21.15.46:60720) 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 -- 172.21.15.46:0/2304822292 learned_addr learned my addr 172.21.15.46:0/2304822292 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe14bfff700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c0c8700 0x7fe14c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe150e33700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe138004810 0x7fe14c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 -- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe138004810 msgr2=0x7fe14c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe138004810 0x7fe14c1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 -- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c0c8700 msgr2=0x7fe14c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c0c8700 0x7fe14c0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.774+0000 7fe151634700 1 -- 172.21.15.46:0/2304822292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0b3790 con 0x7fe14c0c8b70 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe151634700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06b640 tx=0x7fe134007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134006a30 con 0x7fe14c0c8b70 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134006bb0 con 0x7fe14c0c8b70 2023-10-07T08:58:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0b3a70 con 0x7fe14c0c8b70 2023-10-07T08:58:46.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134007030 con 0x7fe14c0c8b70 2023-10-07T08:58:46.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.775+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c0b2d80 con 0x7fe14c0c8b70 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.776+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0648d0 con 0x7fe14c0c8b70 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.776+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1340073a0 con 0x7fe14c0c8b70 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.777+0000 7fe148ff9700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.777+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe134083c60 con 0x7fe14c0c8b70 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.777+0000 7fe150e33700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.777+0000 7fe150e33700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe144000c00 tx=0x7fe14c0ce4d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:46.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.782+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe134050ed0 con 0x7fe14c0c8b70 2023-10-07T08:58:46.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.967+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe14c04c3c0 con 0x7fe12c066f30 2023-10-07T08:58:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.975+0000 7fe148ff9700 1 -- 172.21.15.46:0/2304822292 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264517 (secure 0 0 0) 0x7fe14c04c3c0 con 0x7fe12c066f30 2023-10-07T08:58:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:46.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 msgr2=0x7fe12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe144000c00 tx=0x7fe14c0ce4d0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 msgr2=0x7fe14c0c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:46.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06b640 tx=0x7fe134007d30 comp rx=0 tx=0).stop 2023-10-07T08:58:46.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 shutdown_connections 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c8b70 0x7fe14c0c48b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe138004810 0x7fe14c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 --2- 172.21.15.46:0/2304822292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c0c8700 0x7fe14c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.978+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 >> 172.21.15.46:0/2304822292 conn(0x7fe14c0ce600 msgr2=0x7fe14c1560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.979+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 shutdown_connections 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:46.979+0000 7fe153097700 1 -- 172.21.15.46:0/2304822292 wait complete. 2023-10-07T08:58:46.982 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:58:46.991 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-07T08:58:45.763502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002063"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269469+0000","last_change":"2023-10-07T08:58:38.267255+0000","last_active":"2023-10-07T08:58:38.269469+0000","last_peered":"2023-10-07T08:58:38.269469+0000","last_clean":"2023-10-07T08:58:38.269469+0000","last_became_active":"2023-10-07T08:58:38.266659+0000","last_became_peered":"2023-10-07T08:58:38.266659+0000","last_unstale":"2023-10-07T08:58:38.269469+0000","last_undegraded":"2023-10-07T08:58:38.269469+0000","last_fullsized":"2023-10-07T08:58:38.269469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271311+0000","last_change":"2023-10-07T08:58:38.267764+0000","last_active":"2023-10-07T08:58:38.271311+0000","last_peered":"2023-10-07T08:58:38.271311+0000","last_clean":"2023-10-07T08:58:38.271311+0000","last_became_active":"2023-10-07T08:58:38.267465+0000","last_became_peered":"2023-10-07T08:58:38.267465+0000","last_unstale":"2023-10-07T08:58:38.271311+0000","last_undegraded":"2023-10-07T08:58:38.271311+0000","last_fullsized":"2023-10-07T08:58:38.271311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277699+0000","last_change":"2023-10-07T08:58:38.266617+0000","last_active":"2023-10-07T08:58:38.277699+0000","last_peered":"2023-10-07T08:58:38.277699+0000","last_clean":"2023-10-07T08:58:38.277699+0000","last_became_active":"2023-10-07T08:58:38.266163+0000","last_became_peered":"2023-10-07T08:58:38.266163+0000","last_unstale":"2023-10-07T08:58:38.277699+0000","last_undegraded":"2023-10-07T08:58:38.277699+0000","last_fullsized":"2023-10-07T08:58:38.277699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267216+0000","last_change":"2023-10-07T08:58:38.263351+0000","last_active":"2023-10-07T08:58:38.267216+0000","last_peered":"2023-10-07T08:58:38.267216+0000","last_clean":"2023-10-07T08:58:38.267216+0000","last_became_active":"2023-10-07T08:58:38.262967+0000","last_became_peered":"2023-10-07T08:58:38.262967+0000","last_unstale":"2023-10-07T08:58:38.267216+0000","last_undegraded":"2023-10-07T08:58:38.267216+0000","last_fullsized":"2023-10-07T08:58:38.267216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268506+0000","last_change":"2023-10-07T08:58:38.266316+0000","last_active":"2023-10-07T08:58:38.268506+0000","last_peered":"2023-10-07T08:58:38.268506+0000","last_clean":"2023-10-07T08:58:38.268506+0000","last_became_active":"2023-10-07T08:58:38.266017+0000","last_became_peered":"2023-10-07T08:58:38.266017+0000","last_unstale":"2023-10-07T08:58:38.268506+0000","last_undegraded":"2023-10-07T08:58:38.268506+0000","last_fullsized":"2023-10-07T08:58:38.268506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283688+0000","last_change":"2023-10-07T08:58:38.278399+0000","last_active":"2023-10-07T08:58:38.283688+0000","last_peered":"2023-10-07T08:58:38.283688+0000","last_clean":"2023-10-07T08:58:38.283688+0000","last_became_active":"2023-10-07T08:58:38.278131+0000","last_became_peered":"2023-10-07T08:58:38.278131+0000","last_unstale":"2023-10-07T08:58:38.283688+0000","last_undegraded":"2023-10-07T08:58:38.283688+0000","last_fullsized":"2023-10-07T08:58:38.283688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278620+0000","last_change":"2023-10-07T08:58:38.274141+0000","last_active":"2023-10-07T08:58:38.278620+0000","last_peered":"2023-10-07T08:58:38.278620+0000","last_clean":"2023-10-07T08:58:38.278620+0000","last_became_active":"2023-10-07T08:58:38.273855+0000","last_became_peered":"2023-10-07T08:58:38.273855+0000","last_unstale":"2023-10-07T08:58:38.278620+0000","last_undegraded":"2023-10-07T08:58:38.278620+0000","last_fullsized":"2023-10-07T08:58:38.278620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280682+0000","last_change":"2023-10-07T08:58:38.270600+0000","last_active":"2023-10-07T08:58:38.280682+0000","last_peered":"2023-10-07T08:58:38.280682+0000","last_clean":"2023-10-07T08:58:38.280682+0000","last_became_active":"2023-10-07T08:58:38.270310+0000","last_became_peered":"2023-10-07T08:58:38.270310+0000","last_unstale":"2023-10-07T08:58:38.280682+0000","last_undegraded":"2023-10-07T08:58:38.280682+0000","last_fullsized":"2023-10-07T08:58:38.280682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269449+0000","last_change":"2023-10-07T08:58:38.267490+0000","last_active":"2023-10-07T08:58:38.269449+0000","last_peered":"2023-10-07T08:58:38.269449+0000","last_clean":"2023-10-07T08:58:38.269449+0000","last_became_active":"2023-10-07T08:58:38.267089+0000","last_became_peered":"2023-10-07T08:58:38.267089+0000","last_unstale":"2023-10-07T08:58:38.269449+0000","last_undegraded":"2023-10-07T08:58:38.269449+0000","last_fullsized":"2023-10-07T08:58:38.269449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270528+0000","last_change":"2023-10-07T08:58:38.267172+0000","last_active":"2023-10-07T08:58:38.270528+0000","last_peered":"2023-10-07T08:58:38.270528+0000","last_clean":"2023-10-07T08:58:38.270528+0000","last_became_active":"2023-10-07T08:58:38.266880+0000","last_became_peered":"2023-10-07T08:58:38.266880+0000","last_unstale":"2023-10-07T08:58:38.270528+0000","last_undegraded":"2023-10-07T08:58:38.270528+0000","last_fullsized":"2023-10-07T08:58:38.270528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270070+0000","last_change":"2023-10-07T08:58:38.267001+0000","last_active":"2023-10-07T08:58:38.270070+0000","last_peered":"2023-10-07T08:58:38.270070+0000","last_clean":"2023-10-07T08:58:38.270070+0000","last_became_active":"2023-10-07T08:58:38.266492+0000","last_became_peered":"2023-10-07T08:58:38.266492+0000","last_unstale":"2023-10-07T08:58:38.270070+0000","last_undegraded":"2023-10-07T08:58:38.270070+0000","last_fullsized":"2023-10-07T08:58:38.270070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273887+0000","last_change":"2023-10-07T08:58:38.264386+0000","last_active":"2023-10-07T08:58:38.273887+0000","last_peered":"2023-10-07T08:58:38.273887+0000","last_clean":"2023-10-07T08:58:38.273887+0000","last_became_active":"2023-10-07T08:58:38.264124+0000","last_became_peered":"2023-10-07T08:58:38.264124+0000","last_unstale":"2023-10-07T08:58:38.273887+0000","last_undegraded":"2023-10-07T08:58:38.273887+0000","last_fullsized":"2023-10-07T08:58:38.273887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:30.530699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276582+0000","last_change":"2023-10-07T08:58:38.263696+0000","last_active":"2023-10-07T08:58:38.276582+0000","last_peered":"2023-10-07T08:58:38.276582+0000","last_clean":"2023-10-07T08:58:38.276582+0000","last_became_active":"2023-10-07T08:58:38.263363+0000","last_became_peered":"2023-10-07T08:58:38.263363+0000","last_unstale":"2023-10-07T08:58:38.276582+0000","last_undegraded":"2023-10-07T08:58:38.276582+0000","last_fullsized":"2023-10-07T08:58:38.276582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277744+0000","last_change":"2023-10-07T08:58:38.267349+0000","last_active":"2023-10-07T08:58:38.277744+0000","last_peered":"2023-10-07T08:58:38.277744+0000","last_clean":"2023-10-07T08:58:38.277744+0000","last_became_active":"2023-10-07T08:58:38.266917+0000","last_became_peered":"2023-10-07T08:58:38.266917+0000","last_unstale":"2023-10-07T08:58:38.277744+0000","last_undegraded":"2023-10-07T08:58:38.277744+0000","last_fullsized":"2023-10-07T08:58:38.277744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:59.205812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.262424+0000","last_change":"2023-10-07T08:58:38.259339+0000","last_active":"2023-10-07T08:58:38.262424+0000","last_peered":"2023-10-07T08:58:38.262424+0000","last_clean":"2023-10-07T08:58:38.262424+0000","last_became_active":"2023-10-07T08:58:38.258971+0000","last_became_peered":"2023-10-07T08:58:38.258971+0000","last_unstale":"2023-10-07T08:58:38.262424+0000","last_undegraded":"2023-10-07T08:58:38.262424+0000","last_fullsized":"2023-10-07T08:58:38.262424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283660+0000","last_change":"2023-10-07T08:58:38.278767+0000","last_active":"2023-10-07T08:58:38.283660+0000","last_peered":"2023-10-07T08:58:38.283660+0000","last_clean":"2023-10-07T08:58:38.283660+0000","last_became_active":"2023-10-07T08:58:38.278528+0000","last_became_peered":"2023-10-07T08:58:38.278528+0000","last_unstale":"2023-10-07T08:58:38.283660+0000","last_undegraded":"2023-10-07T08:58:38.283660+0000","last_fullsized":"2023-10-07T08:58:38.283660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273609+0000","last_change":"2023-10-07T08:58:38.269363+0000","last_active":"2023-10-07T08:58:38.273609+0000","last_peered":"2023-10-07T08:58:38.273609+0000","last_clean":"2023-10-07T08:58:38.273609+0000","last_became_active":"2023-10-07T08:58:38.269065+0000","last_became_peered":"2023-10-07T08:58:38.269065+0000","last_unstale":"2023-10-07T08:58:38.273609+0000","last_undegraded":"2023-10-07T08:58:38.273609+0000","last_fullsized":"2023-10-07T08:58:38.273609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272204+0000","last_change":"2023-10-07T08:58:38.269575+0000","last_active":"2023-10-07T08:58:38.272204+0000","last_peered":"2023-10-07T08:58:38.272204+0000","last_clean":"2023-10-07T08:58:38.272204+0000","last_became_active":"2023-10-07T08:58:38.268895+0000","last_became_peered":"2023-10-07T08:58:38.268895+0000","last_unstale":"2023-10-07T08:58:38.272204+0000","last_undegraded":"2023-10-07T08:58:38.272204+0000","last_fullsized":"2023-10-07T08:58:38.272204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:32.828536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269484+0000","last_change":"2023-10-07T08:58:38.267862+0000","last_active":"2023-10-07T08:58:38.269484+0000","last_peered":"2023-10-07T08:58:38.269484+0000","last_clean":"2023-10-07T08:58:38.269484+0000","last_became_active":"2023-10-07T08:58:38.267577+0000","last_became_peered":"2023-10-07T08:58:38.267577+0000","last_unstale":"2023-10-07T08:58:38.269484+0000","last_undegraded":"2023-10-07T08:58:38.269484+0000","last_fullsized":"2023-10-07T08:58:38.269484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284044+0000","last_change":"2023-10-07T08:58:37.268088+0000","last_active":"2023-10-07T08:58:38.284044+0000","last_peered":"2023-10-07T08:58:38.284044+0000","last_clean":"2023-10-07T08:58:38.284044+0000","last_became_active":"2023-10-07T08:58:37.267728+0000","last_became_peered":"2023-10-07T08:58:37.267728+0000","last_unstale":"2023-10-07T08:58:38.284044+0000","last_undegraded":"2023-10-07T08:58:38.284044+0000","last_fullsized":"2023-10-07T08:58:38.284044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:45.288025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280531+0000","last_change":"2023-10-07T08:58:38.268443+0000","last_active":"2023-10-07T08:58:38.280531+0000","last_peered":"2023-10-07T08:58:38.280531+0000","last_clean":"2023-10-07T08:58:38.280531+0000","last_became_active":"2023-10-07T08:58:38.268155+0000","last_became_peered":"2023-10-07T08:58:38.268155+0000","last_unstale":"2023-10-07T08:58:38.280531+0000","last_undegraded":"2023-10-07T08:58:38.280531+0000","last_fullsized":"2023-10-07T08:58:38.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280882+0000","last_change":"2023-10-07T08:58:37.269548+0000","last_active":"2023-10-07T08:58:38.280882+0000","last_peered":"2023-10-07T08:58:38.280882+0000","last_clean":"2023-10-07T08:58:38.280882+0000","last_became_active":"2023-10-07T08:58:37.266826+0000","last_became_peered":"2023-10-07T08:58:37.266826+0000","last_unstale":"2023-10-07T08:58:38.280882+0000","last_undegraded":"2023-10-07T08:58:38.280882+0000","last_fullsized":"2023-10-07T08:58:38.280882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:35.767431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279027+0000","last_change":"2023-10-07T08:58:38.272914+0000","last_active":"2023-10-07T08:58:38.279027+0000","last_peered":"2023-10-07T08:58:38.279027+0000","last_clean":"2023-10-07T08:58:38.279027+0000","last_became_active":"2023-10-07T08:58:38.269972+0000","last_became_peered":"2023-10-07T08:58:38.269972+0000","last_unstale":"2023-10-07T08:58:38.279027+0000","last_undegraded":"2023-10-07T08:58:38.279027+0000","last_fullsized":"2023-10-07T08:58:38.279027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283986+0000","last_change":"2023-10-07T08:58:37.266654+0000","last_active":"2023-10-07T08:58:38.283986+0000","last_peered":"2023-10-07T08:58:38.283986+0000","last_clean":"2023-10-07T08:58:38.283986+0000","last_became_active":"2023-10-07T08:58:37.266400+0000","last_became_peered":"2023-10-07T08:58:37.266400+0000","last_unstale":"2023-10-07T08:58:38.283986+0000","last_undegraded":"2023-10-07T08:58:38.283986+0000","last_fullsized":"2023-10-07T08:58:38.283986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.824130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273578+0000","last_change":"2023-10-07T08:58:38.266906+0000","last_active":"2023-10-07T08:58:38.273578+0000","last_peered":"2023-10-07T08:58:38.273578+0000","last_clean":"2023-10-07T08:58:38.273578+0000","last_became_active":"2023-10-07T08:58:38.266625+0000","last_became_peered":"2023-10-07T08:58:38.266625+0000","last_unstale":"2023-10-07T08:58:38.273578+0000","last_undegraded":"2023-10-07T08:58:38.273578+0000","last_fullsized":"2023-10-07T08:58:38.273578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283998+0000","last_change":"2023-10-07T08:58:37.270622+0000","last_active":"2023-10-07T08:58:38.283998+0000","last_peered":"2023-10-07T08:58:38.283998+0000","last_clean":"2023-10-07T08:58:38.283998+0000","last_became_active":"2023-10-07T08:58:37.270351+0000","last_became_peered":"2023-10-07T08:58:37.270351+0000","last_unstale":"2023-10-07T08:58:38.283998+0000","last_undegraded":"2023-10-07T08:58:38.283998+0000","last_fullsized":"2023-10-07T08:58:38.283998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274092+0000","last_change":"2023-10-07T08:58:38.273162+0000","last_active":"2023-10-07T08:58:38.274092+0000","last_peered":"2023-10-07T08:58:38.274092+0000","last_clean":"2023-10-07T08:58:38.274092+0000","last_became_active":"2023-10-07T08:58:38.272826+0000","last_became_peered":"2023-10-07T08:58:38.272826+0000","last_unstale":"2023-10-07T08:58:38.274092+0000","last_undegraded":"2023-10-07T08:58:38.274092+0000","last_fullsized":"2023-10-07T08:58:38.274092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280732+0000","last_change":"2023-10-07T08:58:37.271548+0000","last_active":"2023-10-07T08:58:38.280732+0000","last_peered":"2023-10-07T08:58:38.280732+0000","last_clean":"2023-10-07T08:58:38.280732+0000","last_became_active":"2023-10-07T08:58:37.271240+0000","last_became_peered":"2023-10-07T08:58:37.271240+0000","last_unstale":"2023-10-07T08:58:38.280732+0000","last_undegraded":"2023-10-07T08:58:38.280732+0000","last_fullsized":"2023-10-07T08:58:38.280732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269827+0000","last_change":"2023-10-07T08:58:38.260549+0000","last_active":"2023-10-07T08:58:38.269827+0000","last_peered":"2023-10-07T08:58:38.269827+0000","last_clean":"2023-10-07T08:58:38.269827+0000","last_became_active":"2023-10-07T08:58:38.260271+0000","last_became_peered":"2023-10-07T08:58:38.260271+0000","last_unstale":"2023-10-07T08:58:38.269827+0000","last_undegraded":"2023-10-07T08:58:38.269827+0000","last_fullsized":"2023-10-07T08:58:38.269827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:53.298964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284294+0000","last_change":"2023-10-07T08:58:37.263334+0000","last_active":"2023-10-07T08:58:38.284294+0000","last_peered":"2023-10-07T08:58:38.284294+0000","last_clean":"2023-10-07T08:58:38.284294+0000","last_became_active":"2023-10-07T08:58:37.263022+0000","last_became_peered":"2023-10-07T08:58:37.263022+0000","last_unstale":"2023-10-07T08:58:38.284294+0000","last_undegraded":"2023-10-07T08:58:38.284294+0000","last_fullsized":"2023-10-07T08:58:38.284294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279664+0000","last_change":"2023-10-07T08:58:38.274587+0000","last_active":"2023-10-07T08:58:38.279664+0000","last_peered":"2023-10-07T08:58:38.279664+0000","last_clean":"2023-10-07T08:58:38.279664+0000","last_became_active":"2023-10-07T08:58:38.273574+0000","last_became_peered":"2023-10-07T08:58:38.273574+0000","last_unstale":"2023-10-07T08:58:38.279664+0000","last_undegraded":"2023-10-07T08:58:38.279664+0000","last_fullsized":"2023-10-07T08:58:38.279664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.254378+0000","last_change":"2023-10-07T08:58:37.267552+0000","last_active":"2023-10-07T08:58:38.254378+0000","last_peered":"2023-10-07T08:58:38.254378+0000","last_clean":"2023-10-07T08:58:38.254378+0000","last_became_active":"2023-10-07T08:58:37.266917+0000","last_became_peered":"2023-10-07T08:58:37.266917+0000","last_unstale":"2023-10-07T08:58:38.254378+0000","last_undegraded":"2023-10-07T08:58:38.254378+0000","last_fullsized":"2023-10-07T08:58:38.254378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276934+0000","last_change":"2023-10-07T08:58:38.264169+0000","last_active":"2023-10-07T08:58:38.276934+0000","last_peered":"2023-10-07T08:58:38.276934+0000","last_clean":"2023-10-07T08:58:38.276934+0000","last_became_active":"2023-10-07T08:58:38.263551+0000","last_became_peered":"2023-10-07T08:58:38.263551+0000","last_unstale":"2023-10-07T08:58:38.276934+0000","last_undegraded":"2023-10-07T08:58:38.276934+0000","last_fullsized":"2023-10-07T08:58:38.276934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.258346+0000","last_change":"2023-10-07T08:58:37.259060+0000","last_active":"2023-10-07T08:58:38.258346+0000","last_peered":"2023-10-07T08:58:38.258346+0000","last_clean":"2023-10-07T08:58:38.258346+0000","last_became_active":"2023-10-07T08:58:37.258771+0000","last_became_peered":"2023-10-07T08:58:37.258771+0000","last_unstale":"2023-10-07T08:58:38.258346+0000","last_undegraded":"2023-10-07T08:58:38.258346+0000","last_fullsized":"2023-10-07T08:58:38.258346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265345+0000","last_change":"2023-10-07T08:58:38.262529+0000","last_active":"2023-10-07T08:58:38.265345+0000","last_peered":"2023-10-07T08:58:38.265345+0000","last_clean":"2023-10-07T08:58:38.265345+0000","last_became_active":"2023-10-07T08:58:38.262257+0000","last_became_peered":"2023-10-07T08:58:38.262257+0000","last_unstale":"2023-10-07T08:58:38.265345+0000","last_undegraded":"2023-10-07T08:58:38.265345+0000","last_fullsized":"2023-10-07T08:58:38.265345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259709+0000","last_change":"2023-10-07T08:58:37.269527+0000","last_active":"2023-10-07T08:58:38.259709+0000","last_peered":"2023-10-07T08:58:38.259709+0000","last_clean":"2023-10-07T08:58:38.259709+0000","last_became_active":"2023-10-07T08:58:37.269253+0000","last_became_peered":"2023-10-07T08:58:37.269253+0000","last_unstale":"2023-10-07T08:58:38.259709+0000","last_undegraded":"2023-10-07T08:58:38.259709+0000","last_fullsized":"2023-10-07T08:58:38.259709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273467+0000","last_change":"2023-10-07T08:58:38.268883+0000","last_active":"2023-10-07T08:58:38.273467+0000","last_peered":"2023-10-07T08:58:38.273467+0000","last_clean":"2023-10-07T08:58:38.273467+0000","last_became_active":"2023-10-07T08:58:38.268618+0000","last_became_peered":"2023-10-07T08:58:38.268618+0000","last_unstale":"2023-10-07T08:58:38.273467+0000","last_undegraded":"2023-10-07T08:58:38.273467+0000","last_fullsized":"2023-10-07T08:58:38.273467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.258019+0000","last_change":"2023-10-07T08:58:37.268203+0000","last_active":"2023-10-07T08:58:38.258019+0000","last_peered":"2023-10-07T08:58:38.258019+0000","last_clean":"2023-10-07T08:58:38.258019+0000","last_became_active":"2023-10-07T08:58:37.267942+0000","last_became_peered":"2023-10-07T08:58:37.267942+0000","last_unstale":"2023-10-07T08:58:38.258019+0000","last_undegraded":"2023-10-07T08:58:38.258019+0000","last_fullsized":"2023-10-07T08:58:38.258019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279006+0000","last_change":"2023-10-07T08:58:38.272764+0000","last_active":"2023-10-07T08:58:38.279006+0000","last_peered":"2023-10-07T08:58:38.279006+0000","last_clean":"2023-10-07T08:58:38.279006+0000","last_became_active":"2023-10-07T08:58:38.267664+0000","last_became_peered":"2023-10-07T08:58:38.267664+0000","last_unstale":"2023-10-07T08:58:38.279006+0000","last_undegraded":"2023-10-07T08:58:38.279006+0000","last_fullsized":"2023-10-07T08:58:38.279006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284633+0000","last_change":"2023-10-07T08:58:37.263922+0000","last_active":"2023-10-07T08:58:38.284633+0000","last_peered":"2023-10-07T08:58:38.284633+0000","last_clean":"2023-10-07T08:58:38.284633+0000","last_became_active":"2023-10-07T08:58:37.263582+0000","last_became_peered":"2023-10-07T08:58:37.263582+0000","last_unstale":"2023-10-07T08:58:38.284633+0000","last_undegraded":"2023-10-07T08:58:38.284633+0000","last_fullsized":"2023-10-07T08:58:38.284633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273905+0000","last_change":"2023-10-07T08:58:38.265834+0000","last_active":"2023-10-07T08:58:38.273905+0000","last_peered":"2023-10-07T08:58:38.273905+0000","last_clean":"2023-10-07T08:58:38.273905+0000","last_became_active":"2023-10-07T08:58:38.265379+0000","last_became_peered":"2023-10-07T08:58:38.265379+0000","last_unstale":"2023-10-07T08:58:38.273905+0000","last_undegraded":"2023-10-07T08:58:38.273905+0000","last_fullsized":"2023-10-07T08:58:38.273905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:15.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.286423+0000","last_change":"2023-10-07T08:58:37.268160+0000","last_active":"2023-10-07T08:58:38.286423+0000","last_peered":"2023-10-07T08:58:38.286423+0000","last_clean":"2023-10-07T08:58:38.286423+0000","last_became_active":"2023-10-07T08:58:37.267825+0000","last_became_peered":"2023-10-07T08:58:37.267825+0000","last_unstale":"2023-10-07T08:58:38.286423+0000","last_undegraded":"2023-10-07T08:58:38.286423+0000","last_fullsized":"2023-10-07T08:58:38.286423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276370+0000","last_change":"2023-10-07T08:58:38.271252+0000","last_active":"2023-10-07T08:58:38.276370+0000","last_peered":"2023-10-07T08:58:38.276370+0000","last_clean":"2023-10-07T08:58:38.276370+0000","last_became_active":"2023-10-07T08:58:38.270444+0000","last_became_peered":"2023-10-07T08:58:38.270444+0000","last_unstale":"2023-10-07T08:58:38.276370+0000","last_undegraded":"2023-10-07T08:58:38.276370+0000","last_fullsized":"2023-10-07T08:58:38.276370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284697+0000","last_change":"2023-10-07T08:58:37.265067+0000","last_active":"2023-10-07T08:58:38.284697+0000","last_peered":"2023-10-07T08:58:38.284697+0000","last_clean":"2023-10-07T08:58:38.284697+0000","last_became_active":"2023-10-07T08:58:37.264758+0000","last_became_peered":"2023-10-07T08:58:37.264758+0000","last_unstale":"2023-10-07T08:58:38.284697+0000","last_undegraded":"2023-10-07T08:58:38.284697+0000","last_fullsized":"2023-10-07T08:58:38.284697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.165187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278973+0000","last_change":"2023-10-07T08:58:38.273936+0000","last_active":"2023-10-07T08:58:38.278973+0000","last_peered":"2023-10-07T08:58:38.278973+0000","last_clean":"2023-10-07T08:58:38.278973+0000","last_became_active":"2023-10-07T08:58:38.267851+0000","last_became_peered":"2023-10-07T08:58:38.267851+0000","last_unstale":"2023-10-07T08:58:38.278973+0000","last_undegraded":"2023-10-07T08:58:38.278973+0000","last_fullsized":"2023-10-07T08:58:38.278973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:27.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257448+0000","last_change":"2023-10-07T08:58:37.266407+0000","last_active":"2023-10-07T08:58:38.257448+0000","last_peered":"2023-10-07T08:58:38.257448+0000","last_clean":"2023-10-07T08:58:38.257448+0000","last_became_active":"2023-10-07T08:58:37.266126+0000","last_became_peered":"2023-10-07T08:58:37.266126+0000","last_unstale":"2023-10-07T08:58:38.257448+0000","last_undegraded":"2023-10-07T08:58:38.257448+0000","last_fullsized":"2023-10-07T08:58:38.257448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280719+0000","last_change":"2023-10-07T08:58:38.278017+0000","last_active":"2023-10-07T08:58:38.280719+0000","last_peered":"2023-10-07T08:58:38.280719+0000","last_clean":"2023-10-07T08:58:38.280719+0000","last_became_active":"2023-10-07T08:58:38.277742+0000","last_became_peered":"2023-10-07T08:58:38.277742+0000","last_unstale":"2023-10-07T08:58:38.280719+0000","last_undegraded":"2023-10-07T08:58:38.280719+0000","last_fullsized":"2023-10-07T08:58:38.280719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259606+0000","last_change":"2023-10-07T08:58:37.264042+0000","last_active":"2023-10-07T08:58:38.259606+0000","last_peered":"2023-10-07T08:58:38.259606+0000","last_clean":"2023-10-07T08:58:38.259606+0000","last_became_active":"2023-10-07T08:58:37.263461+0000","last_became_peered":"2023-10-07T08:58:37.263461+0000","last_unstale":"2023-10-07T08:58:38.259606+0000","last_undegraded":"2023-10-07T08:58:38.259606+0000","last_fullsized":"2023-10-07T08:58:38.259606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283682+0000","last_change":"2023-10-07T08:58:38.276672+0000","last_active":"2023-10-07T08:58:38.283682+0000","last_peered":"2023-10-07T08:58:38.283682+0000","last_clean":"2023-10-07T08:58:38.283682+0000","last_became_active":"2023-10-07T08:58:38.275867+0000","last_became_peered":"2023-10-07T08:58:38.275867+0000","last_unstale":"2023-10-07T08:58:38.283682+0000","last_undegraded":"2023-10-07T08:58:38.283682+0000","last_fullsized":"2023-10-07T08:58:38.283682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278091+0000","last_change":"2023-10-07T08:58:37.259625+0000","last_active":"2023-10-07T08:58:38.278091+0000","last_peered":"2023-10-07T08:58:38.278091+0000","last_clean":"2023-10-07T08:58:38.278091+0000","last_became_active":"2023-10-07T08:58:37.259284+0000","last_became_peered":"2023-10-07T08:58:37.259284+0000","last_unstale":"2023-10-07T08:58:38.278091+0000","last_undegraded":"2023-10-07T08:58:38.278091+0000","last_fullsized":"2023-10-07T08:58:38.278091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274030+0000","last_change":"2023-10-07T08:58:38.271932+0000","last_active":"2023-10-07T08:58:38.274030+0000","last_peered":"2023-10-07T08:58:38.274030+0000","last_clean":"2023-10-07T08:58:38.274030+0000","last_became_active":"2023-10-07T08:58:38.271668+0000","last_became_peered":"2023-10-07T08:58:38.271668+0000","last_unstale":"2023-10-07T08:58:38.274030+0000","last_undegraded":"2023-10-07T08:58:38.274030+0000","last_fullsized":"2023-10-07T08:58:38.274030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284462+0000","last_change":"2023-10-07T08:58:37.262301+0000","last_active":"2023-10-07T08:58:38.284462+0000","last_peered":"2023-10-07T08:58:38.284462+0000","last_clean":"2023-10-07T08:58:38.284462+0000","last_became_active":"2023-10-07T08:58:37.262025+0000","last_became_peered":"2023-10-07T08:58:37.262025+0000","last_unstale":"2023-10-07T08:58:38.284462+0000","last_undegraded":"2023-10-07T08:58:38.284462+0000","last_fullsized":"2023-10-07T08:58:38.284462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:08.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275951+0000","last_change":"2023-10-07T08:58:38.272054+0000","last_active":"2023-10-07T08:58:38.275951+0000","last_peered":"2023-10-07T08:58:38.275951+0000","last_clean":"2023-10-07T08:58:38.275951+0000","last_became_active":"2023-10-07T08:58:38.271783+0000","last_became_peered":"2023-10-07T08:58:38.271783+0000","last_unstale":"2023-10-07T08:58:38.275951+0000","last_undegraded":"2023-10-07T08:58:38.275951+0000","last_fullsized":"2023-10-07T08:58:38.275951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251812+0000","last_change":"2023-10-07T08:58:37.270177+0000","last_active":"2023-10-07T08:58:38.251812+0000","last_peered":"2023-10-07T08:58:38.251812+0000","last_clean":"2023-10-07T08:58:38.251812+0000","last_became_active":"2023-10-07T08:58:37.269889+0000","last_became_peered":"2023-10-07T08:58:37.269889+0000","last_unstale":"2023-10-07T08:58:38.251812+0000","last_undegraded":"2023-10-07T08:58:38.251812+0000","last_fullsized":"2023-10-07T08:58:38.251812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273010+0000","last_change":"2023-10-07T08:58:38.265632+0000","last_active":"2023-10-07T08:58:38.273010+0000","last_peered":"2023-10-07T08:58:38.273010+0000","last_clean":"2023-10-07T08:58:38.273010+0000","last_became_active":"2023-10-07T08:58:38.265352+0000","last_became_peered":"2023-10-07T08:58:38.265352+0000","last_unstale":"2023-10-07T08:58:38.273010+0000","last_undegraded":"2023-10-07T08:58:38.273010+0000","last_fullsized":"2023-10-07T08:58:38.273010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257410+0000","last_change":"2023-10-07T08:58:37.270333+0000","last_active":"2023-10-07T08:58:38.257410+0000","last_peered":"2023-10-07T08:58:38.257410+0000","last_clean":"2023-10-07T08:58:38.257410+0000","last_became_active":"2023-10-07T08:58:37.270099+0000","last_became_peered":"2023-10-07T08:58:37.270099+0000","last_unstale":"2023-10-07T08:58:38.257410+0000","last_undegraded":"2023-10-07T08:58:38.257410+0000","last_fullsized":"2023-10-07T08:58:38.257410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275565+0000","last_change":"2023-10-07T08:58:38.272196+0000","last_active":"2023-10-07T08:58:38.275565+0000","last_peered":"2023-10-07T08:58:38.275565+0000","last_clean":"2023-10-07T08:58:38.275565+0000","last_became_active":"2023-10-07T08:58:38.268871+0000","last_became_peered":"2023-10-07T08:58:38.268871+0000","last_unstale":"2023-10-07T08:58:38.275565+0000","last_undegraded":"2023-10-07T08:58:38.275565+0000","last_fullsized":"2023-10-07T08:58:38.275565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272269+0000","last_change":"2023-10-07T08:58:38.265483+0000","last_active":"2023-10-07T08:58:38.272269+0000","last_peered":"2023-10-07T08:58:38.272269+0000","last_clean":"2023-10-07T08:58:38.272269+0000","last_became_active":"2023-10-07T08:58:38.265225+0000","last_became_peered":"2023-10-07T08:58:38.265225+0000","last_unstale":"2023-10-07T08:58:38.272269+0000","last_undegraded":"2023-10-07T08:58:38.272269+0000","last_fullsized":"2023-10-07T08:58:38.272269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260127+0000","last_change":"2023-10-07T08:58:37.265772+0000","last_active":"2023-10-07T08:58:38.260127+0000","last_peered":"2023-10-07T08:58:38.260127+0000","last_clean":"2023-10-07T08:58:38.260127+0000","last_became_active":"2023-10-07T08:58:37.265480+0000","last_became_peered":"2023-10-07T08:58:37.265480+0000","last_unstale":"2023-10-07T08:58:38.260127+0000","last_undegraded":"2023-10-07T08:58:38.260127+0000","last_fullsized":"2023-10-07T08:58:38.260127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277027+0000","last_change":"2023-10-07T08:58:38.267707+0000","last_active":"2023-10-07T08:58:38.277027+0000","last_peered":"2023-10-07T08:58:38.277027+0000","last_clean":"2023-10-07T08:58:38.277027+0000","last_became_active":"2023-10-07T08:58:38.267397+0000","last_became_peered":"2023-10-07T08:58:38.267397+0000","last_unstale":"2023-10-07T08:58:38.277027+0000","last_undegraded":"2023-10-07T08:58:38.277027+0000","last_fullsized":"2023-10-07T08:58:38.277027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257454+0000","last_change":"2023-10-07T08:58:37.266816+0000","last_active":"2023-10-07T08:58:38.257454+0000","last_peered":"2023-10-07T08:58:38.257454+0000","last_clean":"2023-10-07T08:58:38.257454+0000","last_became_active":"2023-10-07T08:58:37.266529+0000","last_became_peered":"2023-10-07T08:58:37.266529+0000","last_unstale":"2023-10-07T08:58:38.257454+0000","last_undegraded":"2023-10-07T08:58:38.257454+0000","last_fullsized":"2023-10-07T08:58:38.257454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259526+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:58:38.259526+0000","last_peered":"2023-10-07T08:58:38.259526+0000","last_clean":"2023-10-07T08:58:38.259526+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:58:38.259526+0000","last_undegraded":"2023-10-07T08:58:38.259526+0000","last_fullsized":"2023-10-07T08:58:38.259526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278929+0000","last_change":"2023-10-07T08:58:38.274743+0000","last_active":"2023-10-07T08:58:38.278929+0000","last_peered":"2023-10-07T08:58:38.278929+0000","last_clean":"2023-10-07T08:58:38.278929+0000","last_became_active":"2023-10-07T08:58:38.273665+0000","last_became_peered":"2023-10-07T08:58:38.273665+0000","last_unstale":"2023-10-07T08:58:38.278929+0000","last_undegraded":"2023-10-07T08:58:38.278929+0000","last_fullsized":"2023-10-07T08:58:38.278929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259654+0000","last_change":"2023-10-07T08:58:37.267054+0000","last_active":"2023-10-07T08:58:38.259654+0000","last_peered":"2023-10-07T08:58:38.259654+0000","last_clean":"2023-10-07T08:58:38.259654+0000","last_became_active":"2023-10-07T08:58:37.266737+0000","last_became_peered":"2023-10-07T08:58:37.266737+0000","last_unstale":"2023-10-07T08:58:38.259654+0000","last_undegraded":"2023-10-07T08:58:38.259654+0000","last_fullsized":"2023-10-07T08:58:38.259654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:21.835890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.261600+0000","last_change":"2023-10-07T08:58:37.265472+0000","last_active":"2023-10-07T08:58:38.261600+0000","last_peered":"2023-10-07T08:58:38.261600+0000","last_clean":"2023-10-07T08:58:38.261600+0000","last_became_active":"2023-10-07T08:58:37.264985+0000","last_became_peered":"2023-10-07T08:58:37.264985+0000","last_unstale":"2023-10-07T08:58:38.261600+0000","last_undegraded":"2023-10-07T08:58:38.261600+0000","last_fullsized":"2023-10-07T08:58:38.261600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269942+0000","last_change":"2023-10-07T08:58:38.264926+0000","last_active":"2023-10-07T08:58:38.269942+0000","last_peered":"2023-10-07T08:58:38.269942+0000","last_clean":"2023-10-07T08:58:38.269942+0000","last_became_active":"2023-10-07T08:58:38.264654+0000","last_became_peered":"2023-10-07T08:58:38.264654+0000","last_unstale":"2023-10-07T08:58:38.269942+0000","last_undegraded":"2023-10-07T08:58:38.269942+0000","last_fullsized":"2023-10-07T08:58:38.269942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:58:39.261614+0000","last_change":"2023-10-07T08:58:37.261664+0000","last_active":"2023-10-07T08:58:39.261614+0000","last_peered":"2023-10-07T08:58:39.261614+0000","last_clean":"2023-10-07T08:58:39.261614+0000","last_became_active":"2023-10-07T08:58:37.261370+0000","last_became_peered":"2023-10-07T08:58:37.261370+0000","last_unstale":"2023-10-07T08:58:39.261614+0000","last_undegraded":"2023-10-07T08:58:39.261614+0000","last_fullsized":"2023-10-07T08:58:39.261614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276617+0000","last_change":"2023-10-07T08:58:38.264474+0000","last_active":"2023-10-07T08:58:38.276617+0000","last_peered":"2023-10-07T08:58:38.276617+0000","last_clean":"2023-10-07T08:58:38.276617+0000","last_became_active":"2023-10-07T08:58:38.264205+0000","last_became_peered":"2023-10-07T08:58:38.264205+0000","last_unstale":"2023-10-07T08:58:38.276617+0000","last_undegraded":"2023-10-07T08:58:38.276617+0000","last_fullsized":"2023-10-07T08:58:38.276617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283609+0000","last_change":"2023-10-07T08:58:37.265911+0000","last_active":"2023-10-07T08:58:38.283609+0000","last_peered":"2023-10-07T08:58:38.283609+0000","last_clean":"2023-10-07T08:58:38.283609+0000","last_became_active":"2023-10-07T08:58:37.265641+0000","last_became_peered":"2023-10-07T08:58:37.265641+0000","last_unstale":"2023-10-07T08:58:38.283609+0000","last_undegraded":"2023-10-07T08:58:38.283609+0000","last_fullsized":"2023-10-07T08:58:38.283609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277871+0000","last_change":"2023-10-07T08:58:38.270356+0000","last_active":"2023-10-07T08:58:38.277871+0000","last_peered":"2023-10-07T08:58:38.277871+0000","last_clean":"2023-10-07T08:58:38.277871+0000","last_became_active":"2023-10-07T08:58:38.270083+0000","last_became_peered":"2023-10-07T08:58:38.270083+0000","last_unstale":"2023-10-07T08:58:38.277871+0000","last_undegraded":"2023-10-07T08:58:38.277871+0000","last_fullsized":"2023-10-07T08:58:38.277871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:14:21.759445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259621+0000","last_change":"2023-10-07T08:58:37.271336+0000","last_active":"2023-10-07T08:58:38.259621+0000","last_peered":"2023-10-07T08:58:38.259621+0000","last_clean":"2023-10-07T08:58:38.259621+0000","last_became_active":"2023-10-07T08:58:37.271057+0000","last_became_peered":"2023-10-07T08:58:37.271057+0000","last_unstale":"2023-10-07T08:58:38.259621+0000","last_undegraded":"2023-10-07T08:58:38.259621+0000","last_fullsized":"2023-10-07T08:58:38.259621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274310+0000","last_change":"2023-10-07T08:58:38.266393+0000","last_active":"2023-10-07T08:58:38.274310+0000","last_peered":"2023-10-07T08:58:38.274310+0000","last_clean":"2023-10-07T08:58:38.274310+0000","last_became_active":"2023-10-07T08:58:38.266131+0000","last_became_peered":"2023-10-07T08:58:38.266131+0000","last_unstale":"2023-10-07T08:58:38.274310+0000","last_undegraded":"2023-10-07T08:58:38.274310+0000","last_fullsized":"2023-10-07T08:58:38.274310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:57.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252634+0000","last_change":"2023-10-07T08:58:37.265724+0000","last_active":"2023-10-07T08:58:38.252634+0000","last_peered":"2023-10-07T08:58:38.252634+0000","last_clean":"2023-10-07T08:58:38.252634+0000","last_became_active":"2023-10-07T08:58:37.265218+0000","last_became_peered":"2023-10-07T08:58:37.265218+0000","last_unstale":"2023-10-07T08:58:38.252634+0000","last_undegraded":"2023-10-07T08:58:38.252634+0000","last_fullsized":"2023-10-07T08:58:38.252634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268873+0000","last_change":"2023-10-07T08:58:38.259788+0000","last_active":"2023-10-07T08:58:38.268873+0000","last_peered":"2023-10-07T08:58:38.268873+0000","last_clean":"2023-10-07T08:58:38.268873+0000","last_became_active":"2023-10-07T08:58:38.259490+0000","last_became_peered":"2023-10-07T08:58:38.259490+0000","last_unstale":"2023-10-07T08:58:38.268873+0000","last_undegraded":"2023-10-07T08:58:38.268873+0000","last_fullsized":"2023-10-07T08:58:38.268873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251753+0000","last_change":"2023-10-07T08:58:37.269182+0000","last_active":"2023-10-07T08:58:38.251753+0000","last_peered":"2023-10-07T08:58:38.251753+0000","last_clean":"2023-10-07T08:58:38.251753+0000","last_became_active":"2023-10-07T08:58:37.268876+0000","last_became_peered":"2023-10-07T08:58:37.268876+0000","last_unstale":"2023-10-07T08:58:38.251753+0000","last_undegraded":"2023-10-07T08:58:38.251753+0000","last_fullsized":"2023-10-07T08:58:38.251753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:47.176445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280853+0000","last_change":"2023-10-07T08:58:38.277598+0000","last_active":"2023-10-07T08:58:38.280853+0000","last_peered":"2023-10-07T08:58:38.280853+0000","last_clean":"2023-10-07T08:58:38.280853+0000","last_became_active":"2023-10-07T08:58:38.277298+0000","last_became_peered":"2023-10-07T08:58:38.277298+0000","last_unstale":"2023-10-07T08:58:38.280853+0000","last_undegraded":"2023-10-07T08:58:38.280853+0000","last_fullsized":"2023-10-07T08:58:38.280853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284373+0000","last_change":"2023-10-07T08:58:37.267496+0000","last_active":"2023-10-07T08:58:38.284373+0000","last_peered":"2023-10-07T08:58:38.284373+0000","last_clean":"2023-10-07T08:58:38.284373+0000","last_became_active":"2023-10-07T08:58:37.267211+0000","last_became_peered":"2023-10-07T08:58:37.267211+0000","last_unstale":"2023-10-07T08:58:38.284373+0000","last_undegraded":"2023-10-07T08:58:38.284373+0000","last_fullsized":"2023-10-07T08:58:38.284373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273124+0000","last_change":"2023-10-07T08:58:38.270706+0000","last_active":"2023-10-07T08:58:38.273124+0000","last_peered":"2023-10-07T08:58:38.273124+0000","last_clean":"2023-10-07T08:58:38.273124+0000","last_became_active":"2023-10-07T08:58:38.270439+0000","last_became_peered":"2023-10-07T08:58:38.270439+0000","last_unstale":"2023-10-07T08:58:38.273124+0000","last_undegraded":"2023-10-07T08:58:38.273124+0000","last_fullsized":"2023-10-07T08:58:38.273124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.255965+0000","last_change":"2023-10-07T08:58:37.266819+0000","last_active":"2023-10-07T08:58:38.255965+0000","last_peered":"2023-10-07T08:58:38.255965+0000","last_clean":"2023-10-07T08:58:38.255965+0000","last_became_active":"2023-10-07T08:58:37.266526+0000","last_became_peered":"2023-10-07T08:58:37.266526+0000","last_unstale":"2023-10-07T08:58:38.255965+0000","last_undegraded":"2023-10-07T08:58:38.255965+0000","last_fullsized":"2023-10-07T08:58:38.255965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279068+0000","last_change":"2023-10-07T08:58:38.274546+0000","last_active":"2023-10-07T08:58:38.279068+0000","last_peered":"2023-10-07T08:58:38.279068+0000","last_clean":"2023-10-07T08:58:38.279068+0000","last_became_active":"2023-10-07T08:58:38.274288+0000","last_became_peered":"2023-10-07T08:58:38.274288+0000","last_unstale":"2023-10-07T08:58:38.279068+0000","last_undegraded":"2023-10-07T08:58:38.279068+0000","last_fullsized":"2023-10-07T08:58:38.279068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284614+0000","last_change":"2023-10-07T08:58:37.261183+0000","last_active":"2023-10-07T08:58:38.284614+0000","last_peered":"2023-10-07T08:58:38.284614+0000","last_clean":"2023-10-07T08:58:38.284614+0000","last_became_active":"2023-10-07T08:58:37.260954+0000","last_became_peered":"2023-10-07T08:58:37.260954+0000","last_unstale":"2023-10-07T08:58:38.284614+0000","last_undegraded":"2023-10-07T08:58:38.284614+0000","last_fullsized":"2023-10-07T08:58:38.284614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267238+0000","last_change":"2023-10-07T08:58:38.264621+0000","last_active":"2023-10-07T08:58:38.267238+0000","last_peered":"2023-10-07T08:58:38.267238+0000","last_clean":"2023-10-07T08:58:38.267238+0000","last_became_active":"2023-10-07T08:58:38.264344+0000","last_became_peered":"2023-10-07T08:58:38.264344+0000","last_unstale":"2023-10-07T08:58:38.267238+0000","last_undegraded":"2023-10-07T08:58:38.267238+0000","last_fullsized":"2023-10-07T08:58:38.267238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.281550+0000","last_change":"2023-10-07T08:58:37.267477+0000","last_active":"2023-10-07T08:58:38.281550+0000","last_peered":"2023-10-07T08:58:38.281550+0000","last_clean":"2023-10-07T08:58:38.281550+0000","last_became_active":"2023-10-07T08:58:37.267186+0000","last_became_peered":"2023-10-07T08:58:37.267186+0000","last_unstale":"2023-10-07T08:58:38.281550+0000","last_undegraded":"2023-10-07T08:58:38.281550+0000","last_fullsized":"2023-10-07T08:58:38.281550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283571+0000","last_change":"2023-10-07T08:58:38.278356+0000","last_active":"2023-10-07T08:58:38.283571+0000","last_peered":"2023-10-07T08:58:38.283571+0000","last_clean":"2023-10-07T08:58:38.283571+0000","last_became_active":"2023-10-07T08:58:38.277900+0000","last_became_peered":"2023-10-07T08:58:38.277900+0000","last_unstale":"2023-10-07T08:58:38.283571+0000","last_undegraded":"2023-10-07T08:58:38.283571+0000","last_fullsized":"2023-10-07T08:58:38.283571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283653+0000","last_change":"2023-10-07T08:58:38.276244+0000","last_active":"2023-10-07T08:58:38.283653+0000","last_peered":"2023-10-07T08:58:38.283653+0000","last_clean":"2023-10-07T08:58:38.283653+0000","last_became_active":"2023-10-07T08:58:38.275899+0000","last_became_peered":"2023-10-07T08:58:38.275899+0000","last_unstale":"2023-10-07T08:58:38.283653+0000","last_undegraded":"2023-10-07T08:58:38.283653+0000","last_fullsized":"2023-10-07T08:58:38.283653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272163+0000","last_change":"2023-10-07T08:58:38.269027+0000","last_active":"2023-10-07T08:58:38.272163+0000","last_peered":"2023-10-07T08:58:38.272163+0000","last_clean":"2023-10-07T08:58:38.272163+0000","last_became_active":"2023-10-07T08:58:38.268305+0000","last_became_peered":"2023-10-07T08:58:38.268305+0000","last_unstale":"2023-10-07T08:58:38.272163+0000","last_undegraded":"2023-10-07T08:58:38.272163+0000","last_fullsized":"2023-10-07T08:58:38.272163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:39.609895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266087+0000","last_change":"2023-10-07T08:58:38.263865+0000","last_active":"2023-10-07T08:58:38.266087+0000","last_peered":"2023-10-07T08:58:38.266087+0000","last_clean":"2023-10-07T08:58:38.266087+0000","last_became_active":"2023-10-07T08:58:38.263605+0000","last_became_peered":"2023-10-07T08:58:38.263605+0000","last_unstale":"2023-10-07T08:58:38.266087+0000","last_undegraded":"2023-10-07T08:58:38.266087+0000","last_fullsized":"2023-10-07T08:58:38.266087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277986+0000","last_change":"2023-10-07T08:58:38.272673+0000","last_active":"2023-10-07T08:58:38.277986+0000","last_peered":"2023-10-07T08:58:38.277986+0000","last_clean":"2023-10-07T08:58:38.277986+0000","last_became_active":"2023-10-07T08:58:38.272332+0000","last_became_peered":"2023-10-07T08:58:38.272332+0000","last_unstale":"2023-10-07T08:58:38.277986+0000","last_undegraded":"2023-10-07T08:58:38.277986+0000","last_fullsized":"2023-10-07T08:58:38.277986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276971+0000","last_change":"2023-10-07T08:58:38.266586+0000","last_active":"2023-10-07T08:58:38.276971+0000","last_peered":"2023-10-07T08:58:38.276971+0000","last_clean":"2023-10-07T08:58:38.276971+0000","last_became_active":"2023-10-07T08:58:38.266197+0000","last_became_peered":"2023-10-07T08:58:38.266197+0000","last_unstale":"2023-10-07T08:58:38.276971+0000","last_undegraded":"2023-10-07T08:58:38.276971+0000","last_fullsized":"2023-10-07T08:58:38.276971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260868+0000","last_change":"2023-10-07T08:58:38.259089+0000","last_active":"2023-10-07T08:58:38.260868+0000","last_peered":"2023-10-07T08:58:38.260868+0000","last_clean":"2023-10-07T08:58:38.260868+0000","last_became_active":"2023-10-07T08:58:38.258801+0000","last_became_peered":"2023-10-07T08:58:38.258801+0000","last_unstale":"2023-10-07T08:58:38.260868+0000","last_undegraded":"2023-10-07T08:58:38.260868+0000","last_fullsized":"2023-10-07T08:58:38.260868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275061+0000","last_change":"2023-10-07T08:58:38.271464+0000","last_active":"2023-10-07T08:58:38.275061+0000","last_peered":"2023-10-07T08:58:38.275061+0000","last_clean":"2023-10-07T08:58:38.275061+0000","last_became_active":"2023-10-07T08:58:38.271181+0000","last_became_peered":"2023-10-07T08:58:38.271181+0000","last_unstale":"2023-10-07T08:58:38.275061+0000","last_undegraded":"2023-10-07T08:58:38.275061+0000","last_fullsized":"2023-10-07T08:58:38.275061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276652+0000","last_change":"2023-10-07T08:58:38.265753+0000","last_active":"2023-10-07T08:58:38.276652+0000","last_peered":"2023-10-07T08:58:38.276652+0000","last_clean":"2023-10-07T08:58:38.276652+0000","last_became_active":"2023-10-07T08:58:38.265442+0000","last_became_peered":"2023-10-07T08:58:38.265442+0000","last_unstale":"2023-10-07T08:58:38.276652+0000","last_undegraded":"2023-10-07T08:58:38.276652+0000","last_fullsized":"2023-10-07T08:58:38.276652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265756+0000","last_change":"2023-10-07T08:58:38.263382+0000","last_active":"2023-10-07T08:58:38.265756+0000","last_peered":"2023-10-07T08:58:38.265756+0000","last_clean":"2023-10-07T08:58:38.265756+0000","last_became_active":"2023-10-07T08:58:38.263121+0000","last_became_peered":"2023-10-07T08:58:38.263121+0000","last_unstale":"2023-10-07T08:58:38.265756+0000","last_undegraded":"2023-10-07T08:58:38.265756+0000","last_fullsized":"2023-10-07T08:58:38.265756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276899+0000","last_change":"2023-10-07T08:58:38.265927+0000","last_active":"2023-10-07T08:58:38.276899+0000","last_peered":"2023-10-07T08:58:38.276899+0000","last_clean":"2023-10-07T08:58:38.276899+0000","last_became_active":"2023-10-07T08:58:38.265607+0000","last_became_peered":"2023-10-07T08:58:38.265607+0000","last_unstale":"2023-10-07T08:58:38.276899+0000","last_undegraded":"2023-10-07T08:58:38.276899+0000","last_fullsized":"2023-10-07T08:58:38.276899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266109+0000","last_change":"2023-10-07T08:58:38.264874+0000","last_active":"2023-10-07T08:58:38.266109+0000","last_peered":"2023-10-07T08:58:38.266109+0000","last_clean":"2023-10-07T08:58:38.266109+0000","last_became_active":"2023-10-07T08:58:38.264577+0000","last_became_peered":"2023-10-07T08:58:38.264577+0000","last_unstale":"2023-10-07T08:58:38.266109+0000","last_undegraded":"2023-10-07T08:58:38.266109+0000","last_fullsized":"2023-10-07T08:58:38.266109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277961+0000","last_change":"2023-10-07T08:58:38.270592+0000","last_active":"2023-10-07T08:58:38.277961+0000","last_peered":"2023-10-07T08:58:38.277961+0000","last_clean":"2023-10-07T08:58:38.277961+0000","last_became_active":"2023-10-07T08:58:38.270016+0000","last_became_peered":"2023-10-07T08:58:38.270016+0000","last_unstale":"2023-10-07T08:58:38.277961+0000","last_undegraded":"2023-10-07T08:58:38.277961+0000","last_fullsized":"2023-10-07T08:58:38.277961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275054+0000","last_change":"2023-10-07T08:58:38.271588+0000","last_active":"2023-10-07T08:58:38.275054+0000","last_peered":"2023-10-07T08:58:38.275054+0000","last_clean":"2023-10-07T08:58:38.275054+0000","last_became_active":"2023-10-07T08:58:38.271197+0000","last_became_peered":"2023-10-07T08:58:38.271197+0000","last_unstale":"2023-10-07T08:58:38.275054+0000","last_undegraded":"2023-10-07T08:58:38.275054+0000","last_fullsized":"2023-10-07T08:58:38.275054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7040000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9979999999999993}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.569}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:58:46.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:58:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.150+0000 7f4950cdf700 1 Processor -- start 2023-10-07T08:58:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.151+0000 7f4950cdf700 1 -- start start 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.151+0000 7f4950cdf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f494c159c60 0x7f494c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.151+0000 7f4950cdf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c15a160 con 0x7f494c15db10 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.151+0000 7f4950cdf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0d13a0 con 0x7f494c159890 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.151+0000 7f4950cdf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c15df50 con 0x7f494c159c60 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f494c15db10 0x7f494c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54814/0 (socket says 172.21.15.46:54814) 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494ad9d700 1 -- 172.21.15.46:0/92128932 learned_addr learned my addr 172.21.15.46:0/92128932 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f4949d9b700 1 --2- 172.21.15.46:0/92128932 >> v2:172.21.15.133:3300/0 conn(0x7f494c159c60 0x7f494c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844586840 0 0) 0x7f494c15a160 con 0x7f494c15db10 2023-10-07T08:58:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4938003570 con 0x7f494c15db10 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f4949d9b700 1 -- 172.21.15.46:0/92128932 >> v1:172.21.15.133:6789/0 conn(0x7f494c159890 legacy=0x7f494c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882331615 0 0) 0x7f494c0d13a0 con 0x7f494c159890 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f4949d9b700 1 -- 172.21.15.46:0/92128932 >> v1:172.21.15.46:6789/0 conn(0x7f494c15db10 legacy=0x7f494c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f4949d9b700 1 -- 172.21.15.46:0/92128932 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c15e140 con 0x7f494c159c60 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f4949d9b700 1 --2- 172.21.15.46:0/92128932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c159c60 0x7f494c15d5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc33865944ceee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400b640 con 0x7f494c159c60 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b7a0 con 0x7f494c159c60 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.152+0000 7f494959a700 1 -- 172.21.15.46:0/92128932 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bb40 con 0x7f494c159c60 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 -- 172.21.15.46:0/92128932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c159c60 msgr2=0x7f494c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 --2- 172.21.15.46:0/92128932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c159c60 0x7f494c15d5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 -- 172.21.15.46:0/92128932 shutdown_connections 2023-10-07T08:58:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 --2- 172.21.15.46:0/92128932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c159c60 0x7f494c15d5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 -- 172.21.15.46:0/92128932 >> 172.21.15.46:0/92128932 conn(0x7f494c068e20 msgr2=0x7f494c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 -- 172.21.15.46:0/92128932 shutdown_connections 2023-10-07T08:58:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.153+0000 7f4950cdf700 1 -- 172.21.15.46:0/92128932 wait complete. 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.154+0000 7f4950cdf700 1 Processor -- start 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.154+0000 7f4950cdf700 1 -- start start 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f494c159890 0x7f494c153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c15db10 0x7f494c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c16d850 con 0x7f494c159c60 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c153750 con 0x7f494c15db10 2023-10-07T08:58:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0b5de0 con 0x7f494c159890 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60722/0 (socket says 172.21.15.46:60722) 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 -- 172.21.15.46:0/3894917666 learned_addr learned my addr 172.21.15.46:0/3894917666 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f494ad9d700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c15db10 0x7f494c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f494a59c700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f494c159890 0x7f494c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 -- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f494c159890 msgr2=0x7f494c153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f494c159890 0x7f494c153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 -- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c15db10 msgr2=0x7f494c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c15db10 0x7f494c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 -- 172.21.15.46:0/3894917666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009420 con 0x7f494c159c60 2023-10-07T08:58:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4949d9b700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49340093f0 tx=0x7f4934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bb20 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493401a430 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0b60c0 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.155+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493401a7d0 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.156+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c16d4e0 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.156+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c16d9c0 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.157+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f493401ab80 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.157+0000 7f49427fc700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.157+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49340864f0 con 0x7f494c159c60 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.157+0000 7f494a59c700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.158+0000 7f494a59c700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4944007fd0 tx=0x7f4944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.162+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49340536c0 con 0x7f494c159c60 2023-10-07T08:58:47.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.351+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f494c04c3c0 con 0x7f492c066f30 2023-10-07T08:58:47.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.359+0000 7f49427fc700 1 -- 172.21.15.46:0/3894917666 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264517 (secure 0 0 0) 0x7f494c04c3c0 con 0x7f492c066f30 2023-10-07T08:58:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 msgr2=0x7f492c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4944007fd0 tx=0x7f4944009040 comp rx=0 tx=0).stop 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 msgr2=0x7f494c16dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49340093f0 tx=0x7f4934017000 comp rx=0 tx=0).stop 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 shutdown_connections 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f494c15db10 0x7f494c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f494c159890 0x7f494c153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 --2- 172.21.15.46:0/3894917666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f494c159c60 0x7f494c16dce0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 >> 172.21.15.46:0/3894917666 conn(0x7f494c068e20 msgr2=0x7f494c1554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:47.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 shutdown_connections 2023-10-07T08:58:47.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.362+0000 7f4950cdf700 1 -- 172.21.15.46:0/3894917666 wait complete. 2023-10-07T08:58:47.371 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:58:47.374 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-07T08:58:45.763502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002063"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269469+0000","last_change":"2023-10-07T08:58:38.267255+0000","last_active":"2023-10-07T08:58:38.269469+0000","last_peered":"2023-10-07T08:58:38.269469+0000","last_clean":"2023-10-07T08:58:38.269469+0000","last_became_active":"2023-10-07T08:58:38.266659+0000","last_became_peered":"2023-10-07T08:58:38.266659+0000","last_unstale":"2023-10-07T08:58:38.269469+0000","last_undegraded":"2023-10-07T08:58:38.269469+0000","last_fullsized":"2023-10-07T08:58:38.269469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.271311+0000","last_change":"2023-10-07T08:58:38.267764+0000","last_active":"2023-10-07T08:58:38.271311+0000","last_peered":"2023-10-07T08:58:38.271311+0000","last_clean":"2023-10-07T08:58:38.271311+0000","last_became_active":"2023-10-07T08:58:38.267465+0000","last_became_peered":"2023-10-07T08:58:38.267465+0000","last_unstale":"2023-10-07T08:58:38.271311+0000","last_undegraded":"2023-10-07T08:58:38.271311+0000","last_fullsized":"2023-10-07T08:58:38.271311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277699+0000","last_change":"2023-10-07T08:58:38.266617+0000","last_active":"2023-10-07T08:58:38.277699+0000","last_peered":"2023-10-07T08:58:38.277699+0000","last_clean":"2023-10-07T08:58:38.277699+0000","last_became_active":"2023-10-07T08:58:38.266163+0000","last_became_peered":"2023-10-07T08:58:38.266163+0000","last_unstale":"2023-10-07T08:58:38.277699+0000","last_undegraded":"2023-10-07T08:58:38.277699+0000","last_fullsized":"2023-10-07T08:58:38.277699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267216+0000","last_change":"2023-10-07T08:58:38.263351+0000","last_active":"2023-10-07T08:58:38.267216+0000","last_peered":"2023-10-07T08:58:38.267216+0000","last_clean":"2023-10-07T08:58:38.267216+0000","last_became_active":"2023-10-07T08:58:38.262967+0000","last_became_peered":"2023-10-07T08:58:38.262967+0000","last_unstale":"2023-10-07T08:58:38.267216+0000","last_undegraded":"2023-10-07T08:58:38.267216+0000","last_fullsized":"2023-10-07T08:58:38.267216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268506+0000","last_change":"2023-10-07T08:58:38.266316+0000","last_active":"2023-10-07T08:58:38.268506+0000","last_peered":"2023-10-07T08:58:38.268506+0000","last_clean":"2023-10-07T08:58:38.268506+0000","last_became_active":"2023-10-07T08:58:38.266017+0000","last_became_peered":"2023-10-07T08:58:38.266017+0000","last_unstale":"2023-10-07T08:58:38.268506+0000","last_undegraded":"2023-10-07T08:58:38.268506+0000","last_fullsized":"2023-10-07T08:58:38.268506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283688+0000","last_change":"2023-10-07T08:58:38.278399+0000","last_active":"2023-10-07T08:58:38.283688+0000","last_peered":"2023-10-07T08:58:38.283688+0000","last_clean":"2023-10-07T08:58:38.283688+0000","last_became_active":"2023-10-07T08:58:38.278131+0000","last_became_peered":"2023-10-07T08:58:38.278131+0000","last_unstale":"2023-10-07T08:58:38.283688+0000","last_undegraded":"2023-10-07T08:58:38.283688+0000","last_fullsized":"2023-10-07T08:58:38.283688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278620+0000","last_change":"2023-10-07T08:58:38.274141+0000","last_active":"2023-10-07T08:58:38.278620+0000","last_peered":"2023-10-07T08:58:38.278620+0000","last_clean":"2023-10-07T08:58:38.278620+0000","last_became_active":"2023-10-07T08:58:38.273855+0000","last_became_peered":"2023-10-07T08:58:38.273855+0000","last_unstale":"2023-10-07T08:58:38.278620+0000","last_undegraded":"2023-10-07T08:58:38.278620+0000","last_fullsized":"2023-10-07T08:58:38.278620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:11.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280682+0000","last_change":"2023-10-07T08:58:38.270600+0000","last_active":"2023-10-07T08:58:38.280682+0000","last_peered":"2023-10-07T08:58:38.280682+0000","last_clean":"2023-10-07T08:58:38.280682+0000","last_became_active":"2023-10-07T08:58:38.270310+0000","last_became_peered":"2023-10-07T08:58:38.270310+0000","last_unstale":"2023-10-07T08:58:38.280682+0000","last_undegraded":"2023-10-07T08:58:38.280682+0000","last_fullsized":"2023-10-07T08:58:38.280682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269449+0000","last_change":"2023-10-07T08:58:38.267490+0000","last_active":"2023-10-07T08:58:38.269449+0000","last_peered":"2023-10-07T08:58:38.269449+0000","last_clean":"2023-10-07T08:58:38.269449+0000","last_became_active":"2023-10-07T08:58:38.267089+0000","last_became_peered":"2023-10-07T08:58:38.267089+0000","last_unstale":"2023-10-07T08:58:38.269449+0000","last_undegraded":"2023-10-07T08:58:38.269449+0000","last_fullsized":"2023-10-07T08:58:38.269449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270528+0000","last_change":"2023-10-07T08:58:38.267172+0000","last_active":"2023-10-07T08:58:38.270528+0000","last_peered":"2023-10-07T08:58:38.270528+0000","last_clean":"2023-10-07T08:58:38.270528+0000","last_became_active":"2023-10-07T08:58:38.266880+0000","last_became_peered":"2023-10-07T08:58:38.266880+0000","last_unstale":"2023-10-07T08:58:38.270528+0000","last_undegraded":"2023-10-07T08:58:38.270528+0000","last_fullsized":"2023-10-07T08:58:38.270528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.270070+0000","last_change":"2023-10-07T08:58:38.267001+0000","last_active":"2023-10-07T08:58:38.270070+0000","last_peered":"2023-10-07T08:58:38.270070+0000","last_clean":"2023-10-07T08:58:38.270070+0000","last_became_active":"2023-10-07T08:58:38.266492+0000","last_became_peered":"2023-10-07T08:58:38.266492+0000","last_unstale":"2023-10-07T08:58:38.270070+0000","last_undegraded":"2023-10-07T08:58:38.270070+0000","last_fullsized":"2023-10-07T08:58:38.270070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273887+0000","last_change":"2023-10-07T08:58:38.264386+0000","last_active":"2023-10-07T08:58:38.273887+0000","last_peered":"2023-10-07T08:58:38.273887+0000","last_clean":"2023-10-07T08:58:38.273887+0000","last_became_active":"2023-10-07T08:58:38.264124+0000","last_became_peered":"2023-10-07T08:58:38.264124+0000","last_unstale":"2023-10-07T08:58:38.273887+0000","last_undegraded":"2023-10-07T08:58:38.273887+0000","last_fullsized":"2023-10-07T08:58:38.273887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:30.530699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276582+0000","last_change":"2023-10-07T08:58:38.263696+0000","last_active":"2023-10-07T08:58:38.276582+0000","last_peered":"2023-10-07T08:58:38.276582+0000","last_clean":"2023-10-07T08:58:38.276582+0000","last_became_active":"2023-10-07T08:58:38.263363+0000","last_became_peered":"2023-10-07T08:58:38.263363+0000","last_unstale":"2023-10-07T08:58:38.276582+0000","last_undegraded":"2023-10-07T08:58:38.276582+0000","last_fullsized":"2023-10-07T08:58:38.276582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277744+0000","last_change":"2023-10-07T08:58:38.267349+0000","last_active":"2023-10-07T08:58:38.277744+0000","last_peered":"2023-10-07T08:58:38.277744+0000","last_clean":"2023-10-07T08:58:38.277744+0000","last_became_active":"2023-10-07T08:58:38.266917+0000","last_became_peered":"2023-10-07T08:58:38.266917+0000","last_unstale":"2023-10-07T08:58:38.277744+0000","last_undegraded":"2023-10-07T08:58:38.277744+0000","last_fullsized":"2023-10-07T08:58:38.277744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:59.205812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.262424+0000","last_change":"2023-10-07T08:58:38.259339+0000","last_active":"2023-10-07T08:58:38.262424+0000","last_peered":"2023-10-07T08:58:38.262424+0000","last_clean":"2023-10-07T08:58:38.262424+0000","last_became_active":"2023-10-07T08:58:38.258971+0000","last_became_peered":"2023-10-07T08:58:38.258971+0000","last_unstale":"2023-10-07T08:58:38.262424+0000","last_undegraded":"2023-10-07T08:58:38.262424+0000","last_fullsized":"2023-10-07T08:58:38.262424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283660+0000","last_change":"2023-10-07T08:58:38.278767+0000","last_active":"2023-10-07T08:58:38.283660+0000","last_peered":"2023-10-07T08:58:38.283660+0000","last_clean":"2023-10-07T08:58:38.283660+0000","last_became_active":"2023-10-07T08:58:38.278528+0000","last_became_peered":"2023-10-07T08:58:38.278528+0000","last_unstale":"2023-10-07T08:58:38.283660+0000","last_undegraded":"2023-10-07T08:58:38.283660+0000","last_fullsized":"2023-10-07T08:58:38.283660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273609+0000","last_change":"2023-10-07T08:58:38.269363+0000","last_active":"2023-10-07T08:58:38.273609+0000","last_peered":"2023-10-07T08:58:38.273609+0000","last_clean":"2023-10-07T08:58:38.273609+0000","last_became_active":"2023-10-07T08:58:38.269065+0000","last_became_peered":"2023-10-07T08:58:38.269065+0000","last_unstale":"2023-10-07T08:58:38.273609+0000","last_undegraded":"2023-10-07T08:58:38.273609+0000","last_fullsized":"2023-10-07T08:58:38.273609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272204+0000","last_change":"2023-10-07T08:58:38.269575+0000","last_active":"2023-10-07T08:58:38.272204+0000","last_peered":"2023-10-07T08:58:38.272204+0000","last_clean":"2023-10-07T08:58:38.272204+0000","last_became_active":"2023-10-07T08:58:38.268895+0000","last_became_peered":"2023-10-07T08:58:38.268895+0000","last_unstale":"2023-10-07T08:58:38.272204+0000","last_undegraded":"2023-10-07T08:58:38.272204+0000","last_fullsized":"2023-10-07T08:58:38.272204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:32.828536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269484+0000","last_change":"2023-10-07T08:58:38.267862+0000","last_active":"2023-10-07T08:58:38.269484+0000","last_peered":"2023-10-07T08:58:38.269484+0000","last_clean":"2023-10-07T08:58:38.269484+0000","last_became_active":"2023-10-07T08:58:38.267577+0000","last_became_peered":"2023-10-07T08:58:38.267577+0000","last_unstale":"2023-10-07T08:58:38.269484+0000","last_undegraded":"2023-10-07T08:58:38.269484+0000","last_fullsized":"2023-10-07T08:58:38.269484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284044+0000","last_change":"2023-10-07T08:58:37.268088+0000","last_active":"2023-10-07T08:58:38.284044+0000","last_peered":"2023-10-07T08:58:38.284044+0000","last_clean":"2023-10-07T08:58:38.284044+0000","last_became_active":"2023-10-07T08:58:37.267728+0000","last_became_peered":"2023-10-07T08:58:37.267728+0000","last_unstale":"2023-10-07T08:58:38.284044+0000","last_undegraded":"2023-10-07T08:58:38.284044+0000","last_fullsized":"2023-10-07T08:58:38.284044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:45.288025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280531+0000","last_change":"2023-10-07T08:58:38.268443+0000","last_active":"2023-10-07T08:58:38.280531+0000","last_peered":"2023-10-07T08:58:38.280531+0000","last_clean":"2023-10-07T08:58:38.280531+0000","last_became_active":"2023-10-07T08:58:38.268155+0000","last_became_peered":"2023-10-07T08:58:38.268155+0000","last_unstale":"2023-10-07T08:58:38.280531+0000","last_undegraded":"2023-10-07T08:58:38.280531+0000","last_fullsized":"2023-10-07T08:58:38.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280882+0000","last_change":"2023-10-07T08:58:37.269548+0000","last_active":"2023-10-07T08:58:38.280882+0000","last_peered":"2023-10-07T08:58:38.280882+0000","last_clean":"2023-10-07T08:58:38.280882+0000","last_became_active":"2023-10-07T08:58:37.266826+0000","last_became_peered":"2023-10-07T08:58:37.266826+0000","last_unstale":"2023-10-07T08:58:38.280882+0000","last_undegraded":"2023-10-07T08:58:38.280882+0000","last_fullsized":"2023-10-07T08:58:38.280882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:35.767431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279027+0000","last_change":"2023-10-07T08:58:38.272914+0000","last_active":"2023-10-07T08:58:38.279027+0000","last_peered":"2023-10-07T08:58:38.279027+0000","last_clean":"2023-10-07T08:58:38.279027+0000","last_became_active":"2023-10-07T08:58:38.269972+0000","last_became_peered":"2023-10-07T08:58:38.269972+0000","last_unstale":"2023-10-07T08:58:38.279027+0000","last_undegraded":"2023-10-07T08:58:38.279027+0000","last_fullsized":"2023-10-07T08:58:38.279027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283986+0000","last_change":"2023-10-07T08:58:37.266654+0000","last_active":"2023-10-07T08:58:38.283986+0000","last_peered":"2023-10-07T08:58:38.283986+0000","last_clean":"2023-10-07T08:58:38.283986+0000","last_became_active":"2023-10-07T08:58:37.266400+0000","last_became_peered":"2023-10-07T08:58:37.266400+0000","last_unstale":"2023-10-07T08:58:38.283986+0000","last_undegraded":"2023-10-07T08:58:38.283986+0000","last_fullsized":"2023-10-07T08:58:38.283986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.824130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273578+0000","last_change":"2023-10-07T08:58:38.266906+0000","last_active":"2023-10-07T08:58:38.273578+0000","last_peered":"2023-10-07T08:58:38.273578+0000","last_clean":"2023-10-07T08:58:38.273578+0000","last_became_active":"2023-10-07T08:58:38.266625+0000","last_became_peered":"2023-10-07T08:58:38.266625+0000","last_unstale":"2023-10-07T08:58:38.273578+0000","last_undegraded":"2023-10-07T08:58:38.273578+0000","last_fullsized":"2023-10-07T08:58:38.273578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283998+0000","last_change":"2023-10-07T08:58:37.270622+0000","last_active":"2023-10-07T08:58:38.283998+0000","last_peered":"2023-10-07T08:58:38.283998+0000","last_clean":"2023-10-07T08:58:38.283998+0000","last_became_active":"2023-10-07T08:58:37.270351+0000","last_became_peered":"2023-10-07T08:58:37.270351+0000","last_unstale":"2023-10-07T08:58:38.283998+0000","last_undegraded":"2023-10-07T08:58:38.283998+0000","last_fullsized":"2023-10-07T08:58:38.283998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274092+0000","last_change":"2023-10-07T08:58:38.273162+0000","last_active":"2023-10-07T08:58:38.274092+0000","last_peered":"2023-10-07T08:58:38.274092+0000","last_clean":"2023-10-07T08:58:38.274092+0000","last_became_active":"2023-10-07T08:58:38.272826+0000","last_became_peered":"2023-10-07T08:58:38.272826+0000","last_unstale":"2023-10-07T08:58:38.274092+0000","last_undegraded":"2023-10-07T08:58:38.274092+0000","last_fullsized":"2023-10-07T08:58:38.274092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280732+0000","last_change":"2023-10-07T08:58:37.271548+0000","last_active":"2023-10-07T08:58:38.280732+0000","last_peered":"2023-10-07T08:58:38.280732+0000","last_clean":"2023-10-07T08:58:38.280732+0000","last_became_active":"2023-10-07T08:58:37.271240+0000","last_became_peered":"2023-10-07T08:58:37.271240+0000","last_unstale":"2023-10-07T08:58:38.280732+0000","last_undegraded":"2023-10-07T08:58:38.280732+0000","last_fullsized":"2023-10-07T08:58:38.280732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269827+0000","last_change":"2023-10-07T08:58:38.260549+0000","last_active":"2023-10-07T08:58:38.269827+0000","last_peered":"2023-10-07T08:58:38.269827+0000","last_clean":"2023-10-07T08:58:38.269827+0000","last_became_active":"2023-10-07T08:58:38.260271+0000","last_became_peered":"2023-10-07T08:58:38.260271+0000","last_unstale":"2023-10-07T08:58:38.269827+0000","last_undegraded":"2023-10-07T08:58:38.269827+0000","last_fullsized":"2023-10-07T08:58:38.269827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:53.298964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284294+0000","last_change":"2023-10-07T08:58:37.263334+0000","last_active":"2023-10-07T08:58:38.284294+0000","last_peered":"2023-10-07T08:58:38.284294+0000","last_clean":"2023-10-07T08:58:38.284294+0000","last_became_active":"2023-10-07T08:58:37.263022+0000","last_became_peered":"2023-10-07T08:58:37.263022+0000","last_unstale":"2023-10-07T08:58:38.284294+0000","last_undegraded":"2023-10-07T08:58:38.284294+0000","last_fullsized":"2023-10-07T08:58:38.284294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279664+0000","last_change":"2023-10-07T08:58:38.274587+0000","last_active":"2023-10-07T08:58:38.279664+0000","last_peered":"2023-10-07T08:58:38.279664+0000","last_clean":"2023-10-07T08:58:38.279664+0000","last_became_active":"2023-10-07T08:58:38.273574+0000","last_became_peered":"2023-10-07T08:58:38.273574+0000","last_unstale":"2023-10-07T08:58:38.279664+0000","last_undegraded":"2023-10-07T08:58:38.279664+0000","last_fullsized":"2023-10-07T08:58:38.279664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.254378+0000","last_change":"2023-10-07T08:58:37.267552+0000","last_active":"2023-10-07T08:58:38.254378+0000","last_peered":"2023-10-07T08:58:38.254378+0000","last_clean":"2023-10-07T08:58:38.254378+0000","last_became_active":"2023-10-07T08:58:37.266917+0000","last_became_peered":"2023-10-07T08:58:37.266917+0000","last_unstale":"2023-10-07T08:58:38.254378+0000","last_undegraded":"2023-10-07T08:58:38.254378+0000","last_fullsized":"2023-10-07T08:58:38.254378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276934+0000","last_change":"2023-10-07T08:58:38.264169+0000","last_active":"2023-10-07T08:58:38.276934+0000","last_peered":"2023-10-07T08:58:38.276934+0000","last_clean":"2023-10-07T08:58:38.276934+0000","last_became_active":"2023-10-07T08:58:38.263551+0000","last_became_peered":"2023-10-07T08:58:38.263551+0000","last_unstale":"2023-10-07T08:58:38.276934+0000","last_undegraded":"2023-10-07T08:58:38.276934+0000","last_fullsized":"2023-10-07T08:58:38.276934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.258346+0000","last_change":"2023-10-07T08:58:37.259060+0000","last_active":"2023-10-07T08:58:38.258346+0000","last_peered":"2023-10-07T08:58:38.258346+0000","last_clean":"2023-10-07T08:58:38.258346+0000","last_became_active":"2023-10-07T08:58:37.258771+0000","last_became_peered":"2023-10-07T08:58:37.258771+0000","last_unstale":"2023-10-07T08:58:38.258346+0000","last_undegraded":"2023-10-07T08:58:38.258346+0000","last_fullsized":"2023-10-07T08:58:38.258346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265345+0000","last_change":"2023-10-07T08:58:38.262529+0000","last_active":"2023-10-07T08:58:38.265345+0000","last_peered":"2023-10-07T08:58:38.265345+0000","last_clean":"2023-10-07T08:58:38.265345+0000","last_became_active":"2023-10-07T08:58:38.262257+0000","last_became_peered":"2023-10-07T08:58:38.262257+0000","last_unstale":"2023-10-07T08:58:38.265345+0000","last_undegraded":"2023-10-07T08:58:38.265345+0000","last_fullsized":"2023-10-07T08:58:38.265345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259709+0000","last_change":"2023-10-07T08:58:37.269527+0000","last_active":"2023-10-07T08:58:38.259709+0000","last_peered":"2023-10-07T08:58:38.259709+0000","last_clean":"2023-10-07T08:58:38.259709+0000","last_became_active":"2023-10-07T08:58:37.269253+0000","last_became_peered":"2023-10-07T08:58:37.269253+0000","last_unstale":"2023-10-07T08:58:38.259709+0000","last_undegraded":"2023-10-07T08:58:38.259709+0000","last_fullsized":"2023-10-07T08:58:38.259709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273467+0000","last_change":"2023-10-07T08:58:38.268883+0000","last_active":"2023-10-07T08:58:38.273467+0000","last_peered":"2023-10-07T08:58:38.273467+0000","last_clean":"2023-10-07T08:58:38.273467+0000","last_became_active":"2023-10-07T08:58:38.268618+0000","last_became_peered":"2023-10-07T08:58:38.268618+0000","last_unstale":"2023-10-07T08:58:38.273467+0000","last_undegraded":"2023-10-07T08:58:38.273467+0000","last_fullsized":"2023-10-07T08:58:38.273467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:35.046868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.258019+0000","last_change":"2023-10-07T08:58:37.268203+0000","last_active":"2023-10-07T08:58:38.258019+0000","last_peered":"2023-10-07T08:58:38.258019+0000","last_clean":"2023-10-07T08:58:38.258019+0000","last_became_active":"2023-10-07T08:58:37.267942+0000","last_became_peered":"2023-10-07T08:58:37.267942+0000","last_unstale":"2023-10-07T08:58:38.258019+0000","last_undegraded":"2023-10-07T08:58:38.258019+0000","last_fullsized":"2023-10-07T08:58:38.258019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279006+0000","last_change":"2023-10-07T08:58:38.272764+0000","last_active":"2023-10-07T08:58:38.279006+0000","last_peered":"2023-10-07T08:58:38.279006+0000","last_clean":"2023-10-07T08:58:38.279006+0000","last_became_active":"2023-10-07T08:58:38.267664+0000","last_became_peered":"2023-10-07T08:58:38.267664+0000","last_unstale":"2023-10-07T08:58:38.279006+0000","last_undegraded":"2023-10-07T08:58:38.279006+0000","last_fullsized":"2023-10-07T08:58:38.279006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284633+0000","last_change":"2023-10-07T08:58:37.263922+0000","last_active":"2023-10-07T08:58:38.284633+0000","last_peered":"2023-10-07T08:58:38.284633+0000","last_clean":"2023-10-07T08:58:38.284633+0000","last_became_active":"2023-10-07T08:58:37.263582+0000","last_became_peered":"2023-10-07T08:58:37.263582+0000","last_unstale":"2023-10-07T08:58:38.284633+0000","last_undegraded":"2023-10-07T08:58:38.284633+0000","last_fullsized":"2023-10-07T08:58:38.284633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273905+0000","last_change":"2023-10-07T08:58:38.265834+0000","last_active":"2023-10-07T08:58:38.273905+0000","last_peered":"2023-10-07T08:58:38.273905+0000","last_clean":"2023-10-07T08:58:38.273905+0000","last_became_active":"2023-10-07T08:58:38.265379+0000","last_became_peered":"2023-10-07T08:58:38.265379+0000","last_unstale":"2023-10-07T08:58:38.273905+0000","last_undegraded":"2023-10-07T08:58:38.273905+0000","last_fullsized":"2023-10-07T08:58:38.273905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:15.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.286423+0000","last_change":"2023-10-07T08:58:37.268160+0000","last_active":"2023-10-07T08:58:38.286423+0000","last_peered":"2023-10-07T08:58:38.286423+0000","last_clean":"2023-10-07T08:58:38.286423+0000","last_became_active":"2023-10-07T08:58:37.267825+0000","last_became_peered":"2023-10-07T08:58:37.267825+0000","last_unstale":"2023-10-07T08:58:38.286423+0000","last_undegraded":"2023-10-07T08:58:38.286423+0000","last_fullsized":"2023-10-07T08:58:38.286423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276370+0000","last_change":"2023-10-07T08:58:38.271252+0000","last_active":"2023-10-07T08:58:38.276370+0000","last_peered":"2023-10-07T08:58:38.276370+0000","last_clean":"2023-10-07T08:58:38.276370+0000","last_became_active":"2023-10-07T08:58:38.270444+0000","last_became_peered":"2023-10-07T08:58:38.270444+0000","last_unstale":"2023-10-07T08:58:38.276370+0000","last_undegraded":"2023-10-07T08:58:38.276370+0000","last_fullsized":"2023-10-07T08:58:38.276370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:43.256349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284697+0000","last_change":"2023-10-07T08:58:37.265067+0000","last_active":"2023-10-07T08:58:38.284697+0000","last_peered":"2023-10-07T08:58:38.284697+0000","last_clean":"2023-10-07T08:58:38.284697+0000","last_became_active":"2023-10-07T08:58:37.264758+0000","last_became_peered":"2023-10-07T08:58:37.264758+0000","last_unstale":"2023-10-07T08:58:38.284697+0000","last_undegraded":"2023-10-07T08:58:38.284697+0000","last_fullsized":"2023-10-07T08:58:38.284697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.165187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278973+0000","last_change":"2023-10-07T08:58:38.273936+0000","last_active":"2023-10-07T08:58:38.278973+0000","last_peered":"2023-10-07T08:58:38.278973+0000","last_clean":"2023-10-07T08:58:38.278973+0000","last_became_active":"2023-10-07T08:58:38.267851+0000","last_became_peered":"2023-10-07T08:58:38.267851+0000","last_unstale":"2023-10-07T08:58:38.278973+0000","last_undegraded":"2023-10-07T08:58:38.278973+0000","last_fullsized":"2023-10-07T08:58:38.278973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:27.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257448+0000","last_change":"2023-10-07T08:58:37.266407+0000","last_active":"2023-10-07T08:58:38.257448+0000","last_peered":"2023-10-07T08:58:38.257448+0000","last_clean":"2023-10-07T08:58:38.257448+0000","last_became_active":"2023-10-07T08:58:37.266126+0000","last_became_peered":"2023-10-07T08:58:37.266126+0000","last_unstale":"2023-10-07T08:58:38.257448+0000","last_undegraded":"2023-10-07T08:58:38.257448+0000","last_fullsized":"2023-10-07T08:58:38.257448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280719+0000","last_change":"2023-10-07T08:58:38.278017+0000","last_active":"2023-10-07T08:58:38.280719+0000","last_peered":"2023-10-07T08:58:38.280719+0000","last_clean":"2023-10-07T08:58:38.280719+0000","last_became_active":"2023-10-07T08:58:38.277742+0000","last_became_peered":"2023-10-07T08:58:38.277742+0000","last_unstale":"2023-10-07T08:58:38.280719+0000","last_undegraded":"2023-10-07T08:58:38.280719+0000","last_fullsized":"2023-10-07T08:58:38.280719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259606+0000","last_change":"2023-10-07T08:58:37.264042+0000","last_active":"2023-10-07T08:58:38.259606+0000","last_peered":"2023-10-07T08:58:38.259606+0000","last_clean":"2023-10-07T08:58:38.259606+0000","last_became_active":"2023-10-07T08:58:37.263461+0000","last_became_peered":"2023-10-07T08:58:37.263461+0000","last_unstale":"2023-10-07T08:58:38.259606+0000","last_undegraded":"2023-10-07T08:58:38.259606+0000","last_fullsized":"2023-10-07T08:58:38.259606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283682+0000","last_change":"2023-10-07T08:58:38.276672+0000","last_active":"2023-10-07T08:58:38.283682+0000","last_peered":"2023-10-07T08:58:38.283682+0000","last_clean":"2023-10-07T08:58:38.283682+0000","last_became_active":"2023-10-07T08:58:38.275867+0000","last_became_peered":"2023-10-07T08:58:38.275867+0000","last_unstale":"2023-10-07T08:58:38.283682+0000","last_undegraded":"2023-10-07T08:58:38.283682+0000","last_fullsized":"2023-10-07T08:58:38.283682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278091+0000","last_change":"2023-10-07T08:58:37.259625+0000","last_active":"2023-10-07T08:58:38.278091+0000","last_peered":"2023-10-07T08:58:38.278091+0000","last_clean":"2023-10-07T08:58:38.278091+0000","last_became_active":"2023-10-07T08:58:37.259284+0000","last_became_peered":"2023-10-07T08:58:37.259284+0000","last_unstale":"2023-10-07T08:58:38.278091+0000","last_undegraded":"2023-10-07T08:58:38.278091+0000","last_fullsized":"2023-10-07T08:58:38.278091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274030+0000","last_change":"2023-10-07T08:58:38.271932+0000","last_active":"2023-10-07T08:58:38.274030+0000","last_peered":"2023-10-07T08:58:38.274030+0000","last_clean":"2023-10-07T08:58:38.274030+0000","last_became_active":"2023-10-07T08:58:38.271668+0000","last_became_peered":"2023-10-07T08:58:38.271668+0000","last_unstale":"2023-10-07T08:58:38.274030+0000","last_undegraded":"2023-10-07T08:58:38.274030+0000","last_fullsized":"2023-10-07T08:58:38.274030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:35.517628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284462+0000","last_change":"2023-10-07T08:58:37.262301+0000","last_active":"2023-10-07T08:58:38.284462+0000","last_peered":"2023-10-07T08:58:38.284462+0000","last_clean":"2023-10-07T08:58:38.284462+0000","last_became_active":"2023-10-07T08:58:37.262025+0000","last_became_peered":"2023-10-07T08:58:37.262025+0000","last_unstale":"2023-10-07T08:58:38.284462+0000","last_undegraded":"2023-10-07T08:58:38.284462+0000","last_fullsized":"2023-10-07T08:58:38.284462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:08.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275951+0000","last_change":"2023-10-07T08:58:38.272054+0000","last_active":"2023-10-07T08:58:38.275951+0000","last_peered":"2023-10-07T08:58:38.275951+0000","last_clean":"2023-10-07T08:58:38.275951+0000","last_became_active":"2023-10-07T08:58:38.271783+0000","last_became_peered":"2023-10-07T08:58:38.271783+0000","last_unstale":"2023-10-07T08:58:38.275951+0000","last_undegraded":"2023-10-07T08:58:38.275951+0000","last_fullsized":"2023-10-07T08:58:38.275951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251812+0000","last_change":"2023-10-07T08:58:37.270177+0000","last_active":"2023-10-07T08:58:38.251812+0000","last_peered":"2023-10-07T08:58:38.251812+0000","last_clean":"2023-10-07T08:58:38.251812+0000","last_became_active":"2023-10-07T08:58:37.269889+0000","last_became_peered":"2023-10-07T08:58:37.269889+0000","last_unstale":"2023-10-07T08:58:38.251812+0000","last_undegraded":"2023-10-07T08:58:38.251812+0000","last_fullsized":"2023-10-07T08:58:38.251812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273010+0000","last_change":"2023-10-07T08:58:38.265632+0000","last_active":"2023-10-07T08:58:38.273010+0000","last_peered":"2023-10-07T08:58:38.273010+0000","last_clean":"2023-10-07T08:58:38.273010+0000","last_became_active":"2023-10-07T08:58:38.265352+0000","last_became_peered":"2023-10-07T08:58:38.265352+0000","last_unstale":"2023-10-07T08:58:38.273010+0000","last_undegraded":"2023-10-07T08:58:38.273010+0000","last_fullsized":"2023-10-07T08:58:38.273010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257410+0000","last_change":"2023-10-07T08:58:37.270333+0000","last_active":"2023-10-07T08:58:38.257410+0000","last_peered":"2023-10-07T08:58:38.257410+0000","last_clean":"2023-10-07T08:58:38.257410+0000","last_became_active":"2023-10-07T08:58:37.270099+0000","last_became_peered":"2023-10-07T08:58:37.270099+0000","last_unstale":"2023-10-07T08:58:38.257410+0000","last_undegraded":"2023-10-07T08:58:38.257410+0000","last_fullsized":"2023-10-07T08:58:38.257410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:57.902629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275565+0000","last_change":"2023-10-07T08:58:38.272196+0000","last_active":"2023-10-07T08:58:38.275565+0000","last_peered":"2023-10-07T08:58:38.275565+0000","last_clean":"2023-10-07T08:58:38.275565+0000","last_became_active":"2023-10-07T08:58:38.268871+0000","last_became_peered":"2023-10-07T08:58:38.268871+0000","last_unstale":"2023-10-07T08:58:38.275565+0000","last_undegraded":"2023-10-07T08:58:38.275565+0000","last_fullsized":"2023-10-07T08:58:38.275565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:22.840296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272269+0000","last_change":"2023-10-07T08:58:38.265483+0000","last_active":"2023-10-07T08:58:38.272269+0000","last_peered":"2023-10-07T08:58:38.272269+0000","last_clean":"2023-10-07T08:58:38.272269+0000","last_became_active":"2023-10-07T08:58:38.265225+0000","last_became_peered":"2023-10-07T08:58:38.265225+0000","last_unstale":"2023-10-07T08:58:38.272269+0000","last_undegraded":"2023-10-07T08:58:38.272269+0000","last_fullsized":"2023-10-07T08:58:38.272269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260127+0000","last_change":"2023-10-07T08:58:37.265772+0000","last_active":"2023-10-07T08:58:38.260127+0000","last_peered":"2023-10-07T08:58:38.260127+0000","last_clean":"2023-10-07T08:58:38.260127+0000","last_became_active":"2023-10-07T08:58:37.265480+0000","last_became_peered":"2023-10-07T08:58:37.265480+0000","last_unstale":"2023-10-07T08:58:38.260127+0000","last_undegraded":"2023-10-07T08:58:38.260127+0000","last_fullsized":"2023-10-07T08:58:38.260127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277027+0000","last_change":"2023-10-07T08:58:38.267707+0000","last_active":"2023-10-07T08:58:38.277027+0000","last_peered":"2023-10-07T08:58:38.277027+0000","last_clean":"2023-10-07T08:58:38.277027+0000","last_became_active":"2023-10-07T08:58:38.267397+0000","last_became_peered":"2023-10-07T08:58:38.267397+0000","last_unstale":"2023-10-07T08:58:38.277027+0000","last_undegraded":"2023-10-07T08:58:38.277027+0000","last_fullsized":"2023-10-07T08:58:38.277027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:47.055416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.257454+0000","last_change":"2023-10-07T08:58:37.266816+0000","last_active":"2023-10-07T08:58:38.257454+0000","last_peered":"2023-10-07T08:58:38.257454+0000","last_clean":"2023-10-07T08:58:38.257454+0000","last_became_active":"2023-10-07T08:58:37.266529+0000","last_became_peered":"2023-10-07T08:58:37.266529+0000","last_unstale":"2023-10-07T08:58:38.257454+0000","last_undegraded":"2023-10-07T08:58:38.257454+0000","last_fullsized":"2023-10-07T08:58:38.257454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259526+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:58:38.259526+0000","last_peered":"2023-10-07T08:58:38.259526+0000","last_clean":"2023-10-07T08:58:38.259526+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:58:38.259526+0000","last_undegraded":"2023-10-07T08:58:38.259526+0000","last_fullsized":"2023-10-07T08:58:38.259526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.278929+0000","last_change":"2023-10-07T08:58:38.274743+0000","last_active":"2023-10-07T08:58:38.278929+0000","last_peered":"2023-10-07T08:58:38.278929+0000","last_clean":"2023-10-07T08:58:38.278929+0000","last_became_active":"2023-10-07T08:58:38.273665+0000","last_became_peered":"2023-10-07T08:58:38.273665+0000","last_unstale":"2023-10-07T08:58:38.278929+0000","last_undegraded":"2023-10-07T08:58:38.278929+0000","last_fullsized":"2023-10-07T08:58:38.278929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:40.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259654+0000","last_change":"2023-10-07T08:58:37.267054+0000","last_active":"2023-10-07T08:58:38.259654+0000","last_peered":"2023-10-07T08:58:38.259654+0000","last_clean":"2023-10-07T08:58:38.259654+0000","last_became_active":"2023-10-07T08:58:37.266737+0000","last_became_peered":"2023-10-07T08:58:37.266737+0000","last_unstale":"2023-10-07T08:58:38.259654+0000","last_undegraded":"2023-10-07T08:58:38.259654+0000","last_fullsized":"2023-10-07T08:58:38.259654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:21.835890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.261600+0000","last_change":"2023-10-07T08:58:37.265472+0000","last_active":"2023-10-07T08:58:38.261600+0000","last_peered":"2023-10-07T08:58:38.261600+0000","last_clean":"2023-10-07T08:58:38.261600+0000","last_became_active":"2023-10-07T08:58:37.264985+0000","last_became_peered":"2023-10-07T08:58:37.264985+0000","last_unstale":"2023-10-07T08:58:38.261600+0000","last_undegraded":"2023-10-07T08:58:38.261600+0000","last_fullsized":"2023-10-07T08:58:38.261600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.269942+0000","last_change":"2023-10-07T08:58:38.264926+0000","last_active":"2023-10-07T08:58:38.269942+0000","last_peered":"2023-10-07T08:58:38.269942+0000","last_clean":"2023-10-07T08:58:38.269942+0000","last_became_active":"2023-10-07T08:58:38.264654+0000","last_became_peered":"2023-10-07T08:58:38.264654+0000","last_unstale":"2023-10-07T08:58:38.269942+0000","last_undegraded":"2023-10-07T08:58:38.269942+0000","last_fullsized":"2023-10-07T08:58:38.269942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:58:39.261614+0000","last_change":"2023-10-07T08:58:37.261664+0000","last_active":"2023-10-07T08:58:39.261614+0000","last_peered":"2023-10-07T08:58:39.261614+0000","last_clean":"2023-10-07T08:58:39.261614+0000","last_became_active":"2023-10-07T08:58:37.261370+0000","last_became_peered":"2023-10-07T08:58:37.261370+0000","last_unstale":"2023-10-07T08:58:39.261614+0000","last_undegraded":"2023-10-07T08:58:39.261614+0000","last_fullsized":"2023-10-07T08:58:39.261614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276617+0000","last_change":"2023-10-07T08:58:38.264474+0000","last_active":"2023-10-07T08:58:38.276617+0000","last_peered":"2023-10-07T08:58:38.276617+0000","last_clean":"2023-10-07T08:58:38.276617+0000","last_became_active":"2023-10-07T08:58:38.264205+0000","last_became_peered":"2023-10-07T08:58:38.264205+0000","last_unstale":"2023-10-07T08:58:38.276617+0000","last_undegraded":"2023-10-07T08:58:38.276617+0000","last_fullsized":"2023-10-07T08:58:38.276617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283609+0000","last_change":"2023-10-07T08:58:37.265911+0000","last_active":"2023-10-07T08:58:38.283609+0000","last_peered":"2023-10-07T08:58:38.283609+0000","last_clean":"2023-10-07T08:58:38.283609+0000","last_became_active":"2023-10-07T08:58:37.265641+0000","last_became_peered":"2023-10-07T08:58:37.265641+0000","last_unstale":"2023-10-07T08:58:38.283609+0000","last_undegraded":"2023-10-07T08:58:38.283609+0000","last_fullsized":"2023-10-07T08:58:38.283609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277871+0000","last_change":"2023-10-07T08:58:38.270356+0000","last_active":"2023-10-07T08:58:38.277871+0000","last_peered":"2023-10-07T08:58:38.277871+0000","last_clean":"2023-10-07T08:58:38.277871+0000","last_became_active":"2023-10-07T08:58:38.270083+0000","last_became_peered":"2023-10-07T08:58:38.270083+0000","last_unstale":"2023-10-07T08:58:38.277871+0000","last_undegraded":"2023-10-07T08:58:38.277871+0000","last_fullsized":"2023-10-07T08:58:38.277871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:14:21.759445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.259621+0000","last_change":"2023-10-07T08:58:37.271336+0000","last_active":"2023-10-07T08:58:38.259621+0000","last_peered":"2023-10-07T08:58:38.259621+0000","last_clean":"2023-10-07T08:58:38.259621+0000","last_became_active":"2023-10-07T08:58:37.271057+0000","last_became_peered":"2023-10-07T08:58:37.271057+0000","last_unstale":"2023-10-07T08:58:38.259621+0000","last_undegraded":"2023-10-07T08:58:38.259621+0000","last_fullsized":"2023-10-07T08:58:38.259621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:29.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.274310+0000","last_change":"2023-10-07T08:58:38.266393+0000","last_active":"2023-10-07T08:58:38.274310+0000","last_peered":"2023-10-07T08:58:38.274310+0000","last_clean":"2023-10-07T08:58:38.274310+0000","last_became_active":"2023-10-07T08:58:38.266131+0000","last_became_peered":"2023-10-07T08:58:38.266131+0000","last_unstale":"2023-10-07T08:58:38.274310+0000","last_undegraded":"2023-10-07T08:58:38.274310+0000","last_fullsized":"2023-10-07T08:58:38.274310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:57.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.252634+0000","last_change":"2023-10-07T08:58:37.265724+0000","last_active":"2023-10-07T08:58:38.252634+0000","last_peered":"2023-10-07T08:58:38.252634+0000","last_clean":"2023-10-07T08:58:38.252634+0000","last_became_active":"2023-10-07T08:58:37.265218+0000","last_became_peered":"2023-10-07T08:58:37.265218+0000","last_unstale":"2023-10-07T08:58:38.252634+0000","last_undegraded":"2023-10-07T08:58:38.252634+0000","last_fullsized":"2023-10-07T08:58:38.252634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:14.391986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.268873+0000","last_change":"2023-10-07T08:58:38.259788+0000","last_active":"2023-10-07T08:58:38.268873+0000","last_peered":"2023-10-07T08:58:38.268873+0000","last_clean":"2023-10-07T08:58:38.268873+0000","last_became_active":"2023-10-07T08:58:38.259490+0000","last_became_peered":"2023-10-07T08:58:38.259490+0000","last_unstale":"2023-10-07T08:58:38.268873+0000","last_undegraded":"2023-10-07T08:58:38.268873+0000","last_fullsized":"2023-10-07T08:58:38.268873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.251753+0000","last_change":"2023-10-07T08:58:37.269182+0000","last_active":"2023-10-07T08:58:38.251753+0000","last_peered":"2023-10-07T08:58:38.251753+0000","last_clean":"2023-10-07T08:58:38.251753+0000","last_became_active":"2023-10-07T08:58:37.268876+0000","last_became_peered":"2023-10-07T08:58:37.268876+0000","last_unstale":"2023-10-07T08:58:38.251753+0000","last_undegraded":"2023-10-07T08:58:38.251753+0000","last_fullsized":"2023-10-07T08:58:38.251753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:47.176445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.280853+0000","last_change":"2023-10-07T08:58:38.277598+0000","last_active":"2023-10-07T08:58:38.280853+0000","last_peered":"2023-10-07T08:58:38.280853+0000","last_clean":"2023-10-07T08:58:38.280853+0000","last_became_active":"2023-10-07T08:58:38.277298+0000","last_became_peered":"2023-10-07T08:58:38.277298+0000","last_unstale":"2023-10-07T08:58:38.280853+0000","last_undegraded":"2023-10-07T08:58:38.280853+0000","last_fullsized":"2023-10-07T08:58:38.280853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284373+0000","last_change":"2023-10-07T08:58:37.267496+0000","last_active":"2023-10-07T08:58:38.284373+0000","last_peered":"2023-10-07T08:58:38.284373+0000","last_clean":"2023-10-07T08:58:38.284373+0000","last_became_active":"2023-10-07T08:58:37.267211+0000","last_became_peered":"2023-10-07T08:58:37.267211+0000","last_unstale":"2023-10-07T08:58:38.284373+0000","last_undegraded":"2023-10-07T08:58:38.284373+0000","last_fullsized":"2023-10-07T08:58:38.284373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.273124+0000","last_change":"2023-10-07T08:58:38.270706+0000","last_active":"2023-10-07T08:58:38.273124+0000","last_peered":"2023-10-07T08:58:38.273124+0000","last_clean":"2023-10-07T08:58:38.273124+0000","last_became_active":"2023-10-07T08:58:38.270439+0000","last_became_peered":"2023-10-07T08:58:38.270439+0000","last_unstale":"2023-10-07T08:58:38.273124+0000","last_undegraded":"2023-10-07T08:58:38.273124+0000","last_fullsized":"2023-10-07T08:58:38.273124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.255965+0000","last_change":"2023-10-07T08:58:37.266819+0000","last_active":"2023-10-07T08:58:38.255965+0000","last_peered":"2023-10-07T08:58:38.255965+0000","last_clean":"2023-10-07T08:58:38.255965+0000","last_became_active":"2023-10-07T08:58:37.266526+0000","last_became_peered":"2023-10-07T08:58:37.266526+0000","last_unstale":"2023-10-07T08:58:38.255965+0000","last_undegraded":"2023-10-07T08:58:38.255965+0000","last_fullsized":"2023-10-07T08:58:38.255965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:55.451014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.279068+0000","last_change":"2023-10-07T08:58:38.274546+0000","last_active":"2023-10-07T08:58:38.279068+0000","last_peered":"2023-10-07T08:58:38.279068+0000","last_clean":"2023-10-07T08:58:38.279068+0000","last_became_active":"2023-10-07T08:58:38.274288+0000","last_became_peered":"2023-10-07T08:58:38.274288+0000","last_unstale":"2023-10-07T08:58:38.279068+0000","last_undegraded":"2023-10-07T08:58:38.279068+0000","last_fullsized":"2023-10-07T08:58:38.279068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.284614+0000","last_change":"2023-10-07T08:58:37.261183+0000","last_active":"2023-10-07T08:58:38.284614+0000","last_peered":"2023-10-07T08:58:38.284614+0000","last_clean":"2023-10-07T08:58:38.284614+0000","last_became_active":"2023-10-07T08:58:37.260954+0000","last_became_peered":"2023-10-07T08:58:37.260954+0000","last_unstale":"2023-10-07T08:58:38.284614+0000","last_undegraded":"2023-10-07T08:58:38.284614+0000","last_fullsized":"2023-10-07T08:58:38.284614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:22:52.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.267238+0000","last_change":"2023-10-07T08:58:38.264621+0000","last_active":"2023-10-07T08:58:38.267238+0000","last_peered":"2023-10-07T08:58:38.267238+0000","last_clean":"2023-10-07T08:58:38.267238+0000","last_became_active":"2023-10-07T08:58:38.264344+0000","last_became_peered":"2023-10-07T08:58:38.264344+0000","last_unstale":"2023-10-07T08:58:38.267238+0000","last_undegraded":"2023-10-07T08:58:38.267238+0000","last_fullsized":"2023-10-07T08:58:38.267238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:02.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.281550+0000","last_change":"2023-10-07T08:58:37.267477+0000","last_active":"2023-10-07T08:58:38.281550+0000","last_peered":"2023-10-07T08:58:38.281550+0000","last_clean":"2023-10-07T08:58:38.281550+0000","last_became_active":"2023-10-07T08:58:37.267186+0000","last_became_peered":"2023-10-07T08:58:37.267186+0000","last_unstale":"2023-10-07T08:58:38.281550+0000","last_undegraded":"2023-10-07T08:58:38.281550+0000","last_fullsized":"2023-10-07T08:58:38.281550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:36.238191+0000","last_clean_scrub_stamp":"2023-10-07T08:58:36.238191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:56.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283571+0000","last_change":"2023-10-07T08:58:38.278356+0000","last_active":"2023-10-07T08:58:38.283571+0000","last_peered":"2023-10-07T08:58:38.283571+0000","last_clean":"2023-10-07T08:58:38.283571+0000","last_became_active":"2023-10-07T08:58:38.277900+0000","last_became_peered":"2023-10-07T08:58:38.277900+0000","last_unstale":"2023-10-07T08:58:38.283571+0000","last_undegraded":"2023-10-07T08:58:38.283571+0000","last_fullsized":"2023-10-07T08:58:38.283571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.349602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.283653+0000","last_change":"2023-10-07T08:58:38.276244+0000","last_active":"2023-10-07T08:58:38.283653+0000","last_peered":"2023-10-07T08:58:38.283653+0000","last_clean":"2023-10-07T08:58:38.283653+0000","last_became_active":"2023-10-07T08:58:38.275899+0000","last_became_peered":"2023-10-07T08:58:38.275899+0000","last_unstale":"2023-10-07T08:58:38.283653+0000","last_undegraded":"2023-10-07T08:58:38.283653+0000","last_fullsized":"2023-10-07T08:58:38.283653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:24.455615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.272163+0000","last_change":"2023-10-07T08:58:38.269027+0000","last_active":"2023-10-07T08:58:38.272163+0000","last_peered":"2023-10-07T08:58:38.272163+0000","last_clean":"2023-10-07T08:58:38.272163+0000","last_became_active":"2023-10-07T08:58:38.268305+0000","last_became_peered":"2023-10-07T08:58:38.268305+0000","last_unstale":"2023-10-07T08:58:38.272163+0000","last_undegraded":"2023-10-07T08:58:38.272163+0000","last_fullsized":"2023-10-07T08:58:38.272163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:39.609895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266087+0000","last_change":"2023-10-07T08:58:38.263865+0000","last_active":"2023-10-07T08:58:38.266087+0000","last_peered":"2023-10-07T08:58:38.266087+0000","last_clean":"2023-10-07T08:58:38.266087+0000","last_became_active":"2023-10-07T08:58:38.263605+0000","last_became_peered":"2023-10-07T08:58:38.263605+0000","last_unstale":"2023-10-07T08:58:38.266087+0000","last_undegraded":"2023-10-07T08:58:38.266087+0000","last_fullsized":"2023-10-07T08:58:38.266087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:19.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277986+0000","last_change":"2023-10-07T08:58:38.272673+0000","last_active":"2023-10-07T08:58:38.277986+0000","last_peered":"2023-10-07T08:58:38.277986+0000","last_clean":"2023-10-07T08:58:38.277986+0000","last_became_active":"2023-10-07T08:58:38.272332+0000","last_became_peered":"2023-10-07T08:58:38.272332+0000","last_unstale":"2023-10-07T08:58:38.277986+0000","last_undegraded":"2023-10-07T08:58:38.277986+0000","last_fullsized":"2023-10-07T08:58:38.277986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:39.064590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276971+0000","last_change":"2023-10-07T08:58:38.266586+0000","last_active":"2023-10-07T08:58:38.276971+0000","last_peered":"2023-10-07T08:58:38.276971+0000","last_clean":"2023-10-07T08:58:38.276971+0000","last_became_active":"2023-10-07T08:58:38.266197+0000","last_became_peered":"2023-10-07T08:58:38.266197+0000","last_unstale":"2023-10-07T08:58:38.276971+0000","last_undegraded":"2023-10-07T08:58:38.276971+0000","last_fullsized":"2023-10-07T08:58:38.276971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:24.850956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.260868+0000","last_change":"2023-10-07T08:58:38.259089+0000","last_active":"2023-10-07T08:58:38.260868+0000","last_peered":"2023-10-07T08:58:38.260868+0000","last_clean":"2023-10-07T08:58:38.260868+0000","last_became_active":"2023-10-07T08:58:38.258801+0000","last_became_peered":"2023-10-07T08:58:38.258801+0000","last_unstale":"2023-10-07T08:58:38.260868+0000","last_undegraded":"2023-10-07T08:58:38.260868+0000","last_fullsized":"2023-10-07T08:58:38.260868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:38.396361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275061+0000","last_change":"2023-10-07T08:58:38.271464+0000","last_active":"2023-10-07T08:58:38.275061+0000","last_peered":"2023-10-07T08:58:38.275061+0000","last_clean":"2023-10-07T08:58:38.275061+0000","last_became_active":"2023-10-07T08:58:38.271181+0000","last_became_peered":"2023-10-07T08:58:38.271181+0000","last_unstale":"2023-10-07T08:58:38.275061+0000","last_undegraded":"2023-10-07T08:58:38.275061+0000","last_fullsized":"2023-10-07T08:58:38.275061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276652+0000","last_change":"2023-10-07T08:58:38.265753+0000","last_active":"2023-10-07T08:58:38.276652+0000","last_peered":"2023-10-07T08:58:38.276652+0000","last_clean":"2023-10-07T08:58:38.276652+0000","last_became_active":"2023-10-07T08:58:38.265442+0000","last_became_peered":"2023-10-07T08:58:38.265442+0000","last_unstale":"2023-10-07T08:58:38.276652+0000","last_undegraded":"2023-10-07T08:58:38.276652+0000","last_fullsized":"2023-10-07T08:58:38.276652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:02.374949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.265756+0000","last_change":"2023-10-07T08:58:38.263382+0000","last_active":"2023-10-07T08:58:38.265756+0000","last_peered":"2023-10-07T08:58:38.265756+0000","last_clean":"2023-10-07T08:58:38.265756+0000","last_became_active":"2023-10-07T08:58:38.263121+0000","last_became_peered":"2023-10-07T08:58:38.263121+0000","last_unstale":"2023-10-07T08:58:38.265756+0000","last_undegraded":"2023-10-07T08:58:38.265756+0000","last_fullsized":"2023-10-07T08:58:38.265756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:03.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.276899+0000","last_change":"2023-10-07T08:58:38.265927+0000","last_active":"2023-10-07T08:58:38.276899+0000","last_peered":"2023-10-07T08:58:38.276899+0000","last_clean":"2023-10-07T08:58:38.276899+0000","last_became_active":"2023-10-07T08:58:38.265607+0000","last_became_peered":"2023-10-07T08:58:38.265607+0000","last_unstale":"2023-10-07T08:58:38.276899+0000","last_undegraded":"2023-10-07T08:58:38.276899+0000","last_fullsized":"2023-10-07T08:58:38.276899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:22.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.266109+0000","last_change":"2023-10-07T08:58:38.264874+0000","last_active":"2023-10-07T08:58:38.266109+0000","last_peered":"2023-10-07T08:58:38.266109+0000","last_clean":"2023-10-07T08:58:38.266109+0000","last_became_active":"2023-10-07T08:58:38.264577+0000","last_became_peered":"2023-10-07T08:58:38.264577+0000","last_unstale":"2023-10-07T08:58:38.266109+0000","last_undegraded":"2023-10-07T08:58:38.266109+0000","last_fullsized":"2023-10-07T08:58:38.266109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:22.228920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.277961+0000","last_change":"2023-10-07T08:58:38.270592+0000","last_active":"2023-10-07T08:58:38.277961+0000","last_peered":"2023-10-07T08:58:38.277961+0000","last_clean":"2023-10-07T08:58:38.277961+0000","last_became_active":"2023-10-07T08:58:38.270016+0000","last_became_peered":"2023-10-07T08:58:38.270016+0000","last_unstale":"2023-10-07T08:58:38.277961+0000","last_undegraded":"2023-10-07T08:58:38.277961+0000","last_fullsized":"2023-10-07T08:58:38.277961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:58:38.275054+0000","last_change":"2023-10-07T08:58:38.271588+0000","last_active":"2023-10-07T08:58:38.275054+0000","last_peered":"2023-10-07T08:58:38.275054+0000","last_clean":"2023-10-07T08:58:38.275054+0000","last_became_active":"2023-10-07T08:58:38.271197+0000","last_became_peered":"2023-10-07T08:58:38.271197+0000","last_unstale":"2023-10-07T08:58:38.275054+0000","last_undegraded":"2023-10-07T08:58:38.275054+0000","last_fullsized":"2023-10-07T08:58:38.275054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:37.242597+0000","last_clean_scrub_stamp":"2023-10-07T08:58:37.242597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:45:38.483723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7040000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9979999999999993}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.569}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:58:47.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-07T08:58:47.380 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-07T08:58:47.380 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-07T08:58:47.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-07T08:58:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.532+0000 7efce8f9f700 1 Processor -- start 2023-10-07T08:58:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.532+0000 7efce8f9f700 1 -- start start 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce8f9f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efce40cd910 0x7efce40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce8f9f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efce40b55a0 0x7efce40ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce8f9f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce40b5b00 con 0x7efce4159ec0 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce8f9f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce40b5da0 con 0x7efce40b55a0 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce8f9f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce40b6080 con 0x7efce40cd910 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efce40b55a0 0x7efce40ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efce40b55a0 0x7efce40ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60730/0 (socket says 172.21.15.46:60730) 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce2d9d700 1 -- 172.21.15.46:0/1012992889 learned_addr learned my addr 172.21.15.46:0/1012992889 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce259c700 1 --1- 172.21.15.46:0/1012992889 >> v1:172.21.15.133:6789/0 conn(0x7efce4159ec0 0x7efce40b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39696/0 (socket says 172.21.15.46:39696) 2023-10-07T08:58:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.533+0000 7efce1d9b700 1 --2- 172.21.15.46:0/1012992889 >> v2:172.21.15.133:3300/0 conn(0x7efce40cd910 0x7efce40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce2d9d700 1 -- 172.21.15.46:0/1012992889 >> v2:172.21.15.133:3300/0 conn(0x7efce40cd910 msgr2=0x7efce40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce2d9d700 1 --2- 172.21.15.46:0/1012992889 >> v2:172.21.15.133:3300/0 conn(0x7efce40cd910 0x7efce40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce2d9d700 1 -- 172.21.15.46:0/1012992889 >> v1:172.21.15.133:6789/0 conn(0x7efce4159ec0 legacy=0x7efce40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce2d9d700 1 -- 172.21.15.46:0/1012992889 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40cc100 con 0x7efce40b55a0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce159a700 1 -- 172.21.15.46:0/1012992889 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763035167 0 0) 0x7efce40b5b00 con 0x7efce4159ec0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce2d9d700 1 --2- 172.21.15.46:0/1012992889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce40b55a0 0x7efce40ce880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009f20 tx=0x7efcd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe60683bdd38ac68 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce159a700 1 -- 172.21.15.46:0/1012992889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400e070 con 0x7efce40b55a0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce159a700 1 -- 172.21.15.46:0/1012992889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd400b990 con 0x7efce40b55a0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce159a700 1 -- 172.21.15.46:0/1012992889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40092e0 con 0x7efce40b55a0 2023-10-07T08:58:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce8f9f700 1 -- 172.21.15.46:0/1012992889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce40b55a0 msgr2=0x7efce40ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce8f9f700 1 --2- 172.21.15.46:0/1012992889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce40b55a0 0x7efce40ce880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009f20 tx=0x7efcd4009840 comp rx=0 tx=0).stop 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.534+0000 7efce8f9f700 1 -- 172.21.15.46:0/1012992889 shutdown_connections 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.535+0000 7efce8f9f700 1 --2- 172.21.15.46:0/1012992889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce40b55a0 0x7efce40ce880 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.535+0000 7efce8f9f700 1 --2- 172.21.15.46:0/1012992889 >> v2:172.21.15.133:3300/0 conn(0x7efce40cd910 0x7efce40ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.535+0000 7efce8f9f700 1 -- 172.21.15.46:0/1012992889 >> 172.21.15.46:0/1012992889 conn(0x7efce40999f0 msgr2=0x7efce40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.535+0000 7efce8f9f700 1 -- 172.21.15.46:0/1012992889 shutdown_connections 2023-10-07T08:58:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.535+0000 7efce8f9f700 1 -- 172.21.15.46:0/1012992889 wait complete. 2023-10-07T08:58:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 Processor -- start 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 -- start start 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce40b55a0 0x7efce409a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce4159ec0 0x7efce416a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40688d0 con 0x7efce4156ae0 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce4156f60 con 0x7efce40b55a0 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce8f9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce4068b00 con 0x7efce4159ec0 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60734/0 (socket says 172.21.15.46:60734) 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.536+0000 7efce2d9d700 1 -- 172.21.15.46:0/3130891468 learned_addr learned my addr 172.21.15.46:0/3130891468 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce259c700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce40b55a0 0x7efce409a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce1d9b700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce4159ec0 0x7efce416a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 -- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce4159ec0 msgr2=0x7efce416a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce4159ec0 0x7efce416a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 -- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce40b55a0 msgr2=0x7efce409a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce40b55a0 0x7efce409a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 -- 172.21.15.46:0/3130891468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009ae0 con 0x7efce4156ae0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce2d9d700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009ab0 tx=0x7efcd4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4007c20 con 0x7efce4156ae0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4007da0 con 0x7efce4156ae0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce4068de0 con 0x7efce4156ae0 2023-10-07T08:58:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd401c660 con 0x7efce4156ae0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.537+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce40693a0 con 0x7efce4156ae0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.538+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4063c90 con 0x7efce4156ae0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.538+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcd401c9d0 con 0x7efce4156ae0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.539+0000 7efcda7fc700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 0x7efcc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.539+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcd4085e70 con 0x7efce4156ae0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.539+0000 7efce259c700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 0x7efcc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.539+0000 7efce259c700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 0x7efcc40693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcdc000fb0 tx=0x7efcdc007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.543+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcd40530e0 con 0x7efce4156ae0 2023-10-07T08:58:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.776+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efce404c3c0 con 0x7efce4156ae0 2023-10-07T08:58:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.776+0000 7efcda7fc700 1 -- 172.21.15.46:0/3130891468 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efcd4056700 con 0x7efce4156ae0 2023-10-07T08:58:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:47.777 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 msgr2=0x7efcc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 0x7efcc40693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcdc000fb0 tx=0x7efcdc007ba0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 msgr2=0x7efce4068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009ab0 tx=0x7efcd4018000 comp rx=0 tx=0).stop 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 shutdown_connections 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcc4066f30 0x7efcc40693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce4156ae0 0x7efce4068390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce40b55a0 0x7efce409a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 --2- 172.21.15.46:0/3130891468 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce4159ec0 0x7efce416a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 >> 172.21.15.46:0/3130891468 conn(0x7efce40999f0 msgr2=0x7efce40cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:47.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 shutdown_connections 2023-10-07T08:58:47.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.778+0000 7efce8f9f700 1 -- 172.21.15.46:0/3130891468 wait complete. 2023-10-07T08:58:47.790 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-07T08:58:47.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:47.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.910+0000 7f4b46d5a700 1 Processor -- start 2023-10-07T08:58:47.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.910+0000 7f4b46d5a700 1 -- start start 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b46d5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b4006bcd0 0x7f4b40140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b46d5a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b4006c0a0 0x7f4b40141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b46d5a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4015c2a0 con 0x7f4b400c8e00 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b46d5a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4015b690 con 0x7f4b4006c0a0 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b46d5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4015b970 con 0x7f4b4006bcd0 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b3ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b4006c0a0 0x7f4b40141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b452f7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4b400c8e00 0x7f4b400c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54820/0 (socket says 172.21.15.46:54820) 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.911+0000 7f4b452f7700 1 -- 172.21.15.46:0/66659583 learned_addr learned my addr 172.21.15.46:0/66659583 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b44af6700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b4006bcd0 0x7f4b40140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3ffff700 1 -- 172.21.15.46:0/66659583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b4006bcd0 msgr2=0x7f4b40140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3ffff700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b4006bcd0 0x7f4b40140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3ffff700 1 -- 172.21.15.46:0/66659583 >> v1:172.21.15.46:6789/0 conn(0x7f4b400c8e00 legacy=0x7f4b400c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3ffff700 1 -- 172.21.15.46:0/66659583 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4015bc50 con 0x7f4b4006c0a0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3f7fe700 1 -- 172.21.15.46:0/66659583 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948120111 0 0) 0x7f4b4015c2a0 con 0x7f4b400c8e00 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3ffff700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006c0a0 0x7f4b40141330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b300098e0 tx=0x7f4b300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c2f24ca45e0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3f7fe700 1 -- 172.21.15.46:0/66659583 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000b640 con 0x7f4b4006c0a0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3f7fe700 1 -- 172.21.15.46:0/66659583 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3000b7a0 con 0x7f4b4006c0a0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.912+0000 7f4b3f7fe700 1 -- 172.21.15.46:0/66659583 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000bb40 con 0x7f4b4006c0a0 2023-10-07T08:58:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 -- 172.21.15.46:0/66659583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006c0a0 msgr2=0x7f4b40141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006c0a0 0x7f4b40141330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b300098e0 tx=0x7f4b300091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 -- 172.21.15.46:0/66659583 shutdown_connections 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b4006bcd0 0x7f4b40140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/66659583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006c0a0 0x7f4b40141330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 -- 172.21.15.46:0/66659583 >> 172.21.15.46:0/66659583 conn(0x7f4b400ce600 msgr2=0x7f4b400cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 -- 172.21.15.46:0/66659583 shutdown_connections 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.913+0000 7f4b46d5a700 1 -- 172.21.15.46:0/66659583 wait complete. 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.914+0000 7f4b46d5a700 1 Processor -- start 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.914+0000 7f4b46d5a700 1 -- start start 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4006c0a0 0x7f4b400c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b400c8e00 0x7f4b400c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b400b1ae0 con 0x7f4b4006bcd0 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4013fa20 con 0x7f4b4006c0a0 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4013fd00 con 0x7f4b400c8e00 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60744/0 (socket says 172.21.15.46:60744) 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 -- 172.21.15.46:0/336015970 learned_addr learned my addr 172.21.15.46:0/336015970 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 -- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b400c8e00 msgr2=0x7f4b400c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b400c8e00 0x7f4b400c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 -- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4006c0a0 msgr2=0x7f4b400c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:47.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4006c0a0 0x7f4b400c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 -- 172.21.15.46:0/336015970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30009420 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b44af6700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009e50 tx=0x7f4b3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800cc20 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3800f040 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4013ffe0 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38014480 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.915+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4013c390 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.916+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40140170 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.917+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b380147f0 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.917+0000 7f4b3cff9700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 0x7f4b200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.917+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b38084f70 con 0x7f4b4006bcd0 2023-10-07T08:58:47.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.917+0000 7f4b3ffff700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 0x7f4b200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:47.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.918+0000 7f4b3ffff700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 0x7f4b200693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b4006ba30 tx=0x7f4b30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:47.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:47.921+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b380521e0 con 0x7f4b4006bcd0 2023-10-07T08:58:48.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.116+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b4004c3c0 con 0x7f4b4006bcd0 2023-10-07T08:58:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.117+0000 7f4b3cff9700 1 -- 172.21.15.46:0/336015970 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4b38055800 con 0x7f4b4006bcd0 2023-10-07T08:58:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:48.118 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 msgr2=0x7f4b200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 0x7f4b200693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b4006ba30 tx=0x7f4b30017000 comp rx=0 tx=0).stop 2023-10-07T08:58:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 msgr2=0x7f4b4013be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009e50 tx=0x7f4b3800b040 comp rx=0 tx=0).stop 2023-10-07T08:58:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 shutdown_connections 2023-10-07T08:58:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b20066f30 0x7f4b200693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b400c8e00 0x7f4b400c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4006bcd0 0x7f4b4013be50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 --2- 172.21.15.46:0/336015970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4006c0a0 0x7f4b400c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 >> 172.21.15.46:0/336015970 conn(0x7f4b400ce600 msgr2=0x7f4b400cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 shutdown_connections 2023-10-07T08:58:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.119+0000 7f4b46d5a700 1 -- 172.21.15.46:0/336015970 wait complete. 2023-10-07T08:58:48.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:58:48.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:58:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.253+0000 7f6042840700 1 Processor -- start 2023-10-07T08:58:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 -- start start 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f603c159b10 0x7f603c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f603c15d730 0x7f603c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c159ee0 0x7f603c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0c74b0 con 0x7f603c15d730 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c15e0e0 con 0x7f603c159b10 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.254+0000 7f6042840700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c8700 con 0x7f603c159ee0 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f603c15d730 0x7f603c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f603c15d730 0x7f603c15dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60754/0 (socket says 172.21.15.46:60754) 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 -- 172.21.15.46:0/3894448050 learned_addr learned my addr 172.21.15.46:0/3894448050 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f603bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f603c159b10 0x7f603c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6040ddd700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c159ee0 0x7f603c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 -- 172.21.15.46:0/3894448050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c159ee0 msgr2=0x7f603c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c159ee0 0x7f603c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 -- 172.21.15.46:0/3894448050 >> v2:172.21.15.133:3300/0 conn(0x7f603c159b10 msgr2=0x7f603c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 --2- 172.21.15.46:0/3894448050 >> v2:172.21.15.133:3300/0 conn(0x7f603c159b10 0x7f603c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 -- 172.21.15.46:0/3894448050 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0c9070 con 0x7f603c15d730 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f6033fff700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c15d730 0x7f603c15dba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f603c063e90 tx=0x7f6024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf9f74649ce0109 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f603b7fe700 1 -- 172.21.15.46:0/3894448050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400b6d0 con 0x7f603c15d730 2023-10-07T08:58:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f603b7fe700 1 -- 172.21.15.46:0/3894448050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602400b830 con 0x7f603c15d730 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.255+0000 7f603b7fe700 1 -- 172.21.15.46:0/3894448050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400bbf0 con 0x7f603c15d730 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 -- 172.21.15.46:0/3894448050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c15d730 msgr2=0x7f603c15dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c15d730 0x7f603c15dba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f603c063e90 tx=0x7f6024009250 comp rx=0 tx=0).stop 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 -- 172.21.15.46:0/3894448050 shutdown_connections 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c159ee0 0x7f603c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 --2- 172.21.15.46:0/3894448050 >> v2:172.21.15.133:3300/0 conn(0x7f603c159b10 0x7f603c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 --2- 172.21.15.46:0/3894448050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c15d730 0x7f603c15dba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 -- 172.21.15.46:0/3894448050 >> 172.21.15.46:0/3894448050 conn(0x7f603c0c9870 msgr2=0x7f603c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 -- 172.21.15.46:0/3894448050 shutdown_connections 2023-10-07T08:58:48.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.256+0000 7f6042840700 1 -- 172.21.15.46:0/3894448050 wait complete. 2023-10-07T08:58:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.257+0000 7f6042840700 1 Processor -- start 2023-10-07T08:58:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.257+0000 7f6042840700 1 -- start start 2023-10-07T08:58:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f603c159ee0 0x7f603c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c15d730 0x7f603c0c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0b0090 con 0x7f603c159b10 2023-10-07T08:58:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c4c50 con 0x7f603c159ee0 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c4f30 con 0x7f603c15d730 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60756/0 (socket says 172.21.15.46:60756) 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 -- 172.21.15.46:0/602176601 learned_addr learned my addr 172.21.15.46:0/602176601 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6033fff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f603c159ee0 0x7f603c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6040ddd700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c15d730 0x7f603c0c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 -- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c15d730 msgr2=0x7f603c0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c15d730 0x7f603c0c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 -- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f603c159ee0 msgr2=0x7f603c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f603c159ee0 0x7f603c0c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 -- 172.21.15.46:0/602176601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240094f0 con 0x7f603c159b10 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f603bfff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f602c00ec80 tx=0x7f602c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00c9d0 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00cb30 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0afd20 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c013470 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.258+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c148e90 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.259+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c04c3c0 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.260+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f602c013820 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.260+0000 7f6038ff9700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.260+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f602c0848c0 con 0x7f603c159b10 2023-10-07T08:58:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.260+0000 7f6033fff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.261+0000 7f6033fff700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 0x7f601c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f603c063e90 tx=0x7f6024017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.264+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f602c051b30 con 0x7f603c159b10 2023-10-07T08:58:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.462+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f603c157420 con 0x7f603c159b10 2023-10-07T08:58:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.462+0000 7f6038ff9700 1 -- 172.21.15.46:0/602176601 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f602c055150 con 0x7f603c159b10 2023-10-07T08:58:48.463 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:58:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 msgr2=0x7f601c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 0x7f601c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f603c063e90 tx=0x7f6024017000 comp rx=0 tx=0).stop 2023-10-07T08:58:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 msgr2=0x7f603c148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f602c00ec80 tx=0x7f602c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 shutdown_connections 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f603c15d730 0x7f603c0c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f603c159b10 0x7f603c148950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 --2- 172.21.15.46:0/602176601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f603c159ee0 0x7f603c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 >> 172.21.15.46:0/602176601 conn(0x7f603c0c9870 msgr2=0x7f603c1547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 shutdown_connections 2023-10-07T08:58:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.465+0000 7f6042840700 1 -- 172.21.15.46:0/602176601 wait complete. 2023-10-07T08:58:48.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:58:48.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.598+0000 7f7ac4141700 1 Processor -- start 2023-10-07T08:58:48.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.598+0000 7f7ac4141700 1 -- start start 2023-10-07T08:58:48.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac4141700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7abc159890 0x7f7abc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac4141700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7abc159c60 0x7f7abc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac4141700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc15a160 con 0x7f7abc15db10 2023-10-07T08:58:48.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac4141700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc15df50 con 0x7f7abc159c60 2023-10-07T08:58:48.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac4141700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0d13a0 con 0x7f7abc159890 2023-10-07T08:58:48.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac16dc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7abc159c60 0x7f7abc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac26de700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7abc15db10 0x7f7abc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54822/0 (socket says 172.21.15.46:54822) 2023-10-07T08:58:48.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.599+0000 7f7ac26de700 1 -- 172.21.15.46:0/54192124 learned_addr learned my addr 172.21.15.46:0/54192124 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:48.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac1edd700 1 --2- 172.21.15.46:0/54192124 >> v2:172.21.15.133:3300/0 conn(0x7f7abc159890 0x7f7abc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac16dc700 1 -- 172.21.15.46:0/54192124 >> v2:172.21.15.133:3300/0 conn(0x7f7abc159890 msgr2=0x7f7abc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac16dc700 1 --2- 172.21.15.46:0/54192124 >> v2:172.21.15.133:3300/0 conn(0x7f7abc159890 0x7f7abc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac16dc700 1 -- 172.21.15.46:0/54192124 >> v1:172.21.15.46:6789/0 conn(0x7f7abc15db10 legacy=0x7f7abc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac16dc700 1 -- 172.21.15.46:0/54192124 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc15e140 con 0x7f7abc159c60 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac0edb700 1 -- 172.21.15.46:0/54192124 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469916017 0 0) 0x7f7abc15a160 con 0x7f7abc15db10 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac16dc700 1 --2- 172.21.15.46:0/54192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc15d5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0d1090 tx=0x7f7ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4037821cfaf28d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac0edb700 1 -- 172.21.15.46:0/54192124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000b6b0 con 0x7f7abc159c60 2023-10-07T08:58:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac0edb700 1 -- 172.21.15.46:0/54192124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab000b810 con 0x7f7abc159c60 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac0edb700 1 -- 172.21.15.46:0/54192124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000bbb0 con 0x7f7abc159c60 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 -- 172.21.15.46:0/54192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 msgr2=0x7f7abc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 --2- 172.21.15.46:0/54192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc15d5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0d1090 tx=0x7f7ab00091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 -- 172.21.15.46:0/54192124 shutdown_connections 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 --2- 172.21.15.46:0/54192124 >> v2:172.21.15.133:3300/0 conn(0x7f7abc159890 0x7f7abc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 --2- 172.21.15.46:0/54192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc15d5d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.600+0000 7f7ac4141700 1 -- 172.21.15.46:0/54192124 >> 172.21.15.46:0/54192124 conn(0x7f7abc068e20 msgr2=0x7f7abc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.601+0000 7f7ac4141700 1 -- 172.21.15.46:0/54192124 shutdown_connections 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.601+0000 7f7ac4141700 1 -- 172.21.15.46:0/54192124 wait complete. 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 Processor -- start 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 -- start start 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7abc159890 0x7f7abc13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 0x7f7abc1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0cd7b0 con 0x7f7abc159c60 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b2d50 con 0x7f7abc15db10 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac4141700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b2a70 con 0x7f7abc159890 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.602+0000 7f7ac16dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60774/0 (socket says 172.21.15.46:60774) 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 -- 172.21.15.46:0/3778282670 learned_addr learned my addr 172.21.15.46:0/3778282670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac1edd700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7abc159890 0x7f7abc13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac26de700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 0x7f7abc1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 -- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7abc159890 msgr2=0x7f7abc13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7abc159890 0x7f7abc13f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 -- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 msgr2=0x7f7abc1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 0x7f7abc1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 -- 172.21.15.46:0/3778282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0009420 con 0x7f7abc159c60 2023-10-07T08:58:48.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac26de700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 0x7f7abc1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac16dc700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7abc070e20 tx=0x7f7ab0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0011420 con 0x7f7abc159c60 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0011580 con 0x7f7abc159c60 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0cd160 con 0x7f7abc159c60 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0011940 con 0x7f7abc159c60 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.603+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0b1d00 con 0x7f7abc159c60 2023-10-07T08:58:48.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.604+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0cd920 con 0x7f7abc159c60 2023-10-07T08:58:48.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.605+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ab0011d30 con 0x7f7abc159c60 2023-10-07T08:58:48.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.605+0000 7f7ab9ffb700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 0x7f7aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.605+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ab0085f90 con 0x7f7abc159c60 2023-10-07T08:58:48.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.605+0000 7f7ac1edd700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 0x7f7aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.606+0000 7f7ac1edd700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 0x7f7aa80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4007460 tx=0x7f7ab400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.609+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab00b75a0 con 0x7f7abc159c60 2023-10-07T08:58:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.800+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7abc04c3c0 con 0x7f7abc159c60 2023-10-07T08:58:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.800+0000 7f7ab9ffb700 1 -- 172.21.15.46:0/3778282670 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ab0053200 con 0x7f7abc159c60 2023-10-07T08:58:48.801 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 msgr2=0x7f7aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 0x7f7aa80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4007460 tx=0x7f7ab400b040 comp rx=0 tx=0).stop 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 msgr2=0x7f7abc157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7abc070e20 tx=0x7f7ab0017000 comp rx=0 tx=0).stop 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 shutdown_connections 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7aa8066f30 0x7f7aa80693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7abc15db10 0x7f7abc1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7abc159890 0x7f7abc13f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 --2- 172.21.15.46:0/3778282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7abc159c60 0x7f7abc157b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 >> 172.21.15.46:0/3778282670 conn(0x7f7abc068e20 msgr2=0x7f7abc1536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 shutdown_connections 2023-10-07T08:58:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.803+0000 7f7ac4141700 1 -- 172.21.15.46:0/3778282670 wait complete. 2023-10-07T08:58:48.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:58:48.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.936+0000 7ffa819c8700 1 Processor -- start 2023-10-07T08:58:48.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.936+0000 7ffa819c8700 1 -- start start 2023-10-07T08:58:48.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa819c8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa7c159c60 0x7ffa7c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa819c8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c15a160 con 0x7ffa7c15db10 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa819c8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c0d13a0 con 0x7ffa7c159890 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa819c8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c15df50 con 0x7ffa7c159c60 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa7a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa7c159c60 0x7ffa7c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa7b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffa7c15db10 0x7ffa7c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54838/0 (socket says 172.21.15.46:54838) 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.937+0000 7ffa7b7fe700 1 -- 172.21.15.46:0/2375757462 learned_addr learned my addr 172.21.15.46:0/2375757462 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa7a7fc700 1 -- 172.21.15.46:0/2375757462 >> v1:172.21.15.133:6789/0 conn(0x7ffa7c159890 legacy=0x7ffa7c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa7a7fc700 1 -- 172.21.15.46:0/2375757462 >> v1:172.21.15.46:6789/0 conn(0x7ffa7c15db10 legacy=0x7ffa7c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa79ffb700 1 -- 172.21.15.46:0/2375757462 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777536458 0 0) 0x7ffa7c0d13a0 con 0x7ffa7c159890 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa7a7fc700 1 -- 172.21.15.46:0/2375757462 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c15e140 con 0x7ffa7c159c60 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa7a7fc700 1 --2- 172.21.15.46:0/2375757462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159c60 0x7ffa7c15d5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abec6301a90db14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa79ffb700 1 -- 172.21.15.46:0/2375757462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64009e80 con 0x7ffa7c159c60 2023-10-07T08:58:48.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa79ffb700 1 -- 172.21.15.46:0/2375757462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400b760 con 0x7ffa7c159c60 2023-10-07T08:58:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.938+0000 7ffa79ffb700 1 -- 172.21.15.46:0/2375757462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400bae0 con 0x7ffa7c159c60 2023-10-07T08:58:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 -- 172.21.15.46:0/2375757462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159c60 msgr2=0x7ffa7c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2375757462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159c60 0x7ffa7c15d5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa640091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 -- 172.21.15.46:0/2375757462 shutdown_connections 2023-10-07T08:58:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2375757462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159c60 0x7ffa7c15d5d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 -- 172.21.15.46:0/2375757462 >> 172.21.15.46:0/2375757462 conn(0x7ffa7c068e20 msgr2=0x7ffa7c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 -- 172.21.15.46:0/2375757462 shutdown_connections 2023-10-07T08:58:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.939+0000 7ffa819c8700 1 -- 172.21.15.46:0/2375757462 wait complete. 2023-10-07T08:58:48.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.940+0000 7ffa819c8700 1 Processor -- start 2023-10-07T08:58:48.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.940+0000 7ffa819c8700 1 -- start start 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa7c159c60 0x7ffa7c16a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa7c15db10 0x7ffa7c16cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0ce240 con 0x7ffa7c159890 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c16ad30 con 0x7ffa7c159c60 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0cd6c0 con 0x7ffa7c15db10 2023-10-07T08:58:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60800/0 (socket says 172.21.15.46:60800) 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 -- 172.21.15.46:0/2572008052 learned_addr learned my addr 172.21.15.46:0/2572008052 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 -- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa7c15db10 msgr2=0x7ffa7c16cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7a7fc700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa7c159c60 0x7ffa7c16a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7b7fe700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa7c15db10 0x7ffa7c16cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa7c15db10 0x7ffa7c16cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 -- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa7c159c60 msgr2=0x7ffa7c16a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa7c159c60 0x7ffa7c16a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 -- 172.21.15.46:0/2572008052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009420 con 0x7ffa7c159890 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa7affd700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c530 tx=0x7ffa7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74011590 con 0x7ffa7c159890 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa740116f0 con 0x7ffa7c159890 2023-10-07T08:58:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.941+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c0cd9a0 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.942+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74011ab0 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.942+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c0cdf60 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.943+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c04c3c0 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.943+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7401c440 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.943+0000 7ffa72ffd700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 0x7ffa5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.943+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa74083a80 con 0x7ffa7c159890 2023-10-07T08:58:48.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.943+0000 7ffa7a7fc700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 0x7ffa5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.944+0000 7ffa7a7fc700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 0x7ffa5c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa640091e0 tx=0x7ffa64016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:48.947+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa74050cf0 con 0x7ffa7c159890 2023-10-07T08:58:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.140+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa7c06a5b0 con 0x7ffa7c159890 2023-10-07T08:58:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.141+0000 7ffa72ffd700 1 -- 172.21.15.46:0/2572008052 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa74017070 con 0x7ffa7c159890 2023-10-07T08:58:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 msgr2=0x7ffa5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 0x7ffa5c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa640091e0 tx=0x7ffa64016000 comp rx=0 tx=0).stop 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 msgr2=0x7ffa7c16af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c530 tx=0x7ffa7400c8f0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 shutdown_connections 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa5c066f30 0x7ffa5c0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa7c15db10 0x7ffa7c16cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7c159890 0x7ffa7c16af40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 --2- 172.21.15.46:0/2572008052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa7c159c60 0x7ffa7c16a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 >> 172.21.15.46:0/2572008052 conn(0x7ffa7c068e20 msgr2=0x7ffa7c155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 shutdown_connections 2023-10-07T08:58:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.143+0000 7ffa819c8700 1 -- 172.21.15.46:0/2572008052 wait complete. 2023-10-07T08:58:49.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:49.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.274+0000 7fbb5946f700 1 Processor -- start 2023-10-07T08:58:49.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.274+0000 7fbb5946f700 1 -- start start 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb5946f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb540cd0f0 0x7fbb541598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb5946f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb5946f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540d01f0 con 0x7fbb541594d0 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb5946f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540cd540 con 0x7fbb540cd0f0 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb5946f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540cf5e0 con 0x7fbb54159de0 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb527fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb540cd0f0 0x7fbb541598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb537fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb527fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb540cd0f0 0x7fbb541598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33936/0 (socket says 172.21.15.46:33936) 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb537fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:57494/0 (socket says 172.21.15.46:57494) 2023-10-07T08:58:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.275+0000 7fbb527fc700 1 -- 172.21.15.46:0/3392771734 learned_addr learned my addr 172.21.15.46:0/3392771734 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb527fc700 1 -- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 msgr2=0x7fbb5415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb527fc700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb527fc700 1 -- 172.21.15.46:0/3392771734 >> v1:172.21.15.133:6789/0 conn(0x7fbb541594d0 legacy=0x7fbb540b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb527fc700 1 -- 172.21.15.46:0/3392771734 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540cf8c0 con 0x7fbb540cd0f0 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb51ffb700 1 -- 172.21.15.46:0/3392771734 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928196608 0 0) 0x7fbb540d01f0 con 0x7fbb541594d0 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb537fe700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb527fc700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541598a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0099b0 tx=0x7fbb3c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13655a2b7870a89f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb51ffb700 1 -- 172.21.15.46:0/3392771734 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c009ea0 con 0x7fbb540cd0f0 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb51ffb700 1 -- 172.21.15.46:0/3392771734 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00b860 con 0x7fbb540cd0f0 2023-10-07T08:58:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb51ffb700 1 -- 172.21.15.46:0/3392771734 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00bc00 con 0x7fbb540cd0f0 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb5946f700 1 -- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 msgr2=0x7fbb541598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.276+0000 7fbb5946f700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541598a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0099b0 tx=0x7fbb3c009250 comp rx=0 tx=0).stop 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 -- 172.21.15.46:0/3392771734 shutdown_connections 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb5415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 --2- 172.21.15.46:0/3392771734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541598a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 -- 172.21.15.46:0/3392771734 >> 172.21.15.46:0/3392771734 conn(0x7fbb540d05f0 msgr2=0x7fbb540d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 -- 172.21.15.46:0/3392771734 shutdown_connections 2023-10-07T08:58:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.277+0000 7fbb5946f700 1 -- 172.21.15.46:0/3392771734 wait complete. 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.278+0000 7fbb5946f700 1 Processor -- start 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.278+0000 7fbb5946f700 1 -- start start 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.278+0000 7fbb5946f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb541519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540b6520 con 0x7fbb541594d0 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540b4020 con 0x7fbb540cd0f0 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54156350 con 0x7fbb54159de0 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60802/0 (socket says 172.21.15.46:60802) 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 -- 172.21.15.46:0/4158506746 learned_addr learned my addr 172.21.15.46:0/4158506746 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb537fe700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb541519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb52ffd700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 -- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 msgr2=0x7fbb541519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb541519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 -- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 msgr2=0x7fbb541511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 -- 172.21.15.46:0/4158506746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009a20 con 0x7fbb541594d0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb527fc700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00bbe0 con 0x7fbb541594d0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c011420 con 0x7fbb541594d0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0094f0 con 0x7fbb541594d0 2023-10-07T08:58:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0117e0 con 0x7fbb541594d0 2023-10-07T08:58:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.279+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb540b4550 con 0x7fbb541594d0 2023-10-07T08:58:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.280+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5404c3c0 con 0x7fbb541594d0 2023-10-07T08:58:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.281+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb3c011bd0 con 0x7fbb541594d0 2023-10-07T08:58:49.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.281+0000 7fbb4affd700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 0x7fbb340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.281+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb3c0859f0 con 0x7fbb541594d0 2023-10-07T08:58:49.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.281+0000 7fbb52ffd700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 0x7fbb340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.282+0000 7fbb52ffd700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 0x7fbb340693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb540ccca0 tx=0x7fbb4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.285+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb3c052d00 con 0x7fbb541594d0 2023-10-07T08:58:49.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.527+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb540cfb80 con 0x7fbb541594d0 2023-10-07T08:58:49.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.528+0000 7fbb4affd700 1 -- 172.21.15.46:0/4158506746 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fbb3c006cf0 con 0x7fbb541594d0 2023-10-07T08:58:49.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:49.529 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:58:49.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 msgr2=0x7fbb340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 0x7fbb340693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb540ccca0 tx=0x7fbb4c009040 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 msgr2=0x7fbb54152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c017000 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 shutdown_connections 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb34066f30 0x7fbb340693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb54159de0 0x7fbb541519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb540cd0f0 0x7fbb541511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 --2- 172.21.15.46:0/4158506746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb541594d0 0x7fbb54152800 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 >> 172.21.15.46:0/4158506746 conn(0x7fbb540d05f0 msgr2=0x7fbb54069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 shutdown_connections 2023-10-07T08:58:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.530+0000 7fbb5946f700 1 -- 172.21.15.46:0/4158506746 wait complete. 2023-10-07T08:58:49.532 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:58:49.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.661+0000 7f16e0be0700 1 Processor -- start 2023-10-07T08:58:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.661+0000 7f16e0be0700 1 -- start start 2023-10-07T08:58:49.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16e0be0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16dc06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16e0be0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0c74b0 con 0x7f16dc159b10 2023-10-07T08:58:49.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16e0be0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0c8700 con 0x7f16dc15d730 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16e0be0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0c9070 con 0x7f16dc15dba0 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16da59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f16dc159b10 0x7f16dc0cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39748/0 (socket says 172.21.15.46:39748) 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16da59c700 1 -- 172.21.15.46:0/302152078 learned_addr learned my addr 172.21.15.46:0/302152078 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939204022 0 0) 0x7f16dc0c74b0 con 0x7f16dc159b10 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16dad9d700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16dc06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c8003570 con 0x7f16dc159b10 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129835716 0 0) 0x7f16c8003570 con 0x7f16dc159b10 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 msgr2=0x7f16dc06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16dc06ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 >> v1:172.21.15.133:6789/0 conn(0x7f16dc15d730 legacy=0x7f16dc06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0c80f0 con 0x7f16dc159b10 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f16d4001470 con 0x7f16dc159b10 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 >> v1:172.21.15.46:6789/0 conn(0x7f16dc159b10 legacy=0x7f16dc0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16c8003a90 0x7f16c8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c8004d50 0x7f16c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0c9070 con 0x7f16c8003a90 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bb70 con 0x7f16c8004d50 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bd30 con 0x7f16dc15dba0 2023-10-07T08:58:49.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16da59c700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16c8003a90 0x7f16c8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16dad9d700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c8004d50 0x7f16c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.662+0000 7f16d9d9b700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 -- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 msgr2=0x7f16c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 -- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c8004d50 msgr2=0x7f16c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c8004d50 0x7f16c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 -- 172.21.15.46:0/302152078 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8003570 con 0x7f16c8003a90 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16d9d9b700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16dc15dba0 0x7f16c8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16dad9d700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c8004d50 0x7f16c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:49.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16da59c700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16c8003a90 0x7f16c8003ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c390 tx=0x7f16dc0c8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f16921c294c4a49 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cc60 con 0x7f16c8003a90 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400cdc0 con 0x7f16c8003a90 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16d959a700 1 -- 172.21.15.46:0/302152078 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4005b70 con 0x7f16c8003a90 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16e0be0700 1 -- 172.21.15.46:0/302152078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16c8003a90 msgr2=0x7f16c8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16e0be0700 1 --2- 172.21.15.46:0/302152078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16c8003a90 0x7f16c8003ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c390 tx=0x7f16dc0c8670 comp rx=0 tx=0).stop 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.663+0000 7f16dad9d700 1 -- 172.21.15.46:0/302152078 reap_dead start 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.664+0000 7f16e0be0700 1 -- 172.21.15.46:0/302152078 shutdown_connections 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.664+0000 7f16e0be0700 1 -- 172.21.15.46:0/302152078 >> 172.21.15.46:0/302152078 conn(0x7f16dc0c9870 msgr2=0x7f16dc0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.664+0000 7f16e0be0700 1 -- 172.21.15.46:0/302152078 shutdown_connections 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.664+0000 7f16e0be0700 1 -- 172.21.15.46:0/302152078 wait complete. 2023-10-07T08:58:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.665+0000 7f16e0be0700 1 Processor -- start 2023-10-07T08:58:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.665+0000 7f16e0be0700 1 -- start start 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16c8003a90 0x7f16dc154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16dc155d30 0x7f16dc1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc15fcb0 con 0x7f16dc0b05b0 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc154e50 con 0x7f16dc155d30 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1566e0 con 0x7f16c8003a90 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45012/0 (socket says 172.21.15.46:45012) 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 -- 172.21.15.46:0/1059747733 learned_addr learned my addr 172.21.15.46:0/1059747733 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16d9d9b700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16dc155d30 0x7f16dc1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16da59c700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16c8003a90 0x7f16dc154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 -- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16c8003a90 msgr2=0x7f16dc154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16c8003a90 0x7f16dc154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 -- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16dc155d30 msgr2=0x7f16dc1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16dc155d30 0x7f16dc1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 -- 172.21.15.46:0/1059747733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc16a960 con 0x7f16dc0b05b0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16dad9d700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0b2e00 tx=0x7f16cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00e050 con 0x7f16dc0b05b0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc00f040 con 0x7f16dc0b05b0 2023-10-07T08:58:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc0b0f90 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc010e70 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.666+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc0b1230 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.667+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc16aaf0 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.668+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16cc003020 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.668+0000 7f16d27fc700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 0x7f16bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.668+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16cc0848a0 con 0x7f16dc0b05b0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.668+0000 7f16da59c700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 0x7f16bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.669+0000 7f16da59c700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 0x7f16bc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16d4007cd0 tx=0x7f16d4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:49.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.672+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16cc051b10 con 0x7f16dc0b05b0 2023-10-07T08:58:49.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.866+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16dc0cba30 con 0x7f16dc0b05b0 2023-10-07T08:58:49.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.867+0000 7f16d27fc700 1 -- 172.21.15.46:0/1059747733 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f16cc01a090 con 0x7f16dc0b05b0 2023-10-07T08:58:49.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:49.868 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 msgr2=0x7f16bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 0x7f16bc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16d4007cd0 tx=0x7f16d4015000 comp rx=0 tx=0).stop 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 msgr2=0x7f16dc0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0b2e00 tx=0x7f16cc00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 shutdown_connections 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16bc066f30 0x7f16bc0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16dc0b05b0 0x7f16dc0b0a50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16c8003a90 0x7f16dc154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 --2- 172.21.15.46:0/1059747733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16dc155d30 0x7f16dc1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 >> 172.21.15.46:0/1059747733 conn(0x7f16dc0c9870 msgr2=0x7f16dc158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 shutdown_connections 2023-10-07T08:58:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:49.869+0000 7f16e0be0700 1 -- 172.21.15.46:0/1059747733 wait complete. 2023-10-07T08:58:49.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:58:49.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:58:50.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.004+0000 7f8830fbb700 1 Processor -- start 2023-10-07T08:58:50.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.004+0000 7f8830fbb700 1 -- start start 2023-10-07T08:58:50.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8830fbb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f882c159890 0x7f882c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8830fbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f882c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8830fbb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c15a160 con 0x7f882c15db10 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8830fbb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0d13a0 con 0x7f882c159890 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8830fbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c15e140 con 0x7f882c159c60 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f882c15db10 0x7f882c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39754/0 (socket says 172.21.15.46:39754) 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882ad9d700 1 -- 172.21.15.46:0/1483522162 learned_addr learned my addr 172.21.15.46:0/1483522162 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882a59c700 1 --2- 172.21.15.46:0/1483522162 >> v2:172.21.15.133:3300/0 conn(0x7f882c159890 0x7f882c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f8829d9b700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f882c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183071323 0 0) 0x7f882c15a160 con 0x7f882c15db10 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8814003570 con 0x7f882c15db10 2023-10-07T08:58:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479695140 0 0) 0x7f8814003570 con 0x7f882c15db10 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 msgr2=0x7f882c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f882c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 >> v2:172.21.15.133:3300/0 conn(0x7f882c159890 msgr2=0x7f882c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 --2- 172.21.15.46:0/1483522162 >> v2:172.21.15.133:3300/0 conn(0x7f882c159890 0x7f882c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c15a3d0 con 0x7f882c15db10 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f88240017f0 con 0x7f882c15db10 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 >> v1:172.21.15.46:6789/0 conn(0x7f882c15db10 legacy=0x7f882c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f8814003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f8814004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8814004d50 0x7f88140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0d13a0 con 0x7f8814003fe0 2023-10-07T08:58:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.005+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c15e140 con 0x7f8814004d50 2023-10-07T08:58:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881400ba90 con 0x7f882c159c60 2023-10-07T08:58:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f8814004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882a59c700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f8814003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882ad9d700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8814004d50 0x7f88140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 -- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 msgr2=0x7f8814003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c159c60 0x7f8814003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 -- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8814004d50 msgr2=0x7f88140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8814004d50 0x7f88140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 -- 172.21.15.46:0/1483522162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814003570 con 0x7f8814003fe0 2023-10-07T08:58:50.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f8829d9b700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f8814004810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f882c15a090 tx=0x7f88200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f70aef86025ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000e6b0 con 0x7f8814003fe0 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882000e810 con 0x7f8814003fe0 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.006+0000 7f882959a700 1 -- 172.21.15.46:0/1483522162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000ebd0 con 0x7f8814003fe0 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 -- 172.21.15.46:0/1483522162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 msgr2=0x7f8814004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 --2- 172.21.15.46:0/1483522162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f8814004810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f882c15a090 tx=0x7f88200091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f882ad9d700 1 -- 172.21.15.46:0/1483522162 reap_dead start 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 -- 172.21.15.46:0/1483522162 shutdown_connections 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 -- 172.21.15.46:0/1483522162 >> 172.21.15.46:0/1483522162 conn(0x7f882c068e20 msgr2=0x7f882c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 -- 172.21.15.46:0/1483522162 shutdown_connections 2023-10-07T08:58:50.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.007+0000 7f8830fbb700 1 -- 172.21.15.46:0/1483522162 wait complete. 2023-10-07T08:58:50.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.008+0000 7f8830fbb700 1 Processor -- start 2023-10-07T08:58:50.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.008+0000 7f8830fbb700 1 -- start start 2023-10-07T08:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.008+0000 7f8830fbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c0b6100 0x7f882c14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c14f130 0x7f882c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c16a710 con 0x7f8814003fe0 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c169b00 con 0x7f882c14f130 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c169de0 con 0x7f882c0b6100 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45016/0 (socket says 172.21.15.46:45016) 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 -- 172.21.15.46:0/211205204 learned_addr learned my addr 172.21.15.46:0/211205204 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8829d9b700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c0b6100 0x7f882c14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882ad9d700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c14f130 0x7f882c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 -- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c0b6100 msgr2=0x7f882c14ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c0b6100 0x7f882c14ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 -- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c14f130 msgr2=0x7f882c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c14f130 0x7f882c0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 -- 172.21.15.46:0/211205204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c16a0c0 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f882a59c700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f881c011d40 tx=0x7f881c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00fac0 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00fc20 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c16a3a0 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c014440 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.009+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c0b2280 con 0x7f8814003fe0 2023-10-07T08:58:50.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.010+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c16a9f0 con 0x7f8814003fe0 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.011+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f881c014a80 con 0x7f8814003fe0 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.011+0000 7f881a7fc700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 0x7f880c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.011+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f881c018030 con 0x7f8814003fe0 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.011+0000 7f8829d9b700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 0x7f880c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.012+0000 7f8829d9b700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 0x7f880c069410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88200091e0 tx=0x7f882001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.015+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f881c0524d0 con 0x7f8814003fe0 2023-10-07T08:58:50.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.207+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f882c04c3c0 con 0x7f8814003fe0 2023-10-07T08:58:50.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.208+0000 7f881a7fc700 1 -- 172.21.15.46:0/211205204 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f881c022020 con 0x7f8814003fe0 2023-10-07T08:58:50.209 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 msgr2=0x7f880c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 0x7f880c069410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88200091e0 tx=0x7f882001a000 comp rx=0 tx=0).stop 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 msgr2=0x7f882c0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f881c011d40 tx=0x7f881c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 shutdown_connections 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f880c066f60 0x7f880c069410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c14f130 0x7f882c0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8814003fe0 0x7f882c0b1d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 --2- 172.21.15.46:0/211205204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f882c0b6100 0x7f882c14ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 >> 172.21.15.46:0/211205204 conn(0x7f882c068e20 msgr2=0x7f882c15cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 shutdown_connections 2023-10-07T08:58:50.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.210+0000 7f8830fbb700 1 -- 172.21.15.46:0/211205204 wait complete. 2023-10-07T08:58:50.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:58:50.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.344+0000 7f52c48c1700 1 Processor -- start 2023-10-07T08:58:50.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 -- start start 2023-10-07T08:58:50.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52c00b4e70 0x7f52c00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 0x7f52c015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00cfb00 con 0x7f52c00b16d0 2023-10-07T08:58:50.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00b5c40 con 0x7f52c00b4e70 2023-10-07T08:58:50.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.345+0000 7f52c48c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b5f20 con 0x7f52c00b1b40 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52c00b4e70 0x7f52c00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52c00b4e70 0x7f52c00ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:40178/0 (socket says 172.21.15.46:40178) 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bf59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 0x7f52c015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 -- 172.21.15.46:0/998240374 learned_addr learned my addr 172.21.15.46:0/998240374 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52be59c700 1 --1- 172.21.15.46:0/998240374 >> v1:172.21.15.133:6789/0 conn(0x7f52c00b16d0 0x7f52c015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33332/0 (socket says 172.21.15.46:33332) 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 -- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 msgr2=0x7f52c015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 0x7f52c015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 -- 172.21.15.46:0/998240374 >> v1:172.21.15.133:6789/0 conn(0x7f52c00b16d0 legacy=0x7f52c015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 -- 172.21.15.46:0/998240374 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00b6200 con 0x7f52c00b4e70 2023-10-07T08:58:50.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bf59e700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 0x7f52c015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bdd9b700 1 -- 172.21.15.46:0/998240374 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347766809 0 0) 0x7f52c00cfb00 con 0x7f52c00b16d0 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bed9d700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b4e70 0x7f52c00ccff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52b00099b0 tx=0x7f52b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ee6e369b526662 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bdd9b700 1 -- 172.21.15.46:0/998240374 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0009ea0 con 0x7f52c00b4e70 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bdd9b700 1 -- 172.21.15.46:0/998240374 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000b860 con 0x7f52c00b4e70 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.346+0000 7f52bdd9b700 1 -- 172.21.15.46:0/998240374 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bc00 con 0x7f52c00b4e70 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 -- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b4e70 msgr2=0x7f52c00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b4e70 0x7f52c00ccff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52b00099b0 tx=0x7f52b0009250 comp rx=0 tx=0).stop 2023-10-07T08:58:50.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 -- 172.21.15.46:0/998240374 shutdown_connections 2023-10-07T08:58:50.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b1b40 0x7f52c015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 --2- 172.21.15.46:0/998240374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b4e70 0x7f52c00ccff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 -- 172.21.15.46:0/998240374 >> 172.21.15.46:0/998240374 conn(0x7f52c00d10c0 msgr2=0x7f52c00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 -- 172.21.15.46:0/998240374 shutdown_connections 2023-10-07T08:58:50.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.347+0000 7f52c48c1700 1 -- 172.21.15.46:0/998240374 wait complete. 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.348+0000 7f52c48c1700 1 Processor -- start 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.348+0000 7f52c48c1700 1 -- start start 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 0x7f52c00cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 0x7f52c00b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00c6d10 con 0x7f52c00b16d0 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00cbc80 con 0x7f52c00b1b40 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52c48c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00cbf60 con 0x7f52c00b4e70 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45030/0 (socket says 172.21.15.46:45030) 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 -- 172.21.15.46:0/2389509204 learned_addr learned my addr 172.21.15.46:0/2389509204 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52be59c700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 0x7f52c00cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bf59e700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 0x7f52c00b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 -- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 msgr2=0x7f52c00b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 0x7f52c00b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 -- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 msgr2=0x7f52c00cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 0x7f52c00cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bed9d700 1 -- 172.21.15.46:0/2389509204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009a20 con 0x7f52c00b16d0 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52bf59e700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 0x7f52c00b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.349+0000 7f52be59c700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 0x7f52c00cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52bed9d700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c0070dd0 tx=0x7f52b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bbe0 con 0x7f52c00b16d0 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b00094f0 con 0x7f52c00b16d0 2023-10-07T08:58:50.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0011420 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00117e0 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.350+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00c69a0 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.351+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c0088990 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.351+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52b0011c10 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.351+0000 7f52b6ffd700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 0x7f52a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.351+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52b0085f00 con 0x7f52c00b16d0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.352+0000 7f52be59c700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 0x7f52a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.352+0000 7f52be59c700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 0x7f52a00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52a8007fd0 tx=0x7f52a8007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.356+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52b0053170 con 0x7f52c00b16d0 2023-10-07T08:58:50.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.551+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52c004bb80 con 0x7f52c00b16d0 2023-10-07T08:58:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.551+0000 7f52b6ffd700 1 -- 172.21.15.46:0/2389509204 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52b0015020 con 0x7f52c00b16d0 2023-10-07T08:58:50.552 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 msgr2=0x7f52a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 0x7f52a00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52a8007fd0 tx=0x7f52a8007e30 comp rx=0 tx=0).stop 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 msgr2=0x7f52c014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c0070dd0 tx=0x7f52b0017000 comp rx=0 tx=0).stop 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 shutdown_connections 2023-10-07T08:58:50.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52a0066f30 0x7f52a00693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52c00b4e70 0x7f52c00b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c00b16d0 0x7f52c014af90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 --2- 172.21.15.46:0/2389509204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52c00b1b40 0x7f52c00cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 >> 172.21.15.46:0/2389509204 conn(0x7f52c00d10c0 msgr2=0x7f52c0069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 shutdown_connections 2023-10-07T08:58:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.553+0000 7f52c48c1700 1 -- 172.21.15.46:0/2389509204 wait complete. 2023-10-07T08:58:50.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:58:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.687+0000 7f2685eb4700 1 Processor -- start 2023-10-07T08:58:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.687+0000 7f2685eb4700 1 -- start start 2023-10-07T08:58:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f2685eb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f268006bcd0 0x7f2680140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f2685eb4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f2685eb4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268015c2a0 con 0x7f268006c0a0 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f2685eb4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268015b690 con 0x7f268006bcd0 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f2685eb4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268015b970 con 0x7f26800c9510 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f268006bcd0 0x7f2680140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:43818/0 (socket says 172.21.15.46:43818) 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267ffff700 1 -- 172.21.15.46:0/112482089 learned_addr learned my addr 172.21.15.46:0/112482089 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f268006bcd0 0x7f2680140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:40192/0 (socket says 172.21.15.46:40192) 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267effd700 1 --1- 172.21.15.46:0/112482089 >> v1:172.21.15.133:6789/0 conn(0x7f268006c0a0 0x7f26800c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33336/0 (socket says 172.21.15.46:33336) 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 -- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 msgr2=0x7f2680141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 -- 172.21.15.46:0/112482089 >> v1:172.21.15.133:6789/0 conn(0x7f268006c0a0 legacy=0x7f26800c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267f7fe700 1 -- 172.21.15.46:0/112482089 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268015bc50 con 0x7f268006bcd0 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267e7fc700 1 -- 172.21.15.46:0/112482089 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722946760 0 0) 0x7f268015c2a0 con 0x7f268006c0a0 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.688+0000 7f267ffff700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f267f7fe700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006bcd0 0x7f2680140df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26700098e0 tx=0x7f26700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c95ab3f39e718f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f267e7fc700 1 -- 172.21.15.46:0/112482089 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000b640 con 0x7f268006bcd0 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f267e7fc700 1 -- 172.21.15.46:0/112482089 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000b7a0 con 0x7f268006bcd0 2023-10-07T08:58:50.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f267e7fc700 1 -- 172.21.15.46:0/112482089 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000bb40 con 0x7f268006bcd0 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 -- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006bcd0 msgr2=0x7f2680140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006bcd0 0x7f2680140df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26700098e0 tx=0x7f26700091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 -- 172.21.15.46:0/112482089 shutdown_connections 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f2680141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 --2- 172.21.15.46:0/112482089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006bcd0 0x7f2680140df0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 -- 172.21.15.46:0/112482089 >> 172.21.15.46:0/112482089 conn(0x7f26800ce600 msgr2=0x7f26800cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 -- 172.21.15.46:0/112482089 shutdown_connections 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.689+0000 7f2685eb4700 1 -- 172.21.15.46:0/112482089 wait complete. 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 Processor -- start 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 -- start start 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 0x7f268016b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f268016b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680169060 con 0x7f268006bcd0 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800b26f0 con 0x7f268006c0a0 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.691+0000 7f2685eb4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800b29d0 con 0x7f26800c9510 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45042/0 (socket says 172.21.15.46:45042) 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 -- 172.21.15.46:0/1168149902 learned_addr learned my addr 172.21.15.46:0/1168149902 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267effd700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 0x7f268016b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267ffff700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f268016b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 -- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 msgr2=0x7f268016b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f268016b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 -- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 msgr2=0x7f268016b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 0x7f268016b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 -- 172.21.15.46:0/1168149902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009ae0 con 0x7f268006bcd0 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267effd700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 0x7f268016b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f267f7fe700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26800ce1c0 tx=0x7f2670017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000bb20 con 0x7f268006bcd0 2023-10-07T08:58:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670011420 con 0x7f268006bcd0 2023-10-07T08:58:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670009420 con 0x7f268006bcd0 2023-10-07T08:58:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700117c0 con 0x7f268006bcd0 2023-10-07T08:58:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.692+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2680169240 con 0x7f268006bcd0 2023-10-07T08:58:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.693+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26800b2ef0 con 0x7f268006bcd0 2023-10-07T08:58:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.694+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2670011b70 con 0x7f268006bcd0 2023-10-07T08:58:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.694+0000 7f26677fe700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.694+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2670085ba0 con 0x7f268006bcd0 2023-10-07T08:58:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.694+0000 7f267effd700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.695+0000 7f267effd700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26740018d0 tx=0x7f2674009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.698+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2670052e10 con 0x7f268006bcd0 2023-10-07T08:58:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.890+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f268004c3c0 con 0x7f268006bcd0 2023-10-07T08:58:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.890+0000 7f26677fe700 1 -- 172.21.15.46:0/1168149902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2670015020 con 0x7f268006bcd0 2023-10-07T08:58:50.891 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:58:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 msgr2=0x7f266c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26740018d0 tx=0x7f2674009040 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 msgr2=0x7f26800c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26800ce1c0 tx=0x7f2670017000 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 shutdown_connections 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26800c9510 0x7f268016b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f268006bcd0 0x7f26800c8350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 --2- 172.21.15.46:0/1168149902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268006c0a0 0x7f268016b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 >> 172.21.15.46:0/1168149902 conn(0x7f26800ce600 msgr2=0x7f26800c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 shutdown_connections 2023-10-07T08:58:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:50.892+0000 7f2685eb4700 1 -- 172.21.15.46:0/1168149902 wait complete. 2023-10-07T08:58:50.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.023+0000 7f93ca9e4700 1 Processor -- start 2023-10-07T08:58:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.023+0000 7f93ca9e4700 1 -- start start 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca9e4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93c4159420 0x7f93c40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca9e4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40b2980 con 0x7f93c415d230 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca9e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40b11d0 con 0x7f93c41597f0 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca9e4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40b14b0 con 0x7f93c4159420 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93c4159420 0x7f93c40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca1e3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f93c415d230 0x7f93c415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39766/0 (socket says 172.21.15.46:39766) 2023-10-07T08:58:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93c4159420 0x7f93c40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45044/0 (socket says 172.21.15.46:45044) 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93ca1e3700 1 -- 172.21.15.46:0/4029324321 learned_addr learned my addr 172.21.15.46:0/4029324321 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 -- 172.21.15.46:0/4029324321 >> v1:172.21.15.133:6789/0 conn(0x7f93c41597f0 legacy=0x7f93c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 -- 172.21.15.46:0/4029324321 >> v1:172.21.15.46:6789/0 conn(0x7f93c415d230 legacy=0x7f93c415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c89e0700 1 -- 172.21.15.46:0/4029324321 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233970007 0 0) 0x7f93c40b2980 con 0x7f93c415d230 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 -- 172.21.15.46:0/4029324321 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40b1790 con 0x7f93c4159420 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.024+0000 7f93c99e2700 1 --2- 172.21.15.46:0/4029324321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c4159420 0x7f93c40b5f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce70c778e2aff839 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93c89e0700 1 -- 172.21.15.46:0/4029324321 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0009e80 con 0x7f93c4159420 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93c89e0700 1 -- 172.21.15.46:0/4029324321 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000b860 con 0x7f93c4159420 2023-10-07T08:58:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93c89e0700 1 -- 172.21.15.46:0/4029324321 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000bbe0 con 0x7f93c4159420 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 -- 172.21.15.46:0/4029324321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c4159420 msgr2=0x7f93c40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/4029324321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c4159420 0x7f93c40b5f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 -- 172.21.15.46:0/4029324321 shutdown_connections 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/4029324321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c4159420 0x7f93c40b5f40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 -- 172.21.15.46:0/4029324321 >> 172.21.15.46:0/4029324321 conn(0x7f93c40d0660 msgr2=0x7f93c40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 -- 172.21.15.46:0/4029324321 shutdown_connections 2023-10-07T08:58:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.025+0000 7f93ca9e4700 1 -- 172.21.15.46:0/4029324321 wait complete. 2023-10-07T08:58:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.026+0000 7f93ca9e4700 1 Processor -- start 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.026+0000 7f93ca9e4700 1 -- start start 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93c4159420 0x7f93c40c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c415d230 0x7f93c414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c415b0f0 con 0x7f93c41597f0 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c415b3d0 con 0x7f93c415d230 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca9e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c415b6b0 con 0x7f93c4159420 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93c91e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93c91e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45054/0 (socket says 172.21.15.46:45054) 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93c91e1700 1 -- 172.21.15.46:0/2665961946 learned_addr learned my addr 172.21.15.46:0/2665961946 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93c99e2700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93c4159420 0x7f93c40c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.027+0000 7f93ca1e3700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c415d230 0x7f93c414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 -- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93c4159420 msgr2=0x7f93c40c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93c4159420 0x7f93c40c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 -- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c415d230 msgr2=0x7f93c414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c415d230 0x7f93c414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 -- 172.21.15.46:0/2665961946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009420 con 0x7f93c41597f0 2023-10-07T08:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93c91e1700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c7c0 tx=0x7f93b4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4011590 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40116f0 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c415b990 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4011ab0 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.028+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c415a380 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.029+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c4069f80 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.029+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b401b3b0 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.030+0000 7f93b9ffb700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.030+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93b4083a90 con 0x7f93c41597f0 2023-10-07T08:58:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.030+0000 7f93c99e2700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.030+0000 7f93c99e2700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 0x7f93a80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f93c00093f0 tx=0x7f93c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.034+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93b4050d00 con 0x7f93c41597f0 2023-10-07T08:58:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.272+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93c404c3c0 con 0x7f93c41597f0 2023-10-07T08:58:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.273+0000 7f93b9ffb700 1 -- 172.21.15.46:0/2665961946 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f93b4017070 con 0x7f93c41597f0 2023-10-07T08:58:51.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:51.273 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 msgr2=0x7f93a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 0x7f93a80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f93c00093f0 tx=0x7f93c0017000 comp rx=0 tx=0).stop 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 msgr2=0x7f93c4149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c7c0 tx=0x7f93b4007f50 comp rx=0 tx=0).stop 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 shutdown_connections 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c415d230 0x7f93c414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93c4159420 0x7f93c40c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 --2- 172.21.15.46:0/2665961946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93c41597f0 0x7f93c4149e60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 >> 172.21.15.46:0/2665961946 conn(0x7f93c40d0660 msgr2=0x7f93c4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 shutdown_connections 2023-10-07T08:58:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.275+0000 7f93ca9e4700 1 -- 172.21.15.46:0/2665961946 wait complete. 2023-10-07T08:58:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:58:51.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.405+0000 7fa70cdd3700 1 Processor -- start 2023-10-07T08:58:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.405+0000 7fa70cdd3700 1 -- start start 2023-10-07T08:58:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa708159890 0x7fa70815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa70815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 0x7fa708069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70815a160 con 0x7fa708159890 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7080d13a0 con 0x7fa70815db10 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70cdd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70815e140 con 0x7fa708159c60 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa708159890 0x7fa70815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa708159890 0x7fa70815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45064/0 (socket says 172.21.15.46:45064) 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70659c700 1 -- 172.21.15.46:0/3281309523 learned_addr learned my addr 172.21.15.46:0/3281309523 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa705d9b700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa70815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa706d9d700 1 --2- 172.21.15.46:0/3281309523 >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 0x7fa708069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.406+0000 7fa70659c700 1 -- 172.21.15.46:0/3281309523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 msgr2=0x7fa70815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70659c700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa70815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70659c700 1 -- 172.21.15.46:0/3281309523 >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 msgr2=0x7fa708069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70659c700 1 --2- 172.21.15.46:0/3281309523 >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 0x7fa708069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70659c700 1 -- 172.21.15.46:0/3281309523 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70815a3d0 con 0x7fa708159890 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa706d9d700 1 --2- 172.21.15.46:0/3281309523 >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 0x7fa708069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa705d9b700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa70815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70659c700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70815abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa708089b50 tx=0x7fa700009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157ce5f11fc5225b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70559a700 1 -- 172.21.15.46:0/3281309523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000e070 con 0x7fa708159890 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70559a700 1 -- 172.21.15.46:0/3281309523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70000ba50 con 0x7fa708159890 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70559a700 1 -- 172.21.15.46:0/3281309523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000092e0 con 0x7fa708159890 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 -- 172.21.15.46:0/3281309523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 msgr2=0x7fa70815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70815abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa708089b50 tx=0x7fa700009840 comp rx=0 tx=0).stop 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 -- 172.21.15.46:0/3281309523 shutdown_connections 2023-10-07T08:58:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/3281309523 >> v2:172.21.15.133:3300/0 conn(0x7fa70815db10 0x7fa708069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70815abd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/3281309523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa70815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 -- 172.21.15.46:0/3281309523 >> 172.21.15.46:0/3281309523 conn(0x7fa708068e20 msgr2=0x7fa7080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.407+0000 7fa70cdd3700 1 -- 172.21.15.46:0/3281309523 shutdown_connections 2023-10-07T08:58:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.408+0000 7fa70cdd3700 1 -- 172.21.15.46:0/3281309523 wait complete. 2023-10-07T08:58:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 Processor -- start 2023-10-07T08:58:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 -- start start 2023-10-07T08:58:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa708152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa70815db10 0x7fa708153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080cd0c0 con 0x7fa708159890 2023-10-07T08:58:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70815cf60 con 0x7fa70815db10 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70cdd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080cd310 con 0x7fa708159c60 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45078/0 (socket says 172.21.15.46:45078) 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa70659c700 1 -- 172.21.15.46:0/174439730 learned_addr learned my addr 172.21.15.46:0/174439730 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.409+0000 7fa706d9d700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa70815db10 0x7fa708153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa705d9b700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa708152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 -- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 msgr2=0x7fa708152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa708152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 -- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa70815db10 msgr2=0x7fa708153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa70815db10 0x7fa708153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 -- 172.21.15.46:0/174439730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700009ae0 con 0x7fa708159890 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70659c700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa700009880 tx=0x7fa700018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700008a00 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700008b80 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7080cd5f0 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700026460 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.410+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70814b900 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.411+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7080cdb10 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.411+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa700003040 con 0x7fa708159890 2023-10-07T08:58:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.412+0000 7fa6fe7fc700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.412+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa700085d20 con 0x7fa708159890 2023-10-07T08:58:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.412+0000 7fa705d9b700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.413+0000 7fa705d9b700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 0x7fa6e80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7081510c0 tx=0x7fa6f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.416+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7080cdb10 con 0x7fa708159890 2023-10-07T08:58:51.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.611+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7080cdb10 con 0x7fa708159890 2023-10-07T08:58:51.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.612+0000 7fa6fe7fc700 1 -- 172.21.15.46:0/174439730 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa7080cdb10 con 0x7fa708159890 2023-10-07T08:58:51.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:51.613 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 msgr2=0x7fa6e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 0x7fa6e80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7081510c0 tx=0x7fa6f0008040 comp rx=0 tx=0).stop 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 msgr2=0x7fa70814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa700009880 tx=0x7fa700018000 comp rx=0 tx=0).stop 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 shutdown_connections 2023-10-07T08:58:51.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa70815db10 0x7fa708153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa708159890 0x7fa70814b3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 --2- 172.21.15.46:0/174439730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa708159c60 0x7fa708152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 >> 172.21.15.46:0/174439730 conn(0x7fa708068e20 msgr2=0x7fa70814d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 shutdown_connections 2023-10-07T08:58:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.614+0000 7fa70cdd3700 1 -- 172.21.15.46:0/174439730 wait complete. 2023-10-07T08:58:51.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:58:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.745+0000 7f54de302700 1 Processor -- start 2023-10-07T08:58:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.745+0000 7f54de302700 1 -- start start 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54de302700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54d8140cd0 0x7f54d806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54de302700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54d80cd420 0x7f54d806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54de302700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d80b1500 con 0x7f54d81410a0 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54de302700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80cda20 con 0x7f54d80cd420 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54de302700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80cdd00 con 0x7f54d8140cd0 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54ddb01700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54d80cd420 0x7f54d806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54dcaff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f54d81410a0 0x7f54d80ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39770/0 (socket says 172.21.15.46:39770) 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.746+0000 7f54dcaff700 1 -- 172.21.15.46:0/3650216302 learned_addr learned my addr 172.21.15.46:0/3650216302 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54dd300700 1 --2- 172.21.15.46:0/3650216302 >> v2:172.21.15.133:3300/0 conn(0x7f54d8140cd0 0x7f54d806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54ddb01700 1 -- 172.21.15.46:0/3650216302 >> v2:172.21.15.133:3300/0 conn(0x7f54d8140cd0 msgr2=0x7f54d806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54ddb01700 1 --2- 172.21.15.46:0/3650216302 >> v2:172.21.15.133:3300/0 conn(0x7f54d8140cd0 0x7f54d806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54ddb01700 1 -- 172.21.15.46:0/3650216302 >> v1:172.21.15.46:6789/0 conn(0x7f54d81410a0 legacy=0x7f54d80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54d7fff700 1 -- 172.21.15.46:0/3650216302 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928071740 0 0) 0x7f54d80b1500 con 0x7f54d81410a0 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54ddb01700 1 -- 172.21.15.46:0/3650216302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80cdfe0 con 0x7f54d80cd420 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54ddb01700 1 --2- 172.21.15.46:0/3650216302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d806bf20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e60 tx=0x7f54c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cda7e2085bda7b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54d7fff700 1 -- 172.21.15.46:0/3650216302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800e070 con 0x7f54d80cd420 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54d7fff700 1 -- 172.21.15.46:0/3650216302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800bbf0 con 0x7f54d80cd420 2023-10-07T08:58:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.747+0000 7f54d7fff700 1 -- 172.21.15.46:0/3650216302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8012430 con 0x7f54d80cd420 2023-10-07T08:58:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 -- 172.21.15.46:0/3650216302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 msgr2=0x7f54d806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 --2- 172.21.15.46:0/3650216302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d806bf20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e60 tx=0x7f54c8009780 comp rx=0 tx=0).stop 2023-10-07T08:58:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 -- 172.21.15.46:0/3650216302 shutdown_connections 2023-10-07T08:58:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 --2- 172.21.15.46:0/3650216302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d806bf20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 --2- 172.21.15.46:0/3650216302 >> v2:172.21.15.133:3300/0 conn(0x7f54d8140cd0 0x7f54d806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 -- 172.21.15.46:0/3650216302 >> 172.21.15.46:0/3650216302 conn(0x7f54d80ce430 msgr2=0x7f54d80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 -- 172.21.15.46:0/3650216302 shutdown_connections 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.748+0000 7f54de302700 1 -- 172.21.15.46:0/3650216302 wait complete. 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.749+0000 7f54de302700 1 Processor -- start 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.749+0000 7f54de302700 1 -- start start 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 0x7f54d80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 0x7f54d80ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8139900 con 0x7f54d80cd420 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8138cf0 con 0x7f54d8140cd0 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54de302700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8138fd0 con 0x7f54d81410a0 2023-10-07T08:58:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45094/0 (socket says 172.21.15.46:45094) 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 -- 172.21.15.46:0/4100469995 learned_addr learned my addr 172.21.15.46:0/4100469995 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dcaff700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 0x7f54d80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54ddb01700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 0x7f54d80ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 -- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 msgr2=0x7f54d80ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 0x7f54d80ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 -- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 msgr2=0x7f54d80ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 0x7f54d80ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 -- 172.21.15.46:0/4100469995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8009a20 con 0x7f54d80cd420 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dcaff700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 0x7f54d80ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54ddb01700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 0x7f54d80ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54dd300700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d890 tx=0x7f54d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.750+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00125f0 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.751+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0012770 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.751+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d81392b0 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.751+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0012b30 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.751+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d81530f0 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.752+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d804c3c0 con 0x7f54d80cd420 2023-10-07T08:58:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.752+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54d001e460 con 0x7f54d80cd420 2023-10-07T08:58:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.752+0000 7f54d57fa700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.752+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54d0084c50 con 0x7f54d80cd420 2023-10-07T08:58:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.752+0000 7f54dcaff700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.753+0000 7f54dcaff700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54d8071180 tx=0x7f54cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.757+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54d008a020 con 0x7f54d80cd420 2023-10-07T08:58:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.997+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54d80b1750 con 0x7f54d80cd420 2023-10-07T08:58:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:51.997+0000 7f54d57fa700 1 -- 172.21.15.46:0/4100469995 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f54d0051ec0 con 0x7f54d80cd420 2023-10-07T08:58:51.999 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:51.999 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 msgr2=0x7f54c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54d8071180 tx=0x7f54cc009040 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 msgr2=0x7f54d8152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d890 tx=0x7f54d0008040 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 shutdown_connections 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54d81410a0 0x7f54d80ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d80cd420 0x7f54d8152bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 --2- 172.21.15.46:0/4100469995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d8140cd0 0x7f54d80ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 >> 172.21.15.46:0/4100469995 conn(0x7f54d80ce430 msgr2=0x7f54d8156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 shutdown_connections 2023-10-07T08:58:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.000+0000 7f54de302700 1 -- 172.21.15.46:0/4100469995 wait complete. 2023-10-07T08:58:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:58:52.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:58:37.656841+0000', 'modified': '2023-10-07T08:58:41.272972+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/1560537026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6833', 'nonce': 1560537026}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1560537026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:58:52.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:58:52.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:58:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.540+0000 7f9600885700 1 Processor -- start 2023-10-07T08:58:52.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.540+0000 7f9600885700 1 -- start start 2023-10-07T08:58:52.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f9600885700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95fc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f9600885700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95fc159c60 0x7f95fc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f9600885700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc15a160 con 0x7f95fc15db10 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f9600885700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0d13a0 con 0x7f95fc159c60 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f9600885700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15e140 con 0x7f95fc159890 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f95fad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95fc15db10 0x7f95fc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39772/0 (socket says 172.21.15.46:39772) 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f95fad9d700 1 -- 172.21.15.46:0/193673998 learned_addr learned my addr 172.21.15.46:0/193673998 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f95fa59c700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95fc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/193673998 >> v2:172.21.15.133:3300/0 conn(0x7f95fc159c60 0x7f95fc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.541+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319718558 0 0) 0x7f95fc15a160 con 0x7f95fc15db10 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e8003570 con 0x7f95fc15db10 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456599049 0 0) 0x7f95e8003570 con 0x7f95fc15db10 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 msgr2=0x7f95fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95fc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 >> v2:172.21.15.133:3300/0 conn(0x7f95fc159c60 msgr2=0x7f95fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 --2- 172.21.15.46:0/193673998 >> v2:172.21.15.133:3300/0 conn(0x7f95fc159c60 0x7f95fc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc15a3d0 con 0x7f95fc15db10 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f95ec0017f0 con 0x7f95fc15db10 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/193673998 >> v2:172.21.15.133:3300/0 conn(0x7f95fc159c60 0x7f95fc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 >> v1:172.21.15.46:6789/0 conn(0x7f95fc15db10 legacy=0x7f95fc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8003a60 0x7f95e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0d13a0 con 0x7f95e8004d50 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15e140 con 0x7f95e8003a60 2023-10-07T08:58:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e800ba60 con 0x7f95fc159890 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fa59c700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8003a60 0x7f95e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 -- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 msgr2=0x7f95e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc159890 0x7f95e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 -- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8003a60 msgr2=0x7f95e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8003a60 0x7f95e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.542+0000 7f95fad9d700 1 -- 172.21.15.46:0/193673998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8003570 con 0x7f95e8004d50 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f95fad9d700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95e80051c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00a970 tx=0x7f95ec002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa76877b0dab158 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec012440 con 0x7f95e8004d50 2023-10-07T08:58:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec0125c0 con 0x7f95e8004d50 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f95f959a700 1 -- 172.21.15.46:0/193673998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec012980 con 0x7f95e8004d50 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 -- 172.21.15.46:0/193673998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 msgr2=0x7f95e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 --2- 172.21.15.46:0/193673998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95e80051c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00a970 tx=0x7f95ec002210 comp rx=0 tx=0).stop 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f95fad9d700 1 -- 172.21.15.46:0/193673998 reap_dead start 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 -- 172.21.15.46:0/193673998 shutdown_connections 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 -- 172.21.15.46:0/193673998 >> 172.21.15.46:0/193673998 conn(0x7f95fc068e20 msgr2=0x7f95fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 -- 172.21.15.46:0/193673998 shutdown_connections 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.543+0000 7f9600885700 1 -- 172.21.15.46:0/193673998 wait complete. 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.544+0000 7f9600885700 1 Processor -- start 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.544+0000 7f9600885700 1 -- start start 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc0ce440 0x7f95fc15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 0x7f95fc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0cdfb0 con 0x7f95e8004d50 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0cd0c0 con 0x7f95fc0ce8b0 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f9600885700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0cd3a0 con 0x7f95fc0ce440 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45122/0 (socket says 172.21.15.46:45122) 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 -- 172.21.15.46:0/3944328388 learned_addr learned my addr 172.21.15.46:0/3944328388 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fad9d700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 0x7f95fc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc0ce440 0x7f95fc15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 -- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc0ce440 msgr2=0x7f95fc15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc0ce440 0x7f95fc15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 -- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 msgr2=0x7f95fc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 0x7f95fc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fa59c700 1 -- 172.21.15.46:0/3944328388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0cd680 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.545+0000 7f95fad9d700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 0x7f95fc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006ac0 tx=0x7f95f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f95f27fc700 1 -- 172.21.15.46:0/3944328388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400f940 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f95f27fc700 1 -- 172.21.15.46:0/3944328388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f400faa0 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0cd960 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f95f27fc700 1 -- 172.21.15.46:0/3944328388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400fe20 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.546+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc14c880 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.547+0000 7f95f27fc700 1 -- 172.21.15.46:0/3944328388 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95f4014650 con 0x7f95e8004d50 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.547+0000 7f95f27fc700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 0x7f95dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.548+0000 7f95f27fc700 1 -- 172.21.15.46:0/3944328388 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95f4018030 con 0x7f95e8004d50 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.548+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 0x7f95dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.548+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 0x7f95dc0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95fc159020 tx=0x7f95e40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 Processor -- start 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 -- start start 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a3289e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a31e0a70 con 0x55a4a32d3d00 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a31de270 con 0x55a4a32b2f60 2023-10-07T08:58:52.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a31da060 con 0x55a4a3289a50 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f95f9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f95f9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45126/0 (socket says 172.21.15.46:45126) 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.550+0000 7f95f9d9b700 1 -- 172.21.15.46:0/2213565866 learned_addr learned my addr 172.21.15.46:0/2213565866 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95fad9d700 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95fa59c700 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a3289e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 -- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 msgr2=0x55a4a3289e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a3289e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 -- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 msgr2=0x55a4a3285cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 -- 172.21.15.46:0/2213565866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a3074270 con 0x55a4a32d3d00 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95e4014ef0 tx=0x7f95e401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2361566189578446 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95db7fe700 1 -- 172.21.15.46:0/2213565866 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4022430 con 0x55a4a32d3d00 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95db7fe700 1 -- 172.21.15.46:0/2213565866 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e4019070 con 0x55a4a32d3d00 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.551+0000 7f95db7fe700 1 -- 172.21.15.46:0/2213565866 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40227a0 con 0x55a4a32d3d00 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- 172.21.15.46:0/2213565866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 msgr2=0x55a4a32b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95e4014ef0 tx=0x7f95e401c000 comp rx=0 tx=0).stop 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- 172.21.15.46:0/2213565866 shutdown_connections 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a3289e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 --2- 172.21.15.46:0/2213565866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32b2a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- 172.21.15.46:0/2213565866 >> 172.21.15.46:0/2213565866 conn(0x55a4a328b370 msgr2=0x55a4a328b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- 172.21.15.46:0/2213565866 shutdown_connections 2023-10-07T08:58:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- 172.21.15.46:0/2213565866 wait complete. 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 -- start start 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.552+0000 7f9609b7db80 1 Processor -- start 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a32cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a3185890 con 0x55a4a32d3d00 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a31a0ea0 con 0x55a4a32b2f60 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a305ce30 con 0x55a4a3289a50 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f9609b7db80 10 client.0 _ll_register_callbacks cb 0x55a4a324d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45142/0 (socket says 172.21.15.46:45142) 2023-10-07T08:58:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.553+0000 7f95fad9d700 1 -- 172.21.15.46:0/3002732648 learned_addr learned my addr 172.21.15.46:0/3002732648 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a32cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 -- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 msgr2=0x55a4a32e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 -- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 msgr2=0x55a4a32cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a32cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 -- 172.21.15.46:0/3002732648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4014ad0 con 0x55a4a32d3d00 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a32cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95fad9d700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00a000 tx=0x7f95ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76ef5b16dd036de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec001f30 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95ec012730 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4a327eb70 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95ec0128f0 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a4a3016fe0 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a4a327eb70 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f95ec005030 con 0x55a4a32d3d00 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 10 client.4629 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:58:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.554+0000 7f9609b7db80 20 client.4629 populate_metadata read hostname 'smithi046' 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32e18e0 0x55a4a32e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f9609b7db80 4 client.4629 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 --> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4a325baa0 con 0x55a4a32e18e0 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32e18e0 0x55a4a32e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f95fa59c700 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32e18e0 0x55a4a32e1cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59db4b89310c9504 server_cookie=9990d17aff10e79e in_seq=0 out_seq=0 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f95d8ff9700 10 client.4629 ms_handle_connect on v2:172.21.15.46:6833/1560537026 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f95d8ff9700 1 -- 172.21.15.46:0/3002732648 <== mds.0 v2:172.21.15.46:6833/1560537026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a4a325baa0 con 0x55a4a32e18e0 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f95d8ff9700 10 client.4629 handle_command_reply: tid=0 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.555+0000 7f9609b7db80 1 client.4629 shutdown 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 msgr2=0x55a4a32c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00a000 tx=0x7f95ec015000 comp rx=0 tx=0).stop 2023-10-07T08:58:52.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 shutdown_connections 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32c9e70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32e18e0 0x55a4a32e1cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 --2- 172.21.15.46:0/3002732648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a32cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f95d8ff9700 0 client.4629 ms_handle_reset on v2:172.21.15.46:6833/1560537026 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 >> 172.21.15.46:0/3002732648 conn(0x55a4a328b370 msgr2=0x55a4a32868d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 shutdown_connections 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 1 -- 172.21.15.46:0/3002732648 wait complete. 2023-10-07T08:58:52.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.556+0000 7f9609b7db80 20 client.4629 trim_cache size 0 max 16384 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 Processor -- start 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 -- start start 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a3282a60 con 0x55a4a32d3d00 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a3282550 con 0x55a4a32b2f60 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.573+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a32e28c0 con 0x55a4a3289a50 2023-10-07T08:58:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45156/0 (socket says 172.21.15.46:45156) 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 -- 172.21.15.46:0/910432913 learned_addr learned my addr 172.21.15.46:0/910432913 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fa59c700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 -- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 msgr2=0x55a4a32e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 -- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 msgr2=0x55a4a3285b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 -- 172.21.15.46:0/910432913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a31a8780 con 0x55a4a32d3d00 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fa59c700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95fad9d700 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95ec001cc0 tx=0x7f95ec00c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdf53671e3c852d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95dbfff700 1 -- 172.21.15.46:0/910432913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec001f30 con 0x55a4a32d3d00 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95dbfff700 1 -- 172.21.15.46:0/910432913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec0017b0 con 0x55a4a32d3d00 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.574+0000 7f95dbfff700 1 -- 172.21.15.46:0/910432913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005010 con 0x55a4a32d3d00 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- 172.21.15.46:0/910432913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 msgr2=0x55a4a32cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95ec001cc0 tx=0x7f95ec00c050 comp rx=0 tx=0).stop 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- 172.21.15.46:0/910432913 shutdown_connections 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf440 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a3289a50 0x55a4a32e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 --2- 172.21.15.46:0/910432913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a32b2f60 0x55a4a3285b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- 172.21.15.46:0/910432913 >> 172.21.15.46:0/910432913 conn(0x55a4a328b370 msgr2=0x55a4a32af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- 172.21.15.46:0/910432913 shutdown_connections 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- 172.21.15.46:0/910432913 wait complete. 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 -- start start 2023-10-07T08:58:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.575+0000 7f9609b7db80 1 Processor -- start 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a3289a50 0x55a4a332f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 0x55a4a32cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a32e9f70 con 0x55a4a32d3d00 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a33366a0 con 0x55a4a3289a50 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a33360c0 con 0x55a4a32b2f60 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f9609b7db80 10 client.0 _ll_register_callbacks cb 0x55a4a324d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f95fad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45166/0 (socket says 172.21.15.46:45166) 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f95fad9d700 1 -- 172.21.15.46:0/1809446809 learned_addr learned my addr 172.21.15.46:0/1809446809 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f95fa59c700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a3289a50 0x55a4a332f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.576+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 0x55a4a32cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 -- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 msgr2=0x55a4a32cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 0x55a4a32cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 -- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a3289a50 msgr2=0x55a4a332f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a3289a50 0x55a4a332f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 -- 172.21.15.46:0/1809446809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4a3016fe0 con 0x55a4a32d3d00 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95f9d9b700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 0x55a4a32cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95fad9d700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95ec002220 tx=0x7f95ec031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26b23c46648a881 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec001920 con 0x55a4a32d3d00 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95ec001a80 con 0x55a4a32d3d00 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95e4019070 con 0x55a4a32d3d00 2023-10-07T08:58:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95ec004fd0 con 0x55a4a32d3d00 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 10 client.4635 fetch_fsmap learned FSMap version 8 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a4a318f470 con 0x55a4a32d3d00 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e4019070 con 0x55a4a32d3d00 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f95ec03e050 con 0x55a4a32d3d00 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 20 client.4635 populate_metadata read hostname 'smithi046' 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32c6560 0x55a4a32c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 4 client.4635 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.577+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 --> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a4a317ce00 con 0x55a4a32c6560 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95fa59c700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32c6560 0x55a4a32c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95fa59c700 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32c6560 0x55a4a32c6930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c99985dbd5f38b2 server_cookie=652e4a1bef50352 in_seq=0 out_seq=0 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95d8ff9700 10 client.4635 ms_handle_connect on v2:172.21.15.46:6833/1560537026 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95d8ff9700 1 -- 172.21.15.46:0/1809446809 <== mds.0 v2:172.21.15.46:6833/1560537026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a4a317ce00 con 0x55a4a32c6560 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95d8ff9700 10 client.4635 handle_command_reply: tid=0 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 client.4635 shutdown 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 msgr2=0x55a4a32cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95ec002220 tx=0x7f95ec031000 comp rx=0 tx=0).stop 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 shutdown_connections 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a4a32d3d00 0x55a4a32cf980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.46:6833/1560537026,v1:172.21.15.46:6835/1560537026] conn(0x55a4a32c6560 0x55a4a32c6930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a4a3289a50 0x55a4a332f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f95d8ff9700 0 client.4635 ms_handle_reset on v2:172.21.15.46:6833/1560537026 2023-10-07T08:58:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 --2- 172.21.15.46:0/1809446809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a4a32b2f60 0x55a4a32cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 >> 172.21.15.46:0/1809446809 conn(0x55a4a328b370 msgr2=0x55a4a32af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 shutdown_connections 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 1 -- 172.21.15.46:0/1809446809 wait complete. 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.578+0000 7f9609b7db80 20 client.4635 trim_cache size 0 max 16384 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4293, 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T08:58:52.587 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 14.323193636999999, 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 21, 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 21, 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 21.519916457000001 2023-10-07T08:58:52.588 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 msgr2=0x7f95dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 0x7f95dc0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95fc159020 tx=0x7f95e40091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 msgr2=0x7f95fc14c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006ac0 tx=0x7f95f40091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 shutdown_connections 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f95dc066f30 0x7f95dc0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95fc0ce8b0 0x7f95fc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8004d50 0x7f95fc14c340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 --2- 172.21.15.46:0/3944328388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95fc0ce440 0x7f95fc15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:52.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 >> 172.21.15.46:0/3944328388 conn(0x7f95fc068e20 msgr2=0x7f95fc15cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:52.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 shutdown_connections 2023-10-07T08:58:52.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:52.579+0000 7f9600885700 1 -- 172.21.15.46:0/3944328388 wait complete. 2023-10-07T08:58:52.591 INFO:teuthology.run_tasks:Running task kclient... 2023-10-07T08:58:52.612 INFO:tasks.kclient:Mounting kernel clients... 2023-10-07T08:58:52.612 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-07T08:58:52.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.612 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T08:58:52.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-07T08:58:52.694 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-10-07T08:58:52.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:58:52.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.696 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T08:58:52.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-07T08:58:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-10-07T08:58:52.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:58:52.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.819 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T08:58:52.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-10-07T08:58:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-10-07T08:58:52.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:58:52.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.912 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T08:58:52.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:52.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-10-07T08:58:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-10-07T08:58:53.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:58:53.038 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-07T08:58:53.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:58:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.157+0000 7f03f8ab7700 1 Processor -- start 2023-10-07T08:58:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.157+0000 7f03f8ab7700 1 -- start start 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f8ab7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03f4159890 0x7f03f415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f8ab7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03f4069560 0x7f03f40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f8ab7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f4069ee0 con 0x7f03f4159c60 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f8ab7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f415a160 con 0x7f03f4159890 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f8ab7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40d13a0 con 0x7f03f4069560 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03f4159890 0x7f03f415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03f4159890 0x7f03f415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45170/0 (socket says 172.21.15.46:45170) 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.158+0000 7f03f259c700 1 -- 172.21.15.46:0/806127119 learned_addr learned my addr 172.21.15.46:0/806127119 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f2d9d700 1 --2- 172.21.15.46:0/806127119 >> v2:172.21.15.133:3300/0 conn(0x7f03f4069560 0x7f03f40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f259c700 1 -- 172.21.15.46:0/806127119 >> v2:172.21.15.133:3300/0 conn(0x7f03f4069560 msgr2=0x7f03f40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f259c700 1 --2- 172.21.15.46:0/806127119 >> v2:172.21.15.133:3300/0 conn(0x7f03f4069560 0x7f03f40699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f259c700 1 -- 172.21.15.46:0/806127119 >> v1:172.21.15.133:6789/0 conn(0x7f03f4159c60 legacy=0x7f03f415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f259c700 1 -- 172.21.15.46:0/806127119 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f415e140 con 0x7f03f4159890 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f259c700 1 --2- 172.21.15.46:0/806127119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4159890 0x7f03f415abd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03f406a890 tx=0x7f03ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b533ed57737928da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f159a700 1 -- 172.21.15.46:0/806127119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00e070 con 0x7f03f4159890 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f159a700 1 -- 172.21.15.46:0/806127119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec00ba10 con 0x7f03f4159890 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.159+0000 7f03f159a700 1 -- 172.21.15.46:0/806127119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0092e0 con 0x7f03f4159890 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 -- 172.21.15.46:0/806127119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4159890 msgr2=0x7f03f415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/806127119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4159890 0x7f03f415abd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03f406a890 tx=0x7f03ec009840 comp rx=0 tx=0).stop 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 -- 172.21.15.46:0/806127119 shutdown_connections 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/806127119 >> v2:172.21.15.133:3300/0 conn(0x7f03f4069560 0x7f03f40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/806127119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4159890 0x7f03f415abd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 -- 172.21.15.46:0/806127119 >> 172.21.15.46:0/806127119 conn(0x7f03f4068e20 msgr2=0x7f03f40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 -- 172.21.15.46:0/806127119 shutdown_connections 2023-10-07T08:58:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.160+0000 7f03f8ab7700 1 -- 172.21.15.46:0/806127119 wait complete. 2023-10-07T08:58:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.161+0000 7f03f8ab7700 1 Processor -- start 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.161+0000 7f03f8ab7700 1 -- start start 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 0x7f03f40c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f4159c60 0x7f03f40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4152860 con 0x7f03f4069560 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40b3650 con 0x7f03f4159c60 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40c8410 con 0x7f03f4159890 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45182/0 (socket says 172.21.15.46:45182) 2023-10-07T08:58:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 -- 172.21.15.46:0/3611425389 learned_addr learned my addr 172.21.15.46:0/3611425389 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f2d9d700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f4159c60 0x7f03f40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f1d9b700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 0x7f03f40c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 -- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 msgr2=0x7f03f40c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 0x7f03f40c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 -- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f4159c60 msgr2=0x7f03f40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f4159c60 0x7f03f40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 -- 172.21.15.46:0/3611425389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec009ae0 con 0x7f03f4069560 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f1d9b700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 0x7f03f40c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f259c700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009fd0 tx=0x7f03ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec012950 con 0x7f03f4069560 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec012ab0 con 0x7f03f4069560 2023-10-07T08:58:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40c86f0 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec012e70 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.162+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40c8cb0 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.163+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f404c3c0 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.164+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03ec01d630 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.164+0000 7f03ea7fc700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 0x7f03d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.164+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03ec086030 con 0x7f03f4069560 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.164+0000 7f03f1d9b700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 0x7f03d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.165+0000 7f03f1d9b700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 0x7f03d40693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03dc006fd0 tx=0x7f03dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.168+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03ec0532a0 con 0x7f03f4069560 2023-10-07T08:58:53.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.407+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f03f406a5b0 con 0x7f03f4069560 2023-10-07T08:58:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.407+0000 7f03ea7fc700 1 -- 172.21.15.46:0/3611425389 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f03ec0568c0 con 0x7f03f4069560 2023-10-07T08:58:53.408 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 msgr2=0x7f03d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 0x7f03d40693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03dc006fd0 tx=0x7f03dc008040 comp rx=0 tx=0).stop 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 msgr2=0x7f03f4147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009fd0 tx=0x7f03ec017000 comp rx=0 tx=0).stop 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 shutdown_connections 2023-10-07T08:58:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f03d4066f30 0x7f03d40693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f4159c60 0x7f03f40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03f4069560 0x7f03f4147210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 --2- 172.21.15.46:0/3611425389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03f4159890 0x7f03f40c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 >> 172.21.15.46:0/3611425389 conn(0x7f03f4068e20 msgr2=0x7f03f4153420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 shutdown_connections 2023-10-07T08:58:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:53.409+0000 7f03f8ab7700 1 -- 172.21.15.46:0/3611425389 wait complete. 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:58:53.422 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:58:53.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.423 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:53.438 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42480sec preferred_lft 42480sec 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:53.440 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:53.440 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T08:58:53.440 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-07T08:58:53.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:53.440 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:53.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-10-07T08:58:53.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-10-07T08:58:53.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-10-07T08:58:53.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-07T08:58:53.441 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:53.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.599 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:58:53.643 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T08:58:53.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.644 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T08:58:53.675 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T08:58:53.676 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:58:53.676 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T08:58:53.676 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T08:58:53.676 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:58:53.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:53.677 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:53.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T08:58:53.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T08:58:53.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T08:58:53.677 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:53.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.943 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T08:58:53.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:53.958 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-10-07T08:58:54.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:54.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:54.014 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:54.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:58:54.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-07T08:58:54.014 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:54.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-07T08:58:54.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-07T08:58:54.105 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:54.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:54.321 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:54.322 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:54.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T08:58:54.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-10-07T08:58:54.322 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:54.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:54.417 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:58:54.431 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:58:54.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:54.432 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:58:54.487 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T08:58:54.487 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:58:54.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:54.574 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:54.574 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:54.663 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:54.663 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:54.663 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:54.664 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:54.664 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:54.664 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:54.664 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:54.664 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:54.686 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:54.687 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:54.687 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:54.687 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:54.688 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:54.688 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:54.688 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:54.689 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:54.689 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:58:54.689 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:58:54.689 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:58:54.690 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:58:54.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:54.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:58:54.716 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-07T08:58:54.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:58:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.874+0000 7f20a9c77700 1 Processor -- start 2023-10-07T08:58:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.874+0000 7f20a9c77700 1 -- start start 2023-10-07T08:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a9c77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20a4159890 0x7f20a415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a9c77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f20a415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a9c77700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a415a160 con 0x7f20a415db10 2023-10-07T08:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a9c77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40d13a0 con 0x7f20a4159890 2023-10-07T08:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a9c77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a415e140 con 0x7f20a4159c60 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a3fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f20a415db10 0x7f20a4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39784/0 (socket says 172.21.15.46:39784) 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a3fff700 1 -- 172.21.15.46:0/1792976737 learned_addr learned my addr 172.21.15.46:0/1792976737 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.875+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212037494 0 0) 0x7f20a415a160 con 0x7f20a415db10 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f208c003570 con 0x7f20a415db10 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a2ffd700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f20a415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a37fe700 1 --2- 172.21.15.46:0/1792976737 >> v2:172.21.15.133:3300/0 conn(0x7f20a4159890 0x7f20a415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931373233 0 0) 0x7f208c003570 con 0x7f20a415db10 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 msgr2=0x7f20a415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f20a415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 >> v2:172.21.15.133:3300/0 conn(0x7f20a4159890 msgr2=0x7f20a415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 --2- 172.21.15.46:0/1792976737 >> v2:172.21.15.133:3300/0 conn(0x7f20a4159890 0x7f20a415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a415a3d0 con 0x7f20a415db10 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f209c0017f0 con 0x7f20a415db10 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 >> v1:172.21.15.46:6789/0 conn(0x7f20a415db10 legacy=0x7f20a4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f208c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f208c003fe0 0x7f208c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f208c004d50 0x7f208c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40d13a0 con 0x7f208c004d50 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a415e140 con 0x7f208c003fe0 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c00ba90 con 0x7f20a4159c60 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f208c004d50 0x7f208c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a2ffd700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f208c003fe0 0x7f208c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a37fe700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f208c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 -- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 msgr2=0x7f208c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20a4159c60 0x7f208c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 -- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f208c003fe0 msgr2=0x7f208c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f208c003fe0 0x7f208c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.876+0000 7f20a3fff700 1 -- 172.21.15.46:0/1792976737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c003570 con 0x7f208c004d50 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f208c004d50 0x7f208c0051c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a970 tx=0x7f209c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd9549b0b1e7a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c012440 con 0x7f208c004d50 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0125c0 con 0x7f208c004d50 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a27fc700 1 -- 172.21.15.46:0/1792976737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c012980 con 0x7f208c004d50 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 -- 172.21.15.46:0/1792976737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f208c004d50 msgr2=0x7f208c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1792976737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f208c004d50 0x7f208c0051c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a970 tx=0x7f209c002210 comp rx=0 tx=0).stop 2023-10-07T08:58:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a3fff700 1 -- 172.21.15.46:0/1792976737 reap_dead start 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 -- 172.21.15.46:0/1792976737 shutdown_connections 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 -- 172.21.15.46:0/1792976737 >> 172.21.15.46:0/1792976737 conn(0x7f20a4068e20 msgr2=0x7f20a40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 -- 172.21.15.46:0/1792976737 shutdown_connections 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.877+0000 7f20a9c77700 1 -- 172.21.15.46:0/1792976737 wait complete. 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 Processor -- start 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 -- start start 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f208c004d50 0x7f20a40b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a414d190 0x7f20a40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b2580 con 0x7f20a40ce8d0 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b3730 con 0x7f20a414d190 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a9c77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b39d0 con 0x7f208c004d50 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.879+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45212/0 (socket says 172.21.15.46:45212) 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 -- 172.21.15.46:0/1058776298 learned_addr learned my addr 172.21.15.46:0/1058776298 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a37fe700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f208c004d50 0x7f20a40b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a2ffd700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a414d190 0x7f20a40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 -- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f208c004d50 msgr2=0x7f20a40b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f208c004d50 0x7f20a40b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 -- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a414d190 msgr2=0x7f20a40b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a414d190 0x7f20a40b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 -- 172.21.15.46:0/1058776298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40b3cb0 con 0x7f20a40ce8d0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a3fff700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a000 tx=0x7f209c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c0017b0 con 0x7f20a40ce8d0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0072e0 con 0x7f20a40ce8d0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40b3f90 con 0x7f20a40ce8d0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c0076c0 con 0x7f20a40ce8d0 2023-10-07T08:58:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.880+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a40ced20 con 0x7f20a40ce8d0 2023-10-07T08:58:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.881+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40cef10 con 0x7f20a40ce8d0 2023-10-07T08:58:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.882+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f209c019030 con 0x7f20a40ce8d0 2023-10-07T08:58:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.882+0000 7f208b7fe700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 0x7f20900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.882+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f209c086320 con 0x7f20a40ce8d0 2023-10-07T08:58:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.882+0000 7f20a37fe700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 0x7f20900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:54.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.883+0000 7f20a37fe700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 0x7f20900693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2094006f00 tx=0x7f20940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:54.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:54.886+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f209c053590 con 0x7f20a40ce8d0 2023-10-07T08:58:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.126+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20a40b4180 con 0x7f20a40ce8d0 2023-10-07T08:58:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.126+0000 7f208b7fe700 1 -- 172.21.15.46:0/1058776298 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f209c056bb0 con 0x7f20a40ce8d0 2023-10-07T08:58:55.127 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 msgr2=0x7f20900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 0x7f20900693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2094006f00 tx=0x7f20940091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 msgr2=0x7f20a40b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a000 tx=0x7f209c015000 comp rx=0 tx=0).stop 2023-10-07T08:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 shutdown_connections 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2090066f30 0x7f20900693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20a40ce8d0 0x7f20a40b4b20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f208c004d50 0x7f20a40b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 --2- 172.21.15.46:0/1058776298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a414d190 0x7f20a40b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 >> 172.21.15.46:0/1058776298 conn(0x7f20a4068e20 msgr2=0x7f20a40cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 shutdown_connections 2023-10-07T08:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:55.128+0000 7f20a9c77700 1 -- 172.21.15.46:0/1058776298 wait complete. 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-07T08:58:55.142 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:58:55.143 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:58:55.143 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:58:55.143 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-07T08:58:55.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.143 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T08:58:55.159 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:55.159 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:55.159 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:55.160 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42478sec preferred_lft 42478sec 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T08:58:55.161 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:58:55.162 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link tentative 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link tentative 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.164 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:58:55.223 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T08:58:55.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.225 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T08:58:55.281 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T08:58:55.281 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:58:55.281 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T08:58:55.281 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T08:58:55.282 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:58:55.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.282 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:55.282 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:55.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T08:58:55.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T08:58:55.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T08:58:55.283 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:55.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.384 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T08:58:55.399 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:58:55.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.400 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-10-07T08:58:55.454 INFO:teuthology.orchestra.run.smithi046.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-07T08:58:55.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.455 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:55.455 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:55.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:58:55.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-07T08:58:55.455 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:55.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-07T08:58:55.587 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether da:54:78:18:2b:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::d854:78ff:fe18:2b39/64 scope link tentative 2023-10-07T08:58:55.589 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-07T08:58:55.677 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:55.677 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether da:54:78:18:2b:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::d854:78ff:fe18:2b39/64 scope link tentative 2023-10-07T08:58:55.678 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:55.690 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-07T08:58:55.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.690 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:55.690 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:55.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-07T08:58:55.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-07T08:58:55.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-07T08:58:55.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-07T08:58:55.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-07T08:58:55.691 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:55.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:55.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:58:55.922 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:58:55.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.1 up 2023-10-07T08:58:55.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.1 master ceph-brx 2023-10-07T08:58:55.923 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:58:56.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:56.004 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-07T08:58:56.018 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-07T08:58:56.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:56.019 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-07T08:58:56.073 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-07T08:58:56.073 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:58:56.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:56.155 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:56.155 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 2@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:56.174 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:56.175 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:56.195 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:56.195 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:56.195 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:56.195 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 2@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:58:56.196 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:58:56.197 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:58:56.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:56.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-07T08:58:56.263 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-07T08:58:56.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:58:56.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.422+0000 7fe2d9b7d700 1 Processor -- start 2023-10-07T08:58:56.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.422+0000 7fe2d9b7d700 1 -- start start 2023-10-07T08:58:56.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d9b7d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 0x7fe2d40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:56.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d9b7d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40b11d0 con 0x7fe2d4159420 2023-10-07T08:58:56.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d9b7d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40b14b0 con 0x7fe2d415d230 2023-10-07T08:58:56.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d9b7d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40b1790 con 0x7fe2d41597f0 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d8b7b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe2d4159420 0x7fe2d40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39792/0 (socket says 172.21.15.46:39792) 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d8b7b700 1 -- 172.21.15.46:0/3692040484 learned_addr learned my addr 172.21.15.46:0/3692040484 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d3fff700 1 --2- 172.21.15.46:0/3692040484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 0x7fe2d40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125475375 0 0) 0x7fe2d40b11d0 con 0x7fe2d4159420 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.423+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c4003570 con 0x7fe2d4159420 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721038197 0 0) 0x7fe2d40b14b0 con 0x7fe2d415d230 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d40b11d0 con 0x7fe2d415d230 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1466368366 0 0) 0x7fe2c4003570 con 0x7fe2d4159420 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d3fff700 1 -- 172.21.15.46:0/3692040484 >> v1:172.21.15.133:6789/0 conn(0x7fe2d415d230 legacy=0x7fe2d40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d3fff700 1 -- 172.21.15.46:0/3692040484 >> v1:172.21.15.46:6789/0 conn(0x7fe2d4159420 legacy=0x7fe2d40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d3fff700 1 -- 172.21.15.46:0/3692040484 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40b1a70 con 0x7fe2d41597f0 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d3fff700 1 --2- 172.21.15.46:0/3692040484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 0x7fe2d40b2270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009910 tx=0x7fe2c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5561b7cc2f4e24cb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8001470 con 0x7fe2d41597f0 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0011420 con 0x7fe2d41597f0 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.424+0000 7fe2d37fe700 1 -- 172.21.15.46:0/3692040484 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00117c0 con 0x7fe2d41597f0 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3692040484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 msgr2=0x7fe2d40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3692040484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 0x7fe2d40b2270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009910 tx=0x7fe2c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3692040484 shutdown_connections 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3692040484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d41597f0 0x7fe2d40b2270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3692040484 >> 172.21.15.46:0/3692040484 conn(0x7fe2d40d0660 msgr2=0x7fe2d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:56.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3692040484 shutdown_connections 2023-10-07T08:58:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.425+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3692040484 wait complete. 2023-10-07T08:58:56.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.426+0000 7fe2d9b7d700 1 Processor -- start 2023-10-07T08:58:56.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.426+0000 7fe2d9b7d700 1 -- start start 2023-10-07T08:58:56.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d4159420 0x7fe2d4156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 0x7fe2d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d4159e30 con 0x7fe2d415d230 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40c5e50 con 0x7fe2d41597f0 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40c6130 con 0x7fe2d4159420 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45214/0 (socket says 172.21.15.46:45214) 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 -- 172.21.15.46:0/3751430130 learned_addr learned my addr 172.21.15.46:0/3751430130 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d8b7b700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d4159420 0x7fe2d4156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d3fff700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 0x7fe2d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 -- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d4159420 msgr2=0x7fe2d4156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d4159420 0x7fe2d4156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 -- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 msgr2=0x7fe2d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 0x7fe2d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 -- 172.21.15.46:0/3751430130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009420 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d3fff700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 0x7fe2d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d937c700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c860 tx=0x7fe2cc002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc002030 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0021b0 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.427+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d40c6410 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.428+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc012630 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.428+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d4156570 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.429+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d40c6650 con 0x7fe2d415d230 2023-10-07T08:58:56.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.429+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2cc012a20 con 0x7fe2d415d230 2023-10-07T08:58:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.429+0000 7fe2d0ff9700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 0x7fe2b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.429+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2cc0844d0 con 0x7fe2d415d230 2023-10-07T08:58:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.429+0000 7fe2d8b7b700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 0x7fe2b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.430+0000 7fe2d8b7b700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 0x7fe2b80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80011e0 tx=0x7fe2c8000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.434+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d40c6650 con 0x7fe2d415d230 2023-10-07T08:58:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.672+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2d40c6650 con 0x7fe2d415d230 2023-10-07T08:58:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.673+0000 7fe2d0ff9700 1 -- 172.21.15.46:0/3751430130 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe2d40c6650 con 0x7fe2d415d230 2023-10-07T08:58:56.674 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 msgr2=0x7fe2b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 0x7fe2b80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80011e0 tx=0x7fe2c8000bc0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 msgr2=0x7fe2d40c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c860 tx=0x7fe2cc002700 comp rx=0 tx=0).stop 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 shutdown_connections 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe2b8066f30 0x7fe2b80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d415d230 0x7fe2d40c6ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2d4159420 0x7fe2d4156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 --2- 172.21.15.46:0/3751430130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d41597f0 0x7fe2d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:56.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 >> 172.21.15.46:0/3751430130 conn(0x7fe2d40d0660 msgr2=0x7fe2d4157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:56.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 shutdown_connections 2023-10-07T08:58:56.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:56.675+0000 7fe2d9b7d700 1 -- 172.21.15.46:0/3751430130 wait complete. 2023-10-07T08:58:56.687 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:58:56.688 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:58:56.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:56.689 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T08:58:56.707 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:56.708 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42469sec preferred_lft 42469sec 2023-10-07T08:58:56.709 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T08:58:56.710 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:56.710 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-07T08:58:56.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:56.710 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:56.710 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:56.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-10-07T08:58:56.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-10-07T08:58:56.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-10-07T08:58:56.711 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-07T08:58:56.711 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:56.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:56.886 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:58:56.927 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T08:58:56.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:56.929 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T08:58:57.023 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T08:58:57.023 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:58:57.023 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:58:57.023 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:58:57.023 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:58:57.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:58:57.024 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:57.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.230 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T08:58:57.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.245 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-10-07T08:58:57.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.299 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:57.300 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:57.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:58:57.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-07T08:58:57.300 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:57.390 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-07T08:58:57.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.390 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:57.390 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:57.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-07T08:58:57.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-07T08:58:57.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-07T08:58:57.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-07T08:58:57.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-07T08:58:57.391 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:57.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.589 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:57.589 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:57.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T08:58:57.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-10-07T08:58:57.589 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:57.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:57.681 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:58:57.695 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:58:57.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:57.695 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:58:57.749 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T08:58:57.749 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:58:57.750 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:57.842 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:57.842 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:57.925 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:57.925 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:57.925 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:57.925 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:57.925 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:57.926 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:57.926 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:57.926 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:57.948 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:57.948 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:57.948 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:57.948 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:57.948 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:58:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:58:57.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:58:57.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:57.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:58:57.975 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-07T08:58:57.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:58:58.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.108+0000 7f124d8b0700 1 Processor -- start 2023-10-07T08:58:58.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.108+0000 7f124d8b0700 1 -- start start 2023-10-07T08:58:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f124d8b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 0x7f12481598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f124d8b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 0x7f124815a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f124d8b0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12480d01f0 con 0x7f12481594d0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f124d8b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480cd540 con 0x7f1248159de0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f124d8b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480cf5e0 con 0x7f12480cd0f0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f1246ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f12481594d0 0x7f12480b5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39800/0 (socket says 172.21.15.46:39800) 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f1246ffd700 1 -- 172.21.15.46:0/2779788680 learned_addr learned my addr 172.21.15.46:0/2779788680 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f12467fc700 1 --2- 172.21.15.46:0/2779788680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 0x7f12481598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.109+0000 7f12477fe700 1 --2- 172.21.15.46:0/2779788680 >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 0x7f124815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f1245ffb700 1 -- 172.21.15.46:0/2779788680 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688956249 0 0) 0x7f12480d01f0 con 0x7f12481594d0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f1245ffb700 1 -- 172.21.15.46:0/2779788680 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1234003570 con 0x7f12481594d0 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12467fc700 1 -- 172.21.15.46:0/2779788680 >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 msgr2=0x7f124815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12467fc700 1 --2- 172.21.15.46:0/2779788680 >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 0x7f124815a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12467fc700 1 -- 172.21.15.46:0/2779788680 >> v1:172.21.15.46:6789/0 conn(0x7f12481594d0 legacy=0x7f12480b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12467fc700 1 -- 172.21.15.46:0/2779788680 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480cf8c0 con 0x7f12480cd0f0 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12477fe700 1 --2- 172.21.15.46:0/2779788680 >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 0x7f124815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f12467fc700 1 --2- 172.21.15.46:0/2779788680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 0x7f12481598a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12300098e0 tx=0x7f12300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6640b4572afe5747 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f1245ffb700 1 -- 172.21.15.46:0/2779788680 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011630 con 0x7f12480cd0f0 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f1245ffb700 1 -- 172.21.15.46:0/2779788680 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230011790 con 0x7f12480cd0f0 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.110+0000 7f1245ffb700 1 -- 172.21.15.46:0/2779788680 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011b30 con 0x7f12480cd0f0 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 -- 172.21.15.46:0/2779788680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 msgr2=0x7f12481598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 --2- 172.21.15.46:0/2779788680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 0x7f12481598a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12300098e0 tx=0x7f12300091a0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 -- 172.21.15.46:0/2779788680 shutdown_connections 2023-10-07T08:58:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 --2- 172.21.15.46:0/2779788680 >> v2:172.21.15.133:3300/0 conn(0x7f1248159de0 0x7f124815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 --2- 172.21.15.46:0/2779788680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12480cd0f0 0x7f12481598a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 -- 172.21.15.46:0/2779788680 >> 172.21.15.46:0/2779788680 conn(0x7f12480d05f0 msgr2=0x7f12480d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 -- 172.21.15.46:0/2779788680 shutdown_connections 2023-10-07T08:58:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.111+0000 7f124d8b0700 1 -- 172.21.15.46:0/2779788680 wait complete. 2023-10-07T08:58:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.112+0000 7f124d8b0700 1 Processor -- start 2023-10-07T08:58:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.112+0000 7f124d8b0700 1 -- start start 2023-10-07T08:58:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12480cd0f0 0x7f12480b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1248159de0 0x7f124814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124814f090 con 0x7f12481594d0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124814f2a0 con 0x7f12480cd0f0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f124d8b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124814f580 con 0x7f1248159de0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45222/0 (socket says 172.21.15.46:45222) 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 -- 172.21.15.46:0/1924722739 learned_addr learned my addr 172.21.15.46:0/1924722739 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f1246ffd700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12480cd0f0 0x7f12480b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12477fe700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1248159de0 0x7f124814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 -- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1248159de0 msgr2=0x7f124814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1248159de0 0x7f124814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 -- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12480cd0f0 msgr2=0x7f12480b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12480cd0f0 0x7f12480b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 -- 172.21.15.46:0/1924722739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238009420 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.113+0000 7f12467fc700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12480cf720 tx=0x7f1230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011b10 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12300253f0 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300257b0 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230009420 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124816dff0 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.114+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124804c3c0 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.115+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1230025ba0 con 0x7f12481594d0 2023-10-07T08:58:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.115+0000 7f123effd700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.115+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1230085e70 con 0x7f12481594d0 2023-10-07T08:58:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.116+0000 7f1246ffd700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.116+0000 7f1246ffd700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 0x7f12280693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1240005c50 tx=0x7f1240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.120+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12300530e0 con 0x7f12481594d0 2023-10-07T08:58:58.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.365+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12480cfba0 con 0x7f12481594d0 2023-10-07T08:58:58.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.365+0000 7f123effd700 1 -- 172.21.15.46:0/1924722739 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1230056700 con 0x7f12481594d0 2023-10-07T08:58:58.366 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:58:58.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 msgr2=0x7f12280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 0x7f12280693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1240005c50 tx=0x7f1240009040 comp rx=0 tx=0).stop 2023-10-07T08:58:58.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 msgr2=0x7f124814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:58.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12480cf720 tx=0x7f1230017000 comp rx=0 tx=0).stop 2023-10-07T08:58:58.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 shutdown_connections 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1248159de0 0x7f124814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12480cd0f0 0x7f12480b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 --2- 172.21.15.46:0/1924722739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12481594d0 0x7f124814eb50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 >> 172.21.15.46:0/1924722739 conn(0x7f12480d05f0 msgr2=0x7f12480b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 shutdown_connections 2023-10-07T08:58:58.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:58.367+0000 7f124d8b0700 1 -- 172.21.15.46:0/1924722739 wait complete. 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:58:58.380 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-07T08:58:58.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.381 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T08:58:58.396 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:58.396 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:58.396 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:58.396 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:58.397 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42468sec preferred_lft 42468sec 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link tentative 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.398 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:58:58.399 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:58:58.399 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link tentative 2023-10-07T08:58:58.399 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.399 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:58:58.459 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T08:58:58.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.461 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T08:58:58.517 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T08:58:58.517 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:58:58.517 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:58:58.518 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:58:58.518 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:58:58.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.518 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:58.518 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:58.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:58:58.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:58:58.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:58:58.519 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:58.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.617 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T08:58:58.631 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:58:58.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.632 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-10-07T08:58:58.686 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-07T08:58:58.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.687 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:58.687 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:58.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:58:58.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-07T08:58:58.687 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:58.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.776 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:58.815 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 32:da:4f:a9:19:dd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::30da:4fff:fea9:19dd/64 scope link tentative 2023-10-07T08:58:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:58:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 32:da:4f:a9:19:dd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:58:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:58:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::30da:4fff:fea9:19dd/64 scope link tentative 2023-10-07T08:58:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:58:58.921 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-07T08:58:58.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-07T08:58:58.922 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:59.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:59.141 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:58:59.141 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:58:59.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2023-10-07T08:58:59.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2023-10-07T08:58:59.141 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:58:59.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:59.221 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-07T08:58:59.237 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-07T08:58:59.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:58:59.238 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-07T08:58:59.293 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-07T08:58:59.293 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:58:59.293 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:59.373 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:59.373 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:59.391 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:59.391 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:59.391 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 3@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:59.414 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:58:59.414 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:58:59.414 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 3@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:58:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:58:59.416 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:58:59.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:58:59.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-07T08:58:59.481 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-07T08:58:59.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:58:59.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.629+0000 7f863b59e700 1 Processor -- start 2023-10-07T08:58:59.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.629+0000 7f863b59e700 1 -- start start 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 0x7f863c0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0b16a0 con 0x7f863c0cc3c0 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0b1c60 con 0x7f863c06c0f0 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c1578a0 con 0x7f863c1574d0 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 0x7f863c0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44028/0 (socket says 172.21.15.46:44028) 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f863a59c700 1 -- 172.21.15.46:0/3672734881 learned_addr learned my addr 172.21.15.46:0/3672734881 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.630+0000 7f8639d9b700 1 --1- 172.21.15.46:0/3672734881 >> v1:172.21.15.133:6789/0 conn(0x7f863c0cc3c0 0x7f863c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33364/0 (socket says 172.21.15.46:33364) 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863a59c700 1 -- 172.21.15.46:0/3672734881 >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 msgr2=0x7f863c0b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863a59c700 1 --2- 172.21.15.46:0/3672734881 >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 0x7f863c0b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863a59c700 1 -- 172.21.15.46:0/3672734881 >> v1:172.21.15.133:6789/0 conn(0x7f863c0cc3c0 legacy=0x7f863c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863a59c700 1 -- 172.21.15.46:0/3672734881 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0cdb70 con 0x7f863c1574d0 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863959a700 1 -- 172.21.15.46:0/3672734881 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841534037 0 0) 0x7f863c0b16a0 con 0x7f863c0cc3c0 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863ad9d700 1 --2- 172.21.15.46:0/3672734881 >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 0x7f863c0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863a59c700 1 --2- 172.21.15.46:0/3672734881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8634009990 tx=0x7f8634009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d70418eb43681d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863959a700 1 -- 172.21.15.46:0/3672734881 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634009e80 con 0x7f863c1574d0 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863959a700 1 -- 172.21.15.46:0/3672734881 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634005c10 con 0x7f863c1574d0 2023-10-07T08:58:59.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.631+0000 7f863959a700 1 -- 172.21.15.46:0/3672734881 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400b650 con 0x7f863c1574d0 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 -- 172.21.15.46:0/3672734881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 msgr2=0x7f863c0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 --2- 172.21.15.46:0/3672734881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8634009990 tx=0x7f8634009220 comp rx=0 tx=0).stop 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 -- 172.21.15.46:0/3672734881 shutdown_connections 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 --2- 172.21.15.46:0/3672734881 >> v2:172.21.15.133:3300/0 conn(0x7f863c06c0f0 0x7f863c0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 --2- 172.21.15.46:0/3672734881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c1574d0 0x7f863c0cd270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 -- 172.21.15.46:0/3672734881 >> 172.21.15.46:0/3672734881 conn(0x7f863c0ce430 msgr2=0x7f863c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 -- 172.21.15.46:0/3672734881 shutdown_connections 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.632+0000 7f863b59e700 1 -- 172.21.15.46:0/3672734881 wait complete. 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.633+0000 7f863b59e700 1 Processor -- start 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.633+0000 7f863b59e700 1 -- start start 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c06c0f0 0x7f863c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0cc3c0 0x7f863c0c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c167be0 con 0x7f863c1574d0 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c1678d0 con 0x7f863c06c0f0 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c15c810 con 0x7f863c0cc3c0 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45226/0 (socket says 172.21.15.46:45226) 2023-10-07T08:58:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 -- 172.21.15.46:0/3877721462 learned_addr learned my addr 172.21.15.46:0/3877721462 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f8639d9b700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0cc3c0 0x7f863c0c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863a59c700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c06c0f0 0x7f863c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 -- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0cc3c0 msgr2=0x7f863c0c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0cc3c0 0x7f863c0c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 -- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c06c0f0 msgr2=0x7f863c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c06c0f0 0x7f863c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.634+0000 7f863ad9d700 1 -- 172.21.15.46:0/3877721462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c009a20 con 0x7f863c1574d0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f863ad9d700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f862c009f60 tx=0x7f862c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00ccd0 con 0x7f863c1574d0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00f040 con 0x7f863c1574d0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634009480 con 0x7f863c1574d0 2023-10-07T08:58:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0146d0 con 0x7f863c1574d0 2023-10-07T08:58:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.635+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c15cdd0 con 0x7f863c1574d0 2023-10-07T08:58:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.636+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c167d50 con 0x7f863c1574d0 2023-10-07T08:58:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.636+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f862c003020 con 0x7f863c1574d0 2023-10-07T08:58:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.636+0000 7f86327fc700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.637+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f862c085040 con 0x7f863c1574d0 2023-10-07T08:58:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.637+0000 7f863a59c700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.637+0000 7f863a59c700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8634009260 tx=0x7f8634016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.641+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f862c052210 con 0x7f863c1574d0 2023-10-07T08:58:59.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.835+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f863c04c3c0 con 0x7f863c1574d0 2023-10-07T08:58:59.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.836+0000 7f86327fc700 1 -- 172.21.15.46:0/3877721462 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f862c059e60 con 0x7f863c1574d0 2023-10-07T08:58:59.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:58:59.837 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:58:59.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 msgr2=0x7f861c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8634009260 tx=0x7f8634016000 comp rx=0 tx=0).stop 2023-10-07T08:58:59.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 msgr2=0x7f863c0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f862c009f60 tx=0x7f862c00b040 comp rx=0 tx=0).stop 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 shutdown_connections 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c1574d0 0x7f863c0c4120 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c06c0f0 0x7f863c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 --2- 172.21.15.46:0/3877721462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0cc3c0 0x7f863c0c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 >> 172.21.15.46:0/3877721462 conn(0x7f863c0ce430 msgr2=0x7f863c155370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 shutdown_connections 2023-10-07T08:58:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.838+0000 7f863b59e700 1 -- 172.21.15.46:0/3877721462 wait complete. 2023-10-07T08:58:59.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:58:59.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:58:59.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.973+0000 7fbd87078700 1 Processor -- start 2023-10-07T08:58:59.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.973+0000 7fbd87078700 1 -- start start 2023-10-07T08:58:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd87078700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd8006bcd0 0x7fbd800caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd87078700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8006c0a0 0x7fbd8015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd87078700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8015d7e0 con 0x7fbd8015df50 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd87078700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8015dac0 con 0x7fbd8006bcd0 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd87078700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8015aa30 con 0x7fbd8006c0a0 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd84e14700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd8006bcd0 0x7fbd800caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd85615700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbd8015df50 0x7fbd800c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47650/0 (socket says 172.21.15.46:47650) 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd85615700 1 -- 172.21.15.46:0/1461628421 learned_addr learned my addr 172.21.15.46:0/1461628421 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1461628421 >> v2:172.21.15.46:3300/0 conn(0x7fbd8006bcd0 0x7fbd800caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35002/0 (socket says 172.21.15.46:35002) 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.974+0000 7fbd7ffff700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8006c0a0 0x7fbd8015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd84e14700 1 -- 172.21.15.46:0/1461628421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8006c0a0 msgr2=0x7fbd8015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8006c0a0 0x7fbd8015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd84e14700 1 -- 172.21.15.46:0/1461628421 >> v1:172.21.15.46:6789/0 conn(0x7fbd8015df50 legacy=0x7fbd800c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd84e14700 1 -- 172.21.15.46:0/1461628421 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8015ad10 con 0x7fbd8006bcd0 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800caa90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009e60 tx=0x7fbd78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9c8a6aca178334 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd7f7fe700 1 -- 172.21.15.46:0/1461628421 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800e070 con 0x7fbd8006bcd0 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd7f7fe700 1 -- 172.21.15.46:0/1461628421 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7800bb60 con 0x7fbd8006bcd0 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd7f7fe700 1 -- 172.21.15.46:0/1461628421 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78012430 con 0x7fbd8006bcd0 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 -- 172.21.15.46:0/1461628421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 msgr2=0x7fbd800caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800caa90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009e60 tx=0x7fbd78009780 comp rx=0 tx=0).stop 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 -- 172.21.15.46:0/1461628421 shutdown_connections 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800caa90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 --2- 172.21.15.46:0/1461628421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8006c0a0 0x7fbd8015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.975+0000 7fbd87078700 1 -- 172.21.15.46:0/1461628421 >> 172.21.15.46:0/1461628421 conn(0x7fbd800ce600 msgr2=0x7fbd800cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:58:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.976+0000 7fbd87078700 1 -- 172.21.15.46:0/1461628421 shutdown_connections 2023-10-07T08:58:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.976+0000 7fbd87078700 1 -- 172.21.15.46:0/1461628421 wait complete. 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 Processor -- start 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 -- start start 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd8006c0a0 0x7fbd800b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 0x7fbd8015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80155620 con 0x7fbd8006bcd0 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd800b1ca0 con 0x7fbd8006c0a0 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.977+0000 7fbd87078700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd800b1f80 con 0x7fbd8015df50 2023-10-07T08:58:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35016/0 (socket says 172.21.15.46:35016) 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 -- 172.21.15.46:0/1481517647 learned_addr learned my addr 172.21.15.46:0/1481517647 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd85615700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 0x7fbd8015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd7ffff700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd8006c0a0 0x7fbd800b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 -- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 msgr2=0x7fbd8015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 0x7fbd8015c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 -- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd8006c0a0 msgr2=0x7fbd800b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd8006c0a0 0x7fbd800b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 -- 172.21.15.46:0/1481517647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78009a20 con 0x7fbd8006bcd0 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd85615700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 0x7fbd8015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:58:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd84e14700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b6c0 tx=0x7fbd78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78012cd0 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78012e50 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd800b2260 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78026640 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.978+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd800b3700 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.979+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd800b3270 con 0x7fbd8006bcd0 2023-10-07T08:58:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.980+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd78026a30 con 0x7fbd8006bcd0 2023-10-07T08:58:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.980+0000 7fbd7cff9700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 0x7fbd6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:58:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.980+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd780862f0 con 0x7fbd8006bcd0 2023-10-07T08:58:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.980+0000 7fbd7ffff700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 0x7fbd6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:58:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.981+0000 7fbd7ffff700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 0x7fbd6c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd800b3240 tx=0x7fbd74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:58:59.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:58:59.984+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd780535a0 con 0x7fbd8006bcd0 2023-10-07T08:59:00.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.173+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd800b07b0 con 0x7fbd8006bcd0 2023-10-07T08:59:00.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.174+0000 7fbd7cff9700 1 -- 172.21.15.46:0/1481517647 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd78056b80 con 0x7fbd8006bcd0 2023-10-07T08:59:00.175 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 msgr2=0x7fbd6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 0x7fbd6c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd800b3240 tx=0x7fbd74008040 comp rx=0 tx=0).stop 2023-10-07T08:59:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 msgr2=0x7fbd800b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b6c0 tx=0x7fbd78019000 comp rx=0 tx=0).stop 2023-10-07T08:59:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 shutdown_connections 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbd6c066f30 0x7fbd6c0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbd8015df50 0x7fbd8015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8006bcd0 0x7fbd800b13a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 --2- 172.21.15.46:0/1481517647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd8006c0a0 0x7fbd800b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 >> 172.21.15.46:0/1481517647 conn(0x7fbd800ce600 msgr2=0x7fbd800c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 shutdown_connections 2023-10-07T08:59:00.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.176+0000 7fbd87078700 1 -- 172.21.15.46:0/1481517647 wait complete. 2023-10-07T08:59:00.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:00.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.309+0000 7ff7cc6c5700 1 Processor -- start 2023-10-07T08:59:00.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.309+0000 7ff7cc6c5700 1 -- start start 2023-10-07T08:59:00.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cc6c5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7c406bcd0 0x7ff7c4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cc6c5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7c40c9510 0x7ff7c4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cc6c5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c415c2a0 con 0x7ff7c406c0a0 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cc6c5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40c9900 con 0x7ff7c40c9510 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cc6c5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c415b690 con 0x7ff7c406bcd0 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7cac62700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7c40c9510 0x7ff7c4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7c9c60700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff7c406c0a0 0x7ff7c40c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47666/0 (socket says 172.21.15.46:47666) 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.310+0000 7ff7c9c60700 1 -- 172.21.15.46:0/882710722 learned_addr learned my addr 172.21.15.46:0/882710722 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7ca461700 1 --2- 172.21.15.46:0/882710722 >> v2:172.21.15.133:3300/0 conn(0x7ff7c406bcd0 0x7ff7c4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7cac62700 1 -- 172.21.15.46:0/882710722 >> v2:172.21.15.133:3300/0 conn(0x7ff7c406bcd0 msgr2=0x7ff7c4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7cac62700 1 --2- 172.21.15.46:0/882710722 >> v2:172.21.15.133:3300/0 conn(0x7ff7c406bcd0 0x7ff7c4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7cac62700 1 -- 172.21.15.46:0/882710722 >> v1:172.21.15.46:6789/0 conn(0x7ff7c406c0a0 legacy=0x7ff7c40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7cac62700 1 -- 172.21.15.46:0/882710722 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c415b970 con 0x7ff7c40c9510 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7c945f700 1 -- 172.21.15.46:0/882710722 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761638760 0 0) 0x7ff7c415c2a0 con 0x7ff7c406c0a0 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7cac62700 1 --2- 172.21.15.46:0/882710722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c40c9510 0x7ff7c4141330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cafd0 tx=0x7ff7b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb41352eff2c9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7c945f700 1 -- 172.21.15.46:0/882710722 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400b6b0 con 0x7ff7c40c9510 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7c945f700 1 -- 172.21.15.46:0/882710722 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400b810 con 0x7ff7c40c9510 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.311+0000 7ff7c945f700 1 -- 172.21.15.46:0/882710722 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400bbb0 con 0x7ff7c40c9510 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/882710722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c40c9510 msgr2=0x7ff7c4141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/882710722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c40c9510 0x7ff7c4141330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cafd0 tx=0x7ff7b40091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/882710722 shutdown_connections 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/882710722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c40c9510 0x7ff7c4141330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/882710722 >> v2:172.21.15.133:3300/0 conn(0x7ff7c406bcd0 0x7ff7c4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/882710722 >> 172.21.15.46:0/882710722 conn(0x7ff7c40ce600 msgr2=0x7ff7c40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/882710722 shutdown_connections 2023-10-07T08:59:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.312+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/882710722 wait complete. 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.313+0000 7ff7cc6c5700 1 Processor -- start 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.313+0000 7ff7cc6c5700 1 -- start start 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7c406c0a0 0x7ff7c416b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c40c9510 0x7ff7c4156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b1740 con 0x7ff7c406bcd0 2023-10-07T08:59:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b1440 con 0x7ff7c40c9510 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c416bb10 con 0x7ff7c406c0a0 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35044/0 (socket says 172.21.15.46:35044) 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 -- 172.21.15.46:0/1982870217 learned_addr learned my addr 172.21.15.46:0/1982870217 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7c9c60700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7c406c0a0 0x7ff7c416b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cac62700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c40c9510 0x7ff7c4156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 -- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7c406c0a0 msgr2=0x7ff7c416b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7c406c0a0 0x7ff7c416b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 -- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c40c9510 msgr2=0x7ff7c4156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c40c9510 0x7ff7c4156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 -- 172.21.15.46:0/1982870217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009420 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7ca461700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e190 tx=0x7ff7bc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00ee30 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc014420 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c416bdf0 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0147e0 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.314+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c416c0d0 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.315+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404c3c0 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.316+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7bc014b90 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.316+0000 7ff7c27fc700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 0x7ff7b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.316+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7bc084d90 con 0x7ff7c406bcd0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.316+0000 7ff7c9c60700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 0x7ff7b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.316+0000 7ff7c9c60700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 0x7ff7b00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cce30 tx=0x7ff7b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.320+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7bc052000 con 0x7ff7c406bcd0 2023-10-07T08:59:00.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.511+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7c40b41b0 con 0x7ff7c406bcd0 2023-10-07T08:59:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.512+0000 7ff7c27fc700 1 -- 172.21.15.46:0/1982870217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7bc009a60 con 0x7ff7c406bcd0 2023-10-07T08:59:00.513 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 msgr2=0x7ff7b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 0x7ff7b00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cce30 tx=0x7ff7b8009040 comp rx=0 tx=0).stop 2023-10-07T08:59:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 msgr2=0x7ff7c41571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e190 tx=0x7ff7bc009920 comp rx=0 tx=0).stop 2023-10-07T08:59:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 shutdown_connections 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff7b0066f30 0x7ff7b00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c40c9510 0x7ff7c4156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7c406bcd0 0x7ff7c41571d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 --2- 172.21.15.46:0/1982870217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7c406c0a0 0x7ff7c416b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 >> 172.21.15.46:0/1982870217 conn(0x7ff7c40ce600 msgr2=0x7ff7c40cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 shutdown_connections 2023-10-07T08:59:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.514+0000 7ff7cc6c5700 1 -- 172.21.15.46:0/1982870217 wait complete. 2023-10-07T08:59:00.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:00.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.648+0000 7f0e65fec700 1 Processor -- start 2023-10-07T08:59:00.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.648+0000 7f0e65fec700 1 -- start start 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e65fec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 0x7f0e600b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e65fec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e600b33b0 0x7f0e600b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e65fec700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600b2080 con 0x7f0e600b4e70 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e65fec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cfb00 con 0x7f0e600b33b0 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e65fec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b5c40 con 0x7f0e600b16d0 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e64fea700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0e600b4e70 0x7f0e600ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47674/0 (socket says 172.21.15.46:47674) 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.649+0000 7f0e64fea700 1 -- 172.21.15.46:0/851785310 learned_addr learned my addr 172.21.15.46:0/851785310 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/851785310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 0x7f0e600b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e657eb700 1 --2- 172.21.15.46:0/851785310 >> v2:172.21.15.133:3300/0 conn(0x7f0e600b33b0 0x7f0e600b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931399572 0 0) 0x7f0e600b2080 con 0x7f0e600b4e70 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c003570 con 0x7f0e600b4e70 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 -- 172.21.15.46:0/851785310 >> v2:172.21.15.133:3300/0 conn(0x7f0e600b33b0 msgr2=0x7f0e600b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/851785310 >> v2:172.21.15.133:3300/0 conn(0x7f0e600b33b0 0x7f0e600b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 -- 172.21.15.46:0/851785310 >> v1:172.21.15.46:6789/0 conn(0x7f0e600b4e70 legacy=0x7f0e600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4186070507 0 0) 0x7f0e4c003570 con 0x7f0e600b4e70 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 -- 172.21.15.46:0/851785310 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600b5f20 con 0x7f0e600b16d0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/851785310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 0x7f0e600b1b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e500098e0 tx=0x7f0e500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a9880ac5a16693 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e580017f0 con 0x7f0e600b16d0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50011420 con 0x7f0e600b16d0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.650+0000 7f0e5f7fe700 1 -- 172.21.15.46:0/851785310 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500117c0 con 0x7f0e600b16d0 2023-10-07T08:59:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 -- 172.21.15.46:0/851785310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 msgr2=0x7f0e600b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 --2- 172.21.15.46:0/851785310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 0x7f0e600b1b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e500098e0 tx=0x7f0e500091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 -- 172.21.15.46:0/851785310 shutdown_connections 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 --2- 172.21.15.46:0/851785310 >> v2:172.21.15.133:3300/0 conn(0x7f0e600b33b0 0x7f0e600b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 --2- 172.21.15.46:0/851785310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b16d0 0x7f0e600b1b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 -- 172.21.15.46:0/851785310 >> 172.21.15.46:0/851785310 conn(0x7f0e600d10c0 msgr2=0x7f0e600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 -- 172.21.15.46:0/851785310 shutdown_connections 2023-10-07T08:59:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.651+0000 7f0e65fec700 1 -- 172.21.15.46:0/851785310 wait complete. 2023-10-07T08:59:00.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.652+0000 7f0e65fec700 1 Processor -- start 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.652+0000 7f0e65fec700 1 -- start start 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e600b16d0 0x7f0e6016d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b4e70 0x7f0e600cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c78e0 con 0x7f0e600b33b0 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c6cd0 con 0x7f0e600b16d0 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e65fec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c6fb0 con 0x7f0e600b4e70 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35050/0 (socket says 172.21.15.46:35050) 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 -- 172.21.15.46:0/3968422951 learned_addr learned my addr 172.21.15.46:0/3968422951 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e64fea700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e600b16d0 0x7f0e6016d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e657eb700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b4e70 0x7f0e600cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 -- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b4e70 msgr2=0x7f0e600cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b4e70 0x7f0e600cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 -- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e600b16d0 msgr2=0x7f0e6016d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e600b16d0 0x7f0e6016d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.653+0000 7f0e5ffff700 1 -- 172.21.15.46:0/3968422951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009420 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e5ffff700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e500030c0 tx=0x7f0e50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50006b30 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600c7290 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5001cb30 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001a450 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.654+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6016d600 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.655+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60088990 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.655+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e5001a840 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.656+0000 7f0e5cff9700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.656+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e50085d60 con 0x7f0e600b33b0 2023-10-07T08:59:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.656+0000 7f0e64fea700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.656+0000 7f0e64fea700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 0x7f0e400693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e58001560 tx=0x7f0e58001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.660+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e50052fd0 con 0x7f0e600b33b0 2023-10-07T08:59:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.851+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e600cf6f0 con 0x7f0e600b33b0 2023-10-07T08:59:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.852+0000 7f0e5cff9700 1 -- 172.21.15.46:0/3968422951 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e50029020 con 0x7f0e600b33b0 2023-10-07T08:59:00.852 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 msgr2=0x7f0e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 0x7f0e400693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e58001560 tx=0x7f0e58001640 comp rx=0 tx=0).stop 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 msgr2=0x7f0e600caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e500030c0 tx=0x7f0e50016000 comp rx=0 tx=0).stop 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 shutdown_connections 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e600b4e70 0x7f0e600cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e600b16d0 0x7f0e6016d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 --2- 172.21.15.46:0/3968422951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e600b33b0 0x7f0e600caf10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.853+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 >> 172.21.15.46:0/3968422951 conn(0x7f0e600d10c0 msgr2=0x7f0e6015b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.854+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 shutdown_connections 2023-10-07T08:59:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.854+0000 7f0e65fec700 1 -- 172.21.15.46:0/3968422951 wait complete. 2023-10-07T08:59:00.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.985+0000 7f9bd13ba700 1 Processor -- start 2023-10-07T08:59:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.985+0000 7f9bd13ba700 1 -- start start 2023-10-07T08:59:00.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bd13ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bcc141500 0x7f9bcc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bd13ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bcc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bd13ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc15c2a0 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bd13ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc0c9880 con 0x7f9bcc141500 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bd13ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc15b690 con 0x7f9bcc06c0a0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bcaffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9bcc06bcd0 0x7f9bcc140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47688/0 (socket says 172.21.15.46:47688) 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bcaffd700 1 -- 172.21.15.46:0/2301720578 learned_addr learned my addr 172.21.15.46:0/2301720578 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896605223 0 0) 0x7f9bcc15c2a0 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bcb7fe700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bcc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb8003570 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.986+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> v2:172.21.15.133:3300/0 conn(0x7f9bcc141500 0x7f9bcc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4224046814 0 0) 0x7f9bb8003570 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 msgr2=0x7f9bcc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bcc0c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 >> v2:172.21.15.133:3300/0 conn(0x7f9bcc141500 msgr2=0x7f9bcc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 --2- 172.21.15.46:0/2301720578 >> v2:172.21.15.133:3300/0 conn(0x7f9bcc141500 0x7f9bcc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc15b970 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f9bc40017f0 con 0x7f9bcc06bcd0 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> v2:172.21.15.133:3300/0 conn(0x7f9bcc141500 0x7f9bcc0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 >> v1:172.21.15.46:6789/0 conn(0x7f9bcc06bcd0 legacy=0x7f9bcc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8003a60 0x7f9bb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0c9880 con 0x7f9bb8004810 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc15b690 con 0x7f9bb8003a60 2023-10-07T08:59:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb800bae0 con 0x7f9bcc06c0a0 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bcb7fe700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bcaffd700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8003a60 0x7f9bb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 -- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 msgr2=0x7f9bb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc06c0a0 0x7f9bb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 -- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8003a60 msgr2=0x7f9bb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8003a60 0x7f9bb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 -- 172.21.15.46:0/2301720578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8003570 con 0x7f9bb8004810 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.987+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bb8004c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009ba0 tx=0x7f9bb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b67c01aa34bc6fb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400c070 con 0x7f9bb8004810 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400e5e0 con 0x7f9bb8004810 2023-10-07T08:59:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bc9ffb700 1 -- 172.21.15.46:0/2301720578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4009510 con 0x7f9bb8004810 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 -- 172.21.15.46:0/2301720578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 msgr2=0x7f9bb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/2301720578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bb8004c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009ba0 tx=0x7f9bb4008040 comp rx=0 tx=0).stop 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bcb7fe700 1 -- 172.21.15.46:0/2301720578 reap_dead start 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 -- 172.21.15.46:0/2301720578 shutdown_connections 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 -- 172.21.15.46:0/2301720578 >> 172.21.15.46:0/2301720578 conn(0x7f9bcc0ce600 msgr2=0x7f9bcc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 -- 172.21.15.46:0/2301720578 shutdown_connections 2023-10-07T08:59:00.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.988+0000 7f9bd13ba700 1 -- 172.21.15.46:0/2301720578 wait complete. 2023-10-07T08:59:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.989+0000 7f9bd13ba700 1 Processor -- start 2023-10-07T08:59:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.989+0000 7f9bd13ba700 1 -- start start 2023-10-07T08:59:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc15aca0 0x7f9bcc13d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bcc159660 0x7f9bcc16b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc140830 con 0x7f9bb8004810 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc159c20 con 0x7f9bcc159660 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bd13ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc159f00 con 0x7f9bcc15aca0 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bcaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bcaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35060/0 (socket says 172.21.15.46:35060) 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bcaffd700 1 -- 172.21.15.46:0/4094028769 learned_addr learned my addr 172.21.15.46:0/4094028769 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc15aca0 0x7f9bcc13d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.990+0000 7f9bcb7fe700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bcc159660 0x7f9bcc16b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 -- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc15aca0 msgr2=0x7f9bcc13d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc15aca0 0x7f9bcc13d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 -- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bcc159660 msgr2=0x7f9bcc16b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bcc159660 0x7f9bcc16b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 -- 172.21.15.46:0/4094028769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc15a1e0 con 0x7f9bb8004810 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bcaffd700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40019a0 tx=0x7f9bc4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400ad30 con 0x7f9bb8004810 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400ae90 con 0x7f9bb8004810 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc15a4c0 con 0x7f9bb8004810 2023-10-07T08:59:00.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4013640 con 0x7f9bb8004810 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.991+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc13d8b0 con 0x7f9bb8004810 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.992+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc13dad0 con 0x7f9bb8004810 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.992+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bc4013a30 con 0x7f9bb8004810 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.993+0000 7f9bc2ffd700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 0x7f9bac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.993+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bc4085240 con 0x7f9bb8004810 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.993+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 0x7f9bac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:00.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.993+0000 7f9bca7fc700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 0x7f9bac0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009ba0 tx=0x7f9bb401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:00.997+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bc40524b0 con 0x7f9bb8004810 2023-10-07T08:59:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.190+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bcc04c3c0 con 0x7f9bb8004810 2023-10-07T08:59:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.191+0000 7f9bc2ffd700 1 -- 172.21.15.46:0/4094028769 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9bc4055ad0 con 0x7f9bb8004810 2023-10-07T08:59:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:01.192 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 msgr2=0x7f9bac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 0x7f9bac0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009ba0 tx=0x7f9bb401a000 comp rx=0 tx=0).stop 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 msgr2=0x7f9bcc1402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40019a0 tx=0x7f9bc4002210 comp rx=0 tx=0).stop 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 shutdown_connections 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9bac066f30 0x7f9bac0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bcc159660 0x7f9bcc16b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb8004810 0x7f9bcc1402f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 --2- 172.21.15.46:0/4094028769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bcc15aca0 0x7f9bcc13d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 >> 172.21.15.46:0/4094028769 conn(0x7f9bcc0ce600 msgr2=0x7f9bcc0cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 shutdown_connections 2023-10-07T08:59:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.193+0000 7f9bd13ba700 1 -- 172.21.15.46:0/4094028769 wait complete. 2023-10-07T08:59:01.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:59:01.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.328+0000 7f704d4c4700 1 Processor -- start 2023-10-07T08:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.328+0000 7f704d4c4700 1 -- start start 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 0x7f7048069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704815a160 con 0x7f7048159890 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70480d13a0 con 0x7f704815db10 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f704d4c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704815e140 con 0x7f7048159c60 2023-10-07T08:59:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f7046ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f7046ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35064/0 (socket says 172.21.15.46:35064) 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.329+0000 7f7046ffd700 1 -- 172.21.15.46:0/2304804098 learned_addr learned my addr 172.21.15.46:0/2304804098 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f70467fc700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f70477fe700 1 --2- 172.21.15.46:0/2304804098 >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 0x7f7048069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 -- 172.21.15.46:0/2304804098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 msgr2=0x7f704815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 -- 172.21.15.46:0/2304804098 >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 msgr2=0x7f7048069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 --2- 172.21.15.46:0/2304804098 >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 0x7f7048069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 -- 172.21.15.46:0/2304804098 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704815a3d0 con 0x7f7048159890 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f70477fe700 1 --2- 172.21.15.46:0/2304804098 >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 0x7f7048069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7046ffd700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7048089b50 tx=0x7f7040009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60be5dd0e10a7b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7045ffb700 1 -- 172.21.15.46:0/2304804098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000e070 con 0x7f7048159890 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7045ffb700 1 -- 172.21.15.46:0/2304804098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000ba50 con 0x7f7048159890 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.330+0000 7f7045ffb700 1 -- 172.21.15.46:0/2304804098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400092e0 con 0x7f7048159890 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 -- 172.21.15.46:0/2304804098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 msgr2=0x7f704815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7048089b50 tx=0x7f7040009840 comp rx=0 tx=0).stop 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 -- 172.21.15.46:0/2304804098 shutdown_connections 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 --2- 172.21.15.46:0/2304804098 >> v2:172.21.15.133:3300/0 conn(0x7f704815db10 0x7f7048069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 --2- 172.21.15.46:0/2304804098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 -- 172.21.15.46:0/2304804098 >> 172.21.15.46:0/2304804098 conn(0x7f7048068e20 msgr2=0x7f70480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:01.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 -- 172.21.15.46:0/2304804098 shutdown_connections 2023-10-07T08:59:01.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.331+0000 7f704d4c4700 1 -- 172.21.15.46:0/2304804098 wait complete. 2023-10-07T08:59:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.332+0000 7f704d4c4700 1 Processor -- start 2023-10-07T08:59:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.332+0000 7f704d4c4700 1 -- start start 2023-10-07T08:59:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 0x7f7048151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704814caf0 con 0x7f7048159890 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704814b2c0 con 0x7f704815db10 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704814c120 con 0x7f7048159c60 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35066/0 (socket says 172.21.15.46:35066) 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 -- 172.21.15.46:0/3155522838 learned_addr learned my addr 172.21.15.46:0/3155522838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f70477fe700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 0x7f7048151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f70467fc700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 -- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 msgr2=0x7f70480cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 -- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 msgr2=0x7f7048151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 0x7f7048151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 -- 172.21.15.46:0/3155522838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009ae0 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f70467fc700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f70477fe700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 0x7f7048151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f7046ffd700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7040009fd0 tx=0x7f7040018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040008b70 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040008cd0 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704814b510 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400266b0 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.333+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704814bad0 con 0x7f7048159890 2023-10-07T08:59:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.334+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704814c400 con 0x7f7048159890 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.335+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7040003040 con 0x7f7048159890 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.335+0000 7f703effd700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.335+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7040086130 con 0x7f7048159890 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.335+0000 7f70467fc700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.336+0000 7f70467fc700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 0x7f70280693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70480b0c90 tx=0x7f7030008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.339+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7040053450 con 0x7f7048159890 2023-10-07T08:59:01.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.533+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f704804c3c0 con 0x7f7048159890 2023-10-07T08:59:01.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.533+0000 7f703effd700 1 -- 172.21.15.46:0/3155522838 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7040056a70 con 0x7f7048159890 2023-10-07T08:59:01.534 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 msgr2=0x7f70280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 0x7f70280693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70480b0c90 tx=0x7f7030008040 comp rx=0 tx=0).stop 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 msgr2=0x7f704814c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7040009fd0 tx=0x7f7040018000 comp rx=0 tx=0).stop 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 shutdown_connections 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f704815db10 0x7f7048151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704814c5b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 --2- 172.21.15.46:0/3155522838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 >> 172.21.15.46:0/3155522838 conn(0x7f7048068e20 msgr2=0x7f704814d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:01.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 shutdown_connections 2023-10-07T08:59:01.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.535+0000 7f704d4c4700 1 -- 172.21.15.46:0/3155522838 wait complete. 2023-10-07T08:59:01.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.669+0000 7fc2281f1700 1 Processor -- start 2023-10-07T08:59:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.669+0000 7fc2281f1700 1 -- start start 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc2281f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc2281f1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22015d7e0 con 0x7fc22006bcd0 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc2281f1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22015dac0 con 0x7fc22006c0a0 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc2281f1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200caf30 con 0x7fc2200caa90 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc225f8d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc22006bcd0 0x7fc22015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47700/0 (socket says 172.21.15.46:47700) 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.670+0000 7fc225f8d700 1 -- 172.21.15.46:0/3078620627 learned_addr learned my addr 172.21.15.46:0/3078620627 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:01.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc22678e700 1 --2- 172.21.15.46:0/3078620627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977866611 0 0) 0x7fc22015d7e0 con 0x7fc22006bcd0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc208003570 con 0x7fc22006bcd0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767423219 0 0) 0x7fc22015dac0 con 0x7fc22006c0a0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22015d7e0 con 0x7fc22006c0a0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356780593 0 0) 0x7fc208003570 con 0x7fc22006bcd0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc22678e700 1 -- 172.21.15.46:0/3078620627 >> v1:172.21.15.133:6789/0 conn(0x7fc22006c0a0 legacy=0x7fc22015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc22678e700 1 -- 172.21.15.46:0/3078620627 >> v1:172.21.15.46:6789/0 conn(0x7fc22006bcd0 legacy=0x7fc22015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc22678e700 1 -- 172.21.15.46:0/3078620627 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22015aa30 con 0x7fc2200caa90 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc22678e700 1 --2- 172.21.15.46:0/3078620627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200c8c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e90 tx=0x7fc210009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561dd80b2a2fb4c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000e070 con 0x7fc2200caa90 2023-10-07T08:59:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000b870 con 0x7fc2200caa90 2023-10-07T08:59:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.671+0000 7fc224f8b700 1 -- 172.21.15.46:0/3078620627 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218001470 con 0x7fc2200caa90 2023-10-07T08:59:01.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 -- 172.21.15.46:0/3078620627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 msgr2=0x7fc2200c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 --2- 172.21.15.46:0/3078620627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200c8c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e90 tx=0x7fc210009780 comp rx=0 tx=0).stop 2023-10-07T08:59:01.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 -- 172.21.15.46:0/3078620627 shutdown_connections 2023-10-07T08:59:01.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 --2- 172.21.15.46:0/3078620627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200c8c40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 -- 172.21.15.46:0/3078620627 >> 172.21.15.46:0/3078620627 conn(0x7fc2200ce600 msgr2=0x7fc2200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 -- 172.21.15.46:0/3078620627 shutdown_connections 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.672+0000 7fc2281f1700 1 -- 172.21.15.46:0/3078620627 wait complete. 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.673+0000 7fc2281f1700 1 Processor -- start 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.673+0000 7fc2281f1700 1 -- start start 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 0x7fc2200b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200b2fc0 con 0x7fc22006bcd0 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200b2720 con 0x7fc22006c0a0 2023-10-07T08:59:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc2281f1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200b2a00 con 0x7fc2200caa90 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35074/0 (socket says 172.21.15.46:35074) 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 -- 172.21.15.46:0/341960772 learned_addr learned my addr 172.21.15.46:0/341960772 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc22678e700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc22578c700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 0x7fc2200b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 -- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 msgr2=0x7fc2200b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 -- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 msgr2=0x7fc2200b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 0x7fc2200b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 -- 172.21.15.46:0/341960772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009a20 con 0x7fc22006bcd0 2023-10-07T08:59:01.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc22578c700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 0x7fc2200b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc225f8d700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc21800cb70 tx=0x7fc218001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.674+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218001d20 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.675+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218007360 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.675+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200b2ce0 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.675+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218004830 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.675+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc220153830 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.676+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220157e00 con 0x7fc22006bcd0 2023-10-07T08:59:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.676+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc218004be0 con 0x7fc22006bcd0 2023-10-07T08:59:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.676+0000 7fc21dffb700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.676+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc218083bd0 con 0x7fc22006bcd0 2023-10-07T08:59:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.676+0000 7fc22578c700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.677+0000 7fc22578c700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 0x7fc20c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2200b32d0 tx=0x7fc214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:01.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.680+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc220157e00 con 0x7fc22006bcd0 2023-10-07T08:59:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.871+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc220157e00 con 0x7fc22006bcd0 2023-10-07T08:59:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.872+0000 7fc21dffb700 1 -- 172.21.15.46:0/341960772 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc218018020 con 0x7fc22006bcd0 2023-10-07T08:59:01.872 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 msgr2=0x7fc20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 0x7fc20c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2200b32d0 tx=0x7fc214009040 comp rx=0 tx=0).stop 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 msgr2=0x7fc2201532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc21800cb70 tx=0x7fc218001ab0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 shutdown_connections 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2200caa90 0x7fc2200b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc22006bcd0 0x7fc2201532f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 --2- 172.21.15.46:0/341960772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22006c0a0 0x7fc2200b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:01.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 >> 172.21.15.46:0/341960772 conn(0x7fc2200ce600 msgr2=0x7fc22006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:01.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 shutdown_connections 2023-10-07T08:59:01.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:01.874+0000 7fc2281f1700 1 -- 172.21.15.46:0/341960772 wait complete. 2023-10-07T08:59:01.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.008+0000 7f3da8ba0700 1 Processor -- start 2023-10-07T08:59:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.008+0000 7f3da8ba0700 1 -- start start 2023-10-07T08:59:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da8ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da8ba0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3da415db10 0x7f3da4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da8ba0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da415a160 con 0x7f3da4159890 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da8ba0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40d13a0 con 0x7f3da415db10 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da8ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415e140 con 0x7f3da4159c60 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3da415db10 0x7f3da4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3da4159890 0x7f3da415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47714/0 (socket says 172.21.15.46:47714) 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.009+0000 7f3da259c700 1 -- 172.21.15.46:0/2398039141 learned_addr learned my addr 172.21.15.46:0/2398039141 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da1d9b700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da2d9d700 1 -- 172.21.15.46:0/2398039141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 msgr2=0x7f3da415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da2d9d700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da2d9d700 1 -- 172.21.15.46:0/2398039141 >> v1:172.21.15.46:6789/0 conn(0x7f3da4159890 legacy=0x7f3da415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da159a700 1 -- 172.21.15.46:0/2398039141 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404625597 0 0) 0x7f3da415a160 con 0x7f3da4159890 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da2d9d700 1 -- 172.21.15.46:0/2398039141 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da415a3d0 con 0x7f3da415db10 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da2d9d700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4069560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009e60 tx=0x7f3d94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcebdae04d31fbf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da159a700 1 -- 172.21.15.46:0/2398039141 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400e070 con 0x7f3da415db10 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da159a700 1 -- 172.21.15.46:0/2398039141 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400bc30 con 0x7f3da415db10 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da159a700 1 -- 172.21.15.46:0/2398039141 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94012430 con 0x7f3da415db10 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da8ba0700 1 -- 172.21.15.46:0/2398039141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 msgr2=0x7f3da4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.010+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4069560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009e60 tx=0x7f3d94009780 comp rx=0 tx=0).stop 2023-10-07T08:59:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 -- 172.21.15.46:0/2398039141 shutdown_connections 2023-10-07T08:59:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4069560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/2398039141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 -- 172.21.15.46:0/2398039141 >> 172.21.15.46:0/2398039141 conn(0x7f3da4068e20 msgr2=0x7f3da40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 -- 172.21.15.46:0/2398039141 shutdown_connections 2023-10-07T08:59:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.011+0000 7f3da8ba0700 1 -- 172.21.15.46:0/2398039141 wait complete. 2023-10-07T08:59:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 Processor -- start 2023-10-07T08:59:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 -- start start 2023-10-07T08:59:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159890 0x7f3da415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da4160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4160fd0 con 0x7f3da415db10 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415d2a0 con 0x7f3da4159890 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.012+0000 7f3da8ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415c690 con 0x7f3da4159c60 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35092/0 (socket says 172.21.15.46:35092) 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 -- 172.21.15.46:0/1559821896 learned_addr learned my addr 172.21.15.46:0/1559821896 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da259c700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159890 0x7f3da415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 -- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 msgr2=0x7f3da4160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da4160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 -- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159890 msgr2=0x7f3da415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159890 0x7f3da415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 -- 172.21.15.46:0/1559821896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009a20 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da2d9d700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d94013000 tx=0x7f3d94019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9401d630 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9401d790 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da415c970 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9401db30 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.013+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da415cf30 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.014+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da415d450 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.015+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d94024070 con 0x7f3da415db10 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.015+0000 7f3d9a7fc700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.015+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d94086d70 con 0x7f3da415db10 2023-10-07T08:59:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.015+0000 7f3da259c700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.016+0000 7f3da259c700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 0x7f3d840693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c007fd0 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.019+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3da415d450 con 0x7f3da415db10 2023-10-07T08:59:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.211+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3da415d410 con 0x7f3da415db10 2023-10-07T08:59:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.211+0000 7f3d9a7fc700 1 -- 172.21.15.46:0/1559821896 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d9402c020 con 0x7f3da415db10 2023-10-07T08:59:02.212 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 msgr2=0x7f3d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 0x7f3d840693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c007fd0 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 msgr2=0x7f3da4160a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d94013000 tx=0x7f3d94019000 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 shutdown_connections 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da415db10 0x7f3da4160a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159890 0x7f3da415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 --2- 172.21.15.46:0/1559821896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159c60 0x7f3da4160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 >> 172.21.15.46:0/1559821896 conn(0x7f3da4068e20 msgr2=0x7f3da4153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 shutdown_connections 2023-10-07T08:59:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.214+0000 7f3da8ba0700 1 -- 172.21.15.46:0/1559821896 wait complete. 2023-10-07T08:59:02.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:02.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.346+0000 7f5fc55c7700 1 Processor -- start 2023-10-07T08:59:02.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.346+0000 7f5fc55c7700 1 -- start start 2023-10-07T08:59:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc55c7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fc0140cd0 0x7f5fc006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc55c7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00b1500 con 0x7f5fc00cd420 2023-10-07T08:59:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc55c7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00cda20 con 0x7f5fc01410a0 2023-10-07T08:59:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc55c7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00cdd00 con 0x7f5fc0140cd0 2023-10-07T08:59:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc4dc6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5fc00cd420 0x7f5fc00b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47716/0 (socket says 172.21.15.46:47716) 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/2708146481 learned_addr learned my addr 172.21.15.46:0/2708146481 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fbffff700 1 --2- 172.21.15.46:0/2708146481 >> v2:172.21.15.133:3300/0 conn(0x7f5fc0140cd0 0x7f5fc006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869098408 0 0) 0x7f5fc00b1500 con 0x7f5fc00cd420 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.347+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa8003570 con 0x7f5fc00cd420 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373371350 0 0) 0x7f5fa8003570 con 0x7f5fc00cd420 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 >> v2:172.21.15.133:3300/0 conn(0x7f5fc0140cd0 msgr2=0x7f5fc006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 --2- 172.21.15.46:0/2708146481 >> v2:172.21.15.133:3300/0 conn(0x7f5fc0140cd0 0x7f5fc006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 >> v1:172.21.15.133:6789/0 conn(0x7f5fc01410a0 legacy=0x7f5fc00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00cdfe0 con 0x7f5fc00cd420 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5fb80017f0 con 0x7f5fc00cd420 2023-10-07T08:59:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 >> v1:172.21.15.46:6789/0 conn(0x7f5fc00cd420 legacy=0x7f5fc00b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 0x7f5fa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8004810 0x7f5fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fa80051c0 0x7f5fa800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00cdd00 con 0x7f5fa8003a60 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa800c160 con 0x7f5fa80051c0 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa800c320 con 0x7f5fa8004810 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 0x7f5fa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbf7fe700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8004810 0x7f5fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fc4dc6700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fa80051c0 0x7f5fa800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 -- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8004810 msgr2=0x7f5fa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8004810 0x7f5fa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 -- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fa80051c0 msgr2=0x7f5fa800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fa80051c0 0x7f5fa800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 -- 172.21.15.46:0/2708146481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8003570 con 0x7f5fa8003a60 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fc4dc6700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fa80051c0 0x7f5fa800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/2708146481 reap_dead start 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbffff700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 0x7f5fa8003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009c00 tx=0x7f5fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc989d4f1cc9813 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000e710 con 0x7f5fa8003a60 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb000e870 con 0x7f5fa8003a60 2023-10-07T08:59:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.348+0000 7f5fbeffd700 1 -- 172.21.15.46:0/2708146481 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000ec30 con 0x7f5fa8003a60 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 -- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 msgr2=0x7f5fa8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 0x7f5fa8003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009c00 tx=0x7f5fb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 -- 172.21.15.46:0/2708146481 shutdown_connections 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/2708146481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fa8003a60 0x7f5fa8003e70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 -- 172.21.15.46:0/2708146481 >> 172.21.15.46:0/2708146481 conn(0x7f5fc00ce430 msgr2=0x7f5fc00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 -- 172.21.15.46:0/2708146481 shutdown_connections 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.349+0000 7f5fc55c7700 1 -- 172.21.15.46:0/2708146481 wait complete. 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.350+0000 7f5fc55c7700 1 Processor -- start 2023-10-07T08:59:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.350+0000 7f5fc55c7700 1 -- start start 2023-10-07T08:59:02.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8003a60 0x7f5fc01674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc0157190 0x7f5fc015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc013ccf0 con 0x7f5fc013c340 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0158320 con 0x7f5fc0157190 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc55c7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0157600 con 0x7f5fa8003a60 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc4dc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc4dc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35098/0 (socket says 172.21.15.46:35098) 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/81847420 learned_addr learned my addr 172.21.15.46:0/81847420 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fbffff700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8003a60 0x7f5fc01674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.351+0000 7f5fbf7fe700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc0157190 0x7f5fc015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8003a60 msgr2=0x7f5fc01674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8003a60 0x7f5fc01674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc0157190 msgr2=0x7f5fc015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc0157190 0x7f5fc015b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 -- 172.21.15.46:0/81847420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0167b70 con 0x7f5fc013c340 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc4dc6700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8001350 tx=0x7f5fb80017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800eb60 con 0x7f5fc013c340 2023-10-07T08:59:02.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800ecc0 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc0167e50 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8013420 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.352+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc0168410 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.353+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc01584d0 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.353+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fb80137b0 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.354+0000 7f5fa7fff700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 0x7f5fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.354+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fb8084a20 con 0x7f5fc013c340 2023-10-07T08:59:02.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.354+0000 7f5fbffff700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 0x7f5fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.355+0000 7f5fbffff700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 0x7f5fac0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00091e0 tx=0x7f5fb001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.358+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc01584d0 con 0x7f5fc013c340 2023-10-07T08:59:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.552+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc0158490 con 0x7f5fc013c340 2023-10-07T08:59:02.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.553+0000 7f5fa7fff700 1 -- 172.21.15.46:0/81847420 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5fb8051d50 con 0x7f5fc013c340 2023-10-07T08:59:02.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:02.553 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:02.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.554+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 msgr2=0x7f5fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.554+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 0x7f5fac0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00091e0 tx=0x7f5fb001a000 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.554+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 msgr2=0x7f5fc013c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.554+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8001350 tx=0x7f5fb80017f0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 shutdown_connections 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fac066f30 0x7f5fac0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fc013c340 0x7f5fc013c7b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fa8003a60 0x7f5fc01674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 --2- 172.21.15.46:0/81847420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc0157190 0x7f5fc015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 >> 172.21.15.46:0/81847420 conn(0x7f5fc00ce430 msgr2=0x7f5fc013d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 shutdown_connections 2023-10-07T08:59:02.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.555+0000 7f5fc55c7700 1 -- 172.21.15.46:0/81847420 wait complete. 2023-10-07T08:59:02.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:59:02.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.688+0000 7f901a854700 1 Processor -- start 2023-10-07T08:59:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 -- start start 2023-10-07T08:59:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 0x7f901415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 0x7f901415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901415a160 con 0x7f901415db10 2023-10-07T08:59:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90140d13a0 con 0x7f9014159c60 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.689+0000 7f901a854700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901415e140 con 0x7f9014159890 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 0x7f901415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f90137fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 0x7f901415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9018df1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f901415db10 0x7f9014069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43652/0 (socket says 172.21.15.46:43652) 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9018df1700 1 -- 172.21.15.46:0/37200669 learned_addr learned my addr 172.21.15.46:0/37200669 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9012ffd700 1 -- 172.21.15.46:0/37200669 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853143696 0 0) 0x7f901415a160 con 0x7f901415db10 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9012ffd700 1 -- 172.21.15.46:0/37200669 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9000003570 con 0x7f901415db10 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 -- 172.21.15.46:0/37200669 >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 msgr2=0x7f901415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 --2- 172.21.15.46:0/37200669 >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 0x7f901415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 -- 172.21.15.46:0/37200669 >> v1:172.21.15.133:6789/0 conn(0x7f901415db10 legacy=0x7f9014069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 -- 172.21.15.46:0/37200669 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901415a3d0 con 0x7f9014159890 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f90137fe700 1 --2- 172.21.15.46:0/37200669 >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 0x7f901415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.690+0000 7f9013fff700 1 --2- 172.21.15.46:0/37200669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 0x7f901415abd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90040098e0 tx=0x7f90040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4342aefa910b3f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f9012ffd700 1 -- 172.21.15.46:0/37200669 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004011630 con 0x7f9014159890 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f9012ffd700 1 -- 172.21.15.46:0/37200669 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9004011790 con 0x7f9014159890 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f9012ffd700 1 -- 172.21.15.46:0/37200669 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004011b10 con 0x7f9014159890 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 -- 172.21.15.46:0/37200669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 msgr2=0x7f901415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 --2- 172.21.15.46:0/37200669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 0x7f901415abd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90040098e0 tx=0x7f90040091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 -- 172.21.15.46:0/37200669 shutdown_connections 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 --2- 172.21.15.46:0/37200669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159890 0x7f901415abd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 --2- 172.21.15.46:0/37200669 >> v2:172.21.15.133:3300/0 conn(0x7f9014159c60 0x7f901415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 -- 172.21.15.46:0/37200669 >> 172.21.15.46:0/37200669 conn(0x7f9014068e20 msgr2=0x7f90140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 -- 172.21.15.46:0/37200669 shutdown_connections 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.691+0000 7f901a854700 1 -- 172.21.15.46:0/37200669 wait complete. 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.692+0000 7f901a854700 1 Processor -- start 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.692+0000 7f901a854700 1 -- start start 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159c60 0x7f90140cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f901415db10 0x7f90140cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140cd410 con 0x7f9014159890 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901414bdd0 con 0x7f901415db10 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f901a854700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9014151390 con 0x7f9014159c60 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f9013fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f9013fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35108/0 (socket says 172.21.15.46:35108) 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f9013fff700 1 -- 172.21.15.46:0/3127619026 learned_addr learned my addr 172.21.15.46:0/3127619026 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f90137fe700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159c60 0x7f90140cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.693+0000 7f9018df1700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f901415db10 0x7f90140cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 -- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159c60 msgr2=0x7f90140cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159c60 0x7f90140cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 -- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f901415db10 msgr2=0x7f90140cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f901415db10 0x7f90140cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 -- 172.21.15.46:0/3127619026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009420 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f9013fff700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9014070e20 tx=0x7f9004017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004011900 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9004011a60 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9004009420 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900401a680 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.694+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9014151670 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.695+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901404c3c0 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.695+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f900401aa70 con 0x7f9014159890 2023-10-07T08:59:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.696+0000 7f900bfff700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 0x7f8ff4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.696+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9004086010 con 0x7f9014159890 2023-10-07T08:59:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.696+0000 7f90137fe700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 0x7f8ff4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.696+0000 7f90137fe700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 0x7f8ff4069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f901416d060 tx=0x7f8ffc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.700+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9004053280 con 0x7f9014159890 2023-10-07T08:59:02.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.896+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f901406a5b0 con 0x7f9014159890 2023-10-07T08:59:02.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.897+0000 7f900bfff700 1 -- 172.21.15.46:0/3127619026 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90040568a0 con 0x7f9014159890 2023-10-07T08:59:02.898 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 msgr2=0x7f8ff4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 0x7f8ff4069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f901416d060 tx=0x7f8ffc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 msgr2=0x7f901414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9014070e20 tx=0x7f9004017000 comp rx=0 tx=0).stop 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 shutdown_connections 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8ff4066f60 0x7f8ff4069410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f901415db10 0x7f90140cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9014159890 0x7f901414b890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 --2- 172.21.15.46:0/3127619026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014159c60 0x7f90140cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 >> 172.21.15.46:0/3127619026 conn(0x7f9014068e20 msgr2=0x7f90140b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 shutdown_connections 2023-10-07T08:59:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:02.899+0000 7f901a854700 1 -- 172.21.15.46:0/3127619026 wait complete. 2023-10-07T08:59:02.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.032+0000 7f275ade9700 1 Processor -- start 2023-10-07T08:59:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.032+0000 7f275ade9700 1 -- start start 2023-10-07T08:59:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f275ade9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27540caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f275ade9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f275406c0a0 0x7f275415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f275ade9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275415d7e0 con 0x7f275415df50 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f275ade9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275415dac0 con 0x7f275406c0a0 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f275ade9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275415aa30 con 0x7f275406bcd0 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f2759386700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f275415df50 0x7f27540c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47724/0 (socket says 172.21.15.46:47724) 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.033+0000 7f2759386700 1 -- 172.21.15.46:0/776549545 learned_addr learned my addr 172.21.15.46:0/776549545 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27540caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2753fff700 1 --2- 172.21.15.46:0/776549545 >> v2:172.21.15.133:3300/0 conn(0x7f275406c0a0 0x7f275415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630926998 0 0) 0x7f275415d7e0 con 0x7f275415df50 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003570 con 0x7f275415df50 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 440655029 0 0) 0x7f2740003570 con 0x7f275415df50 2023-10-07T08:59:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 msgr2=0x7f27540caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27540caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 >> v2:172.21.15.133:3300/0 conn(0x7f275406c0a0 msgr2=0x7f275415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 --2- 172.21.15.46:0/776549545 >> v2:172.21.15.133:3300/0 conn(0x7f275406c0a0 0x7f275415a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275415ad10 con 0x7f275415df50 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f273c001470 con 0x7f275415df50 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 >> v1:172.21.15.46:6789/0 conn(0x7f275415df50 legacy=0x7f27540c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2740003a60 0x7f2740003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2740004810 0x7f2740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275415dac0 con 0x7f2740003a60 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275415aa30 con 0x7f2740004810 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274000bae0 con 0x7f275406bcd0 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2740003a60 0x7f2740003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2753fff700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2740004810 0x7f2740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2759386700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 -- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 msgr2=0x7f27400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 -- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2740004810 msgr2=0x7f2740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2740004810 0x7f2740004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2758b85700 1 -- 172.21.15.46:0/776549545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740003570 con 0x7f2740003a60 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.034+0000 7f2759386700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f275406bcd0 0x7f27400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f2758b85700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2740003a60 0x7f2740003e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f274c009c00 tx=0x7f274c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d215376395e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00e710 con 0x7f2740003a60 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c00e870 con 0x7f2740003a60 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f27537fe700 1 -- 172.21.15.46:0/776549545 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00ec30 con 0x7f2740003a60 2023-10-07T08:59:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 -- 172.21.15.46:0/776549545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2740003a60 msgr2=0x7f2740003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 --2- 172.21.15.46:0/776549545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2740003a60 0x7f2740003e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f274c009c00 tx=0x7f274c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f2759386700 1 -- 172.21.15.46:0/776549545 reap_dead start 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 -- 172.21.15.46:0/776549545 shutdown_connections 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 -- 172.21.15.46:0/776549545 >> 172.21.15.46:0/776549545 conn(0x7f27540ce600 msgr2=0x7f27540cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 -- 172.21.15.46:0/776549545 shutdown_connections 2023-10-07T08:59:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.035+0000 7f275ade9700 1 -- 172.21.15.46:0/776549545 wait complete. 2023-10-07T08:59:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.036+0000 7f275ade9700 1 Processor -- start 2023-10-07T08:59:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 -- start start 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2740003a60 0x7f2754154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27540b3610 0x7f27540c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540b17a0 con 0x7f27540c68a0 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540b3b90 con 0x7f27540b3610 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f275ade9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540b3e70 con 0x7f2740003a60 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f2753fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f2753fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35124/0 (socket says 172.21.15.46:35124) 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.037+0000 7f2753fff700 1 -- 172.21.15.46:0/1021460502 learned_addr learned my addr 172.21.15.46:0/1021460502 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2758b85700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2740003a60 0x7f2754154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2759386700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27540b3610 0x7f27540c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 -- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2740003a60 msgr2=0x7f2754154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2740003a60 0x7f2754154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 -- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27540b3610 msgr2=0x7f27540c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27540b3610 0x7f27540c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 -- 172.21.15.46:0/1021460502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540b4150 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2753fff700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2744011f80 tx=0x7f274400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274400e040 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274400f040 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27540b1430 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744015430 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.038+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27540c6d10 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.039+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275404c3c0 con 0x7f27540c68a0 2023-10-07T08:59:03.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.039+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2744015820 con 0x7f27540c68a0 2023-10-07T08:59:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.040+0000 7f2750ff9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.040+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2744085110 con 0x7f27540c68a0 2023-10-07T08:59:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.040+0000 7f2758b85700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.041+0000 7f2758b85700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 0x7f27340693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f274c0091e0 tx=0x7f274c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.044+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2744055e10 con 0x7f27540c68a0 2023-10-07T08:59:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.236+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f275415aff0 con 0x7f27540c68a0 2023-10-07T08:59:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.236+0000 7f2750ff9700 1 -- 172.21.15.46:0/1021460502 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27440559a0 con 0x7f27540c68a0 2023-10-07T08:59:03.237 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 msgr2=0x7f27340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 0x7f27340693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f274c0091e0 tx=0x7f274c01a000 comp rx=0 tx=0).stop 2023-10-07T08:59:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 msgr2=0x7f27540b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2744011f80 tx=0x7f274400b040 comp rx=0 tx=0).stop 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 shutdown_connections 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27540b3610 0x7f27540c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2740003a60 0x7f2754154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 --2- 172.21.15.46:0/1021460502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27540c68a0 0x7f27540b30d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 >> 172.21.15.46:0/1021460502 conn(0x7f27540ce600 msgr2=0x7f275415a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 shutdown_connections 2023-10-07T08:59:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.238+0000 7f275ade9700 1 -- 172.21.15.46:0/1021460502 wait complete. 2023-10-07T08:59:03.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:03.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.372+0000 7f0340f2d700 1 Processor -- start 2023-10-07T08:59:03.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.372+0000 7f0340f2d700 1 -- start start 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0340f2d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f033c0aca80 0x7f033c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0340f2d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0340f2d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c06bdb0 con 0x7f033c0c81f0 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0340f2d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0c8670 con 0x7f033c0aca80 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0340f2d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0cb370 con 0x7f033c069d60 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f033a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f033c0aca80 0x7f033c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f033a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f033c0aca80 0x7f033c06aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35134/0 (socket says 172.21.15.46:35134) 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f033a59c700 1 -- 172.21.15.46:0/1571517759 learned_addr learned my addr 172.21.15.46:0/1571517759 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:03.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.373+0000 7f0339d9b700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033a59c700 1 -- 172.21.15.46:0/1571517759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 msgr2=0x7f033c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033a59c700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c0c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033a59c700 1 -- 172.21.15.46:0/1571517759 >> v1:172.21.15.133:6789/0 conn(0x7f033c0c81f0 legacy=0x7f033c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033a59c700 1 -- 172.21.15.46:0/1571517759 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c159f60 con 0x7f033c0aca80 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033a59c700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c06aba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0334009f70 tx=0x7f0334009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ffd9b9749a0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033959a700 1 -- 172.21.15.46:0/1571517759 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400e070 con 0x7f033c0aca80 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033959a700 1 -- 172.21.15.46:0/1571517759 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400ba20 con 0x7f033c0aca80 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.374+0000 7f033959a700 1 -- 172.21.15.46:0/1571517759 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03340092e0 con 0x7f033c0aca80 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 -- 172.21.15.46:0/1571517759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 msgr2=0x7f033c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c06aba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0334009f70 tx=0x7f0334009840 comp rx=0 tx=0).stop 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 -- 172.21.15.46:0/1571517759 shutdown_connections 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c06aba0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 --2- 172.21.15.46:0/1571517759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 -- 172.21.15.46:0/1571517759 >> 172.21.15.46:0/1571517759 conn(0x7f033c0cd670 msgr2=0x7f033c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 -- 172.21.15.46:0/1571517759 shutdown_connections 2023-10-07T08:59:03.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.375+0000 7f0340f2d700 1 -- 172.21.15.46:0/1571517759 wait complete. 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.376+0000 7f0340f2d700 1 Processor -- start 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.376+0000 7f0340f2d700 1 -- start start 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f033c0c81f0 0x7f033c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c16ad60 con 0x7f033c0aca80 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c169ca0 con 0x7f033c0c81f0 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c169f80 con 0x7f033c069d60 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35140/0 (socket says 172.21.15.46:35140) 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 -- 172.21.15.46:0/623482681 learned_addr learned my addr 172.21.15.46:0/623482681 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f033a59c700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f033ad9d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f033c0c81f0 0x7f033c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 -- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 msgr2=0x7f033c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 -- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f033c0c81f0 msgr2=0x7f033c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f033c0c81f0 0x7f033c15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 -- 172.21.15.46:0/623482681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334009ae0 con 0x7f033c0aca80 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0339d9b700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f032400ec50 tx=0x7f03240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400c850 con 0x7f033c0aca80 2023-10-07T08:59:03.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400c9b0 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c16a260 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400cd70 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.377+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c16a820 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.378+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c04c3c0 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.379+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0324013680 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.379+0000 7f03327fc700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 0x7f031c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.379+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03240847b0 con 0x7f033c0aca80 2023-10-07T08:59:03.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.379+0000 7f033a59c700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 0x7f031c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.380+0000 7f033a59c700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 0x7f031c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0334009880 tx=0x7f0334018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.383+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0324051a20 con 0x7f033c0aca80 2023-10-07T08:59:03.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.581+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f033c06b510 con 0x7f033c0aca80 2023-10-07T08:59:03.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.581+0000 7f03327fc700 1 -- 172.21.15.46:0/623482681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0324055040 con 0x7f033c0aca80 2023-10-07T08:59:03.582 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 msgr2=0x7f031c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 0x7f031c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0334009880 tx=0x7f0334018000 comp rx=0 tx=0).stop 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 msgr2=0x7f033c0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f032400ec50 tx=0x7f03240091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 shutdown_connections 2023-10-07T08:59:03.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f031c066f30 0x7f031c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f033c0c81f0 0x7f033c15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f033c069d60 0x7f033c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 --2- 172.21.15.46:0/623482681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f033c0aca80 0x7f033c0ae980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 >> 172.21.15.46:0/623482681 conn(0x7f033c0cd670 msgr2=0x7f033c157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 shutdown_connections 2023-10-07T08:59:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.583+0000 7f0340f2d700 1 -- 172.21.15.46:0/623482681 wait complete. 2023-10-07T08:59:03.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:03.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.714+0000 7f14b1e91700 1 Processor -- start 2023-10-07T08:59:03.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.714+0000 7f14b1e91700 1 -- start start 2023-10-07T08:59:03.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14b1e91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14b1e91700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14ac159c60 0x7f14ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14b1e91700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac15a160 con 0x7f14ac15db10 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14b1e91700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0d13a0 con 0x7f14ac159c60 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14b1e91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac15e140 con 0x7f14ac159890 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14aaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14ac159c60 0x7f14ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14aaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14ac159c60 0x7f14ac15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35156/0 (socket says 172.21.15.46:35156) 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14aaffd700 1 -- 172.21.15.46:0/1434773025 learned_addr learned my addr 172.21.15.46:0/1434773025 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.715+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aaffd700 1 -- 172.21.15.46:0/1434773025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 msgr2=0x7f14ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aaffd700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aaffd700 1 -- 172.21.15.46:0/1434773025 >> v1:172.21.15.133:6789/0 conn(0x7f14ac15db10 legacy=0x7f14ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aa7fc700 1 -- 172.21.15.46:0/1434773025 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619444943 0 0) 0x7f14ac15a160 con 0x7f14ac15db10 2023-10-07T08:59:03.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aaffd700 1 -- 172.21.15.46:0/1434773025 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac15a3d0 con 0x7f14ac159c60 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aaffd700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac159c60 0x7f14ac15d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14a00099b0 tx=0x7f14a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b585b6cc65344400 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aa7fc700 1 -- 172.21.15.46:0/1434773025 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0009ea0 con 0x7f14ac159c60 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aa7fc700 1 -- 172.21.15.46:0/1434773025 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000b860 con 0x7f14ac159c60 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.716+0000 7f14aa7fc700 1 -- 172.21.15.46:0/1434773025 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000bc00 con 0x7f14ac159c60 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 -- 172.21.15.46:0/1434773025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac159c60 msgr2=0x7f14ac15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac159c60 0x7f14ac15d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14a00099b0 tx=0x7f14a0009250 comp rx=0 tx=0).stop 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 -- 172.21.15.46:0/1434773025 shutdown_connections 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 --2- 172.21.15.46:0/1434773025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac159c60 0x7f14ac15d5d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 -- 172.21.15.46:0/1434773025 >> 172.21.15.46:0/1434773025 conn(0x7f14ac068e20 msgr2=0x7f14ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 -- 172.21.15.46:0/1434773025 shutdown_connections 2023-10-07T08:59:03.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.717+0000 7f14b1e91700 1 -- 172.21.15.46:0/1434773025 wait complete. 2023-10-07T08:59:03.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.718+0000 7f14b1e91700 1 Processor -- start 2023-10-07T08:59:03.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.718+0000 7f14b1e91700 1 -- start start 2023-10-07T08:59:03.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 0x7f14ac14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14c4e0 con 0x7f14ac15db10 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac151400 con 0x7f14ac159c60 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14b1e91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14c910 con 0x7f14ac159890 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35172/0 (socket says 172.21.15.46:35172) 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 -- 172.21.15.46:0/3816543879 learned_addr learned my addr 172.21.15.46:0/3816543879 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14aaffd700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 0x7f14ac14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 -- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 msgr2=0x7f14ac153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 -- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 msgr2=0x7f14ac14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 0x7f14ac14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 -- 172.21.15.46:0/3816543879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009420 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14aaffd700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 0x7f14ac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14abfff700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c890 tx=0x7f14a4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.719+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4017070 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.720+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4006ba0 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.720+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a00094f0 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.720+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4012630 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.720+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac0cd880 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.720+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac1515d0 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.721+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a4012a60 con 0x7f14ac15db10 2023-10-07T08:59:03.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.721+0000 7f14937fe700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:03.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.721+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a4084340 con 0x7f14ac15db10 2023-10-07T08:59:03.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.722+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:03.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.722+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 0x7f14980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f149c0093f0 tx=0x7f149c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:03.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.725+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a40515b0 con 0x7f14ac15db10 2023-10-07T08:59:03.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.920+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14ac04c3c0 con 0x7f14ac15db10 2023-10-07T08:59:03.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.921+0000 7f14937fe700 1 -- 172.21.15.46:0/3816543879 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f14a4054bd0 con 0x7f14ac15db10 2023-10-07T08:59:03.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:03.922 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 msgr2=0x7f14980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 0x7f14980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f149c0093f0 tx=0x7f149c008040 comp rx=0 tx=0).stop 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 msgr2=0x7f14ac0cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c890 tx=0x7f14a4001670 comp rx=0 tx=0).stop 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 shutdown_connections 2023-10-07T08:59:03.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac15db10 0x7f14ac0cf480 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159890 0x7f14ac153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 --2- 172.21.15.46:0/3816543879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac159c60 0x7f14ac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 >> 172.21.15.46:0/3816543879 conn(0x7f14ac068e20 msgr2=0x7f14ac0d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 shutdown_connections 2023-10-07T08:59:03.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:03.923+0000 7f14b1e91700 1 -- 172.21.15.46:0/3816543879 wait complete. 2023-10-07T08:59:03.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:59:03.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:04.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.058+0000 7f4378bd8700 1 Processor -- start 2023-10-07T08:59:04.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.058+0000 7f4378bd8700 1 -- start start 2023-10-07T08:59:04.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4378bd8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 0x7f437415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4378bd8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f437415db10 0x7f4374069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4378bd8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437415a160 con 0x7f4374159890 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4378bd8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437415df50 con 0x7f437415db10 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4378bd8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740d13a0 con 0x7f4374159c60 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4372d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f437415db10 0x7f4374069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4372d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f437415db10 0x7f4374069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35186/0 (socket says 172.21.15.46:35186) 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4372d9d700 1 -- 172.21.15.46:0/3834571145 learned_addr learned my addr 172.21.15.46:0/3834571145 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4371d9b700 1 --2- 172.21.15.46:0/3834571145 >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 0x7f437415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4372d9d700 1 -- 172.21.15.46:0/3834571145 >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 msgr2=0x7f437415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.059+0000 7f4372d9d700 1 --2- 172.21.15.46:0/3834571145 >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 0x7f437415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4372d9d700 1 -- 172.21.15.46:0/3834571145 >> v1:172.21.15.133:6789/0 conn(0x7f4374159890 legacy=0x7f437415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4372d9d700 1 -- 172.21.15.46:0/3834571145 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437415e140 con 0x7f437415db10 2023-10-07T08:59:04.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4371d9b700 1 --2- 172.21.15.46:0/3834571145 >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 0x7f437415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:04.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4372d9d700 1 --2- 172.21.15.46:0/3834571145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374069560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f43740b67f0 tx=0x7f4364009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6fcef6793dccda server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f437159a700 1 -- 172.21.15.46:0/3834571145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400e070 con 0x7f437415db10 2023-10-07T08:59:04.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f437159a700 1 -- 172.21.15.46:0/3834571145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400ba50 con 0x7f437415db10 2023-10-07T08:59:04.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f437159a700 1 -- 172.21.15.46:0/3834571145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640092e0 con 0x7f437415db10 2023-10-07T08:59:04.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 -- 172.21.15.46:0/3834571145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 msgr2=0x7f4374069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3834571145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374069560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f43740b67f0 tx=0x7f4364009840 comp rx=0 tx=0).stop 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 -- 172.21.15.46:0/3834571145 shutdown_connections 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3834571145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374069560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3834571145 >> v2:172.21.15.133:3300/0 conn(0x7f4374159c60 0x7f437415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 -- 172.21.15.46:0/3834571145 >> 172.21.15.46:0/3834571145 conn(0x7f4374068e20 msgr2=0x7f43740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.060+0000 7f4378bd8700 1 -- 172.21.15.46:0/3834571145 shutdown_connections 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.061+0000 7f4378bd8700 1 -- 172.21.15.46:0/3834571145 wait complete. 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 Processor -- start 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 -- start start 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 0x7f437415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 0x7f4374169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374151fe0 con 0x7f437415db10 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374151410 con 0x7f4374159c60 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4378bd8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43741516b0 con 0x7f4374159890 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4372d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4372d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35194/0 (socket says 172.21.15.46:35194) 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.062+0000 7f4372d9d700 1 -- 172.21.15.46:0/3119563382 learned_addr learned my addr 172.21.15.46:0/3119563382 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4371d9b700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 0x7f4374169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f437259c700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 0x7f437415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 -- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 msgr2=0x7f437415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 0x7f437415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 -- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 msgr2=0x7f4374169630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 0x7f4374169630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 -- 172.21.15.46:0/3119563382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009ae0 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4371d9b700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 0x7f4374169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f437259c700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 0x7f437415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4372d9d700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4374070e20 tx=0x7f4364018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364008e40 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400be60 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4374151990 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436401c660 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.063+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437416a350 con 0x7f437415db10 2023-10-07T08:59:04.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.064+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437404c3c0 con 0x7f437415db10 2023-10-07T08:59:04.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.065+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4364003040 con 0x7f437415db10 2023-10-07T08:59:04.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.065+0000 7f436a7fc700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.065+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4364085dc0 con 0x7f437415db10 2023-10-07T08:59:04.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.065+0000 7f437259c700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.066+0000 7f437259c700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f436c007fd0 tx=0x7f436c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.069+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4364053030 con 0x7f437415db10 2023-10-07T08:59:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.263+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f437415d8f0 con 0x7f437415db10 2023-10-07T08:59:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.264+0000 7f436a7fc700 1 -- 172.21.15.46:0/3119563382 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4364056650 con 0x7f437415db10 2023-10-07T08:59:04.265 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:04.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 msgr2=0x7f43540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f436c007fd0 tx=0x7f436c009040 comp rx=0 tx=0).stop 2023-10-07T08:59:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 msgr2=0x7f4374169b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4374070e20 tx=0x7f4364018000 comp rx=0 tx=0).stop 2023-10-07T08:59:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 shutdown_connections 2023-10-07T08:59:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f437415db10 0x7f4374169b70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4374159890 0x7f437415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 --2- 172.21.15.46:0/3119563382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4374159c60 0x7f4374169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 >> 172.21.15.46:0/3119563382 conn(0x7f4374068e20 msgr2=0x7f437415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 shutdown_connections 2023-10-07T08:59:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.266+0000 7f4378bd8700 1 -- 172.21.15.46:0/3119563382 wait complete. 2023-10-07T08:59:04.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:04.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.401+0000 7f5a408e8700 1 Processor -- start 2023-10-07T08:59:04.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.401+0000 7f5a408e8700 1 -- start start 2023-10-07T08:59:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a408e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 0x7f5a3c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a408e8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a3c15db10 0x7f5a3c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a408e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c15a160 con 0x7f5a3c159890 2023-10-07T08:59:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a408e8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c15df50 con 0x7f5a3c15db10 2023-10-07T08:59:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a408e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0d13a0 con 0x7f5a3c159c60 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a3c15db10 0x7f5a3c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a3c15db10 0x7f5a3c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35208/0 (socket says 172.21.15.46:35208) 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3168007155 learned_addr learned my addr 172.21.15.46:0/3168007155 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a39d9b700 1 --2- 172.21.15.46:0/3168007155 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 0x7f5a3c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3168007155 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 msgr2=0x7f5a3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 --2- 172.21.15.46:0/3168007155 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 0x7f5a3c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3168007155 >> v1:172.21.15.133:6789/0 conn(0x7f5a3c159890 legacy=0x7f5a3c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3168007155 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c15e140 con 0x7f5a3c15db10 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a39d9b700 1 --2- 172.21.15.46:0/3168007155 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 0x7f5a3c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3ad9d700 1 --2- 172.21.15.46:0/3168007155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c069560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b67f0 tx=0x7f5a34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8272cf16752dc53 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3959a700 1 -- 172.21.15.46:0/3168007155 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400e070 con 0x7f5a3c15db10 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3959a700 1 -- 172.21.15.46:0/3168007155 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400ba10 con 0x7f5a3c15db10 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.402+0000 7f5a3959a700 1 -- 172.21.15.46:0/3168007155 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340092e0 con 0x7f5a3c15db10 2023-10-07T08:59:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 -- 172.21.15.46:0/3168007155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 msgr2=0x7f5a3c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3168007155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c069560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b67f0 tx=0x7f5a34009840 comp rx=0 tx=0).stop 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 -- 172.21.15.46:0/3168007155 shutdown_connections 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3168007155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c069560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3168007155 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c159c60 0x7f5a3c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 -- 172.21.15.46:0/3168007155 >> 172.21.15.46:0/3168007155 conn(0x7f5a3c068e20 msgr2=0x7f5a3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 -- 172.21.15.46:0/3168007155 shutdown_connections 2023-10-07T08:59:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.403+0000 7f5a408e8700 1 -- 172.21.15.46:0/3168007155 wait complete. 2023-10-07T08:59:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.404+0000 7f5a408e8700 1 Processor -- start 2023-10-07T08:59:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.404+0000 7f5a408e8700 1 -- start start 2023-10-07T08:59:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c159890 0x7f5a3c15d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3c159c60 0x7f5a3c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0cfdf0 con 0x7f5a3c15db10 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0cd0c0 con 0x7f5a3c159890 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a408e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c151a80 con 0x7f5a3c159c60 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35220/0 (socket says 172.21.15.46:35220) 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3202909715 learned_addr learned my addr 172.21.15.46:0/3202909715 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a39d9b700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3c159c60 0x7f5a3c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3a59c700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c159890 0x7f5a3c15d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3c159c60 msgr2=0x7f5a3c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3c159c60 0x7f5a3c0cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c159890 msgr2=0x7f5a3c15d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c159890 0x7f5a3c15d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.405+0000 7f5a3ad9d700 1 -- 172.21.15.46:0/3202909715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34009ae0 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a3ad9d700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c070e20 tx=0x7f5a34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340094e0 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340032f0 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c0cd310 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3401d420 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.406+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c0b0670 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.407+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c0b0890 con 0x7f5a3c15db10 2023-10-07T08:59:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.407+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3401d850 con 0x7f5a3c15db10 2023-10-07T08:59:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.407+0000 7f5a2a7fc700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.408+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a34085c30 con 0x7f5a3c15db10 2023-10-07T08:59:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.408+0000 7f5a3a59c700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.408+0000 7f5a3a59c700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 0x7f5a1c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c063ed0 tx=0x7f5a2c007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.412+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a34052ea0 con 0x7f5a3c15db10 2023-10-07T08:59:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.604+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a3c04c3c0 con 0x7f5a3c15db10 2023-10-07T08:59:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.604+0000 7f5a2a7fc700 1 -- 172.21.15.46:0/3202909715 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a340564c0 con 0x7f5a3c15db10 2023-10-07T08:59:04.605 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.606+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 msgr2=0x7f5a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.606+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 0x7f5a1c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c063ed0 tx=0x7f5a2c007ea0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.606+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 msgr2=0x7f5a3c151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.606+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c070e20 tx=0x7f5a34017000 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 shutdown_connections 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a3c15db10 0x7f5a3c151540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c159890 0x7f5a3c15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 --2- 172.21.15.46:0/3202909715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3c159c60 0x7f5a3c0cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 >> 172.21.15.46:0/3202909715 conn(0x7f5a3c068e20 msgr2=0x7f5a3c156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 shutdown_connections 2023-10-07T08:59:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.607+0000 7f5a408e8700 1 -- 172.21.15.46:0/3202909715 wait complete. 2023-10-07T08:59:04.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:04.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.741+0000 7fb65acb1700 1 Processor -- start 2023-10-07T08:59:04.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.741+0000 7fb65acb1700 1 -- start start 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb654159890 0x7fb65415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb654159c60 0x7fb65415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb65415db10 0x7fb654069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65415a160 con 0x7fb654159c60 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540d13a0 con 0x7fb65415db10 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65acb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65415e140 con 0x7fb654159890 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb654159c60 0x7fb65415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb654159c60 0x7fb65415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35228/0 (socket says 172.21.15.46:35228) 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 -- 172.21.15.46:0/323581663 learned_addr learned my addr 172.21.15.46:0/323581663 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb658a4d700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb654159890 0x7fb65415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb65924e700 1 --2- 172.21.15.46:0/323581663 >> v2:172.21.15.133:3300/0 conn(0x7fb65415db10 0x7fb654069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 -- 172.21.15.46:0/323581663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb654159890 msgr2=0x7fb65415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb654159890 0x7fb65415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 -- 172.21.15.46:0/323581663 >> v2:172.21.15.133:3300/0 conn(0x7fb65415db10 msgr2=0x7fb654069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 --2- 172.21.15.46:0/323581663 >> v2:172.21.15.133:3300/0 conn(0x7fb65415db10 0x7fb654069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 -- 172.21.15.46:0/323581663 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65415a3d0 con 0x7fb654159c60 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.742+0000 7fb653fff700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159c60 0x7fb65415d5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb654089b50 tx=0x7fb644009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cccc4d8bbec6155 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb6537fe700 1 -- 172.21.15.46:0/323581663 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64400e070 con 0x7fb654159c60 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb6537fe700 1 -- 172.21.15.46:0/323581663 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64400b970 con 0x7fb654159c60 2023-10-07T08:59:04.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb6537fe700 1 -- 172.21.15.46:0/323581663 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440092e0 con 0x7fb654159c60 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 -- 172.21.15.46:0/323581663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159c60 msgr2=0x7fb65415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159c60 0x7fb65415d5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb654089b50 tx=0x7fb644009840 comp rx=0 tx=0).stop 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 -- 172.21.15.46:0/323581663 shutdown_connections 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 --2- 172.21.15.46:0/323581663 >> v2:172.21.15.133:3300/0 conn(0x7fb65415db10 0x7fb654069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb654159890 0x7fb65415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 --2- 172.21.15.46:0/323581663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159c60 0x7fb65415d5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 -- 172.21.15.46:0/323581663 >> 172.21.15.46:0/323581663 conn(0x7fb654068e20 msgr2=0x7fb6540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 -- 172.21.15.46:0/323581663 shutdown_connections 2023-10-07T08:59:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.743+0000 7fb65acb1700 1 -- 172.21.15.46:0/323581663 wait complete. 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.744+0000 7fb65acb1700 1 Processor -- start 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.744+0000 7fb65acb1700 1 -- start start 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 0x7fb6540b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 0x7fb6540b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540b4420 con 0x7fb654159890 2023-10-07T08:59:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540b5700 con 0x7fb654159c60 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65acb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540cd0c0 con 0x7fb65415db10 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb658a4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb658a4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35234/0 (socket says 172.21.15.46:35234) 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb658a4d700 1 -- 172.21.15.46:0/3136837311 learned_addr learned my addr 172.21.15.46:0/3136837311 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb653fff700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 0x7fb6540b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.745+0000 7fb65924e700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 0x7fb6540b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 -- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 msgr2=0x7fb6540b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 0x7fb6540b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 -- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 msgr2=0x7fb6540b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 0x7fb6540b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 -- 172.21.15.46:0/3136837311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009ae0 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb653fff700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 0x7fb6540b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb65924e700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 0x7fb6540b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb658a4d700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00ec80 tx=0x7fb63c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00c9d0 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00cb30 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540b5930 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c013470 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.746+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540cd5f0 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.747+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65404c3c0 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.747+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63c0137e0 con 0x7fb654159890 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.748+0000 7fb650ff9700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 0x7fb6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:04.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.748+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb63c0848a0 con 0x7fb654159890 2023-10-07T08:59:04.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.748+0000 7fb653fff700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 0x7fb6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:04.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.748+0000 7fb653fff700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 0x7fb6340693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65415a090 tx=0x7fb644018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:04.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.752+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb63c051b10 con 0x7fb654159890 2023-10-07T08:59:04.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.942+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb65406a5b0 con 0x7fb654159890 2023-10-07T08:59:04.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.943+0000 7fb650ff9700 1 -- 172.21.15.46:0/3136837311 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb63c055130 con 0x7fb654159890 2023-10-07T08:59:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 msgr2=0x7fb6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 0x7fb6340693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65415a090 tx=0x7fb644018000 comp rx=0 tx=0).stop 2023-10-07T08:59:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 msgr2=0x7fb65416abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00ec80 tx=0x7fb63c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 shutdown_connections 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb634066f30 0x7fb6340693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb65415db10 0x7fb6540b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb654159890 0x7fb65416abf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 --2- 172.21.15.46:0/3136837311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb654159c60 0x7fb6540b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 >> 172.21.15.46:0/3136837311 conn(0x7fb654068e20 msgr2=0x7fb65414d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 shutdown_connections 2023-10-07T08:59:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:04.945+0000 7fb65acb1700 1 -- 172.21.15.46:0/3136837311 wait complete. 2023-10-07T08:59:05.022 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-07T08:59:05.023 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T08:59:05.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-07T08:59:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.141+0000 7f1628d56700 1 Processor -- start 2023-10-07T08:59:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.141+0000 7f1628d56700 1 -- start start 2023-10-07T08:59:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f1628d56700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1624157960 0x7f16240af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f1628d56700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b4d0 0x7f1624068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f1628d56700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162406b030 con 0x7f162406b940 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f1628d56700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16240ac760 con 0x7f1624157960 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f1628d56700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240af830 con 0x7f162406b4d0 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f162259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1624157960 0x7f16240af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f162259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1624157960 0x7f16240af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35242/0 (socket says 172.21.15.46:35242) 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.142+0000 7f162259c700 1 -- 172.21.15.46:0/738346213 learned_addr learned my addr 172.21.15.46:0/738346213 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f1621d9b700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b4d0 0x7f1624068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162259c700 1 -- 172.21.15.46:0/738346213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b4d0 msgr2=0x7f1624068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162259c700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b4d0 0x7f1624068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162259c700 1 -- 172.21.15.46:0/738346213 >> v1:172.21.15.133:6789/0 conn(0x7f162406b940 legacy=0x7f162415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162259c700 1 -- 172.21.15.46:0/738346213 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240c7f60 con 0x7f1624157960 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162259c700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1624157960 0x7f16240af250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f161c009f20 tx=0x7f161c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e719a8a26eb9a5a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162159a700 1 -- 172.21.15.46:0/738346213 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00e070 con 0x7f1624157960 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162159a700 1 -- 172.21.15.46:0/738346213 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00ba40 con 0x7f1624157960 2023-10-07T08:59:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.143+0000 7f162159a700 1 -- 172.21.15.46:0/738346213 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0092e0 con 0x7f1624157960 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 -- 172.21.15.46:0/738346213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1624157960 msgr2=0x7f16240af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1624157960 0x7f16240af250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f161c009f20 tx=0x7f161c009840 comp rx=0 tx=0).stop 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 -- 172.21.15.46:0/738346213 shutdown_connections 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1624157960 0x7f16240af250 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 --2- 172.21.15.46:0/738346213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b4d0 0x7f1624068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 -- 172.21.15.46:0/738346213 >> 172.21.15.46:0/738346213 conn(0x7f16240c9870 msgr2=0x7f16240c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 -- 172.21.15.46:0/738346213 shutdown_connections 2023-10-07T08:59:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.144+0000 7f1628d56700 1 -- 172.21.15.46:0/738346213 wait complete. 2023-10-07T08:59:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.145+0000 7f1628d56700 1 Processor -- start 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.145+0000 7f1628d56700 1 -- start start 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b940 0x7f16240c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624157960 0x7f16240b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240c6720 con 0x7f162406b4d0 2023-10-07T08:59:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240abec0 con 0x7f1624157960 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240c43f0 con 0x7f162406b940 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35250/0 (socket says 172.21.15.46:35250) 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 -- 172.21.15.46:0/783616220 learned_addr learned my addr 172.21.15.46:0/783616220 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1621d9b700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b940 0x7f16240c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1622d9d700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624157960 0x7f16240b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 -- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b940 msgr2=0x7f16240c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b940 0x7f16240c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 -- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624157960 msgr2=0x7f16240b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624157960 0x7f16240b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 -- 172.21.15.46:0/783616220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009ae0 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f162259c700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f162406cac0 tx=0x7f161c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012920 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c012a80 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240c5df0 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.146+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012e20 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.147+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16240c63b0 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.147+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162404c3c0 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.148+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f161c01d630 con 0x7f162406b4d0 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.148+0000 7f161a7fc700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 0x7f16040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.148+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f161c085ac0 con 0x7f162406b4d0 2023-10-07T08:59:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.148+0000 7f1621d9b700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 0x7f16040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.149+0000 7f1621d9b700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 0x7f16040693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f160c006fd0 tx=0x7f160c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.152+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f161c052d30 con 0x7f162406b4d0 2023-10-07T08:59:05.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.423+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f1624063300 con 0x7f162406b4d0 2023-10-07T08:59:05.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.888+0000 7f161a7fc700 1 -- 172.21.15.46:0/783616220 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f161c056350 con 0x7f162406b4d0 2023-10-07T08:59:05.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 msgr2=0x7f16040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:05.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 0x7f16040693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f160c006fd0 tx=0x7f160c008040 comp rx=0 tx=0).stop 2023-10-07T08:59:05.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 msgr2=0x7f162416dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:05.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f162406cac0 tx=0x7f161c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 shutdown_connections 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1604066f30 0x7f16040693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624157960 0x7f16240b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f162406b4d0 0x7f162416dd60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 --2- 172.21.15.46:0/783616220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f162406b940 0x7f16240c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 >> 172.21.15.46:0/783616220 conn(0x7f16240c9870 msgr2=0x7f1624159770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.890+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 shutdown_connections 2023-10-07T08:59:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:05.891+0000 7f1628d56700 1 -- 172.21.15.46:0/783616220 wait complete. 2023-10-07T08:59:05.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:59:06.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.030+0000 7f6415536700 1 Processor -- start 2023-10-07T08:59:06.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.030+0000 7f6415536700 1 -- start start 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f6415536700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6410159890 0x7f641015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f6415536700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6410069560 0x7f64100699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f6415536700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6410069ee0 con 0x7f6410159c60 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f6415536700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641015a160 con 0x7f6410159890 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f6415536700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64100d13a0 con 0x7f6410069560 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6410159890 0x7f641015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640e7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6410159c60 0x7f641015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47734/0 (socket says 172.21.15.46:47734) 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640e7fc700 1 -- 172.21.15.46:0/1950372294 learned_addr learned my addr 172.21.15.46:0/1950372294 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:06.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 -- 172.21.15.46:0/1950372294 >> v2:172.21.15.133:3300/0 conn(0x7f6410069560 msgr2=0x7f64100699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 --2- 172.21.15.46:0/1950372294 >> v2:172.21.15.133:3300/0 conn(0x7f6410069560 0x7f64100699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 -- 172.21.15.46:0/1950372294 >> v1:172.21.15.46:6789/0 conn(0x7f6410159c60 legacy=0x7f641015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 -- 172.21.15.46:0/1950372294 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641015e140 con 0x7f6410159890 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640dffb700 1 -- 172.21.15.46:0/1950372294 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513561328 0 0) 0x7f6410069ee0 con 0x7f6410159c60 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640effd700 1 --2- 172.21.15.46:0/1950372294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159890 0x7f641015abd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f641006a890 tx=0x7f64080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615910acb74946d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.031+0000 7f640dffb700 1 -- 172.21.15.46:0/1950372294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800b6b0 con 0x7f6410159890 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f640dffb700 1 -- 172.21.15.46:0/1950372294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800b810 con 0x7f6410159890 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f640dffb700 1 -- 172.21.15.46:0/1950372294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800bbb0 con 0x7f6410159890 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 -- 172.21.15.46:0/1950372294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159890 msgr2=0x7f641015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 --2- 172.21.15.46:0/1950372294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159890 0x7f641015abd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f641006a890 tx=0x7f64080091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 -- 172.21.15.46:0/1950372294 shutdown_connections 2023-10-07T08:59:06.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 --2- 172.21.15.46:0/1950372294 >> v2:172.21.15.133:3300/0 conn(0x7f6410069560 0x7f64100699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 --2- 172.21.15.46:0/1950372294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159890 0x7f641015abd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 -- 172.21.15.46:0/1950372294 >> 172.21.15.46:0/1950372294 conn(0x7f6410068e20 msgr2=0x7f64100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:06.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 -- 172.21.15.46:0/1950372294 shutdown_connections 2023-10-07T08:59:06.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.032+0000 7f6415536700 1 -- 172.21.15.46:0/1950372294 wait complete. 2023-10-07T08:59:06.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.033+0000 7f6415536700 1 Processor -- start 2023-10-07T08:59:06.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.033+0000 7f6415536700 1 -- start start 2023-10-07T08:59:06.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6410069560 0x7f6410158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 0x7f64100c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64101582b0 con 0x7f6410159c60 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64101576a0 con 0x7f6410069560 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f6415536700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410157980 con 0x7f6410159890 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35266/0 (socket says 172.21.15.46:35266) 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 -- 172.21.15.46:0/2355629425 learned_addr learned my addr 172.21.15.46:0/2355629425 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640effd700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6410069560 0x7f6410158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640e7fc700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 0x7f64100c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 -- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 msgr2=0x7f64100c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 0x7f64100c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 -- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6410069560 msgr2=0x7f6410158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6410069560 0x7f6410158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640f7fe700 1 -- 172.21.15.46:0/2355629425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009420 con 0x7f6410159c60 2023-10-07T08:59:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.034+0000 7f640e7fc700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 0x7f64100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f640f7fe700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f640000bc30 tx=0x7f6400009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000092e0 con 0x7f6410159c60 2023-10-07T08:59:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640000c6f0 con 0x7f6410159c60 2023-10-07T08:59:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6410157c60 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640000cad0 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.035+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64100c7020 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.036+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64100c72a0 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.036+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6400012070 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.036+0000 7f6406ffd700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 0x7f63f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.037+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6400084200 con 0x7f6410159c60 2023-10-07T08:59:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.037+0000 7f640effd700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 0x7f63f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.037+0000 7f640effd700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 0x7f63f00693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64080093f0 tx=0x7f6408017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.041+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64000513d0 con 0x7f6410159c60 2023-10-07T08:59:06.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.233+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f641004c3c0 con 0x7f6410159c60 2023-10-07T08:59:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.236+0000 7f6406ffd700 1 -- 172.21.15.46:0/2355629425 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64000549f0 con 0x7f6410159c60 2023-10-07T08:59:06.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 msgr2=0x7f63f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 0x7f63f00693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64080093f0 tx=0x7f6408017000 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 msgr2=0x7f6410148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f640000bc30 tx=0x7f6400009840 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 shutdown_connections 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63f0066f30 0x7f63f00693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6410159c60 0x7f6410148f80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6410069560 0x7f6410158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 --2- 172.21.15.46:0/2355629425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6410159890 0x7f64100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.238+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 >> 172.21.15.46:0/2355629425 conn(0x7f6410068e20 msgr2=0x7f6410149c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.239+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 shutdown_connections 2023-10-07T08:59:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.239+0000 7f6415536700 1 -- 172.21.15.46:0/2355629425 wait complete. 2023-10-07T08:59:06.251 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:59:06.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:06.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:06.333 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:59:06.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:59:06.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:06.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-07T08:59:06.374 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:59:06.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:06.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:59:06.430 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:59:06.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:06.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-07T08:59:06.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:59:06.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:06.468 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:59:06.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-07T08:59:06.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:06.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-07T08:59:06.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:59:06.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:06.559 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T08:59:06.614 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-07T08:59:06.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:06.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-07T08:59:06.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:59:06.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:06.656 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T08:59:06.712 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:59:06.712 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.831+0000 7f744a3be700 1 Processor -- start 2023-10-07T08:59:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.831+0000 7f744a3be700 1 -- start start 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f744a3be700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 0x7f74440b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f744a3be700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f744415d230 0x7f744415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f744a3be700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744415dbd0 con 0x7f74441597f0 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f744a3be700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74440b2980 con 0x7f744415d230 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f744a3be700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440b11d0 con 0x7f7444159420 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f7449bbd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f744415d230 0x7f744415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f74493bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 0x7f74440b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f7448bbb700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74441597f0 0x7f74440b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43718/0 (socket says 172.21.15.46:43718) 2023-10-07T08:59:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.832+0000 7f7448bbb700 1 -- 172.21.15.46:0/3392883838 learned_addr learned my addr 172.21.15.46:0/3392883838 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7449bbd700 1 -- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 msgr2=0x7f74440b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7449bbd700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 0x7f74440b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7449bbd700 1 -- 172.21.15.46:0/3392883838 >> v1:172.21.15.133:6789/0 conn(0x7f74441597f0 legacy=0x7f74440b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7449bbd700 1 -- 172.21.15.46:0/3392883838 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440b14b0 con 0x7f744415d230 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7443fff700 1 -- 172.21.15.46:0/3392883838 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155030883 0 0) 0x7f7438001110 con 0x7f74441597f0 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f74493bc700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 0x7f74440b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7449bbd700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744415d230 0x7f744415d690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7434009e60 tx=0x7f7434009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64aa62f1c9e3ddcf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7443fff700 1 -- 172.21.15.46:0/3392883838 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400e070 con 0x7f744415d230 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7443fff700 1 -- 172.21.15.46:0/3392883838 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400bb60 con 0x7f744415d230 2023-10-07T08:59:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.833+0000 7f7443fff700 1 -- 172.21.15.46:0/3392883838 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434012430 con 0x7f744415d230 2023-10-07T08:59:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 -- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744415d230 msgr2=0x7f744415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744415d230 0x7f744415d690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7434009e60 tx=0x7f7434009780 comp rx=0 tx=0).stop 2023-10-07T08:59:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 -- 172.21.15.46:0/3392883838 shutdown_connections 2023-10-07T08:59:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744415d230 0x7f744415d690 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 --2- 172.21.15.46:0/3392883838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7444159420 0x7f74440b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 -- 172.21.15.46:0/3392883838 >> 172.21.15.46:0/3392883838 conn(0x7f74440d0660 msgr2=0x7f74440d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 -- 172.21.15.46:0/3392883838 shutdown_connections 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.834+0000 7f744a3be700 1 -- 172.21.15.46:0/3392883838 wait complete. 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.835+0000 7f744a3be700 1 Processor -- start 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.835+0000 7f744a3be700 1 -- start start 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7444159420 0x7f744415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74441597f0 0x7f74440b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744415a910 con 0x7f744415d230 2023-10-07T08:59:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444159d00 con 0x7f7444159420 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f744a3be700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7444159fe0 con 0x7f74441597f0 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35276/0 (socket says 172.21.15.46:35276) 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 -- 172.21.15.46:0/3301688132 learned_addr learned my addr 172.21.15.46:0/3301688132 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f74493bc700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7444159420 0x7f744415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7448bbb700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74441597f0 0x7f74440b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 -- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74441597f0 msgr2=0x7f74440b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74441597f0 0x7f74440b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 -- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7444159420 msgr2=0x7f744415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7444159420 0x7f744415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 -- 172.21.15.46:0/3301688132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009420 con 0x7f744415d230 2023-10-07T08:59:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f7449bbd700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7444089340 tx=0x7f7434019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.836+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434012ea0 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.837+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434027470 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.837+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434009a20 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.837+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434027830 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.837+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744415a5a0 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.837+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744415aa80 con 0x7f744415d230 2023-10-07T08:59:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.838+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7434024070 con 0x7f744415d230 2023-10-07T08:59:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.838+0000 7f74417fa700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 0x7f74300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.838+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7434086bc0 con 0x7f744415d230 2023-10-07T08:59:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.839+0000 7f74493bc700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 0x7f74300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.839+0000 7f74493bc700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 0x7f74300693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f743c009f40 tx=0x7f743c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:06.842+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7434053e30 con 0x7f744415d230 2023-10-07T08:59:07.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.080+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f744404c3c0 con 0x7f744415d230 2023-10-07T08:59:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.081+0000 7f74417fa700 1 -- 172.21.15.46:0/3301688132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f743402c090 con 0x7f744415d230 2023-10-07T08:59:07.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:07.082 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 msgr2=0x7f74300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 0x7f74300693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f743c009f40 tx=0x7f743c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 msgr2=0x7f74440b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7444089340 tx=0x7f7434019000 comp rx=0 tx=0).stop 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 shutdown_connections 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7430066f30 0x7f74300693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f744415d230 0x7f74440b5e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7444159420 0x7f744415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 --2- 172.21.15.46:0/3301688132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74441597f0 0x7f74440b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 >> 172.21.15.46:0/3301688132 conn(0x7f74440d0660 msgr2=0x7f74440d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 shutdown_connections 2023-10-07T08:59:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.083+0000 7f744a3be700 1 -- 172.21.15.46:0/3301688132 wait complete. 2023-10-07T08:59:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:59:07.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.215+0000 7f5c99559700 1 Processor -- start 2023-10-07T08:59:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.215+0000 7f5c99559700 1 -- start start 2023-10-07T08:59:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c99559700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5c941594d0 0x7f5c940cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c99559700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c94159fb0 0x7f5c940b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c99559700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940d01f0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c99559700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c940cf5e0 con 0x7f5c941594d0 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c99559700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cf8c0 con 0x7f5c94159fb0 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5c941594d0 0x7f5c940cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5c941594d0 0x7f5c940cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35280/0 (socket says 172.21.15.46:35280) 2023-10-07T08:59:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 -- 172.21.15.46:0/164209668 learned_addr learned my addr 172.21.15.46:0/164209668 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c937fe700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c94159fb0 0x7f5c940b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 -- 172.21.15.46:0/164209668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c94159fb0 msgr2=0x7f5c940b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c94159fb0 0x7f5c940b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 -- 172.21.15.46:0/164209668 >> v1:172.21.15.133:6789/0 conn(0x7f5c940b5fb0 legacy=0x7f5c941598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.216+0000 7f5c92ffd700 1 -- 172.21.15.46:0/164209668 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940cfba0 con 0x7f5c941594d0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c92ffd700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c941594d0 0x7f5c940cd0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0099b0 tx=0x7f5c8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea4114fb0864a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c91ffb700 1 -- 172.21.15.46:0/164209668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00b820 con 0x7f5c941594d0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c91ffb700 1 -- 172.21.15.46:0/164209668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b980 con 0x7f5c941594d0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c91ffb700 1 -- 172.21.15.46:0/164209668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00bd20 con 0x7f5c941594d0 2023-10-07T08:59:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 -- 172.21.15.46:0/164209668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c941594d0 msgr2=0x7f5c940cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c941594d0 0x7f5c940cd0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0099b0 tx=0x7f5c8c009250 comp rx=0 tx=0).stop 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 -- 172.21.15.46:0/164209668 shutdown_connections 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c94159fb0 0x7f5c940b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 --2- 172.21.15.46:0/164209668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c941594d0 0x7f5c940cd0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 -- 172.21.15.46:0/164209668 >> 172.21.15.46:0/164209668 conn(0x7f5c940d05f0 msgr2=0x7f5c940d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 -- 172.21.15.46:0/164209668 shutdown_connections 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.217+0000 7f5c99559700 1 -- 172.21.15.46:0/164209668 wait complete. 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 Processor -- start 2023-10-07T08:59:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 -- start start 2023-10-07T08:59:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 0x7f5c94157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c94159fb0 0x7f5c940b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94157470 con 0x7f5c940b5fb0 2023-10-07T08:59:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941565e0 con 0x7f5c94159fb0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c99559700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94156860 con 0x7f5c941594d0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.219+0000 7f5c92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35286/0 (socket says 172.21.15.46:35286) 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 -- 172.21.15.46:0/684301735 learned_addr learned my addr 172.21.15.46:0/684301735 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c927fc700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 0x7f5c94157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c937fe700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c94159fb0 0x7f5c940b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 -- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 msgr2=0x7f5c94157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 0x7f5c94157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 -- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c94159fb0 msgr2=0x7f5c940b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c94159fb0 0x7f5c940b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 -- 172.21.15.46:0/684301735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0094f0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c927fc700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 0x7f5c94157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c92ffd700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009290 tx=0x7f5c8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011d70 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c020070 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c94156b40 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c01b6a0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.220+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94157100 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.221+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940ccff0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.222+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c8c022030 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.222+0000 7f5c8affd700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 0x7f5c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.222+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c8c0864e0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.222+0000 7f5c927fc700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 0x7f5c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.223+0000 7f5c927fc700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 0x7f5c740693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c007fd0 tx=0x7f5c7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.226+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c8c053750 con 0x7f5c940b5fb0 2023-10-07T08:59:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.419+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c940ccff0 con 0x7f5c940b5fb0 2023-10-07T08:59:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.420+0000 7f5c8affd700 1 -- 172.21.15.46:0/684301735 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5c8c056d70 con 0x7f5c940b5fb0 2023-10-07T08:59:07.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:07.422 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 msgr2=0x7f5c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 0x7f5c740693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c007fd0 tx=0x7f5c7c009040 comp rx=0 tx=0).stop 2023-10-07T08:59:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 msgr2=0x7f5c941560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009290 tx=0x7f5c8c016000 comp rx=0 tx=0).stop 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 shutdown_connections 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c74066f30 0x7f5c740693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c94159fb0 0x7f5c940b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c940b5fb0 0x7f5c941560a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 --2- 172.21.15.46:0/684301735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c941594d0 0x7f5c94157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 >> 172.21.15.46:0/684301735 conn(0x7f5c940d05f0 msgr2=0x7f5c94155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 shutdown_connections 2023-10-07T08:59:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.422+0000 7f5c99559700 1 -- 172.21.15.46:0/684301735 wait complete. 2023-10-07T08:59:07.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:58:35.508869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:58:36.633739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:59:07.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.557+0000 7fbc7007a700 1 Processor -- start 2023-10-07T08:59:07.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.557+0000 7fbc7007a700 1 -- start start 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc7007a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc6815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc7007a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6815a160 con 0x7fbc6815db10 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc7007a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc680d13a0 con 0x7fbc68159890 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc7007a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6815e140 con 0x7fbc68159c60 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6e617700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbc6815db10 0x7fbc68069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47748/0 (socket says 172.21.15.46:47748) 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6e617700 1 -- 172.21.15.46:0/528403296 learned_addr learned my addr 172.21.15.46:0/528403296 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6d615700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc6815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172794010 0 0) 0x7fbc6815a160 con 0x7fbc6815db10 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc54003570 con 0x7fbc6815db10 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212260763 0 0) 0x7fbc680d13a0 con 0x7fbc68159890 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc6815a160 con 0x7fbc68159890 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477772672 0 0) 0x7fbc54003570 con 0x7fbc6815db10 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 msgr2=0x7fbc6815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc6815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 >> v1:172.21.15.133:6789/0 conn(0x7fbc68159890 legacy=0x7fbc6815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6815a3d0 con 0x7fbc6815db10 2023-10-07T08:59:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.558+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fbc600017f0 con 0x7fbc6815db10 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 >> v1:172.21.15.46:6789/0 conn(0x7fbc6815db10 legacy=0x7fbc68069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc54003c20 0x7fbc54004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc54004810 0x7fbc54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc54005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6815e140 con 0x7fbc54004810 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5400bbf0 con 0x7fbc54003c20 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5400bdb0 con 0x7fbc68159c60 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc54004810 0x7fbc54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6de16700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc54003c20 0x7fbc54004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6e617700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc54005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 -- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 msgr2=0x7fbc54005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc68159c60 0x7fbc54005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 -- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc54003c20 msgr2=0x7fbc54004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc54003c20 0x7fbc54004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 -- 172.21.15.46:0/528403296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54003570 con 0x7fbc54004810 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6d615700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc54004810 0x7fbc54004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc6815a090 tx=0x7fbc580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae727bbf026fd2e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800e710 con 0x7fbc54004810 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800e870 con 0x7fbc54004810 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.559+0000 7fbc6ce14700 1 -- 172.21.15.46:0/528403296 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800ec30 con 0x7fbc54004810 2023-10-07T08:59:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 -- 172.21.15.46:0/528403296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc54004810 msgr2=0x7fbc54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 --2- 172.21.15.46:0/528403296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc54004810 0x7fbc54004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc6815a090 tx=0x7fbc580091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc6e617700 1 -- 172.21.15.46:0/528403296 reap_dead start 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 -- 172.21.15.46:0/528403296 shutdown_connections 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 -- 172.21.15.46:0/528403296 >> 172.21.15.46:0/528403296 conn(0x7fbc68068e20 msgr2=0x7fbc680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 -- 172.21.15.46:0/528403296 shutdown_connections 2023-10-07T08:59:07.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.560+0000 7fbc7007a700 1 -- 172.21.15.46:0/528403296 wait complete. 2023-10-07T08:59:07.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.561+0000 7fbc7007a700 1 Processor -- start 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.561+0000 7fbc7007a700 1 -- start start 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc54004810 0x7fbc6816a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc680c9e10 0x7fbc680ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680ca7c0 con 0x7fbc68158a70 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc68158ee0 con 0x7fbc680c9e10 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc7007a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680b59c0 con 0x7fbc54004810 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35292/0 (socket says 172.21.15.46:35292) 2023-10-07T08:59:07.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 -- 172.21.15.46:0/454808837 learned_addr learned my addr 172.21.15.46:0/454808837 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6de16700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc54004810 0x7fbc6816a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6e617700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc680c9e10 0x7fbc680ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 -- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc54004810 msgr2=0x7fbc6816a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc54004810 0x7fbc6816a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 -- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc680c9e10 msgr2=0x7fbc680ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc680c9e10 0x7fbc680ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 -- 172.21.15.46:0/454808837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680b5e50 con 0x7fbc68158a70 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc6d615700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800e4b0 tx=0x7fbc5801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.562+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58022070 con 0x7fbc68158a70 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.563+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800e9e0 con 0x7fbc68158a70 2023-10-07T08:59:07.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.563+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc680b4db0 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.563+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58027470 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.563+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc680b5370 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.564+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc680b5b70 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.564+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc58027860 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.564+0000 7fbc5dffb700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 0x7fbc4c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.564+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc58085b60 con 0x7fbc68158a70 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.565+0000 7fbc6de16700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 0x7fbc4c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.565+0000 7fbc6de16700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 0x7fbc4c069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000c00 tx=0x7fbc64007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.569+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc680b5b70 con 0x7fbc68158a70 2023-10-07T08:59:07.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.760+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc680ca7c0 con 0x7fbc68158a70 2023-10-07T08:59:07.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.760+0000 7fbc5dffb700 1 -- 172.21.15.46:0/454808837 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc58052df0 con 0x7fbc68158a70 2023-10-07T08:59:07.761 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 msgr2=0x7fbc4c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 0x7fbc4c069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000c00 tx=0x7fbc64007d30 comp rx=0 tx=0).stop 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 msgr2=0x7fbc680b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800e4b0 tx=0x7fbc5801a000 comp rx=0 tx=0).stop 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 shutdown_connections 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc4c066f60 0x7fbc4c069410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc680c9e10 0x7fbc680ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc54004810 0x7fbc6816a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 --2- 172.21.15.46:0/454808837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc68158a70 0x7fbc680b4560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 >> 172.21.15.46:0/454808837 conn(0x7fbc68068e20 msgr2=0x7fbc680d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 shutdown_connections 2023-10-07T08:59:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.762+0000 7fbc7007a700 1 -- 172.21.15.46:0/454808837 wait complete. 2023-10-07T08:59:07.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:07.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.896+0000 7fb7e6d7a700 1 Processor -- start 2023-10-07T08:59:07.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.896+0000 7fb7e6d7a700 1 -- start start 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 0x7fb7e00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7e00b0610 0x7fb7e00b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 0x7fb7e006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e006ee30 con 0x7fb7e00b0610 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b0fa0 con 0x7fb7e006e470 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6d7a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b27b0 con 0x7fb7e0159a50 2023-10-07T08:59:07.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7e00b0610 0x7fb7e00b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7e00b0610 0x7fb7e00b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35308/0 (socket says 172.21.15.46:35308) 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 -- 172.21.15.46:0/674043159 learned_addr learned my addr 172.21.15.46:0/674043159 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5d78700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 0x7fb7e00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6579700 1 --2- 172.21.15.46:0/674043159 >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 0x7fb7e006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 -- 172.21.15.46:0/674043159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 msgr2=0x7fb7e00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 0x7fb7e00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 -- 172.21.15.46:0/674043159 >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 msgr2=0x7fb7e006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 --2- 172.21.15.46:0/674043159 >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 0x7fb7e006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5577700 1 -- 172.21.15.46:0/674043159 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00b1de0 con 0x7fb7e00b0610 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e5d78700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 0x7fb7e00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.897+0000 7fb7e6579700 1 --2- 172.21.15.46:0/674043159 >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 0x7fb7e006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e5577700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e00b0610 0x7fb7e00b0a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0063f60 tx=0x7fb7d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db9289c574f3979 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e4d76700 1 -- 172.21.15.46:0/674043159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400b860 con 0x7fb7e00b0610 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e4d76700 1 -- 172.21.15.46:0/674043159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400b9c0 con 0x7fb7e00b0610 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e4d76700 1 -- 172.21.15.46:0/674043159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400bd60 con 0x7fb7e00b0610 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/674043159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e00b0610 msgr2=0x7fb7e00b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e00b0610 0x7fb7e00b0a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0063f60 tx=0x7fb7d4009250 comp rx=0 tx=0).stop 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/674043159 shutdown_connections 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/674043159 >> v2:172.21.15.133:3300/0 conn(0x7fb7e006e470 0x7fb7e006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e0159a50 0x7fb7e00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/674043159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e00b0610 0x7fb7e00b0a60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/674043159 >> 172.21.15.46:0/674043159 conn(0x7fb7e00c9f70 msgr2=0x7fb7e006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:07.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/674043159 shutdown_connections 2023-10-07T08:59:07.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.898+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/674043159 wait complete. 2023-10-07T08:59:07.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.899+0000 7fb7e6d7a700 1 Processor -- start 2023-10-07T08:59:07.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 -- start start 2023-10-07T08:59:07.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7e006e470 0x7fb7e0154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e00b0610 0x7fb7e0157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0155150 con 0x7fb7e0159a50 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00aba50 con 0x7fb7e006e470 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6d7a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00abd30 con 0x7fb7e00b0610 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6579700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6579700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35316/0 (socket says 172.21.15.46:35316) 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e6579700 1 -- 172.21.15.46:0/86577439 learned_addr learned my addr 172.21.15.46:0/86577439 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e5d78700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7e006e470 0x7fb7e0154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.900+0000 7fb7e5577700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e00b0610 0x7fb7e0157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 -- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e00b0610 msgr2=0x7fb7e0157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e00b0610 0x7fb7e0157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 -- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7e006e470 msgr2=0x7fb7e0154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7e006e470 0x7fb7e0154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 -- 172.21.15.46:0/86577439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094f0 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6579700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7d00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000dbe0 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000f040 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00ac010 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0015440 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.901+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00697b0 con 0x7fb7e0159a50 2023-10-07T08:59:07.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.902+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e0069db0 con 0x7fb7e0159a50 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.902+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7d001e3b0 con 0x7fb7e0159a50 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.903+0000 7fb7ddffb700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.903+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7d0084950 con 0x7fb7e0159a50 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.903+0000 7fb7e5d78700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.904+0000 7fb7e5d78700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 0x7fb7cc0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006fd0 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:07.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:07.907+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7d0051bc0 con 0x7fb7e0159a50 2023-10-07T08:59:08.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.100+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7e004bb80 con 0x7fb7e0159a50 2023-10-07T08:59:08.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.100+0000 7fb7ddffb700 1 -- 172.21.15.46:0/86577439 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7d001a020 con 0x7fb7e0159a50 2023-10-07T08:59:08.102 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 msgr2=0x7fb7cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 0x7fb7cc0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006fd0 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2023-10-07T08:59:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 msgr2=0x7fb7e0157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7d00099b0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 shutdown_connections 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7e0159a50 0x7fb7e0157a40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7e006e470 0x7fb7e0154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 --2- 172.21.15.46:0/86577439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7e00b0610 0x7fb7e0157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 >> 172.21.15.46:0/86577439 conn(0x7fb7e00c9f70 msgr2=0x7fb7e00c25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 shutdown_connections 2023-10-07T08:59:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.103+0000 7fb7e6d7a700 1 -- 172.21.15.46:0/86577439 wait complete. 2023-10-07T08:59:08.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.245+0000 7f2c1a6da700 1 Processor -- start 2023-10-07T08:59:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.245+0000 7f2c1a6da700 1 -- start start 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c1a6da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b16d0 0x7f2c140b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c1a6da700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c140b33b0 0x7f2c140b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c1a6da700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140b2080 con 0x7f2c140b4e70 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c1a6da700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c140cfb00 con 0x7f2c140b33b0 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c1a6da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b5c40 con 0x7f2c140b16d0 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c140b33b0 0x7f2c140b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c140b33b0 0x7f2c140b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35330/0 (socket says 172.21.15.46:35330) 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 -- 172.21.15.46:0/569279067 learned_addr learned my addr 172.21.15.46:0/569279067 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c18ed7700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b16d0 0x7f2c140b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 -- 172.21.15.46:0/569279067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b16d0 msgr2=0x7f2c140b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b16d0 0x7f2c140b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 -- 172.21.15.46:0/569279067 >> v1:172.21.15.133:6789/0 conn(0x7f2c140b4e70 legacy=0x7f2c140ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c19ed9700 1 -- 172.21.15.46:0/569279067 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140b5f20 con 0x7f2c140b33b0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.246+0000 7f2c13fff700 1 -- 172.21.15.46:0/569279067 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136715490 0 0) 0x7f2c140b2080 con 0x7f2c140b4e70 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c19ed9700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b33b0 0x7f2c140b3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009f20 tx=0x7f2c04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4ca1998ed998c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c13fff700 1 -- 172.21.15.46:0/569279067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400e070 con 0x7f2c140b33b0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c13fff700 1 -- 172.21.15.46:0/569279067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0400b9d0 con 0x7f2c140b33b0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c13fff700 1 -- 172.21.15.46:0/569279067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c040092e0 con 0x7f2c140b33b0 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 -- 172.21.15.46:0/569279067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b33b0 msgr2=0x7f2c140b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b33b0 0x7f2c140b3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009f20 tx=0x7f2c04009840 comp rx=0 tx=0).stop 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 -- 172.21.15.46:0/569279067 shutdown_connections 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b33b0 0x7f2c140b3830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/569279067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b16d0 0x7f2c140b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 -- 172.21.15.46:0/569279067 >> 172.21.15.46:0/569279067 conn(0x7f2c140d10c0 msgr2=0x7f2c140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 -- 172.21.15.46:0/569279067 shutdown_connections 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.247+0000 7f2c1a6da700 1 -- 172.21.15.46:0/569279067 wait complete. 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 Processor -- start 2023-10-07T08:59:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 -- start start 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b33b0 0x7f2c14068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 0x7f2c14068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.249+0000 7f2c1a6da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140c6660 con 0x7f2c140b16d0 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c1a6da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1416dfa0 con 0x7f2c140b4e70 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c1a6da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140c5d30 con 0x7f2c140b33b0 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35336/0 (socket says 172.21.15.46:35336) 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 -- 172.21.15.46:0/3328998353 learned_addr learned my addr 172.21.15.46:0/3328998353 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c18ed7700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b33b0 0x7f2c14068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c19ed9700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 0x7f2c14068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 -- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b33b0 msgr2=0x7f2c14068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b33b0 0x7f2c14068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 -- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 msgr2=0x7f2c14068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 0x7f2c14068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 -- 172.21.15.46:0/3328998353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04009ae0 con 0x7f2c140b16d0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c19ed9700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 0x7f2c14068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c196d8700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c530 tx=0x7f2c0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c011590 con 0x7f2c140b16d0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0116f0 con 0x7f2c140b16d0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c140c6010 con 0x7f2c140b16d0 2023-10-07T08:59:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c011ab0 con 0x7f2c140b16d0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.250+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c140ca790 con 0x7f2c140b16d0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.251+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c14088990 con 0x7f2c140b16d0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.252+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c0c01b3b0 con 0x7f2c140b16d0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.252+0000 7f2c117fa700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.252+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c0c083aa0 con 0x7f2c140b16d0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.252+0000 7f2c18ed7700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.253+0000 7f2c18ed7700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 0x7f2c000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c140c7b40 tx=0x7f2c08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.256+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c0c050d10 con 0x7f2c140b16d0 2023-10-07T08:59:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.448+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c1404bb80 con 0x7f2c140b16d0 2023-10-07T08:59:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.448+0000 7f2c117fa700 1 -- 172.21.15.46:0/3328998353 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c0c017070 con 0x7f2c140b16d0 2023-10-07T08:59:08.449 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 msgr2=0x7f2c000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 0x7f2c000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c140c7b40 tx=0x7f2c08008040 comp rx=0 tx=0).stop 2023-10-07T08:59:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 msgr2=0x7f2c140ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c530 tx=0x7f2c0c00c8f0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 shutdown_connections 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140b4e70 0x7f2c14068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c140b16d0 0x7f2c140ca250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 --2- 172.21.15.46:0/3328998353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c140b33b0 0x7f2c14068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 >> 172.21.15.46:0/3328998353 conn(0x7f2c140d10c0 msgr2=0x7f2c14158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 shutdown_connections 2023-10-07T08:59:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.450+0000 7f2c1a6da700 1 -- 172.21.15.46:0/3328998353 wait complete. 2023-10-07T08:59:08.463 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.585+0000 7f493c0d8700 1 Processor -- start 2023-10-07T08:59:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.585+0000 7f493c0d8700 1 -- start start 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493c0d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f493406bcd0 0x7f4934140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493c0d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f493406c0a0 0x7f4934141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493c0d8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493415c2a0 con 0x7f49340c8e00 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493c0d8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493415b690 con 0x7f493406bcd0 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493c0d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493415b970 con 0x7f493406c0a0 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f4939e74700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f493406bcd0 0x7f4934140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493a675700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f49340c8e00 0x7f49340c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47756/0 (socket says 172.21.15.46:47756) 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.586+0000 7f493a675700 1 -- 172.21.15.46:0/34497908 learned_addr learned my addr 172.21.15.46:0/34497908 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939673700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f493406c0a0 0x7f4934141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939e74700 1 -- 172.21.15.46:0/34497908 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f493406c0a0 msgr2=0x7f4934141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939e74700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f493406c0a0 0x7f4934141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939e74700 1 -- 172.21.15.46:0/34497908 >> v1:172.21.15.46:6789/0 conn(0x7f49340c8e00 legacy=0x7f49340c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4938e72700 1 -- 172.21.15.46:0/34497908 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457742296 0 0) 0x7f493415c2a0 con 0x7f49340c8e00 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939e74700 1 -- 172.21.15.46:0/34497908 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493415bc50 con 0x7f493406bcd0 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4939e74700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f4934140df0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4bf07a8802e6b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4938e72700 1 -- 172.21.15.46:0/34497908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c009e80 con 0x7f493406bcd0 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4938e72700 1 -- 172.21.15.46:0/34497908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00b860 con 0x7f493406bcd0 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f4938e72700 1 -- 172.21.15.46:0/34497908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00bbe0 con 0x7f493406bcd0 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f493c0d8700 1 -- 172.21.15.46:0/34497908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 msgr2=0x7f4934140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.587+0000 7f493c0d8700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f4934140df0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 -- 172.21.15.46:0/34497908 shutdown_connections 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f4934140df0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 --2- 172.21.15.46:0/34497908 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f493406c0a0 0x7f4934141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 -- 172.21.15.46:0/34497908 >> 172.21.15.46:0/34497908 conn(0x7f49340ce600 msgr2=0x7f49340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 -- 172.21.15.46:0/34497908 shutdown_connections 2023-10-07T08:59:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.588+0000 7f493c0d8700 1 -- 172.21.15.46:0/34497908 wait complete. 2023-10-07T08:59:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.589+0000 7f493c0d8700 1 Processor -- start 2023-10-07T08:59:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.589+0000 7f493c0d8700 1 -- start start 2023-10-07T08:59:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.589+0000 7f493c0d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.589+0000 7f493c0d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493406c0a0 0x7f49340c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493c0d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49340c8e00 0x7f493413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493c0d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49340b1d70 con 0x7f493406bcd0 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493c0d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49340b1440 con 0x7f493406c0a0 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493c0d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49340b1720 con 0x7f49340c8e00 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35346/0 (socket says 172.21.15.46:35346) 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 -- 172.21.15.46:0/142862274 learned_addr learned my addr 172.21.15.46:0/142862274 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939673700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493406c0a0 0x7f49340c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493a675700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49340c8e00 0x7f493413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 -- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49340c8e00 msgr2=0x7f493413e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49340c8e00 0x7f493413e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 -- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493406c0a0 msgr2=0x7f49340c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493406c0a0 0x7f49340c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 -- 172.21.15.46:0/142862274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009420 con 0x7f493406bcd0 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4939e74700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4934069220 tx=0x7f492c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00bbe0 con 0x7f493406bcd0 2023-10-07T08:59:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011420 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49340b1a00 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.590+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0117e0 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.591+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49340c7110 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.591+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493404c3c0 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.592+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f492c011bd0 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.592+0000 7f4931ffb700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.592+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f492c085ee0 con 0x7f493406bcd0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.592+0000 7f4939673700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.593+0000 7f4939673700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 0x7f49200693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f493406fd50 tx=0x7f4928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.597+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f492c053150 con 0x7f493406bcd0 2023-10-07T08:59:08.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.831+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49340b1b90 con 0x7f493406bcd0 2023-10-07T08:59:08.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.832+0000 7f4931ffb700 1 -- 172.21.15.46:0/142862274 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f492c056770 con 0x7f493406bcd0 2023-10-07T08:59:08.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:08.833 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 msgr2=0x7f49200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 0x7f49200693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f493406fd50 tx=0x7f4928008040 comp rx=0 tx=0).stop 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 msgr2=0x7f493413c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4934069220 tx=0x7f492c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 shutdown_connections 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49340c8e00 0x7f493413e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f493406bcd0 0x7f493413c540 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 --2- 172.21.15.46:0/142862274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493406c0a0 0x7f49340c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 >> 172.21.15.46:0/142862274 conn(0x7f49340ce600 msgr2=0x7f4934140bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 shutdown_connections 2023-10-07T08:59:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.834+0000 7f493c0d8700 1 -- 172.21.15.46:0/142862274 wait complete. 2023-10-07T08:59:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:59:08.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:08.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.966+0000 7fc7560f7700 1 Processor -- start 2023-10-07T08:59:08.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.966+0000 7fc7560f7700 1 -- start start 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc7560f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc75006bcd0 0x7fc7500caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc7560f7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75015d7e0 con 0x7fc75015df50 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc7560f7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75015dac0 con 0x7fc75006c0a0 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc7560f7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75015aa30 con 0x7fc75006bcd0 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc75015df50 0x7fc7500c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47764/0 (socket says 172.21.15.46:47764) 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74ffff700 1 -- 172.21.15.46:0/836856862 learned_addr learned my addr 172.21.15.46:0/836856862 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:08.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74f7fe700 1 --2- 172.21.15.46:0/836856862 >> v2:172.21.15.133:3300/0 conn(0x7fc75006bcd0 0x7fc7500caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375451216 0 0) 0x7fc75015d7e0 con 0x7fc75015df50 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc738003570 con 0x7fc75015df50 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225357590 0 0) 0x7fc738003570 con 0x7fc75015df50 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 >> v2:172.21.15.133:3300/0 conn(0x7fc75006bcd0 msgr2=0x7fc7500caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 --2- 172.21.15.46:0/836856862 >> v2:172.21.15.133:3300/0 conn(0x7fc75006bcd0 0x7fc7500caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 >> v1:172.21.15.133:6789/0 conn(0x7fc75006c0a0 legacy=0x7fc75015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75015ad10 con 0x7fc75015df50 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.967+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fc7480017f0 con 0x7fc75015df50 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 >> v1:172.21.15.46:6789/0 conn(0x7fc75015df50 legacy=0x7fc7500c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc738003a60 0x7fc738003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc738004810 0x7fc738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc73800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75015aa30 con 0x7fc7380052e0 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73800c2a0 con 0x7fc738004810 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73800c460 con 0x7fc738003a60 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc73800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74f7fe700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc738003a60 0x7fc738003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74effd700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc738004810 0x7fc738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 -- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc738003a60 msgr2=0x7fc738003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc738003a60 0x7fc738003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 -- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc738004810 msgr2=0x7fc738004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc738004810 0x7fc738004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 -- 172.21.15.46:0/836856862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738003570 con 0x7fc7380052e0 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 -- 172.21.15.46:0/836856862 reap_dead start 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74ffff700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc73800ba60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a900 tx=0x7fc75015da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742b823ad8399576 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480070d0 con 0x7fc7380052e0 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748007230 con 0x7fc7380052e0 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.968+0000 7fc74e7fc700 1 -- 172.21.15.46:0/836856862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480075f0 con 0x7fc7380052e0 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 -- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 msgr2=0x7fc73800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc73800ba60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a900 tx=0x7fc75015da30 comp rx=0 tx=0).stop 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 -- 172.21.15.46:0/836856862 shutdown_connections 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 --2- 172.21.15.46:0/836856862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc73800ba60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 -- 172.21.15.46:0/836856862 >> 172.21.15.46:0/836856862 conn(0x7fc7500ce600 msgr2=0x7fc7500cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:08.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 -- 172.21.15.46:0/836856862 shutdown_connections 2023-10-07T08:59:08.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.969+0000 7fc7560f7700 1 -- 172.21.15.46:0/836856862 wait complete. 2023-10-07T08:59:08.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.970+0000 7fc7560f7700 1 Processor -- start 2023-10-07T08:59:08.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.970+0000 7fc7560f7700 1 -- start start 2023-10-07T08:59:08.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7501444c0 0x7fc750153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc750154320 0x7fc75015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b2d50 con 0x7fc7380052e0 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b2ff0 con 0x7fc7501444c0 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc7560f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b32d0 con 0x7fc750154320 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35366/0 (socket says 172.21.15.46:35366) 2023-10-07T08:59:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 -- 172.21.15.46:0/711727236 learned_addr learned my addr 172.21.15.46:0/711727236 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74effd700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7501444c0 0x7fc750153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74ffff700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc750154320 0x7fc75015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 -- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc750154320 msgr2=0x7fc75015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc750154320 0x7fc75015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 -- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7501444c0 msgr2=0x7fc750153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7501444c0 0x7fc750153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.971+0000 7fc74f7fe700 1 -- 172.21.15.46:0/711727236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500b35b0 con 0x7fc7380052e0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc74f7fe700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc740006ac0 tx=0x7fc7400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011ec0 con 0x7fc7380052e0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000f940 con 0x7fc7380052e0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc750154860 con 0x7fc7380052e0 2023-10-07T08:59:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000fcc0 con 0x7fc7380052e0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.972+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75015c340 con 0x7fc7380052e0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.973+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500b3920 con 0x7fc7380052e0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.973+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc740014650 con 0x7fc7380052e0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.974+0000 7fc7377fe700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.974+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc740018030 con 0x7fc7380052e0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.974+0000 7fc74effd700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.974+0000 7fc74effd700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7500b2c40 tx=0x7fc744007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:08.978+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc740052070 con 0x7fc7380052e0 2023-10-07T08:59:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.172+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7500b3130 con 0x7fc7380052e0 2023-10-07T08:59:09.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.172+0000 7fc7377fe700 1 -- 172.21.15.46:0/711727236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc7500b3130 con 0x7fc7380052e0 2023-10-07T08:59:09.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:09.173 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:09.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 msgr2=0x7fc73c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7500b2c40 tx=0x7fc744007d30 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 msgr2=0x7fc7500b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc740006ac0 tx=0x7fc7400091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 shutdown_connections 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc750154320 0x7fc75015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7380052e0 0x7fc7500b3ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 --2- 172.21.15.46:0/711727236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7501444c0 0x7fc750153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.174+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 >> 172.21.15.46:0/711727236 conn(0x7fc7500ce600 msgr2=0x7fc75006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.175+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 shutdown_connections 2023-10-07T08:59:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.175+0000 7fc7560f7700 1 -- 172.21.15.46:0/711727236 wait complete. 2023-10-07T08:59:09.187 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:59:09.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:09.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.306+0000 7fc8d0e5b700 1 Processor -- start 2023-10-07T08:59:09.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.306+0000 7fc8d0e5b700 1 -- start start 2023-10-07T08:59:09.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8d0e5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8cc159c60 0x7fc8cc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8d0e5b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8cc15db10 0x7fc8cc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8d0e5b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc15a160 con 0x7fc8cc159890 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8d0e5b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc15df50 con 0x7fc8cc15db10 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8d0e5b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc0d13a0 con 0x7fc8cc159c60 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8cad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8cc15db10 0x7fc8cc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8cad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8cc15db10 0x7fc8cc069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35374/0 (socket says 172.21.15.46:35374) 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1224324855 learned_addr learned my addr 172.21.15.46:0/1224324855 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.307+0000 7fc8c9d9b700 1 --2- 172.21.15.46:0/1224324855 >> v2:172.21.15.133:3300/0 conn(0x7fc8cc159c60 0x7fc8cc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1224324855 >> v2:172.21.15.133:3300/0 conn(0x7fc8cc159c60 msgr2=0x7fc8cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:09.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8cad9d700 1 --2- 172.21.15.46:0/1224324855 >> v2:172.21.15.133:3300/0 conn(0x7fc8cc159c60 0x7fc8cc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1224324855 >> v1:172.21.15.133:6789/0 conn(0x7fc8cc159890 legacy=0x7fc8cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1224324855 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc15e140 con 0x7fc8cc15db10 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8cad9d700 1 --2- 172.21.15.46:0/1224324855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc069560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0b67f0 tx=0x7fc8bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1bd5c5dc71d773 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8c959a700 1 -- 172.21.15.46:0/1224324855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc009e70 con 0x7fc8cc15db10 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8c959a700 1 -- 172.21.15.46:0/1224324855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc00b860 con 0x7fc8cc15db10 2023-10-07T08:59:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8c959a700 1 -- 172.21.15.46:0/1224324855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00bc00 con 0x7fc8cc15db10 2023-10-07T08:59:09.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1224324855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 msgr2=0x7fc8cc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.308+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1224324855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc069560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0b67f0 tx=0x7fc8bc009250 comp rx=0 tx=0).stop 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1224324855 shutdown_connections 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1224324855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc069560 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1224324855 >> v2:172.21.15.133:3300/0 conn(0x7fc8cc159c60 0x7fc8cc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1224324855 >> 172.21.15.46:0/1224324855 conn(0x7fc8cc068e20 msgr2=0x7fc8cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1224324855 shutdown_connections 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.309+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1224324855 wait complete. 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.310+0000 7fc8d0e5b700 1 Processor -- start 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.310+0000 7fc8d0e5b700 1 -- start start 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.310+0000 7fc8d0e5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc159890 0x7fc8cc152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.310+0000 7fc8d0e5b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8cc159c60 0x7fc8cc0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0cf730 con 0x7fc8cc15db10 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0cd560 con 0x7fc8cc159890 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0cf170 con 0x7fc8cc159c60 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35386/0 (socket says 172.21.15.46:35386) 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1526416667 learned_addr learned my addr 172.21.15.46:0/1526416667 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8c9d9b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8cc159c60 0x7fc8cc0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8ca59c700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc159890 0x7fc8cc152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8cc159c60 msgr2=0x7fc8cc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8cc159c60 0x7fc8cc0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc159890 msgr2=0x7fc8cc152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc159890 0x7fc8cc152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 -- 172.21.15.46:0/1526416667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0094f0 con 0x7fc8cc15db10 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8cad9d700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009290 tx=0x7fc8bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00baa0 con 0x7fc8cc15db10 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc025420 con 0x7fc8cc15db10 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc0cf450 con 0x7fc8cc15db10 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00bc00 con 0x7fc8cc15db10 2023-10-07T08:59:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.311+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc0cd9f0 con 0x7fc8cc15db10 2023-10-07T08:59:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.312+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc0cd6d0 con 0x7fc8cc15db10 2023-10-07T08:59:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.313+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8bc023070 con 0x7fc8cc15db10 2023-10-07T08:59:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.313+0000 7fc8c27fc700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.313+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8bc085ad0 con 0x7fc8cc15db10 2023-10-07T08:59:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.314+0000 7fc8ca59c700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.314+0000 7fc8ca59c700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 0x7fc8ac0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4007fd0 tx=0x7fc8c40016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.318+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8bc052d40 con 0x7fc8cc15db10 2023-10-07T08:59:09.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.554+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8cc0cd3b0 con 0x7fc8cc15db10 2023-10-07T08:59:09.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.555+0000 7fc8c27fc700 1 -- 172.21.15.46:0/1526416667 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fc8bc02a090 con 0x7fc8cc15db10 2023-10-07T08:59:09.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:09.556 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:59:09.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 msgr2=0x7fc8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 0x7fc8ac0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4007fd0 tx=0x7fc8c40016f0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 msgr2=0x7fc8cc15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009290 tx=0x7fc8bc017000 comp rx=0 tx=0).stop 2023-10-07T08:59:09.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 shutdown_connections 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8cc15db10 0x7fc8cc15c0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc159890 0x7fc8cc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 --2- 172.21.15.46:0/1526416667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8cc159c60 0x7fc8cc0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 >> 172.21.15.46:0/1526416667 conn(0x7fc8cc068e20 msgr2=0x7fc8cc1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 shutdown_connections 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.557+0000 7fc8d0e5b700 1 -- 172.21.15.46:0/1526416667 wait complete. 2023-10-07T08:59:09.559 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:59:09.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:09.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.688+0000 7fd88b518700 1 Processor -- start 2023-10-07T08:59:09.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.688+0000 7fd88b518700 1 -- start start 2023-10-07T08:59:09.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd88b518700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd884159890 0x7fd88415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd88b518700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd884069560 0x7fd8840699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd88b518700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd884069ee0 con 0x7fd884159c60 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd88b518700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88415a160 con 0x7fd884159890 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd88b518700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840d13a0 con 0x7fd884069560 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd8892b4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd884159890 0x7fd88415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd888ab3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd884159c60 0x7fd88415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50226/0 (socket says 172.21.15.46:50226) 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd888ab3700 1 -- 172.21.15.46:0/3561555418 learned_addr learned my addr 172.21.15.46:0/3561555418 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.689+0000 7fd889ab5700 1 --2- 172.21.15.46:0/3561555418 >> v2:172.21.15.133:3300/0 conn(0x7fd884069560 0x7fd8840699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd8892b4700 1 -- 172.21.15.46:0/3561555418 >> v2:172.21.15.133:3300/0 conn(0x7fd884069560 msgr2=0x7fd8840699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd8892b4700 1 --2- 172.21.15.46:0/3561555418 >> v2:172.21.15.133:3300/0 conn(0x7fd884069560 0x7fd8840699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd8892b4700 1 -- 172.21.15.46:0/3561555418 >> v1:172.21.15.46:6789/0 conn(0x7fd884159c60 legacy=0x7fd88415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd8892b4700 1 -- 172.21.15.46:0/3561555418 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88415e140 con 0x7fd884159890 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd883fff700 1 -- 172.21.15.46:0/3561555418 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030244578 0 0) 0x7fd884069ee0 con 0x7fd884159c60 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd8892b4700 1 --2- 172.21.15.46:0/3561555418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd88415abd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd88406a890 tx=0x7fd87c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd1d699d57b94fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd883fff700 1 -- 172.21.15.46:0/3561555418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011630 con 0x7fd884159890 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd883fff700 1 -- 172.21.15.46:0/3561555418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c011790 con 0x7fd884159890 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd883fff700 1 -- 172.21.15.46:0/3561555418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011b30 con 0x7fd884159890 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd88b518700 1 -- 172.21.15.46:0/3561555418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 msgr2=0x7fd88415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.690+0000 7fd88b518700 1 --2- 172.21.15.46:0/3561555418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd88415abd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd88406a890 tx=0x7fd87c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 -- 172.21.15.46:0/3561555418 shutdown_connections 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 --2- 172.21.15.46:0/3561555418 >> v2:172.21.15.133:3300/0 conn(0x7fd884069560 0x7fd8840699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 --2- 172.21.15.46:0/3561555418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd88415abd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 -- 172.21.15.46:0/3561555418 >> 172.21.15.46:0/3561555418 conn(0x7fd884068e20 msgr2=0x7fd8840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 -- 172.21.15.46:0/3561555418 shutdown_connections 2023-10-07T08:59:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.691+0000 7fd88b518700 1 -- 172.21.15.46:0/3561555418 wait complete. 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.692+0000 7fd88b518700 1 Processor -- start 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.692+0000 7fd88b518700 1 -- start start 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd884069560 0x7fd88414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd884159c60 0x7fd884155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840cef60 con 0x7fd884159890 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841522b0 con 0x7fd884159c60 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840ce910 con 0x7fd884069560 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56624/0 (socket says 172.21.15.46:56624) 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 -- 172.21.15.46:0/3960215384 learned_addr learned my addr 172.21.15.46:0/3960215384 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd8892b4700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd884069560 0x7fd88414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 -- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd884069560 msgr2=0x7fd88414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd884069560 0x7fd88414c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 -- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd884159c60 msgr2=0x7fd884155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd889ab5700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd884159c60 0x7fd884155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd884159c60 0x7fd884155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 -- 172.21.15.46:0/3960215384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009420 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd888ab3700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c5b0 tx=0x7fd878001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878005b30 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878005c90 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8840cebf0 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007300 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.693+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8840cf930 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.694+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8840ced80 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.695+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd87801b3b0 con 0x7fd884159890 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.695+0000 7fd8817fa700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 0x7fd8700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.695+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd878083a60 con 0x7fd884159890 2023-10-07T08:59:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.695+0000 7fd8892b4700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 0x7fd8700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.696+0000 7fd8892b4700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 0x7fd8700693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd87c003080 tx=0x7fd87c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.699+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd878050cd0 con 0x7fd884159890 2023-10-07T08:59:09.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.938+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8840cfc10 con 0x7fd884159890 2023-10-07T08:59:09.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.938+0000 7fd8817fa700 1 -- 172.21.15.46:0/3960215384 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fd878017070 con 0x7fd884159890 2023-10-07T08:59:09.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:09.939 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3422912710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3422912710},{"type":"v1","addr":"172.21.15.133:6837","nonce":3422912710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1798107044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1798107044},{"type":"v1","addr":"172.21.15.46:6834","nonce":1798107044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2294484781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2294484781},{"type":"v1","addr":"172.21.15.133:6836","nonce":2294484781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:58:37.656841+0000","modified":"2023-10-07T08:58:41.272972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1560537026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1560537026},{"type":"v1","addr":"172.21.15.46:6835","nonce":1560537026}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 msgr2=0x7fd8700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 0x7fd8700693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd87c003080 tx=0x7fd87c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 msgr2=0x7fd8840cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c5b0 tx=0x7fd878001070 comp rx=0 tx=0).stop 2023-10-07T08:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 shutdown_connections 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd870066f30 0x7fd8700693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd884159c60 0x7fd884155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd884069560 0x7fd88414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 --2- 172.21.15.46:0/3960215384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd884159890 0x7fd8840cf3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 >> 172.21.15.46:0/3960215384 conn(0x7fd884068e20 msgr2=0x7fd8840b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 shutdown_connections 2023-10-07T08:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:09.940+0000 7fd88b518700 1 -- 172.21.15.46:0/3960215384 wait complete. 2023-10-07T08:59:09.943 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-10-07T08:59:09.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:10.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.072+0000 7f8472254700 1 Processor -- start 2023-10-07T08:59:10.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.072+0000 7f8472254700 1 -- start start 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.073+0000 7f8472254700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f846c06c0a0 0x7f846c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.073+0000 7f8472254700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c15df50 0x7f846c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f8472254700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c15d7e0 con 0x7f846c06bcd0 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f8472254700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c15dac0 con 0x7f846c06c0a0 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f8472254700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c15aa30 con 0x7f846c15df50 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f846c06c0a0 0x7f846c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f846c06bcd0 0x7f846c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50234/0 (socket says 172.21.15.46:50234) 2023-10-07T08:59:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846b7fe700 1 -- 172.21.15.46:0/876615375 learned_addr learned my addr 172.21.15.46:0/876615375 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846bfff700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c15df50 0x7f846c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 -- 172.21.15.46:0/876615375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c15df50 msgr2=0x7f846c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c15df50 0x7f846c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 -- 172.21.15.46:0/876615375 >> v1:172.21.15.46:6789/0 conn(0x7f846c06bcd0 legacy=0x7f846c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846a7fc700 1 -- 172.21.15.46:0/876615375 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353602492 0 0) 0x7f846c15d7e0 con 0x7f846c06bcd0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 -- 172.21.15.46:0/876615375 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c15ad10 con 0x7f846c06c0a0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846affd700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c0caa90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84600098e0 tx=0x7f84600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a89cbb6cf13f52f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846a7fc700 1 -- 172.21.15.46:0/876615375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000b640 con 0x7f846c06c0a0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846a7fc700 1 -- 172.21.15.46:0/876615375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000b7a0 con 0x7f846c06c0a0 2023-10-07T08:59:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.074+0000 7f846a7fc700 1 -- 172.21.15.46:0/876615375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000bb40 con 0x7f846c06c0a0 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 -- 172.21.15.46:0/876615375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 msgr2=0x7f846c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c0caa90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84600098e0 tx=0x7f84600091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 -- 172.21.15.46:0/876615375 shutdown_connections 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c15df50 0x7f846c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 --2- 172.21.15.46:0/876615375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c0caa90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 -- 172.21.15.46:0/876615375 >> 172.21.15.46:0/876615375 conn(0x7f846c0ce600 msgr2=0x7f846c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 -- 172.21.15.46:0/876615375 shutdown_connections 2023-10-07T08:59:10.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.075+0000 7f8472254700 1 -- 172.21.15.46:0/876615375 wait complete. 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.076+0000 7f8472254700 1 Processor -- start 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.076+0000 7f8472254700 1 -- start start 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c06bcd0 0x7f846c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f846c15df50 0x7f846c0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c62c0 con 0x7f846c06c0a0 2023-10-07T08:59:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c56b0 con 0x7f846c15df50 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f8472254700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c5990 con 0x7f846c06bcd0 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56634/0 (socket says 172.21.15.46:56634) 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 -- 172.21.15.46:0/2632746695 learned_addr learned my addr 172.21.15.46:0/2632746695 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846bfff700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f846c15df50 0x7f846c0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846b7fe700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c06bcd0 0x7f846c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 -- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c06bcd0 msgr2=0x7f846c0c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c06bcd0 0x7f846c0c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 -- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f846c15df50 msgr2=0x7f846c0c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f846c15df50 0x7f846c0c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.077+0000 7f846affd700 1 -- 172.21.15.46:0/2632746695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8460009420 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f846affd700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84600093f0 tx=0x7f8460017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460000bc0 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000b910 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0c5c70 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460025670 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.078+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c14c960 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.079+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c04c3c0 con 0x7f846c06c0a0 2023-10-07T08:59:10.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.079+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8460023070 con 0x7f846c06c0a0 2023-10-07T08:59:10.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.079+0000 7f84537fe700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 0x7f84580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.080+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84600857c0 con 0x7f846c06c0a0 2023-10-07T08:59:10.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.080+0000 7f846b7fe700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 0x7f84580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.080+0000 7f846b7fe700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 0x7f84580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f846c0cad90 tx=0x7f845c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.084+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8460052a30 con 0x7f846c06c0a0 2023-10-07T08:59:10.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.279+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f846c0c6400 con 0x7f846c06c0a0 2023-10-07T08:59:10.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.280+0000 7f84537fe700 1 -- 172.21.15.46:0/2632746695 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f8460056050 con 0x7f846c06c0a0 2023-10-07T08:59:10.280 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:10.281 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:58:39.255395+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:58:35.508869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:58:36.633739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 msgr2=0x7f84580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 0x7f84580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f846c0cad90 tx=0x7f845c009040 comp rx=0 tx=0).stop 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 msgr2=0x7f846c14c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84600093f0 tx=0x7f8460017000 comp rx=0 tx=0).stop 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 shutdown_connections 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8458066f30 0x7f84580693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f846c15df50 0x7f846c0c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f846c06bcd0 0x7f846c0c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 --2- 172.21.15.46:0/2632746695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f846c06c0a0 0x7f846c14c420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 >> 172.21.15.46:0/2632746695 conn(0x7f846c0ce600 msgr2=0x7f846c15c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 shutdown_connections 2023-10-07T08:59:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.282+0000 7f8472254700 1 -- 172.21.15.46:0/2632746695 wait complete. 2023-10-07T08:59:10.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:59:10.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.416+0000 7f4acf2d1700 1 Processor -- start 2023-10-07T08:59:10.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.417+0000 7f4acf2d1700 1 -- start start 2023-10-07T08:59:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.417+0000 7f4acf2d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159890 0x7f4ac815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.417+0000 7f4acf2d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ac8159c60 0x7f4ac815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acf2d1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ac815db10 0x7f4ac8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acf2d1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac815a160 con 0x7f4ac815db10 2023-10-07T08:59:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acf2d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80d13a0 con 0x7f4ac8159c60 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acf2d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac815e140 con 0x7f4ac8159890 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ac815db10 0x7f4ac8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ac815db10 0x7f4ac8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56644/0 (socket says 172.21.15.46:56644) 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 -- 172.21.15.46:0/4129921354 learned_addr learned my addr 172.21.15.46:0/4129921354 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd06d700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159890 0x7f4ac815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acc86c700 1 --2- 172.21.15.46:0/4129921354 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8159c60 0x7f4ac815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 -- 172.21.15.46:0/4129921354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159890 msgr2=0x7f4ac815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159890 0x7f4ac815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 -- 172.21.15.46:0/4129921354 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8159c60 msgr2=0x7f4ac815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 --2- 172.21.15.46:0/4129921354 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8159c60 0x7f4ac815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 -- 172.21.15.46:0/4129921354 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac815a3d0 con 0x7f4ac815db10 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4acd86e700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac815db10 0x7f4ac8069560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80650f0 tx=0x7f4ac0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44deced5ec77fd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4ac7fff700 1 -- 172.21.15.46:0/4129921354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000e070 con 0x7f4ac815db10 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4ac7fff700 1 -- 172.21.15.46:0/4129921354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac000ba50 con 0x7f4ac815db10 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.418+0000 7f4ac7fff700 1 -- 172.21.15.46:0/4129921354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00092e0 con 0x7f4ac815db10 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 -- 172.21.15.46:0/4129921354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac815db10 msgr2=0x7f4ac8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac815db10 0x7f4ac8069560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80650f0 tx=0x7f4ac0009840 comp rx=0 tx=0).stop 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 -- 172.21.15.46:0/4129921354 shutdown_connections 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac815db10 0x7f4ac8069560 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/4129921354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159890 0x7f4ac815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/4129921354 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8159c60 0x7f4ac815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 -- 172.21.15.46:0/4129921354 >> 172.21.15.46:0/4129921354 conn(0x7f4ac8068e20 msgr2=0x7f4ac80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 -- 172.21.15.46:0/4129921354 shutdown_connections 2023-10-07T08:59:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.419+0000 7f4acf2d1700 1 -- 172.21.15.46:0/4129921354 wait complete. 2023-10-07T08:59:10.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.420+0000 7f4acf2d1700 1 Processor -- start 2023-10-07T08:59:10.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.420+0000 7f4acf2d1700 1 -- start start 2023-10-07T08:59:10.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 0x7f4ac80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815db10 0x7f4ac80b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80b2d80 con 0x7f4ac8159890 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80b28f0 con 0x7f4ac815db10 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acf2d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80b1fc0 con 0x7f4ac8159c60 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56656/0 (socket says 172.21.15.46:56656) 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 -- 172.21.15.46:0/2137257436 learned_addr learned my addr 172.21.15.46:0/2137257436 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acc86c700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 0x7f4ac80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd86e700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815db10 0x7f4ac80b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 -- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 msgr2=0x7f4ac80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 0x7f4ac80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 -- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815db10 msgr2=0x7f4ac80b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815db10 0x7f4ac80b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acd06d700 1 -- 172.21.15.46:0/2137257436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009ae0 con 0x7f4ac8159890 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.421+0000 7f4acc86c700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 0x7f4ac80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4acd06d700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d890 tx=0x7f4ab8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800b600 con 0x7f4ac8159890 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab800b760 con 0x7f4ac8159890 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800bae0 con 0x7f4ac8159890 2023-10-07T08:59:10.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac80b22a0 con 0x7f4ac8159890 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.422+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac80b1cb0 con 0x7f4ac8159890 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.423+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac804c3c0 con 0x7f4ac8159890 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.423+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ab801e460 con 0x7f4ac8159890 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.424+0000 7f4ac57fa700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 0x7f4ab4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.424+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ab8084c90 con 0x7f4ac8159890 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.424+0000 7f4acc86c700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 0x7f4ab4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.424+0000 7f4acc86c700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 0x7f4ab4069460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ac816ceb0 tx=0x7f4abc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.428+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ab8051e60 con 0x7f4ac8159890 2023-10-07T08:59:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.664+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4ac80b2bd0 con 0x7f4ac8159890 2023-10-07T08:59:10.665 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T08:59:10.665+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:59:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.668+0000 7f4ac57fa700 1 -- 172.21.15.46:0/2137257436 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ab8055480 con 0x7f4ac8159890 2023-10-07T08:59:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 msgr2=0x7f4ab4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 0x7f4ab4069460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ac816ceb0 tx=0x7f4abc008040 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 msgr2=0x7f4ac8158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d890 tx=0x7f4ab8008040 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 shutdown_connections 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ab4066fb0 0x7f4ab4069460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815db10 0x7f4ac80b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8159890 0x7f4ac8158900 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 --2- 172.21.15.46:0/2137257436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8159c60 0x7f4ac80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 >> 172.21.15.46:0/2137257436 conn(0x7f4ac8068e20 msgr2=0x7f4ac815cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 shutdown_connections 2023-10-07T08:59:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.671+0000 7f4acf2d1700 1 -- 172.21.15.46:0/2137257436 wait complete. 2023-10-07T08:59:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:59:10.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:59:10.695 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T08:59:10.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.807+0000 7f268ab5f700 1 Processor -- start 2023-10-07T08:59:10.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.807+0000 7f268ab5f700 1 -- start start 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f268ab5f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2684159890 0x7f268415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f268ab5f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 0x7f268415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f268ab5f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268415a160 con 0x7f268415db10 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f268ab5f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268415df50 con 0x7f2684159890 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f268ab5f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26840d13a0 con 0x7f2684159c60 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2684159890 0x7f268415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2684159890 0x7f268415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56680/0 (socket says 172.21.15.46:56680) 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 -- 172.21.15.46:0/3038861990 learned_addr learned my addr 172.21.15.46:0/3038861990 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f2683fff700 1 --2- 172.21.15.46:0/3038861990 >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 0x7f268415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 -- 172.21.15.46:0/3038861990 >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 msgr2=0x7f268415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 --2- 172.21.15.46:0/3038861990 >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 0x7f268415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 -- 172.21.15.46:0/3038861990 >> v1:172.21.15.133:6789/0 conn(0x7f268415db10 legacy=0x7f2684069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 -- 172.21.15.46:0/3038861990 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268415e140 con 0x7f2684159890 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f2683fff700 1 --2- 172.21.15.46:0/3038861990 >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 0x7f268415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.808+0000 7f26888fb700 1 --2- 172.21.15.46:0/3038861990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159890 0x7f268415abd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26840b67f0 tx=0x7f2678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835e6170c5270e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f26837fe700 1 -- 172.21.15.46:0/3038861990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267800b860 con 0x7f2684159890 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f26837fe700 1 -- 172.21.15.46:0/3038861990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267800b9c0 con 0x7f2684159890 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f26837fe700 1 -- 172.21.15.46:0/3038861990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267800bd60 con 0x7f2684159890 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 -- 172.21.15.46:0/3038861990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159890 msgr2=0x7f268415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3038861990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159890 0x7f268415abd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26840b67f0 tx=0x7f2678009250 comp rx=0 tx=0).stop 2023-10-07T08:59:10.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 -- 172.21.15.46:0/3038861990 shutdown_connections 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3038861990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159890 0x7f268415abd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3038861990 >> v2:172.21.15.133:3300/0 conn(0x7f2684159c60 0x7f268415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 -- 172.21.15.46:0/3038861990 >> 172.21.15.46:0/3038861990 conn(0x7f2684068e20 msgr2=0x7f26840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 -- 172.21.15.46:0/3038861990 shutdown_connections 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.809+0000 7f268ab5f700 1 -- 172.21.15.46:0/3038861990 wait complete. 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.810+0000 7f268ab5f700 1 Processor -- start 2023-10-07T08:59:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.810+0000 7f268ab5f700 1 -- start start 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2684159890 0x7f26840cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268415db10 0x7f26840b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840ca050 con 0x7f2684159c60 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684145ac0 con 0x7f268415db10 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f268ab5f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c93d0 con 0x7f2684159890 2023-10-07T08:59:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f2683fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f2683fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56694/0 (socket says 172.21.15.46:56694) 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f2683fff700 1 -- 172.21.15.46:0/3754942374 learned_addr learned my addr 172.21.15.46:0/3754942374 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f26888fb700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2684159890 0x7f26840cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.811+0000 7f26890fc700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268415db10 0x7f26840b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 -- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2684159890 msgr2=0x7f26840cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2684159890 0x7f26840cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 -- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268415db10 msgr2=0x7f26840b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268415db10 0x7f26840b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 -- 172.21.15.46:0/3754942374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780094f0 con 0x7f2684159c60 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2683fff700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f267000e8d0 tx=0x7f2670008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670013410 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670013570 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26840c96b0 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670013910 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.812+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26840c9c70 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.813+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26840ca190 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.813+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2670013d00 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.814+0000 7f2680ff9700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 0x7f26680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.814+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2670084280 con 0x7f2684159c60 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.814+0000 7f26888fb700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 0x7f26680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.814+0000 7f26888fb700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 0x7f26680693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26840b67f0 tx=0x7f2678017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:10.818+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26840ca190 con 0x7f2684159c60 2023-10-07T08:59:11.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.056+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f26840ca190 con 0x7f2684159c60 2023-10-07T08:59:11.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:59:11.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:59:11.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.669+0000 7f2680ff9700 1 -- 172.21.15.46:0/3754942374 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26840ca190 con 0x7f2684159c60 2023-10-07T08:59:11.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 msgr2=0x7f26680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 0x7f26680693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26840b67f0 tx=0x7f2678017000 comp rx=0 tx=0).stop 2023-10-07T08:59:11.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 msgr2=0x7f26840c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f267000e8d0 tx=0x7f2670008040 comp rx=0 tx=0).stop 2023-10-07T08:59:11.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 shutdown_connections 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2668066f30 0x7f26680693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f268415db10 0x7f26840b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2684159890 0x7f26840cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 --2- 172.21.15.46:0/3754942374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2684159c60 0x7f26840c8a60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 >> 172.21.15.46:0/3754942374 conn(0x7f2684068e20 msgr2=0x7f26841530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:11.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 shutdown_connections 2023-10-07T08:59:11.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.672+0000 7f268ab5f700 1 -- 172.21.15.46:0/3754942374 wait complete. 2023-10-07T08:59:11.687 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:59:11.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 Processor -- start 2023-10-07T08:59:11.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 -- start start 2023-10-07T08:59:11.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b03c0 0x7f25c40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25c41591e0 0x7f25c4159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c40cfa00 con 0x7f25c40b0790 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40cb580 con 0x7f25c41591e0 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.813+0000 7f25c8c14700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40cf160 con 0x7f25c40b03c0 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25c41591e0 0x7f25c4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25c41591e0 0x7f25c4159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56708/0 (socket says 172.21.15.46:56708) 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 -- 172.21.15.46:0/3270972411 learned_addr learned my addr 172.21.15.46:0/3270972411 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c37fe700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b03c0 0x7f25c40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 -- 172.21.15.46:0/3270972411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b03c0 msgr2=0x7f25c40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b03c0 0x7f25c40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 -- 172.21.15.46:0/3270972411 >> v1:172.21.15.133:6789/0 conn(0x7f25c40b0790 legacy=0x7f25c40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 -- 172.21.15.46:0/3270972411 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40cf440 con 0x7f25c41591e0 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c3fff700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c4159620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009f20 tx=0x7f25bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1d257a089d0414 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c27fc700 1 -- 172.21.15.46:0/3270972411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00e070 con 0x7f25c41591e0 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c27fc700 1 -- 172.21.15.46:0/3270972411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00ba80 con 0x7f25c41591e0 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.814+0000 7f25c27fc700 1 -- 172.21.15.46:0/3270972411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0092e0 con 0x7f25c41591e0 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 -- 172.21.15.46:0/3270972411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 msgr2=0x7f25c4159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c4159620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009f20 tx=0x7f25bc009840 comp rx=0 tx=0).stop 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 -- 172.21.15.46:0/3270972411 shutdown_connections 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c4159620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 --2- 172.21.15.46:0/3270972411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b03c0 0x7f25c40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 -- 172.21.15.46:0/3270972411 >> 172.21.15.46:0/3270972411 conn(0x7f25c4063230 msgr2=0x7f25c4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:11.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 -- 172.21.15.46:0/3270972411 shutdown_connections 2023-10-07T08:59:11.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.815+0000 7f25c8c14700 1 -- 172.21.15.46:0/3270972411 wait complete. 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.816+0000 7f25c8c14700 1 Processor -- start 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.816+0000 7f25c8c14700 1 -- start start 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c40b03c0 0x7f25c40c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b0790 0x7f25c40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c8af0 con 0x7f25c41591e0 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4157d70 con 0x7f25c40b03c0 2023-10-07T08:59:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c8c14700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c4f40 con 0x7f25c40b0790 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c40b03c0 0x7f25c40c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56714/0 (socket says 172.21.15.46:56714) 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 -- 172.21.15.46:0/2186134359 learned_addr learned my addr 172.21.15.46:0/2186134359 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c2ffd700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b0790 0x7f25c40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 -- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b0790 msgr2=0x7f25c40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b0790 0x7f25c40c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 -- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c40b03c0 msgr2=0x7f25c40c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c40b03c0 0x7f25c40c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 -- 172.21.15.46:0/2186134359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009ae0 con 0x7f25c41591e0 2023-10-07T08:59:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.817+0000 7f25c3fff700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25c40cfe40 tx=0x7f25bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.818+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0032f0 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.818+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc008d20 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.818+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40c5910 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.818+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc026690 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.818+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c4610 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.819+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c404c3c0 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.819+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25bc003040 con 0x7f25c41591e0 2023-10-07T08:59:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.819+0000 7f25ab7fe700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:11.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.820+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f25bc086520 con 0x7f25c41591e0 2023-10-07T08:59:11.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.820+0000 7f25c37fe700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:11.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.820+0000 7f25c37fe700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 0x7f25b00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:11.824+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25bc053740 con 0x7f25c41591e0 2023-10-07T08:59:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.016+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25c40c5080 con 0x7f25c41591e0 2023-10-07T08:59:12.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.908+0000 7f25ab7fe700 1 -- 172.21.15.46:0/2186134359 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f25bc056d60 con 0x7f25c41591e0 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 msgr2=0x7f25b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 0x7f25b00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b8008040 comp rx=0 tx=0).stop 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 msgr2=0x7f25c415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25c40cfe40 tx=0x7f25bc018000 comp rx=0 tx=0).stop 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 shutdown_connections 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f25b0066f30 0x7f25b00693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c41591e0 0x7f25c415aab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c40b03c0 0x7f25c40c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 --2- 172.21.15.46:0/2186134359 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25c40b0790 0x7f25c40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:12.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 >> 172.21.15.46:0/2186134359 conn(0x7f25c4063230 msgr2=0x7f25c40b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:12.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.913+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 shutdown_connections 2023-10-07T08:59:12.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:12.914+0000 7f25c8c14700 1 -- 172.21.15.46:0/2186134359 wait complete. 2023-10-07T08:59:12.916 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:59:12.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:59:13.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.061+0000 7f6ed05b8700 1 Processor -- start 2023-10-07T08:59:13.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.061+0000 7f6ed05b8700 1 -- start start 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.062+0000 7f6ed05b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.062+0000 7f6ed05b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.062+0000 7f6ed05b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80b4570 con 0x7f6ec8154320 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.062+0000 7f6ed05b8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec815a730 con 0x7f6ec806d840 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.062+0000 7f6ed05b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec815aa10 con 0x7f6ec8153f50 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6eceb55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:38822/0 (socket says 172.21.15.46:38822) 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6eceb55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33136/0 (socket says 172.21.15.46:33136) 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ecdb53700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6ec8154320 0x7f6ec806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:47484/0 (socket says 172.21.15.46:47484) 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 -- 172.21.15.46:0/748544162 learned_addr learned my addr 172.21.15.46:0/748544162 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 -- 172.21.15.46:0/748544162 >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 msgr2=0x7f6ec8069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 --2- 172.21.15.46:0/748544162 >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 -- 172.21.15.46:0/748544162 >> v1:172.21.15.133:6789/0 conn(0x7f6ec8154320 legacy=0x7f6ec806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ecd352700 1 -- 172.21.15.46:0/748544162 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564649680 0 0) 0x7f6ec80b4570 con 0x7f6ec8154320 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 -- 172.21.15.46:0/748544162 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec815acf0 con 0x7f6ec8153f50 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6eceb55700 1 --2- 172.21.15.46:0/748544162 >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ece354700 1 --2- 172.21.15.46:0/748544162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009f20 tx=0x7f6ec0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79fd576de6fa552c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ecd352700 1 -- 172.21.15.46:0/748544162 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000e070 con 0x7f6ec8153f50 2023-10-07T08:59:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ecd352700 1 -- 172.21.15.46:0/748544162 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000b9d0 con 0x7f6ec8153f50 2023-10-07T08:59:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.063+0000 7f6ecd352700 1 -- 172.21.15.46:0/748544162 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00092e0 con 0x7f6ec8153f50 2023-10-07T08:59:13.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 -- 172.21.15.46:0/748544162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 msgr2=0x7f6ec80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/748544162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009f20 tx=0x7f6ec0009840 comp rx=0 tx=0).stop 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 -- 172.21.15.46:0/748544162 shutdown_connections 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/748544162 >> v2:172.21.15.133:3300/0 conn(0x7f6ec806d840 0x7f6ec8069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/748544162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8153f50 0x7f6ec80b2000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 -- 172.21.15.46:0/748544162 >> 172.21.15.46:0/748544162 conn(0x7f6ec806baf0 msgr2=0x7f6ec806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 -- 172.21.15.46:0/748544162 shutdown_connections 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.064+0000 7f6ed05b8700 1 -- 172.21.15.46:0/748544162 wait complete. 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.065+0000 7f6ed05b8700 1 Processor -- start 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.065+0000 7f6ed05b8700 1 -- start start 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec8153f50 0x7f6ec8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8154320 0x7f6ec8169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80aea90 con 0x7f6ec806d840 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80af610 con 0x7f6ec8153f50 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ed05b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80aece0 con 0x7f6ec8154320 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56720/0 (socket says 172.21.15.46:56720) 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 -- 172.21.15.46:0/2419669983 learned_addr learned my addr 172.21.15.46:0/2419669983 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ecdb53700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec8153f50 0x7f6ec8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6eceb55700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8154320 0x7f6ec8169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 -- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8154320 msgr2=0x7f6ec8169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8154320 0x7f6ec8169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 -- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec8153f50 msgr2=0x7f6ec8153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.066+0000 7f6ece354700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec8153f50 0x7f6ec8153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ece354700 1 -- 172.21.15.46:0/2419669983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8009420 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ece354700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ec815ab50 tx=0x7f6ec0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0008a60 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec0009ae0 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0008be0 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0026460 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.067+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80af2a0 con 0x7f6ec806d840 2023-10-07T08:59:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.068+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec806e360 con 0x7f6ec806d840 2023-10-07T08:59:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.068+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ec0003040 con 0x7f6ec806d840 2023-10-07T08:59:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.069+0000 7f6ec67fc700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 0x7f6eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.069+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f6ec0086150 con 0x7f6ec806d840 2023-10-07T08:59:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.069+0000 7f6ecdb53700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 0x7f6eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.069+0000 7f6ecdb53700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 0x7f6eb40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80cd740 tx=0x7f6ebc007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:13.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.073+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ec00535e0 con 0x7f6ec806d840 2023-10-07T08:59:13.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.266+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ec80718b0 con 0x7f6ec806d840 2023-10-07T08:59:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.915+0000 7f6ec67fc700 1 -- 172.21.15.46:0/2419669983 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ec0056c00 con 0x7f6ec806d840 2023-10-07T08:59:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.919+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 msgr2=0x7f6eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.919+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 0x7f6eb40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80cd740 tx=0x7f6ebc007ef0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.919+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 msgr2=0x7f6ec80cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.919+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ec815ab50 tx=0x7f6ec0018000 comp rx=0 tx=0).stop 2023-10-07T08:59:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.919+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 shutdown_connections 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6eb4066f30 0x7f6eb40693e0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80cd740 tx=0x7f6ebc007ef0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ec8154320 0x7f6ec8169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ec806d840 0x7f6ec80cc8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 --2- 172.21.15.46:0/2419669983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec8153f50 0x7f6ec8153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 >> 172.21.15.46:0/2419669983 conn(0x7f6ec806baf0 msgr2=0x7f6ec8159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 shutdown_connections 2023-10-07T08:59:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:13.920+0000 7f6ed05b8700 1 -- 172.21.15.46:0/2419669983 wait complete. 2023-10-07T08:59:13.923 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T08:59:13.938 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:59:13.938 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:59:13.938 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:59:13.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:13.938 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:59:13.938 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:59:13.939 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:59:13.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:13.939 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:59:13.939 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:59:13.939 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:59:13.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:13.939 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:59:13.940 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:59:13.940 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:59:13.940 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:13.948 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:59:13.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:59:13.949 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:59:13.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:59:13.950 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:59:13.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:59:13.951 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:59:13.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:59:13.991 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:59:13.991 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:13.991 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:59:13.992 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:13.993 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:59:13.994 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:13.994 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:59:13.994 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:13.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:59:14.072 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T08:59:14.073 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T08:59:14.073 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T08:59:14.073 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T08:59:14.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.124+0000 7fb971732700 1 Processor -- start 2023-10-07T08:59:14.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.124+0000 7fb971732700 1 -- start start 2023-10-07T08:59:14.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb971732700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb96c154110 0x7fb96c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb971732700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 0x7fb96c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb971732700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c06eb00 con 0x7fb96c157270 2023-10-07T08:59:14.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb971732700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c157d40 con 0x7fb96c154110 2023-10-07T08:59:14.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb971732700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c06e4f0 con 0x7fb96c1544e0 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb96c154110 0x7fb96c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb96c154110 0x7fb96c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56746/0 (socket says 172.21.15.46:56746) 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 -- 172.21.15.46:0/1231378776 learned_addr learned my addr 172.21.15.46:0/1231378776 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96b7fe700 1 --2- 172.21.15.46:0/1231378776 >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 0x7fb96c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 -- 172.21.15.46:0/1231378776 >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 msgr2=0x7fb96c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 --2- 172.21.15.46:0/1231378776 >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 0x7fb96c0c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 -- 172.21.15.46:0/1231378776 >> v1:172.21.15.133:6789/0 conn(0x7fb96c157270 legacy=0x7fb96c06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:14.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96affd700 1 -- 172.21.15.46:0/1231378776 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c157780 con 0x7fb96c154110 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.125+0000 7fb96b7fe700 1 --2- 172.21.15.46:0/1231378776 >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 0x7fb96c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb96affd700 1 --2- 172.21.15.46:0/1231378776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c154110 0x7fb96c156d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb96c06ea70 tx=0x7fb95c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed098d2367ffbc0a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb969ffb700 1 -- 172.21.15.46:0/1231378776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00dc10 con 0x7fb96c154110 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb969ffb700 1 -- 172.21.15.46:0/1231378776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00dd70 con 0x7fb96c154110 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb969ffb700 1 -- 172.21.15.46:0/1231378776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0106c0 con 0x7fb96c154110 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 -- 172.21.15.46:0/1231378776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c154110 msgr2=0x7fb96c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 --2- 172.21.15.46:0/1231378776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c154110 0x7fb96c156d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb96c06ea70 tx=0x7fb95c00b4f0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 -- 172.21.15.46:0/1231378776 shutdown_connections 2023-10-07T08:59:14.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 --2- 172.21.15.46:0/1231378776 >> v2:172.21.15.133:3300/0 conn(0x7fb96c1544e0 0x7fb96c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 --2- 172.21.15.46:0/1231378776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c154110 0x7fb96c156d30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 -- 172.21.15.46:0/1231378776 >> 172.21.15.46:0/1231378776 conn(0x7fb96c0cc1e0 msgr2=0x7fb96c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 -- 172.21.15.46:0/1231378776 shutdown_connections 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.126+0000 7fb971732700 1 -- 172.21.15.46:0/1231378776 wait complete. 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.127+0000 7fb971732700 1 Processor -- start 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 -- start start 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 0x7fb96c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 0x7fb96c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c16a650 con 0x7fb96c1544e0 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c169d40 con 0x7fb96c154110 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb971732700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c156ef0 con 0x7fb96c157270 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb96a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb96a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56750/0 (socket says 172.21.15.46:56750) 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.128+0000 7fb96a7fc700 1 -- 172.21.15.46:0/2660210446 learned_addr learned my addr 172.21.15.46:0/2660210446 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96affd700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 0x7fb96c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96b7fe700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 0x7fb96c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 -- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 msgr2=0x7fb96c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 0x7fb96c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 -- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 msgr2=0x7fb96c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 0x7fb96c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 -- 172.21.15.46:0/2660210446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c00b790 con 0x7fb96c1544e0 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96affd700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 0x7fb96c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96b7fe700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 0x7fb96c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb96a7fc700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb95400b5e0 tx=0x7fb9540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400f510 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400f6b0 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c16a000 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400fa70 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.129+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c150260 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.130+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c16a800 con 0x7fb96c1544e0 2023-10-07T08:59:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.130+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb95401a400 con 0x7fb96c1544e0 2023-10-07T08:59:14.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.131+0000 7fb962ffd700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:14.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.131+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb954083d50 con 0x7fb96c1544e0 2023-10-07T08:59:14.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.131+0000 7fb96affd700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:14.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.131+0000 7fb96affd700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 0x7fb94c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb96c06ea70 tx=0x7fb95c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:14.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.135+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb96c16a800 con 0x7fb96c1544e0 2023-10-07T08:59:14.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:14.354+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb96c04c3c0 con 0x7fb96c1544e0 2023-10-07T08:59:15.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.891+0000 7fb962ffd700 1 -- 172.21.15.46:0/2660210446 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb954087030 con 0x7fb96c1544e0 2023-10-07T08:59:15.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 msgr2=0x7fb94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 0x7fb94c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb96c06ea70 tx=0x7fb95c01a000 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 msgr2=0x7fb96c1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb95400b5e0 tx=0x7fb9540090f0 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 shutdown_connections 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb96c157270 0x7fb96c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb96c154110 0x7fb96c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 --2- 172.21.15.46:0/2660210446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb96c1544e0 0x7fb96c1564a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 >> 172.21.15.46:0/2660210446 conn(0x7fb96c0cc1e0 msgr2=0x7fb96c06ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 shutdown_connections 2023-10-07T08:59:15.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:15.894+0000 7fb971732700 1 -- 172.21.15.46:0/2660210446 wait complete. 2023-10-07T08:59:15.897 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T08:59:15.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:59:16.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.036+0000 7fb60da78700 1 Processor -- start 2023-10-07T08:59:16.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.036+0000 7fb60da78700 1 -- start start 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb60da78700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb60815d730 0x7fb60815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb60da78700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080c74b0 con 0x7fb608159b10 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb60da78700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60815e0e0 con 0x7fb60806a410 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb60da78700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080c8700 con 0x7fb60815d730 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb6077fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb608159b10 0x7fb6080cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50262/0 (socket says 172.21.15.46:50262) 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.037+0000 7fb6077fe700 1 -- 172.21.15.46:0/4111982837 learned_addr learned my addr 172.21.15.46:0/4111982837 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb606ffd700 1 --2- 172.21.15.46:0/4111982837 >> v2:172.21.15.133:3300/0 conn(0x7fb60815d730 0x7fb60815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85455899 0 0) 0x7fb6080c74b0 con 0x7fb608159b10 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f0003570 con 0x7fb608159b10 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086423900 0 0) 0x7fb5f0003570 con 0x7fb608159b10 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 >> v2:172.21.15.133:3300/0 conn(0x7fb60815d730 msgr2=0x7fb60815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 --2- 172.21.15.46:0/4111982837 >> v2:172.21.15.133:3300/0 conn(0x7fb60815d730 0x7fb60815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 >> v1:172.21.15.133:6789/0 conn(0x7fb60806a410 legacy=0x7fb60806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080c9070 con 0x7fb608159b10 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb5f8001470 con 0x7fb608159b10 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 >> v1:172.21.15.46:6789/0 conn(0x7fb608159b10 legacy=0x7fb6080cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0003ab0 0x7fb5f0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 0x7fb5f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0005210 0x7fb5f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c8700 con 0x7fb5f0004810 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f000c130 con 0x7fb5f0003ab0 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f000c2f0 con 0x7fb5f0005210 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb606ffd700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 0x7fb5f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb6077fe700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0003ab0 0x7fb5f0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.038+0000 7fb607fff700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0005210 0x7fb5f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 -- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0005210 msgr2=0x7fb5f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0005210 0x7fb5f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 -- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0003ab0 msgr2=0x7fb5f0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0003ab0 0x7fb5f0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 -- 172.21.15.46:0/4111982837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0003570 con 0x7fb5f0004810 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb607fff700 1 -- 172.21.15.46:0/4111982837 reap_dead start 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb606ffd700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 0x7fb5f0004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009c00 tx=0x7fb5fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aee68c8288afbdd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00e710 con 0x7fb5f0004810 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00e870 con 0x7fb5f0004810 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb6067fc700 1 -- 172.21.15.46:0/4111982837 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00ec30 con 0x7fb5f0004810 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb60da78700 1 -- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 msgr2=0x7fb5f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb60da78700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 0x7fb5f0004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009c00 tx=0x7fb5fc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb60da78700 1 -- 172.21.15.46:0/4111982837 shutdown_connections 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb60da78700 1 --2- 172.21.15.46:0/4111982837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0004810 0x7fb5f0004c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.039+0000 7fb60da78700 1 -- 172.21.15.46:0/4111982837 >> 172.21.15.46:0/4111982837 conn(0x7fb6080c9870 msgr2=0x7fb6080c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.040+0000 7fb60da78700 1 -- 172.21.15.46:0/4111982837 shutdown_connections 2023-10-07T08:59:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.040+0000 7fb60da78700 1 -- 172.21.15.46:0/4111982837 wait complete. 2023-10-07T08:59:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.041+0000 7fb60da78700 1 Processor -- start 2023-10-07T08:59:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.041+0000 7fb60da78700 1 -- start start 2023-10-07T08:59:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.041+0000 7fb60da78700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 0x7fb6080c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.041+0000 7fb60da78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.041+0000 7fb60da78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6080c2600 0x7fb6080c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb60da78700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60815b7d0 con 0x7fb60815b010 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb60da78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c2fb0 con 0x7fb6080c2600 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb60da78700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60815a9b0 con 0x7fb5f0004810 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56776/0 (socket says 172.21.15.46:56776) 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 -- 172.21.15.46:0/2064885598 learned_addr learned my addr 172.21.15.46:0/2064885598 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb607fff700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6080c2600 0x7fb6080c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb6077fe700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 0x7fb6080c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 -- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 msgr2=0x7fb6080c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 0x7fb6080c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 -- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6080c2600 msgr2=0x7fb6080c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6080c2600 0x7fb6080c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 -- 172.21.15.46:0/2064885598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608146e00 con 0x7fb60815b010 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb6077fe700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 0x7fb6080c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb606ffd700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00057d0 tx=0x7fb5fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc022070 con 0x7fb60815b010 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00e9e0 con 0x7fb60815b010 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60815a080 con 0x7fb60815b010 2023-10-07T08:59:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc027470 con 0x7fb60815b010 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.042+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60815a640 con 0x7fb60815b010 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.043+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60804c3c0 con 0x7fb60815b010 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.044+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5fc0278a0 con 0x7fb60815b010 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.044+0000 7fb5ef7fe700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 0x7fb5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.044+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb5fc085d70 con 0x7fb60815b010 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.044+0000 7fb6077fe700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 0x7fb5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.045+0000 7fb6077fe700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 0x7fb5f40693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80015a0 tx=0x7fb5f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.048+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5fc0533e0 con 0x7fb60815b010 2023-10-07T08:59:16.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.320+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb60815aaf0 con 0x7fb60815b010 2023-10-07T08:59:16.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.321+0000 7fb5ef7fe700 1 -- 172.21.15.46:0/2064885598 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb5fc056a00 con 0x7fb60815b010 2023-10-07T08:59:16.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.322 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.323 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T08:59:16.324 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.325 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T08:59:16.327 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.328 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.329 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T08:59:16.330 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:16.331 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T08:59:16.334 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mds", 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFl4vu9BhAAkeX5JcgeUTArvUcFCNn//g==", 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mds" 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.335 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mgr", 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFl6wW+BhAApbBjfzsw96ooogQ9JJdz9Q==", 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-osd", 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFlaRK+BhAAJU58Fxq/+pGhcYEyRRZgBw==", 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.336 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-osd" 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd", 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFlYRu+BhAAhyhHSwVHaDa6echrBys9Tg==", 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFlsyS+BhAARsD8I7aPjSMS0YaaVurqzA==", 2023-10-07T08:59:16.337 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rgw", 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCsHSFlii2+BhAAFmEhiUUK8bQM2BfQgI5deg==", 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T08:59:16.340 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:16.340 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.340 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:16.340 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T08:59:16.340 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T08:59:16.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 msgr2=0x7fb5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 0x7fb5f40693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80015a0 tx=0x7fb5f8009040 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 msgr2=0x7fb6081468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00057d0 tx=0x7fb5fc01a000 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 shutdown_connections 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5f4066f30 0x7fb5f40693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6080c2600 0x7fb6080c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f0004810 0x7fb6080c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 --2- 172.21.15.46:0/2064885598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb60815b010 0x7fb6081468c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 >> 172.21.15.46:0/2064885598 conn(0x7fb6080c9870 msgr2=0x7fb608158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 shutdown_connections 2023-10-07T08:59:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.323+0000 7fb60da78700 1 -- 172.21.15.46:0/2064885598 wait complete. 2023-10-07T08:59:16.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-07T08:59:16.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.461+0000 7f0557415700 1 Processor -- start 2023-10-07T08:59:16.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.461+0000 7f0557415700 1 -- start start 2023-10-07T08:59:16.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.462+0000 7f0557415700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0550157960 0x7f05500af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.462+0000 7f0557415700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 0x7f0550157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.462+0000 7f0557415700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055006b030 con 0x7f055006b4d0 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.462+0000 7f0557415700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500ac760 con 0x7f0550157960 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.462+0000 7f0557415700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500af830 con 0x7f055006b970 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0550157960 0x7f05500af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05549b0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f055006b4d0 0x7f0550068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:47534/0 (socket says 172.21.15.46:47534) 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05559b2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 0x7f0550157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05549b0700 1 -- 172.21.15.46:0/64263772 learned_addr learned my addr 172.21.15.46:0/64263772 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 -- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 msgr2=0x7f0550157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 0x7f0550157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 -- 172.21.15.46:0/64263772 >> v1:172.21.15.133:6789/0 conn(0x7f055006b4d0 legacy=0x7f0550068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 -- 172.21.15.46:0/64263772 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500c7f60 con 0x7f0550157960 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05559b2700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 0x7f0550157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f054ffff700 1 -- 172.21.15.46:0/64263772 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505661538 0 0) 0x7f055006b030 con 0x7f055006b4d0 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.463+0000 7f05551b1700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500af250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0540009e60 tx=0x7f0540009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc80cbf9a59f56f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f054ffff700 1 -- 172.21.15.46:0/64263772 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000e070 con 0x7f0550157960 2023-10-07T08:59:16.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f054ffff700 1 -- 172.21.15.46:0/64263772 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000bb60 con 0x7f0550157960 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f054ffff700 1 -- 172.21.15.46:0/64263772 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540012430 con 0x7f0550157960 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 -- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 msgr2=0x7f05500af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500af250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0540009e60 tx=0x7f0540009780 comp rx=0 tx=0).stop 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 -- 172.21.15.46:0/64263772 shutdown_connections 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b970 0x7f0550157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 --2- 172.21.15.46:0/64263772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500af250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 -- 172.21.15.46:0/64263772 >> 172.21.15.46:0/64263772 conn(0x7f05500c9870 msgr2=0x7f05500c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 -- 172.21.15.46:0/64263772 shutdown_connections 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.464+0000 7f0557415700 1 -- 172.21.15.46:0/64263772 wait complete. 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.465+0000 7f0557415700 1 Processor -- start 2023-10-07T08:59:16.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.465+0000 7f0557415700 1 -- start start 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b4d0 0x7f055016d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055016e3c0 con 0x7f055006b970 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055016db20 con 0x7f0550157960 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f0557415700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055016de00 con 0x7f055006b4d0 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f05549b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f05549b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56788/0 (socket says 172.21.15.46:56788) 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f05549b0700 1 -- 172.21.15.46:0/1270182760 learned_addr learned my addr 172.21.15.46:0/1270182760 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:16.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f05559b2700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.466+0000 7f05551b1700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b4d0 0x7f055016d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 -- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b4d0 msgr2=0x7f055016d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b4d0 0x7f055016d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 -- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 msgr2=0x7f05500ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 -- 172.21.15.46:0/1270182760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009420 con 0x7f055006b970 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f05549b0700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f054400c5b0 tx=0x7f0544001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544005b30 con 0x7f055006b970 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0544005c90 con 0x7f055006b970 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540009a20 con 0x7f055006b970 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544007300 con 0x7f055006b970 2023-10-07T08:59:16.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.467+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055016a160 con 0x7f055006b970 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.468+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055016a380 con 0x7f055006b970 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.468+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f054401b3b0 con 0x7f055006b970 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.469+0000 7f054d7fa700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 0x7f053c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.469+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f05440836c0 con 0x7f055006b970 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.469+0000 7f05551b1700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 0x7f053c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.469+0000 7f05551b1700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 0x7f053c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05500b2c40 tx=0x7f0540019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.473+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0544050d40 con 0x7f055006b970 2023-10-07T08:59:16.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.744+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f055004c3c0 con 0x7f055006b970 2023-10-07T08:59:16.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.748+0000 7f054d7fa700 1 -- 172.21.15.46:0/1270182760 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0544054360 con 0x7f055006b970 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 msgr2=0x7f053c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 0x7f053c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05500b2c40 tx=0x7f0540019000 comp rx=0 tx=0).stop 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 msgr2=0x7f05500ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f054400c5b0 tx=0x7f0544001070 comp rx=0 tx=0).stop 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 shutdown_connections 2023-10-07T08:59:16.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f053c066f30 0x7f053c0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0550157960 0x7f05500ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f055006b4d0 0x7f055016d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 --2- 172.21.15.46:0/1270182760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055006b970 0x7f05500ae2e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 >> 172.21.15.46:0/1270182760 conn(0x7f05500c9870 msgr2=0x7f0550069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 shutdown_connections 2023-10-07T08:59:16.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.750+0000 7f0557415700 1 -- 172.21.15.46:0/1270182760 wait complete. 2023-10-07T08:59:16.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-07T08:59:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.881+0000 7fd2aa58f700 1 Processor -- start 2023-10-07T08:59:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.881+0000 7fd2aa58f700 1 -- start start 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2aa58f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2a4159890 0x7fd2a415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2aa58f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 0x7fd2a415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2aa58f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a415a160 con 0x7fd2a415db10 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2aa58f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a40d13a0 con 0x7fd2a4159890 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2aa58f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a415e140 con 0x7fd2a4159c60 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2a8b2c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd2a415db10 0x7fd2a4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50266/0 (socket says 172.21.15.46:50266) 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2a8b2c700 1 -- 172.21.15.46:0/1881301541 learned_addr learned my addr 172.21.15.46:0/1881301541 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:16.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.882+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/1881301541 >> v2:172.21.15.133:3300/0 conn(0x7fd2a4159890 0x7fd2a415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a37fe700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 0x7fd2a415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a2ffd700 1 -- 172.21.15.46:0/1881301541 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799075756 0 0) 0x7fd2a415a160 con 0x7fd2a415db10 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a2ffd700 1 -- 172.21.15.46:0/1881301541 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c003570 con 0x7fd2a415db10 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a3fff700 1 -- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 msgr2=0x7fd2a415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 0x7fd2a415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a3fff700 1 -- 172.21.15.46:0/1881301541 >> v1:172.21.15.46:6789/0 conn(0x7fd2a415db10 legacy=0x7fd2a4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a3fff700 1 -- 172.21.15.46:0/1881301541 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a415a3d0 con 0x7fd2a4159890 2023-10-07T08:59:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a37fe700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 0x7fd2a415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a415abd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2940098e0 tx=0x7fd2940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a63a0e0fc449c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a2ffd700 1 -- 172.21.15.46:0/1881301541 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294011630 con 0x7fd2a4159890 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a2ffd700 1 -- 172.21.15.46:0/1881301541 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294011790 con 0x7fd2a4159890 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.883+0000 7fd2a2ffd700 1 -- 172.21.15.46:0/1881301541 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294011b30 con 0x7fd2a4159890 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 -- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 msgr2=0x7fd2a415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a415abd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2940098e0 tx=0x7fd2940091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 -- 172.21.15.46:0/1881301541 shutdown_connections 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a415abd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/1881301541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a4159c60 0x7fd2a415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 -- 172.21.15.46:0/1881301541 >> 172.21.15.46:0/1881301541 conn(0x7fd2a4068e20 msgr2=0x7fd2a40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 -- 172.21.15.46:0/1881301541 shutdown_connections 2023-10-07T08:59:16.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.884+0000 7fd2aa58f700 1 -- 172.21.15.46:0/1881301541 wait complete. 2023-10-07T08:59:16.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.885+0000 7fd2aa58f700 1 Processor -- start 2023-10-07T08:59:16.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.885+0000 7fd2aa58f700 1 -- start start 2023-10-07T08:59:16.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a40b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a415db10 0x7fd2a416a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b4710 con 0x7fd2a4159c60 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b3a90 con 0x7fd2a4159890 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2aa58f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b3d70 con 0x7fd2a415db10 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56794/0 (socket says 172.21.15.46:56794) 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 -- 172.21.15.46:0/3268699624 learned_addr learned my addr 172.21.15.46:0/3268699624 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a40b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a8b2c700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a415db10 0x7fd2a416a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 -- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a415db10 msgr2=0x7fd2a416a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a415db10 0x7fd2a416a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 -- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 msgr2=0x7fd2a40b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a40b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a37fe700 1 -- 172.21.15.46:0/3268699624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298009420 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.886+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a40b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd2a37fe700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd29800ec80 tx=0x7fd2980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800c9d0 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800cb30 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd294009420 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298013470 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.887+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a414fc60 con 0x7fd2a4159c60 2023-10-07T08:59:16.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.888+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40b4160 con 0x7fd2a4159c60 2023-10-07T08:59:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.888+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd298013820 con 0x7fd2a4159c60 2023-10-07T08:59:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.888+0000 7fd28bfff700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.889+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd298084510 con 0x7fd2a4159c60 2023-10-07T08:59:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.889+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:16.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.889+0000 7fd2a3fff700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 0x7fd2900693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd2940091e0 tx=0x7fd294017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:16.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:16.893+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd298051a30 con 0x7fd2a4159c60 2023-10-07T08:59:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.168+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd2a40b3f30 con 0x7fd2a4159c60 2023-10-07T08:59:17.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.171+0000 7fd28bfff700 1 -- 172.21.15.46:0/3268699624 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd298055050 con 0x7fd2a4159c60 2023-10-07T08:59:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 msgr2=0x7fd2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 0x7fd2900693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd2940091e0 tx=0x7fd294017000 comp rx=0 tx=0).stop 2023-10-07T08:59:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 msgr2=0x7fd2a4169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd29800ec80 tx=0x7fd2980091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 shutdown_connections 2023-10-07T08:59:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2a415db10 0x7fd2a416a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2a4159890 0x7fd2a40b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 --2- 172.21.15.46:0/3268699624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a4159c60 0x7fd2a4169bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 >> 172.21.15.46:0/3268699624 conn(0x7fd2a4068e20 msgr2=0x7fd2a4152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.173+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 shutdown_connections 2023-10-07T08:59:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.174+0000 7fd2aa58f700 1 -- 172.21.15.46:0/3268699624 wait complete. 2023-10-07T08:59:17.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-07T08:59:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.306+0000 7fa61a594700 1 Processor -- start 2023-10-07T08:59:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.306+0000 7fa61a594700 1 -- start start 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa61a594700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa61415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa61a594700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61415a160 con 0x7fa614159890 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa61a594700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140d13a0 con 0x7fa61415db10 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa61a594700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415e140 con 0x7fa614159c60 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa613fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa614159890 0x7fa61415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50280/0 (socket says 172.21.15.46:50280) 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.307+0000 7fa613fff700 1 -- 172.21.15.46:0/3042430761 learned_addr learned my addr 172.21.15.46:0/3042430761 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023816194 0 0) 0x7fa61415a160 con 0x7fa614159890 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa600003570 con 0x7fa614159890 2023-10-07T08:59:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa6137fe700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa61415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286015126 0 0) 0x7fa600003570 con 0x7fa614159890 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 msgr2=0x7fa61415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa61415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 >> v1:172.21.15.133:6789/0 conn(0x7fa61415db10 legacy=0x7fa614069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61415a3d0 con 0x7fa614159890 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fa604001470 con 0x7fa614159890 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa6137fe700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa61415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 >> v1:172.21.15.46:6789/0 conn(0x7fa614159890 legacy=0x7fa61415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa600003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa600004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600004d50 0x7fa6000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415e140 con 0x7fa600003a90 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60000bc40 con 0x7fa600004d50 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60000be00 con 0x7fa614159c60 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa600003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa6137fe700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa600004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa618b31700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600004d50 0x7fa6000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 -- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 msgr2=0x7fa600004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa614159c60 0x7fa600004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 -- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600004d50 msgr2=0x7fa6000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600004d50 0x7fa6000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa613fff700 1 -- 172.21.15.46:0/3042430761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600003570 con 0x7fa600003a90 2023-10-07T08:59:17.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.308+0000 7fa618b31700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600004d50 0x7fa6000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa613fff700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa600003ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c3c0 tx=0x7fa604001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2dc2e34ff687e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400cc90 con 0x7fa600003a90 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400cdf0 con 0x7fa600003a90 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa612ffd700 1 -- 172.21.15.46:0/3042430761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604005b70 con 0x7fa600003a90 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 -- 172.21.15.46:0/3042430761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 msgr2=0x7fa600003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 --2- 172.21.15.46:0/3042430761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa600003ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c3c0 tx=0x7fa604001e50 comp rx=0 tx=0).stop 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa618b31700 1 -- 172.21.15.46:0/3042430761 reap_dead start 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 -- 172.21.15.46:0/3042430761 shutdown_connections 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 -- 172.21.15.46:0/3042430761 >> 172.21.15.46:0/3042430761 conn(0x7fa614068e20 msgr2=0x7fa6140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 -- 172.21.15.46:0/3042430761 shutdown_connections 2023-10-07T08:59:17.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.309+0000 7fa61a594700 1 -- 172.21.15.46:0/3042430761 wait complete. 2023-10-07T08:59:17.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.310+0000 7fa61a594700 1 Processor -- start 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 -- start start 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 0x7fa61416a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa61416af00 0x7fa6141582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140cdd00 con 0x7fa600003a90 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140cd130 con 0x7fa6140b4c70 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa61a594700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140cd3d0 con 0x7fa61416af00 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56812/0 (socket says 172.21.15.46:56812) 2023-10-07T08:59:17.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa613fff700 1 -- 172.21.15.46:0/1858500888 learned_addr learned my addr 172.21.15.46:0/1858500888 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.311+0000 7fa6137fe700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 0x7fa61416a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa618b31700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa61416af00 0x7fa6141582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 -- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa61416af00 msgr2=0x7fa6141582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa61416af00 0x7fa6141582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 -- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 msgr2=0x7fa61416a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 0x7fa61416a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 -- 172.21.15.46:0/1858500888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140cd6b0 con 0x7fa600003a90 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa6137fe700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 0x7fa61416a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa613fff700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa604001e90 tx=0x7fa604015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040070d0 con 0x7fa600003a90 2023-10-07T08:59:17.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604007290 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140cd990 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604007650 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.312+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa614158820 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.313+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6141536b0 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.313+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa604019070 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.314+0000 7fa60bfff700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.314+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa6040857a0 con 0x7fa600003a90 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.314+0000 7fa6137fe700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.315+0000 7fa6137fe700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6140b50e0 tx=0x7fa5fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.318+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa604052d60 con 0x7fa600003a90 2023-10-07T08:59:17.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.591+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa6140b0140 con 0x7fa600003a90 2023-10-07T08:59:17.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.594+0000 7fa60bfff700 1 -- 172.21.15.46:0/1858500888 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa6040170a0 con 0x7fa600003a90 2023-10-07T08:59:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6140b50e0 tx=0x7fa5fc008040 comp rx=0 tx=0).stop 2023-10-07T08:59:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 msgr2=0x7fa6140c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa604001e90 tx=0x7fa604015000 comp rx=0 tx=0).stop 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 shutdown_connections 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa61416af00 0x7fa6141582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600003a90 0x7fa6140c9c40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 --2- 172.21.15.46:0/1858500888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6140b4c70 0x7fa61416a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.596+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 >> 172.21.15.46:0/1858500888 conn(0x7fa614068e20 msgr2=0x7fa614152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.597+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 shutdown_connections 2023-10-07T08:59:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.597+0000 7fa61a594700 1 -- 172.21.15.46:0/1858500888 wait complete. 2023-10-07T08:59:17.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-07T08:59:17.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 Processor -- start 2023-10-07T08:59:17.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 -- start start 2023-10-07T08:59:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2eb8142ea0 0x7f2eb80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2eb80ad870 0x7f2eb806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb80b40f0 con 0x7f2eb80b3b70 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8069640 con 0x7f2eb80ad870 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.729+0000 7f2ebdde2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8069920 con 0x7f2eb8142ea0 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2eb80ad870 0x7f2eb806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2ebd5e1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2eb80b3b70 0x7f2eb806cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50292/0 (socket says 172.21.15.46:50292) 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2ebd5e1700 1 -- 172.21.15.46:0/442910067 learned_addr learned my addr 172.21.15.46:0/442910067 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2ebcde0700 1 --2- 172.21.15.46:0/442910067 >> v2:172.21.15.133:3300/0 conn(0x7f2eb8142ea0 0x7f2eb80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 -- 172.21.15.46:0/442910067 >> v2:172.21.15.133:3300/0 conn(0x7f2eb8142ea0 msgr2=0x7f2eb80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 --2- 172.21.15.46:0/442910067 >> v2:172.21.15.133:3300/0 conn(0x7f2eb8142ea0 0x7f2eb80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 -- 172.21.15.46:0/442910067 >> v1:172.21.15.46:6789/0 conn(0x7f2eb80b3b70 legacy=0x7f2eb806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 -- 172.21.15.46:0/442910067 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8069c00 con 0x7f2eb80ad870 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb77fe700 1 -- 172.21.15.46:0/442910067 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472223978 0 0) 0x7f2eb80b40f0 con 0x7f2eb80b3b70 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb7fff700 1 --2- 172.21.15.46:0/442910067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80ad870 0x7f2eb806b9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071240 tx=0x7f2ea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178fb33bd841dd2a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb77fe700 1 -- 172.21.15.46:0/442910067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800b6b0 con 0x7f2eb80ad870 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb77fe700 1 -- 172.21.15.46:0/442910067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800b810 con 0x7f2eb80ad870 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.730+0000 7f2eb77fe700 1 -- 172.21.15.46:0/442910067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800bbb0 con 0x7f2eb80ad870 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 -- 172.21.15.46:0/442910067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80ad870 msgr2=0x7f2eb806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/442910067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80ad870 0x7f2eb806b9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071240 tx=0x7f2ea80091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 -- 172.21.15.46:0/442910067 shutdown_connections 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/442910067 >> v2:172.21.15.133:3300/0 conn(0x7f2eb8142ea0 0x7f2eb80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/442910067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80ad870 0x7f2eb806b9e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 -- 172.21.15.46:0/442910067 >> 172.21.15.46:0/442910067 conn(0x7f2eb80ce430 msgr2=0x7f2eb80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 -- 172.21.15.46:0/442910067 shutdown_connections 2023-10-07T08:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.731+0000 7f2ebdde2700 1 -- 172.21.15.46:0/442910067 wait complete. 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.732+0000 7f2ebdde2700 1 Processor -- start 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.732+0000 7f2ebdde2700 1 -- start start 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb8142ea0 0x7f2eb80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb816af10 0x7f2eb80cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8169d30 con 0x7f2eb80b3b70 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb816ab40 con 0x7f2eb8142ea0 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebdde2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8169f50 con 0x7f2eb816af10 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56828/0 (socket says 172.21.15.46:56828) 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 -- 172.21.15.46:0/3238335179 learned_addr learned my addr 172.21.15.46:0/3238335179 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2eb7fff700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb8142ea0 0x7f2eb80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebd5e1700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb816af10 0x7f2eb80cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 -- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb816af10 msgr2=0x7f2eb80cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb816af10 0x7f2eb80cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 -- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb8142ea0 msgr2=0x7f2eb80c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb8142ea0 0x7f2eb80c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.733+0000 7f2ebcde0700 1 -- 172.21.15.46:0/3238335179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009420 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2ebcde0700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009fa0 tx=0x7f2eb0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000ed20 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000ee80 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb816a210 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0014670 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.734+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb816a7d0 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.735+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb804c3c0 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.735+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eb00149e0 con 0x7f2eb80b3b70 2023-10-07T08:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.735+0000 7f2eb4ff9700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:17.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.736+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2eb0084960 con 0x7f2eb80b3b70 2023-10-07T08:59:17.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.736+0000 7f2eb7fff700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:17.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.736+0000 7f2eb7fff700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 0x7f2e980693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071240 tx=0x7f2ea8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:17.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:17.740+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2eb0051f20 con 0x7f2eb80b3b70 2023-10-07T08:59:18.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.011+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2eb8143270 con 0x7f2eb80b3b70 2023-10-07T08:59:18.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.014+0000 7f2eb4ff9700 1 -- 172.21.15.46:0/3238335179 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2eb0055540 con 0x7f2eb80b3b70 2023-10-07T08:59:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 msgr2=0x7f2e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 0x7f2e980693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071240 tx=0x7f2ea8017000 comp rx=0 tx=0).stop 2023-10-07T08:59:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 msgr2=0x7f2eb8158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009fa0 tx=0x7f2eb0009880 comp rx=0 tx=0).stop 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 shutdown_connections 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb816af10 0x7f2eb80cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb80b3b70 0x7f2eb8158ef0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 --2- 172.21.15.46:0/3238335179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb8142ea0 0x7f2eb80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.016+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 >> 172.21.15.46:0/3238335179 conn(0x7f2eb80ce430 msgr2=0x7f2eb8141d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.017+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 shutdown_connections 2023-10-07T08:59:18.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.017+0000 7f2ebdde2700 1 -- 172.21.15.46:0/3238335179 wait complete. 2023-10-07T08:59:18.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-07T08:59:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.149+0000 7f58318a8700 1 Processor -- start 2023-10-07T08:59:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.149+0000 7f58318a8700 1 -- start start 2023-10-07T08:59:18.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58318a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58318a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 0x7f582c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58318a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0b11d0 con 0x7f582c15d230 2023-10-07T08:59:18.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58318a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0b14b0 con 0x7f582c1597f0 2023-10-07T08:59:18.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58318a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0b1790 con 0x7f582c159420 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58308a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58308a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:38962/0 (socket says 172.21.15.46:38962) 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58308a6700 1 -- 172.21.15.46:0/746226099 learned_addr learned my addr 172.21.15.46:0/746226099 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f582bfff700 1 --2- 172.21.15.46:0/746226099 >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 0x7f582c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.150+0000 7f58310a7700 1 --1- 172.21.15.46:0/746226099 >> v1:172.21.15.133:6789/0 conn(0x7f582c15d230 0x7f582c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:47558/0 (socket says 172.21.15.46:47558) 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f58308a6700 1 -- 172.21.15.46:0/746226099 >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 msgr2=0x7f582c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f58308a6700 1 --2- 172.21.15.46:0/746226099 >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 0x7f582c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f58308a6700 1 -- 172.21.15.46:0/746226099 >> v1:172.21.15.133:6789/0 conn(0x7f582c15d230 legacy=0x7f582c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f58308a6700 1 -- 172.21.15.46:0/746226099 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0b1a70 con 0x7f582c159420 2023-10-07T08:59:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f582bfff700 1 --2- 172.21.15.46:0/746226099 >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 0x7f582c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f58308a6700 1 --2- 172.21.15.46:0/746226099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5824009f20 tx=0x7f5824009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d21fb620f898c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f582b7fe700 1 -- 172.21.15.46:0/746226099 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400e070 con 0x7f582c159420 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f582b7fe700 1 -- 172.21.15.46:0/746226099 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582400b9d0 con 0x7f582c159420 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.151+0000 7f582b7fe700 1 -- 172.21.15.46:0/746226099 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240092e0 con 0x7f582c159420 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 -- 172.21.15.46:0/746226099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 msgr2=0x7f582c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 --2- 172.21.15.46:0/746226099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5824009f20 tx=0x7f5824009840 comp rx=0 tx=0).stop 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 -- 172.21.15.46:0/746226099 shutdown_connections 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 --2- 172.21.15.46:0/746226099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c159420 0x7f582c0b5f40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 --2- 172.21.15.46:0/746226099 >> v2:172.21.15.133:3300/0 conn(0x7f582c1597f0 0x7f582c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 -- 172.21.15.46:0/746226099 >> 172.21.15.46:0/746226099 conn(0x7f582c0d0660 msgr2=0x7f582c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 -- 172.21.15.46:0/746226099 shutdown_connections 2023-10-07T08:59:18.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.152+0000 7f58318a8700 1 -- 172.21.15.46:0/746226099 wait complete. 2023-10-07T08:59:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.153+0000 7f58318a8700 1 Processor -- start 2023-10-07T08:59:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.153+0000 7f58318a8700 1 -- start start 2023-10-07T08:59:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 0x7f582c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c15d230 0x7f582c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c16aef0 con 0x7f582c159420 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1570a0 con 0x7f582c1597f0 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58318a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c6270 con 0x7f582c15d230 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56840/0 (socket says 172.21.15.46:56840) 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 -- 172.21.15.46:0/693885912 learned_addr learned my addr 172.21.15.46:0/693885912 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f582bfff700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 0x7f582c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58310a7700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c15d230 0x7f582c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 -- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c15d230 msgr2=0x7f582c0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c15d230 0x7f582c0c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 -- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 msgr2=0x7f582c156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 0x7f582c156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 -- 172.21.15.46:0/693885912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009420 con 0x7f582c159420 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f582bfff700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 0x7f582c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.154+0000 7f58308a6700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f582400b610 tx=0x7f5824018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.155+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824008a50 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.155+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824008bb0 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.155+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824009ae0 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.155+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824026460 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.155+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0c7790 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.156+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c04c3c0 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.156+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5824003040 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.156+0000 7f5828ff9700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 0x7f58180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.156+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f58240860d0 con 0x7f582c159420 2023-10-07T08:59:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.157+0000 7f582bfff700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 0x7f58180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.157+0000 7f582bfff700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 0x7f58180693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58200093f0 tx=0x7f5820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.161+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58240535f0 con 0x7f582c159420 2023-10-07T08:59:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.428+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f582c0b1d50 con 0x7f582c159420 2023-10-07T08:59:18.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.432+0000 7f5828ff9700 1 -- 172.21.15.46:0/693885912 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5824056c10 con 0x7f582c159420 2023-10-07T08:59:18.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 msgr2=0x7f58180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 0x7f58180693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58200093f0 tx=0x7f5820008040 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 msgr2=0x7f582c16a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f582400b610 tx=0x7f5824018000 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 shutdown_connections 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5818066f30 0x7f58180693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f582c15d230 0x7f582c0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f582c159420 0x7f582c16a9b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 --2- 172.21.15.46:0/693885912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f582c1597f0 0x7f582c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 >> 172.21.15.46:0/693885912 conn(0x7f582c0d0660 msgr2=0x7f582c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 shutdown_connections 2023-10-07T08:59:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.434+0000 7f58318a8700 1 -- 172.21.15.46:0/693885912 wait complete. 2023-10-07T08:59:18.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-07T08:59:18.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.576+0000 7f0a6143d700 1 Processor -- start 2023-10-07T08:59:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.576+0000 7f0a6143d700 1 -- start start 2023-10-07T08:59:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.576+0000 7f0a6143d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a5c159890 0x7f0a5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a6143d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c15a160 con 0x7f0a5c069560 2023-10-07T08:59:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a6143d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c0d13a0 con 0x7f0a5c159c60 2023-10-07T08:59:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a6143d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c15e140 con 0x7f0a5c159890 2023-10-07T08:59:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a5b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0a5c069560 0x7f0a5c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50302/0 (socket says 172.21.15.46:50302) 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a5b7fe700 1 -- 172.21.15.46:0/4219978164 learned_addr learned my addr 172.21.15.46:0/4219978164 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308736490 0 0) 0x7f0a5c15a160 con 0x7f0a5c069560 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a5affd700 1 --2- 172.21.15.46:0/4219978164 >> v2:172.21.15.133:3300/0 conn(0x7f0a5c159890 0x7f0a5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a48003570 con 0x7f0a5c069560 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449266789 0 0) 0x7f0a48003570 con 0x7f0a5c069560 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 >> v2:172.21.15.133:3300/0 conn(0x7f0a5c159890 msgr2=0x7f0a5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 --2- 172.21.15.46:0/4219978164 >> v2:172.21.15.133:3300/0 conn(0x7f0a5c159890 0x7f0a5c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 >> v1:172.21.15.133:6789/0 conn(0x7f0a5c159c60 legacy=0x7f0a5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c15a3d0 con 0x7f0a5c069560 2023-10-07T08:59:18.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f0a4c001470 con 0x7f0a5c069560 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 >> v1:172.21.15.46:6789/0 conn(0x7f0a5c069560 legacy=0x7f0a5c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a48004810 0x7f0a48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a480051c0 0x7f0a4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c15e140 con 0x7f0a48003a60 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4800c0d0 con 0x7f0a480051c0 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4800c290 con 0x7f0a48004810 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.577+0000 7f0a5affd700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5a7fc700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a48004810 0x7f0a48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5b7fe700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a480051c0 0x7f0a4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 -- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a48004810 msgr2=0x7f0a48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:18.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a48004810 0x7f0a48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 -- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a480051c0 msgr2=0x7f0a4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a480051c0 0x7f0a4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5b7fe700 1 -- 172.21.15.46:0/4219978164 reap_dead start 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 -- 172.21.15.46:0/4219978164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48003570 con 0x7f0a48003a60 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a5affd700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a48003e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400e210 tx=0x7f0a5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e64c6f19b14856 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400eac0 con 0x7f0a48003a60 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5400f040 con 0x7f0a48003a60 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.578+0000 7f0a59ffb700 1 -- 172.21.15.46:0/4219978164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400ee70 con 0x7f0a48003a60 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 -- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 msgr2=0x7f0a48003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a48003e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400e210 tx=0x7f0a5400b040 comp rx=0 tx=0).stop 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 -- 172.21.15.46:0/4219978164 shutdown_connections 2023-10-07T08:59:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 --2- 172.21.15.46:0/4219978164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a48003e70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 -- 172.21.15.46:0/4219978164 >> 172.21.15.46:0/4219978164 conn(0x7f0a5c068e20 msgr2=0x7f0a5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:18.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 -- 172.21.15.46:0/4219978164 shutdown_connections 2023-10-07T08:59:18.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.579+0000 7f0a6143d700 1 -- 172.21.15.46:0/4219978164 wait complete. 2023-10-07T08:59:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.580+0000 7f0a6143d700 1 Processor -- start 2023-10-07T08:59:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.580+0000 7f0a6143d700 1 -- start start 2023-10-07T08:59:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 0x7f0a5c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 0x7f0a5c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0cf070 con 0x7f0a48003a60 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0b6410 con 0x7f0a5c151de0 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a6143d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0ce740 con 0x7f0a5c0c78a0 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56868/0 (socket says 172.21.15.46:56868) 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 -- 172.21.15.46:0/1999618532 learned_addr learned my addr 172.21.15.46:0/1999618532 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 -- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 msgr2=0x7f0a5c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5b7fe700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 0x7f0a5c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5a7fc700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 0x7f0a5c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 0x7f0a5c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 -- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 msgr2=0x7f0a5c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 0x7f0a5c0b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 -- 172.21.15.46:0/1999618532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0cea20 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5b7fe700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 0x7f0a5c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5a7fc700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 0x7f0a5c0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.581+0000 7f0a5affd700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c0a0 tx=0x7f0a5401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.582+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401d420 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.582+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5401d580 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.582+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c0ced00 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.582+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401d980 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.582+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c0c7d10 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.583+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c0cf350 con 0x7f0a48003a60 2023-10-07T08:59:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.583+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a54003040 con 0x7f0a48003a60 2023-10-07T08:59:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.583+0000 7f0a52ffd700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.583+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0a54086650 con 0x7f0a48003a60 2023-10-07T08:59:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.584+0000 7f0a5a7fc700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.584+0000 7f0a5a7fc700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007bc0 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.588+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a54053c10 con 0x7f0a48003a60 2023-10-07T08:59:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.857+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0a5c04c3c0 con 0x7f0a48003a60 2023-10-07T08:59:18.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.860+0000 7f0a52ffd700 1 -- 172.21.15.46:0/1999618532 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0a54057230 con 0x7f0a48003a60 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 msgr2=0x7f0a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007bc0 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 msgr2=0x7f0a5c0b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c0a0 tx=0x7f0a5401a000 comp rx=0 tx=0).stop 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 shutdown_connections 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a5c0c78a0 0x7f0a5c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a48003a60 0x7f0a5c0b4260 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 --2- 172.21.15.46:0/1999618532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5c151de0 0x7f0a5c0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:18.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 >> 172.21.15.46:0/1999618532 conn(0x7f0a5c068e20 msgr2=0x7f0a5c15c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:18.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 shutdown_connections 2023-10-07T08:59:18.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.862+0000 7f0a6143d700 1 -- 172.21.15.46:0/1999618532 wait complete. 2023-10-07T08:59:18.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.994+0000 7f1fa0339700 1 Processor -- start 2023-10-07T08:59:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.994+0000 7f1fa0339700 1 -- start start 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1fa0339700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1fa0339700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1fa0339700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9815a160 con 0x7f1f9815db10 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1fa0339700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980d13a0 con 0x7f1f98159c60 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1fa0339700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9815e140 con 0x7f1f98159890 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1f9e8d6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1f9815db10 0x7f1f98069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50308/0 (socket says 172.21.15.46:50308) 2023-10-07T08:59:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.995+0000 7f1f9e8d6700 1 -- 172.21.15.46:0/196639999 learned_addr learned my addr 172.21.15.46:0/196639999 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> v2:172.21.15.133:3300/0 conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9e0d5700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963751337 0 0) 0x7f1f9815a160 con 0x7f1f9815db10 2023-10-07T08:59:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f80003570 con 0x7f1f9815db10 2023-10-07T08:59:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777223315 0 0) 0x7f1f80003570 con 0x7f1f9815db10 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 msgr2=0x7f1f9815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 >> v2:172.21.15.133:3300/0 conn(0x7f1f98159c60 msgr2=0x7f1f9815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 --2- 172.21.15.46:0/196639999 >> v2:172.21.15.133:3300/0 conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9815a3d0 con 0x7f1f9815db10 2023-10-07T08:59:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f1f880017f0 con 0x7f1f9815db10 2023-10-07T08:59:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 >> v1:172.21.15.46:6789/0 conn(0x7f1f9815db10 legacy=0x7f1f98069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f80003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f80004d50 0x7f1f800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980d13a0 con 0x7f1f80003fe0 2023-10-07T08:59:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9815e140 con 0x7f1f80004d50 2023-10-07T08:59:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8000ba90 con 0x7f1f98159890 2023-10-07T08:59:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> v2:172.21.15.133:3300/0 conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:19.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9e0d5700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f80003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.996+0000 7f1f9e8d6700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f80004d50 0x7f1f800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 -- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 msgr2=0x7f1f80003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f80003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 -- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f80004d50 msgr2=0x7f1f800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f80004d50 0x7f1f800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 -- 172.21.15.46:0/196639999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80003570 con 0x7f1f80003fe0 2023-10-07T08:59:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f80004810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f9815a090 tx=0x7f1f8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d308377034c200fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c009740 con 0x7f1f80003fe0 2023-10-07T08:59:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00e8c0 con 0x7f1f80003fe0 2023-10-07T08:59:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9d0d3700 1 -- 172.21.15.46:0/196639999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00ec60 con 0x7f1f80003fe0 2023-10-07T08:59:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1fa0339700 1 -- 172.21.15.46:0/196639999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 msgr2=0x7f1f80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1fa0339700 1 --2- 172.21.15.46:0/196639999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f80004810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f9815a090 tx=0x7f1f8c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.997+0000 7f1f9e8d6700 1 -- 172.21.15.46:0/196639999 reap_dead start 2023-10-07T08:59:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.998+0000 7f1fa0339700 1 -- 172.21.15.46:0/196639999 shutdown_connections 2023-10-07T08:59:19.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.998+0000 7f1fa0339700 1 -- 172.21.15.46:0/196639999 >> 172.21.15.46:0/196639999 conn(0x7f1f98068e20 msgr2=0x7f1f980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.998+0000 7f1fa0339700 1 -- 172.21.15.46:0/196639999 shutdown_connections 2023-10-07T08:59:19.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.998+0000 7f1fa0339700 1 -- 172.21.15.46:0/196639999 wait complete. 2023-10-07T08:59:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 Processor -- start 2023-10-07T08:59:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 -- start start 2023-10-07T08:59:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f980c7c50 0x7f1f980c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 0x7f1f980b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f98169bf0 con 0x7f1f80003fe0 2023-10-07T08:59:19.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c8600 con 0x7f1f980b18e0 2023-10-07T08:59:19.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:18.999+0000 7f1fa0339700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9816aa30 con 0x7f1f980c7c50 2023-10-07T08:59:19.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56898/0 (socket says 172.21.15.46:56898) 2023-10-07T08:59:19.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 -- 172.21.15.46:0/48961353 learned_addr learned my addr 172.21.15.46:0/48961353 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 -- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f980c7c50 msgr2=0x7f1f980c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f980c7c50 0x7f1f980c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e8d6700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 0x7f1f980b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 -- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 msgr2=0x7f1f980b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 0x7f1f980b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 -- 172.21.15.46:0/48961353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980c90d0 con 0x7f1f80003fe0 2023-10-07T08:59:19.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e8d6700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 0x7f1f980b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:19.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f9e0d5700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1f90011da0 tx=0x7f1f900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90009e20 con 0x7f1f80003fe0 2023-10-07T08:59:19.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9000fc70 con 0x7f1f80003fe0 2023-10-07T08:59:19.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980ce660 con 0x7f1f80003fe0 2023-10-07T08:59:19.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90014440 con 0x7f1f80003fe0 2023-10-07T08:59:19.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.000+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980c8830 con 0x7f1f80003fe0 2023-10-07T08:59:19.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.001+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804c3c0 con 0x7f1f80003fe0 2023-10-07T08:59:19.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.002+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f90014870 con 0x7f1f80003fe0 2023-10-07T08:59:19.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.002+0000 7f1f967fc700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.002+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1f90018030 con 0x7f1f80003fe0 2023-10-07T08:59:19.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.002+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.003+0000 7f1f9d8d4700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 0x7f1f840693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f980d07e0 tx=0x7f1f8c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.006+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f90052170 con 0x7f1f80003fe0 2023-10-07T08:59:19.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.201+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f9806a5b0 con 0x7f1f80003fe0 2023-10-07T08:59:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.201+0000 7f1f967fc700 1 -- 172.21.15.46:0/48961353 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f1f90022090 con 0x7f1f80003fe0 2023-10-07T08:59:19.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:15.888985+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 msgr2=0x7f1f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 0x7f1f840693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f980d07e0 tx=0x7f1f8c019000 comp rx=0 tx=0).stop 2023-10-07T08:59:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 msgr2=0x7f1f98149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1f90011da0 tx=0x7f1f900091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 shutdown_connections 2023-10-07T08:59:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f980b18e0 0x7f1f980b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f80003fe0 0x7f1f98149e50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 --2- 172.21.15.46:0/48961353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f980c7c50 0x7f1f980c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 >> 172.21.15.46:0/48961353 conn(0x7f1f98068e20 msgr2=0x7f1f9815ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 shutdown_connections 2023-10-07T08:59:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.203+0000 7f1fa0339700 1 -- 172.21.15.46:0/48961353 wait complete. 2023-10-07T08:59:19.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:59:19.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.337+0000 7f302807a700 1 Processor -- start 2023-10-07T08:59:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.337+0000 7f302807a700 1 -- start start 2023-10-07T08:59:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.338+0000 7f302807a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 0x7f302015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.338+0000 7f302807a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.338+0000 7f302807a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3020069ee0 con 0x7f3020159c60 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.338+0000 7f302807a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302015a160 con 0x7f3020159890 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.338+0000 7f302807a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30200d13a0 con 0x7f3020069560 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3025e16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 0x7f302015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39036/0 (socket says 172.21.15.46:39036) 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 -- 172.21.15.46:0/3927672037 learned_addr learned my addr 172.21.15.46:0/3927672037 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3025e16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 0x7f302015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33380/0 (socket says 172.21.15.46:33380) 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3025615700 1 --1- 172.21.15.46:0/3927672037 >> v1:172.21.15.133:6789/0 conn(0x7f3020159c60 0x7f302015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:47576/0 (socket says 172.21.15.46:47576) 2023-10-07T08:59:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 -- 172.21.15.46:0/3927672037 >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 msgr2=0x7f302015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 --2- 172.21.15.46:0/3927672037 >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 0x7f302015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 -- 172.21.15.46:0/3927672037 >> v1:172.21.15.133:6789/0 conn(0x7f3020159c60 legacy=0x7f302015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 -- 172.21.15.46:0/3927672037 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302015e140 con 0x7f3020069560 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3026617700 1 --2- 172.21.15.46:0/3927672037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3010009f20 tx=0x7f3010009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f530a0c8c27fdbb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3024e14700 1 -- 172.21.15.46:0/3927672037 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301000e070 con 0x7f3020069560 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3024e14700 1 -- 172.21.15.46:0/3927672037 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301000b9d0 con 0x7f3020069560 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.339+0000 7f3024e14700 1 -- 172.21.15.46:0/3927672037 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100092e0 con 0x7f3020069560 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 -- 172.21.15.46:0/3927672037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 msgr2=0x7f30200699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 --2- 172.21.15.46:0/3927672037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3010009f20 tx=0x7f3010009840 comp rx=0 tx=0).stop 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 -- 172.21.15.46:0/3927672037 shutdown_connections 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 --2- 172.21.15.46:0/3927672037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020069560 0x7f30200699a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 --2- 172.21.15.46:0/3927672037 >> v2:172.21.15.133:3300/0 conn(0x7f3020159890 0x7f302015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 -- 172.21.15.46:0/3927672037 >> 172.21.15.46:0/3927672037 conn(0x7f3020068e20 msgr2=0x7f30200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 -- 172.21.15.46:0/3927672037 shutdown_connections 2023-10-07T08:59:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.340+0000 7f302807a700 1 -- 172.21.15.46:0/3927672037 wait complete. 2023-10-07T08:59:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.341+0000 7f302807a700 1 Processor -- start 2023-10-07T08:59:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.341+0000 7f302807a700 1 -- start start 2023-10-07T08:59:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020159890 0x7f30201496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020159c60 0x7f30200b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30201512e0 con 0x7f3020069560 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020151e60 con 0x7f3020159890 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f302807a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3020151530 con 0x7f3020159c60 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56914/0 (socket says 172.21.15.46:56914) 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 -- 172.21.15.46:0/3483237226 learned_addr learned my addr 172.21.15.46:0/3483237226 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025615700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020159890 0x7f30201496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3026617700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020159c60 0x7f30200b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 -- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020159c60 msgr2=0x7f30200b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020159c60 0x7f30200b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 -- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020159890 msgr2=0x7f30201496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020159890 0x7f30201496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.342+0000 7f3025e16700 1 -- 172.21.15.46:0/3483237226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010009ae0 con 0x7f3020069560 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f3025e16700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f301800ecb0 tx=0x7f30180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800c850 con 0x7f3020069560 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301800c9b0 con 0x7f3020069560 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020151810 con 0x7f3020069560 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800cd50 con 0x7f3020069560 2023-10-07T08:59:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.343+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3020149c10 con 0x7f3020069560 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.344+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302004c3c0 con 0x7f3020069560 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.344+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3018013680 con 0x7f3020069560 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.345+0000 7f301dffb700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.345+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3018084510 con 0x7f3020069560 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.345+0000 7f3025615700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.345+0000 7f3025615700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 0x7f300c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f302015d540 tx=0x7f3014007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.349+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3018051a30 con 0x7f3020069560 2023-10-07T08:59:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.539+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f302006a5b0 con 0x7f3020069560 2023-10-07T08:59:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.540+0000 7f301dffb700 1 -- 172.21.15.46:0/3483237226 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3018055050 con 0x7f3020069560 2023-10-07T08:59:19.541 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 msgr2=0x7f300c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 0x7f300c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f302015d540 tx=0x7f3014007eb0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 msgr2=0x7f30201522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f301800ecb0 tx=0x7f30180091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 shutdown_connections 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3020159c60 0x7f30200b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020069560 0x7f30201522f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 --2- 172.21.15.46:0/3483237226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020159890 0x7f30201496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 >> 172.21.15.46:0/3483237226 conn(0x7f3020068e20 msgr2=0x7f30201540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 shutdown_connections 2023-10-07T08:59:19.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.542+0000 7f302807a700 1 -- 172.21.15.46:0/3483237226 wait complete. 2023-10-07T08:59:19.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:59:19.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.673+0000 7f29ce936700 1 Processor -- start 2023-10-07T08:59:19.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.673+0000 7f29ce936700 1 -- start start 2023-10-07T08:59:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29ce936700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29c815ab90 0x7f29c80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29ce936700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c80cbf90 con 0x7f29c80cbb30 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29ce936700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c806a220 con 0x7f29c81599c0 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29ce936700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c8069c70 con 0x7f29c815ab90 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29c815ab90 0x7f29c80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29cced3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f29c80cbb30 0x7f29c80ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33170/0 (socket says 172.21.15.46:33170) 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29cced3700 1 -- 172.21.15.46:0/915300359 learned_addr learned my addr 172.21.15.46:0/915300359 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c77fe700 1 -- 172.21.15.46:0/915300359 >> v1:172.21.15.133:6789/0 conn(0x7f29c81599c0 legacy=0x7f29c8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c77fe700 1 -- 172.21.15.46:0/915300359 >> v1:172.21.15.46:6789/0 conn(0x7f29c80cbb30 legacy=0x7f29c80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c77fe700 1 -- 172.21.15.46:0/915300359 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c8069f40 con 0x7f29c815ab90 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c77fe700 1 --2- 172.21.15.46:0/915300359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c815ab90 0x7f29c80cb5f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098e0 tx=0x7f29bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f06a48f3e56e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c6ffd700 1 -- 172.21.15.46:0/915300359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc009e80 con 0x7f29c815ab90 2023-10-07T08:59:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c6ffd700 1 -- 172.21.15.46:0/915300359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00b860 con 0x7f29c815ab90 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.674+0000 7f29c6ffd700 1 -- 172.21.15.46:0/915300359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bbe0 con 0x7f29c815ab90 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 -- 172.21.15.46:0/915300359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c815ab90 msgr2=0x7f29c80cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 --2- 172.21.15.46:0/915300359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c815ab90 0x7f29c80cb5f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098e0 tx=0x7f29bc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 -- 172.21.15.46:0/915300359 shutdown_connections 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 --2- 172.21.15.46:0/915300359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c815ab90 0x7f29c80cb5f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 -- 172.21.15.46:0/915300359 >> 172.21.15.46:0/915300359 conn(0x7f29c8068e10 msgr2=0x7f29c80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 -- 172.21.15.46:0/915300359 shutdown_connections 2023-10-07T08:59:19.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.675+0000 7f29ce936700 1 -- 172.21.15.46:0/915300359 wait complete. 2023-10-07T08:59:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.676+0000 7f29ce936700 1 Processor -- start 2023-10-07T08:59:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.676+0000 7f29ce936700 1 -- start start 2023-10-07T08:59:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29c80cbb30 0x7f29c81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c815ab90 0x7f29c80b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80b5630 con 0x7f29c81599c0 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c816b5a0 con 0x7f29c815ab90 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29ce936700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80b63d0 con 0x7f29c80cbb30 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42672/0 (socket says 172.21.15.46:42672) 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 -- 172.21.15.46:0/1291200842 learned_addr learned my addr 172.21.15.46:0/1291200842 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29cced3700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c815ab90 0x7f29c80b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c7fff700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29c80cbb30 0x7f29c81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 -- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29c80cbb30 msgr2=0x7f29c81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29c80cbb30 0x7f29c81589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 -- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c815ab90 msgr2=0x7f29c80b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c815ab90 0x7f29c80b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 -- 172.21.15.46:0/1291200842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009420 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.677+0000 7f29c77fe700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00b3c0 tx=0x7f29bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.678+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bb20 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.678+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc026430 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.678+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c816a990 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.678+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0267d0 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.678+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c816af50 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.679+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c816dc40 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.679+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29bc023030 con 0x7f29c81599c0 2023-10-07T08:59:19.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.679+0000 7f29affff700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 0x7f29b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:19.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.679+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f29bc085b40 con 0x7f29c81599c0 2023-10-07T08:59:19.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.680+0000 7f29c7fff700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 0x7f29b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:19.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.680+0000 7f29c7fff700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 0x7f29b40693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29c81532e0 tx=0x7f29b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:19.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.684+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29c816dc40 con 0x7f29c81599c0 2023-10-07T08:59:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.879+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f29c816dc40 con 0x7f29c81599c0 2023-10-07T08:59:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.879+0000 7f29affff700 1 -- 172.21.15.46:0/1291200842 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f29c816dc40 con 0x7f29c81599c0 2023-10-07T08:59:19.880 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T08:59:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.881+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 msgr2=0x7f29b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.881+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 0x7f29b40693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29c81532e0 tx=0x7f29b8009040 comp rx=0 tx=0).stop 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.881+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 msgr2=0x7f29c80b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.881+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00b3c0 tx=0x7f29bc017000 comp rx=0 tx=0).stop 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 shutdown_connections 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f29b4066f30 0x7f29b40693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c815ab90 0x7f29c80b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29c80cbb30 0x7f29c81589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 --2- 172.21.15.46:0/1291200842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29c81599c0 0x7f29c80b50f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 >> 172.21.15.46:0/1291200842 conn(0x7f29c8068e10 msgr2=0x7f29c80c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 shutdown_connections 2023-10-07T08:59:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:19.882+0000 7f29ce936700 1 -- 172.21.15.46:0/1291200842 wait complete. 2023-10-07T08:59:19.894 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:59:19.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:59:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.017+0000 7f5f8701f700 1 Processor -- start 2023-10-07T08:59:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.017+0000 7f5f8701f700 1 -- start start 2023-10-07T08:59:20.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f8701f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f80159ec0 0x7f5f800b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f8701f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f800cf350 0x7f5f800cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f8701f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f800b5b00 con 0x7f5f800b53d0 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f8701f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800b5850 con 0x7f5f800cf350 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f8701f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800b5da0 con 0x7f5f80159ec0 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f855bc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f800cf350 0x7f5f800cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f855bc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f800cf350 0x7f5f800cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42674/0 (socket says 172.21.15.46:42674) 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.018+0000 7f5f855bc700 1 -- 172.21.15.46:0/1115864065 learned_addr learned my addr 172.21.15.46:0/1115864065 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f84dbb700 1 --2- 172.21.15.46:0/1115864065 >> v2:172.21.15.133:3300/0 conn(0x7f5f80159ec0 0x7f5f800b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f855bc700 1 -- 172.21.15.46:0/1115864065 >> v2:172.21.15.133:3300/0 conn(0x7f5f80159ec0 msgr2=0x7f5f800b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f855bc700 1 --2- 172.21.15.46:0/1115864065 >> v2:172.21.15.133:3300/0 conn(0x7f5f80159ec0 0x7f5f800b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f855bc700 1 -- 172.21.15.46:0/1115864065 >> v1:172.21.15.133:6789/0 conn(0x7f5f800b53d0 legacy=0x7f5f800cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f855bc700 1 -- 172.21.15.46:0/1115864065 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800b6080 con 0x7f5f800cf350 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f855bc700 1 --2- 172.21.15.46:0/1115864065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800cf350 0x7f5f800cd010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f80089120 tx=0x7f5f70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db41315f3d1f957f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:20.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f7f7fe700 1 -- 172.21.15.46:0/1115864065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000b820 con 0x7f5f800cf350 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f7f7fe700 1 -- 172.21.15.46:0/1115864065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000b980 con 0x7f5f800cf350 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f7f7fe700 1 -- 172.21.15.46:0/1115864065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000bd20 con 0x7f5f800cf350 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f8701f700 1 -- 172.21.15.46:0/1115864065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800cf350 msgr2=0x7f5f800cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.019+0000 7f5f8701f700 1 --2- 172.21.15.46:0/1115864065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800cf350 0x7f5f800cd010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f80089120 tx=0x7f5f70009250 comp rx=0 tx=0).stop 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 -- 172.21.15.46:0/1115864065 shutdown_connections 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 --2- 172.21.15.46:0/1115864065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800cf350 0x7f5f800cd010 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 --2- 172.21.15.46:0/1115864065 >> v2:172.21.15.133:3300/0 conn(0x7f5f80159ec0 0x7f5f800b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 -- 172.21.15.46:0/1115864065 >> 172.21.15.46:0/1115864065 conn(0x7f5f800999f0 msgr2=0x7f5f800b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 -- 172.21.15.46:0/1115864065 shutdown_connections 2023-10-07T08:59:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.020+0000 7f5f8701f700 1 -- 172.21.15.46:0/1115864065 wait complete. 2023-10-07T08:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.021+0000 7f5f8701f700 1 Processor -- start 2023-10-07T08:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.021+0000 7f5f8701f700 1 -- start start 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 0x7f5f80169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f80159ec0 0x7f5f800c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006a3e0 con 0x7f5f800b53d0 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8009ab50 con 0x7f5f80159ec0 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006a100 con 0x7f5f800cf350 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42682/0 (socket says 172.21.15.46:42682) 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 -- 172.21.15.46:0/4101459389 learned_addr learned my addr 172.21.15.46:0/4101459389 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f855bc700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f80159ec0 0x7f5f800c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f7ffff700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 0x7f5f80169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 -- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 msgr2=0x7f5f80169b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 0x7f5f80169b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 -- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f80159ec0 msgr2=0x7f5f800c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f80159ec0 0x7f5f800c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 -- 172.21.15.46:0/4101459389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700094f0 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f7ffff700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 0x7f5f80169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f84dbb700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800e160 tx=0x7f5f78009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7800ee00 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f78014420 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8009a500 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780147e0 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.022+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f80157590 con 0x7f5f800b53d0 2023-10-07T08:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.023+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80063c90 con 0x7f5f800b53d0 2023-10-07T08:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.024+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f78014b90 con 0x7f5f800b53d0 2023-10-07T08:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.024+0000 7f5f7cff9700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.024+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5f78084af0 con 0x7f5f800b53d0 2023-10-07T08:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.025+0000 7f5f7ffff700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.025+0000 7f5f7ffff700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006fd0 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:20.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.029+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f78052010 con 0x7f5f800b53d0 2023-10-07T08:59:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.221+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5f8009ae30 con 0x7f5f800b53d0 2023-10-07T08:59:20.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.936+0000 7f5f7cff9700 1 -- 172.21.15.46:0/4101459389 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5f78009ab0 con 0x7f5f800b53d0 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 msgr2=0x7f5f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006fd0 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 msgr2=0x7f5f80157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800e160 tx=0x7f5f78009970 comp rx=0 tx=0).stop 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 shutdown_connections 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f80159ec0 0x7f5f800c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f800b53d0 0x7f5f80157050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 --2- 172.21.15.46:0/4101459389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f800cf350 0x7f5f80169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 >> 172.21.15.46:0/4101459389 conn(0x7f5f800999f0 msgr2=0x7f5f800c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 shutdown_connections 2023-10-07T08:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:20.940+0000 7f5f8701f700 1 -- 172.21.15.46:0/4101459389 wait complete. 2023-10-07T08:59:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T08:59:20.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:59:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.084+0000 7f735a3cf700 1 Processor -- start 2023-10-07T08:59:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 -- start start 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73540b0360 0x7f73540c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f73540caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540adf00 con 0x7f73540cd5f0 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540cda80 con 0x7f73540b0360 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.085+0000 7f735a3cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540cdd60 con 0x7f73540cd180 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7359bce700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f73540cd5f0 0x7f735406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33172/0 (socket says 172.21.15.46:33172) 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7359bce700 1 -- 172.21.15.46:0/34285078 learned_addr learned my addr 172.21.15.46:0/34285078 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 --2- 172.21.15.46:0/34285078 >> v2:172.21.15.133:3300/0 conn(0x7f73540b0360 0x7f73540c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7358bcc700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f73540caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7353fff700 1 -- 172.21.15.46:0/34285078 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683382217 0 0) 0x7f73540adf00 con 0x7f73540cd5f0 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7353fff700 1 -- 172.21.15.46:0/34285078 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003570 con 0x7f73540cd5f0 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 -- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 msgr2=0x7f73540caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f73540caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 -- 172.21.15.46:0/34285078 >> v1:172.21.15.46:6789/0 conn(0x7f73540cd5f0 legacy=0x7f735406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 -- 172.21.15.46:0/34285078 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540ce040 con 0x7f73540b0360 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f7358bcc700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f73540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.086+0000 7f73593cd700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540b0360 0x7f73540c9700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f733c0098e0 tx=0x7f733c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672e7bdb1cd29063 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f7353fff700 1 -- 172.21.15.46:0/34285078 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c011630 con 0x7f73540b0360 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f7353fff700 1 -- 172.21.15.46:0/34285078 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c011790 con 0x7f73540b0360 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f7353fff700 1 -- 172.21.15.46:0/34285078 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c011b10 con 0x7f73540b0360 2023-10-07T08:59:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 -- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540b0360 msgr2=0x7f73540c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540b0360 0x7f73540c9700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f733c0098e0 tx=0x7f733c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 -- 172.21.15.46:0/34285078 shutdown_connections 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540b0360 0x7f73540c9700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 --2- 172.21.15.46:0/34285078 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f73540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 -- 172.21.15.46:0/34285078 >> 172.21.15.46:0/34285078 conn(0x7f735406baa0 msgr2=0x7f735406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 -- 172.21.15.46:0/34285078 shutdown_connections 2023-10-07T08:59:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.087+0000 7f735a3cf700 1 -- 172.21.15.46:0/34285078 wait complete. 2023-10-07T08:59:21.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.088+0000 7f735a3cf700 1 Processor -- start 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.088+0000 7f735a3cf700 1 -- start start 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f7354167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 0x7f735415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c9300 con 0x7f73540b0360 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c68f0 con 0x7f73540cd5f0 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f735a3cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c5ce0 con 0x7f73540cd180 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f73593cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f73593cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42694/0 (socket says 172.21.15.46:42694) 2023-10-07T08:59:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f73593cd700 1 -- 172.21.15.46:0/1258001628 learned_addr learned my addr 172.21.15.46:0/1258001628 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f7359bce700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 0x7f735415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.089+0000 7f7358bcc700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f7354167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 -- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 msgr2=0x7f7354167ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f7354167ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 -- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 msgr2=0x7f735415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 0x7f735415ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 -- 172.21.15.46:0/1258001628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009a20 con 0x7f73540b0360 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f7359bce700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 0x7f735415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73593cd700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f735406f490 tx=0x7f733c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c011900 con 0x7f73540b0360 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c011a60 con 0x7f73540b0360 2023-10-07T08:59:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c009420 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c01a680 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.090+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73540c62a0 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.091+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735404c3c0 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.092+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f733c01aa30 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.092+0000 7f73517fa700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.092+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f733c085d40 con 0x7f73540b0360 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.092+0000 7f7358bcc700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.093+0000 7f7358bcc700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 0x7f73340693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7344009fd0 tx=0x7f734400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:21.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.097+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f733c0531d0 con 0x7f73540b0360 2023-10-07T08:59:21.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.288+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f735404c3c0 con 0x7f73540b0360 2023-10-07T08:59:21.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.942+0000 7f73517fa700 1 -- 172.21.15.46:0/1258001628 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f733c0567b0 con 0x7f73540b0360 2023-10-07T08:59:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.948+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 msgr2=0x7f73340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.948+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 0x7f73340693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7344009fd0 tx=0x7f734400b040 comp rx=0 tx=0).stop 2023-10-07T08:59:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.948+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 msgr2=0x7f73540b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.948+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f735406f490 tx=0x7f733c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 shutdown_connections 2023-10-07T08:59:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73540cd5f0 0x7f735415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73540b0360 0x7f73540b3bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 --2- 172.21.15.46:0/1258001628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73540cd180 0x7f7354167ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:21.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.949+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 >> 172.21.15.46:0/1258001628 conn(0x7f735406baa0 msgr2=0x7f735406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:21.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.950+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 shutdown_connections 2023-10-07T08:59:21.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:21.951+0000 7f735a3cf700 1 -- 172.21.15.46:0/1258001628 wait complete. 2023-10-07T08:59:21.962 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T08:59:21.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:59:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.098+0000 7f7409d56700 1 Processor -- start 2023-10-07T08:59:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.098+0000 7f7409d56700 1 -- start start 2023-10-07T08:59:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74040c93a0 0x7f740406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c9770 0x7f74040caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74040cb400 0x7f74040c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040af490 con 0x7f74040c93a0 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040af770 con 0x7f74040cb400 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409d56700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74040afa50 con 0x7f74040c9770 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74040c93a0 0x7f740406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74040c93a0 0x7f740406c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42710/0 (socket says 172.21.15.46:42710) 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 -- 172.21.15.46:0/3207761838 learned_addr learned my addr 172.21.15.46:0/3207761838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7409555700 1 --2- 172.21.15.46:0/3207761838 >> v2:172.21.15.133:3300/0 conn(0x7f74040cb400 0x7f74040c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7403fff700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c9770 0x7f74040caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 -- 172.21.15.46:0/3207761838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c9770 msgr2=0x7f74040caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c9770 0x7f74040caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 -- 172.21.15.46:0/3207761838 >> v2:172.21.15.133:3300/0 conn(0x7f74040cb400 msgr2=0x7f74040c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 --2- 172.21.15.46:0/3207761838 >> v2:172.21.15.133:3300/0 conn(0x7f74040cb400 0x7f74040c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.099+0000 7f7408d54700 1 -- 172.21.15.46:0/3207761838 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040c7ab0 con 0x7f74040c93a0 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7408d54700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040c93a0 0x7f740406c980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f74040cca30 tx=0x7f73fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddf3cfc1ec0ad09 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f74037fe700 1 -- 172.21.15.46:0/3207761838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00e070 con 0x7f74040c93a0 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f74037fe700 1 -- 172.21.15.46:0/3207761838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00ba50 con 0x7f74040c93a0 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f74037fe700 1 -- 172.21.15.46:0/3207761838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0092e0 con 0x7f74040c93a0 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 -- 172.21.15.46:0/3207761838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040c93a0 msgr2=0x7f740406c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040c93a0 0x7f740406c980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f74040cca30 tx=0x7f73fc009840 comp rx=0 tx=0).stop 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 -- 172.21.15.46:0/3207761838 shutdown_connections 2023-10-07T08:59:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 --2- 172.21.15.46:0/3207761838 >> v2:172.21.15.133:3300/0 conn(0x7f74040cb400 0x7f74040c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040c93a0 0x7f740406c980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 --2- 172.21.15.46:0/3207761838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c9770 0x7f74040caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 -- 172.21.15.46:0/3207761838 >> 172.21.15.46:0/3207761838 conn(0x7f74040cddc0 msgr2=0x7f74040c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:22.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 -- 172.21.15.46:0/3207761838 shutdown_connections 2023-10-07T08:59:22.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.100+0000 7f7409d56700 1 -- 172.21.15.46:0/3207761838 wait complete. 2023-10-07T08:59:22.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.101+0000 7f7409d56700 1 Processor -- start 2023-10-07T08:59:22.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 -- start start 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c93a0 0x7f74041441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74040c9770 0x7f74040b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040b17f0 con 0x7f74040cb400 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740414f770 con 0x7f74040c9770 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409d56700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74040b0be0 con 0x7f74040c93a0 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409555700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409555700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42716/0 (socket says 172.21.15.46:42716) 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7409555700 1 -- 172.21.15.46:0/3325265620 learned_addr learned my addr 172.21.15.46:0/3325265620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7408d54700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c93a0 0x7f74041441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.102+0000 7f7403fff700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74040c9770 0x7f74040b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 -- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c93a0 msgr2=0x7f74041441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c93a0 0x7f74041441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 -- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74040c9770 msgr2=0x7f74040b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74040c9770 0x7f74040b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 -- 172.21.15.46:0/3325265620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009ae0 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409555700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d860 tx=0x7f73f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40125f0 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4012790 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74040b0ec0 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4012b50 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.103+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74040b1480 con 0x7f74040cb400 2023-10-07T08:59:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.104+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74040b19a0 con 0x7f74040cb400 2023-10-07T08:59:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.105+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73f4013480 con 0x7f74040cb400 2023-10-07T08:59:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.105+0000 7f7400ff9700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 0x7f73f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.105+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f73f40847a0 con 0x7f74040cb400 2023-10-07T08:59:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.105+0000 7f7408d54700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 0x7f73f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.106+0000 7f7408d54700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 0x7f73f00693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009880 tx=0x7f73fc018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.110+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74040b19a0 con 0x7f74040cb400 2023-10-07T08:59:22.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.347+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74040b1930 con 0x7f74040cb400 2023-10-07T08:59:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.944+0000 7f7400ff9700 1 -- 172.21.15.46:0/3325265620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f73f4055500 con 0x7f74040cb400 2023-10-07T08:59:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.953+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 msgr2=0x7f73f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.953+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 0x7f73f00693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009880 tx=0x7f73fc018000 comp rx=0 tx=0).stop 2023-10-07T08:59:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.953+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 msgr2=0x7f74040b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.953+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d860 tx=0x7f73f4008040 comp rx=0 tx=0).stop 2023-10-07T08:59:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 shutdown_connections 2023-10-07T08:59:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f73f0066f30 0x7f73f00693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74040cb400 0x7f74040b05d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74040c93a0 0x7f74041441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 --2- 172.21.15.46:0/3325265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74040c9770 0x7f74040b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:22.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.957+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 >> 172.21.15.46:0/3325265620 conn(0x7f74040cddc0 msgr2=0x7f74040c2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:22.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.959+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 shutdown_connections 2023-10-07T08:59:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:22.963+0000 7f7409d56700 1 -- 172.21.15.46:0/3325265620 wait complete. 2023-10-07T08:59:22.977 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 4 and data pool 5 2023-10-07T08:59:22.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.111+0000 7f16c2011700 1 Processor -- start 2023-10-07T08:59:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.111+0000 7f16c2011700 1 -- start start 2023-10-07T08:59:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16c2011700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16bc0b5ea0 0x7f16bc068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16c2011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc068bb0 0x7f16bc15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16c2011700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc15c480 con 0x7f16bc159c10 2023-10-07T08:59:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16c2011700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16bc0b2a40 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16c2011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc15b870 con 0x7f16bc068bb0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16bc0b5ea0 0x7f16bc068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16bc0b5ea0 0x7f16bc068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42718/0 (socket says 172.21.15.46:42718) 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 -- 172.21.15.46:0/2294707508 learned_addr learned my addr 172.21.15.46:0/2294707508 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16bbfff700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc068bb0 0x7f16bc15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 -- 172.21.15.46:0/2294707508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc068bb0 msgr2=0x7f16bc15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc068bb0 0x7f16bc15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 -- 172.21.15.46:0/2294707508 >> v1:172.21.15.133:6789/0 conn(0x7f16bc159c10 legacy=0x7f16bc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 -- 172.21.15.46:0/2294707508 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc15bb50 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16baffd700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc068670 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099b0 tx=0x7f16a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a223e81b3e40b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.112+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2294707508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a400b820 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2294707508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a400b980 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2294707508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a400bd20 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 -- 172.21.15.46:0/2294707508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc0b5ea0 msgr2=0x7f16bc068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc068670 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099b0 tx=0x7f16a4009250 comp rx=0 tx=0).stop 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 -- 172.21.15.46:0/2294707508 shutdown_connections 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc068bb0 0x7f16bc15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 --2- 172.21.15.46:0/2294707508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc068670 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 -- 172.21.15.46:0/2294707508 >> 172.21.15.46:0/2294707508 conn(0x7f16bc099a20 msgr2=0x7f16bc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 -- 172.21.15.46:0/2294707508 shutdown_connections 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.113+0000 7f16c2011700 1 -- 172.21.15.46:0/2294707508 wait complete. 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.114+0000 7f16c2011700 1 Processor -- start 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.114+0000 7f16c2011700 1 -- start start 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 0x7f16bc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0afa90 con 0x7f16bc068bb0 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0afd70 con 0x7f16bc0b5ea0 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16c2011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0b0050 con 0x7f16bc159c10 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42722/0 (socket says 172.21.15.46:42722) 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 -- 172.21.15.46:0/2989447249 learned_addr learned my addr 172.21.15.46:0/2989447249 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16baffd700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bbfff700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 0x7f16bc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 -- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 msgr2=0x7f16bc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 0x7f16bc15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 -- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16bc0b5ea0 msgr2=0x7f16bc0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bb7fe700 1 -- 172.21.15.46:0/2989447249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40094f0 con 0x7f16bc068bb0 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.115+0000 7f16bbfff700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 0x7f16bc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16bb7fe700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00b5e0 tx=0x7f16ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00f510 con 0x7f16bc068bb0 2023-10-07T08:59:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00f670 con 0x7f16bc068bb0 2023-10-07T08:59:23.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc0b0330 con 0x7f16bc068bb0 2023-10-07T08:59:23.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00fa30 con 0x7f16bc068bb0 2023-10-07T08:59:23.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.116+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc16c9a0 con 0x7f16bc068bb0 2023-10-07T08:59:23.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.117+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc04c3c0 con 0x7f16bc068bb0 2023-10-07T08:59:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.117+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16ac01a400 con 0x7f16bc068bb0 2023-10-07T08:59:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.117+0000 7f16b37fe700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 0x7f169c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.118+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16ac083fd0 con 0x7f16bc068bb0 2023-10-07T08:59:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.118+0000 7f16baffd700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 0x7f169c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.118+0000 7f16baffd700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 0x7f169c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099b0 tx=0x7f16a4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.122+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16ac0512c0 con 0x7f16bc068bb0 2023-10-07T08:59:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.315+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16bc15be30 con 0x7f16bc068bb0 2023-10-07T08:59:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.316+0000 7f16b37fe700 1 -- 172.21.15.46:0/2989447249 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f16ac0548e0 con 0x7f16bc068bb0 2023-10-07T08:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:22.348753+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 msgr2=0x7f169c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 0x7f169c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099b0 tx=0x7f16a4016000 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 msgr2=0x7f16bc16c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00b5e0 tx=0x7f16ac009120 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 shutdown_connections 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f169c066f30 0x7f169c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16bc159c10 0x7f16bc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16bc068bb0 0x7f16bc16c460 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 --2- 172.21.15.46:0/2989447249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16bc0b5ea0 0x7f16bc0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 >> 172.21.15.46:0/2989447249 conn(0x7f16bc099a20 msgr2=0x7f16bc0b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 shutdown_connections 2023-10-07T08:59:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.318+0000 7f16c2011700 1 -- 172.21.15.46:0/2989447249 wait complete. 2023-10-07T08:59:23.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.448+0000 7fb4758dc700 1 Processor -- start 2023-10-07T08:59:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 -- start start 2023-10-07T08:59:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb47006bcd0 0x7fb4700caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47015df50 0x7fb47015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47015d7e0 con 0x7fb47006c0a0 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015dac0 con 0x7fb47006bcd0 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.449+0000 7fb4758dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015aa30 con 0x7fb47015df50 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb47006bcd0 0x7fb4700caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb47006bcd0 0x7fb4700caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42734/0 (socket says 172.21.15.46:42734) 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 -- 172.21.15.46:0/1417302301 learned_addr learned my addr 172.21.15.46:0/1417302301 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46f7fe700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47015df50 0x7fb47015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 -- 172.21.15.46:0/1417302301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47015df50 msgr2=0x7fb47015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47015df50 0x7fb47015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 -- 172.21.15.46:0/1417302301 >> v1:172.21.15.133:6789/0 conn(0x7fb47006c0a0 legacy=0x7fb47015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 -- 172.21.15.46:0/1417302301 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47015ad10 con 0x7fb47006bcd0 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46effd700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47006bcd0 0x7fb4700caa90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb460009f20 tx=0x7fb460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff333f927e5c2fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46dffb700 1 -- 172.21.15.46:0/1417302301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000e070 con 0x7fb47006bcd0 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46dffb700 1 -- 172.21.15.46:0/1417302301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000b9d0 con 0x7fb47006bcd0 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.450+0000 7fb46dffb700 1 -- 172.21.15.46:0/1417302301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600092e0 con 0x7fb47006bcd0 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 -- 172.21.15.46:0/1417302301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47006bcd0 msgr2=0x7fb4700caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47006bcd0 0x7fb4700caa90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb460009f20 tx=0x7fb460009840 comp rx=0 tx=0).stop 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 -- 172.21.15.46:0/1417302301 shutdown_connections 2023-10-07T08:59:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47015df50 0x7fb47015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 --2- 172.21.15.46:0/1417302301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47006bcd0 0x7fb4700caa90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 -- 172.21.15.46:0/1417302301 >> 172.21.15.46:0/1417302301 conn(0x7fb4700ce600 msgr2=0x7fb4700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 -- 172.21.15.46:0/1417302301 shutdown_connections 2023-10-07T08:59:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.451+0000 7fb4758dc700 1 -- 172.21.15.46:0/1417302301 wait complete. 2023-10-07T08:59:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.452+0000 7fb4758dc700 1 Processor -- start 2023-10-07T08:59:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.452+0000 7fb4758dc700 1 -- start start 2023-10-07T08:59:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47006bcd0 0x7fb470143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 0x7fb4700c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700c6130 con 0x7fb47015df50 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701584d0 con 0x7fb47006c0a0 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb4758dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb470157ef0 con 0x7fb47006bcd0 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42736/0 (socket says 172.21.15.46:42736) 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 -- 172.21.15.46:0/2612182912 learned_addr learned my addr 172.21.15.46:0/2612182912 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46effd700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47006bcd0 0x7fb470143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46e7fc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 0x7fb4700c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 -- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47006bcd0 msgr2=0x7fb470143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47006bcd0 0x7fb470143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 -- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 msgr2=0x7fb4700c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 0x7fb4700c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 -- 172.21.15.46:0/2612182912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460009ae0 con 0x7fb47015df50 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46e7fc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 0x7fb4700c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb46f7fe700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb46800ea80 tx=0x7fb4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.453+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800c850 con 0x7fb47015df50 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.454+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800c9d0 con 0x7fb47015df50 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.454+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4700c8680 con 0x7fb47015df50 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.454+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800cd90 con 0x7fb47015df50 2023-10-07T08:59:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.454+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4700c8960 con 0x7fb47015df50 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.455+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47004c3c0 con 0x7fb47015df50 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.455+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb468013680 con 0x7fb47015df50 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.455+0000 7fb466ffd700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.456+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb468084800 con 0x7fb47015df50 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.456+0000 7fb46effd700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.456+0000 7fb46effd700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 0x7fb4500693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb470167d10 tx=0x7fb460018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.460+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb468051a70 con 0x7fb47015df50 2023-10-07T08:59:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.652+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb470158640 con 0x7fb47015df50 2023-10-07T08:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.653+0000 7fb466ffd700 1 -- 172.21.15.46:0/2612182912 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fb468055090 con 0x7fb47015df50 2023-10-07T08:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:22.348753+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 msgr2=0x7fb4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 0x7fb4500693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb470167d10 tx=0x7fb460018000 comp rx=0 tx=0).stop 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 msgr2=0x7fb4700c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb46800ea80 tx=0x7fb4680091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 shutdown_connections 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb47015df50 0x7fb4700c5bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb47006bcd0 0x7fb470143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 --2- 172.21.15.46:0/2612182912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb47006c0a0 0x7fb4700c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:23.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 >> 172.21.15.46:0/2612182912 conn(0x7fb4700ce600 msgr2=0x7fb4700c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:23.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 shutdown_connections 2023-10-07T08:59:23.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.655+0000 7fb4758dc700 1 -- 172.21.15.46:0/2612182912 wait complete. 2023-10-07T08:59:23.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:59:23.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.951+0000 7fc518312700 1 Processor -- start 2023-10-07T08:59:24.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.951+0000 7fc518312700 1 -- start start 2023-10-07T08:59:24.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc518312700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc51006bcd0 0x7fc510140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc518312700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 0x7fc510141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc518312700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51015c2a0 con 0x7fc51006c0a0 2023-10-07T08:59:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc518312700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51015b690 con 0x7fc51006bcd0 2023-10-07T08:59:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc518312700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51015b970 con 0x7fc5100c9510 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5158ad700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc51006c0a0 0x7fc5100c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33180/0 (socket says 172.21.15.46:33180) 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5158ad700 1 -- 172.21.15.46:0/4165680343 learned_addr learned my addr 172.21.15.46:0/4165680343 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5160ae700 1 --2- 172.21.15.46:0/4165680343 >> v2:172.21.15.133:3300/0 conn(0x7fc51006bcd0 0x7fc510140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5168af700 1 --2- 172.21.15.46:0/4165680343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 0x7fc510141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5168af700 1 -- 172.21.15.46:0/4165680343 >> v2:172.21.15.133:3300/0 conn(0x7fc51006bcd0 msgr2=0x7fc510140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5150ac700 1 -- 172.21.15.46:0/4165680343 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110432389 0 0) 0x7fc51015c2a0 con 0x7fc51006c0a0 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5168af700 1 --2- 172.21.15.46:0/4165680343 >> v2:172.21.15.133:3300/0 conn(0x7fc51006bcd0 0x7fc510140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5168af700 1 -- 172.21.15.46:0/4165680343 >> v1:172.21.15.46:6789/0 conn(0x7fc51006c0a0 legacy=0x7fc5100c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.952+0000 7fc5168af700 1 -- 172.21.15.46:0/4165680343 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51015bc50 con 0x7fc5100c9510 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.953+0000 7fc5168af700 1 --2- 172.21.15.46:0/4165680343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 0x7fc510141330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc508009e60 tx=0x7fc508009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9806b1f55f3e7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.953+0000 7fc5150ac700 1 -- 172.21.15.46:0/4165680343 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50800e070 con 0x7fc5100c9510 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.953+0000 7fc5150ac700 1 -- 172.21.15.46:0/4165680343 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50800bb60 con 0x7fc5100c9510 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.953+0000 7fc5150ac700 1 -- 172.21.15.46:0/4165680343 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508012430 con 0x7fc5100c9510 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 -- 172.21.15.46:0/4165680343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 msgr2=0x7fc510141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 --2- 172.21.15.46:0/4165680343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 0x7fc510141330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc508009e60 tx=0x7fc508009780 comp rx=0 tx=0).stop 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 -- 172.21.15.46:0/4165680343 shutdown_connections 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 --2- 172.21.15.46:0/4165680343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5100c9510 0x7fc510141330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 --2- 172.21.15.46:0/4165680343 >> v2:172.21.15.133:3300/0 conn(0x7fc51006bcd0 0x7fc510140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.954+0000 7fc518312700 1 -- 172.21.15.46:0/4165680343 >> 172.21.15.46:0/4165680343 conn(0x7fc5100ce600 msgr2=0x7fc5100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.958+0000 7fc518312700 1 -- 172.21.15.46:0/4165680343 shutdown_connections 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.958+0000 7fc518312700 1 -- 172.21.15.46:0/4165680343 wait complete. 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.959+0000 7fc518312700 1 Processor -- start 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.959+0000 7fc518312700 1 -- start start 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc51006bcd0 0x7fc51006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5100c9510 0x7fc510157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100c7850 con 0x7fc51006c0a0 2023-10-07T08:59:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100c6c40 con 0x7fc5100c9510 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc518312700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100c6f20 con 0x7fc51006bcd0 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42740/0 (socket says 172.21.15.46:42740) 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 -- 172.21.15.46:0/955188431 learned_addr learned my addr 172.21.15.46:0/955188431 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5168af700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5100c9510 0x7fc510157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5160ae700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc51006bcd0 0x7fc51006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 -- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc51006bcd0 msgr2=0x7fc51006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc51006bcd0 0x7fc51006ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 -- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5100c9510 msgr2=0x7fc510157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5100c9510 0x7fc510157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 -- 172.21.15.46:0/955188431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009a20 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.960+0000 7fc5158ad700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc50000c7e0 tx=0x7fc500007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.961+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500005b30 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.961+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500005c90 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.961+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5100c7200 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.961+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500007300 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.961+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51006b2c0 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.962+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5100c7a00 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.962+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc50001b3b0 con 0x7fc51006c0a0 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.962+0000 7fc5067fc700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 0x7fc4f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:24.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.962+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc500083a50 con 0x7fc51006c0a0 2023-10-07T08:59:24.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.963+0000 7fc5160ae700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 0x7fc4f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:24.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.963+0000 7fc5160ae700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 0x7fc4f40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009db0 tx=0x7fc50c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:24.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:23.967+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5100c7a00 con 0x7fc51006c0a0 2023-10-07T08:59:24.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.204+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc51004c3c0 con 0x7fc51006c0a0 2023-10-07T08:59:24.920 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-10-07T08:59:24.919+0000 7efe0e0e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:59:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.961+0000 7fc5067fc700 1 -- 172.21.15.46:0/955188431 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc500017020 con 0x7fc51006c0a0 2023-10-07T08:59:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 msgr2=0x7fc4f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 0x7fc4f40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009db0 tx=0x7fc50c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 msgr2=0x7fc510157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc50000c7e0 tx=0x7fc500007df0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 shutdown_connections 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4f4066f30 0x7fc4f40693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5100c9510 0x7fc510157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc51006bcd0 0x7fc51006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 --2- 172.21.15.46:0/955188431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51006c0a0 0x7fc510157760 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 >> 172.21.15.46:0/955188431 conn(0x7fc5100ce600 msgr2=0x7fc5100cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 shutdown_connections 2023-10-07T08:59:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:24.964+0000 7fc518312700 1 -- 172.21.15.46:0/955188431 wait complete. 2023-10-07T08:59:25.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:59:25.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.393+0000 7f3e878a0700 1 Processor -- start 2023-10-07T08:59:25.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.393+0000 7f3e878a0700 1 -- start start 2023-10-07T08:59:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e878a0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e878a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e80159c60 0x7f3e8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e878a0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8015a160 con 0x7f3e8015db10 2023-10-07T08:59:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e878a0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800d13a0 con 0x7f3e80159c60 2023-10-07T08:59:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e878a0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8015e140 con 0x7f3e80159890 2023-10-07T08:59:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e85e3d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e8015db10 0x7f3e80069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33194/0 (socket says 172.21.15.46:33194) 2023-10-07T08:59:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e85e3d700 1 -- 172.21.15.46:0/764177925 learned_addr learned my addr 172.21.15.46:0/764177925 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e84e3b700 1 --2- 172.21.15.46:0/764177925 >> v2:172.21.15.133:3300/0 conn(0x7f3e80159c60 0x7f3e8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e8563c700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479209712 0 0) 0x7f3e8015a160 con 0x7f3e8015db10 2023-10-07T08:59:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e68003570 con 0x7f3e8015db10 2023-10-07T08:59:26.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e84e3b700 1 -- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 msgr2=0x7f3e8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:26.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e84e3b700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e8015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e84e3b700 1 -- 172.21.15.46:0/764177925 >> v1:172.21.15.46:6789/0 conn(0x7f3e8015db10 legacy=0x7f3e80069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675077779 0 0) 0x7f3e68003570 con 0x7f3e8015db10 2023-10-07T08:59:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.394+0000 7f3e84e3b700 1 -- 172.21.15.46:0/764177925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8015a3d0 con 0x7f3e80159c60 2023-10-07T08:59:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e84e3b700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e8015d5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e740098e0 tx=0x7f3e740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7806c143a6db6d05 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780017f0 con 0x7f3e80159c60 2023-10-07T08:59:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74011420 con 0x7f3e80159c60 2023-10-07T08:59:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e7ffff700 1 -- 172.21.15.46:0/764177925 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740117a0 con 0x7f3e80159c60 2023-10-07T08:59:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 -- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 msgr2=0x7f3e8015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e8015d5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e740098e0 tx=0x7f3e740091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 -- 172.21.15.46:0/764177925 shutdown_connections 2023-10-07T08:59:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e8015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 --2- 172.21.15.46:0/764177925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e8015d5d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.395+0000 7f3e878a0700 1 -- 172.21.15.46:0/764177925 >> 172.21.15.46:0/764177925 conn(0x7f3e80068e20 msgr2=0x7f3e800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.396+0000 7f3e878a0700 1 -- 172.21.15.46:0/764177925 shutdown_connections 2023-10-07T08:59:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.396+0000 7f3e878a0700 1 -- 172.21.15.46:0/764177925 wait complete. 2023-10-07T08:59:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.397+0000 7f3e878a0700 1 Processor -- start 2023-10-07T08:59:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.397+0000 7f3e878a0700 1 -- start start 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e80147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e800cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800b6100 con 0x7f3e8015db10 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800cd710 con 0x7f3e80159c60 2023-10-07T08:59:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800b5af0 con 0x7f3e80159890 2023-10-07T08:59:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42752/0 (socket says 172.21.15.46:42752) 2023-10-07T08:59:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 -- 172.21.15.46:0/3555121448 learned_addr learned my addr 172.21.15.46:0/3555121448 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e84e3b700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e800cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e8563c700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e80147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 -- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 msgr2=0x7f3e80147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e80147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 -- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 msgr2=0x7f3e800cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e800cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 -- 172.21.15.46:0/3555121448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009420 con 0x7f3e8015db10 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e85e3d700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cb90 tx=0x7f3e780015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78004dc0 con 0x7f3e8015db10 2023-10-07T08:59:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800a5d0 con 0x7f3e8015db10 2023-10-07T08:59:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800cfea0 con 0x7f3e8015db10 2023-10-07T08:59:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.398+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800a990 con 0x7f3e8015db10 2023-10-07T08:59:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.399+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800b5d90 con 0x7f3e8015db10 2023-10-07T08:59:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.399+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e800b6270 con 0x7f3e8015db10 2023-10-07T08:59:26.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.400+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e7800ad40 con 0x7f3e8015db10 2023-10-07T08:59:26.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.400+0000 7f3e7d7fa700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.400+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e78083eb0 con 0x7f3e8015db10 2023-10-07T08:59:26.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.401+0000 7f3e8563c700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.401+0000 7f3e8563c700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 0x7f3e6c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009db0 tx=0x7f3e700091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.405+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e780511a0 con 0x7f3e8015db10 2023-10-07T08:59:26.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.643+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3e8004c3c0 con 0x7f3e8015db10 2023-10-07T08:59:26.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.968+0000 7f3e7d7fa700 1 -- 172.21.15.46:0/3555121448 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e780180c0 con 0x7f3e8015db10 2023-10-07T08:59:26.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.970+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 msgr2=0x7f3e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.970+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 0x7f3e6c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009db0 tx=0x7f3e700091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.970+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 msgr2=0x7f3e800c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.970+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cb90 tx=0x7f3e780015b0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 shutdown_connections 2023-10-07T08:59:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e8015db10 0x7f3e800c67e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e80159890 0x7f3e80147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 --2- 172.21.15.46:0/3555121448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e80159c60 0x7f3e800cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 >> 172.21.15.46:0/3555121448 conn(0x7f3e80068e20 msgr2=0x7f3e80153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 shutdown_connections 2023-10-07T08:59:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:25.971+0000 7f3e878a0700 1 -- 172.21.15.46:0/3555121448 wait complete. 2023-10-07T08:59:26.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.167+0000 7f717ff09700 1 Processor -- start 2023-10-07T08:59:26.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.167+0000 7f717ff09700 1 -- start start 2023-10-07T08:59:26.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717ff09700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7178159890 0x7f717815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717ff09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f71780699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717ff09700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7178069ee0 con 0x7f7178159c60 2023-10-07T08:59:26.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717ff09700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717815a160 con 0x7f7178159890 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717ff09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780d13a0 con 0x7f7178069560 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717dca5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7178159890 0x7f717815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717dca5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7178159890 0x7f717815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42764/0 (socket says 172.21.15.46:42764) 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.168+0000 7f717dca5700 1 -- 172.21.15.46:0/3749634533 learned_addr learned my addr 172.21.15.46:0/3749634533 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717e4a6700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f71780699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717dca5700 1 -- 172.21.15.46:0/3749634533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 msgr2=0x7f71780699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:26.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717dca5700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f71780699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717dca5700 1 -- 172.21.15.46:0/3749634533 >> v1:172.21.15.133:6789/0 conn(0x7f7178159c60 legacy=0x7f717815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717dca5700 1 -- 172.21.15.46:0/3749634533 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717815e140 con 0x7f7178159890 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717e4a6700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f71780699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717dca5700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159890 0x7f717815abd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71700099b0 tx=0x7f7170009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a079767c8ae138b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717cca3700 1 -- 172.21.15.46:0/3749634533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000b820 con 0x7f7178159890 2023-10-07T08:59:26.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717cca3700 1 -- 172.21.15.46:0/3749634533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000b980 con 0x7f7178159890 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717cca3700 1 -- 172.21.15.46:0/3749634533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000bd20 con 0x7f7178159890 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717ff09700 1 -- 172.21.15.46:0/3749634533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159890 msgr2=0x7f717815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.169+0000 7f717ff09700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159890 0x7f717815abd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71700099b0 tx=0x7f7170009250 comp rx=0 tx=0).stop 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 -- 172.21.15.46:0/3749634533 shutdown_connections 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f71780699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 --2- 172.21.15.46:0/3749634533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159890 0x7f717815abd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 -- 172.21.15.46:0/3749634533 >> 172.21.15.46:0/3749634533 conn(0x7f7178068e20 msgr2=0x7f71780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 -- 172.21.15.46:0/3749634533 shutdown_connections 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.170+0000 7f717ff09700 1 -- 172.21.15.46:0/3749634533 wait complete. 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 Processor -- start 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 -- start start 2023-10-07T08:59:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f717816a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 0x7f71780ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780cf2a0 con 0x7f7178159c60 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780cdb00 con 0x7f7178159890 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.171+0000 7f717ff09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780cf4d0 con 0x7f7178069560 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42766/0 (socket says 172.21.15.46:42766) 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 -- 172.21.15.46:0/759831442 learned_addr learned my addr 172.21.15.46:0/759831442 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717d4a4700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 0x7f71780ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 -- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 msgr2=0x7f717816a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717dca5700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f717816a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f717816a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 -- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 msgr2=0x7f71780ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 0x7f71780ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 -- 172.21.15.46:0/759831442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700094f0 con 0x7f7178159c60 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717d4a4700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 0x7f71780ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717e4a6700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f716800cef0 tx=0x7f7168007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716800ae00 con 0x7f7178159c60 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7168016420 con 0x7f7178159c60 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780cd1d0 con 0x7f7178159c60 2023-10-07T08:59:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680167e0 con 0x7f7178159c60 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.172+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780cd790 con 0x7f7178159c60 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.173+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780cdc70 con 0x7f7178159c60 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.174+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7168016bd0 con 0x7f7178159c60 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.174+0000 7f7175ffb700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.174+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7168012070 con 0x7f7178159c60 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.174+0000 7f717dca5700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.175+0000 7f717dca5700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 0x7f71640693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71700099b0 tx=0x7f7170016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.178+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f716804e5a0 con 0x7f7178159c60 2023-10-07T08:59:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.415+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f717804c3c0 con 0x7f7178159c60 2023-10-07T08:59:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.415+0000 7f7175ffb700 1 -- 172.21.15.46:0/759831442 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f7168052140 con 0x7f7178159c60 2023-10-07T08:59:26.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:26.417 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1068755666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1068755666},{"type":"v1","addr":"172.21.15.133:6837","nonce":1068755666}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 msgr2=0x7f71640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 0x7f71640693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71700099b0 tx=0x7f7170016000 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 msgr2=0x7f7178148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f716800cef0 tx=0x7f7168007860 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 shutdown_connections 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7178159c60 0x7f7178148220 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7178069560 0x7f717816a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 --2- 172.21.15.46:0/759831442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7178159890 0x7f71780ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 >> 172.21.15.46:0/759831442 conn(0x7f7178068e20 msgr2=0x7f717815b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 shutdown_connections 2023-10-07T08:59:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.418+0000 7f717ff09700 1 -- 172.21.15.46:0/759831442 wait complete. 2023-10-07T08:59:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2023-10-07T08:59:26.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.548+0000 7faee562c700 1 Processor -- start 2023-10-07T08:59:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.548+0000 7faee562c700 1 -- start start 2023-10-07T08:59:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faee562c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faee0141500 0x7faee00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faee562c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee015c2a0 con 0x7faee006bcd0 2023-10-07T08:59:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faee562c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee015b690 con 0x7faee006c0a0 2023-10-07T08:59:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faee562c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee015b970 con 0x7faee0141500 2023-10-07T08:59:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faede7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faee0141500 0x7faee00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faedeffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faee006bcd0 0x7faee0140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33210/0 (socket says 172.21.15.46:33210) 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faede7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faee0141500 0x7faee00c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42774/0 (socket says 172.21.15.46:42774) 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.549+0000 7faedeffd700 1 -- 172.21.15.46:0/3894898011 learned_addr learned my addr 172.21.15.46:0/3894898011 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faede7fc700 1 -- 172.21.15.46:0/3894898011 >> v1:172.21.15.133:6789/0 conn(0x7faee006c0a0 legacy=0x7faee00c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faede7fc700 1 -- 172.21.15.46:0/3894898011 >> v1:172.21.15.46:6789/0 conn(0x7faee006bcd0 legacy=0x7faee0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faeddffb700 1 -- 172.21.15.46:0/3894898011 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027476928 0 0) 0x7faee015c2a0 con 0x7faee006bcd0 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faede7fc700 1 -- 172.21.15.46:0/3894898011 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee015bc50 con 0x7faee0141500 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faede7fc700 1 --2- 172.21.15.46:0/3894898011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00c8e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faec80098e0 tx=0x7faec80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64473e6f71c220c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faeddffb700 1 -- 172.21.15.46:0/3894898011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8009e80 con 0x7faee0141500 2023-10-07T08:59:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faeddffb700 1 -- 172.21.15.46:0/3894898011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800b860 con 0x7faee0141500 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faeddffb700 1 -- 172.21.15.46:0/3894898011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800bbe0 con 0x7faee0141500 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 -- 172.21.15.46:0/3894898011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 msgr2=0x7faee00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 --2- 172.21.15.46:0/3894898011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00c8e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faec80098e0 tx=0x7faec80091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 -- 172.21.15.46:0/3894898011 shutdown_connections 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 --2- 172.21.15.46:0/3894898011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00c8e00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 -- 172.21.15.46:0/3894898011 >> 172.21.15.46:0/3894898011 conn(0x7faee00ce600 msgr2=0x7faee00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.550+0000 7faee562c700 1 -- 172.21.15.46:0/3894898011 shutdown_connections 2023-10-07T08:59:26.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.551+0000 7faee562c700 1 -- 172.21.15.46:0/3894898011 wait complete. 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 Processor -- start 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 -- start start 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 0x7faee013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee006c0a0 0x7faee00cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c63f0 con 0x7faee0141500 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c57e0 con 0x7faee006c0a0 2023-10-07T08:59:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.552+0000 7faee562c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c5ac0 con 0x7faee006bcd0 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42786/0 (socket says 172.21.15.46:42786) 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 -- 172.21.15.46:0/2639712287 learned_addr learned my addr 172.21.15.46:0/2639712287 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faede7fc700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee006c0a0 0x7faee00cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedeffd700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 0x7faee013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 -- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 msgr2=0x7faee013fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 0x7faee013fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 -- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee006c0a0 msgr2=0x7faee00cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee006c0a0 0x7faee00cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 -- 172.21.15.46:0/2639712287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8009420 con 0x7faee0141500 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedeffd700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 0x7faee013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faedf7fe700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faed000c8e0 tx=0x7faed0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000ce80 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000a7e0 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00c5da0 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000aba0 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.553+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01400e0 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.554+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004c3c0 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.555+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed0003030 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.555+0000 7faed6ffd700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.555+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faed0084540 con 0x7faee0141500 2023-10-07T08:59:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.555+0000 7faedeffd700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.556+0000 7faedeffd700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faed8000c00 tx=0x7faed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.559+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed00517b0 con 0x7faee0141500 2023-10-07T08:59:26.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.753+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee00c6530 con 0x7faee0141500 2023-10-07T08:59:26.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.754+0000 7faed6ffd700 1 -- 172.21.15.46:0/2639712287 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7faed0054dd0 con 0x7faee0141500 2023-10-07T08:59:26.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:26.755 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:23.950952+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 msgr2=0x7faec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faed8000c00 tx=0x7faed8009040 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 msgr2=0x7faee00cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faed000c8e0 tx=0x7faed0001710 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 shutdown_connections 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee0141500 0x7faee00cd870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faee006bcd0 0x7faee013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 --2- 172.21.15.46:0/2639712287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee006c0a0 0x7faee00cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 >> 172.21.15.46:0/2639712287 conn(0x7faee00ce600 msgr2=0x7faee00c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 shutdown_connections 2023-10-07T08:59:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.756+0000 7faee562c700 1 -- 172.21.15.46:0/2639712287 wait complete. 2023-10-07T08:59:26.769 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:59:26.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:59:26.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.888+0000 7f2d5d3b2700 1 Processor -- start 2023-10-07T08:59:26.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.888+0000 7f2d5d3b2700 1 -- start start 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d5d3b2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d580cd0f0 0x7f2d581598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d5d3b2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580d01f0 con 0x7f2d58159de0 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d5d3b2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580cd540 con 0x7f2d581594d0 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d5d3b2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d580cf5e0 con 0x7f2d580cd0f0 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d577fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2d58159de0 0x7f2d580b1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33216/0 (socket says 172.21.15.46:33216) 2023-10-07T08:59:26.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d577fe700 1 -- 172.21.15.46:0/1634501689 learned_addr learned my addr 172.21.15.46:0/1634501689 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d567fc700 1 --2- 172.21.15.46:0/1634501689 >> v2:172.21.15.133:3300/0 conn(0x7f2d580cd0f0 0x7f2d581598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512577876 0 0) 0x7f2d580d01f0 con 0x7f2d58159de0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.889+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d44003570 con 0x7f2d58159de0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624473037 0 0) 0x7f2d580cd540 con 0x7f2d581594d0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d580d01f0 con 0x7f2d581594d0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d567fc700 1 -- 172.21.15.46:0/1634501689 >> v1:172.21.15.133:6789/0 conn(0x7f2d581594d0 legacy=0x7f2d580b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d567fc700 1 -- 172.21.15.46:0/1634501689 >> v1:172.21.15.46:6789/0 conn(0x7f2d58159de0 legacy=0x7f2d580b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d567fc700 1 -- 172.21.15.46:0/1634501689 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580cf8c0 con 0x7f2d580cd0f0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d567fc700 1 --2- 172.21.15.46:0/1634501689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d581598a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d400098e0 tx=0x7f2d400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47758441caa70f54 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011630 con 0x7f2d580cd0f0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40011790 con 0x7f2d580cd0f0 2023-10-07T08:59:26.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.890+0000 7f2d55ffb700 1 -- 172.21.15.46:0/1634501689 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011b10 con 0x7f2d580cd0f0 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/1634501689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 msgr2=0x7f2d581598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/1634501689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d581598a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d400098e0 tx=0x7f2d400091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/1634501689 shutdown_connections 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/1634501689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d581598a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/1634501689 >> 172.21.15.46:0/1634501689 conn(0x7f2d580d05f0 msgr2=0x7f2d580d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/1634501689 shutdown_connections 2023-10-07T08:59:26.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.891+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/1634501689 wait complete. 2023-10-07T08:59:26.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.892+0000 7f2d5d3b2700 1 Processor -- start 2023-10-07T08:59:26.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.892+0000 7f2d5d3b2700 1 -- start start 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d580b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d58159de0 0x7f2d5815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58155ed0 con 0x7f2d581594d0 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5816d810 con 0x7f2d580cd0f0 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5816daf0 con 0x7f2d58159de0 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42796/0 (socket says 172.21.15.46:42796) 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 -- 172.21.15.46:0/168266149 learned_addr learned my addr 172.21.15.46:0/168266149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d56ffd700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d580b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d577fe700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d58159de0 0x7f2d5815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 -- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d58159de0 msgr2=0x7f2d5815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d58159de0 0x7f2d5815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 -- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 msgr2=0x7f2d580b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d580b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 -- 172.21.15.46:0/168266149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009420 con 0x7f2d581594d0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d567fc700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009ed0 tx=0x7f2d40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011b10 con 0x7f2d581594d0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40000c90 con 0x7f2d581594d0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5816ddd0 con 0x7f2d581594d0 2023-10-07T08:59:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4001a660 con 0x7f2d581594d0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.893+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5816d430 con 0x7f2d581594d0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.894+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5804c3c0 con 0x7f2d581594d0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.895+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d4001a9d0 con 0x7f2d581594d0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.895+0000 7f2d4effd700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.895+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d40086270 con 0x7f2d581594d0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.895+0000 7f2d56ffd700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.896+0000 7f2d56ffd700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 0x7f2d380693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007fd0 tx=0x7f2d50007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:26.899+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d40053440 con 0x7f2d581594d0 2023-10-07T08:59:27.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.088+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d580b0d40 con 0x7f2d38066f30 2023-10-07T08:59:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.095+0000 7f2d4effd700 1 -- 172.21.15.46:0/168266149 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249825 (secure 0 0 0) 0x7f2d580b0d40 con 0x7f2d38066f30 2023-10-07T08:59:27.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:27.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 msgr2=0x7f2d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 0x7f2d380693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007fd0 tx=0x7f2d50007d50 comp rx=0 tx=0).stop 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 msgr2=0x7f2d5814dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009ed0 tx=0x7f2d40017000 comp rx=0 tx=0).stop 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 shutdown_connections 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d58159de0 0x7f2d5815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d580cd0f0 0x7f2d580b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 --2- 172.21.15.46:0/168266149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d581594d0 0x7f2d5814dec0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 >> 172.21.15.46:0/168266149 conn(0x7f2d580d05f0 msgr2=0x7f2d5815eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:27.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 shutdown_connections 2023-10-07T08:59:27.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.098+0000 7f2d5d3b2700 1 -- 172.21.15.46:0/168266149 wait complete. 2023-10-07T08:59:27.104 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:59:27.111 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-07T08:59:25.773698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381992,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592728,"statfs":{"total":773094113280,"available":770654953472,"internally_reserved":0,"allocated":3776512,"data_stored":2129256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.837899"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-07T08:59:14.894778+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:14.894778+0000","last_peered":"2023-10-07T08:59:14.894778+0000","last_clean":"2023-10-07T08:59:14.894778+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:14.894778+0000","last_undegraded":"2023-10-07T08:59:14.894778+0000","last_fullsized":"2023-10-07T08:59:14.894778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:59:27.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:59:27.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.270+0000 7f50059dd700 1 Processor -- start 2023-10-07T08:59:27.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.270+0000 7f50059dd700 1 -- start start 2023-10-07T08:59:27.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50059dd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f500006c0f0 0x7f5000159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50059dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50000b3810 0x7f50000b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50059dd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5000143420 con 0x7f5000143050 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50059dd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500006a1e0 con 0x7f500006c0f0 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50059dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000695d0 con 0x7f50000b3810 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4ffffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f500006c0f0 0x7f5000159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50049db700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5000143050 0x7f500006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33226/0 (socket says 172.21.15.46:33226) 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50049db700 1 -- 172.21.15.46:0/1490940766 learned_addr learned my addr 172.21.15.46:0/1490940766 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f50051dc700 1 --2- 172.21.15.46:0/1490940766 >> v2:172.21.15.133:3300/0 conn(0x7f50000b3810 0x7f50000b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4fff7fe700 1 -- 172.21.15.46:0/1490940766 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015304637 0 0) 0x7f5000143420 con 0x7f5000143050 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4ffffff700 1 -- 172.21.15.46:0/1490940766 >> v2:172.21.15.133:3300/0 conn(0x7f50000b3810 msgr2=0x7f50000b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1490940766 >> v2:172.21.15.133:3300/0 conn(0x7f50000b3810 0x7f50000b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4ffffff700 1 -- 172.21.15.46:0/1490940766 >> v1:172.21.15.46:6789/0 conn(0x7f5000143050 legacy=0x7f500006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.271+0000 7f4ffffff700 1 -- 172.21.15.46:0/1490940766 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000698b0 con 0x7f500006c0f0 2023-10-07T08:59:27.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1490940766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000159c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f50000cda70 tx=0x7f4ff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121f96a7e739d8ce server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f4fff7fe700 1 -- 172.21.15.46:0/1490940766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011630 con 0x7f500006c0f0 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f4fff7fe700 1 -- 172.21.15.46:0/1490940766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0011790 con 0x7f500006c0f0 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f4fff7fe700 1 -- 172.21.15.46:0/1490940766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011b30 con 0x7f500006c0f0 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 -- 172.21.15.46:0/1490940766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 msgr2=0x7f5000159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 --2- 172.21.15.46:0/1490940766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000159c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f50000cda70 tx=0x7f4ff00091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 -- 172.21.15.46:0/1490940766 shutdown_connections 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 --2- 172.21.15.46:0/1490940766 >> v2:172.21.15.133:3300/0 conn(0x7f50000b3810 0x7f50000b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 --2- 172.21.15.46:0/1490940766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000159c90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 -- 172.21.15.46:0/1490940766 >> 172.21.15.46:0/1490940766 conn(0x7f50000ce430 msgr2=0x7f50000ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 -- 172.21.15.46:0/1490940766 shutdown_connections 2023-10-07T08:59:27.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.272+0000 7f50059dd700 1 -- 172.21.15.46:0/1490940766 wait complete. 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.273+0000 7f50059dd700 1 Processor -- start 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 -- start start 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 0x7f500012b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 0x7f50000af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500012ac80 con 0x7f500006c0f0 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001573e0 con 0x7f5000143050 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.274+0000 7f50059dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500012a350 con 0x7f50000b3810 2023-10-07T08:59:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42820/0 (socket says 172.21.15.46:42820) 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 -- 172.21.15.46:0/1144737234 learned_addr learned my addr 172.21.15.46:0/1144737234 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50051dc700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 0x7f50000af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 -- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 msgr2=0x7f500012b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 0x7f500012b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 0x7f500012b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 -- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 msgr2=0x7f50000af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 0x7f50000af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 -- 172.21.15.46:0/1144737234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009420 con 0x7f500006c0f0 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50051dc700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 0x7f50000af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 0x7f500012b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:27.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50049db700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c930 tx=0x7f4ff80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8005d80 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800a5d0 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500012a630 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800a990 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.275+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500012b650 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.276+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500012af60 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.277+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ff80070f0 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.277+0000 7f4ffcff9700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.277+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ff8084300 con 0x7f500006c0f0 2023-10-07T08:59:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.277+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.278+0000 7f4ffffff700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 0x7f4fe00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50000b0f30 tx=0x7f4ff0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.281+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ff80515f0 con 0x7f500006c0f0 2023-10-07T08:59:27.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.470+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f500012adc0 con 0x7f4fe0066f30 2023-10-07T08:59:27.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.477+0000 7f4ffcff9700 1 -- 172.21.15.46:0/1144737234 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249825 (secure 0 0 0) 0x7f4ff0000c90 con 0x7f4fe0066f30 2023-10-07T08:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 msgr2=0x7f4fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 0x7f4fe00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50000b0f30 tx=0x7f4ff0017000 comp rx=0 tx=0).stop 2023-10-07T08:59:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 msgr2=0x7f5000156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c930 tx=0x7f4ff80016f0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 shutdown_connections 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000143050 0x7f50000af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f500006c0f0 0x7f5000156ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 --2- 172.21.15.46:0/1144737234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b3810 0x7f500012b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 >> 172.21.15.46:0/1144737234 conn(0x7f50000ce430 msgr2=0x7f5000127410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 shutdown_connections 2023-10-07T08:59:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.480+0000 7f50059dd700 1 -- 172.21.15.46:0/1144737234 wait complete. 2023-10-07T08:59:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-07T08:59:25.773698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381992,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592728,"statfs":{"total":773094113280,"available":770654953472,"internally_reserved":0,"allocated":3776512,"data_stored":2129256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.837899"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:21.935557+0000","last_change":"2023-10-07T08:59:21.935557+0000","last_active":"2023-10-07T08:59:21.935557+0000","last_peered":"2023-10-07T08:59:21.935557+0000","last_clean":"2023-10-07T08:59:21.935557+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:21.935557+0000","last_undegraded":"2023-10-07T08:59:21.935557+0000","last_fullsized":"2023-10-07T08:59:21.935557+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:59:20.930025+0000","last_change":"2023-10-07T08:59:20.930025+0000","last_active":"2023-10-07T08:59:20.930025+0000","last_peered":"2023-10-07T08:59:20.930025+0000","last_clean":"2023-10-07T08:59:20.930025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:20.930025+0000","last_undegraded":"2023-10-07T08:59:20.930025+0000","last_fullsized":"2023-10-07T08:59:20.930025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-07T08:59:14.894778+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:14.894778+0000","last_peered":"2023-10-07T08:59:14.894778+0000","last_clean":"2023-10-07T08:59:14.894778+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:14.894778+0000","last_undegraded":"2023-10-07T08:59:14.894778+0000","last_fullsized":"2023-10-07T08:59:14.894778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:59:27.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:59:27.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.652+0000 7f303359e700 1 Processor -- start 2023-10-07T08:59:27.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.652+0000 7f303359e700 1 -- start start 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30341597f0 0x7f30340b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f303415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303415dbb0 con 0x7f3034159420 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340b11d0 con 0x7f30341597f0 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b14b0 con 0x7f303415d230 2023-10-07T08:59:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3034159420 0x7f30340b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33236/0 (socket says 172.21.15.46:33236) 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303259c700 1 -- 172.21.15.46:0/2672771727 learned_addr learned my addr 172.21.15.46:0/2672771727 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006562892 0 0) 0x7f303415dbb0 con 0x7f3034159420 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3020003570 con 0x7f3034159420 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f3031d9b700 1 --2- 172.21.15.46:0/2672771727 >> v2:172.21.15.133:3300/0 conn(0x7f30341597f0 0x7f30340b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.653+0000 7f3032d9d700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f303415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886631969 0 0) 0x7f3020003570 con 0x7f3034159420 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 msgr2=0x7f303415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f303415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 >> v2:172.21.15.133:3300/0 conn(0x7f30341597f0 msgr2=0x7f30340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 --2- 172.21.15.46:0/2672771727 >> v2:172.21.15.133:3300/0 conn(0x7f30341597f0 0x7f30340b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340b1790 con 0x7f3034159420 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f3024001470 con 0x7f3034159420 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 >> v1:172.21.15.46:6789/0 conn(0x7f3034159420 legacy=0x7f30340b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3020003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f3020004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020004d50 0x7f30200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b11d0 con 0x7f3020004d50 2023-10-07T08:59:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b14b0 con 0x7f3020003ae0 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302000bb10 con 0x7f303415d230 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3020003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f3032d9d700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020004d50 0x7f30200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f3031d9b700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f3020004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 -- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 msgr2=0x7f3020004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f303415d230 0x7f3020004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 -- 172.21.15.46:0/2672771727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020004d50 msgr2=0x7f30200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020004d50 0x7f30200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 -- 172.21.15.46:0/2672771727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020003570 con 0x7f3020003ae0 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f3032d9d700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3020004d50 0x7f30200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.654+0000 7f303259c700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3020003ef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f302400c300 tx=0x7f3024001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b5675fe858c433 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400cb90 con 0x7f3020003ae0 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400cd10 con 0x7f3020003ae0 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303159a700 1 -- 172.21.15.46:0/2672771727 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024005b70 con 0x7f3020003ae0 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 -- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 msgr2=0x7f3020003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 --2- 172.21.15.46:0/2672771727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3020003ef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f302400c300 tx=0x7f3024001dc0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f3032d9d700 1 -- 172.21.15.46:0/2672771727 reap_dead start 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 -- 172.21.15.46:0/2672771727 shutdown_connections 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 -- 172.21.15.46:0/2672771727 >> 172.21.15.46:0/2672771727 conn(0x7f30340d0660 msgr2=0x7f30340d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 -- 172.21.15.46:0/2672771727 shutdown_connections 2023-10-07T08:59:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.655+0000 7f303359e700 1 -- 172.21.15.46:0/2672771727 wait complete. 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.656+0000 7f303359e700 1 Processor -- start 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.656+0000 7f303359e700 1 -- start start 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3034155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30340685d0 0x7f3034068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c6fd0 con 0x7f30340c6620 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340cf6a0 con 0x7f3020003ae0 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340cea90 con 0x7f30340685d0 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42852/0 (socket says 172.21.15.46:42852) 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 -- 172.21.15.46:0/3434965723 learned_addr learned my addr 172.21.15.46:0/3434965723 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f303259c700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3034155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3032d9d700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30340685d0 0x7f3034068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 -- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30340685d0 msgr2=0x7f3034068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30340685d0 0x7f3034068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 -- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 msgr2=0x7f3034155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3034155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.657+0000 7f3031d9b700 1 -- 172.21.15.46:0/3434965723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340ced70 con 0x7f30340c6620 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f3031d9b700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f301c011ac0 tx=0x7f301c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00f940 con 0x7f30340c6620 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00faa0 con 0x7f30340c6620 2023-10-07T08:59:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340cf050 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00fe20 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.658+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034068f80 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.659+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30340cf980 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.659+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f301c014650 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.659+0000 7f302a7fc700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 0x7f30140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.660+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f301c018030 con 0x7f30340c6620 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.660+0000 7f303259c700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 0x7f30140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.660+0000 7f303259c700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 0x7f30140693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3024015040 tx=0x7f3024012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.664+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f301c052060 con 0x7f30340c6620 2023-10-07T08:59:27.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.853+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f303404c3c0 con 0x7f3014066f30 2023-10-07T08:59:27.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.861+0000 7f302a7fc700 1 -- 172.21.15.46:0/3434965723 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264653 (secure 0 0 0) 0x7f303404c3c0 con 0x7f3014066f30 2023-10-07T08:59:27.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.864+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 msgr2=0x7f30140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.864+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 0x7f30140693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3024015040 tx=0x7f3024012000 comp rx=0 tx=0).stop 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.864+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 msgr2=0x7f30340c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.864+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f301c011ac0 tx=0x7f301c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 shutdown_connections 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3014066f30 0x7f30140693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30340685d0 0x7f3034068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3020003ae0 0x7f3034155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 --2- 172.21.15.46:0/3434965723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30340c6620 0x7f30340c6a90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 >> 172.21.15.46:0/3434965723 conn(0x7f30340d0660 msgr2=0x7f3034069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 shutdown_connections 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:27.865+0000 7f303359e700 1 -- 172.21.15.46:0/3434965723 wait complete. 2023-10-07T08:59:27.869 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:59:27.878 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-07T08:59:27.774146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382440,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592280,"statfs":{"total":773094113280,"available":770654494720,"internally_reserved":0,"allocated":4235264,"data_stored":2334756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001499"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969597+0000","last_change":"2023-10-07T08:59:22.966032+0000","last_active":"2023-10-07T08:59:22.969597+0000","last_peered":"2023-10-07T08:59:22.969597+0000","last_clean":"2023-10-07T08:59:22.969597+0000","last_became_active":"2023-10-07T08:59:22.963168+0000","last_became_peered":"2023-10-07T08:59:22.963168+0000","last_unstale":"2023-10-07T08:59:22.969597+0000","last_undegraded":"2023-10-07T08:59:22.969597+0000","last_fullsized":"2023-10-07T08:59:22.969597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.975413+0000","last_change":"2023-10-07T08:59:22.968766+0000","last_active":"2023-10-07T08:59:22.975413+0000","last_peered":"2023-10-07T08:59:22.975413+0000","last_clean":"2023-10-07T08:59:22.975413+0000","last_became_active":"2023-10-07T08:59:22.968453+0000","last_became_peered":"2023-10-07T08:59:22.968453+0000","last_unstale":"2023-10-07T08:59:22.975413+0000","last_undegraded":"2023-10-07T08:59:22.975413+0000","last_fullsized":"2023-10-07T08:59:22.975413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:32.765587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969379+0000","last_change":"2023-10-07T08:59:22.966930+0000","last_active":"2023-10-07T08:59:22.969379+0000","last_peered":"2023-10-07T08:59:22.969379+0000","last_clean":"2023-10-07T08:59:22.969379+0000","last_became_active":"2023-10-07T08:59:22.966662+0000","last_became_peered":"2023-10-07T08:59:22.966662+0000","last_unstale":"2023-10-07T08:59:22.969379+0000","last_undegraded":"2023-10-07T08:59:22.969379+0000","last_fullsized":"2023-10-07T08:59:22.969379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964269+0000","last_change":"2023-10-07T08:59:22.960408+0000","last_active":"2023-10-07T08:59:22.964269+0000","last_peered":"2023-10-07T08:59:22.964269+0000","last_clean":"2023-10-07T08:59:22.964269+0000","last_became_active":"2023-10-07T08:59:22.960131+0000","last_became_peered":"2023-10-07T08:59:22.960131+0000","last_unstale":"2023-10-07T08:59:22.964269+0000","last_undegraded":"2023-10-07T08:59:22.964269+0000","last_fullsized":"2023-10-07T08:59:22.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972970+0000","last_change":"2023-10-07T08:59:22.965143+0000","last_active":"2023-10-07T08:59:22.972970+0000","last_peered":"2023-10-07T08:59:22.972970+0000","last_clean":"2023-10-07T08:59:22.972970+0000","last_became_active":"2023-10-07T08:59:22.964866+0000","last_became_peered":"2023-10-07T08:59:22.964866+0000","last_unstale":"2023-10-07T08:59:22.972970+0000","last_undegraded":"2023-10-07T08:59:22.972970+0000","last_fullsized":"2023-10-07T08:59:22.972970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:35.827887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976468+0000","last_change":"2023-10-07T08:59:22.971761+0000","last_active":"2023-10-07T08:59:22.976468+0000","last_peered":"2023-10-07T08:59:22.976468+0000","last_clean":"2023-10-07T08:59:22.976468+0000","last_became_active":"2023-10-07T08:59:22.971439+0000","last_became_peered":"2023-10-07T08:59:22.971439+0000","last_unstale":"2023-10-07T08:59:22.976468+0000","last_undegraded":"2023-10-07T08:59:22.976468+0000","last_fullsized":"2023-10-07T08:59:22.976468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:19.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976877+0000","last_change":"2023-10-07T08:59:22.971534+0000","last_active":"2023-10-07T08:59:22.976877+0000","last_peered":"2023-10-07T08:59:22.976877+0000","last_clean":"2023-10-07T08:59:22.976877+0000","last_became_active":"2023-10-07T08:59:22.967972+0000","last_became_peered":"2023-10-07T08:59:22.967972+0000","last_unstale":"2023-10-07T08:59:22.976877+0000","last_undegraded":"2023-10-07T08:59:22.976877+0000","last_fullsized":"2023-10-07T08:59:22.976877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977068+0000","last_change":"2023-10-07T08:59:22.971721+0000","last_active":"2023-10-07T08:59:22.977068+0000","last_peered":"2023-10-07T08:59:22.977068+0000","last_clean":"2023-10-07T08:59:22.977068+0000","last_became_active":"2023-10-07T08:59:22.971001+0000","last_became_peered":"2023-10-07T08:59:22.971001+0000","last_unstale":"2023-10-07T08:59:22.977068+0000","last_undegraded":"2023-10-07T08:59:22.977068+0000","last_fullsized":"2023-10-07T08:59:22.977068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959807+0000","last_change":"2023-10-07T08:59:22.954651+0000","last_active":"2023-10-07T08:59:22.959807+0000","last_peered":"2023-10-07T08:59:22.959807+0000","last_clean":"2023-10-07T08:59:22.959807+0000","last_became_active":"2023-10-07T08:59:22.954361+0000","last_became_peered":"2023-10-07T08:59:22.954361+0000","last_unstale":"2023-10-07T08:59:22.959807+0000","last_undegraded":"2023-10-07T08:59:22.959807+0000","last_fullsized":"2023-10-07T08:59:22.959807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971264+0000","last_change":"2023-10-07T08:59:22.962607+0000","last_active":"2023-10-07T08:59:22.971264+0000","last_peered":"2023-10-07T08:59:22.971264+0000","last_clean":"2023-10-07T08:59:22.971264+0000","last_became_active":"2023-10-07T08:59:22.962301+0000","last_became_peered":"2023-10-07T08:59:22.962301+0000","last_unstale":"2023-10-07T08:59:22.971264+0000","last_undegraded":"2023-10-07T08:59:22.971264+0000","last_fullsized":"2023-10-07T08:59:22.971264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971329+0000","last_change":"2023-10-07T08:59:22.965344+0000","last_active":"2023-10-07T08:59:22.971329+0000","last_peered":"2023-10-07T08:59:22.971329+0000","last_clean":"2023-10-07T08:59:22.971329+0000","last_became_active":"2023-10-07T08:59:22.965080+0000","last_became_peered":"2023-10-07T08:59:22.965080+0000","last_unstale":"2023-10-07T08:59:22.971329+0000","last_undegraded":"2023-10-07T08:59:22.971329+0000","last_fullsized":"2023-10-07T08:59:22.971329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969297+0000","last_change":"2023-10-07T08:59:22.964523+0000","last_active":"2023-10-07T08:59:22.969297+0000","last_peered":"2023-10-07T08:59:22.969297+0000","last_clean":"2023-10-07T08:59:22.969297+0000","last_became_active":"2023-10-07T08:59:22.964258+0000","last_became_peered":"2023-10-07T08:59:22.964258+0000","last_unstale":"2023-10-07T08:59:22.969297+0000","last_undegraded":"2023-10-07T08:59:22.969297+0000","last_fullsized":"2023-10-07T08:59:22.969297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957669+0000","last_change":"2023-10-07T08:59:22.950494+0000","last_active":"2023-10-07T08:59:22.957669+0000","last_peered":"2023-10-07T08:59:22.957669+0000","last_clean":"2023-10-07T08:59:22.957669+0000","last_became_active":"2023-10-07T08:59:22.950214+0000","last_became_peered":"2023-10-07T08:59:22.950214+0000","last_unstale":"2023-10-07T08:59:22.957669+0000","last_undegraded":"2023-10-07T08:59:22.957669+0000","last_fullsized":"2023-10-07T08:59:22.957669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:30.838341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.962673+0000","last_change":"2023-10-07T08:59:22.960342+0000","last_active":"2023-10-07T08:59:22.962673+0000","last_peered":"2023-10-07T08:59:22.962673+0000","last_clean":"2023-10-07T08:59:22.962673+0000","last_became_active":"2023-10-07T08:59:22.960079+0000","last_became_peered":"2023-10-07T08:59:22.960079+0000","last_unstale":"2023-10-07T08:59:22.962673+0000","last_undegraded":"2023-10-07T08:59:22.962673+0000","last_fullsized":"2023-10-07T08:59:22.962673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969326+0000","last_change":"2023-10-07T08:59:22.964021+0000","last_active":"2023-10-07T08:59:22.969326+0000","last_peered":"2023-10-07T08:59:22.969326+0000","last_clean":"2023-10-07T08:59:22.969326+0000","last_became_active":"2023-10-07T08:59:22.963657+0000","last_became_peered":"2023-10-07T08:59:22.963657+0000","last_unstale":"2023-10-07T08:59:22.969326+0000","last_undegraded":"2023-10-07T08:59:22.969326+0000","last_fullsized":"2023-10-07T08:59:22.969326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977051+0000","last_change":"2023-10-07T08:59:22.973535+0000","last_active":"2023-10-07T08:59:22.977051+0000","last_peered":"2023-10-07T08:59:22.977051+0000","last_clean":"2023-10-07T08:59:22.977051+0000","last_became_active":"2023-10-07T08:59:22.972931+0000","last_became_peered":"2023-10-07T08:59:22.972931+0000","last_unstale":"2023-10-07T08:59:22.977051+0000","last_undegraded":"2023-10-07T08:59:22.977051+0000","last_fullsized":"2023-10-07T08:59:22.977051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974028+0000","last_change":"2023-10-07T08:59:22.971177+0000","last_active":"2023-10-07T08:59:22.974028+0000","last_peered":"2023-10-07T08:59:22.974028+0000","last_clean":"2023-10-07T08:59:22.974028+0000","last_became_active":"2023-10-07T08:59:22.970888+0000","last_became_peered":"2023-10-07T08:59:22.970888+0000","last_unstale":"2023-10-07T08:59:22.974028+0000","last_undegraded":"2023-10-07T08:59:22.974028+0000","last_fullsized":"2023-10-07T08:59:22.974028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971773+0000","last_change":"2023-10-07T08:59:22.965330+0000","last_active":"2023-10-07T08:59:22.971773+0000","last_peered":"2023-10-07T08:59:22.971773+0000","last_clean":"2023-10-07T08:59:22.971773+0000","last_became_active":"2023-10-07T08:59:22.965026+0000","last_became_peered":"2023-10-07T08:59:22.965026+0000","last_unstale":"2023-10-07T08:59:22.971773+0000","last_undegraded":"2023-10-07T08:59:22.971773+0000","last_fullsized":"2023-10-07T08:59:22.971773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:11.641653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971306+0000","last_change":"2023-10-07T08:59:22.965209+0000","last_active":"2023-10-07T08:59:22.971306+0000","last_peered":"2023-10-07T08:59:22.971306+0000","last_clean":"2023-10-07T08:59:22.971306+0000","last_became_active":"2023-10-07T08:59:22.964928+0000","last_became_peered":"2023-10-07T08:59:22.964928+0000","last_unstale":"2023-10-07T08:59:22.971306+0000","last_undegraded":"2023-10-07T08:59:22.971306+0000","last_fullsized":"2023-10-07T08:59:22.971306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972998+0000","last_change":"2023-10-07T08:59:22.966234+0000","last_active":"2023-10-07T08:59:22.972998+0000","last_peered":"2023-10-07T08:59:22.972998+0000","last_clean":"2023-10-07T08:59:22.972998+0000","last_became_active":"2023-10-07T08:59:22.965971+0000","last_became_peered":"2023-10-07T08:59:22.965971+0000","last_unstale":"2023-10-07T08:59:22.972998+0000","last_undegraded":"2023-10-07T08:59:22.972998+0000","last_fullsized":"2023-10-07T08:59:22.972998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:01.809856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968900+0000","last_change":"2023-10-07T08:59:22.966063+0000","last_active":"2023-10-07T08:59:22.968900+0000","last_peered":"2023-10-07T08:59:22.968900+0000","last_clean":"2023-10-07T08:59:22.968900+0000","last_became_active":"2023-10-07T08:59:22.965785+0000","last_became_peered":"2023-10-07T08:59:22.965785+0000","last_unstale":"2023-10-07T08:59:22.968900+0000","last_undegraded":"2023-10-07T08:59:22.968900+0000","last_fullsized":"2023-10-07T08:59:22.968900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965183+0000","last_change":"2023-10-07T08:59:22.962375+0000","last_active":"2023-10-07T08:59:22.965183+0000","last_peered":"2023-10-07T08:59:22.965183+0000","last_clean":"2023-10-07T08:59:22.965183+0000","last_became_active":"2023-10-07T08:59:22.961312+0000","last_became_peered":"2023-10-07T08:59:22.961312+0000","last_unstale":"2023-10-07T08:59:22.965183+0000","last_undegraded":"2023-10-07T08:59:22.965183+0000","last_fullsized":"2023-10-07T08:59:22.965183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971499+0000","last_change":"2023-10-07T08:59:22.967031+0000","last_active":"2023-10-07T08:59:22.971499+0000","last_peered":"2023-10-07T08:59:22.971499+0000","last_clean":"2023-10-07T08:59:22.971499+0000","last_became_active":"2023-10-07T08:59:22.966704+0000","last_became_peered":"2023-10-07T08:59:22.966704+0000","last_unstale":"2023-10-07T08:59:22.971499+0000","last_undegraded":"2023-10-07T08:59:22.971499+0000","last_fullsized":"2023-10-07T08:59:22.971499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973879+0000","last_change":"2023-10-07T08:59:22.968183+0000","last_active":"2023-10-07T08:59:22.973879+0000","last_peered":"2023-10-07T08:59:22.973879+0000","last_clean":"2023-10-07T08:59:22.973879+0000","last_became_active":"2023-10-07T08:59:22.967869+0000","last_became_peered":"2023-10-07T08:59:22.967869+0000","last_unstale":"2023-10-07T08:59:22.973879+0000","last_undegraded":"2023-10-07T08:59:22.973879+0000","last_fullsized":"2023-10-07T08:59:22.973879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976265+0000","last_change":"2023-10-07T08:59:22.975170+0000","last_active":"2023-10-07T08:59:22.976265+0000","last_peered":"2023-10-07T08:59:22.976265+0000","last_clean":"2023-10-07T08:59:22.976265+0000","last_became_active":"2023-10-07T08:59:22.974824+0000","last_became_peered":"2023-10-07T08:59:22.974824+0000","last_unstale":"2023-10-07T08:59:22.976265+0000","last_undegraded":"2023-10-07T08:59:22.976265+0000","last_fullsized":"2023-10-07T08:59:22.976265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976389+0000","last_change":"2023-10-07T08:59:22.971685+0000","last_active":"2023-10-07T08:59:22.976389+0000","last_peered":"2023-10-07T08:59:22.976389+0000","last_clean":"2023-10-07T08:59:22.976389+0000","last_became_active":"2023-10-07T08:59:22.971400+0000","last_became_peered":"2023-10-07T08:59:22.971400+0000","last_unstale":"2023-10-07T08:59:22.976389+0000","last_undegraded":"2023-10-07T08:59:22.976389+0000","last_fullsized":"2023-10-07T08:59:22.976389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:07:57.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964347+0000","last_change":"2023-10-07T08:59:22.960377+0000","last_active":"2023-10-07T08:59:22.964347+0000","last_peered":"2023-10-07T08:59:22.964347+0000","last_clean":"2023-10-07T08:59:22.964347+0000","last_became_active":"2023-10-07T08:59:22.960087+0000","last_became_peered":"2023-10-07T08:59:22.960087+0000","last_unstale":"2023-10-07T08:59:22.964347+0000","last_undegraded":"2023-10-07T08:59:22.964347+0000","last_fullsized":"2023-10-07T08:59:22.964347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969276+0000","last_change":"2023-10-07T08:59:22.964055+0000","last_active":"2023-10-07T08:59:22.969276+0000","last_peered":"2023-10-07T08:59:22.969276+0000","last_clean":"2023-10-07T08:59:22.969276+0000","last_became_active":"2023-10-07T08:59:22.963777+0000","last_became_peered":"2023-10-07T08:59:22.963777+0000","last_unstale":"2023-10-07T08:59:22.969276+0000","last_undegraded":"2023-10-07T08:59:22.969276+0000","last_fullsized":"2023-10-07T08:59:22.969276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:14.754496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967138+0000","last_change":"2023-10-07T08:59:22.964583+0000","last_active":"2023-10-07T08:59:22.967138+0000","last_peered":"2023-10-07T08:59:22.967138+0000","last_clean":"2023-10-07T08:59:22.967138+0000","last_became_active":"2023-10-07T08:59:22.964310+0000","last_became_peered":"2023-10-07T08:59:22.964310+0000","last_unstale":"2023-10-07T08:59:22.967138+0000","last_undegraded":"2023-10-07T08:59:22.967138+0000","last_fullsized":"2023-10-07T08:59:22.967138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970814+0000","last_change":"2023-10-07T08:59:22.961939+0000","last_active":"2023-10-07T08:59:22.970814+0000","last_peered":"2023-10-07T08:59:22.970814+0000","last_clean":"2023-10-07T08:59:22.970814+0000","last_became_active":"2023-10-07T08:59:22.961616+0000","last_became_peered":"2023-10-07T08:59:22.961616+0000","last_unstale":"2023-10-07T08:59:22.970814+0000","last_undegraded":"2023-10-07T08:59:22.970814+0000","last_fullsized":"2023-10-07T08:59:22.970814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967464+0000","last_change":"2023-10-07T08:59:22.959696+0000","last_active":"2023-10-07T08:59:22.967464+0000","last_peered":"2023-10-07T08:59:22.967464+0000","last_clean":"2023-10-07T08:59:22.967464+0000","last_became_active":"2023-10-07T08:59:22.959451+0000","last_became_peered":"2023-10-07T08:59:22.959451+0000","last_unstale":"2023-10-07T08:59:22.967464+0000","last_undegraded":"2023-10-07T08:59:22.967464+0000","last_fullsized":"2023-10-07T08:59:22.967464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977007+0000","last_change":"2023-10-07T08:59:22.973234+0000","last_active":"2023-10-07T08:59:22.977007+0000","last_peered":"2023-10-07T08:59:22.977007+0000","last_clean":"2023-10-07T08:59:22.977007+0000","last_became_active":"2023-10-07T08:59:22.971436+0000","last_became_peered":"2023-10-07T08:59:22.971436+0000","last_unstale":"2023-10-07T08:59:22.977007+0000","last_undegraded":"2023-10-07T08:59:22.977007+0000","last_fullsized":"2023-10-07T08:59:22.977007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973457+0000","last_change":"2023-10-07T08:59:22.972107+0000","last_active":"2023-10-07T08:59:22.973457+0000","last_peered":"2023-10-07T08:59:22.973457+0000","last_clean":"2023-10-07T08:59:22.973457+0000","last_became_active":"2023-10-07T08:59:22.971722+0000","last_became_peered":"2023-10-07T08:59:22.971722+0000","last_unstale":"2023-10-07T08:59:22.973457+0000","last_undegraded":"2023-10-07T08:59:22.973457+0000","last_fullsized":"2023-10-07T08:59:22.973457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969789+0000","last_change":"2023-10-07T08:59:21.960418+0000","last_active":"2023-10-07T08:59:22.969789+0000","last_peered":"2023-10-07T08:59:22.969789+0000","last_clean":"2023-10-07T08:59:22.969789+0000","last_became_active":"2023-10-07T08:59:21.960094+0000","last_became_peered":"2023-10-07T08:59:21.960094+0000","last_unstale":"2023-10-07T08:59:22.969789+0000","last_undegraded":"2023-10-07T08:59:22.969789+0000","last_fullsized":"2023-10-07T08:59:22.969789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968601+0000","last_change":"2023-10-07T08:59:22.961156+0000","last_active":"2023-10-07T08:59:22.968601+0000","last_peered":"2023-10-07T08:59:22.968601+0000","last_clean":"2023-10-07T08:59:22.968601+0000","last_became_active":"2023-10-07T08:59:22.960384+0000","last_became_peered":"2023-10-07T08:59:22.960384+0000","last_unstale":"2023-10-07T08:59:22.968601+0000","last_undegraded":"2023-10-07T08:59:22.968601+0000","last_fullsized":"2023-10-07T08:59:22.968601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971930+0000","last_change":"2023-10-07T08:59:21.959319+0000","last_active":"2023-10-07T08:59:22.971930+0000","last_peered":"2023-10-07T08:59:22.971930+0000","last_clean":"2023-10-07T08:59:22.971930+0000","last_became_active":"2023-10-07T08:59:21.959076+0000","last_became_peered":"2023-10-07T08:59:21.959076+0000","last_unstale":"2023-10-07T08:59:22.971930+0000","last_undegraded":"2023-10-07T08:59:22.971930+0000","last_fullsized":"2023-10-07T08:59:22.971930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968874+0000","last_change":"2023-10-07T08:59:22.964844+0000","last_active":"2023-10-07T08:59:22.968874+0000","last_peered":"2023-10-07T08:59:22.968874+0000","last_clean":"2023-10-07T08:59:22.968874+0000","last_became_active":"2023-10-07T08:59:22.964064+0000","last_became_peered":"2023-10-07T08:59:22.964064+0000","last_unstale":"2023-10-07T08:59:22.968874+0000","last_undegraded":"2023-10-07T08:59:22.968874+0000","last_fullsized":"2023-10-07T08:59:22.968874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976272+0000","last_change":"2023-10-07T08:59:21.953378+0000","last_active":"2023-10-07T08:59:22.976272+0000","last_peered":"2023-10-07T08:59:22.976272+0000","last_clean":"2023-10-07T08:59:22.976272+0000","last_became_active":"2023-10-07T08:59:21.950841+0000","last_became_peered":"2023-10-07T08:59:21.950841+0000","last_unstale":"2023-10-07T08:59:22.976272+0000","last_undegraded":"2023-10-07T08:59:22.976272+0000","last_fullsized":"2023-10-07T08:59:22.976272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:13.862576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973235+0000","last_change":"2023-10-07T08:59:22.962110+0000","last_active":"2023-10-07T08:59:22.973235+0000","last_peered":"2023-10-07T08:59:22.973235+0000","last_clean":"2023-10-07T08:59:22.973235+0000","last_became_active":"2023-10-07T08:59:22.960934+0000","last_became_peered":"2023-10-07T08:59:22.960934+0000","last_unstale":"2023-10-07T08:59:22.973235+0000","last_undegraded":"2023-10-07T08:59:22.973235+0000","last_fullsized":"2023-10-07T08:59:22.973235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963697+0000","last_change":"2023-10-07T08:59:21.960536+0000","last_active":"2023-10-07T08:59:22.963697+0000","last_peered":"2023-10-07T08:59:22.963697+0000","last_clean":"2023-10-07T08:59:22.963697+0000","last_became_active":"2023-10-07T08:59:21.960244+0000","last_became_peered":"2023-10-07T08:59:21.960244+0000","last_unstale":"2023-10-07T08:59:22.963697+0000","last_undegraded":"2023-10-07T08:59:22.963697+0000","last_fullsized":"2023-10-07T08:59:22.963697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:02:02.649357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971198+0000","last_change":"2023-10-07T08:59:22.964458+0000","last_active":"2023-10-07T08:59:22.971198+0000","last_peered":"2023-10-07T08:59:22.971198+0000","last_clean":"2023-10-07T08:59:22.971198+0000","last_became_active":"2023-10-07T08:59:22.962184+0000","last_became_peered":"2023-10-07T08:59:22.962184+0000","last_unstale":"2023-10-07T08:59:22.971198+0000","last_undegraded":"2023-10-07T08:59:22.971198+0000","last_fullsized":"2023-10-07T08:59:22.971198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965532+0000","last_change":"2023-10-07T08:59:21.950366+0000","last_active":"2023-10-07T08:59:22.965532+0000","last_peered":"2023-10-07T08:59:22.965532+0000","last_clean":"2023-10-07T08:59:22.965532+0000","last_became_active":"2023-10-07T08:59:21.950100+0000","last_became_peered":"2023-10-07T08:59:21.950100+0000","last_unstale":"2023-10-07T08:59:22.965532+0000","last_undegraded":"2023-10-07T08:59:22.965532+0000","last_fullsized":"2023-10-07T08:59:22.965532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:57.236161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976747+0000","last_change":"2023-10-07T08:59:22.971772+0000","last_active":"2023-10-07T08:59:22.976747+0000","last_peered":"2023-10-07T08:59:22.976747+0000","last_clean":"2023-10-07T08:59:22.976747+0000","last_became_active":"2023-10-07T08:59:22.971513+0000","last_became_peered":"2023-10-07T08:59:22.971513+0000","last_unstale":"2023-10-07T08:59:22.976747+0000","last_undegraded":"2023-10-07T08:59:22.976747+0000","last_fullsized":"2023-10-07T08:59:22.976747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964782+0000","last_change":"2023-10-07T08:59:21.954959+0000","last_active":"2023-10-07T08:59:22.964782+0000","last_peered":"2023-10-07T08:59:22.964782+0000","last_clean":"2023-10-07T08:59:22.964782+0000","last_became_active":"2023-10-07T08:59:21.954416+0000","last_became_peered":"2023-10-07T08:59:21.954416+0000","last_unstale":"2023-10-07T08:59:22.964782+0000","last_undegraded":"2023-10-07T08:59:22.964782+0000","last_fullsized":"2023-10-07T08:59:22.964782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:31.178523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960905+0000","last_change":"2023-10-07T08:59:22.956931+0000","last_active":"2023-10-07T08:59:22.960905+0000","last_peered":"2023-10-07T08:59:22.960905+0000","last_clean":"2023-10-07T08:59:22.960905+0000","last_became_active":"2023-10-07T08:59:22.956653+0000","last_became_peered":"2023-10-07T08:59:22.956653+0000","last_unstale":"2023-10-07T08:59:22.960905+0000","last_undegraded":"2023-10-07T08:59:22.960905+0000","last_fullsized":"2023-10-07T08:59:22.960905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958858+0000","last_change":"2023-10-07T08:59:21.955565+0000","last_active":"2023-10-07T08:59:22.958858+0000","last_peered":"2023-10-07T08:59:22.958858+0000","last_clean":"2023-10-07T08:59:22.958858+0000","last_became_active":"2023-10-07T08:59:21.955280+0000","last_became_peered":"2023-10-07T08:59:21.955280+0000","last_unstale":"2023-10-07T08:59:22.958858+0000","last_undegraded":"2023-10-07T08:59:22.958858+0000","last_fullsized":"2023-10-07T08:59:22.958858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:12.266896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974474+0000","last_change":"2023-10-07T08:59:22.968325+0000","last_active":"2023-10-07T08:59:22.974474+0000","last_peered":"2023-10-07T08:59:22.974474+0000","last_clean":"2023-10-07T08:59:22.974474+0000","last_became_active":"2023-10-07T08:59:22.968064+0000","last_became_peered":"2023-10-07T08:59:22.968064+0000","last_unstale":"2023-10-07T08:59:22.974474+0000","last_undegraded":"2023-10-07T08:59:22.974474+0000","last_fullsized":"2023-10-07T08:59:22.974474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947611+0000","last_change":"2023-10-07T08:59:21.954754+0000","last_active":"2023-10-07T08:59:22.947611+0000","last_peered":"2023-10-07T08:59:22.947611+0000","last_clean":"2023-10-07T08:59:22.947611+0000","last_became_active":"2023-10-07T08:59:21.954203+0000","last_became_peered":"2023-10-07T08:59:21.954203+0000","last_unstale":"2023-10-07T08:59:22.947611+0000","last_undegraded":"2023-10-07T08:59:22.947611+0000","last_fullsized":"2023-10-07T08:59:22.947611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:00.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969330+0000","last_change":"2023-10-07T08:59:22.965263+0000","last_active":"2023-10-07T08:59:22.969330+0000","last_peered":"2023-10-07T08:59:22.969330+0000","last_clean":"2023-10-07T08:59:22.969330+0000","last_became_active":"2023-10-07T08:59:22.964907+0000","last_became_peered":"2023-10-07T08:59:22.964907+0000","last_unstale":"2023-10-07T08:59:22.969330+0000","last_undegraded":"2023-10-07T08:59:22.969330+0000","last_fullsized":"2023-10-07T08:59:22.969330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961413+0000","last_change":"2023-10-07T08:59:21.958681+0000","last_active":"2023-10-07T08:59:22.961413+0000","last_peered":"2023-10-07T08:59:22.961413+0000","last_clean":"2023-10-07T08:59:22.961413+0000","last_became_active":"2023-10-07T08:59:21.958382+0000","last_became_peered":"2023-10-07T08:59:21.958382+0000","last_unstale":"2023-10-07T08:59:22.961413+0000","last_undegraded":"2023-10-07T08:59:22.961413+0000","last_fullsized":"2023-10-07T08:59:22.961413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:09.399693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976211+0000","last_change":"2023-10-07T08:59:22.970344+0000","last_active":"2023-10-07T08:59:22.976211+0000","last_peered":"2023-10-07T08:59:22.976211+0000","last_clean":"2023-10-07T08:59:22.976211+0000","last_became_active":"2023-10-07T08:59:22.970059+0000","last_became_peered":"2023-10-07T08:59:22.970059+0000","last_unstale":"2023-10-07T08:59:22.976211+0000","last_undegraded":"2023-10-07T08:59:22.976211+0000","last_fullsized":"2023-10-07T08:59:22.976211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952481+0000","last_change":"2023-10-07T08:59:21.959789+0000","last_active":"2023-10-07T08:59:22.952481+0000","last_peered":"2023-10-07T08:59:22.952481+0000","last_clean":"2023-10-07T08:59:22.952481+0000","last_became_active":"2023-10-07T08:59:21.959526+0000","last_became_peered":"2023-10-07T08:59:21.959526+0000","last_unstale":"2023-10-07T08:59:22.952481+0000","last_undegraded":"2023-10-07T08:59:22.952481+0000","last_fullsized":"2023-10-07T08:59:22.952481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976651+0000","last_change":"2023-10-07T08:59:22.973479+0000","last_active":"2023-10-07T08:59:22.976651+0000","last_peered":"2023-10-07T08:59:22.976651+0000","last_clean":"2023-10-07T08:59:22.976651+0000","last_became_active":"2023-10-07T08:59:22.973230+0000","last_became_peered":"2023-10-07T08:59:22.973230+0000","last_unstale":"2023-10-07T08:59:22.976651+0000","last_undegraded":"2023-10-07T08:59:22.976651+0000","last_fullsized":"2023-10-07T08:59:22.976651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:48:17.315649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972105+0000","last_change":"2023-10-07T08:59:21.957294+0000","last_active":"2023-10-07T08:59:22.972105+0000","last_peered":"2023-10-07T08:59:22.972105+0000","last_clean":"2023-10-07T08:59:22.972105+0000","last_became_active":"2023-10-07T08:59:21.956864+0000","last_became_peered":"2023-10-07T08:59:21.956864+0000","last_unstale":"2023-10-07T08:59:22.972105+0000","last_undegraded":"2023-10-07T08:59:22.972105+0000","last_fullsized":"2023-10-07T08:59:22.972105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969360+0000","last_change":"2023-10-07T08:59:22.966816+0000","last_active":"2023-10-07T08:59:22.969360+0000","last_peered":"2023-10-07T08:59:22.969360+0000","last_clean":"2023-10-07T08:59:22.969360+0000","last_became_active":"2023-10-07T08:59:22.966542+0000","last_became_peered":"2023-10-07T08:59:22.966542+0000","last_unstale":"2023-10-07T08:59:22.969360+0000","last_undegraded":"2023-10-07T08:59:22.969360+0000","last_fullsized":"2023-10-07T08:59:22.969360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978596+0000","last_change":"2023-10-07T08:59:21.951690+0000","last_active":"2023-10-07T08:59:22.978596+0000","last_peered":"2023-10-07T08:59:22.978596+0000","last_clean":"2023-10-07T08:59:22.978596+0000","last_became_active":"2023-10-07T08:59:21.951427+0000","last_became_peered":"2023-10-07T08:59:21.951427+0000","last_unstale":"2023-10-07T08:59:22.978596+0000","last_undegraded":"2023-10-07T08:59:22.978596+0000","last_fullsized":"2023-10-07T08:59:22.978596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:16.651091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976017+0000","last_change":"2023-10-07T08:59:22.971008+0000","last_active":"2023-10-07T08:59:22.976017+0000","last_peered":"2023-10-07T08:59:22.976017+0000","last_clean":"2023-10-07T08:59:22.976017+0000","last_became_active":"2023-10-07T08:59:22.970742+0000","last_became_peered":"2023-10-07T08:59:22.970742+0000","last_unstale":"2023-10-07T08:59:22.976017+0000","last_undegraded":"2023-10-07T08:59:22.976017+0000","last_fullsized":"2023-10-07T08:59:22.976017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967012+0000","last_change":"2023-10-07T08:59:21.957245+0000","last_active":"2023-10-07T08:59:22.967012+0000","last_peered":"2023-10-07T08:59:22.967012+0000","last_clean":"2023-10-07T08:59:22.967012+0000","last_became_active":"2023-10-07T08:59:21.956954+0000","last_became_peered":"2023-10-07T08:59:21.956954+0000","last_unstale":"2023-10-07T08:59:22.967012+0000","last_undegraded":"2023-10-07T08:59:22.967012+0000","last_fullsized":"2023-10-07T08:59:22.967012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965261+0000","last_change":"2023-10-07T08:59:22.963914+0000","last_active":"2023-10-07T08:59:22.965261+0000","last_peered":"2023-10-07T08:59:22.965261+0000","last_clean":"2023-10-07T08:59:22.965261+0000","last_became_active":"2023-10-07T08:59:22.963646+0000","last_became_peered":"2023-10-07T08:59:22.963646+0000","last_unstale":"2023-10-07T08:59:22.965261+0000","last_undegraded":"2023-10-07T08:59:22.965261+0000","last_fullsized":"2023-10-07T08:59:22.965261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949329+0000","last_change":"2023-10-07T08:59:21.958261+0000","last_active":"2023-10-07T08:59:22.949329+0000","last_peered":"2023-10-07T08:59:22.949329+0000","last_clean":"2023-10-07T08:59:22.949329+0000","last_became_active":"2023-10-07T08:59:21.957949+0000","last_became_peered":"2023-10-07T08:59:21.957949+0000","last_unstale":"2023-10-07T08:59:22.949329+0000","last_undegraded":"2023-10-07T08:59:22.949329+0000","last_fullsized":"2023-10-07T08:59:22.949329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977033+0000","last_change":"2023-10-07T08:59:22.973392+0000","last_active":"2023-10-07T08:59:22.977033+0000","last_peered":"2023-10-07T08:59:22.977033+0000","last_clean":"2023-10-07T08:59:22.977033+0000","last_became_active":"2023-10-07T08:59:22.970983+0000","last_became_peered":"2023-10-07T08:59:22.970983+0000","last_unstale":"2023-10-07T08:59:22.977033+0000","last_undegraded":"2023-10-07T08:59:22.977033+0000","last_fullsized":"2023-10-07T08:59:22.977033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958967+0000","last_change":"2023-10-07T08:59:21.958676+0000","last_active":"2023-10-07T08:59:22.958967+0000","last_peered":"2023-10-07T08:59:22.958967+0000","last_clean":"2023-10-07T08:59:22.958967+0000","last_became_active":"2023-10-07T08:59:21.958407+0000","last_became_peered":"2023-10-07T08:59:21.958407+0000","last_unstale":"2023-10-07T08:59:22.958967+0000","last_undegraded":"2023-10-07T08:59:22.958967+0000","last_fullsized":"2023-10-07T08:59:22.958967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974517+0000","last_change":"2023-10-07T08:59:22.967122+0000","last_active":"2023-10-07T08:59:22.974517+0000","last_peered":"2023-10-07T08:59:22.974517+0000","last_clean":"2023-10-07T08:59:22.974517+0000","last_became_active":"2023-10-07T08:59:22.966798+0000","last_became_peered":"2023-10-07T08:59:22.966798+0000","last_unstale":"2023-10-07T08:59:22.974517+0000","last_undegraded":"2023-10-07T08:59:22.974517+0000","last_fullsized":"2023-10-07T08:59:22.974517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:39.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976907+0000","last_change":"2023-10-07T08:59:21.951544+0000","last_active":"2023-10-07T08:59:22.976907+0000","last_peered":"2023-10-07T08:59:22.976907+0000","last_clean":"2023-10-07T08:59:22.976907+0000","last_became_active":"2023-10-07T08:59:21.951224+0000","last_became_peered":"2023-10-07T08:59:21.951224+0000","last_unstale":"2023-10-07T08:59:22.976907+0000","last_undegraded":"2023-10-07T08:59:22.976907+0000","last_fullsized":"2023-10-07T08:59:22.976907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:30:59.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974703+0000","last_change":"2023-10-07T08:59:22.969787+0000","last_active":"2023-10-07T08:59:22.974703+0000","last_peered":"2023-10-07T08:59:22.974703+0000","last_clean":"2023-10-07T08:59:22.974703+0000","last_became_active":"2023-10-07T08:59:22.969523+0000","last_became_peered":"2023-10-07T08:59:22.969523+0000","last_unstale":"2023-10-07T08:59:22.974703+0000","last_undegraded":"2023-10-07T08:59:22.974703+0000","last_fullsized":"2023-10-07T08:59:22.974703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963665+0000","last_change":"2023-10-07T08:59:21.954238+0000","last_active":"2023-10-07T08:59:22.963665+0000","last_peered":"2023-10-07T08:59:22.963665+0000","last_clean":"2023-10-07T08:59:22.963665+0000","last_became_active":"2023-10-07T08:59:21.953919+0000","last_became_peered":"2023-10-07T08:59:21.953919+0000","last_unstale":"2023-10-07T08:59:22.963665+0000","last_undegraded":"2023-10-07T08:59:22.963665+0000","last_fullsized":"2023-10-07T08:59:22.963665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969501+0000","last_change":"2023-10-07T08:59:22.962830+0000","last_active":"2023-10-07T08:59:22.969501+0000","last_peered":"2023-10-07T08:59:22.969501+0000","last_clean":"2023-10-07T08:59:22.969501+0000","last_became_active":"2023-10-07T08:59:22.962523+0000","last_became_peered":"2023-10-07T08:59:22.962523+0000","last_unstale":"2023-10-07T08:59:22.969501+0000","last_undegraded":"2023-10-07T08:59:22.969501+0000","last_fullsized":"2023-10-07T08:59:22.969501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:51.060633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.966432+0000","last_change":"2023-10-07T08:59:21.957801+0000","last_active":"2023-10-07T08:59:22.966432+0000","last_peered":"2023-10-07T08:59:22.966432+0000","last_clean":"2023-10-07T08:59:22.966432+0000","last_became_active":"2023-10-07T08:59:21.957546+0000","last_became_peered":"2023-10-07T08:59:21.957546+0000","last_unstale":"2023-10-07T08:59:22.966432+0000","last_undegraded":"2023-10-07T08:59:22.966432+0000","last_fullsized":"2023-10-07T08:59:22.966432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964239+0000","last_change":"2023-10-07T08:59:22.960245+0000","last_active":"2023-10-07T08:59:22.964239+0000","last_peered":"2023-10-07T08:59:22.964239+0000","last_clean":"2023-10-07T08:59:22.964239+0000","last_became_active":"2023-10-07T08:59:22.959949+0000","last_became_peered":"2023-10-07T08:59:22.959949+0000","last_unstale":"2023-10-07T08:59:22.964239+0000","last_undegraded":"2023-10-07T08:59:22.964239+0000","last_fullsized":"2023-10-07T08:59:22.964239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960623+0000","last_change":"2023-10-07T08:59:21.956381+0000","last_active":"2023-10-07T08:59:22.960623+0000","last_peered":"2023-10-07T08:59:22.960623+0000","last_clean":"2023-10-07T08:59:22.960623+0000","last_became_active":"2023-10-07T08:59:21.956091+0000","last_became_peered":"2023-10-07T08:59:21.956091+0000","last_unstale":"2023-10-07T08:59:22.960623+0000","last_undegraded":"2023-10-07T08:59:22.960623+0000","last_fullsized":"2023-10-07T08:59:22.960623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973631+0000","last_change":"2023-10-07T08:59:22.966879+0000","last_active":"2023-10-07T08:59:22.973631+0000","last_peered":"2023-10-07T08:59:22.973631+0000","last_clean":"2023-10-07T08:59:22.973631+0000","last_became_active":"2023-10-07T08:59:22.966568+0000","last_became_peered":"2023-10-07T08:59:22.966568+0000","last_unstale":"2023-10-07T08:59:22.973631+0000","last_undegraded":"2023-10-07T08:59:22.973631+0000","last_fullsized":"2023-10-07T08:59:22.973631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:10.201801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947762+0000","last_change":"2023-10-07T08:59:21.949515+0000","last_active":"2023-10-07T08:59:22.947762+0000","last_peered":"2023-10-07T08:59:22.947762+0000","last_clean":"2023-10-07T08:59:22.947762+0000","last_became_active":"2023-10-07T08:59:21.949242+0000","last_became_peered":"2023-10-07T08:59:21.949242+0000","last_unstale":"2023-10-07T08:59:22.947762+0000","last_undegraded":"2023-10-07T08:59:22.947762+0000","last_fullsized":"2023-10-07T08:59:22.947762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:49.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959579+0000","last_change":"2023-10-07T08:59:22.953298+0000","last_active":"2023-10-07T08:59:22.959579+0000","last_peered":"2023-10-07T08:59:22.959579+0000","last_clean":"2023-10-07T08:59:22.959579+0000","last_became_active":"2023-10-07T08:59:22.952968+0000","last_became_peered":"2023-10-07T08:59:22.952968+0000","last_unstale":"2023-10-07T08:59:22.959579+0000","last_undegraded":"2023-10-07T08:59:22.959579+0000","last_fullsized":"2023-10-07T08:59:22.959579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:41.722574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978027+0000","last_change":"2023-10-07T08:59:21.957699+0000","last_active":"2023-10-07T08:59:22.978027+0000","last_peered":"2023-10-07T08:59:22.978027+0000","last_clean":"2023-10-07T08:59:22.978027+0000","last_became_active":"2023-10-07T08:59:21.957442+0000","last_became_peered":"2023-10-07T08:59:21.957442+0000","last_unstale":"2023-10-07T08:59:22.978027+0000","last_undegraded":"2023-10-07T08:59:22.978027+0000","last_fullsized":"2023-10-07T08:59:22.978027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972948+0000","last_change":"2023-10-07T08:59:22.964265+0000","last_active":"2023-10-07T08:59:22.972948+0000","last_peered":"2023-10-07T08:59:22.972948+0000","last_clean":"2023-10-07T08:59:22.972948+0000","last_became_active":"2023-10-07T08:59:22.963974+0000","last_became_peered":"2023-10-07T08:59:22.963974+0000","last_unstale":"2023-10-07T08:59:22.972948+0000","last_undegraded":"2023-10-07T08:59:22.972948+0000","last_fullsized":"2023-10-07T08:59:22.972948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:34.140709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952643+0000","last_change":"2023-10-07T08:59:21.959701+0000","last_active":"2023-10-07T08:59:22.952643+0000","last_peered":"2023-10-07T08:59:22.952643+0000","last_clean":"2023-10-07T08:59:22.952643+0000","last_became_active":"2023-10-07T08:59:21.959434+0000","last_became_peered":"2023-10-07T08:59:21.959434+0000","last_unstale":"2023-10-07T08:59:22.952643+0000","last_undegraded":"2023-10-07T08:59:22.952643+0000","last_fullsized":"2023-10-07T08:59:22.952643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968272+0000","last_change":"2023-10-07T08:59:22.963370+0000","last_active":"2023-10-07T08:59:22.968272+0000","last_peered":"2023-10-07T08:59:22.968272+0000","last_clean":"2023-10-07T08:59:22.968272+0000","last_became_active":"2023-10-07T08:59:22.963002+0000","last_became_peered":"2023-10-07T08:59:22.963002+0000","last_unstale":"2023-10-07T08:59:22.968272+0000","last_undegraded":"2023-10-07T08:59:22.968272+0000","last_fullsized":"2023-10-07T08:59:22.968272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:58.241693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947856+0000","last_change":"2023-10-07T08:59:21.951124+0000","last_active":"2023-10-07T08:59:22.947856+0000","last_peered":"2023-10-07T08:59:22.947856+0000","last_clean":"2023-10-07T08:59:22.947856+0000","last_became_active":"2023-10-07T08:59:21.950935+0000","last_became_peered":"2023-10-07T08:59:21.950935+0000","last_unstale":"2023-10-07T08:59:22.947856+0000","last_undegraded":"2023-10-07T08:59:22.947856+0000","last_fullsized":"2023-10-07T08:59:22.947856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:54.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976900+0000","last_change":"2023-10-07T08:59:22.971562+0000","last_active":"2023-10-07T08:59:22.976900+0000","last_peered":"2023-10-07T08:59:22.976900+0000","last_clean":"2023-10-07T08:59:22.976900+0000","last_became_active":"2023-10-07T08:59:22.971230+0000","last_became_peered":"2023-10-07T08:59:22.971230+0000","last_unstale":"2023-10-07T08:59:22.976900+0000","last_undegraded":"2023-10-07T08:59:22.976900+0000","last_fullsized":"2023-10-07T08:59:22.976900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955316+0000","last_change":"2023-10-07T08:59:21.959123+0000","last_active":"2023-10-07T08:59:22.955316+0000","last_peered":"2023-10-07T08:59:22.955316+0000","last_clean":"2023-10-07T08:59:22.955316+0000","last_became_active":"2023-10-07T08:59:21.958832+0000","last_became_peered":"2023-10-07T08:59:21.958832+0000","last_unstale":"2023-10-07T08:59:22.955316+0000","last_undegraded":"2023-10-07T08:59:22.955316+0000","last_fullsized":"2023-10-07T08:59:22.955316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:32.934580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969052+0000","last_change":"2023-10-07T08:59:22.963437+0000","last_active":"2023-10-07T08:59:22.969052+0000","last_peered":"2023-10-07T08:59:22.969052+0000","last_clean":"2023-10-07T08:59:22.969052+0000","last_became_active":"2023-10-07T08:59:22.963178+0000","last_became_peered":"2023-10-07T08:59:22.963178+0000","last_unstale":"2023-10-07T08:59:22.969052+0000","last_undegraded":"2023-10-07T08:59:22.969052+0000","last_fullsized":"2023-10-07T08:59:22.969052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:28.000390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974496+0000","last_change":"2023-10-07T08:59:21.959424+0000","last_active":"2023-10-07T08:59:22.974496+0000","last_peered":"2023-10-07T08:59:22.974496+0000","last_clean":"2023-10-07T08:59:22.974496+0000","last_became_active":"2023-10-07T08:59:21.959117+0000","last_became_peered":"2023-10-07T08:59:21.959117+0000","last_unstale":"2023-10-07T08:59:22.974496+0000","last_undegraded":"2023-10-07T08:59:22.974496+0000","last_fullsized":"2023-10-07T08:59:22.974496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969562+0000","last_change":"2023-10-07T08:59:22.965766+0000","last_active":"2023-10-07T08:59:22.969562+0000","last_peered":"2023-10-07T08:59:22.969562+0000","last_clean":"2023-10-07T08:59:22.969562+0000","last_became_active":"2023-10-07T08:59:22.965507+0000","last_became_peered":"2023-10-07T08:59:22.965507+0000","last_unstale":"2023-10-07T08:59:22.969562+0000","last_undegraded":"2023-10-07T08:59:22.969562+0000","last_fullsized":"2023-10-07T08:59:22.969562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-07T08:59:23.958758+0000","last_change":"2023-10-07T08:59:21.956983+0000","last_active":"2023-10-07T08:59:23.958758+0000","last_peered":"2023-10-07T08:59:23.958758+0000","last_clean":"2023-10-07T08:59:23.958758+0000","last_became_active":"2023-10-07T08:59:21.956701+0000","last_became_peered":"2023-10-07T08:59:21.956701+0000","last_unstale":"2023-10-07T08:59:23.958758+0000","last_undegraded":"2023-10-07T08:59:23.958758+0000","last_fullsized":"2023-10-07T08:59:23.958758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967249+0000","last_change":"2023-10-07T08:59:22.963033+0000","last_active":"2023-10-07T08:59:22.967249+0000","last_peered":"2023-10-07T08:59:22.967249+0000","last_clean":"2023-10-07T08:59:22.967249+0000","last_became_active":"2023-10-07T08:59:22.962738+0000","last_became_peered":"2023-10-07T08:59:22.962738+0000","last_unstale":"2023-10-07T08:59:22.967249+0000","last_undegraded":"2023-10-07T08:59:22.967249+0000","last_fullsized":"2023-10-07T08:59:22.967249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947669+0000","last_change":"2023-10-07T08:59:21.956828+0000","last_active":"2023-10-07T08:59:22.947669+0000","last_peered":"2023-10-07T08:59:22.947669+0000","last_clean":"2023-10-07T08:59:22.947669+0000","last_became_active":"2023-10-07T08:59:21.956570+0000","last_became_peered":"2023-10-07T08:59:21.956570+0000","last_unstale":"2023-10-07T08:59:22.947669+0000","last_undegraded":"2023-10-07T08:59:22.947669+0000","last_fullsized":"2023-10-07T08:59:22.947669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968481+0000","last_change":"2023-10-07T08:59:22.963523+0000","last_active":"2023-10-07T08:59:22.968481+0000","last_peered":"2023-10-07T08:59:22.968481+0000","last_clean":"2023-10-07T08:59:22.968481+0000","last_became_active":"2023-10-07T08:59:22.963240+0000","last_became_peered":"2023-10-07T08:59:22.963240+0000","last_unstale":"2023-10-07T08:59:22.968481+0000","last_undegraded":"2023-10-07T08:59:22.968481+0000","last_fullsized":"2023-10-07T08:59:22.968481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:33.940112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955155+0000","last_change":"2023-10-07T08:59:21.958204+0000","last_active":"2023-10-07T08:59:22.955155+0000","last_peered":"2023-10-07T08:59:22.955155+0000","last_clean":"2023-10-07T08:59:22.955155+0000","last_became_active":"2023-10-07T08:59:21.957951+0000","last_became_peered":"2023-10-07T08:59:21.957951+0000","last_unstale":"2023-10-07T08:59:22.955155+0000","last_undegraded":"2023-10-07T08:59:22.955155+0000","last_fullsized":"2023-10-07T08:59:22.955155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970961+0000","last_change":"2023-10-07T08:59:22.963055+0000","last_active":"2023-10-07T08:59:22.970961+0000","last_peered":"2023-10-07T08:59:22.970961+0000","last_clean":"2023-10-07T08:59:22.970961+0000","last_became_active":"2023-10-07T08:59:22.962594+0000","last_became_peered":"2023-10-07T08:59:22.962594+0000","last_unstale":"2023-10-07T08:59:22.970961+0000","last_undegraded":"2023-10-07T08:59:22.970961+0000","last_fullsized":"2023-10-07T08:59:22.970961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949360+0000","last_change":"2023-10-07T08:59:21.957647+0000","last_active":"2023-10-07T08:59:22.949360+0000","last_peered":"2023-10-07T08:59:22.949360+0000","last_clean":"2023-10-07T08:59:22.949360+0000","last_became_active":"2023-10-07T08:59:21.957377+0000","last_became_peered":"2023-10-07T08:59:21.957377+0000","last_unstale":"2023-10-07T08:59:22.949360+0000","last_undegraded":"2023-10-07T08:59:22.949360+0000","last_fullsized":"2023-10-07T08:59:22.949360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961666+0000","last_change":"2023-10-07T08:59:22.958557+0000","last_active":"2023-10-07T08:59:22.961666+0000","last_peered":"2023-10-07T08:59:22.961666+0000","last_clean":"2023-10-07T08:59:22.961666+0000","last_became_active":"2023-10-07T08:59:22.958198+0000","last_became_peered":"2023-10-07T08:59:22.958198+0000","last_unstale":"2023-10-07T08:59:22.961666+0000","last_undegraded":"2023-10-07T08:59:22.961666+0000","last_fullsized":"2023-10-07T08:59:22.961666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947969+0000","last_change":"2023-10-07T08:59:21.957341+0000","last_active":"2023-10-07T08:59:22.947969+0000","last_peered":"2023-10-07T08:59:22.947969+0000","last_clean":"2023-10-07T08:59:22.947969+0000","last_became_active":"2023-10-07T08:59:21.957033+0000","last_became_peered":"2023-10-07T08:59:21.957033+0000","last_unstale":"2023-10-07T08:59:22.947969+0000","last_undegraded":"2023-10-07T08:59:22.947969+0000","last_fullsized":"2023-10-07T08:59:22.947969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:06.282559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967082+0000","last_change":"2023-10-07T08:59:22.964316+0000","last_active":"2023-10-07T08:59:22.967082+0000","last_peered":"2023-10-07T08:59:22.967082+0000","last_clean":"2023-10-07T08:59:22.967082+0000","last_became_active":"2023-10-07T08:59:22.964034+0000","last_became_peered":"2023-10-07T08:59:22.964034+0000","last_unstale":"2023-10-07T08:59:22.967082+0000","last_undegraded":"2023-10-07T08:59:22.967082+0000","last_fullsized":"2023-10-07T08:59:22.967082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959239+0000","last_change":"2023-10-07T08:59:21.960520+0000","last_active":"2023-10-07T08:59:22.959239+0000","last_peered":"2023-10-07T08:59:22.959239+0000","last_clean":"2023-10-07T08:59:22.959239+0000","last_became_active":"2023-10-07T08:59:21.960255+0000","last_became_peered":"2023-10-07T08:59:21.960255+0000","last_unstale":"2023-10-07T08:59:22.959239+0000","last_undegraded":"2023-10-07T08:59:22.959239+0000","last_fullsized":"2023-10-07T08:59:22.959239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:19.684755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976927+0000","last_change":"2023-10-07T08:59:22.972802+0000","last_active":"2023-10-07T08:59:22.976927+0000","last_peered":"2023-10-07T08:59:22.976927+0000","last_clean":"2023-10-07T08:59:22.976927+0000","last_became_active":"2023-10-07T08:59:22.971123+0000","last_became_peered":"2023-10-07T08:59:22.971123+0000","last_unstale":"2023-10-07T08:59:22.976927+0000","last_undegraded":"2023-10-07T08:59:22.976927+0000","last_fullsized":"2023-10-07T08:59:22.976927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952622+0000","last_change":"2023-10-07T08:59:21.959379+0000","last_active":"2023-10-07T08:59:22.952622+0000","last_peered":"2023-10-07T08:59:22.952622+0000","last_clean":"2023-10-07T08:59:22.952622+0000","last_became_active":"2023-10-07T08:59:21.959112+0000","last_became_peered":"2023-10-07T08:59:21.959112+0000","last_unstale":"2023-10-07T08:59:22.952622+0000","last_undegraded":"2023-10-07T08:59:22.952622+0000","last_fullsized":"2023-10-07T08:59:22.952622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957798+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:22.957798+0000","last_peered":"2023-10-07T08:59:22.957798+0000","last_clean":"2023-10-07T08:59:22.957798+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:22.957798+0000","last_undegraded":"2023-10-07T08:59:22.957798+0000","last_fullsized":"2023-10-07T08:59:22.957798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:59:27.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T08:59:28.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.040+0000 7fb9e9943700 1 Processor -- start 2023-10-07T08:59:28.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.040+0000 7fb9e9943700 1 -- start start 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e9943700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9e41598c0 0x7fb9e40cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e9943700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40cb090 con 0x7fb9e4068390 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e9943700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b4390 con 0x7fb9e40cbc30 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e9943700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40b3dd0 con 0x7fb9e41598c0 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e27fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb9e4068390 0x7fb9e40cb520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33252/0 (socket says 172.21.15.46:33252) 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e27fc700 1 -- 172.21.15.46:0/1550260972 learned_addr learned my addr 172.21.15.46:0/1550260972 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289384290 0 0) 0x7fb9e40cb090 con 0x7fb9e4068390 2023-10-07T08:59:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e2ffd700 1 --2- 172.21.15.46:0/1550260972 >> v2:172.21.15.133:3300/0 conn(0x7fb9e41598c0 0x7fb9e40cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.041+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003570 con 0x7fb9e4068390 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 554281857 0 0) 0x7fb9d0003570 con 0x7fb9e4068390 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 >> v2:172.21.15.133:3300/0 conn(0x7fb9e41598c0 msgr2=0x7fb9e40cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 --2- 172.21.15.46:0/1550260972 >> v2:172.21.15.133:3300/0 conn(0x7fb9e41598c0 0x7fb9e40cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 >> v1:172.21.15.133:6789/0 conn(0x7fb9e40cbc30 legacy=0x7fb9e415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40b40b0 con 0x7fb9e4068390 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb9cc001470 con 0x7fb9e4068390 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 >> v1:172.21.15.46:6789/0 conn(0x7fb9e4068390 legacy=0x7fb9e40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9d0003a60 0x7fb9d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9d00052e0 0x7fb9d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b3dd0 con 0x7fb9d0004810 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d000c2a0 con 0x7fb9d0003a60 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d000c460 con 0x7fb9d00052e0 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e2ffd700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9d0003a60 0x7fb9d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e37fe700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9d00052e0 0x7fb9d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 -- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9d00052e0 msgr2=0x7fb9d000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9d00052e0 0x7fb9d000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 -- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9d0003a60 msgr2=0x7fb9d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9d0003a60 0x7fb9d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e37fe700 1 -- 172.21.15.46:0/1550260972 reap_dead start 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 -- 172.21.15.46:0/1550260972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0003570 con 0x7fb9d0004810 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.042+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c3c0 tx=0x7fb9cc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49a63c535b1ae09 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00cc90 con 0x7fb9d0004810 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00cdf0 con 0x7fb9d0004810 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e1ffb700 1 -- 172.21.15.46:0/1550260972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc005b50 con 0x7fb9d0004810 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 -- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 msgr2=0x7fb9d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c3c0 tx=0x7fb9cc001e50 comp rx=0 tx=0).stop 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 -- 172.21.15.46:0/1550260972 shutdown_connections 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 --2- 172.21.15.46:0/1550260972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 -- 172.21.15.46:0/1550260972 >> 172.21.15.46:0/1550260972 conn(0x7fb9e40998b0 msgr2=0x7fb9e40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 -- 172.21.15.46:0/1550260972 shutdown_connections 2023-10-07T08:59:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.043+0000 7fb9e9943700 1 -- 172.21.15.46:0/1550260972 wait complete. 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.044+0000 7fb9e9943700 1 Processor -- start 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.044+0000 7fb9e9943700 1 -- start start 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e40c7ca0 0x7fb9e416dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 0x7fb9e4158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c8110 con 0x7fb9d0004810 2023-10-07T08:59:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c5ec0 con 0x7fb9e4147a60 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e9943700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c52b0 con 0x7fb9e40c7ca0 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42874/0 (socket says 172.21.15.46:42874) 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 -- 172.21.15.46:0/932002508 learned_addr learned my addr 172.21.15.46:0/932002508 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e37fe700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 0x7fb9e4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e40c7ca0 0x7fb9e416dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 -- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e40c7ca0 msgr2=0x7fb9e416dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e40c7ca0 0x7fb9e416dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.045+0000 7fb9e2ffd700 1 -- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 msgr2=0x7fb9e4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e2ffd700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 0x7fb9e4158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e2ffd700 1 -- 172.21.15.46:0/932002508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40c5590 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e37fe700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 0x7fb9e4158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e2ffd700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc011a10 tx=0x7fb9dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00f6d0 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00f830 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e40c5870 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00fbb0 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.046+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4147ed0 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.047+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40c61a0 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.047+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9dc014440 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.048+0000 7fb9daffd700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.048+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9dc018030 con 0x7fb9d0004810 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.048+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.049+0000 7fb9e27fc700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007cd0 tx=0x7fb9cc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.052+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9dc051fc0 con 0x7fb9d0004810 2023-10-07T08:59:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.327+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb9e40c5d10 con 0x7fb9d0004810 2023-10-07T08:59:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.327+0000 7fb9daffd700 1 -- 172.21.15.46:0/932002508 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2627 (secure 0 0 0) 0x7fb9dc022a60 con 0x7fb9d0004810 2023-10-07T08:59:28.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:28.328 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1696669110,"num_in_osds":8,"osd_in_since":1696669102,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592674,"bytes_used":2439618560,"bytes_avail":770654494720,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4822}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-10-07T08:59:27.774392+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 msgr2=0x7fb9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007cd0 tx=0x7fb9cc015000 comp rx=0 tx=0).stop 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 msgr2=0x7fb9e40c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc011a10 tx=0x7fb9dc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 shutdown_connections 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e4147a60 0x7fb9e4158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9d0004810 0x7fb9e40c7660 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 --2- 172.21.15.46:0/932002508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e40c7ca0 0x7fb9e416dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 >> 172.21.15.46:0/932002508 conn(0x7fb9e40998b0 msgr2=0x7fb9e406aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 shutdown_connections 2023-10-07T08:59:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.330+0000 7fb9e9943700 1 -- 172.21.15.46:0/932002508 wait complete. 2023-10-07T08:59:28.342 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T08:59:28.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:59:28.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.460+0000 7fd37fc0a700 1 Processor -- start 2023-10-07T08:59:28.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.460+0000 7fd37fc0a700 1 -- start start 2023-10-07T08:59:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37fc0a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd37806aa40 0x7fd3780cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37fc0a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3780cc210 con 0x7fd37806bac0 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37fc0a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3780cc4f0 con 0x7fd3780c91e0 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37fc0a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3780cc7d0 con 0x7fd37806aa40 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37d9a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd37806aa40 0x7fd3780cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37d1a5700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd37806bac0 0x7fd37806ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33254/0 (socket says 172.21.15.46:33254) 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.461+0000 7fd37d1a5700 1 -- 172.21.15.46:0/159200039 learned_addr learned my addr 172.21.15.46:0/159200039 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37d9a6700 1 -- 172.21.15.46:0/159200039 >> v1:172.21.15.133:6789/0 conn(0x7fd3780c91e0 legacy=0x7fd378160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37d9a6700 1 -- 172.21.15.46:0/159200039 >> v1:172.21.15.46:6789/0 conn(0x7fd37806bac0 legacy=0x7fd37806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37d9a6700 1 -- 172.21.15.46:0/159200039 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780ccab0 con 0x7fd37806aa40 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37c9a4700 1 -- 172.21.15.46:0/159200039 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190089951 0 0) 0x7fd3780cc210 con 0x7fd37806bac0 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37d9a6700 1 --2- 172.21.15.46:0/159200039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd37806aa40 0x7fd3780cbc00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098d0 tx=0x7fd370009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b820f194167ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37c9a4700 1 -- 172.21.15.46:0/159200039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370009e70 con 0x7fd37806aa40 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37c9a4700 1 -- 172.21.15.46:0/159200039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370005c10 con 0x7fd37806aa40 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.462+0000 7fd37c9a4700 1 -- 172.21.15.46:0/159200039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000b650 con 0x7fd37806aa40 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 -- 172.21.15.46:0/159200039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd37806aa40 msgr2=0x7fd3780cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/159200039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd37806aa40 0x7fd3780cbc00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098d0 tx=0x7fd370009120 comp rx=0 tx=0).stop 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 -- 172.21.15.46:0/159200039 shutdown_connections 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/159200039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd37806aa40 0x7fd3780cbc00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 -- 172.21.15.46:0/159200039 >> 172.21.15.46:0/159200039 conn(0x7fd3780cd670 msgr2=0x7fd3780cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 -- 172.21.15.46:0/159200039 shutdown_connections 2023-10-07T08:59:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.463+0000 7fd37fc0a700 1 -- 172.21.15.46:0/159200039 wait complete. 2023-10-07T08:59:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.464+0000 7fd37fc0a700 1 Processor -- start 2023-10-07T08:59:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.464+0000 7fd37fc0a700 1 -- start start 2023-10-07T08:59:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd37806aa40 0x7fd37814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd37806bac0 0x7fd378159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378150d60 con 0x7fd3780c91e0 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378151040 con 0x7fd37806aa40 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd378151320 con 0x7fd37806bac0 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42894/0 (socket says 172.21.15.46:42894) 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 -- 172.21.15.46:0/442389449 learned_addr learned my addr 172.21.15.46:0/442389449 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37d9a6700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd37806aa40 0x7fd37814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 -- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd37806bac0 msgr2=0x7fd378159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd37806bac0 0x7fd378159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 -- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd37806aa40 msgr2=0x7fd37814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd37806aa40 0x7fd37814ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 -- 172.21.15.46:0/442389449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700093c0 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37e1a7700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c840 tx=0x7fd368001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368012630 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680127b0 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368012b70 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd378151600 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.465+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37814e310 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.467+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37804c3c0 con 0x7fd3780c91e0 2023-10-07T08:59:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.467+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd368003030 con 0x7fd3780c91e0 2023-10-07T08:59:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.467+0000 7fd375ffb700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 0x7fd3640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.467+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3680844f0 con 0x7fd3780c91e0 2023-10-07T08:59:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.467+0000 7fd37d9a6700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 0x7fd3640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.468+0000 7fd37d9a6700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 0x7fd3640693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd370009390 tx=0x7fd370016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:28.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.471+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd368051760 con 0x7fd3780c91e0 2023-10-07T08:59:28.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.660+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3780c7cb0 con 0x7fd364066f30 2023-10-07T08:59:28.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.668+0000 7fd375ffb700 1 -- 172.21.15.46:0/442389449 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264653 (secure 0 0 0) 0x7fd3780c7cb0 con 0x7fd364066f30 2023-10-07T08:59:28.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 msgr2=0x7fd3640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 0x7fd3640693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd370009390 tx=0x7fd370016000 comp rx=0 tx=0).stop 2023-10-07T08:59:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 msgr2=0x7fd378152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c840 tx=0x7fd368001670 comp rx=0 tx=0).stop 2023-10-07T08:59:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 shutdown_connections 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd364066f30 0x7fd3640693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3780c91e0 0x7fd378152370 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd37806aa40 0x7fd37814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 --2- 172.21.15.46:0/442389449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd37806bac0 0x7fd378159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 >> 172.21.15.46:0/442389449 conn(0x7fd3780cd670 msgr2=0x7fd3780cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 shutdown_connections 2023-10-07T08:59:28.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:28.671+0000 7fd37fc0a700 1 -- 172.21.15.46:0/442389449 wait complete. 2023-10-07T08:59:28.678 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:59:28.683 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-07T08:59:27.774146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382440,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592280,"statfs":{"total":773094113280,"available":770654494720,"internally_reserved":0,"allocated":4235264,"data_stored":2334756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001499"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969597+0000","last_change":"2023-10-07T08:59:22.966032+0000","last_active":"2023-10-07T08:59:22.969597+0000","last_peered":"2023-10-07T08:59:22.969597+0000","last_clean":"2023-10-07T08:59:22.969597+0000","last_became_active":"2023-10-07T08:59:22.963168+0000","last_became_peered":"2023-10-07T08:59:22.963168+0000","last_unstale":"2023-10-07T08:59:22.969597+0000","last_undegraded":"2023-10-07T08:59:22.969597+0000","last_fullsized":"2023-10-07T08:59:22.969597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.975413+0000","last_change":"2023-10-07T08:59:22.968766+0000","last_active":"2023-10-07T08:59:22.975413+0000","last_peered":"2023-10-07T08:59:22.975413+0000","last_clean":"2023-10-07T08:59:22.975413+0000","last_became_active":"2023-10-07T08:59:22.968453+0000","last_became_peered":"2023-10-07T08:59:22.968453+0000","last_unstale":"2023-10-07T08:59:22.975413+0000","last_undegraded":"2023-10-07T08:59:22.975413+0000","last_fullsized":"2023-10-07T08:59:22.975413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:32.765587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969379+0000","last_change":"2023-10-07T08:59:22.966930+0000","last_active":"2023-10-07T08:59:22.969379+0000","last_peered":"2023-10-07T08:59:22.969379+0000","last_clean":"2023-10-07T08:59:22.969379+0000","last_became_active":"2023-10-07T08:59:22.966662+0000","last_became_peered":"2023-10-07T08:59:22.966662+0000","last_unstale":"2023-10-07T08:59:22.969379+0000","last_undegraded":"2023-10-07T08:59:22.969379+0000","last_fullsized":"2023-10-07T08:59:22.969379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964269+0000","last_change":"2023-10-07T08:59:22.960408+0000","last_active":"2023-10-07T08:59:22.964269+0000","last_peered":"2023-10-07T08:59:22.964269+0000","last_clean":"2023-10-07T08:59:22.964269+0000","last_became_active":"2023-10-07T08:59:22.960131+0000","last_became_peered":"2023-10-07T08:59:22.960131+0000","last_unstale":"2023-10-07T08:59:22.964269+0000","last_undegraded":"2023-10-07T08:59:22.964269+0000","last_fullsized":"2023-10-07T08:59:22.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972970+0000","last_change":"2023-10-07T08:59:22.965143+0000","last_active":"2023-10-07T08:59:22.972970+0000","last_peered":"2023-10-07T08:59:22.972970+0000","last_clean":"2023-10-07T08:59:22.972970+0000","last_became_active":"2023-10-07T08:59:22.964866+0000","last_became_peered":"2023-10-07T08:59:22.964866+0000","last_unstale":"2023-10-07T08:59:22.972970+0000","last_undegraded":"2023-10-07T08:59:22.972970+0000","last_fullsized":"2023-10-07T08:59:22.972970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:35.827887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976468+0000","last_change":"2023-10-07T08:59:22.971761+0000","last_active":"2023-10-07T08:59:22.976468+0000","last_peered":"2023-10-07T08:59:22.976468+0000","last_clean":"2023-10-07T08:59:22.976468+0000","last_became_active":"2023-10-07T08:59:22.971439+0000","last_became_peered":"2023-10-07T08:59:22.971439+0000","last_unstale":"2023-10-07T08:59:22.976468+0000","last_undegraded":"2023-10-07T08:59:22.976468+0000","last_fullsized":"2023-10-07T08:59:22.976468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:19.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976877+0000","last_change":"2023-10-07T08:59:22.971534+0000","last_active":"2023-10-07T08:59:22.976877+0000","last_peered":"2023-10-07T08:59:22.976877+0000","last_clean":"2023-10-07T08:59:22.976877+0000","last_became_active":"2023-10-07T08:59:22.967972+0000","last_became_peered":"2023-10-07T08:59:22.967972+0000","last_unstale":"2023-10-07T08:59:22.976877+0000","last_undegraded":"2023-10-07T08:59:22.976877+0000","last_fullsized":"2023-10-07T08:59:22.976877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977068+0000","last_change":"2023-10-07T08:59:22.971721+0000","last_active":"2023-10-07T08:59:22.977068+0000","last_peered":"2023-10-07T08:59:22.977068+0000","last_clean":"2023-10-07T08:59:22.977068+0000","last_became_active":"2023-10-07T08:59:22.971001+0000","last_became_peered":"2023-10-07T08:59:22.971001+0000","last_unstale":"2023-10-07T08:59:22.977068+0000","last_undegraded":"2023-10-07T08:59:22.977068+0000","last_fullsized":"2023-10-07T08:59:22.977068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959807+0000","last_change":"2023-10-07T08:59:22.954651+0000","last_active":"2023-10-07T08:59:22.959807+0000","last_peered":"2023-10-07T08:59:22.959807+0000","last_clean":"2023-10-07T08:59:22.959807+0000","last_became_active":"2023-10-07T08:59:22.954361+0000","last_became_peered":"2023-10-07T08:59:22.954361+0000","last_unstale":"2023-10-07T08:59:22.959807+0000","last_undegraded":"2023-10-07T08:59:22.959807+0000","last_fullsized":"2023-10-07T08:59:22.959807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971264+0000","last_change":"2023-10-07T08:59:22.962607+0000","last_active":"2023-10-07T08:59:22.971264+0000","last_peered":"2023-10-07T08:59:22.971264+0000","last_clean":"2023-10-07T08:59:22.971264+0000","last_became_active":"2023-10-07T08:59:22.962301+0000","last_became_peered":"2023-10-07T08:59:22.962301+0000","last_unstale":"2023-10-07T08:59:22.971264+0000","last_undegraded":"2023-10-07T08:59:22.971264+0000","last_fullsized":"2023-10-07T08:59:22.971264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971329+0000","last_change":"2023-10-07T08:59:22.965344+0000","last_active":"2023-10-07T08:59:22.971329+0000","last_peered":"2023-10-07T08:59:22.971329+0000","last_clean":"2023-10-07T08:59:22.971329+0000","last_became_active":"2023-10-07T08:59:22.965080+0000","last_became_peered":"2023-10-07T08:59:22.965080+0000","last_unstale":"2023-10-07T08:59:22.971329+0000","last_undegraded":"2023-10-07T08:59:22.971329+0000","last_fullsized":"2023-10-07T08:59:22.971329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969297+0000","last_change":"2023-10-07T08:59:22.964523+0000","last_active":"2023-10-07T08:59:22.969297+0000","last_peered":"2023-10-07T08:59:22.969297+0000","last_clean":"2023-10-07T08:59:22.969297+0000","last_became_active":"2023-10-07T08:59:22.964258+0000","last_became_peered":"2023-10-07T08:59:22.964258+0000","last_unstale":"2023-10-07T08:59:22.969297+0000","last_undegraded":"2023-10-07T08:59:22.969297+0000","last_fullsized":"2023-10-07T08:59:22.969297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957669+0000","last_change":"2023-10-07T08:59:22.950494+0000","last_active":"2023-10-07T08:59:22.957669+0000","last_peered":"2023-10-07T08:59:22.957669+0000","last_clean":"2023-10-07T08:59:22.957669+0000","last_became_active":"2023-10-07T08:59:22.950214+0000","last_became_peered":"2023-10-07T08:59:22.950214+0000","last_unstale":"2023-10-07T08:59:22.957669+0000","last_undegraded":"2023-10-07T08:59:22.957669+0000","last_fullsized":"2023-10-07T08:59:22.957669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:30.838341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.962673+0000","last_change":"2023-10-07T08:59:22.960342+0000","last_active":"2023-10-07T08:59:22.962673+0000","last_peered":"2023-10-07T08:59:22.962673+0000","last_clean":"2023-10-07T08:59:22.962673+0000","last_became_active":"2023-10-07T08:59:22.960079+0000","last_became_peered":"2023-10-07T08:59:22.960079+0000","last_unstale":"2023-10-07T08:59:22.962673+0000","last_undegraded":"2023-10-07T08:59:22.962673+0000","last_fullsized":"2023-10-07T08:59:22.962673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969326+0000","last_change":"2023-10-07T08:59:22.964021+0000","last_active":"2023-10-07T08:59:22.969326+0000","last_peered":"2023-10-07T08:59:22.969326+0000","last_clean":"2023-10-07T08:59:22.969326+0000","last_became_active":"2023-10-07T08:59:22.963657+0000","last_became_peered":"2023-10-07T08:59:22.963657+0000","last_unstale":"2023-10-07T08:59:22.969326+0000","last_undegraded":"2023-10-07T08:59:22.969326+0000","last_fullsized":"2023-10-07T08:59:22.969326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977051+0000","last_change":"2023-10-07T08:59:22.973535+0000","last_active":"2023-10-07T08:59:22.977051+0000","last_peered":"2023-10-07T08:59:22.977051+0000","last_clean":"2023-10-07T08:59:22.977051+0000","last_became_active":"2023-10-07T08:59:22.972931+0000","last_became_peered":"2023-10-07T08:59:22.972931+0000","last_unstale":"2023-10-07T08:59:22.977051+0000","last_undegraded":"2023-10-07T08:59:22.977051+0000","last_fullsized":"2023-10-07T08:59:22.977051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974028+0000","last_change":"2023-10-07T08:59:22.971177+0000","last_active":"2023-10-07T08:59:22.974028+0000","last_peered":"2023-10-07T08:59:22.974028+0000","last_clean":"2023-10-07T08:59:22.974028+0000","last_became_active":"2023-10-07T08:59:22.970888+0000","last_became_peered":"2023-10-07T08:59:22.970888+0000","last_unstale":"2023-10-07T08:59:22.974028+0000","last_undegraded":"2023-10-07T08:59:22.974028+0000","last_fullsized":"2023-10-07T08:59:22.974028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971773+0000","last_change":"2023-10-07T08:59:22.965330+0000","last_active":"2023-10-07T08:59:22.971773+0000","last_peered":"2023-10-07T08:59:22.971773+0000","last_clean":"2023-10-07T08:59:22.971773+0000","last_became_active":"2023-10-07T08:59:22.965026+0000","last_became_peered":"2023-10-07T08:59:22.965026+0000","last_unstale":"2023-10-07T08:59:22.971773+0000","last_undegraded":"2023-10-07T08:59:22.971773+0000","last_fullsized":"2023-10-07T08:59:22.971773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:11.641653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971306+0000","last_change":"2023-10-07T08:59:22.965209+0000","last_active":"2023-10-07T08:59:22.971306+0000","last_peered":"2023-10-07T08:59:22.971306+0000","last_clean":"2023-10-07T08:59:22.971306+0000","last_became_active":"2023-10-07T08:59:22.964928+0000","last_became_peered":"2023-10-07T08:59:22.964928+0000","last_unstale":"2023-10-07T08:59:22.971306+0000","last_undegraded":"2023-10-07T08:59:22.971306+0000","last_fullsized":"2023-10-07T08:59:22.971306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972998+0000","last_change":"2023-10-07T08:59:22.966234+0000","last_active":"2023-10-07T08:59:22.972998+0000","last_peered":"2023-10-07T08:59:22.972998+0000","last_clean":"2023-10-07T08:59:22.972998+0000","last_became_active":"2023-10-07T08:59:22.965971+0000","last_became_peered":"2023-10-07T08:59:22.965971+0000","last_unstale":"2023-10-07T08:59:22.972998+0000","last_undegraded":"2023-10-07T08:59:22.972998+0000","last_fullsized":"2023-10-07T08:59:22.972998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:01.809856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968900+0000","last_change":"2023-10-07T08:59:22.966063+0000","last_active":"2023-10-07T08:59:22.968900+0000","last_peered":"2023-10-07T08:59:22.968900+0000","last_clean":"2023-10-07T08:59:22.968900+0000","last_became_active":"2023-10-07T08:59:22.965785+0000","last_became_peered":"2023-10-07T08:59:22.965785+0000","last_unstale":"2023-10-07T08:59:22.968900+0000","last_undegraded":"2023-10-07T08:59:22.968900+0000","last_fullsized":"2023-10-07T08:59:22.968900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965183+0000","last_change":"2023-10-07T08:59:22.962375+0000","last_active":"2023-10-07T08:59:22.965183+0000","last_peered":"2023-10-07T08:59:22.965183+0000","last_clean":"2023-10-07T08:59:22.965183+0000","last_became_active":"2023-10-07T08:59:22.961312+0000","last_became_peered":"2023-10-07T08:59:22.961312+0000","last_unstale":"2023-10-07T08:59:22.965183+0000","last_undegraded":"2023-10-07T08:59:22.965183+0000","last_fullsized":"2023-10-07T08:59:22.965183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971499+0000","last_change":"2023-10-07T08:59:22.967031+0000","last_active":"2023-10-07T08:59:22.971499+0000","last_peered":"2023-10-07T08:59:22.971499+0000","last_clean":"2023-10-07T08:59:22.971499+0000","last_became_active":"2023-10-07T08:59:22.966704+0000","last_became_peered":"2023-10-07T08:59:22.966704+0000","last_unstale":"2023-10-07T08:59:22.971499+0000","last_undegraded":"2023-10-07T08:59:22.971499+0000","last_fullsized":"2023-10-07T08:59:22.971499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973879+0000","last_change":"2023-10-07T08:59:22.968183+0000","last_active":"2023-10-07T08:59:22.973879+0000","last_peered":"2023-10-07T08:59:22.973879+0000","last_clean":"2023-10-07T08:59:22.973879+0000","last_became_active":"2023-10-07T08:59:22.967869+0000","last_became_peered":"2023-10-07T08:59:22.967869+0000","last_unstale":"2023-10-07T08:59:22.973879+0000","last_undegraded":"2023-10-07T08:59:22.973879+0000","last_fullsized":"2023-10-07T08:59:22.973879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976265+0000","last_change":"2023-10-07T08:59:22.975170+0000","last_active":"2023-10-07T08:59:22.976265+0000","last_peered":"2023-10-07T08:59:22.976265+0000","last_clean":"2023-10-07T08:59:22.976265+0000","last_became_active":"2023-10-07T08:59:22.974824+0000","last_became_peered":"2023-10-07T08:59:22.974824+0000","last_unstale":"2023-10-07T08:59:22.976265+0000","last_undegraded":"2023-10-07T08:59:22.976265+0000","last_fullsized":"2023-10-07T08:59:22.976265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976389+0000","last_change":"2023-10-07T08:59:22.971685+0000","last_active":"2023-10-07T08:59:22.976389+0000","last_peered":"2023-10-07T08:59:22.976389+0000","last_clean":"2023-10-07T08:59:22.976389+0000","last_became_active":"2023-10-07T08:59:22.971400+0000","last_became_peered":"2023-10-07T08:59:22.971400+0000","last_unstale":"2023-10-07T08:59:22.976389+0000","last_undegraded":"2023-10-07T08:59:22.976389+0000","last_fullsized":"2023-10-07T08:59:22.976389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:07:57.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964347+0000","last_change":"2023-10-07T08:59:22.960377+0000","last_active":"2023-10-07T08:59:22.964347+0000","last_peered":"2023-10-07T08:59:22.964347+0000","last_clean":"2023-10-07T08:59:22.964347+0000","last_became_active":"2023-10-07T08:59:22.960087+0000","last_became_peered":"2023-10-07T08:59:22.960087+0000","last_unstale":"2023-10-07T08:59:22.964347+0000","last_undegraded":"2023-10-07T08:59:22.964347+0000","last_fullsized":"2023-10-07T08:59:22.964347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969276+0000","last_change":"2023-10-07T08:59:22.964055+0000","last_active":"2023-10-07T08:59:22.969276+0000","last_peered":"2023-10-07T08:59:22.969276+0000","last_clean":"2023-10-07T08:59:22.969276+0000","last_became_active":"2023-10-07T08:59:22.963777+0000","last_became_peered":"2023-10-07T08:59:22.963777+0000","last_unstale":"2023-10-07T08:59:22.969276+0000","last_undegraded":"2023-10-07T08:59:22.969276+0000","last_fullsized":"2023-10-07T08:59:22.969276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:14.754496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967138+0000","last_change":"2023-10-07T08:59:22.964583+0000","last_active":"2023-10-07T08:59:22.967138+0000","last_peered":"2023-10-07T08:59:22.967138+0000","last_clean":"2023-10-07T08:59:22.967138+0000","last_became_active":"2023-10-07T08:59:22.964310+0000","last_became_peered":"2023-10-07T08:59:22.964310+0000","last_unstale":"2023-10-07T08:59:22.967138+0000","last_undegraded":"2023-10-07T08:59:22.967138+0000","last_fullsized":"2023-10-07T08:59:22.967138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970814+0000","last_change":"2023-10-07T08:59:22.961939+0000","last_active":"2023-10-07T08:59:22.970814+0000","last_peered":"2023-10-07T08:59:22.970814+0000","last_clean":"2023-10-07T08:59:22.970814+0000","last_became_active":"2023-10-07T08:59:22.961616+0000","last_became_peered":"2023-10-07T08:59:22.961616+0000","last_unstale":"2023-10-07T08:59:22.970814+0000","last_undegraded":"2023-10-07T08:59:22.970814+0000","last_fullsized":"2023-10-07T08:59:22.970814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967464+0000","last_change":"2023-10-07T08:59:22.959696+0000","last_active":"2023-10-07T08:59:22.967464+0000","last_peered":"2023-10-07T08:59:22.967464+0000","last_clean":"2023-10-07T08:59:22.967464+0000","last_became_active":"2023-10-07T08:59:22.959451+0000","last_became_peered":"2023-10-07T08:59:22.959451+0000","last_unstale":"2023-10-07T08:59:22.967464+0000","last_undegraded":"2023-10-07T08:59:22.967464+0000","last_fullsized":"2023-10-07T08:59:22.967464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977007+0000","last_change":"2023-10-07T08:59:22.973234+0000","last_active":"2023-10-07T08:59:22.977007+0000","last_peered":"2023-10-07T08:59:22.977007+0000","last_clean":"2023-10-07T08:59:22.977007+0000","last_became_active":"2023-10-07T08:59:22.971436+0000","last_became_peered":"2023-10-07T08:59:22.971436+0000","last_unstale":"2023-10-07T08:59:22.977007+0000","last_undegraded":"2023-10-07T08:59:22.977007+0000","last_fullsized":"2023-10-07T08:59:22.977007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973457+0000","last_change":"2023-10-07T08:59:22.972107+0000","last_active":"2023-10-07T08:59:22.973457+0000","last_peered":"2023-10-07T08:59:22.973457+0000","last_clean":"2023-10-07T08:59:22.973457+0000","last_became_active":"2023-10-07T08:59:22.971722+0000","last_became_peered":"2023-10-07T08:59:22.971722+0000","last_unstale":"2023-10-07T08:59:22.973457+0000","last_undegraded":"2023-10-07T08:59:22.973457+0000","last_fullsized":"2023-10-07T08:59:22.973457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969789+0000","last_change":"2023-10-07T08:59:21.960418+0000","last_active":"2023-10-07T08:59:22.969789+0000","last_peered":"2023-10-07T08:59:22.969789+0000","last_clean":"2023-10-07T08:59:22.969789+0000","last_became_active":"2023-10-07T08:59:21.960094+0000","last_became_peered":"2023-10-07T08:59:21.960094+0000","last_unstale":"2023-10-07T08:59:22.969789+0000","last_undegraded":"2023-10-07T08:59:22.969789+0000","last_fullsized":"2023-10-07T08:59:22.969789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968601+0000","last_change":"2023-10-07T08:59:22.961156+0000","last_active":"2023-10-07T08:59:22.968601+0000","last_peered":"2023-10-07T08:59:22.968601+0000","last_clean":"2023-10-07T08:59:22.968601+0000","last_became_active":"2023-10-07T08:59:22.960384+0000","last_became_peered":"2023-10-07T08:59:22.960384+0000","last_unstale":"2023-10-07T08:59:22.968601+0000","last_undegraded":"2023-10-07T08:59:22.968601+0000","last_fullsized":"2023-10-07T08:59:22.968601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971930+0000","last_change":"2023-10-07T08:59:21.959319+0000","last_active":"2023-10-07T08:59:22.971930+0000","last_peered":"2023-10-07T08:59:22.971930+0000","last_clean":"2023-10-07T08:59:22.971930+0000","last_became_active":"2023-10-07T08:59:21.959076+0000","last_became_peered":"2023-10-07T08:59:21.959076+0000","last_unstale":"2023-10-07T08:59:22.971930+0000","last_undegraded":"2023-10-07T08:59:22.971930+0000","last_fullsized":"2023-10-07T08:59:22.971930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968874+0000","last_change":"2023-10-07T08:59:22.964844+0000","last_active":"2023-10-07T08:59:22.968874+0000","last_peered":"2023-10-07T08:59:22.968874+0000","last_clean":"2023-10-07T08:59:22.968874+0000","last_became_active":"2023-10-07T08:59:22.964064+0000","last_became_peered":"2023-10-07T08:59:22.964064+0000","last_unstale":"2023-10-07T08:59:22.968874+0000","last_undegraded":"2023-10-07T08:59:22.968874+0000","last_fullsized":"2023-10-07T08:59:22.968874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976272+0000","last_change":"2023-10-07T08:59:21.953378+0000","last_active":"2023-10-07T08:59:22.976272+0000","last_peered":"2023-10-07T08:59:22.976272+0000","last_clean":"2023-10-07T08:59:22.976272+0000","last_became_active":"2023-10-07T08:59:21.950841+0000","last_became_peered":"2023-10-07T08:59:21.950841+0000","last_unstale":"2023-10-07T08:59:22.976272+0000","last_undegraded":"2023-10-07T08:59:22.976272+0000","last_fullsized":"2023-10-07T08:59:22.976272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:13.862576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973235+0000","last_change":"2023-10-07T08:59:22.962110+0000","last_active":"2023-10-07T08:59:22.973235+0000","last_peered":"2023-10-07T08:59:22.973235+0000","last_clean":"2023-10-07T08:59:22.973235+0000","last_became_active":"2023-10-07T08:59:22.960934+0000","last_became_peered":"2023-10-07T08:59:22.960934+0000","last_unstale":"2023-10-07T08:59:22.973235+0000","last_undegraded":"2023-10-07T08:59:22.973235+0000","last_fullsized":"2023-10-07T08:59:22.973235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963697+0000","last_change":"2023-10-07T08:59:21.960536+0000","last_active":"2023-10-07T08:59:22.963697+0000","last_peered":"2023-10-07T08:59:22.963697+0000","last_clean":"2023-10-07T08:59:22.963697+0000","last_became_active":"2023-10-07T08:59:21.960244+0000","last_became_peered":"2023-10-07T08:59:21.960244+0000","last_unstale":"2023-10-07T08:59:22.963697+0000","last_undegraded":"2023-10-07T08:59:22.963697+0000","last_fullsized":"2023-10-07T08:59:22.963697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:02:02.649357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971198+0000","last_change":"2023-10-07T08:59:22.964458+0000","last_active":"2023-10-07T08:59:22.971198+0000","last_peered":"2023-10-07T08:59:22.971198+0000","last_clean":"2023-10-07T08:59:22.971198+0000","last_became_active":"2023-10-07T08:59:22.962184+0000","last_became_peered":"2023-10-07T08:59:22.962184+0000","last_unstale":"2023-10-07T08:59:22.971198+0000","last_undegraded":"2023-10-07T08:59:22.971198+0000","last_fullsized":"2023-10-07T08:59:22.971198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965532+0000","last_change":"2023-10-07T08:59:21.950366+0000","last_active":"2023-10-07T08:59:22.965532+0000","last_peered":"2023-10-07T08:59:22.965532+0000","last_clean":"2023-10-07T08:59:22.965532+0000","last_became_active":"2023-10-07T08:59:21.950100+0000","last_became_peered":"2023-10-07T08:59:21.950100+0000","last_unstale":"2023-10-07T08:59:22.965532+0000","last_undegraded":"2023-10-07T08:59:22.965532+0000","last_fullsized":"2023-10-07T08:59:22.965532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:57.236161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976747+0000","last_change":"2023-10-07T08:59:22.971772+0000","last_active":"2023-10-07T08:59:22.976747+0000","last_peered":"2023-10-07T08:59:22.976747+0000","last_clean":"2023-10-07T08:59:22.976747+0000","last_became_active":"2023-10-07T08:59:22.971513+0000","last_became_peered":"2023-10-07T08:59:22.971513+0000","last_unstale":"2023-10-07T08:59:22.976747+0000","last_undegraded":"2023-10-07T08:59:22.976747+0000","last_fullsized":"2023-10-07T08:59:22.976747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964782+0000","last_change":"2023-10-07T08:59:21.954959+0000","last_active":"2023-10-07T08:59:22.964782+0000","last_peered":"2023-10-07T08:59:22.964782+0000","last_clean":"2023-10-07T08:59:22.964782+0000","last_became_active":"2023-10-07T08:59:21.954416+0000","last_became_peered":"2023-10-07T08:59:21.954416+0000","last_unstale":"2023-10-07T08:59:22.964782+0000","last_undegraded":"2023-10-07T08:59:22.964782+0000","last_fullsized":"2023-10-07T08:59:22.964782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:31.178523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960905+0000","last_change":"2023-10-07T08:59:22.956931+0000","last_active":"2023-10-07T08:59:22.960905+0000","last_peered":"2023-10-07T08:59:22.960905+0000","last_clean":"2023-10-07T08:59:22.960905+0000","last_became_active":"2023-10-07T08:59:22.956653+0000","last_became_peered":"2023-10-07T08:59:22.956653+0000","last_unstale":"2023-10-07T08:59:22.960905+0000","last_undegraded":"2023-10-07T08:59:22.960905+0000","last_fullsized":"2023-10-07T08:59:22.960905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958858+0000","last_change":"2023-10-07T08:59:21.955565+0000","last_active":"2023-10-07T08:59:22.958858+0000","last_peered":"2023-10-07T08:59:22.958858+0000","last_clean":"2023-10-07T08:59:22.958858+0000","last_became_active":"2023-10-07T08:59:21.955280+0000","last_became_peered":"2023-10-07T08:59:21.955280+0000","last_unstale":"2023-10-07T08:59:22.958858+0000","last_undegraded":"2023-10-07T08:59:22.958858+0000","last_fullsized":"2023-10-07T08:59:22.958858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:12.266896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974474+0000","last_change":"2023-10-07T08:59:22.968325+0000","last_active":"2023-10-07T08:59:22.974474+0000","last_peered":"2023-10-07T08:59:22.974474+0000","last_clean":"2023-10-07T08:59:22.974474+0000","last_became_active":"2023-10-07T08:59:22.968064+0000","last_became_peered":"2023-10-07T08:59:22.968064+0000","last_unstale":"2023-10-07T08:59:22.974474+0000","last_undegraded":"2023-10-07T08:59:22.974474+0000","last_fullsized":"2023-10-07T08:59:22.974474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947611+0000","last_change":"2023-10-07T08:59:21.954754+0000","last_active":"2023-10-07T08:59:22.947611+0000","last_peered":"2023-10-07T08:59:22.947611+0000","last_clean":"2023-10-07T08:59:22.947611+0000","last_became_active":"2023-10-07T08:59:21.954203+0000","last_became_peered":"2023-10-07T08:59:21.954203+0000","last_unstale":"2023-10-07T08:59:22.947611+0000","last_undegraded":"2023-10-07T08:59:22.947611+0000","last_fullsized":"2023-10-07T08:59:22.947611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:00.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969330+0000","last_change":"2023-10-07T08:59:22.965263+0000","last_active":"2023-10-07T08:59:22.969330+0000","last_peered":"2023-10-07T08:59:22.969330+0000","last_clean":"2023-10-07T08:59:22.969330+0000","last_became_active":"2023-10-07T08:59:22.964907+0000","last_became_peered":"2023-10-07T08:59:22.964907+0000","last_unstale":"2023-10-07T08:59:22.969330+0000","last_undegraded":"2023-10-07T08:59:22.969330+0000","last_fullsized":"2023-10-07T08:59:22.969330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961413+0000","last_change":"2023-10-07T08:59:21.958681+0000","last_active":"2023-10-07T08:59:22.961413+0000","last_peered":"2023-10-07T08:59:22.961413+0000","last_clean":"2023-10-07T08:59:22.961413+0000","last_became_active":"2023-10-07T08:59:21.958382+0000","last_became_peered":"2023-10-07T08:59:21.958382+0000","last_unstale":"2023-10-07T08:59:22.961413+0000","last_undegraded":"2023-10-07T08:59:22.961413+0000","last_fullsized":"2023-10-07T08:59:22.961413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:09.399693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976211+0000","last_change":"2023-10-07T08:59:22.970344+0000","last_active":"2023-10-07T08:59:22.976211+0000","last_peered":"2023-10-07T08:59:22.976211+0000","last_clean":"2023-10-07T08:59:22.976211+0000","last_became_active":"2023-10-07T08:59:22.970059+0000","last_became_peered":"2023-10-07T08:59:22.970059+0000","last_unstale":"2023-10-07T08:59:22.976211+0000","last_undegraded":"2023-10-07T08:59:22.976211+0000","last_fullsized":"2023-10-07T08:59:22.976211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952481+0000","last_change":"2023-10-07T08:59:21.959789+0000","last_active":"2023-10-07T08:59:22.952481+0000","last_peered":"2023-10-07T08:59:22.952481+0000","last_clean":"2023-10-07T08:59:22.952481+0000","last_became_active":"2023-10-07T08:59:21.959526+0000","last_became_peered":"2023-10-07T08:59:21.959526+0000","last_unstale":"2023-10-07T08:59:22.952481+0000","last_undegraded":"2023-10-07T08:59:22.952481+0000","last_fullsized":"2023-10-07T08:59:22.952481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976651+0000","last_change":"2023-10-07T08:59:22.973479+0000","last_active":"2023-10-07T08:59:22.976651+0000","last_peered":"2023-10-07T08:59:22.976651+0000","last_clean":"2023-10-07T08:59:22.976651+0000","last_became_active":"2023-10-07T08:59:22.973230+0000","last_became_peered":"2023-10-07T08:59:22.973230+0000","last_unstale":"2023-10-07T08:59:22.976651+0000","last_undegraded":"2023-10-07T08:59:22.976651+0000","last_fullsized":"2023-10-07T08:59:22.976651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:48:17.315649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972105+0000","last_change":"2023-10-07T08:59:21.957294+0000","last_active":"2023-10-07T08:59:22.972105+0000","last_peered":"2023-10-07T08:59:22.972105+0000","last_clean":"2023-10-07T08:59:22.972105+0000","last_became_active":"2023-10-07T08:59:21.956864+0000","last_became_peered":"2023-10-07T08:59:21.956864+0000","last_unstale":"2023-10-07T08:59:22.972105+0000","last_undegraded":"2023-10-07T08:59:22.972105+0000","last_fullsized":"2023-10-07T08:59:22.972105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969360+0000","last_change":"2023-10-07T08:59:22.966816+0000","last_active":"2023-10-07T08:59:22.969360+0000","last_peered":"2023-10-07T08:59:22.969360+0000","last_clean":"2023-10-07T08:59:22.969360+0000","last_became_active":"2023-10-07T08:59:22.966542+0000","last_became_peered":"2023-10-07T08:59:22.966542+0000","last_unstale":"2023-10-07T08:59:22.969360+0000","last_undegraded":"2023-10-07T08:59:22.969360+0000","last_fullsized":"2023-10-07T08:59:22.969360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978596+0000","last_change":"2023-10-07T08:59:21.951690+0000","last_active":"2023-10-07T08:59:22.978596+0000","last_peered":"2023-10-07T08:59:22.978596+0000","last_clean":"2023-10-07T08:59:22.978596+0000","last_became_active":"2023-10-07T08:59:21.951427+0000","last_became_peered":"2023-10-07T08:59:21.951427+0000","last_unstale":"2023-10-07T08:59:22.978596+0000","last_undegraded":"2023-10-07T08:59:22.978596+0000","last_fullsized":"2023-10-07T08:59:22.978596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:16.651091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976017+0000","last_change":"2023-10-07T08:59:22.971008+0000","last_active":"2023-10-07T08:59:22.976017+0000","last_peered":"2023-10-07T08:59:22.976017+0000","last_clean":"2023-10-07T08:59:22.976017+0000","last_became_active":"2023-10-07T08:59:22.970742+0000","last_became_peered":"2023-10-07T08:59:22.970742+0000","last_unstale":"2023-10-07T08:59:22.976017+0000","last_undegraded":"2023-10-07T08:59:22.976017+0000","last_fullsized":"2023-10-07T08:59:22.976017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967012+0000","last_change":"2023-10-07T08:59:21.957245+0000","last_active":"2023-10-07T08:59:22.967012+0000","last_peered":"2023-10-07T08:59:22.967012+0000","last_clean":"2023-10-07T08:59:22.967012+0000","last_became_active":"2023-10-07T08:59:21.956954+0000","last_became_peered":"2023-10-07T08:59:21.956954+0000","last_unstale":"2023-10-07T08:59:22.967012+0000","last_undegraded":"2023-10-07T08:59:22.967012+0000","last_fullsized":"2023-10-07T08:59:22.967012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965261+0000","last_change":"2023-10-07T08:59:22.963914+0000","last_active":"2023-10-07T08:59:22.965261+0000","last_peered":"2023-10-07T08:59:22.965261+0000","last_clean":"2023-10-07T08:59:22.965261+0000","last_became_active":"2023-10-07T08:59:22.963646+0000","last_became_peered":"2023-10-07T08:59:22.963646+0000","last_unstale":"2023-10-07T08:59:22.965261+0000","last_undegraded":"2023-10-07T08:59:22.965261+0000","last_fullsized":"2023-10-07T08:59:22.965261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949329+0000","last_change":"2023-10-07T08:59:21.958261+0000","last_active":"2023-10-07T08:59:22.949329+0000","last_peered":"2023-10-07T08:59:22.949329+0000","last_clean":"2023-10-07T08:59:22.949329+0000","last_became_active":"2023-10-07T08:59:21.957949+0000","last_became_peered":"2023-10-07T08:59:21.957949+0000","last_unstale":"2023-10-07T08:59:22.949329+0000","last_undegraded":"2023-10-07T08:59:22.949329+0000","last_fullsized":"2023-10-07T08:59:22.949329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977033+0000","last_change":"2023-10-07T08:59:22.973392+0000","last_active":"2023-10-07T08:59:22.977033+0000","last_peered":"2023-10-07T08:59:22.977033+0000","last_clean":"2023-10-07T08:59:22.977033+0000","last_became_active":"2023-10-07T08:59:22.970983+0000","last_became_peered":"2023-10-07T08:59:22.970983+0000","last_unstale":"2023-10-07T08:59:22.977033+0000","last_undegraded":"2023-10-07T08:59:22.977033+0000","last_fullsized":"2023-10-07T08:59:22.977033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958967+0000","last_change":"2023-10-07T08:59:21.958676+0000","last_active":"2023-10-07T08:59:22.958967+0000","last_peered":"2023-10-07T08:59:22.958967+0000","last_clean":"2023-10-07T08:59:22.958967+0000","last_became_active":"2023-10-07T08:59:21.958407+0000","last_became_peered":"2023-10-07T08:59:21.958407+0000","last_unstale":"2023-10-07T08:59:22.958967+0000","last_undegraded":"2023-10-07T08:59:22.958967+0000","last_fullsized":"2023-10-07T08:59:22.958967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974517+0000","last_change":"2023-10-07T08:59:22.967122+0000","last_active":"2023-10-07T08:59:22.974517+0000","last_peered":"2023-10-07T08:59:22.974517+0000","last_clean":"2023-10-07T08:59:22.974517+0000","last_became_active":"2023-10-07T08:59:22.966798+0000","last_became_peered":"2023-10-07T08:59:22.966798+0000","last_unstale":"2023-10-07T08:59:22.974517+0000","last_undegraded":"2023-10-07T08:59:22.974517+0000","last_fullsized":"2023-10-07T08:59:22.974517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:39.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976907+0000","last_change":"2023-10-07T08:59:21.951544+0000","last_active":"2023-10-07T08:59:22.976907+0000","last_peered":"2023-10-07T08:59:22.976907+0000","last_clean":"2023-10-07T08:59:22.976907+0000","last_became_active":"2023-10-07T08:59:21.951224+0000","last_became_peered":"2023-10-07T08:59:21.951224+0000","last_unstale":"2023-10-07T08:59:22.976907+0000","last_undegraded":"2023-10-07T08:59:22.976907+0000","last_fullsized":"2023-10-07T08:59:22.976907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:30:59.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974703+0000","last_change":"2023-10-07T08:59:22.969787+0000","last_active":"2023-10-07T08:59:22.974703+0000","last_peered":"2023-10-07T08:59:22.974703+0000","last_clean":"2023-10-07T08:59:22.974703+0000","last_became_active":"2023-10-07T08:59:22.969523+0000","last_became_peered":"2023-10-07T08:59:22.969523+0000","last_unstale":"2023-10-07T08:59:22.974703+0000","last_undegraded":"2023-10-07T08:59:22.974703+0000","last_fullsized":"2023-10-07T08:59:22.974703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963665+0000","last_change":"2023-10-07T08:59:21.954238+0000","last_active":"2023-10-07T08:59:22.963665+0000","last_peered":"2023-10-07T08:59:22.963665+0000","last_clean":"2023-10-07T08:59:22.963665+0000","last_became_active":"2023-10-07T08:59:21.953919+0000","last_became_peered":"2023-10-07T08:59:21.953919+0000","last_unstale":"2023-10-07T08:59:22.963665+0000","last_undegraded":"2023-10-07T08:59:22.963665+0000","last_fullsized":"2023-10-07T08:59:22.963665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969501+0000","last_change":"2023-10-07T08:59:22.962830+0000","last_active":"2023-10-07T08:59:22.969501+0000","last_peered":"2023-10-07T08:59:22.969501+0000","last_clean":"2023-10-07T08:59:22.969501+0000","last_became_active":"2023-10-07T08:59:22.962523+0000","last_became_peered":"2023-10-07T08:59:22.962523+0000","last_unstale":"2023-10-07T08:59:22.969501+0000","last_undegraded":"2023-10-07T08:59:22.969501+0000","last_fullsized":"2023-10-07T08:59:22.969501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:51.060633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.966432+0000","last_change":"2023-10-07T08:59:21.957801+0000","last_active":"2023-10-07T08:59:22.966432+0000","last_peered":"2023-10-07T08:59:22.966432+0000","last_clean":"2023-10-07T08:59:22.966432+0000","last_became_active":"2023-10-07T08:59:21.957546+0000","last_became_peered":"2023-10-07T08:59:21.957546+0000","last_unstale":"2023-10-07T08:59:22.966432+0000","last_undegraded":"2023-10-07T08:59:22.966432+0000","last_fullsized":"2023-10-07T08:59:22.966432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964239+0000","last_change":"2023-10-07T08:59:22.960245+0000","last_active":"2023-10-07T08:59:22.964239+0000","last_peered":"2023-10-07T08:59:22.964239+0000","last_clean":"2023-10-07T08:59:22.964239+0000","last_became_active":"2023-10-07T08:59:22.959949+0000","last_became_peered":"2023-10-07T08:59:22.959949+0000","last_unstale":"2023-10-07T08:59:22.964239+0000","last_undegraded":"2023-10-07T08:59:22.964239+0000","last_fullsized":"2023-10-07T08:59:22.964239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960623+0000","last_change":"2023-10-07T08:59:21.956381+0000","last_active":"2023-10-07T08:59:22.960623+0000","last_peered":"2023-10-07T08:59:22.960623+0000","last_clean":"2023-10-07T08:59:22.960623+0000","last_became_active":"2023-10-07T08:59:21.956091+0000","last_became_peered":"2023-10-07T08:59:21.956091+0000","last_unstale":"2023-10-07T08:59:22.960623+0000","last_undegraded":"2023-10-07T08:59:22.960623+0000","last_fullsized":"2023-10-07T08:59:22.960623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973631+0000","last_change":"2023-10-07T08:59:22.966879+0000","last_active":"2023-10-07T08:59:22.973631+0000","last_peered":"2023-10-07T08:59:22.973631+0000","last_clean":"2023-10-07T08:59:22.973631+0000","last_became_active":"2023-10-07T08:59:22.966568+0000","last_became_peered":"2023-10-07T08:59:22.966568+0000","last_unstale":"2023-10-07T08:59:22.973631+0000","last_undegraded":"2023-10-07T08:59:22.973631+0000","last_fullsized":"2023-10-07T08:59:22.973631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:10.201801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947762+0000","last_change":"2023-10-07T08:59:21.949515+0000","last_active":"2023-10-07T08:59:22.947762+0000","last_peered":"2023-10-07T08:59:22.947762+0000","last_clean":"2023-10-07T08:59:22.947762+0000","last_became_active":"2023-10-07T08:59:21.949242+0000","last_became_peered":"2023-10-07T08:59:21.949242+0000","last_unstale":"2023-10-07T08:59:22.947762+0000","last_undegraded":"2023-10-07T08:59:22.947762+0000","last_fullsized":"2023-10-07T08:59:22.947762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:49.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959579+0000","last_change":"2023-10-07T08:59:22.953298+0000","last_active":"2023-10-07T08:59:22.959579+0000","last_peered":"2023-10-07T08:59:22.959579+0000","last_clean":"2023-10-07T08:59:22.959579+0000","last_became_active":"2023-10-07T08:59:22.952968+0000","last_became_peered":"2023-10-07T08:59:22.952968+0000","last_unstale":"2023-10-07T08:59:22.959579+0000","last_undegraded":"2023-10-07T08:59:22.959579+0000","last_fullsized":"2023-10-07T08:59:22.959579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:41.722574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978027+0000","last_change":"2023-10-07T08:59:21.957699+0000","last_active":"2023-10-07T08:59:22.978027+0000","last_peered":"2023-10-07T08:59:22.978027+0000","last_clean":"2023-10-07T08:59:22.978027+0000","last_became_active":"2023-10-07T08:59:21.957442+0000","last_became_peered":"2023-10-07T08:59:21.957442+0000","last_unstale":"2023-10-07T08:59:22.978027+0000","last_undegraded":"2023-10-07T08:59:22.978027+0000","last_fullsized":"2023-10-07T08:59:22.978027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972948+0000","last_change":"2023-10-07T08:59:22.964265+0000","last_active":"2023-10-07T08:59:22.972948+0000","last_peered":"2023-10-07T08:59:22.972948+0000","last_clean":"2023-10-07T08:59:22.972948+0000","last_became_active":"2023-10-07T08:59:22.963974+0000","last_became_peered":"2023-10-07T08:59:22.963974+0000","last_unstale":"2023-10-07T08:59:22.972948+0000","last_undegraded":"2023-10-07T08:59:22.972948+0000","last_fullsized":"2023-10-07T08:59:22.972948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:34.140709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952643+0000","last_change":"2023-10-07T08:59:21.959701+0000","last_active":"2023-10-07T08:59:22.952643+0000","last_peered":"2023-10-07T08:59:22.952643+0000","last_clean":"2023-10-07T08:59:22.952643+0000","last_became_active":"2023-10-07T08:59:21.959434+0000","last_became_peered":"2023-10-07T08:59:21.959434+0000","last_unstale":"2023-10-07T08:59:22.952643+0000","last_undegraded":"2023-10-07T08:59:22.952643+0000","last_fullsized":"2023-10-07T08:59:22.952643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968272+0000","last_change":"2023-10-07T08:59:22.963370+0000","last_active":"2023-10-07T08:59:22.968272+0000","last_peered":"2023-10-07T08:59:22.968272+0000","last_clean":"2023-10-07T08:59:22.968272+0000","last_became_active":"2023-10-07T08:59:22.963002+0000","last_became_peered":"2023-10-07T08:59:22.963002+0000","last_unstale":"2023-10-07T08:59:22.968272+0000","last_undegraded":"2023-10-07T08:59:22.968272+0000","last_fullsized":"2023-10-07T08:59:22.968272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:58.241693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947856+0000","last_change":"2023-10-07T08:59:21.951124+0000","last_active":"2023-10-07T08:59:22.947856+0000","last_peered":"2023-10-07T08:59:22.947856+0000","last_clean":"2023-10-07T08:59:22.947856+0000","last_became_active":"2023-10-07T08:59:21.950935+0000","last_became_peered":"2023-10-07T08:59:21.950935+0000","last_unstale":"2023-10-07T08:59:22.947856+0000","last_undegraded":"2023-10-07T08:59:22.947856+0000","last_fullsized":"2023-10-07T08:59:22.947856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:54.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976900+0000","last_change":"2023-10-07T08:59:22.971562+0000","last_active":"2023-10-07T08:59:22.976900+0000","last_peered":"2023-10-07T08:59:22.976900+0000","last_clean":"2023-10-07T08:59:22.976900+0000","last_became_active":"2023-10-07T08:59:22.971230+0000","last_became_peered":"2023-10-07T08:59:22.971230+0000","last_unstale":"2023-10-07T08:59:22.976900+0000","last_undegraded":"2023-10-07T08:59:22.976900+0000","last_fullsized":"2023-10-07T08:59:22.976900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955316+0000","last_change":"2023-10-07T08:59:21.959123+0000","last_active":"2023-10-07T08:59:22.955316+0000","last_peered":"2023-10-07T08:59:22.955316+0000","last_clean":"2023-10-07T08:59:22.955316+0000","last_became_active":"2023-10-07T08:59:21.958832+0000","last_became_peered":"2023-10-07T08:59:21.958832+0000","last_unstale":"2023-10-07T08:59:22.955316+0000","last_undegraded":"2023-10-07T08:59:22.955316+0000","last_fullsized":"2023-10-07T08:59:22.955316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:32.934580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969052+0000","last_change":"2023-10-07T08:59:22.963437+0000","last_active":"2023-10-07T08:59:22.969052+0000","last_peered":"2023-10-07T08:59:22.969052+0000","last_clean":"2023-10-07T08:59:22.969052+0000","last_became_active":"2023-10-07T08:59:22.963178+0000","last_became_peered":"2023-10-07T08:59:22.963178+0000","last_unstale":"2023-10-07T08:59:22.969052+0000","last_undegraded":"2023-10-07T08:59:22.969052+0000","last_fullsized":"2023-10-07T08:59:22.969052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:28.000390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974496+0000","last_change":"2023-10-07T08:59:21.959424+0000","last_active":"2023-10-07T08:59:22.974496+0000","last_peered":"2023-10-07T08:59:22.974496+0000","last_clean":"2023-10-07T08:59:22.974496+0000","last_became_active":"2023-10-07T08:59:21.959117+0000","last_became_peered":"2023-10-07T08:59:21.959117+0000","last_unstale":"2023-10-07T08:59:22.974496+0000","last_undegraded":"2023-10-07T08:59:22.974496+0000","last_fullsized":"2023-10-07T08:59:22.974496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969562+0000","last_change":"2023-10-07T08:59:22.965766+0000","last_active":"2023-10-07T08:59:22.969562+0000","last_peered":"2023-10-07T08:59:22.969562+0000","last_clean":"2023-10-07T08:59:22.969562+0000","last_became_active":"2023-10-07T08:59:22.965507+0000","last_became_peered":"2023-10-07T08:59:22.965507+0000","last_unstale":"2023-10-07T08:59:22.969562+0000","last_undegraded":"2023-10-07T08:59:22.969562+0000","last_fullsized":"2023-10-07T08:59:22.969562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-07T08:59:23.958758+0000","last_change":"2023-10-07T08:59:21.956983+0000","last_active":"2023-10-07T08:59:23.958758+0000","last_peered":"2023-10-07T08:59:23.958758+0000","last_clean":"2023-10-07T08:59:23.958758+0000","last_became_active":"2023-10-07T08:59:21.956701+0000","last_became_peered":"2023-10-07T08:59:21.956701+0000","last_unstale":"2023-10-07T08:59:23.958758+0000","last_undegraded":"2023-10-07T08:59:23.958758+0000","last_fullsized":"2023-10-07T08:59:23.958758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967249+0000","last_change":"2023-10-07T08:59:22.963033+0000","last_active":"2023-10-07T08:59:22.967249+0000","last_peered":"2023-10-07T08:59:22.967249+0000","last_clean":"2023-10-07T08:59:22.967249+0000","last_became_active":"2023-10-07T08:59:22.962738+0000","last_became_peered":"2023-10-07T08:59:22.962738+0000","last_unstale":"2023-10-07T08:59:22.967249+0000","last_undegraded":"2023-10-07T08:59:22.967249+0000","last_fullsized":"2023-10-07T08:59:22.967249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947669+0000","last_change":"2023-10-07T08:59:21.956828+0000","last_active":"2023-10-07T08:59:22.947669+0000","last_peered":"2023-10-07T08:59:22.947669+0000","last_clean":"2023-10-07T08:59:22.947669+0000","last_became_active":"2023-10-07T08:59:21.956570+0000","last_became_peered":"2023-10-07T08:59:21.956570+0000","last_unstale":"2023-10-07T08:59:22.947669+0000","last_undegraded":"2023-10-07T08:59:22.947669+0000","last_fullsized":"2023-10-07T08:59:22.947669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968481+0000","last_change":"2023-10-07T08:59:22.963523+0000","last_active":"2023-10-07T08:59:22.968481+0000","last_peered":"2023-10-07T08:59:22.968481+0000","last_clean":"2023-10-07T08:59:22.968481+0000","last_became_active":"2023-10-07T08:59:22.963240+0000","last_became_peered":"2023-10-07T08:59:22.963240+0000","last_unstale":"2023-10-07T08:59:22.968481+0000","last_undegraded":"2023-10-07T08:59:22.968481+0000","last_fullsized":"2023-10-07T08:59:22.968481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:33.940112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955155+0000","last_change":"2023-10-07T08:59:21.958204+0000","last_active":"2023-10-07T08:59:22.955155+0000","last_peered":"2023-10-07T08:59:22.955155+0000","last_clean":"2023-10-07T08:59:22.955155+0000","last_became_active":"2023-10-07T08:59:21.957951+0000","last_became_peered":"2023-10-07T08:59:21.957951+0000","last_unstale":"2023-10-07T08:59:22.955155+0000","last_undegraded":"2023-10-07T08:59:22.955155+0000","last_fullsized":"2023-10-07T08:59:22.955155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970961+0000","last_change":"2023-10-07T08:59:22.963055+0000","last_active":"2023-10-07T08:59:22.970961+0000","last_peered":"2023-10-07T08:59:22.970961+0000","last_clean":"2023-10-07T08:59:22.970961+0000","last_became_active":"2023-10-07T08:59:22.962594+0000","last_became_peered":"2023-10-07T08:59:22.962594+0000","last_unstale":"2023-10-07T08:59:22.970961+0000","last_undegraded":"2023-10-07T08:59:22.970961+0000","last_fullsized":"2023-10-07T08:59:22.970961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949360+0000","last_change":"2023-10-07T08:59:21.957647+0000","last_active":"2023-10-07T08:59:22.949360+0000","last_peered":"2023-10-07T08:59:22.949360+0000","last_clean":"2023-10-07T08:59:22.949360+0000","last_became_active":"2023-10-07T08:59:21.957377+0000","last_became_peered":"2023-10-07T08:59:21.957377+0000","last_unstale":"2023-10-07T08:59:22.949360+0000","last_undegraded":"2023-10-07T08:59:22.949360+0000","last_fullsized":"2023-10-07T08:59:22.949360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961666+0000","last_change":"2023-10-07T08:59:22.958557+0000","last_active":"2023-10-07T08:59:22.961666+0000","last_peered":"2023-10-07T08:59:22.961666+0000","last_clean":"2023-10-07T08:59:22.961666+0000","last_became_active":"2023-10-07T08:59:22.958198+0000","last_became_peered":"2023-10-07T08:59:22.958198+0000","last_unstale":"2023-10-07T08:59:22.961666+0000","last_undegraded":"2023-10-07T08:59:22.961666+0000","last_fullsized":"2023-10-07T08:59:22.961666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947969+0000","last_change":"2023-10-07T08:59:21.957341+0000","last_active":"2023-10-07T08:59:22.947969+0000","last_peered":"2023-10-07T08:59:22.947969+0000","last_clean":"2023-10-07T08:59:22.947969+0000","last_became_active":"2023-10-07T08:59:21.957033+0000","last_became_peered":"2023-10-07T08:59:21.957033+0000","last_unstale":"2023-10-07T08:59:22.947969+0000","last_undegraded":"2023-10-07T08:59:22.947969+0000","last_fullsized":"2023-10-07T08:59:22.947969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:06.282559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967082+0000","last_change":"2023-10-07T08:59:22.964316+0000","last_active":"2023-10-07T08:59:22.967082+0000","last_peered":"2023-10-07T08:59:22.967082+0000","last_clean":"2023-10-07T08:59:22.967082+0000","last_became_active":"2023-10-07T08:59:22.964034+0000","last_became_peered":"2023-10-07T08:59:22.964034+0000","last_unstale":"2023-10-07T08:59:22.967082+0000","last_undegraded":"2023-10-07T08:59:22.967082+0000","last_fullsized":"2023-10-07T08:59:22.967082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959239+0000","last_change":"2023-10-07T08:59:21.960520+0000","last_active":"2023-10-07T08:59:22.959239+0000","last_peered":"2023-10-07T08:59:22.959239+0000","last_clean":"2023-10-07T08:59:22.959239+0000","last_became_active":"2023-10-07T08:59:21.960255+0000","last_became_peered":"2023-10-07T08:59:21.960255+0000","last_unstale":"2023-10-07T08:59:22.959239+0000","last_undegraded":"2023-10-07T08:59:22.959239+0000","last_fullsized":"2023-10-07T08:59:22.959239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:19.684755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976927+0000","last_change":"2023-10-07T08:59:22.972802+0000","last_active":"2023-10-07T08:59:22.976927+0000","last_peered":"2023-10-07T08:59:22.976927+0000","last_clean":"2023-10-07T08:59:22.976927+0000","last_became_active":"2023-10-07T08:59:22.971123+0000","last_became_peered":"2023-10-07T08:59:22.971123+0000","last_unstale":"2023-10-07T08:59:22.976927+0000","last_undegraded":"2023-10-07T08:59:22.976927+0000","last_fullsized":"2023-10-07T08:59:22.976927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952622+0000","last_change":"2023-10-07T08:59:21.959379+0000","last_active":"2023-10-07T08:59:22.952622+0000","last_peered":"2023-10-07T08:59:22.952622+0000","last_clean":"2023-10-07T08:59:22.952622+0000","last_became_active":"2023-10-07T08:59:21.959112+0000","last_became_peered":"2023-10-07T08:59:21.959112+0000","last_unstale":"2023-10-07T08:59:22.952622+0000","last_undegraded":"2023-10-07T08:59:22.952622+0000","last_fullsized":"2023-10-07T08:59:22.952622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957798+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:22.957798+0000","last_peered":"2023-10-07T08:59:22.957798+0000","last_clean":"2023-10-07T08:59:22.957798+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:22.957798+0000","last_undegraded":"2023-10-07T08:59:22.957798+0000","last_fullsized":"2023-10-07T08:59:22.957798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:59:31.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:59:31.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 Processor -- start 2023-10-07T08:59:31.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 -- start start 2023-10-07T08:59:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159890 0x7fa54815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa548159c60 0x7fa54815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54815a160 con 0x7fa54815db10 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5480d13a0 con 0x7fa548159c60 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.828+0000 7fa54ed84700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54815e140 con 0x7fa548159890 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa548159c60 0x7fa54815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa54d321700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa54815db10 0x7fa548069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa54d321700 1 -- 172.21.15.46:0/2149317985 learned_addr learned my addr 172.21.15.46:0/2149317985 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa54cb20700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159890 0x7fa54815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 -- 172.21.15.46:0/2149317985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159890 msgr2=0x7fa54815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159890 0x7fa54815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 -- 172.21.15.46:0/2149317985 >> v1:172.21.15.46:6789/0 conn(0x7fa54815db10 legacy=0x7fa548069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa5477fe700 1 -- 172.21.15.46:0/2149317985 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098374089 0 0) 0x7fa54815a160 con 0x7fa54815db10 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 -- 172.21.15.46:0/2149317985 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54815a3d0 con 0x7fa548159c60 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa547fff700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159c60 0x7fa54815d5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa538009e60 tx=0x7fa538009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a769b4e37c216d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa5477fe700 1 -- 172.21.15.46:0/2149317985 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800e070 con 0x7fa548159c60 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa5477fe700 1 -- 172.21.15.46:0/2149317985 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53800bb60 con 0x7fa548159c60 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.829+0000 7fa5477fe700 1 -- 172.21.15.46:0/2149317985 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538012430 con 0x7fa548159c60 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 -- 172.21.15.46:0/2149317985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159c60 msgr2=0x7fa54815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159c60 0x7fa54815d5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa538009e60 tx=0x7fa538009780 comp rx=0 tx=0).stop 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 -- 172.21.15.46:0/2149317985 shutdown_connections 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159890 0x7fa54815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 --2- 172.21.15.46:0/2149317985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159c60 0x7fa54815d5d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 -- 172.21.15.46:0/2149317985 >> 172.21.15.46:0/2149317985 conn(0x7fa548068e20 msgr2=0x7fa5480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 -- 172.21.15.46:0/2149317985 shutdown_connections 2023-10-07T08:59:31.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.830+0000 7fa54ed84700 1 -- 172.21.15.46:0/2149317985 wait complete. 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.831+0000 7fa54ed84700 1 Processor -- start 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.831+0000 7fa54ed84700 1 -- start start 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159c60 0x7fa5481471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 0x7fa5480c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480ce7a0 con 0x7fa548159890 2023-10-07T08:59:31.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480cea40 con 0x7fa54815db10 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54ed84700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480ced20 con 0x7fa548159c60 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53002/0 (socket says 172.21.15.46:53002) 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 -- 172.21.15.46:0/3001978849 learned_addr learned my addr 172.21.15.46:0/3001978849 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 -- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159c60 msgr2=0x7fa5481471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54d321700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 0x7fa5480c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa547fff700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159c60 0x7fa5481471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159c60 0x7fa5481471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 -- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 msgr2=0x7fa5480c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 0x7fa5480c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 -- 172.21.15.46:0/3001978849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009a20 con 0x7fa548159890 2023-10-07T08:59:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54d321700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 0x7fa5480c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.832+0000 7fa54cb20700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa54000ec80 tx=0x7fa5400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.833+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000c9d0 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.833+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54000cb30 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.833+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5480cf000 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.833+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540013470 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.833+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa548147730 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.834+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54804c3c0 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.834+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa540013820 con 0x7fa548159890 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.834+0000 7fa544ff9700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:31.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.835+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5400848c0 con 0x7fa548159890 2023-10-07T08:59:31.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.835+0000 7fa547fff700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:31.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.835+0000 7fa547fff700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 0x7fa5280693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa54815a090 tx=0x7fa538019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:31.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:31.839+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa540051b30 con 0x7fa548159890 2023-10-07T08:59:32.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.030+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa54806a5b0 con 0x7fa528066f30 2023-10-07T08:59:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.039+0000 7fa544ff9700 1 -- 172.21.15.46:0/3001978849 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270539 (secure 0 0 0) 0x7fa54806a5b0 con 0x7fa528066f30 2023-10-07T08:59:32.043 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 msgr2=0x7fa5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 0x7fa5280693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa54815a090 tx=0x7fa538019000 comp rx=0 tx=0).stop 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 msgr2=0x7fa5480c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa54000ec80 tx=0x7fa5400091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 shutdown_connections 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa54815db10 0x7fa5480c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa548159890 0x7fa5480c9df0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 --2- 172.21.15.46:0/3001978849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa548159c60 0x7fa5481471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 >> 172.21.15.46:0/3001978849 conn(0x7fa548068e20 msgr2=0x7fa548152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 shutdown_connections 2023-10-07T08:59:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.042+0000 7fa54ed84700 1 -- 172.21.15.46:0/3001978849 wait complete. 2023-10-07T08:59:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T08:59:32.054 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-07T08:59:31.775312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382440,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592280,"statfs":{"total":773094113280,"available":770654494720,"internally_reserved":0,"allocated":4235264,"data_stored":2334756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.830579"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969597+0000","last_change":"2023-10-07T08:59:22.966032+0000","last_active":"2023-10-07T08:59:22.969597+0000","last_peered":"2023-10-07T08:59:22.969597+0000","last_clean":"2023-10-07T08:59:22.969597+0000","last_became_active":"2023-10-07T08:59:22.963168+0000","last_became_peered":"2023-10-07T08:59:22.963168+0000","last_unstale":"2023-10-07T08:59:22.969597+0000","last_undegraded":"2023-10-07T08:59:22.969597+0000","last_fullsized":"2023-10-07T08:59:22.969597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.975413+0000","last_change":"2023-10-07T08:59:22.968766+0000","last_active":"2023-10-07T08:59:22.975413+0000","last_peered":"2023-10-07T08:59:22.975413+0000","last_clean":"2023-10-07T08:59:22.975413+0000","last_became_active":"2023-10-07T08:59:22.968453+0000","last_became_peered":"2023-10-07T08:59:22.968453+0000","last_unstale":"2023-10-07T08:59:22.975413+0000","last_undegraded":"2023-10-07T08:59:22.975413+0000","last_fullsized":"2023-10-07T08:59:22.975413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:32.765587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969379+0000","last_change":"2023-10-07T08:59:22.966930+0000","last_active":"2023-10-07T08:59:22.969379+0000","last_peered":"2023-10-07T08:59:22.969379+0000","last_clean":"2023-10-07T08:59:22.969379+0000","last_became_active":"2023-10-07T08:59:22.966662+0000","last_became_peered":"2023-10-07T08:59:22.966662+0000","last_unstale":"2023-10-07T08:59:22.969379+0000","last_undegraded":"2023-10-07T08:59:22.969379+0000","last_fullsized":"2023-10-07T08:59:22.969379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964269+0000","last_change":"2023-10-07T08:59:22.960408+0000","last_active":"2023-10-07T08:59:22.964269+0000","last_peered":"2023-10-07T08:59:22.964269+0000","last_clean":"2023-10-07T08:59:22.964269+0000","last_became_active":"2023-10-07T08:59:22.960131+0000","last_became_peered":"2023-10-07T08:59:22.960131+0000","last_unstale":"2023-10-07T08:59:22.964269+0000","last_undegraded":"2023-10-07T08:59:22.964269+0000","last_fullsized":"2023-10-07T08:59:22.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972970+0000","last_change":"2023-10-07T08:59:22.965143+0000","last_active":"2023-10-07T08:59:22.972970+0000","last_peered":"2023-10-07T08:59:22.972970+0000","last_clean":"2023-10-07T08:59:22.972970+0000","last_became_active":"2023-10-07T08:59:22.964866+0000","last_became_peered":"2023-10-07T08:59:22.964866+0000","last_unstale":"2023-10-07T08:59:22.972970+0000","last_undegraded":"2023-10-07T08:59:22.972970+0000","last_fullsized":"2023-10-07T08:59:22.972970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:35.827887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976468+0000","last_change":"2023-10-07T08:59:22.971761+0000","last_active":"2023-10-07T08:59:22.976468+0000","last_peered":"2023-10-07T08:59:22.976468+0000","last_clean":"2023-10-07T08:59:22.976468+0000","last_became_active":"2023-10-07T08:59:22.971439+0000","last_became_peered":"2023-10-07T08:59:22.971439+0000","last_unstale":"2023-10-07T08:59:22.976468+0000","last_undegraded":"2023-10-07T08:59:22.976468+0000","last_fullsized":"2023-10-07T08:59:22.976468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:19.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976877+0000","last_change":"2023-10-07T08:59:22.971534+0000","last_active":"2023-10-07T08:59:22.976877+0000","last_peered":"2023-10-07T08:59:22.976877+0000","last_clean":"2023-10-07T08:59:22.976877+0000","last_became_active":"2023-10-07T08:59:22.967972+0000","last_became_peered":"2023-10-07T08:59:22.967972+0000","last_unstale":"2023-10-07T08:59:22.976877+0000","last_undegraded":"2023-10-07T08:59:22.976877+0000","last_fullsized":"2023-10-07T08:59:22.976877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977068+0000","last_change":"2023-10-07T08:59:22.971721+0000","last_active":"2023-10-07T08:59:22.977068+0000","last_peered":"2023-10-07T08:59:22.977068+0000","last_clean":"2023-10-07T08:59:22.977068+0000","last_became_active":"2023-10-07T08:59:22.971001+0000","last_became_peered":"2023-10-07T08:59:22.971001+0000","last_unstale":"2023-10-07T08:59:22.977068+0000","last_undegraded":"2023-10-07T08:59:22.977068+0000","last_fullsized":"2023-10-07T08:59:22.977068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959807+0000","last_change":"2023-10-07T08:59:22.954651+0000","last_active":"2023-10-07T08:59:22.959807+0000","last_peered":"2023-10-07T08:59:22.959807+0000","last_clean":"2023-10-07T08:59:22.959807+0000","last_became_active":"2023-10-07T08:59:22.954361+0000","last_became_peered":"2023-10-07T08:59:22.954361+0000","last_unstale":"2023-10-07T08:59:22.959807+0000","last_undegraded":"2023-10-07T08:59:22.959807+0000","last_fullsized":"2023-10-07T08:59:22.959807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:48.356691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971264+0000","last_change":"2023-10-07T08:59:22.962607+0000","last_active":"2023-10-07T08:59:22.971264+0000","last_peered":"2023-10-07T08:59:22.971264+0000","last_clean":"2023-10-07T08:59:22.971264+0000","last_became_active":"2023-10-07T08:59:22.962301+0000","last_became_peered":"2023-10-07T08:59:22.962301+0000","last_unstale":"2023-10-07T08:59:22.971264+0000","last_undegraded":"2023-10-07T08:59:22.971264+0000","last_fullsized":"2023-10-07T08:59:22.971264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971329+0000","last_change":"2023-10-07T08:59:22.965344+0000","last_active":"2023-10-07T08:59:22.971329+0000","last_peered":"2023-10-07T08:59:22.971329+0000","last_clean":"2023-10-07T08:59:22.971329+0000","last_became_active":"2023-10-07T08:59:22.965080+0000","last_became_peered":"2023-10-07T08:59:22.965080+0000","last_unstale":"2023-10-07T08:59:22.971329+0000","last_undegraded":"2023-10-07T08:59:22.971329+0000","last_fullsized":"2023-10-07T08:59:22.971329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969297+0000","last_change":"2023-10-07T08:59:22.964523+0000","last_active":"2023-10-07T08:59:22.969297+0000","last_peered":"2023-10-07T08:59:22.969297+0000","last_clean":"2023-10-07T08:59:22.969297+0000","last_became_active":"2023-10-07T08:59:22.964258+0000","last_became_peered":"2023-10-07T08:59:22.964258+0000","last_unstale":"2023-10-07T08:59:22.969297+0000","last_undegraded":"2023-10-07T08:59:22.969297+0000","last_fullsized":"2023-10-07T08:59:22.969297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957669+0000","last_change":"2023-10-07T08:59:22.950494+0000","last_active":"2023-10-07T08:59:22.957669+0000","last_peered":"2023-10-07T08:59:22.957669+0000","last_clean":"2023-10-07T08:59:22.957669+0000","last_became_active":"2023-10-07T08:59:22.950214+0000","last_became_peered":"2023-10-07T08:59:22.950214+0000","last_unstale":"2023-10-07T08:59:22.957669+0000","last_undegraded":"2023-10-07T08:59:22.957669+0000","last_fullsized":"2023-10-07T08:59:22.957669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:30.838341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.962673+0000","last_change":"2023-10-07T08:59:22.960342+0000","last_active":"2023-10-07T08:59:22.962673+0000","last_peered":"2023-10-07T08:59:22.962673+0000","last_clean":"2023-10-07T08:59:22.962673+0000","last_became_active":"2023-10-07T08:59:22.960079+0000","last_became_peered":"2023-10-07T08:59:22.960079+0000","last_unstale":"2023-10-07T08:59:22.962673+0000","last_undegraded":"2023-10-07T08:59:22.962673+0000","last_fullsized":"2023-10-07T08:59:22.962673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969326+0000","last_change":"2023-10-07T08:59:22.964021+0000","last_active":"2023-10-07T08:59:22.969326+0000","last_peered":"2023-10-07T08:59:22.969326+0000","last_clean":"2023-10-07T08:59:22.969326+0000","last_became_active":"2023-10-07T08:59:22.963657+0000","last_became_peered":"2023-10-07T08:59:22.963657+0000","last_unstale":"2023-10-07T08:59:22.969326+0000","last_undegraded":"2023-10-07T08:59:22.969326+0000","last_fullsized":"2023-10-07T08:59:22.969326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977051+0000","last_change":"2023-10-07T08:59:22.973535+0000","last_active":"2023-10-07T08:59:22.977051+0000","last_peered":"2023-10-07T08:59:22.977051+0000","last_clean":"2023-10-07T08:59:22.977051+0000","last_became_active":"2023-10-07T08:59:22.972931+0000","last_became_peered":"2023-10-07T08:59:22.972931+0000","last_unstale":"2023-10-07T08:59:22.977051+0000","last_undegraded":"2023-10-07T08:59:22.977051+0000","last_fullsized":"2023-10-07T08:59:22.977051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974028+0000","last_change":"2023-10-07T08:59:22.971177+0000","last_active":"2023-10-07T08:59:22.974028+0000","last_peered":"2023-10-07T08:59:22.974028+0000","last_clean":"2023-10-07T08:59:22.974028+0000","last_became_active":"2023-10-07T08:59:22.970888+0000","last_became_peered":"2023-10-07T08:59:22.970888+0000","last_unstale":"2023-10-07T08:59:22.974028+0000","last_undegraded":"2023-10-07T08:59:22.974028+0000","last_fullsized":"2023-10-07T08:59:22.974028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971773+0000","last_change":"2023-10-07T08:59:22.965330+0000","last_active":"2023-10-07T08:59:22.971773+0000","last_peered":"2023-10-07T08:59:22.971773+0000","last_clean":"2023-10-07T08:59:22.971773+0000","last_became_active":"2023-10-07T08:59:22.965026+0000","last_became_peered":"2023-10-07T08:59:22.965026+0000","last_unstale":"2023-10-07T08:59:22.971773+0000","last_undegraded":"2023-10-07T08:59:22.971773+0000","last_fullsized":"2023-10-07T08:59:22.971773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:11.641653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971306+0000","last_change":"2023-10-07T08:59:22.965209+0000","last_active":"2023-10-07T08:59:22.971306+0000","last_peered":"2023-10-07T08:59:22.971306+0000","last_clean":"2023-10-07T08:59:22.971306+0000","last_became_active":"2023-10-07T08:59:22.964928+0000","last_became_peered":"2023-10-07T08:59:22.964928+0000","last_unstale":"2023-10-07T08:59:22.971306+0000","last_undegraded":"2023-10-07T08:59:22.971306+0000","last_fullsized":"2023-10-07T08:59:22.971306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:57.749323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972998+0000","last_change":"2023-10-07T08:59:22.966234+0000","last_active":"2023-10-07T08:59:22.972998+0000","last_peered":"2023-10-07T08:59:22.972998+0000","last_clean":"2023-10-07T08:59:22.972998+0000","last_became_active":"2023-10-07T08:59:22.965971+0000","last_became_peered":"2023-10-07T08:59:22.965971+0000","last_unstale":"2023-10-07T08:59:22.972998+0000","last_undegraded":"2023-10-07T08:59:22.972998+0000","last_fullsized":"2023-10-07T08:59:22.972998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:01.809856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968900+0000","last_change":"2023-10-07T08:59:22.966063+0000","last_active":"2023-10-07T08:59:22.968900+0000","last_peered":"2023-10-07T08:59:22.968900+0000","last_clean":"2023-10-07T08:59:22.968900+0000","last_became_active":"2023-10-07T08:59:22.965785+0000","last_became_peered":"2023-10-07T08:59:22.965785+0000","last_unstale":"2023-10-07T08:59:22.968900+0000","last_undegraded":"2023-10-07T08:59:22.968900+0000","last_fullsized":"2023-10-07T08:59:22.968900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:57.284215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965183+0000","last_change":"2023-10-07T08:59:22.962375+0000","last_active":"2023-10-07T08:59:22.965183+0000","last_peered":"2023-10-07T08:59:22.965183+0000","last_clean":"2023-10-07T08:59:22.965183+0000","last_became_active":"2023-10-07T08:59:22.961312+0000","last_became_peered":"2023-10-07T08:59:22.961312+0000","last_unstale":"2023-10-07T08:59:22.965183+0000","last_undegraded":"2023-10-07T08:59:22.965183+0000","last_fullsized":"2023-10-07T08:59:22.965183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971499+0000","last_change":"2023-10-07T08:59:22.967031+0000","last_active":"2023-10-07T08:59:22.971499+0000","last_peered":"2023-10-07T08:59:22.971499+0000","last_clean":"2023-10-07T08:59:22.971499+0000","last_became_active":"2023-10-07T08:59:22.966704+0000","last_became_peered":"2023-10-07T08:59:22.966704+0000","last_unstale":"2023-10-07T08:59:22.971499+0000","last_undegraded":"2023-10-07T08:59:22.971499+0000","last_fullsized":"2023-10-07T08:59:22.971499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973879+0000","last_change":"2023-10-07T08:59:22.968183+0000","last_active":"2023-10-07T08:59:22.973879+0000","last_peered":"2023-10-07T08:59:22.973879+0000","last_clean":"2023-10-07T08:59:22.973879+0000","last_became_active":"2023-10-07T08:59:22.967869+0000","last_became_peered":"2023-10-07T08:59:22.967869+0000","last_unstale":"2023-10-07T08:59:22.973879+0000","last_undegraded":"2023-10-07T08:59:22.973879+0000","last_fullsized":"2023-10-07T08:59:22.973879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976265+0000","last_change":"2023-10-07T08:59:22.975170+0000","last_active":"2023-10-07T08:59:22.976265+0000","last_peered":"2023-10-07T08:59:22.976265+0000","last_clean":"2023-10-07T08:59:22.976265+0000","last_became_active":"2023-10-07T08:59:22.974824+0000","last_became_peered":"2023-10-07T08:59:22.974824+0000","last_unstale":"2023-10-07T08:59:22.976265+0000","last_undegraded":"2023-10-07T08:59:22.976265+0000","last_fullsized":"2023-10-07T08:59:22.976265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976389+0000","last_change":"2023-10-07T08:59:22.971685+0000","last_active":"2023-10-07T08:59:22.976389+0000","last_peered":"2023-10-07T08:59:22.976389+0000","last_clean":"2023-10-07T08:59:22.976389+0000","last_became_active":"2023-10-07T08:59:22.971400+0000","last_became_peered":"2023-10-07T08:59:22.971400+0000","last_unstale":"2023-10-07T08:59:22.976389+0000","last_undegraded":"2023-10-07T08:59:22.976389+0000","last_fullsized":"2023-10-07T08:59:22.976389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:07:57.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964347+0000","last_change":"2023-10-07T08:59:22.960377+0000","last_active":"2023-10-07T08:59:22.964347+0000","last_peered":"2023-10-07T08:59:22.964347+0000","last_clean":"2023-10-07T08:59:22.964347+0000","last_became_active":"2023-10-07T08:59:22.960087+0000","last_became_peered":"2023-10-07T08:59:22.960087+0000","last_unstale":"2023-10-07T08:59:22.964347+0000","last_undegraded":"2023-10-07T08:59:22.964347+0000","last_fullsized":"2023-10-07T08:59:22.964347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969276+0000","last_change":"2023-10-07T08:59:22.964055+0000","last_active":"2023-10-07T08:59:22.969276+0000","last_peered":"2023-10-07T08:59:22.969276+0000","last_clean":"2023-10-07T08:59:22.969276+0000","last_became_active":"2023-10-07T08:59:22.963777+0000","last_became_peered":"2023-10-07T08:59:22.963777+0000","last_unstale":"2023-10-07T08:59:22.969276+0000","last_undegraded":"2023-10-07T08:59:22.969276+0000","last_fullsized":"2023-10-07T08:59:22.969276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:14.754496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967138+0000","last_change":"2023-10-07T08:59:22.964583+0000","last_active":"2023-10-07T08:59:22.967138+0000","last_peered":"2023-10-07T08:59:22.967138+0000","last_clean":"2023-10-07T08:59:22.967138+0000","last_became_active":"2023-10-07T08:59:22.964310+0000","last_became_peered":"2023-10-07T08:59:22.964310+0000","last_unstale":"2023-10-07T08:59:22.967138+0000","last_undegraded":"2023-10-07T08:59:22.967138+0000","last_fullsized":"2023-10-07T08:59:22.967138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970814+0000","last_change":"2023-10-07T08:59:22.961939+0000","last_active":"2023-10-07T08:59:22.970814+0000","last_peered":"2023-10-07T08:59:22.970814+0000","last_clean":"2023-10-07T08:59:22.970814+0000","last_became_active":"2023-10-07T08:59:22.961616+0000","last_became_peered":"2023-10-07T08:59:22.961616+0000","last_unstale":"2023-10-07T08:59:22.970814+0000","last_undegraded":"2023-10-07T08:59:22.970814+0000","last_fullsized":"2023-10-07T08:59:22.970814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967464+0000","last_change":"2023-10-07T08:59:22.959696+0000","last_active":"2023-10-07T08:59:22.967464+0000","last_peered":"2023-10-07T08:59:22.967464+0000","last_clean":"2023-10-07T08:59:22.967464+0000","last_became_active":"2023-10-07T08:59:22.959451+0000","last_became_peered":"2023-10-07T08:59:22.959451+0000","last_unstale":"2023-10-07T08:59:22.967464+0000","last_undegraded":"2023-10-07T08:59:22.967464+0000","last_fullsized":"2023-10-07T08:59:22.967464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977007+0000","last_change":"2023-10-07T08:59:22.973234+0000","last_active":"2023-10-07T08:59:22.977007+0000","last_peered":"2023-10-07T08:59:22.977007+0000","last_clean":"2023-10-07T08:59:22.977007+0000","last_became_active":"2023-10-07T08:59:22.971436+0000","last_became_peered":"2023-10-07T08:59:22.971436+0000","last_unstale":"2023-10-07T08:59:22.977007+0000","last_undegraded":"2023-10-07T08:59:22.977007+0000","last_fullsized":"2023-10-07T08:59:22.977007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973457+0000","last_change":"2023-10-07T08:59:22.972107+0000","last_active":"2023-10-07T08:59:22.973457+0000","last_peered":"2023-10-07T08:59:22.973457+0000","last_clean":"2023-10-07T08:59:22.973457+0000","last_became_active":"2023-10-07T08:59:22.971722+0000","last_became_peered":"2023-10-07T08:59:22.971722+0000","last_unstale":"2023-10-07T08:59:22.973457+0000","last_undegraded":"2023-10-07T08:59:22.973457+0000","last_fullsized":"2023-10-07T08:59:22.973457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:10.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969789+0000","last_change":"2023-10-07T08:59:21.960418+0000","last_active":"2023-10-07T08:59:22.969789+0000","last_peered":"2023-10-07T08:59:22.969789+0000","last_clean":"2023-10-07T08:59:22.969789+0000","last_became_active":"2023-10-07T08:59:21.960094+0000","last_became_peered":"2023-10-07T08:59:21.960094+0000","last_unstale":"2023-10-07T08:59:22.969789+0000","last_undegraded":"2023-10-07T08:59:22.969789+0000","last_fullsized":"2023-10-07T08:59:22.969789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968601+0000","last_change":"2023-10-07T08:59:22.961156+0000","last_active":"2023-10-07T08:59:22.968601+0000","last_peered":"2023-10-07T08:59:22.968601+0000","last_clean":"2023-10-07T08:59:22.968601+0000","last_became_active":"2023-10-07T08:59:22.960384+0000","last_became_peered":"2023-10-07T08:59:22.960384+0000","last_unstale":"2023-10-07T08:59:22.968601+0000","last_undegraded":"2023-10-07T08:59:22.968601+0000","last_fullsized":"2023-10-07T08:59:22.968601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971930+0000","last_change":"2023-10-07T08:59:21.959319+0000","last_active":"2023-10-07T08:59:22.971930+0000","last_peered":"2023-10-07T08:59:22.971930+0000","last_clean":"2023-10-07T08:59:22.971930+0000","last_became_active":"2023-10-07T08:59:21.959076+0000","last_became_peered":"2023-10-07T08:59:21.959076+0000","last_unstale":"2023-10-07T08:59:22.971930+0000","last_undegraded":"2023-10-07T08:59:22.971930+0000","last_fullsized":"2023-10-07T08:59:22.971930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968874+0000","last_change":"2023-10-07T08:59:22.964844+0000","last_active":"2023-10-07T08:59:22.968874+0000","last_peered":"2023-10-07T08:59:22.968874+0000","last_clean":"2023-10-07T08:59:22.968874+0000","last_became_active":"2023-10-07T08:59:22.964064+0000","last_became_peered":"2023-10-07T08:59:22.964064+0000","last_unstale":"2023-10-07T08:59:22.968874+0000","last_undegraded":"2023-10-07T08:59:22.968874+0000","last_fullsized":"2023-10-07T08:59:22.968874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:13.272428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976272+0000","last_change":"2023-10-07T08:59:21.953378+0000","last_active":"2023-10-07T08:59:22.976272+0000","last_peered":"2023-10-07T08:59:22.976272+0000","last_clean":"2023-10-07T08:59:22.976272+0000","last_became_active":"2023-10-07T08:59:21.950841+0000","last_became_peered":"2023-10-07T08:59:21.950841+0000","last_unstale":"2023-10-07T08:59:22.976272+0000","last_undegraded":"2023-10-07T08:59:22.976272+0000","last_fullsized":"2023-10-07T08:59:22.976272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:13.862576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973235+0000","last_change":"2023-10-07T08:59:22.962110+0000","last_active":"2023-10-07T08:59:22.973235+0000","last_peered":"2023-10-07T08:59:22.973235+0000","last_clean":"2023-10-07T08:59:22.973235+0000","last_became_active":"2023-10-07T08:59:22.960934+0000","last_became_peered":"2023-10-07T08:59:22.960934+0000","last_unstale":"2023-10-07T08:59:22.973235+0000","last_undegraded":"2023-10-07T08:59:22.973235+0000","last_fullsized":"2023-10-07T08:59:22.973235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963697+0000","last_change":"2023-10-07T08:59:21.960536+0000","last_active":"2023-10-07T08:59:22.963697+0000","last_peered":"2023-10-07T08:59:22.963697+0000","last_clean":"2023-10-07T08:59:22.963697+0000","last_became_active":"2023-10-07T08:59:21.960244+0000","last_became_peered":"2023-10-07T08:59:21.960244+0000","last_unstale":"2023-10-07T08:59:22.963697+0000","last_undegraded":"2023-10-07T08:59:22.963697+0000","last_fullsized":"2023-10-07T08:59:22.963697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:02:02.649357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.971198+0000","last_change":"2023-10-07T08:59:22.964458+0000","last_active":"2023-10-07T08:59:22.971198+0000","last_peered":"2023-10-07T08:59:22.971198+0000","last_clean":"2023-10-07T08:59:22.971198+0000","last_became_active":"2023-10-07T08:59:22.962184+0000","last_became_peered":"2023-10-07T08:59:22.962184+0000","last_unstale":"2023-10-07T08:59:22.971198+0000","last_undegraded":"2023-10-07T08:59:22.971198+0000","last_fullsized":"2023-10-07T08:59:22.971198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965532+0000","last_change":"2023-10-07T08:59:21.950366+0000","last_active":"2023-10-07T08:59:22.965532+0000","last_peered":"2023-10-07T08:59:22.965532+0000","last_clean":"2023-10-07T08:59:22.965532+0000","last_became_active":"2023-10-07T08:59:21.950100+0000","last_became_peered":"2023-10-07T08:59:21.950100+0000","last_unstale":"2023-10-07T08:59:22.965532+0000","last_undegraded":"2023-10-07T08:59:22.965532+0000","last_fullsized":"2023-10-07T08:59:22.965532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:57.236161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976747+0000","last_change":"2023-10-07T08:59:22.971772+0000","last_active":"2023-10-07T08:59:22.976747+0000","last_peered":"2023-10-07T08:59:22.976747+0000","last_clean":"2023-10-07T08:59:22.976747+0000","last_became_active":"2023-10-07T08:59:22.971513+0000","last_became_peered":"2023-10-07T08:59:22.971513+0000","last_unstale":"2023-10-07T08:59:22.976747+0000","last_undegraded":"2023-10-07T08:59:22.976747+0000","last_fullsized":"2023-10-07T08:59:22.976747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:09.483099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964782+0000","last_change":"2023-10-07T08:59:21.954959+0000","last_active":"2023-10-07T08:59:22.964782+0000","last_peered":"2023-10-07T08:59:22.964782+0000","last_clean":"2023-10-07T08:59:22.964782+0000","last_became_active":"2023-10-07T08:59:21.954416+0000","last_became_peered":"2023-10-07T08:59:21.954416+0000","last_unstale":"2023-10-07T08:59:22.964782+0000","last_undegraded":"2023-10-07T08:59:22.964782+0000","last_fullsized":"2023-10-07T08:59:22.964782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:31.178523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960905+0000","last_change":"2023-10-07T08:59:22.956931+0000","last_active":"2023-10-07T08:59:22.960905+0000","last_peered":"2023-10-07T08:59:22.960905+0000","last_clean":"2023-10-07T08:59:22.960905+0000","last_became_active":"2023-10-07T08:59:22.956653+0000","last_became_peered":"2023-10-07T08:59:22.956653+0000","last_unstale":"2023-10-07T08:59:22.960905+0000","last_undegraded":"2023-10-07T08:59:22.960905+0000","last_fullsized":"2023-10-07T08:59:22.960905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:00.818404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958858+0000","last_change":"2023-10-07T08:59:21.955565+0000","last_active":"2023-10-07T08:59:22.958858+0000","last_peered":"2023-10-07T08:59:22.958858+0000","last_clean":"2023-10-07T08:59:22.958858+0000","last_became_active":"2023-10-07T08:59:21.955280+0000","last_became_peered":"2023-10-07T08:59:21.955280+0000","last_unstale":"2023-10-07T08:59:22.958858+0000","last_undegraded":"2023-10-07T08:59:22.958858+0000","last_fullsized":"2023-10-07T08:59:22.958858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:12.266896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974474+0000","last_change":"2023-10-07T08:59:22.968325+0000","last_active":"2023-10-07T08:59:22.974474+0000","last_peered":"2023-10-07T08:59:22.974474+0000","last_clean":"2023-10-07T08:59:22.974474+0000","last_became_active":"2023-10-07T08:59:22.968064+0000","last_became_peered":"2023-10-07T08:59:22.968064+0000","last_unstale":"2023-10-07T08:59:22.974474+0000","last_undegraded":"2023-10-07T08:59:22.974474+0000","last_fullsized":"2023-10-07T08:59:22.974474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:00.984777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947611+0000","last_change":"2023-10-07T08:59:21.954754+0000","last_active":"2023-10-07T08:59:22.947611+0000","last_peered":"2023-10-07T08:59:22.947611+0000","last_clean":"2023-10-07T08:59:22.947611+0000","last_became_active":"2023-10-07T08:59:21.954203+0000","last_became_peered":"2023-10-07T08:59:21.954203+0000","last_unstale":"2023-10-07T08:59:22.947611+0000","last_undegraded":"2023-10-07T08:59:22.947611+0000","last_fullsized":"2023-10-07T08:59:22.947611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:00.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969330+0000","last_change":"2023-10-07T08:59:22.965263+0000","last_active":"2023-10-07T08:59:22.969330+0000","last_peered":"2023-10-07T08:59:22.969330+0000","last_clean":"2023-10-07T08:59:22.969330+0000","last_became_active":"2023-10-07T08:59:22.964907+0000","last_became_peered":"2023-10-07T08:59:22.964907+0000","last_unstale":"2023-10-07T08:59:22.969330+0000","last_undegraded":"2023-10-07T08:59:22.969330+0000","last_fullsized":"2023-10-07T08:59:22.969330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:46.337332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961413+0000","last_change":"2023-10-07T08:59:21.958681+0000","last_active":"2023-10-07T08:59:22.961413+0000","last_peered":"2023-10-07T08:59:22.961413+0000","last_clean":"2023-10-07T08:59:22.961413+0000","last_became_active":"2023-10-07T08:59:21.958382+0000","last_became_peered":"2023-10-07T08:59:21.958382+0000","last_unstale":"2023-10-07T08:59:22.961413+0000","last_undegraded":"2023-10-07T08:59:22.961413+0000","last_fullsized":"2023-10-07T08:59:22.961413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:09.399693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976211+0000","last_change":"2023-10-07T08:59:22.970344+0000","last_active":"2023-10-07T08:59:22.976211+0000","last_peered":"2023-10-07T08:59:22.976211+0000","last_clean":"2023-10-07T08:59:22.976211+0000","last_became_active":"2023-10-07T08:59:22.970059+0000","last_became_peered":"2023-10-07T08:59:22.970059+0000","last_unstale":"2023-10-07T08:59:22.976211+0000","last_undegraded":"2023-10-07T08:59:22.976211+0000","last_fullsized":"2023-10-07T08:59:22.976211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:26.700754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952481+0000","last_change":"2023-10-07T08:59:21.959789+0000","last_active":"2023-10-07T08:59:22.952481+0000","last_peered":"2023-10-07T08:59:22.952481+0000","last_clean":"2023-10-07T08:59:22.952481+0000","last_became_active":"2023-10-07T08:59:21.959526+0000","last_became_peered":"2023-10-07T08:59:21.959526+0000","last_unstale":"2023-10-07T08:59:22.952481+0000","last_undegraded":"2023-10-07T08:59:22.952481+0000","last_fullsized":"2023-10-07T08:59:22.952481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976651+0000","last_change":"2023-10-07T08:59:22.973479+0000","last_active":"2023-10-07T08:59:22.976651+0000","last_peered":"2023-10-07T08:59:22.976651+0000","last_clean":"2023-10-07T08:59:22.976651+0000","last_became_active":"2023-10-07T08:59:22.973230+0000","last_became_peered":"2023-10-07T08:59:22.973230+0000","last_unstale":"2023-10-07T08:59:22.976651+0000","last_undegraded":"2023-10-07T08:59:22.976651+0000","last_fullsized":"2023-10-07T08:59:22.976651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:48:17.315649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972105+0000","last_change":"2023-10-07T08:59:21.957294+0000","last_active":"2023-10-07T08:59:22.972105+0000","last_peered":"2023-10-07T08:59:22.972105+0000","last_clean":"2023-10-07T08:59:22.972105+0000","last_became_active":"2023-10-07T08:59:21.956864+0000","last_became_peered":"2023-10-07T08:59:21.956864+0000","last_unstale":"2023-10-07T08:59:22.972105+0000","last_undegraded":"2023-10-07T08:59:22.972105+0000","last_fullsized":"2023-10-07T08:59:22.972105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969360+0000","last_change":"2023-10-07T08:59:22.966816+0000","last_active":"2023-10-07T08:59:22.969360+0000","last_peered":"2023-10-07T08:59:22.969360+0000","last_clean":"2023-10-07T08:59:22.969360+0000","last_became_active":"2023-10-07T08:59:22.966542+0000","last_became_peered":"2023-10-07T08:59:22.966542+0000","last_unstale":"2023-10-07T08:59:22.969360+0000","last_undegraded":"2023-10-07T08:59:22.969360+0000","last_fullsized":"2023-10-07T08:59:22.969360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:14.495602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978596+0000","last_change":"2023-10-07T08:59:21.951690+0000","last_active":"2023-10-07T08:59:22.978596+0000","last_peered":"2023-10-07T08:59:22.978596+0000","last_clean":"2023-10-07T08:59:22.978596+0000","last_became_active":"2023-10-07T08:59:21.951427+0000","last_became_peered":"2023-10-07T08:59:21.951427+0000","last_unstale":"2023-10-07T08:59:22.978596+0000","last_undegraded":"2023-10-07T08:59:22.978596+0000","last_fullsized":"2023-10-07T08:59:22.978596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:16.651091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976017+0000","last_change":"2023-10-07T08:59:22.971008+0000","last_active":"2023-10-07T08:59:22.976017+0000","last_peered":"2023-10-07T08:59:22.976017+0000","last_clean":"2023-10-07T08:59:22.976017+0000","last_became_active":"2023-10-07T08:59:22.970742+0000","last_became_peered":"2023-10-07T08:59:22.970742+0000","last_unstale":"2023-10-07T08:59:22.976017+0000","last_undegraded":"2023-10-07T08:59:22.976017+0000","last_fullsized":"2023-10-07T08:59:22.976017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:25.181857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967012+0000","last_change":"2023-10-07T08:59:21.957245+0000","last_active":"2023-10-07T08:59:22.967012+0000","last_peered":"2023-10-07T08:59:22.967012+0000","last_clean":"2023-10-07T08:59:22.967012+0000","last_became_active":"2023-10-07T08:59:21.956954+0000","last_became_peered":"2023-10-07T08:59:21.956954+0000","last_unstale":"2023-10-07T08:59:22.967012+0000","last_undegraded":"2023-10-07T08:59:22.967012+0000","last_fullsized":"2023-10-07T08:59:22.967012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.965261+0000","last_change":"2023-10-07T08:59:22.963914+0000","last_active":"2023-10-07T08:59:22.965261+0000","last_peered":"2023-10-07T08:59:22.965261+0000","last_clean":"2023-10-07T08:59:22.965261+0000","last_became_active":"2023-10-07T08:59:22.963646+0000","last_became_peered":"2023-10-07T08:59:22.963646+0000","last_unstale":"2023-10-07T08:59:22.965261+0000","last_undegraded":"2023-10-07T08:59:22.965261+0000","last_fullsized":"2023-10-07T08:59:22.965261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949329+0000","last_change":"2023-10-07T08:59:21.958261+0000","last_active":"2023-10-07T08:59:22.949329+0000","last_peered":"2023-10-07T08:59:22.949329+0000","last_clean":"2023-10-07T08:59:22.949329+0000","last_became_active":"2023-10-07T08:59:21.957949+0000","last_became_peered":"2023-10-07T08:59:21.957949+0000","last_unstale":"2023-10-07T08:59:22.949329+0000","last_undegraded":"2023-10-07T08:59:22.949329+0000","last_fullsized":"2023-10-07T08:59:22.949329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:26.994858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.977033+0000","last_change":"2023-10-07T08:59:22.973392+0000","last_active":"2023-10-07T08:59:22.977033+0000","last_peered":"2023-10-07T08:59:22.977033+0000","last_clean":"2023-10-07T08:59:22.977033+0000","last_became_active":"2023-10-07T08:59:22.970983+0000","last_became_peered":"2023-10-07T08:59:22.970983+0000","last_unstale":"2023-10-07T08:59:22.977033+0000","last_undegraded":"2023-10-07T08:59:22.977033+0000","last_fullsized":"2023-10-07T08:59:22.977033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.958967+0000","last_change":"2023-10-07T08:59:21.958676+0000","last_active":"2023-10-07T08:59:22.958967+0000","last_peered":"2023-10-07T08:59:22.958967+0000","last_clean":"2023-10-07T08:59:22.958967+0000","last_became_active":"2023-10-07T08:59:21.958407+0000","last_became_peered":"2023-10-07T08:59:21.958407+0000","last_unstale":"2023-10-07T08:59:22.958967+0000","last_undegraded":"2023-10-07T08:59:22.958967+0000","last_fullsized":"2023-10-07T08:59:22.958967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:04.521668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974517+0000","last_change":"2023-10-07T08:59:22.967122+0000","last_active":"2023-10-07T08:59:22.974517+0000","last_peered":"2023-10-07T08:59:22.974517+0000","last_clean":"2023-10-07T08:59:22.974517+0000","last_became_active":"2023-10-07T08:59:22.966798+0000","last_became_peered":"2023-10-07T08:59:22.966798+0000","last_unstale":"2023-10-07T08:59:22.974517+0000","last_undegraded":"2023-10-07T08:59:22.974517+0000","last_fullsized":"2023-10-07T08:59:22.974517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:39.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976907+0000","last_change":"2023-10-07T08:59:21.951544+0000","last_active":"2023-10-07T08:59:22.976907+0000","last_peered":"2023-10-07T08:59:22.976907+0000","last_clean":"2023-10-07T08:59:22.976907+0000","last_became_active":"2023-10-07T08:59:21.951224+0000","last_became_peered":"2023-10-07T08:59:21.951224+0000","last_unstale":"2023-10-07T08:59:22.976907+0000","last_undegraded":"2023-10-07T08:59:22.976907+0000","last_fullsized":"2023-10-07T08:59:22.976907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:30:59.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974703+0000","last_change":"2023-10-07T08:59:22.969787+0000","last_active":"2023-10-07T08:59:22.974703+0000","last_peered":"2023-10-07T08:59:22.974703+0000","last_clean":"2023-10-07T08:59:22.974703+0000","last_became_active":"2023-10-07T08:59:22.969523+0000","last_became_peered":"2023-10-07T08:59:22.969523+0000","last_unstale":"2023-10-07T08:59:22.974703+0000","last_undegraded":"2023-10-07T08:59:22.974703+0000","last_fullsized":"2023-10-07T08:59:22.974703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.963665+0000","last_change":"2023-10-07T08:59:21.954238+0000","last_active":"2023-10-07T08:59:22.963665+0000","last_peered":"2023-10-07T08:59:22.963665+0000","last_clean":"2023-10-07T08:59:22.963665+0000","last_became_active":"2023-10-07T08:59:21.953919+0000","last_became_peered":"2023-10-07T08:59:21.953919+0000","last_unstale":"2023-10-07T08:59:22.963665+0000","last_undegraded":"2023-10-07T08:59:22.963665+0000","last_fullsized":"2023-10-07T08:59:22.963665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969501+0000","last_change":"2023-10-07T08:59:22.962830+0000","last_active":"2023-10-07T08:59:22.969501+0000","last_peered":"2023-10-07T08:59:22.969501+0000","last_clean":"2023-10-07T08:59:22.969501+0000","last_became_active":"2023-10-07T08:59:22.962523+0000","last_became_peered":"2023-10-07T08:59:22.962523+0000","last_unstale":"2023-10-07T08:59:22.969501+0000","last_undegraded":"2023-10-07T08:59:22.969501+0000","last_fullsized":"2023-10-07T08:59:22.969501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:51.060633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.966432+0000","last_change":"2023-10-07T08:59:21.957801+0000","last_active":"2023-10-07T08:59:22.966432+0000","last_peered":"2023-10-07T08:59:22.966432+0000","last_clean":"2023-10-07T08:59:22.966432+0000","last_became_active":"2023-10-07T08:59:21.957546+0000","last_became_peered":"2023-10-07T08:59:21.957546+0000","last_unstale":"2023-10-07T08:59:22.966432+0000","last_undegraded":"2023-10-07T08:59:22.966432+0000","last_fullsized":"2023-10-07T08:59:22.966432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.964239+0000","last_change":"2023-10-07T08:59:22.960245+0000","last_active":"2023-10-07T08:59:22.964239+0000","last_peered":"2023-10-07T08:59:22.964239+0000","last_clean":"2023-10-07T08:59:22.964239+0000","last_became_active":"2023-10-07T08:59:22.959949+0000","last_became_peered":"2023-10-07T08:59:22.959949+0000","last_unstale":"2023-10-07T08:59:22.964239+0000","last_undegraded":"2023-10-07T08:59:22.964239+0000","last_fullsized":"2023-10-07T08:59:22.964239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:42.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.960623+0000","last_change":"2023-10-07T08:59:21.956381+0000","last_active":"2023-10-07T08:59:22.960623+0000","last_peered":"2023-10-07T08:59:22.960623+0000","last_clean":"2023-10-07T08:59:22.960623+0000","last_became_active":"2023-10-07T08:59:21.956091+0000","last_became_peered":"2023-10-07T08:59:21.956091+0000","last_unstale":"2023-10-07T08:59:22.960623+0000","last_undegraded":"2023-10-07T08:59:22.960623+0000","last_fullsized":"2023-10-07T08:59:22.960623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.973631+0000","last_change":"2023-10-07T08:59:22.966879+0000","last_active":"2023-10-07T08:59:22.973631+0000","last_peered":"2023-10-07T08:59:22.973631+0000","last_clean":"2023-10-07T08:59:22.973631+0000","last_became_active":"2023-10-07T08:59:22.966568+0000","last_became_peered":"2023-10-07T08:59:22.966568+0000","last_unstale":"2023-10-07T08:59:22.973631+0000","last_undegraded":"2023-10-07T08:59:22.973631+0000","last_fullsized":"2023-10-07T08:59:22.973631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:10.201801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947762+0000","last_change":"2023-10-07T08:59:21.949515+0000","last_active":"2023-10-07T08:59:22.947762+0000","last_peered":"2023-10-07T08:59:22.947762+0000","last_clean":"2023-10-07T08:59:22.947762+0000","last_became_active":"2023-10-07T08:59:21.949242+0000","last_became_peered":"2023-10-07T08:59:21.949242+0000","last_unstale":"2023-10-07T08:59:22.947762+0000","last_undegraded":"2023-10-07T08:59:22.947762+0000","last_fullsized":"2023-10-07T08:59:22.947762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:49.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959579+0000","last_change":"2023-10-07T08:59:22.953298+0000","last_active":"2023-10-07T08:59:22.959579+0000","last_peered":"2023-10-07T08:59:22.959579+0000","last_clean":"2023-10-07T08:59:22.959579+0000","last_became_active":"2023-10-07T08:59:22.952968+0000","last_became_peered":"2023-10-07T08:59:22.952968+0000","last_unstale":"2023-10-07T08:59:22.959579+0000","last_undegraded":"2023-10-07T08:59:22.959579+0000","last_fullsized":"2023-10-07T08:59:22.959579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:41.722574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.978027+0000","last_change":"2023-10-07T08:59:21.957699+0000","last_active":"2023-10-07T08:59:22.978027+0000","last_peered":"2023-10-07T08:59:22.978027+0000","last_clean":"2023-10-07T08:59:22.978027+0000","last_became_active":"2023-10-07T08:59:21.957442+0000","last_became_peered":"2023-10-07T08:59:21.957442+0000","last_unstale":"2023-10-07T08:59:22.978027+0000","last_undegraded":"2023-10-07T08:59:22.978027+0000","last_fullsized":"2023-10-07T08:59:22.978027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:26.604021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.972948+0000","last_change":"2023-10-07T08:59:22.964265+0000","last_active":"2023-10-07T08:59:22.972948+0000","last_peered":"2023-10-07T08:59:22.972948+0000","last_clean":"2023-10-07T08:59:22.972948+0000","last_became_active":"2023-10-07T08:59:22.963974+0000","last_became_peered":"2023-10-07T08:59:22.963974+0000","last_unstale":"2023-10-07T08:59:22.972948+0000","last_undegraded":"2023-10-07T08:59:22.972948+0000","last_fullsized":"2023-10-07T08:59:22.972948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:34.140709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952643+0000","last_change":"2023-10-07T08:59:21.959701+0000","last_active":"2023-10-07T08:59:22.952643+0000","last_peered":"2023-10-07T08:59:22.952643+0000","last_clean":"2023-10-07T08:59:22.952643+0000","last_became_active":"2023-10-07T08:59:21.959434+0000","last_became_peered":"2023-10-07T08:59:21.959434+0000","last_unstale":"2023-10-07T08:59:22.952643+0000","last_undegraded":"2023-10-07T08:59:22.952643+0000","last_fullsized":"2023-10-07T08:59:22.952643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968272+0000","last_change":"2023-10-07T08:59:22.963370+0000","last_active":"2023-10-07T08:59:22.968272+0000","last_peered":"2023-10-07T08:59:22.968272+0000","last_clean":"2023-10-07T08:59:22.968272+0000","last_became_active":"2023-10-07T08:59:22.963002+0000","last_became_peered":"2023-10-07T08:59:22.963002+0000","last_unstale":"2023-10-07T08:59:22.968272+0000","last_undegraded":"2023-10-07T08:59:22.968272+0000","last_fullsized":"2023-10-07T08:59:22.968272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:58.241693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947856+0000","last_change":"2023-10-07T08:59:21.951124+0000","last_active":"2023-10-07T08:59:22.947856+0000","last_peered":"2023-10-07T08:59:22.947856+0000","last_clean":"2023-10-07T08:59:22.947856+0000","last_became_active":"2023-10-07T08:59:21.950935+0000","last_became_peered":"2023-10-07T08:59:21.950935+0000","last_unstale":"2023-10-07T08:59:22.947856+0000","last_undegraded":"2023-10-07T08:59:22.947856+0000","last_fullsized":"2023-10-07T08:59:22.947856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:54.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976900+0000","last_change":"2023-10-07T08:59:22.971562+0000","last_active":"2023-10-07T08:59:22.976900+0000","last_peered":"2023-10-07T08:59:22.976900+0000","last_clean":"2023-10-07T08:59:22.976900+0000","last_became_active":"2023-10-07T08:59:22.971230+0000","last_became_peered":"2023-10-07T08:59:22.971230+0000","last_unstale":"2023-10-07T08:59:22.976900+0000","last_undegraded":"2023-10-07T08:59:22.976900+0000","last_fullsized":"2023-10-07T08:59:22.976900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:54.967499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955316+0000","last_change":"2023-10-07T08:59:21.959123+0000","last_active":"2023-10-07T08:59:22.955316+0000","last_peered":"2023-10-07T08:59:22.955316+0000","last_clean":"2023-10-07T08:59:22.955316+0000","last_became_active":"2023-10-07T08:59:21.958832+0000","last_became_peered":"2023-10-07T08:59:21.958832+0000","last_unstale":"2023-10-07T08:59:22.955316+0000","last_undegraded":"2023-10-07T08:59:22.955316+0000","last_fullsized":"2023-10-07T08:59:22.955316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:32.934580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969052+0000","last_change":"2023-10-07T08:59:22.963437+0000","last_active":"2023-10-07T08:59:22.969052+0000","last_peered":"2023-10-07T08:59:22.969052+0000","last_clean":"2023-10-07T08:59:22.969052+0000","last_became_active":"2023-10-07T08:59:22.963178+0000","last_became_peered":"2023-10-07T08:59:22.963178+0000","last_unstale":"2023-10-07T08:59:22.969052+0000","last_undegraded":"2023-10-07T08:59:22.969052+0000","last_fullsized":"2023-10-07T08:59:22.969052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:28.000390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.974496+0000","last_change":"2023-10-07T08:59:21.959424+0000","last_active":"2023-10-07T08:59:22.974496+0000","last_peered":"2023-10-07T08:59:22.974496+0000","last_clean":"2023-10-07T08:59:22.974496+0000","last_became_active":"2023-10-07T08:59:21.959117+0000","last_became_peered":"2023-10-07T08:59:21.959117+0000","last_unstale":"2023-10-07T08:59:22.974496+0000","last_undegraded":"2023-10-07T08:59:22.974496+0000","last_fullsized":"2023-10-07T08:59:22.974496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:29.832809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.969562+0000","last_change":"2023-10-07T08:59:22.965766+0000","last_active":"2023-10-07T08:59:22.969562+0000","last_peered":"2023-10-07T08:59:22.969562+0000","last_clean":"2023-10-07T08:59:22.969562+0000","last_became_active":"2023-10-07T08:59:22.965507+0000","last_became_peered":"2023-10-07T08:59:22.965507+0000","last_unstale":"2023-10-07T08:59:22.969562+0000","last_undegraded":"2023-10-07T08:59:22.969562+0000","last_fullsized":"2023-10-07T08:59:22.969562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:40.001711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-07T08:59:23.958758+0000","last_change":"2023-10-07T08:59:21.956983+0000","last_active":"2023-10-07T08:59:23.958758+0000","last_peered":"2023-10-07T08:59:23.958758+0000","last_clean":"2023-10-07T08:59:23.958758+0000","last_became_active":"2023-10-07T08:59:21.956701+0000","last_became_peered":"2023-10-07T08:59:21.956701+0000","last_unstale":"2023-10-07T08:59:23.958758+0000","last_undegraded":"2023-10-07T08:59:23.958758+0000","last_fullsized":"2023-10-07T08:59:23.958758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967249+0000","last_change":"2023-10-07T08:59:22.963033+0000","last_active":"2023-10-07T08:59:22.967249+0000","last_peered":"2023-10-07T08:59:22.967249+0000","last_clean":"2023-10-07T08:59:22.967249+0000","last_became_active":"2023-10-07T08:59:22.962738+0000","last_became_peered":"2023-10-07T08:59:22.962738+0000","last_unstale":"2023-10-07T08:59:22.967249+0000","last_undegraded":"2023-10-07T08:59:22.967249+0000","last_fullsized":"2023-10-07T08:59:22.967249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:20.690287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947669+0000","last_change":"2023-10-07T08:59:21.956828+0000","last_active":"2023-10-07T08:59:22.947669+0000","last_peered":"2023-10-07T08:59:22.947669+0000","last_clean":"2023-10-07T08:59:22.947669+0000","last_became_active":"2023-10-07T08:59:21.956570+0000","last_became_peered":"2023-10-07T08:59:21.956570+0000","last_unstale":"2023-10-07T08:59:22.947669+0000","last_undegraded":"2023-10-07T08:59:22.947669+0000","last_fullsized":"2023-10-07T08:59:22.947669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:00.804324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.968481+0000","last_change":"2023-10-07T08:59:22.963523+0000","last_active":"2023-10-07T08:59:22.968481+0000","last_peered":"2023-10-07T08:59:22.968481+0000","last_clean":"2023-10-07T08:59:22.968481+0000","last_became_active":"2023-10-07T08:59:22.963240+0000","last_became_peered":"2023-10-07T08:59:22.963240+0000","last_unstale":"2023-10-07T08:59:22.968481+0000","last_undegraded":"2023-10-07T08:59:22.968481+0000","last_fullsized":"2023-10-07T08:59:22.968481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:49:33.940112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.955155+0000","last_change":"2023-10-07T08:59:21.958204+0000","last_active":"2023-10-07T08:59:22.955155+0000","last_peered":"2023-10-07T08:59:22.955155+0000","last_clean":"2023-10-07T08:59:22.955155+0000","last_became_active":"2023-10-07T08:59:21.957951+0000","last_became_peered":"2023-10-07T08:59:21.957951+0000","last_unstale":"2023-10-07T08:59:22.955155+0000","last_undegraded":"2023-10-07T08:59:22.955155+0000","last_fullsized":"2023-10-07T08:59:22.955155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:33.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.970961+0000","last_change":"2023-10-07T08:59:22.963055+0000","last_active":"2023-10-07T08:59:22.970961+0000","last_peered":"2023-10-07T08:59:22.970961+0000","last_clean":"2023-10-07T08:59:22.970961+0000","last_became_active":"2023-10-07T08:59:22.962594+0000","last_became_peered":"2023-10-07T08:59:22.962594+0000","last_unstale":"2023-10-07T08:59:22.970961+0000","last_undegraded":"2023-10-07T08:59:22.970961+0000","last_fullsized":"2023-10-07T08:59:22.970961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:50:05.527200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.949360+0000","last_change":"2023-10-07T08:59:21.957647+0000","last_active":"2023-10-07T08:59:22.949360+0000","last_peered":"2023-10-07T08:59:22.949360+0000","last_clean":"2023-10-07T08:59:22.949360+0000","last_became_active":"2023-10-07T08:59:21.957377+0000","last_became_peered":"2023-10-07T08:59:21.957377+0000","last_unstale":"2023-10-07T08:59:22.949360+0000","last_undegraded":"2023-10-07T08:59:22.949360+0000","last_fullsized":"2023-10-07T08:59:22.949360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:30:34.822355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.961666+0000","last_change":"2023-10-07T08:59:22.958557+0000","last_active":"2023-10-07T08:59:22.961666+0000","last_peered":"2023-10-07T08:59:22.961666+0000","last_clean":"2023-10-07T08:59:22.961666+0000","last_became_active":"2023-10-07T08:59:22.958198+0000","last_became_peered":"2023-10-07T08:59:22.958198+0000","last_unstale":"2023-10-07T08:59:22.961666+0000","last_undegraded":"2023-10-07T08:59:22.961666+0000","last_fullsized":"2023-10-07T08:59:22.961666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:51:31.098927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.947969+0000","last_change":"2023-10-07T08:59:21.957341+0000","last_active":"2023-10-07T08:59:22.947969+0000","last_peered":"2023-10-07T08:59:22.947969+0000","last_clean":"2023-10-07T08:59:22.947969+0000","last_became_active":"2023-10-07T08:59:21.957033+0000","last_became_peered":"2023-10-07T08:59:21.957033+0000","last_unstale":"2023-10-07T08:59:22.947969+0000","last_undegraded":"2023-10-07T08:59:22.947969+0000","last_fullsized":"2023-10-07T08:59:22.947969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:06.282559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.967082+0000","last_change":"2023-10-07T08:59:22.964316+0000","last_active":"2023-10-07T08:59:22.967082+0000","last_peered":"2023-10-07T08:59:22.967082+0000","last_clean":"2023-10-07T08:59:22.967082+0000","last_became_active":"2023-10-07T08:59:22.964034+0000","last_became_peered":"2023-10-07T08:59:22.964034+0000","last_unstale":"2023-10-07T08:59:22.967082+0000","last_undegraded":"2023-10-07T08:59:22.967082+0000","last_fullsized":"2023-10-07T08:59:22.967082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:17.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.959239+0000","last_change":"2023-10-07T08:59:21.960520+0000","last_active":"2023-10-07T08:59:22.959239+0000","last_peered":"2023-10-07T08:59:22.959239+0000","last_clean":"2023-10-07T08:59:22.959239+0000","last_became_active":"2023-10-07T08:59:21.960255+0000","last_became_peered":"2023-10-07T08:59:21.960255+0000","last_unstale":"2023-10-07T08:59:22.959239+0000","last_undegraded":"2023-10-07T08:59:22.959239+0000","last_fullsized":"2023-10-07T08:59:22.959239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:19.684755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.976927+0000","last_change":"2023-10-07T08:59:22.972802+0000","last_active":"2023-10-07T08:59:22.976927+0000","last_peered":"2023-10-07T08:59:22.976927+0000","last_clean":"2023-10-07T08:59:22.976927+0000","last_became_active":"2023-10-07T08:59:22.971123+0000","last_became_peered":"2023-10-07T08:59:22.971123+0000","last_unstale":"2023-10-07T08:59:22.976927+0000","last_undegraded":"2023-10-07T08:59:22.976927+0000","last_fullsized":"2023-10-07T08:59:22.976927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:21.935557+0000","last_clean_scrub_stamp":"2023-10-07T08:59:21.935557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:59.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.952622+0000","last_change":"2023-10-07T08:59:21.959379+0000","last_active":"2023-10-07T08:59:22.952622+0000","last_peered":"2023-10-07T08:59:22.952622+0000","last_clean":"2023-10-07T08:59:22.952622+0000","last_became_active":"2023-10-07T08:59:21.959112+0000","last_became_peered":"2023-10-07T08:59:21.959112+0000","last_unstale":"2023-10-07T08:59:22.952622+0000","last_undegraded":"2023-10-07T08:59:22.952622+0000","last_fullsized":"2023-10-07T08:59:22.952622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:20.930025+0000","last_clean_scrub_stamp":"2023-10-07T08:59:20.930025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:09.196269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:59:22.957798+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:22.957798+0000","last_peered":"2023-10-07T08:59:22.957798+0000","last_clean":"2023-10-07T08:59:22.957798+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:22.957798+0000","last_undegraded":"2023-10-07T08:59:22.957798+0000","last_fullsized":"2023-10-07T08:59:22.957798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T08:59:32.060 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:59:32.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:59:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.220+0000 7fd58eee8700 1 Processor -- start 2023-10-07T08:59:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.220+0000 7fd58eee8700 1 -- start start 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58eee8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd588159950 0x7fd5880cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58eee8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588069c70 0x7fd5880cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58eee8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880ce380 con 0x7fd5880af320 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58eee8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880cec20 con 0x7fd588159950 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58eee8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880afa90 con 0x7fd588069c70 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd588159950 0x7fd5880cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd587fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5880af320 0x7fd588069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33162/0 (socket says 172.21.15.46:33162) 2023-10-07T08:59:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd588159950 0x7fd5880cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53004/0 (socket says 172.21.15.46:53004) 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd587fff700 1 -- 172.21.15.46:0/1874494937 learned_addr learned my addr 172.21.15.46:0/1874494937 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58d485700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588069c70 0x7fd5880cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 -- 172.21.15.46:0/1874494937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588069c70 msgr2=0x7fd5880cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588069c70 0x7fd5880cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 -- 172.21.15.46:0/1874494937 >> v1:172.21.15.46:6789/0 conn(0x7fd5880af320 legacy=0x7fd588069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 -- 172.21.15.46:0/1874494937 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880ce5d0 con 0x7fd588159950 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd5877fe700 1 -- 172.21.15.46:0/1874494937 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219080633 0 0) 0x7fd5880ce380 con 0x7fd5880af320 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd58cc84700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd588159950 0x7fd5880cbb90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1fd6a0ec09d2a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd5877fe700 1 -- 172.21.15.46:0/1874494937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c009e80 con 0x7fd588159950 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd5877fe700 1 -- 172.21.15.46:0/1874494937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00b860 con 0x7fd588159950 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.221+0000 7fd5877fe700 1 -- 172.21.15.46:0/1874494937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00bbe0 con 0x7fd588159950 2023-10-07T08:59:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 -- 172.21.15.46:0/1874494937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd588159950 msgr2=0x7fd5880cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd588159950 0x7fd5880cbb90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 -- 172.21.15.46:0/1874494937 shutdown_connections 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588069c70 0x7fd5880cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 --2- 172.21.15.46:0/1874494937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd588159950 0x7fd5880cbb90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 -- 172.21.15.46:0/1874494937 >> 172.21.15.46:0/1874494937 conn(0x7fd588068e00 msgr2=0x7fd5880d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 -- 172.21.15.46:0/1874494937 shutdown_connections 2023-10-07T08:59:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.222+0000 7fd58eee8700 1 -- 172.21.15.46:0/1874494937 wait complete. 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.223+0000 7fd58eee8700 1 Processor -- start 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.223+0000 7fd58eee8700 1 -- start start 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 0x7fd588152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588159950 0x7fd5880c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815bb60 con 0x7fd5880af320 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815be40 con 0x7fd588069c70 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58eee8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815c120 con 0x7fd588159950 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53008/0 (socket says 172.21.15.46:53008) 2023-10-07T08:59:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 -- 172.21.15.46:0/3004796759 learned_addr learned my addr 172.21.15.46:0/3004796759 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58d485700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588159950 0x7fd5880c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58cc84700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 0x7fd588152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 -- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588159950 msgr2=0x7fd5880c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588159950 0x7fd5880c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 -- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 msgr2=0x7fd588152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 0x7fd588152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd587fff700 1 -- 172.21.15.46:0/3004796759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd5880af320 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.224+0000 7fd58cc84700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 0x7fd588152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd587fff700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd57400c7e0 tx=0x7fd574007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574005b30 con 0x7fd5880af320 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574005c90 con 0x7fd5880af320 2023-10-07T08:59:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58815c400 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574007300 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.225+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd588159f30 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.226+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58815c640 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.226+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd57401b400 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.227+0000 7fd584ff9700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.227+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd574084050 con 0x7fd5880af320 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.227+0000 7fd58cc84700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.227+0000 7fd58cc84700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 0x7fd56c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0091e0 tx=0x7fd57c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.231+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd58815c640 con 0x7fd5880af320 2023-10-07T08:59:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.501+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd58815c640 con 0x7fd5880af320 2023-10-07T08:59:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.505+0000 7fd584ff9700 1 -- 172.21.15.46:0/3004796759 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd58815c640 con 0x7fd5880af320 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 msgr2=0x7fd56c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 0x7fd56c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0091e0 tx=0x7fd57c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 msgr2=0x7fd58815c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd57400c7e0 tx=0x7fd574007df0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 shutdown_connections 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd588159950 0x7fd5880c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd588069c70 0x7fd588152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 --2- 172.21.15.46:0/3004796759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880af320 0x7fd58815c920 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 >> 172.21.15.46:0/3004796759 conn(0x7fd588068e00 msgr2=0x7fd5880c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 shutdown_connections 2023-10-07T08:59:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.507+0000 7fd58eee8700 1 -- 172.21.15.46:0/3004796759 wait complete. 2023-10-07T08:59:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T08:59:32.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.637+0000 7f98782fc700 1 Processor -- start 2023-10-07T08:59:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.637+0000 7f98782fc700 1 -- start start 2023-10-07T08:59:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f98782fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f987006bcd0 0x7f98700caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f98782fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f987015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f98782fc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987015d7e0 con 0x7f987006c0a0 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f98782fc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987015dac0 con 0x7f987006bcd0 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f98782fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987015aa30 con 0x7f987015df50 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f9875897700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f987006c0a0 0x7f987015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33174/0 (socket says 172.21.15.46:33174) 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.638+0000 7f9875897700 1 -- 172.21.15.46:0/1672256134 learned_addr learned my addr 172.21.15.46:0/1672256134 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876098700 1 --2- 172.21.15.46:0/1672256134 >> v2:172.21.15.133:3300/0 conn(0x7f987006bcd0 0x7f98700caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876899700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f987015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972701712 0 0) 0x7f987015d7e0 con 0x7f987006c0a0 2023-10-07T08:59:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9858003570 con 0x7f987006c0a0 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827807579 0 0) 0x7f9858003570 con 0x7f987006c0a0 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 msgr2=0x7f987015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f987015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 >> v2:172.21.15.133:3300/0 conn(0x7f987006bcd0 msgr2=0x7f98700caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 --2- 172.21.15.46:0/1672256134 >> v2:172.21.15.133:3300/0 conn(0x7f987006bcd0 0x7f98700caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987015ad10 con 0x7f987006c0a0 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f9864001470 con 0x7f987006c0a0 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 >> v1:172.21.15.46:6789/0 conn(0x7f987006c0a0 legacy=0x7f987015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9858003a60 0x7f9858003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9858004810 0x7f9858004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f98580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987015dac0 con 0x7f9858003a60 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987015aa30 con 0x7f9858004810 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985800bae0 con 0x7f987015df50 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876098700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9858003a60 0x7f9858003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876899700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f98580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9875897700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9858004810 0x7f9858004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876098700 1 -- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 msgr2=0x7f98580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.639+0000 7f9876098700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f987015df50 0x7f98580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9876098700 1 -- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9858004810 msgr2=0x7f9858004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9876098700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9858004810 0x7f9858004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9876098700 1 -- 172.21.15.46:0/1672256134 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858003570 con 0x7f9858003a60 2023-10-07T08:59:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9876098700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9858003a60 0x7f9858003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f986000e210 tx=0x7f986000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470c216e3e9e4345 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000eac0 con 0x7f9858003a60 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986000f040 con 0x7f9858003a60 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9875096700 1 -- 172.21.15.46:0/1672256134 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000ee70 con 0x7f9858003a60 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 -- 172.21.15.46:0/1672256134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9858003a60 msgr2=0x7f9858003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 --2- 172.21.15.46:0/1672256134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9858003a60 0x7f9858003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f986000e210 tx=0x7f986000b040 comp rx=0 tx=0).stop 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f9876899700 1 -- 172.21.15.46:0/1672256134 reap_dead start 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 -- 172.21.15.46:0/1672256134 shutdown_connections 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 -- 172.21.15.46:0/1672256134 >> 172.21.15.46:0/1672256134 conn(0x7f98700ce600 msgr2=0x7f98700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 -- 172.21.15.46:0/1672256134 shutdown_connections 2023-10-07T08:59:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.640+0000 7f98782fc700 1 -- 172.21.15.46:0/1672256134 wait complete. 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 Processor -- start 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 -- start start 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9858003a60 0x7f98701547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f987006a690 0x7f987006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870169fd0 con 0x7f98700c60a0 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98700c6a50 con 0x7f987006a690 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f98782fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987006b030 con 0x7f9858003a60 2023-10-07T08:59:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f9875897700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f9875897700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53026/0 (socket says 172.21.15.46:53026) 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.642+0000 7f9875897700 1 -- 172.21.15.46:0/789495396 learned_addr learned my addr 172.21.15.46:0/789495396 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9876098700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9858003a60 0x7f98701547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9876899700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f987006a690 0x7f987006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 -- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9858003a60 msgr2=0x7f98701547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9858003a60 0x7f98701547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 -- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f987006a690 msgr2=0x7f987006aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f987006a690 0x7f987006aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 -- 172.21.15.46:0/789495396 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987016adb0 con 0x7f98700c60a0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f9875897700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9864000fd0 tx=0x7f9864001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640077f0 con 0x7f98700c60a0 2023-10-07T08:59:32.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986400f8d0 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987016a1c0 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400fc70 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.643+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987016a760 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.644+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987016af40 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.644+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98640133b0 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.645+0000 7f986e7fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.645+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9864083fc0 con 0x7f98700c60a0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.645+0000 7f9876098700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.645+0000 7f9876098700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f986000afd0 tx=0x7f986001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.649+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9864051230 con 0x7f98700c60a0 2023-10-07T08:59:32.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.885+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f987004c3c0 con 0x7f98700c60a0 2023-10-07T08:59:32.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.885+0000 7f986e7fc700 1 -- 172.21.15.46:0/789495396 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f986401a020 con 0x7f98700c60a0 2023-10-07T08:59:32.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:32.886 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1068755666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1068755666},{"type":"v1","addr":"172.21.15.133:6837","nonce":1068755666}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:32.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.887+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 msgr2=0x7f985c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.887+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f986000afd0 tx=0x7f986001a000 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.887+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 msgr2=0x7f98700c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.887+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9864000fd0 tx=0x7f9864001e90 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 shutdown_connections 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f987006a690 0x7f987006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9858003a60 0x7f98701547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 --2- 172.21.15.46:0/789495396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98700c60a0 0x7f98700c6510 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 >> 172.21.15.46:0/789495396 conn(0x7f98700ce600 msgr2=0x7f987006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 shutdown_connections 2023-10-07T08:59:32.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:32.888+0000 7f98782fc700 1 -- 172.21.15.46:0/789495396 wait complete. 2023-10-07T08:59:32.890 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2023-10-07T08:59:33.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:59:22.349064+0000', 'modified': '2023-10-07T08:59:25.961353+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4822}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4822': {'gid': 4822, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.46:6835/2054891740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6833', 'nonce': 2054891740}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 2054891740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:59:33.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:59:33.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T08:59:33.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.424+0000 7f4601a82700 1 Processor -- start 2023-10-07T08:59:33.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.424+0000 7f4601a82700 1 -- start start 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f4601a82700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 0x7f45fc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f4601a82700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc069ee0 con 0x7f45fc159c60 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f4601a82700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc15a160 con 0x7f45fc159890 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f4601a82700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0d13a0 con 0x7f45fc069560 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f45faffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f45fc159c60 0x7f45fc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33178/0 (socket says 172.21.15.46:33178) 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.425+0000 7f45faffd700 1 -- 172.21.15.46:0/1442361887 learned_addr learned my addr 172.21.15.46:0/1442361887 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fbfff700 1 --2- 172.21.15.46:0/1442361887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 0x7f45fc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185570858 0 0) 0x7f45fc069ee0 con 0x7f45fc159c60 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e4003570 con 0x7f45fc159c60 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695122148 0 0) 0x7f45fc15a160 con 0x7f45fc159890 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc069ee0 con 0x7f45fc159890 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fbfff700 1 -- 172.21.15.46:0/1442361887 >> v1:172.21.15.133:6789/0 conn(0x7f45fc159890 legacy=0x7f45fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fbfff700 1 -- 172.21.15.46:0/1442361887 >> v1:172.21.15.46:6789/0 conn(0x7f45fc159c60 legacy=0x7f45fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951842260 0 0) 0x7f45e4003570 con 0x7f45fc159c60 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fbfff700 1 -- 172.21.15.46:0/1442361887 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc15e140 con 0x7f45fc069560 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fbfff700 1 --2- 172.21.15.46:0/1442361887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 0x7f45fc0699a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009e90 tx=0x7f45f4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc4b2e950695181d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f400e070 con 0x7f45fc069560 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400b870 con 0x7f45fc069560 2023-10-07T08:59:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.426+0000 7f45fa7fc700 1 -- 172.21.15.46:0/1442361887 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0001470 con 0x7f45fc069560 2023-10-07T08:59:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 -- 172.21.15.46:0/1442361887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 msgr2=0x7f45fc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 --2- 172.21.15.46:0/1442361887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 0x7f45fc0699a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009e90 tx=0x7f45f4009780 comp rx=0 tx=0).stop 2023-10-07T08:59:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 -- 172.21.15.46:0/1442361887 shutdown_connections 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 --2- 172.21.15.46:0/1442361887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc069560 0x7f45fc0699a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 -- 172.21.15.46:0/1442361887 >> 172.21.15.46:0/1442361887 conn(0x7f45fc068e20 msgr2=0x7f45fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 -- 172.21.15.46:0/1442361887 shutdown_connections 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.427+0000 7f4601a82700 1 -- 172.21.15.46:0/1442361887 wait complete. 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.428+0000 7f4601a82700 1 Processor -- start 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.428+0000 7f4601a82700 1 -- start start 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45fc159890 0x7f45fc154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 0x7f45fc0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b5990 con 0x7f45fc069560 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0c8000 con 0x7f45fc159890 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f4601a82700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0cf400 con 0x7f45fc159c60 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53040/0 (socket says 172.21.15.46:53040) 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2226538035 learned_addr learned my addr 172.21.15.46:0/2226538035 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45faffd700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45fc159890 0x7f45fc154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 0x7f45fc0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 msgr2=0x7f45fc0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 0x7f45fc0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45fc159890 msgr2=0x7f45fc154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45fc159890 0x7f45fc154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2226538035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4009a20 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 0x7f45fc0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.429+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c7c0 tx=0x7f45ec007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.430+0000 7f45e37fe700 1 -- 172.21.15.46:0/2226538035 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec010510 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.430+0000 7f45e37fe700 1 -- 172.21.15.46:0/2226538035 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec010690 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.430+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0cf6e0 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.430+0000 7f45e37fe700 1 -- 172.21.15.46:0/2226538035 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec010a50 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.430+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0cfca0 con 0x7f45fc069560 2023-10-07T08:59:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.431+0000 7f45e37fe700 1 -- 172.21.15.46:0/2226538035 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45ec01b400 con 0x7f45fc069560 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.431+0000 7f45e37fe700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.431+0000 7f45e37fe700 1 -- 172.21.15.46:0/2226538035 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45ec084260 con 0x7f45fc069560 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.432+0000 7f45faffd700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.432+0000 7f45faffd700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f45fc16cb20 tx=0x7f45f0000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.433+0000 7f460ad7ab80 1 Processor -- start 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.433+0000 7f460ad7ab80 1 -- start start 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803dad00 0x5647803b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803b9f60 0x56478038ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647802e7a70 con 0x564780390a50 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647802e5270 con 0x5647803b9f60 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647802e1060 con 0x5647803dad00 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53042/0 (socket says 172.21.15.46:53042) 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f45fb7fe700 1 -- 172.21.15.46:0/500695212 learned_addr learned my addr 172.21.15.46:0/500695212 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f45faffd700 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803dad00 0x5647803b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.434+0000 7f45fbfff700 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803b9f60 0x56478038ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 -- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803dad00 msgr2=0x5647803b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803dad00 0x5647803b9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 -- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803b9f60 msgr2=0x56478038ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803b9f60 0x56478038ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 -- 172.21.15.46:0/500695212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56478017b270 con 0x564780390a50 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f45ec082830 tx=0x7f45ec0826e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b5aac08ae69f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45e0ff9700 1 -- 172.21.15.46:0/500695212 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0583e0 con 0x564780390a50 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45e0ff9700 1 -- 172.21.15.46:0/500695212 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec05c130 con 0x564780390a50 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f45e0ff9700 1 -- 172.21.15.46:0/500695212 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec053530 con 0x564780390a50 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f460ad7ab80 1 -- 172.21.15.46:0/500695212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 msgr2=0x564780390e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.435+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f45ec082830 tx=0x7f45ec0826e0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 -- 172.21.15.46:0/500695212 shutdown_connections 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803b9f60 0x56478038ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390e20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/500695212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803dad00 0x5647803b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 -- 172.21.15.46:0/500695212 >> 172.21.15.46:0/500695212 conn(0x564780392370 msgr2=0x564780392740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 -- 172.21.15.46:0/500695212 shutdown_connections 2023-10-07T08:59:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 -- 172.21.15.46:0/500695212 wait complete. 2023-10-07T08:59:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 -- start start 2023-10-07T08:59:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.436+0000 7f460ad7ab80 1 Processor -- start 2023-10-07T08:59:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564780390a50 0x5647803e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x5647803d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478028c890 con 0x5647803b9f60 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647802a7ea0 con 0x5647803dad00 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564780163e30 con 0x564780390a50 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f460ad7ab80 10 client.0 _ll_register_callbacks cb 0x564780354110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53052/0 (socket says 172.21.15.46:53052) 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 -- 172.21.15.46:0/2495163997 learned_addr learned my addr 172.21.15.46:0/2495163997 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564780390a50 0x5647803e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x5647803d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 -- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564780390a50 msgr2=0x5647803e6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564780390a50 0x5647803e6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 -- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 msgr2=0x5647803d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x5647803d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.437+0000 7f45faffd700 1 -- 172.21.15.46:0/2495163997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0cfca0 con 0x5647803b9f60 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45faffd700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f45f0013840 tx=0x7f45f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b640bfa7d1b4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0012350 con 0x5647803b9f60 2023-10-07T08:59:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45f001b070 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564780385b70 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f0022d10 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 10 client.5091 fetch_fsmap learned FSMap version 16 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56478011dfe0 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564780385b70 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45f00124b0 con 0x5647803b9f60 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 10 client.5091 fetch_fsmap finished waiting for FSMap version 16 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 10 client.5091 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 20 client.5091 populate_metadata read hostname 'smithi046' 2023-10-07T08:59:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x5647803bff00 0x5647803c02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 4 client.5091 mds_command: new command op to 4822 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 --> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564780362aa0 con 0x5647803bff00 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.438+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x5647803bff00 0x5647803c02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x5647803bff00 0x5647803c02d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a4f26993bbc087 server_cookie=53e27f0226781938 in_seq=0 out_seq=0 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f45d9ffb700 10 client.5091 ms_handle_connect on v2:172.21.15.46:6833/2054891740 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2495163997 <== mds.0 v2:172.21.15.46:6833/2054891740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564780362aa0 con 0x5647803bff00 2023-10-07T08:59:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f45d9ffb700 10 client.5091 handle_command_reply: tid=0 2023-10-07T08:59:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 client.5091 shutdown 2023-10-07T08:59:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 msgr2=0x5647803d3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f45f0013840 tx=0x7f45f0014000 comp rx=0 tx=0).stop 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 shutdown_connections 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x5647803bff00 0x5647803c02d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f45d9ffb700 0 client.5091 ms_handle_reset on v2:172.21.15.46:6833/2054891740 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.439+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x5647803d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564780390a50 0x5647803e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2495163997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803b9f60 0x5647803d3320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 >> 172.21.15.46:0/2495163997 conn(0x564780392370 msgr2=0x564780391350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 shutdown_connections 2023-10-07T08:59:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2495163997 wait complete. 2023-10-07T08:59:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.440+0000 7f460ad7ab80 20 client.5091 trim_cache size 0 max 16384 2023-10-07T08:59:33.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.456+0000 7f460ad7ab80 1 Processor -- start 2023-10-07T08:59:33.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.456+0000 7f460ad7ab80 1 -- start start 2023-10-07T08:59:33.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564780390a50 0x56478038ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x5647803da710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564780393380 con 0x5647803dad00 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647803cf740 con 0x564780390a50 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647803f88d0 con 0x5647803b9f60 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53054/0 (socket says 172.21.15.46:53054) 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 -- 172.21.15.46:0/2945104779 learned_addr learned my addr 172.21.15.46:0/2945104779 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564780390a50 0x56478038ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45faffd700 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x5647803da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 -- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 msgr2=0x5647803da710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x5647803da710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 -- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564780390a50 msgr2=0x56478038ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564780390a50 0x56478038ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.457+0000 7f45fbfff700 1 -- 172.21.15.46:0/2945104779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647802af780 con 0x5647803dad00 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f45f40097c0 tx=0x7f45f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e3f3bbe19f6d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f45e17fa700 1 -- 172.21.15.46:0/2945104779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4024070 con 0x5647803dad00 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f45e17fa700 1 -- 172.21.15.46:0/2945104779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400ba60 con 0x5647803dad00 2023-10-07T08:59:33.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f45e17fa700 1 -- 172.21.15.46:0/2945104779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f401e6a0 con 0x5647803dad00 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2945104779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 msgr2=0x564780391070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f45f40097c0 tx=0x7f45f4017000 comp rx=0 tx=0).stop 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2945104779 shutdown_connections 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5647803dad00 0x564780391070 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564780390a50 0x56478038ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2945104779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x5647803da710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2945104779 >> 172.21.15.46:0/2945104779 conn(0x564780392370 msgr2=0x5647803e6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2945104779 shutdown_connections 2023-10-07T08:59:33.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.458+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2945104779 wait complete. 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.459+0000 7f460ad7ab80 1 -- start start 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.459+0000 7f460ad7ab80 1 Processor -- start 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x56478038d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x56478038dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647803be2b0 con 0x564780390a50 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647803b89d0 con 0x5647803dad00 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647803b8cb0 con 0x5647803b9f60 2023-10-07T08:59:33.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 10 client.0 _ll_register_callbacks cb 0x564780354110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53066/0 (socket says 172.21.15.46:53066) 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2362977832 learned_addr learned my addr 172.21.15.46:0/2362977832 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fbfff700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x56478038dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45faffd700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x56478038d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 msgr2=0x56478038d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x56478038d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 msgr2=0x56478038dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x56478038dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 -- 172.21.15.46:0/2362977832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc15e140 con 0x564780390a50 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45faffd700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x56478038d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45fb7fe700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f45ec01a000 tx=0x7f45ec068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8553a2c457a782 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0840e0 con 0x564780390a50 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45ec05c130 con 0x564780390a50 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.460+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45ec0532d0 con 0x564780390a50 2023-10-07T08:59:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45ec0553f0 con 0x564780390a50 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 10 client.5097 fetch_fsmap learned FSMap version 16 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564780296470 con 0x564780390a50 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec05c130 con 0x564780390a50 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45ec054680 con 0x564780390a50 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 10 client.5097 fetch_fsmap finished waiting for FSMap version 16 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 20 client.5097 populate_metadata read hostname 'smithi046' 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x56478043d8c0 0x56478043dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 4 client.5097 mds_command: new command op to 4822 tid=0[{"prefix": "status"}] 2023-10-07T08:59:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 --> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564780283e00 con 0x56478043d8c0 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45faffd700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x56478043d8c0 0x56478043dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45d9ffb700 10 client.5097 ms_handle_connect on v2:172.21.15.46:6833/2054891740 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.461+0000 7f45faffd700 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x56478043d8c0 0x56478043dc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacfa148ff906b09 server_cookie=139298bf2c8a39f0 in_seq=0 out_seq=0 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f45d9ffb700 1 -- 172.21.15.46:0/2362977832 <== mds.0 v2:172.21.15.46:6833/2054891740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564780283e00 con 0x56478043d8c0 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f45d9ffb700 10 client.5097 handle_command_reply: tid=0 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 client.5097 shutdown 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 msgr2=0x564780390fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f45ec01a000 tx=0x7f45ec068000 comp rx=0 tx=0).stop 2023-10-07T08:59:33.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 shutdown_connections 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:6833/2054891740,v1:172.21.15.46:6835/2054891740] conn(0x56478043d8c0 0x56478043dc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647803dad00 0x56478038dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564780390a50 0x564780390fd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 --2- 172.21.15.46:0/2362977832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5647803b9f60 0x56478038d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f45d9ffb700 0 client.5097 ms_handle_reset on v2:172.21.15.46:6833/2054891740 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 >> 172.21.15.46:0/2362977832 conn(0x564780392370 msgr2=0x56478038ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 shutdown_connections 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 1 -- 172.21.15.46:0/2362977832 wait complete. 2023-10-07T08:59:33.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f460ad7ab80 20 client.5097 trim_cache size 0 max 16384 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4822, 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T08:59:33.474 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 10.517189138999999, 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 16, 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 33, 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 33, 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 19.387798236999998 2023-10-07T08:59:33.475 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 msgr2=0x7f45e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f45fc16cb20 tx=0x7f45f0000bc0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 msgr2=0x7f45fc0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c7c0 tx=0x7f45ec007de0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 shutdown_connections 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45fc159c60 0x7f45fc0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc069560 0x7f45fc0b5450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 --2- 172.21.15.46:0/2226538035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45fc159890 0x7f45fc154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 >> 172.21.15.46:0/2226538035 conn(0x7f45fc068e20 msgr2=0x7f45fc157450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 shutdown_connections 2023-10-07T08:59:33.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.462+0000 7f4601a82700 1 -- 172.21.15.46:0/2226538035 wait complete. 2023-10-07T08:59:33.479 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:59:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 Processor -- start 2023-10-07T08:59:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 -- start start 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 0x7fd5880cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 0x7fd588160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880cc210 con 0x7fd58806bac0 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880cc4f0 con 0x7fd5880c91e0 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.599+0000 7fd58ef28700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880cc7d0 con 0x7fd58806aa40 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd587fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd58806bac0 0x7fd58806ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33186/0 (socket says 172.21.15.46:33186) 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd587fff700 1 -- 172.21.15.46:0/1666681363 learned_addr learned my addr 172.21.15.46:0/1666681363 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1666681363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 0x7fd5880cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58d4c5700 1 --2- 172.21.15.46:0/1666681363 >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 0x7fd588160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd5877fe700 1 -- 172.21.15.46:0/1666681363 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201343223 0 0) 0x7fd5880cc210 con 0x7fd58806bac0 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd5877fe700 1 -- 172.21.15.46:0/1666681363 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd574003570 con 0x7fd58806bac0 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 -- 172.21.15.46:0/1666681363 >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 msgr2=0x7fd588160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1666681363 >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 0x7fd588160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 -- 172.21.15.46:0/1666681363 >> v1:172.21.15.46:6789/0 conn(0x7fd58806bac0 legacy=0x7fd58806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 -- 172.21.15.46:0/1666681363 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880ccab0 con 0x7fd58806aa40 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58d4c5700 1 --2- 172.21.15.46:0/1666681363 >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 0x7fd588160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1666681363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 0x7fd5880cbc00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd580009eb0 tx=0x7fd580009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e096ad548644106f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd5877fe700 1 -- 172.21.15.46:0/1666681363 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000e070 con 0x7fd58806aa40 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd5877fe700 1 -- 172.21.15.46:0/1666681363 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000bb80 con 0x7fd58806aa40 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.600+0000 7fd5877fe700 1 -- 172.21.15.46:0/1666681363 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580012430 con 0x7fd58806aa40 2023-10-07T08:59:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 -- 172.21.15.46:0/1666681363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 msgr2=0x7fd5880cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1666681363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 0x7fd5880cbc00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd580009eb0 tx=0x7fd580009780 comp rx=0 tx=0).stop 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 -- 172.21.15.46:0/1666681363 shutdown_connections 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1666681363 >> v2:172.21.15.133:3300/0 conn(0x7fd5880c91e0 0x7fd588160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1666681363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806aa40 0x7fd5880cbc00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 -- 172.21.15.46:0/1666681363 >> 172.21.15.46:0/1666681363 conn(0x7fd5880cd670 msgr2=0x7fd5880cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 -- 172.21.15.46:0/1666681363 shutdown_connections 2023-10-07T08:59:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.601+0000 7fd58ef28700 1 -- 172.21.15.46:0/1666681363 wait complete. 2023-10-07T08:59:33.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.602+0000 7fd58ef28700 1 Processor -- start 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.602+0000 7fd58ef28700 1 -- start start 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58806aa40 0x7fd588155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806bac0 0x7fd588168510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588150cd0 con 0x7fd5880c91e0 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588155030 con 0x7fd58806aa40 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ef28700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd588154440 con 0x7fd58806bac0 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58d4c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58d4c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53078/0 (socket says 172.21.15.46:53078) 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58d4c5700 1 -- 172.21.15.46:0/1519554332 learned_addr learned my addr 172.21.15.46:0/1519554332 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:33.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd587fff700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806bac0 0x7fd588168510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.603+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58806aa40 0x7fd588155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 -- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806bac0 msgr2=0x7fd588168510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806bac0 0x7fd588168510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 -- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58806aa40 msgr2=0x7fd588155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58806aa40 0x7fd588155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 -- 172.21.15.46:0/1519554332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009420 con 0x7fd5880c91e0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58d4c5700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ea20 tx=0x7fd5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000ee60 con 0x7fd5880c91e0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000c850 con 0x7fd5880c91e0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580009a20 con 0x7fd5880c91e0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000cc10 con 0x7fd5880c91e0 2023-10-07T08:59:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.604+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881549e0 con 0x7fd5880c91e0 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.605+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5881551c0 con 0x7fd5880c91e0 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.605+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd570013470 con 0x7fd5880c91e0 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.606+0000 7fd584ff9700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 0x7fd5680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.606+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5700844a0 con 0x7fd5880c91e0 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.606+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 0x7fd5680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.606+0000 7fd58ccc4700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 0x7fd5680693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd588152590 tx=0x7fd580019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:33.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.610+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd570051710 con 0x7fd5880c91e0 2023-10-07T08:59:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.847+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd58804c3c0 con 0x7fd5880c91e0 2023-10-07T08:59:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.848+0000 7fd584ff9700 1 -- 172.21.15.46:0/1519554332 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd570054d30 con 0x7fd5880c91e0 2023-10-07T08:59:33.849 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 msgr2=0x7fd5680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 0x7fd5680693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd588152590 tx=0x7fd580019000 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 msgr2=0x7fd588150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ea20 tx=0x7fd5700091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 shutdown_connections 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568066f30 0x7fd5680693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5880c91e0 0x7fd588150010 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58806aa40 0x7fd588155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 --2- 172.21.15.46:0/1519554332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd58806bac0 0x7fd588168510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 >> 172.21.15.46:0/1519554332 conn(0x7fd5880cd670 msgr2=0x7fd588152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:33.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 shutdown_connections 2023-10-07T08:59:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:33.850+0000 7fd58ef28700 1 -- 172.21.15.46:0/1519554332 wait complete. 2023-10-07T08:59:33.863 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:59:33.863 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:59:33.863 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T08:59:33.863 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:59:33.863 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:59:33.864 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:59:33.864 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:59:33.864 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:59:33.864 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:59:33.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:33.864 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T08:59:33.880 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:59:33.880 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:59:33.881 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:59:33.881 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.881 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T08:59:33.882 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.882 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:33.882 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:33.882 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T08:59:33.882 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42440sec preferred_lft 42440sec 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:33.883 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T08:59:33.884 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.885 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:59:33.885 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:59:33.885 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T08:59:33.885 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:33.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:33.885 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:59:33.954 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T08:59:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:34.517 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:59:34.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:34.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T08:59:34.537 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T08:59:34.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T08:59:34.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T08:59:34.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T08:59:34.537 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T08:59:34.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:34.642 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T08:59:34.658 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:59:34.658 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:59:34.658 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:59:34.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:34.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T08:59:34.726 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:59:34.726 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:59:34.781 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:59:34.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:59:34.782 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:59:34.836 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T08:59:34.836 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:59:34.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:34.918 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:34.918 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:34.937 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:34.937 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:34.937 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:59:34.937 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:59:34.937 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:59:34.938 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:59:34.938 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:59:34.938 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:59:34.959 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:34.959 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:34.959 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:59:34.959 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:59:34.960 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:59:34.962 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:59:34.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:34.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:59:35.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:59:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.187+0000 7f97b5406700 1 Processor -- start 2023-10-07T08:59:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.187+0000 7f97b5406700 1 -- start start 2023-10-07T08:59:35.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b5406700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 0x7f97b00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b5406700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b015d230 0x7f97b015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b5406700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b015db70 con 0x7f97b0159420 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b5406700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00b11d0 con 0x7f97b015d230 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b5406700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00b14b0 con 0x7f97b01597f0 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b015d230 0x7f97b015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b015d230 0x7f97b015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53080/0 (socket says 172.21.15.46:53080) 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 -- 172.21.15.46:0/2098746080 learned_addr learned my addr 172.21.15.46:0/2098746080 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97af7fe700 1 --2- 172.21.15.46:0/2098746080 >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 0x7f97b00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 -- 172.21.15.46:0/2098746080 >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 msgr2=0x7f97b00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 --2- 172.21.15.46:0/2098746080 >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 0x7f97b00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 -- 172.21.15.46:0/2098746080 >> v1:172.21.15.133:6789/0 conn(0x7f97b0159420 legacy=0x7f97b00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97b4c05700 1 -- 172.21.15.46:0/2098746080 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00b1790 con 0x7f97b015d230 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.188+0000 7f97af7fe700 1 --2- 172.21.15.46:0/2098746080 >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 0x7f97b00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b4c05700 1 --2- 172.21.15.46:0/2098746080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b015d230 0x7f97b015d630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f97b0089750 tx=0x7f97a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4016ec2fc17ddc91 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97aeffd700 1 -- 172.21.15.46:0/2098746080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800e070 con 0x7f97b015d230 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97aeffd700 1 -- 172.21.15.46:0/2098746080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800ba10 con 0x7f97b015d230 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97aeffd700 1 -- 172.21.15.46:0/2098746080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80092e0 con 0x7f97b015d230 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 -- 172.21.15.46:0/2098746080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b015d230 msgr2=0x7f97b015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 --2- 172.21.15.46:0/2098746080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b015d230 0x7f97b015d630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f97b0089750 tx=0x7f97a8009840 comp rx=0 tx=0).stop 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 -- 172.21.15.46:0/2098746080 shutdown_connections 2023-10-07T08:59:35.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 --2- 172.21.15.46:0/2098746080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b015d230 0x7f97b015d630 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 --2- 172.21.15.46:0/2098746080 >> v2:172.21.15.133:3300/0 conn(0x7f97b01597f0 0x7f97b00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 -- 172.21.15.46:0/2098746080 >> 172.21.15.46:0/2098746080 conn(0x7f97b00d0660 msgr2=0x7f97b00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 -- 172.21.15.46:0/2098746080 shutdown_connections 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.189+0000 7f97b5406700 1 -- 172.21.15.46:0/2098746080 wait complete. 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.190+0000 7f97b5406700 1 Processor -- start 2023-10-07T08:59:35.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.190+0000 7f97b5406700 1 -- start start 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97b0159420 0x7f97b0169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97b015d230 0x7f97b00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b015bd50 con 0x7f97b01597f0 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01552b0 con 0x7f97b015d230 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b5406700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b015b140 con 0x7f97b0159420 2023-10-07T08:59:35.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53084/0 (socket says 172.21.15.46:53084) 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97af7fe700 1 -- 172.21.15.46:0/1555043054 learned_addr learned my addr 172.21.15.46:0/1555043054 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97b4c05700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97b015d230 0x7f97b00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.191+0000 7f97affff700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97b0159420 0x7f97b0169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 -- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97b0159420 msgr2=0x7f97b0169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97b0159420 0x7f97b0169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 -- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97b015d230 msgr2=0x7f97b00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97b015d230 0x7f97b00b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 -- 172.21.15.46:0/1555043054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8009ae0 con 0x7f97b01597f0 2023-10-07T08:59:35.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97af7fe700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c880 tx=0x7f97a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4011600 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4011760 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b015b420 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4011ae0 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.192+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b015b9e0 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.193+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b015bf00 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.193+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a40193b0 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.194+0000 7f9797fff700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.194+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97a4084480 con 0x7f97b01597f0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.194+0000 7f97affff700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:35.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.195+0000 7f97affff700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 0x7f979c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f97a0003a30 tx=0x7f97a0007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:35.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.198+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97b015bf00 con 0x7f97b01597f0 2023-10-07T08:59:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.434+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97b015bf00 con 0x7f97b01597f0 2023-10-07T08:59:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.435+0000 7f9797fff700 1 -- 172.21.15.46:0/1555043054 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f97b015bf00 con 0x7f97b01597f0 2023-10-07T08:59:35.436 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 msgr2=0x7f979c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 0x7f979c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f97a0003a30 tx=0x7f97a0007ea0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 msgr2=0x7f97b0154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c880 tx=0x7f97a4008040 comp rx=0 tx=0).stop 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 shutdown_connections 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97b015d230 0x7f97b00b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97b0159420 0x7f97b0169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 --2- 172.21.15.46:0/1555043054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b01597f0 0x7f97b0154d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:35.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.436+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 >> 172.21.15.46:0/1555043054 conn(0x7f97b00d0660 msgr2=0x7f97b00696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:35.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.437+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 shutdown_connections 2023-10-07T08:59:35.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:35.437+0000 7f97b5406700 1 -- 172.21.15.46:0/1555043054 wait complete. 2023-10-07T08:59:35.449 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:59:35.449 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:59:35.450 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:59:35.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.451 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.470 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T08:59:35.471 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42430sec preferred_lft 42430sec 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T08:59:35.472 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T08:59:35.473 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.474 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:59:35.474 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:59:35.474 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T08:59:35.474 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:59:35.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.474 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:59:35.538 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T08:59:35.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.540 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T08:59:35.599 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T08:59:35.599 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:59:35.599 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:59:35.600 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:59:35.600 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:59:35.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.600 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T08:59:35.600 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T08:59:35.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:59:35.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:59:35.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:59:35.601 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T08:59:35.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.708 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T08:59:35.723 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:59:35.723 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:59:35.723 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:59:35.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:35.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T08:59:35.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:59:35.790 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:59:35.845 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:59:35.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:59:35.846 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:59:35.902 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T08:59:35.902 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:59:35.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:35.983 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:35.983 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:59:36.002 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:59:36.003 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:59:36.024 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T08:59:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:59:36.026 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T08:59:36.026 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T08:59:36.026 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T08:59:36.027 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:59:36.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:36.027 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:59:36.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T08:59:36.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.219+0000 7f9a9c860700 1 Processor -- start 2023-10-07T08:59:36.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.219+0000 7f9a9c860700 1 -- start start 2023-10-07T08:59:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a9c860700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a980b03c0 0x7f9a980cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a9c860700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a980b0790 0x7f9a980b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a9c860700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980cfa00 con 0x7f9a981591e0 2023-10-07T08:59:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a9c860700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980cb580 con 0x7f9a980b0790 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a9c860700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980b2de0 con 0x7f9a980b03c0 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a96ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a980b0790 0x7f9a980b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a97fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a981591e0 0x7f9a98159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33198/0 (socket says 172.21.15.46:33198) 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a97fff700 1 -- 172.21.15.46:0/2821457500 learned_addr learned my addr 172.21.15.46:0/2821457500 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a977fe700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a980b03c0 0x7f9a980cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a96ffd700 1 -- 172.21.15.46:0/2821457500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a980b03c0 msgr2=0x7f9a980cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a96ffd700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a980b03c0 0x7f9a980cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a96ffd700 1 -- 172.21.15.46:0/2821457500 >> v1:172.21.15.46:6789/0 conn(0x7f9a981591e0 legacy=0x7f9a98159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a96ffd700 1 -- 172.21.15.46:0/2821457500 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980cf160 con 0x7f9a980b0790 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.220+0000 7f9a967fc700 1 -- 172.21.15.46:0/2821457500 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266380156 0 0) 0x7f9a980cfa00 con 0x7f9a981591e0 2023-10-07T08:59:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a96ffd700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a980b28a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0098e0 tx=0x7f9a8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d91fe6ac166b91a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a967fc700 1 -- 172.21.15.46:0/2821457500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c009e80 con 0x7f9a980b0790 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a967fc700 1 -- 172.21.15.46:0/2821457500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c00b860 con 0x7f9a980b0790 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a967fc700 1 -- 172.21.15.46:0/2821457500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00bbe0 con 0x7f9a980b0790 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 -- 172.21.15.46:0/2821457500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 msgr2=0x7f9a980b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a980b28a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0098e0 tx=0x7f9a8c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 -- 172.21.15.46:0/2821457500 shutdown_connections 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a980b03c0 0x7f9a980cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 --2- 172.21.15.46:0/2821457500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a980b28a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 -- 172.21.15.46:0/2821457500 >> 172.21.15.46:0/2821457500 conn(0x7f9a98063230 msgr2=0x7f9a98063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 -- 172.21.15.46:0/2821457500 shutdown_connections 2023-10-07T08:59:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.221+0000 7f9a9c860700 1 -- 172.21.15.46:0/2821457500 wait complete. 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 Processor -- start 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 -- start start 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a980b03c0 0x7f9a9815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a981591e0 0x7f9a980c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9816a630 con 0x7f9a980b0790 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c8ef0 con 0x7f9a980b03c0 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a9c860700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9815dbb0 con 0x7f9a981591e0 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53104/0 (socket says 172.21.15.46:53104) 2023-10-07T08:59:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.223+0000 7f9a96ffd700 1 -- 172.21.15.46:0/3894377918 learned_addr learned my addr 172.21.15.46:0/3894377918 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 -- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a981591e0 msgr2=0x7f9a980c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a981591e0 0x7f9a980c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 -- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a980b03c0 msgr2=0x7f9a9815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a980b03c0 0x7f9a9815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 -- 172.21.15.46:0/3894377918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009420 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a96ffd700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9a980cfe40 tx=0x7f9a8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00bbe0 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c011420 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980c4560 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0117c0 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.224+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980c4b20 con 0x7f9a980b0790 2023-10-07T08:59:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.225+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9804c3c0 con 0x7f9a980b0790 2023-10-07T08:59:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.225+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a8c011bb0 con 0x7f9a980b0790 2023-10-07T08:59:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.226+0000 7f9a7f7fe700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 0x7f9a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.226+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a8c085f00 con 0x7f9a980b0790 2023-10-07T08:59:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.226+0000 7f9a977fe700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 0x7f9a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.227+0000 7f9a977fe700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 0x7f9a840693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009a40 tx=0x7f9a88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:36.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.230+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a8c053170 con 0x7f9a980b0790 2023-10-07T08:59:36.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.466+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a980c42a0 con 0x7f9a980b0790 2023-10-07T08:59:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:36.997+0000 7f9a7f7fe700 1 -- 172.21.15.46:0/3894377918 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9a8c011e60 con 0x7f9a980b0790 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 msgr2=0x7f9a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 0x7f9a840693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009a40 tx=0x7f9a88008040 comp rx=0 tx=0).stop 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 msgr2=0x7f9a9816a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9a980cfe40 tx=0x7f9a8c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 shutdown_connections 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9a84066f30 0x7f9a840693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a981591e0 0x7f9a980c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a980b03c0 0x7f9a9815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 --2- 172.21.15.46:0/3894377918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a980b0790 0x7f9a9816a0f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 >> 172.21.15.46:0/3894377918 conn(0x7f9a98063230 msgr2=0x7f9a98068d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 shutdown_connections 2023-10-07T08:59:37.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.000+0000 7f9a9c860700 1 -- 172.21.15.46:0/3894377918 wait complete. 2023-10-07T08:59:37.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T08:59:37.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 Processor -- start 2023-10-07T08:59:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 -- start start 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa1cc159c10 0x7fa1cc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1cc15c910 0x7fa1cc15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc15c480 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0b2a40 con 0x7fa1cc159c10 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.143+0000 7fa1d1503700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc15d290 con 0x7fa1cc15c910 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa1cc159c10 0x7fa1cc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1ca7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa1cc0b5ea0 0x7fa1cc068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33208/0 (socket says 172.21.15.46:33208) 2023-10-07T08:59:37.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1ca7fc700 1 -- 172.21.15.46:0/2227346444 learned_addr learned my addr 172.21.15.46:0/2227346444 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 -- 172.21.15.46:0/2227346444 >> v2:172.21.15.133:3300/0 conn(0x7fa1cc15c910 msgr2=0x7fa1cc15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 --2- 172.21.15.46:0/2227346444 >> v2:172.21.15.133:3300/0 conn(0x7fa1cc15c910 0x7fa1cc15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 -- 172.21.15.46:0/2227346444 >> v1:172.21.15.46:6789/0 conn(0x7fa1cc0b5ea0 legacy=0x7fa1cc068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 -- 172.21.15.46:0/2227346444 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc15b5d0 con 0x7fa1cc159c10 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1c9ffb700 1 -- 172.21.15.46:0/2227346444 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128166981 0 0) 0x7fa1cc15c480 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1caffd700 1 --2- 172.21.15.46:0/2227346444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc159c10 0x7fa1cc15b090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b21a0 tx=0x7fa1c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53038af8cf5fede server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1c9ffb700 1 -- 172.21.15.46:0/2227346444 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400e070 con 0x7fa1cc159c10 2023-10-07T08:59:37.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1c9ffb700 1 -- 172.21.15.46:0/2227346444 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400bc30 con 0x7fa1cc159c10 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.144+0000 7fa1c9ffb700 1 -- 172.21.15.46:0/2227346444 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4012430 con 0x7fa1cc159c10 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 -- 172.21.15.46:0/2227346444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc159c10 msgr2=0x7fa1cc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 --2- 172.21.15.46:0/2227346444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc159c10 0x7fa1cc15b090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b21a0 tx=0x7fa1c4009780 comp rx=0 tx=0).stop 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 -- 172.21.15.46:0/2227346444 shutdown_connections 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 --2- 172.21.15.46:0/2227346444 >> v2:172.21.15.133:3300/0 conn(0x7fa1cc15c910 0x7fa1cc15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 --2- 172.21.15.46:0/2227346444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc159c10 0x7fa1cc15b090 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 -- 172.21.15.46:0/2227346444 >> 172.21.15.46:0/2227346444 conn(0x7fa1cc099a20 msgr2=0x7fa1cc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 -- 172.21.15.46:0/2227346444 shutdown_connections 2023-10-07T08:59:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.145+0000 7fa1d1503700 1 -- 172.21.15.46:0/2227346444 wait complete. 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.146+0000 7fa1d1503700 1 Processor -- start 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.146+0000 7fa1d1503700 1 -- start start 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1cc159c10 0x7fa1cc0cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 0x7fa1cc0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0b0be0 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0d0390 con 0x7fa1cc15c910 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1d1503700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0affd0 con 0x7fa1cc159c10 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53120/0 (socket says 172.21.15.46:53120) 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 -- 172.21.15.46:0/1890015449 learned_addr learned my addr 172.21.15.46:0/1890015449 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1ca7fc700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1cc159c10 0x7fa1cc0cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1cb7fe700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 0x7fa1cc0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 -- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1cc159c10 msgr2=0x7fa1cc0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1cc159c10 0x7fa1cc0cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 -- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 msgr2=0x7fa1cc0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 0x7fa1cc0af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1caffd700 1 -- 172.21.15.46:0/1890015449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009a20 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.147+0000 7fa1cb7fe700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 0x7fa1cc0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1caffd700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4013000 tx=0x7fa1c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4012e20 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c401d630 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc0b02b0 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c401d9f0 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.148+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc0b0870 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.149+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc04c3c0 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.149+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1c4024070 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.150+0000 7fa1c2ffd700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 0x7fa1ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.150+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1c4086c10 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.150+0000 7fa1ca7fc700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 0x7fa1ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.150+0000 7fa1ca7fc700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 0x7fa1ac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc14c140 tx=0x7fa1b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.154+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1c4053e80 con 0x7fa1cc0b5ea0 2023-10-07T08:59:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.374+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1cc0b0d20 con 0x7fa1ac066f30 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.376+0000 7fa1c2ffd700 1 -- 172.21.15.46:0/1890015449 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa1b400cd90 con 0x7fa1ac066f30 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:37.377 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 msgr2=0x7fa1ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 0x7fa1ac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc14c140 tx=0x7fa1b4009040 comp rx=0 tx=0).stop 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 msgr2=0x7fa1cc1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4013000 tx=0x7fa1c4019000 comp rx=0 tx=0).stop 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 shutdown_connections 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa1ac066f30 0x7fa1ac0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1cc15c910 0x7fa1cc0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1cc0b5ea0 0x7fa1cc1590d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 --2- 172.21.15.46:0/1890015449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa1cc159c10 0x7fa1cc0cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 >> 172.21.15.46:0/1890015449 conn(0x7fa1cc099a20 msgr2=0x7fa1cc09d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.378+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 shutdown_connections 2023-10-07T08:59:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.379+0000 7fa1d1503700 1 -- 172.21.15.46:0/1890015449 wait complete. 2023-10-07T08:59:37.391 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:59:37.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.513+0000 7f2709694700 1 Processor -- start 2023-10-07T08:59:37.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.513+0000 7f2709694700 1 -- start start 2023-10-07T08:59:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2709694700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2704157460 0x7f27040b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2709694700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040c91c0 0x7f27040cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2709694700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270415c110 con 0x7f27040caa60 2023-10-07T08:59:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2709694700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270406c5a0 con 0x7f2704157460 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2709694700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040b0b10 con 0x7f27040c91c0 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2704157460 0x7f27040b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2704157460 0x7f27040b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53136/0 (socket says 172.21.15.46:53136) 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 -- 172.21.15.46:0/3415286445 learned_addr learned my addr 172.21.15.46:0/3415286445 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f27037fe700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040c91c0 0x7f27040cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 -- 172.21.15.46:0/3415286445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040c91c0 msgr2=0x7f27040cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040c91c0 0x7f27040cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 -- 172.21.15.46:0/3415286445 >> v1:172.21.15.133:6789/0 conn(0x7f27040caa60 legacy=0x7f27040c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.514+0000 7f2702ffd700 1 -- 172.21.15.46:0/3415286445 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270415bc80 con 0x7f2704157460 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2702ffd700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2704157460 0x7f27040b0210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26f40099b0 tx=0x7f26f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc7d75954f8d49c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2701ffb700 1 -- 172.21.15.46:0/3415286445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400b860 con 0x7f2704157460 2023-10-07T08:59:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2701ffb700 1 -- 172.21.15.46:0/3415286445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400b9c0 con 0x7f2704157460 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2701ffb700 1 -- 172.21.15.46:0/3415286445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400bd60 con 0x7f2704157460 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 -- 172.21.15.46:0/3415286445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2704157460 msgr2=0x7f27040b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2704157460 0x7f27040b0210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26f40099b0 tx=0x7f26f4009250 comp rx=0 tx=0).stop 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 -- 172.21.15.46:0/3415286445 shutdown_connections 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040c91c0 0x7f27040cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 --2- 172.21.15.46:0/3415286445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2704157460 0x7f27040b0210 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 -- 172.21.15.46:0/3415286445 >> 172.21.15.46:0/3415286445 conn(0x7f27040ce470 msgr2=0x7f27040ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 -- 172.21.15.46:0/3415286445 shutdown_connections 2023-10-07T08:59:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.515+0000 7f2709694700 1 -- 172.21.15.46:0/3415286445 wait complete. 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 Processor -- start 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 -- start start 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040caa60 0x7f27040c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2704157460 0x7f27040c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040c6130 con 0x7f27040c91c0 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040c5520 con 0x7f2704157460 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2709694700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040c5800 con 0x7f27040caa60 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2702ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2702ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53146/0 (socket says 172.21.15.46:53146) 2023-10-07T08:59:37.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.517+0000 7f2702ffd700 1 -- 172.21.15.46:0/1326526536 learned_addr learned my addr 172.21.15.46:0/1326526536 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 -- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040caa60 msgr2=0x7f27040c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040caa60 0x7f27040c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 -- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2704157460 msgr2=0x7f27040c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2704157460 0x7f27040c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 -- 172.21.15.46:0/1326526536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40094f0 con 0x7f27040c91c0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2702ffd700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009fd0 tx=0x7f26f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4024440 con 0x7f27040c91c0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f40245a0 con 0x7f27040c91c0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040c5ae0 con 0x7f27040c91c0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4024940 con 0x7f27040c91c0 2023-10-07T08:59:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.518+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270415a560 con 0x7f27040c91c0 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.519+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040c5f80 con 0x7f27040c91c0 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.519+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26f401a420 con 0x7f27040c91c0 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.520+0000 7f26faffd700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 0x7f26e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.520+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26f40862c0 con 0x7f27040c91c0 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.520+0000 7f27027fc700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 0x7f26e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.521+0000 7f27027fc700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 0x7f26e40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2704153d10 tx=0x7f26ec007b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.524+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26f4053490 con 0x7f27040c91c0 2023-10-07T08:59:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.716+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f270415b350 con 0x7f27040c91c0 2023-10-07T08:59:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.716+0000 7f26faffd700 1 -- 172.21.15.46:0/1326526536 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26f4056ab0 con 0x7f27040c91c0 2023-10-07T08:59:37.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 msgr2=0x7f26e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 0x7f26e40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2704153d10 tx=0x7f26ec007b00 comp rx=0 tx=0).stop 2023-10-07T08:59:37.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 msgr2=0x7f2704168b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009fd0 tx=0x7f26f4017000 comp rx=0 tx=0).stop 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 shutdown_connections 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f26e4066f30 0x7f26e40693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2704157460 0x7f27040c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27040c91c0 0x7f2704168b00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 --2- 172.21.15.46:0/1326526536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27040caa60 0x7f27040c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 >> 172.21.15.46:0/1326526536 conn(0x7f27040ce470 msgr2=0x7f2704156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 shutdown_connections 2023-10-07T08:59:37.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.718+0000 7f2709694700 1 -- 172.21.15.46:0/1326526536 wait complete. 2023-10-07T08:59:37.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000079883 2023-10-07T08:59:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.852+0000 7f3772bd4700 1 Processor -- start 2023-10-07T08:59:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.852+0000 7f3772bd4700 1 -- start start 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3772bd4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3772bd4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f376c06c0a0 0x7f376c0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3772bd4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c15c2a0 con 0x7f376c06bcd0 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3772bd4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0c9880 con 0x7f376c06c0a0 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3772bd4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c15b690 con 0x7f376c141500 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3770970700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f376c06bcd0 0x7f376c140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33218/0 (socket says 172.21.15.46:33218) 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f376c06c0a0 0x7f376c0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3770970700 1 -- 172.21.15.46:0/3074864524 learned_addr learned my addr 172.21.15.46:0/3074864524 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 -- 172.21.15.46:0/3074864524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 msgr2=0x7f376c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:37.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 --2- 172.21.15.46:0/3074864524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 -- 172.21.15.46:0/3074864524 >> v1:172.21.15.46:6789/0 conn(0x7f376c06bcd0 legacy=0x7f376c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 -- 172.21.15.46:0/3074864524 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c15b970 con 0x7f376c06c0a0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f376b7fe700 1 -- 172.21.15.46:0/3074864524 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927962422 0 0) 0x7f376c15c2a0 con 0x7f376c06bcd0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f3771171700 1 --2- 172.21.15.46:0/3074864524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c0c9340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f375c0098e0 tx=0x7f375c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5071f5b111abf147 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.853+0000 7f376b7fe700 1 -- 172.21.15.46:0/3074864524 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c009e80 con 0x7f376c06c0a0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f376b7fe700 1 -- 172.21.15.46:0/3074864524 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00b860 con 0x7f376c06c0a0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f376b7fe700 1 -- 172.21.15.46:0/3074864524 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00bbe0 con 0x7f376c06c0a0 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 -- 172.21.15.46:0/3074864524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 msgr2=0x7f376c0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 --2- 172.21.15.46:0/3074864524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c0c9340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f375c0098e0 tx=0x7f375c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 -- 172.21.15.46:0/3074864524 shutdown_connections 2023-10-07T08:59:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 --2- 172.21.15.46:0/3074864524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c0c9340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 --2- 172.21.15.46:0/3074864524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 -- 172.21.15.46:0/3074864524 >> 172.21.15.46:0/3074864524 conn(0x7f376c0ce600 msgr2=0x7f376c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:37.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 -- 172.21.15.46:0/3074864524 shutdown_connections 2023-10-07T08:59:37.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.854+0000 7f3772bd4700 1 -- 172.21.15.46:0/3074864524 wait complete. 2023-10-07T08:59:37.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.855+0000 7f3772bd4700 1 Processor -- start 2023-10-07T08:59:37.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.855+0000 7f3772bd4700 1 -- start start 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c06bcd0 0x7f376c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c13dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b4210 con 0x7f376c06c0a0 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b2530 con 0x7f376c06bcd0 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3772bd4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b3c50 con 0x7f376c141500 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53160/0 (socket says 172.21.15.46:53160) 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 -- 172.21.15.46:0/731596561 learned_addr learned my addr 172.21.15.46:0/731596561 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:37.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3771171700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c13dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f3770970700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c06bcd0 0x7f376c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 -- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 msgr2=0x7f376c13dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c13dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 -- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c06bcd0 msgr2=0x7f376c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.856+0000 7f376bfff700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c06bcd0 0x7f376c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f376bfff700 1 -- 172.21.15.46:0/731596561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c009420 con 0x7f376c06c0a0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f376bfff700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f376000b840 tx=0x7f37600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000f510 con 0x7f376c06c0a0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000f670 con 0x7f376c06c0a0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0b3f30 con 0x7f376c06c0a0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000fa30 con 0x7f376c06c0a0 2023-10-07T08:59:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.857+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0b21c0 con 0x7f376c06c0a0 2023-10-07T08:59:37.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.858+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c04c3c0 con 0x7f376c06c0a0 2023-10-07T08:59:37.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.858+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f376001a400 con 0x7f376c06c0a0 2023-10-07T08:59:37.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.859+0000 7f3768ff9700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:37.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.859+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3760083ed0 con 0x7f376c06c0a0 2023-10-07T08:59:37.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.859+0000 7f3770970700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:37.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.859+0000 7f3770970700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3764002250 tx=0x7f3764001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:37.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:37.863+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37600511c0 con 0x7f376c06c0a0 2023-10-07T08:59:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:38.084+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000079883", "target": ["mon-mgr", ""]}) v1 -- 0x7f376c15bc50 con 0x7f3758066f30 2023-10-07T08:59:41.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.038+0000 7f3768ff9700 1 -- 172.21.15.46:0/731596561 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f376c15bc50 con 0x7f3758066f30 2023-10-07T08:59:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 msgr2=0x7f37580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3764002250 tx=0x7f3764001a20 comp rx=0 tx=0).stop 2023-10-07T08:59:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 msgr2=0x7f376c13d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f376000b840 tx=0x7f37600091d0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 shutdown_connections 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f376c141500 0x7f376c13dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c06bcd0 0x7f376c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 --2- 172.21.15.46:0/731596561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f376c06c0a0 0x7f376c13d960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 >> 172.21.15.46:0/731596561 conn(0x7f376c0ce600 msgr2=0x7f376c0c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 shutdown_connections 2023-10-07T08:59:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.042+0000 7f3772bd4700 1 -- 172.21.15.46:0/731596561 wait complete. 2023-10-07T08:59:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:Volume created successfully (no MDS daemons created) 2023-10-07T08:59:41.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T08:59:41.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.181+0000 7f1d4687f700 1 Processor -- start 2023-10-07T08:59:41.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.181+0000 7f1d4687f700 1 -- start start 2023-10-07T08:59:41.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d4687f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d40069560 0x7f1d400699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d4687f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d40069ee0 con 0x7f1d40159890 2023-10-07T08:59:41.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d4687f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4015a160 con 0x7f1d40159c60 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d4687f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400d13a0 con 0x7f1d40069560 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d44e1c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d40069560 0x7f1d400699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d3ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1d40159890 0x7f1d4015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34664/0 (socket says 172.21.15.46:34664) 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.182+0000 7f1d3ffff700 1 -- 172.21.15.46:0/3909176044 learned_addr learned my addr 172.21.15.46:0/3909176044 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d44e1c700 1 -- 172.21.15.46:0/3909176044 >> v1:172.21.15.133:6789/0 conn(0x7f1d40159c60 legacy=0x7f1d4015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d44e1c700 1 -- 172.21.15.46:0/3909176044 >> v1:172.21.15.46:6789/0 conn(0x7f1d40159890 legacy=0x7f1d4015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d44e1c700 1 -- 172.21.15.46:0/3909176044 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4015e140 con 0x7f1d40069560 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d3effd700 1 -- 172.21.15.46:0/3909176044 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183808548 0 0) 0x7f1d40069ee0 con 0x7f1d40159890 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d44e1c700 1 --2- 172.21.15.46:0/3909176044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400699a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009e60 tx=0x7f1d38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b9396e79f1e43e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d3effd700 1 -- 172.21.15.46:0/3909176044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800e070 con 0x7f1d40069560 2023-10-07T08:59:41.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d3effd700 1 -- 172.21.15.46:0/3909176044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800bc30 con 0x7f1d40069560 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.183+0000 7f1d3effd700 1 -- 172.21.15.46:0/3909176044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38012430 con 0x7f1d40069560 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 -- 172.21.15.46:0/3909176044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 msgr2=0x7f1d400699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 --2- 172.21.15.46:0/3909176044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400699a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009e60 tx=0x7f1d38009780 comp rx=0 tx=0).stop 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 -- 172.21.15.46:0/3909176044 shutdown_connections 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 --2- 172.21.15.46:0/3909176044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400699a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 -- 172.21.15.46:0/3909176044 >> 172.21.15.46:0/3909176044 conn(0x7f1d40068e20 msgr2=0x7f1d400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 -- 172.21.15.46:0/3909176044 shutdown_connections 2023-10-07T08:59:41.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.184+0000 7f1d4687f700 1 -- 172.21.15.46:0/3909176044 wait complete. 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.185+0000 7f1d4687f700 1 Processor -- start 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.185+0000 7f1d4687f700 1 -- start start 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 0x7f1d40140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d40159c60 0x7f1d40157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400b4170 con 0x7f1d40069560 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4016dac0 con 0x7f1d40159c60 2023-10-07T08:59:41.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4016dda0 con 0x7f1d40159890 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44740/0 (socket says 172.21.15.46:44740) 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 -- 172.21.15.46:0/4149081959 learned_addr learned my addr 172.21.15.46:0/4149081959 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3f7fe700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 0x7f1d40140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d44e1c700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d40159c60 0x7f1d40157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 -- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 msgr2=0x7f1d40140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 0x7f1d40140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 -- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d40159c60 msgr2=0x7f1d40157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d40159c60 0x7f1d40157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 -- 172.21.15.46:0/4149081959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38009a20 con 0x7f1d40069560 2023-10-07T08:59:41.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3f7fe700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 0x7f1d40140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d3ffff700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c7e0 tx=0x7f1d30007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30005b30 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30005c90 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4016e080 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30007300 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.186+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400cd6b0 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.187+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d400cd8d0 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.188+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d3001b400 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.188+0000 7f1d37fff700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.188+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1d300843b0 con 0x7f1d40069560 2023-10-07T08:59:41.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.188+0000 7f1d3f7fe700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.189+0000 7f1d3f7fe700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.193+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d30051320 con 0x7f1d40069560 2023-10-07T08:59:41.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.415+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d4004c3c0 con 0x7f1d20066f30 2023-10-07T08:59:41.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.418+0000 7f1d37fff700 1 -- 172.21.15.46:0/4149081959 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f1d4004c3c0 con 0x7f1d20066f30 2023-10-07T08:59:41.418 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T08:59:41.418 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:41.418 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T08:59:41.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:41.419 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:41.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000079883" 2023-10-07T08:59:41.419 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:41.419 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 msgr2=0x7f1d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28009040 comp rx=0 tx=0).stop 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 msgr2=0x7f1d400b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c7e0 tx=0x7f1d30007df0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 shutdown_connections 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d40159c60 0x7f1d40157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d40069560 0x7f1d400b3c30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 --2- 172.21.15.46:0/4149081959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d40159890 0x7f1d40140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 >> 172.21.15.46:0/4149081959 conn(0x7f1d40068e20 msgr2=0x7f1d4015aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 shutdown_connections 2023-10-07T08:59:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.419+0000 7f1d4687f700 1 -- 172.21.15.46:0/4149081959 wait complete. 2023-10-07T08:59:41.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-07T08:59:41.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:59:41.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:59:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.555+0000 7fa16d81c700 1 Processor -- start 2023-10-07T08:59:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa16d81c700 1 -- start start 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa16d81c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa16815dba0 0x7fa16806ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa16d81c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680c74b0 con 0x7fa168159b10 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa16d81c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680c8700 con 0x7fa16815d730 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa16d81c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680c9070 con 0x7fa16815dba0 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.556+0000 7fa166ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa168159b10 0x7fa1680cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34670/0 (socket says 172.21.15.46:34670) 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa166ffd700 1 -- 172.21.15.46:0/21753881 learned_addr learned my addr 172.21.15.46:0/21753881 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> v2:172.21.15.133:3300/0 conn(0x7fa16815dba0 0x7fa16806ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728379692 0 0) 0x7fa1680c74b0 con 0x7fa168159b10 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa154003570 con 0x7fa168159b10 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427737071 0 0) 0x7fa154003570 con 0x7fa168159b10 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 >> v2:172.21.15.133:3300/0 conn(0x7fa16815dba0 msgr2=0x7fa16806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 --2- 172.21.15.46:0/21753881 >> v2:172.21.15.133:3300/0 conn(0x7fa16815dba0 0x7fa16806ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 >> v1:172.21.15.133:6789/0 conn(0x7fa16815d730 legacy=0x7fa16806a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680c80f0 con 0x7fa168159b10 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fa1580017f0 con 0x7fa168159b10 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> v2:172.21.15.133:3300/0 conn(0x7fa16815dba0 0x7fa16806ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 >> v1:172.21.15.46:6789/0 conn(0x7fa168159b10 legacy=0x7fa1680cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa154003a60 0x7fa154003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa154004810 0x7fa154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 0x7fa15400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680c9070 con 0x7fa1540051c0 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15400c0d0 con 0x7fa154003a60 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15400c290 con 0x7fa154004810 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 0x7fa15400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa166ffd700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa154003a60 0x7fa154003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.557+0000 7fa1667fc700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa154004810 0x7fa154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 -- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa154004810 msgr2=0x7fa154004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa154004810 0x7fa154004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 -- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa154003a60 msgr2=0x7fa154003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa154003a60 0x7fa154003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 -- 172.21.15.46:0/21753881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154003570 con 0x7fa1540051c0 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1667fc700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa154004810 0x7fa154004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 -- 172.21.15.46:0/21753881 reap_dead start 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa1677fe700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 0x7fa15400ba60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa160009df0 tx=0x7fa1600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1971347c48c803b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160009740 con 0x7fa1540051c0 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000e920 con 0x7fa1540051c0 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa165ffb700 1 -- 172.21.15.46:0/21753881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000ece0 con 0x7fa1540051c0 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa16d81c700 1 -- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 msgr2=0x7fa15400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa16d81c700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 0x7fa15400ba60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa160009df0 tx=0x7fa1600091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa16d81c700 1 -- 172.21.15.46:0/21753881 shutdown_connections 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa16d81c700 1 --2- 172.21.15.46:0/21753881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1540051c0 0x7fa15400ba60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.558+0000 7fa16d81c700 1 -- 172.21.15.46:0/21753881 >> 172.21.15.46:0/21753881 conn(0x7fa1680c9870 msgr2=0x7fa1680c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.559+0000 7fa16d81c700 1 -- 172.21.15.46:0/21753881 shutdown_connections 2023-10-07T08:59:41.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.559+0000 7fa16d81c700 1 -- 172.21.15.46:0/21753881 wait complete. 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.560+0000 7fa16d81c700 1 Processor -- start 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.560+0000 7fa16d81c700 1 -- start start 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1540051c0 0x7fa1680afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa16814d310 0x7fa16814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16814d780 con 0x7fa16814fa90 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680b0230 con 0x7fa1540051c0 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa16d81c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680b0510 con 0x7fa16814d310 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44754/0 (socket says 172.21.15.46:44754) 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 -- 172.21.15.46:0/1564152957 learned_addr learned my addr 172.21.15.46:0/1564152957 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa166ffd700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1540051c0 0x7fa1680afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1667fc700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa16814d310 0x7fa16814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 -- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa16814d310 msgr2=0x7fa16814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa16814d310 0x7fa16814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 -- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1540051c0 msgr2=0x7fa1680afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1540051c0 0x7fa1680afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 -- 172.21.15.46:0/1564152957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680b07f0 con 0x7fa16814fa90 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa1677fe700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1600093f0 tx=0x7fa16001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.561+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160022070 con 0x7fa16814fa90 2023-10-07T08:59:41.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.562+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160013e70 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.562+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1680b0ad0 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.562+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16001c680 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.562+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16814bff0 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.563+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16814d6e0 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.563+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa160026070 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.563+0000 7fa15effd700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 0x7fa1480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.563+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa160085ff0 con 0x7fa16814fa90 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.564+0000 7fa166ffd700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 0x7fa1480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.564+0000 7fa166ffd700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 0x7fa1480693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a0e0 tx=0x7fa1680c8280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.568+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa160052ee0 con 0x7fa16814fa90 2023-10-07T08:59:41.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.759+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fa16804c3c0 con 0x7fa16814fa90 2023-10-07T08:59:41.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.760+0000 7fa15effd700 1 -- 172.21.15.46:0/1564152957 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fa160056500 con 0x7fa16814fa90 2023-10-07T08:59:41.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 msgr2=0x7fa1480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 0x7fa1480693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a0e0 tx=0x7fa1680c8280 comp rx=0 tx=0).stop 2023-10-07T08:59:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 msgr2=0x7fa16814ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1600093f0 tx=0x7fa16001a000 comp rx=0 tx=0).stop 2023-10-07T08:59:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 shutdown_connections 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa148066f30 0x7fa1480693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa16814fa90 0x7fa16814ff30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1540051c0 0x7fa1680afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 --2- 172.21.15.46:0/1564152957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa16814d310 0x7fa16814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 >> 172.21.15.46:0/1564152957 conn(0x7fa1680c9870 msgr2=0x7fa16814edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 shutdown_connections 2023-10-07T08:59:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.762+0000 7fa16d81c700 1 -- 172.21.15.46:0/1564152957 wait complete. 2023-10-07T08:59:41.775 INFO:teuthology.orchestra.run.smithi046.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000079883.meta","create_time":"2023-10-07T08:59:38.116501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000079883"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000079883.data","create_time":"2023-10-07T08:59:39.049828+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000079883"}}}] 2023-10-07T08:59:41.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000079883 --format=json 2023-10-07T08:59:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.935+0000 7fd71b43b700 1 Processor -- start 2023-10-07T08:59:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.935+0000 7fd71b43b700 1 -- start start 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71b43b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd7140cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71b43b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7140cc3c0 0x7fd71406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71b43b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71406c380 con 0x7fd71406bf20 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71b43b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7140b16a0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71b43b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140b1c60 con 0x7fd7141574d0 2023-10-07T08:59:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71a439700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd7140cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd719c38700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7140cc3c0 0x7fd71406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71ac3a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd71406bf20 0x7fd71406cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39356/0 (socket says 172.21.15.46:39356) 2023-10-07T08:59:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.936+0000 7fd71ac3a700 1 -- 172.21.15.46:0/3206092479 learned_addr learned my addr 172.21.15.46:0/3206092479 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719437700 1 -- 172.21.15.46:0/3206092479 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411508884 0 0) 0x7fd704001490 con 0x7fd71406bf20 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719437700 1 -- 172.21.15.46:0/3206092479 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6fc003570 con 0x7fd71406bf20 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719c38700 1 -- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 msgr2=0x7fd7140cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719c38700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd7140cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719c38700 1 -- 172.21.15.46:0/3206092479 >> v1:172.21.15.133:6789/0 conn(0x7fd71406bf20 legacy=0x7fd71406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719c38700 1 -- 172.21.15.46:0/3206092479 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7141578a0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd71a439700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd7140cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:41.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719c38700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140cc3c0 0x7fd71406b9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd7080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c322caf7b5eeaab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719437700 1 -- 172.21.15.46:0/3206092479 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011630 con 0x7fd7140cc3c0 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719437700 1 -- 172.21.15.46:0/3206092479 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708011790 con 0x7fd7140cc3c0 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.937+0000 7fd719437700 1 -- 172.21.15.46:0/3206092479 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011b10 con 0x7fd7140cc3c0 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 -- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140cc3c0 msgr2=0x7fd71406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140cc3c0 0x7fd71406b9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd7080091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 -- 172.21.15.46:0/3206092479 shutdown_connections 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd7140cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3206092479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140cc3c0 0x7fd71406b9e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 -- 172.21.15.46:0/3206092479 >> 172.21.15.46:0/3206092479 conn(0x7fd7140ce430 msgr2=0x7fd7140ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:41.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 -- 172.21.15.46:0/3206092479 shutdown_connections 2023-10-07T08:59:41.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.938+0000 7fd71b43b700 1 -- 172.21.15.46:0/3206092479 wait complete. 2023-10-07T08:59:41.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.939+0000 7fd71b43b700 1 Processor -- start 2023-10-07T08:59:41.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.939+0000 7fd71b43b700 1 -- start start 2023-10-07T08:59:41.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 0x7fd714159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd714145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714152700 con 0x7fd7140cc3c0 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71415a510 con 0x7fd71406bf20 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71b43b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71415a7f0 con 0x7fd7141574d0 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44760/0 (socket says 172.21.15.46:44760) 2023-10-07T08:59:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 -- 172.21.15.46:0/3711194786 learned_addr learned my addr 172.21.15.46:0/3711194786 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71ac3a700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd714145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71a439700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 0x7fd714159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 -- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 msgr2=0x7fd714145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd714145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 -- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 msgr2=0x7fd714159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 0x7fd714159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 -- 172.21.15.46:0/3711194786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0093c0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71ac3a700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd714145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd71a439700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 0x7fd714159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.940+0000 7fd719c38700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd7140ada10 tx=0x7fd708017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.941+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011b10 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.941+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708000cc0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.941+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd708009420 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.941+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70801a680 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.941+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71415adb0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.942+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71406cb10 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.942+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd70801aa70 con 0x7fd7140cc3c0 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.942+0000 7fd7127fc700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.942+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd7080865d0 con 0x7fd7140cc3c0 2023-10-07T08:59:41.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.943+0000 7fd71a439700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:41.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.943+0000 7fd71a439700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 0x7fd7000693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009390 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:41.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:41.947+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd708053420 con 0x7fd7140cc3c0 2023-10-07T08:59:42.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.185+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000079883", "format": "json"} v 0) v1 -- 0x7fd71404c3c0 con 0x7fd7140cc3c0 2023-10-07T08:59:42.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.186+0000 7fd7127fc700 1 -- 172.21.15.46:0/3711194786 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000079883", "format": "json"}]=0 v20) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fd708056a40 con 0x7fd7140cc3c0 2023-10-07T08:59:42.187 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:42.187 INFO:teuthology.orchestra.run.smithi046.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:40.034076+0000","modified":"2023-10-07T08:59:42.031613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6837/1068755666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1068755666},{"type":"v1","addr":"172.21.15.133:6837","nonce":1068755666}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000079883","balancer":"","standby_count_wanted":1},"id":3} 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 msgr2=0x7fd7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 0x7fd7000693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009390 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 msgr2=0x7fd714159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd7140ada10 tx=0x7fd708017000 comp rx=0 tx=0).stop 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 shutdown_connections 2023-10-07T08:59:42.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7141574d0 0x7fd714145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71406bf20 0x7fd714159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 --2- 172.21.15.46:0/3711194786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7140cc3c0 0x7fd714159360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 >> 172.21.15.46:0/3711194786 conn(0x7fd7140ce430 msgr2=0x7fd7140afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 shutdown_connections 2023-10-07T08:59:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.188+0000 7fd71b43b700 1 -- 172.21.15.46:0/3711194786 wait complete. 2023-10-07T08:59:42.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000079883 --yes-i-really-mean-it 2023-10-07T08:59:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.322+0000 7fdf2ab23700 1 Processor -- start 2023-10-07T08:59:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.322+0000 7fdf2ab23700 1 -- start start 2023-10-07T08:59:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf2ab23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf2ab23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf2ab23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2415a160 con 0x7fdf24159c60 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf2ab23700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf24069f20 con 0x7fdf24069560 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf2ab23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240d13a0 con 0x7fdf24159890 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf290c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf288bf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf288bf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:47384/0 (socket says 172.21.15.46:47384) 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf288bf700 1 -- 172.21.15.46:0/1900753039 learned_addr learned my addr 172.21.15.46:0/1900753039 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf290c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:52452/0 (socket says 172.21.15.46:52452) 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.323+0000 7fdf23fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf24159c60 0x7fdf2415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39364/0 (socket says 172.21.15.46:39364) 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf288bf700 1 -- 172.21.15.46:0/1900753039 >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 msgr2=0x7fdf240699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf288bf700 1 --2- 172.21.15.46:0/1900753039 >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf288bf700 1 -- 172.21.15.46:0/1900753039 >> v1:172.21.15.133:6789/0 conn(0x7fdf24159c60 legacy=0x7fdf2415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf288bf700 1 -- 172.21.15.46:0/1900753039 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2415e140 con 0x7fdf24159890 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf237fe700 1 -- 172.21.15.46:0/1900753039 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010764155 0 0) 0x7fdf2415a160 con 0x7fdf24159c60 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf290c0700 1 --2- 172.21.15.46:0/1900753039 >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf288bf700 1 --2- 172.21.15.46:0/1900753039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf180099b0 tx=0x7fdf18009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c07ca53bec988ba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf237fe700 1 -- 172.21.15.46:0/1900753039 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18009ea0 con 0x7fdf24159890 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf237fe700 1 -- 172.21.15.46:0/1900753039 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1800b860 con 0x7fdf24159890 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.324+0000 7fdf237fe700 1 -- 172.21.15.46:0/1900753039 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800bc00 con 0x7fdf24159890 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 -- 172.21.15.46:0/1900753039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 msgr2=0x7fdf2415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/1900753039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf180099b0 tx=0x7fdf18009250 comp rx=0 tx=0).stop 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 -- 172.21.15.46:0/1900753039 shutdown_connections 2023-10-07T08:59:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/1900753039 >> v2:172.21.15.133:3300/0 conn(0x7fdf24069560 0x7fdf240699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/1900753039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf2415abd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 -- 172.21.15.46:0/1900753039 >> 172.21.15.46:0/1900753039 conn(0x7fdf24068e20 msgr2=0x7fdf240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:42.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 -- 172.21.15.46:0/1900753039 shutdown_connections 2023-10-07T08:59:42.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.325+0000 7fdf2ab23700 1 -- 172.21.15.46:0/1900753039 wait complete. 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.326+0000 7fdf2ab23700 1 Processor -- start 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.326+0000 7fdf2ab23700 1 -- start start 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf24069560 0x7fdf240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf240ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cf3e0 con 0x7fdf24159c60 2023-10-07T08:59:42.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cee20 con 0x7fdf24069560 2023-10-07T08:59:42.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf2ab23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cf100 con 0x7fdf24159890 2023-10-07T08:59:42.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44762/0 (socket says 172.21.15.46:44762) 2023-10-07T08:59:42.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 -- 172.21.15.46:0/2533961107 learned_addr learned my addr 172.21.15.46:0/2533961107 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf288bf700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf24069560 0x7fdf240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf23fff700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf240ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 -- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 msgr2=0x7fdf240ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf240ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 -- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf24069560 msgr2=0x7fdf240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf24069560 0x7fdf240ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 -- 172.21.15.46:0/2533961107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c009a20 con 0x7fdf24159c60 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.327+0000 7fdf290c0700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009fc0 tx=0x7fdf1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.328+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00cbd0 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.328+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00f040 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.328+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf180094f0 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.328+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c014480 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.328+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf240c5d10 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.329+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2404c3c0 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.329+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf1c003020 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.329+0000 7fdf20ff9700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.329+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fdf1c0851d0 con 0x7fdf24159c60 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.330+0000 7fdf288bf700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.330+0000 7fdf288bf700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf180099b0 tx=0x7fdf18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:42.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.334+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf1c0520c0 con 0x7fdf24159c60 2023-10-07T08:59:42.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:42.554+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000079883", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf2406a5b0 con 0x7fdf08066f30 2023-10-07T08:59:42.559 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T08:59:42.559+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:59:42.586 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T08:59:45.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.572+0000 7fdf20ff9700 1 -- 172.21.15.46:0/2533961107 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fdf2406a5b0 con 0x7fdf08066f30 2023-10-07T08:59:45.574 INFO:teuthology.orchestra.run.smithi046.stdout:metadata pool: cephfs.volume_0000000000079883.meta data pool: ['cephfs.volume_0000000000079883.data'] removed 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 msgr2=0x7fdf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf180099b0 tx=0x7fdf18017000 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 msgr2=0x7fdf24169d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009fc0 tx=0x7fdf1c00b040 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 shutdown_connections 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf24159c60 0x7fdf24169d20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf24069560 0x7fdf240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 --2- 172.21.15.46:0/2533961107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf24159890 0x7fdf240ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:45.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 >> 172.21.15.46:0/2533961107 conn(0x7fdf24068e20 msgr2=0x7fdf240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:45.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 shutdown_connections 2023-10-07T08:59:45.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.578+0000 7fdf2ab23700 1 -- 172.21.15.46:0/2533961107 wait complete. 2023-10-07T08:59:45.593 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:59:45.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:45.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:45.679 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:59:45.679 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:59:45.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:45.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:59:45.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T08:59:45.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:45.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:59:45.780 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:59:45.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:59:45.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:59:45.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T08:59:45.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:59:45.816 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:59:45.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:45.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.993+0000 7f904b59e700 1 Processor -- start 2023-10-07T08:59:45.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.993+0000 7f904b59e700 1 -- start start 2023-10-07T08:59:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f904c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904b59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0b11d0 con 0x7f904c159420 2023-10-07T08:59:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0b14b0 con 0x7f904c15d230 2023-10-07T08:59:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b1790 con 0x7f904c1597f0 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904a59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f904c159420 0x7f904c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34682/0 (socket says 172.21.15.46:34682) 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904a59c700 1 -- 172.21.15.46:0/598597780 learned_addr learned my addr 172.21.15.46:0/598597780 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f9049d9b700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f904c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660340702 0 0) 0x7f904c0b11d0 con 0x7f904c159420 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.994+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9038003570 con 0x7f904c159420 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371716846 0 0) 0x7f9038003570 con 0x7f904c159420 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 msgr2=0x7f904c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f904c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 >> v1:172.21.15.133:6789/0 conn(0x7f904c15d230 legacy=0x7f904c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0b1a70 con 0x7f904c159420 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f9044001470 con 0x7f904c159420 2023-10-07T08:59:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 >> v1:172.21.15.46:6789/0 conn(0x7f904c159420 legacy=0x7f904c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f9038003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9038004810 0x7f9038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f90380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b1790 con 0x7f9038003a90 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903800bb10 con 0x7f9038004810 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903800bcd0 con 0x7f904c1597f0 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f9038003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f9049d9b700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9038004810 0x7f9038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904ad9d700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f90380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 -- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 msgr2=0x7f90380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f90380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 -- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9038004810 msgr2=0x7f9038004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9038004810 0x7f9038004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 -- 172.21.15.46:0/598597780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038003570 con 0x7f9038003a90 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904ad9d700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c1597f0 0x7f90380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904a59c700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f9038003e60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f904400c3c0 tx=0x7f9044001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a935fb0f8c762e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400cc90 con 0x7f9038003a90 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904400ce10 con 0x7f9038003a90 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.995+0000 7f904959a700 1 -- 172.21.15.46:0/598597780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044005b70 con 0x7f9038003a90 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 -- 172.21.15.46:0/598597780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 msgr2=0x7f9038003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 --2- 172.21.15.46:0/598597780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f9038003e60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f904400c3c0 tx=0x7f9044001e70 comp rx=0 tx=0).stop 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904ad9d700 1 -- 172.21.15.46:0/598597780 reap_dead start 2023-10-07T08:59:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 -- 172.21.15.46:0/598597780 shutdown_connections 2023-10-07T08:59:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 -- 172.21.15.46:0/598597780 >> 172.21.15.46:0/598597780 conn(0x7f904c0d0660 msgr2=0x7f904c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 -- 172.21.15.46:0/598597780 shutdown_connections 2023-10-07T08:59:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.996+0000 7f904b59e700 1 -- 172.21.15.46:0/598597780 wait complete. 2023-10-07T08:59:46.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.997+0000 7f904b59e700 1 Processor -- start 2023-10-07T08:59:46.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.997+0000 7f904b59e700 1 -- start start 2023-10-07T08:59:46.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c0c7880 0x7f904c16d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f904c068f80 0x7f904c156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0c83b0 con 0x7f9038003a90 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c16db90 con 0x7f904c068f80 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0cc3d0 con 0x7f904c0c7880 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44776/0 (socket says 172.21.15.46:44776) 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 -- 172.21.15.46:0/1286906279 learned_addr learned my addr 172.21.15.46:0/1286906279 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f9049d9b700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c0c7880 0x7f904c16d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904ad9d700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f904c068f80 0x7f904c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 -- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c0c7880 msgr2=0x7f904c16d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c0c7880 0x7f904c16d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 -- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f904c068f80 msgr2=0x7f904c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f904c068f80 0x7f904c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 -- 172.21.15.46:0/1286906279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0c5910 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.998+0000 7f904a59c700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f904400c9b0 tx=0x7f9044015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.999+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440070d0 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.999+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9044007250 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.999+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0c7df0 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.999+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044007610 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:45.999+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0c55a0 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.000+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c0c5400 con 0x7f9038003a90 2023-10-07T08:59:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.000+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9044019030 con 0x7f9038003a90 2023-10-07T08:59:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.000+0000 7f90427fc700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 0x7f902c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.000+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9044085f50 con 0x7f9038003a90 2023-10-07T08:59:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.001+0000 7f9049d9b700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 0x7f902c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.001+0000 7f9049d9b700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 0x7f902c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f904c0b65e0 tx=0x7f90340091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.005+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f904c0c5400 con 0x7f9038003a90 2023-10-07T08:59:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.247+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f904c0c5400 con 0x7f9038003a90 2023-10-07T08:59:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.248+0000 7f90427fc700 1 -- 172.21.15.46:0/1286906279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f904c0c5400 con 0x7f9038003a90 2023-10-07T08:59:46.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:46.249 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4045627749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4045627749},{"type":"v1","addr":"172.21.15.133:6837","nonce":4045627749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:46.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.249+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 msgr2=0x7f902c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.249+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 0x7f902c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f904c0b65e0 tx=0x7f90340091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.249+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 msgr2=0x7f904c0c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.249+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f904400c9b0 tx=0x7f9044015000 comp rx=0 tx=0).stop 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 shutdown_connections 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f902c066f30 0x7f902c0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f904c068f80 0x7f904c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9038003a90 0x7f904c0c9870 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 --2- 172.21.15.46:0/1286906279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f904c0c7880 0x7f904c16d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 >> 172.21.15.46:0/1286906279 conn(0x7f904c0d0660 msgr2=0x7f904c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 shutdown_connections 2023-10-07T08:59:46.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.250+0000 7f904b59e700 1 -- 172.21.15.46:0/1286906279 wait complete. 2023-10-07T08:59:46.252 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2023-10-07T08:59:46.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.381+0000 7f124bb40700 1 Processor -- start 2023-10-07T08:59:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.381+0000 7f124bb40700 1 -- start start 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1244159890 0x7f124415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 0x7f124415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f1244069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124415df50 con 0x7f1244159890 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124415a160 con 0x7f1244159c60 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124bb40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12440d13a0 con 0x7f124415db10 2023-10-07T08:59:46.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1244159890 0x7f124415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1244159890 0x7f124415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44788/0 (socket says 172.21.15.46:44788) 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 -- 172.21.15.46:0/766367233 learned_addr learned my addr 172.21.15.46:0/766367233 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f124a0dd700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f1244069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12490db700 1 --2- 172.21.15.46:0/766367233 >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 0x7f124415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 -- 172.21.15.46:0/766367233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 msgr2=0x7f1244069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f1244069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 -- 172.21.15.46:0/766367233 >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 msgr2=0x7f124415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 --2- 172.21.15.46:0/766367233 >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 0x7f124415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 -- 172.21.15.46:0/766367233 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124415e140 con 0x7f1244159890 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12490db700 1 --2- 172.21.15.46:0/766367233 >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 0x7f124415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12498dc700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f124415abd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f12440b67f0 tx=0x7f1234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cb3f59642d2e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12488da700 1 -- 172.21.15.46:0/766367233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400b860 con 0x7f1244159890 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12488da700 1 -- 172.21.15.46:0/766367233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400b9c0 con 0x7f1244159890 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.382+0000 7f12488da700 1 -- 172.21.15.46:0/766367233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400bd60 con 0x7f1244159890 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 -- 172.21.15.46:0/766367233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 msgr2=0x7f124415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f124415abd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f12440b67f0 tx=0x7f1234009250 comp rx=0 tx=0).stop 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 -- 172.21.15.46:0/766367233 shutdown_connections 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f1244069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 --2- 172.21.15.46:0/766367233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f124415abd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 --2- 172.21.15.46:0/766367233 >> v2:172.21.15.133:3300/0 conn(0x7f1244159c60 0x7f124415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 -- 172.21.15.46:0/766367233 >> 172.21.15.46:0/766367233 conn(0x7f1244068e20 msgr2=0x7f12440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 -- 172.21.15.46:0/766367233 shutdown_connections 2023-10-07T08:59:46.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.383+0000 7f124bb40700 1 -- 172.21.15.46:0/766367233 wait complete. 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.384+0000 7f124bb40700 1 Processor -- start 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.384+0000 7f124bb40700 1 -- start start 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1244159c60 0x7f12440ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f12440b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244155890 con 0x7f1244159890 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440ced80 con 0x7f1244159c60 2023-10-07T08:59:46.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124bb40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cf060 con 0x7f124415db10 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44794/0 (socket says 172.21.15.46:44794) 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 -- 172.21.15.46:0/1072604647 learned_addr learned my addr 172.21.15.46:0/1072604647 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12490db700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1244159c60 0x7f12440ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124a0dd700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f12440b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 -- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 msgr2=0x7f12440b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f12440b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 -- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1244159c60 msgr2=0x7f12440ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1244159c60 0x7f12440ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 -- 172.21.15.46:0/1072604647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340094f0 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f124a0dd700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f12440b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.385+0000 7f12498dc700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1234009290 tx=0x7f1234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.386+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234026480 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.386+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123401f070 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.386+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12440cf340 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.386+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234026830 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.386+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1244148740 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.387+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124404c3c0 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.387+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1234026ba0 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.388+0000 7f1241ffb700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 0x7f12300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.388+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f1234021070 con 0x7f1244159890 2023-10-07T08:59:46.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.388+0000 7f12490db700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 0x7f12300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.388+0000 7f12490db700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 0x7f12300693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12440cab40 tx=0x7f1238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.392+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1234053510 con 0x7f1244159890 2023-10-07T08:59:46.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.585+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12440d0e70 con 0x7f1244159890 2023-10-07T08:59:46.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.586+0000 7f1241ffb700 1 -- 172.21.15.46:0/1072604647 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f1234056b30 con 0x7f1244159890 2023-10-07T08:59:46.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:46.587 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:45.565981+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/1068755666":"2023-10-08T08:59:42.559381+0000","172.21.15.133:6835/1068755666":"2023-10-08T08:59:42.559381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 msgr2=0x7f12300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 0x7f12300693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12440cab40 tx=0x7f1238008040 comp rx=0 tx=0).stop 2023-10-07T08:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 msgr2=0x7f1244148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1234009290 tx=0x7f1234017000 comp rx=0 tx=0).stop 2023-10-07T08:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 shutdown_connections 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1230066f30 0x7f12300693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124415db10 0x7f12440b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1244159890 0x7f1244148200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 --2- 172.21.15.46:0/1072604647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1244159c60 0x7f12440ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 >> 172.21.15.46:0/1072604647 conn(0x7f1244068e20 msgr2=0x7f12441584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 shutdown_connections 2023-10-07T08:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.588+0000 7f124bb40700 1 -- 172.21.15.46:0/1072604647 wait complete. 2023-10-07T08:59:46.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:59:20.251974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:59:21.318290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:59:46.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:46.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.722+0000 7f42eeb9a700 1 Processor -- start 2023-10-07T08:59:46.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.722+0000 7f42eeb9a700 1 -- start start 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42eeb9a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42eeb9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42e8069560 0x7f42e80699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42eeb9a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e815a160 con 0x7f42e8159c60 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42eeb9a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e8069f20 con 0x7f42e8069560 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42eeb9a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80d13a0 con 0x7f42e8159890 2023-10-07T08:59:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42e7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f42e8159c60 0x7f42e815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34688/0 (socket says 172.21.15.46:34688) 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42e7fff700 1 -- 172.21.15.46:0/117797866 learned_addr learned my addr 172.21.15.46:0/117797866 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ec936700 1 --2- 172.21.15.46:0/117797866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ed137700 1 --2- 172.21.15.46:0/117797866 >> v2:172.21.15.133:3300/0 conn(0x7f42e8069560 0x7f42e80699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906932343 0 0) 0x7f42e815a160 con 0x7f42e8159c60 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d0003570 con 0x7f42e8159c60 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ec936700 1 -- 172.21.15.46:0/117797866 >> v2:172.21.15.133:3300/0 conn(0x7f42e8069560 msgr2=0x7f42e80699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ec936700 1 --2- 172.21.15.46:0/117797866 >> v2:172.21.15.133:3300/0 conn(0x7f42e8069560 0x7f42e80699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ec936700 1 -- 172.21.15.46:0/117797866 >> v1:172.21.15.46:6789/0 conn(0x7f42e8159c60 legacy=0x7f42e815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103045367 0 0) 0x7f42d0003570 con 0x7f42e8159c60 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.723+0000 7f42ec936700 1 -- 172.21.15.46:0/117797866 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e815e140 con 0x7f42e8159890 2023-10-07T08:59:46.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42ec936700 1 --2- 172.21.15.46:0/117797866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e815abd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42d80098e0 tx=0x7f42d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=244b1cd8ed79c89b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc001470 con 0x7f42e8159890 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8011420 con 0x7f42e8159890 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42e77fe700 1 -- 172.21.15.46:0/117797866 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80117c0 con 0x7f42e8159890 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 -- 172.21.15.46:0/117797866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 msgr2=0x7f42e815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/117797866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e815abd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42d80098e0 tx=0x7f42d80091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 -- 172.21.15.46:0/117797866 shutdown_connections 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/117797866 >> v2:172.21.15.133:3300/0 conn(0x7f42e8069560 0x7f42e80699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/117797866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e815abd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 -- 172.21.15.46:0/117797866 >> 172.21.15.46:0/117797866 conn(0x7f42e8068e20 msgr2=0x7f42e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 -- 172.21.15.46:0/117797866 shutdown_connections 2023-10-07T08:59:46.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.724+0000 7f42eeb9a700 1 -- 172.21.15.46:0/117797866 wait complete. 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.725+0000 7f42eeb9a700 1 Processor -- start 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 -- start start 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e8140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 0x7f42e815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e816aa80 con 0x7f42e8069560 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e81528f0 con 0x7f42e8159c60 2023-10-07T08:59:46.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42eeb9a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80b50c0 con 0x7f42e8159890 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42ec936700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42ec936700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44808/0 (socket says 172.21.15.46:44808) 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.726+0000 7f42ec936700 1 -- 172.21.15.46:0/4207318656 learned_addr learned my addr 172.21.15.46:0/4207318656 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42e7fff700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e8140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ed137700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 0x7f42e815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 -- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 msgr2=0x7f42e8140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e8140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 -- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 msgr2=0x7f42e815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 0x7f42e815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 -- 172.21.15.46:0/4207318656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8009420 con 0x7f42e8069560 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ed137700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 0x7f42e815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42ec936700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42d80030c0 tx=0x7f42d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d801cbe0 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d801cd40 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e80b3b50 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d801a6a0 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.727+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e80b4110 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.728+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e804c3c0 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.728+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42d801aad0 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.729+0000 7f42e4ff9700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 0x7f42d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.729+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f42d8085f30 con 0x7f42e8069560 2023-10-07T08:59:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.729+0000 7f42e7fff700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 0x7f42d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.730+0000 7f42e7fff700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 0x7f42d40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42e815c850 tx=0x7f42dc0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.733+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42d8053150 con 0x7f42e8069560 2023-10-07T08:59:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.925+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42e806a5b0 con 0x7f42e8069560 2023-10-07T08:59:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.925+0000 7f42e4ff9700 1 -- 172.21.15.46:0/4207318656 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42d8056770 con 0x7f42e8069560 2023-10-07T08:59:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:46.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 msgr2=0x7f42d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 0x7f42d40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42e815c850 tx=0x7f42dc0011a0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 msgr2=0x7f42e816a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:46.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42d80030c0 tx=0x7f42d8016000 comp rx=0 tx=0).stop 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 shutdown_connections 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f42d4066f30 0x7f42d40693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e8159c60 0x7f42e815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42e8069560 0x7f42e816a540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 --2- 172.21.15.46:0/4207318656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42e8159890 0x7f42e8140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 >> 172.21.15.46:0/4207318656 conn(0x7f42e8068e20 msgr2=0x7f42e8152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 shutdown_connections 2023-10-07T08:59:46.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:46.927+0000 7f42eeb9a700 1 -- 172.21.15.46:0/4207318656 wait complete. 2023-10-07T08:59:46.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:59:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.062+0000 7f3a768de700 1 Processor -- start 2023-10-07T08:59:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.062+0000 7f3a768de700 1 -- start start 2023-10-07T08:59:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a768de700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a70159c60 0x7f3a7015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a768de700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7015a160 con 0x7f3a70159890 2023-10-07T08:59:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a768de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700d13a0 con 0x7f3a7015db10 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a768de700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7015df50 con 0x7f3a70159c60 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a6f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a70159c60 0x7f3a7015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a6ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3a70159890 0x7f3a7015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34700/0 (socket says 172.21.15.46:34700) 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a6f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a70159c60 0x7f3a7015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44814/0 (socket says 172.21.15.46:44814) 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.063+0000 7f3a6ffff700 1 -- 172.21.15.46:0/2489575186 learned_addr learned my addr 172.21.15.46:0/2489575186 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6f7fe700 1 -- 172.21.15.46:0/2489575186 >> v1:172.21.15.133:6789/0 conn(0x7f3a7015db10 legacy=0x7f3a70069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6f7fe700 1 -- 172.21.15.46:0/2489575186 >> v1:172.21.15.46:6789/0 conn(0x7f3a70159890 legacy=0x7f3a7015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6effd700 1 -- 172.21.15.46:0/2489575186 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296173158 0 0) 0x7f3a7015a160 con 0x7f3a70159890 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6f7fe700 1 -- 172.21.15.46:0/2489575186 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7015e140 con 0x7f3a70159c60 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6f7fe700 1 --2- 172.21.15.46:0/2489575186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a70159c60 0x7f3a7015d5d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a580098e0 tx=0x7f3a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a394ec607e7b26 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6effd700 1 -- 172.21.15.46:0/2489575186 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58009e80 con 0x7f3a70159c60 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6effd700 1 -- 172.21.15.46:0/2489575186 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800b860 con 0x7f3a70159c60 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a6effd700 1 -- 172.21.15.46:0/2489575186 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800bbe0 con 0x7f3a70159c60 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a768de700 1 -- 172.21.15.46:0/2489575186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a70159c60 msgr2=0x7f3a7015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a768de700 1 --2- 172.21.15.46:0/2489575186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a70159c60 0x7f3a7015d5d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a580098e0 tx=0x7f3a580091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a768de700 1 -- 172.21.15.46:0/2489575186 shutdown_connections 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a768de700 1 --2- 172.21.15.46:0/2489575186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a70159c60 0x7f3a7015d5d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.064+0000 7f3a768de700 1 -- 172.21.15.46:0/2489575186 >> 172.21.15.46:0/2489575186 conn(0x7f3a70068e20 msgr2=0x7f3a700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.065+0000 7f3a768de700 1 -- 172.21.15.46:0/2489575186 shutdown_connections 2023-10-07T08:59:47.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.065+0000 7f3a768de700 1 -- 172.21.15.46:0/2489575186 wait complete. 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 Processor -- start 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 -- start start 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a70159890 0x7f3a700b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 0x7f3a700b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700b2090 con 0x7f3a7015db10 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700b64b0 con 0x7f3a70159890 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.066+0000 7f3a768de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700b1480 con 0x7f3a70159c60 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44816/0 (socket says 172.21.15.46:44816) 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 -- 172.21.15.46:0/2651350392 learned_addr learned my addr 172.21.15.46:0/2651350392 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a6ffff700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a70159890 0x7f3a700b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 -- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 msgr2=0x7f3a700b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a6f7fe700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 0x7f3a700b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 0x7f3a700b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 -- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a70159890 msgr2=0x7f3a700b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a70159890 0x7f3a700b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 -- 172.21.15.46:0/2651350392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009420 con 0x7f3a7015db10 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a6f7fe700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 0x7f3a700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a74e7b700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c840 tx=0x7f3a68001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68012630 con 0x7f3a7015db10 2023-10-07T08:59:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a680127b0 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700b1760 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68012b70 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.067+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a700b1d20 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.068+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a700cd100 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.069+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a68003030 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.069+0000 7f3a67fff700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 0x7f3a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.069+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f3a68084540 con 0x7f3a7015db10 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.069+0000 7f3a6ffff700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 0x7f3a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.070+0000 7f3a6ffff700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 0x7f3a500693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a600011e0 tx=0x7f3a60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.073+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a700cd100 con 0x7f3a7015db10 2023-10-07T08:59:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.267+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a700cd100 con 0x7f3a7015db10 2023-10-07T08:59:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.267+0000 7f3a67fff700 1 -- 172.21.15.46:0/2651350392 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a700cd100 con 0x7f3a7015db10 2023-10-07T08:59:47.268 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.269+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 msgr2=0x7f3a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.269+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 0x7f3a500693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a600011e0 tx=0x7f3a60009040 comp rx=0 tx=0).stop 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.269+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 msgr2=0x7f3a700b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.269+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c840 tx=0x7f3a68001670 comp rx=0 tx=0).stop 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 shutdown_connections 2023-10-07T08:59:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a50066f30 0x7f3a500693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a7015db10 0x7f3a700b3ad0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a70159890 0x7f3a700b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 --2- 172.21.15.46:0/2651350392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a70159c60 0x7f3a700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 >> 172.21.15.46:0/2651350392 conn(0x7f3a70068e20 msgr2=0x7f3a70153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 shutdown_connections 2023-10-07T08:59:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.270+0000 7f3a768de700 1 -- 172.21.15.46:0/2651350392 wait complete. 2023-10-07T08:59:47.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:59:47.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.404+0000 7effa2e9f700 1 Processor -- start 2023-10-07T08:59:47.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.404+0000 7effa2e9f700 1 -- start start 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.404+0000 7effa2e9f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff9c159b10 0x7eff9c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa2e9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c06b420 0x7eff9c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa2e9f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0c74b0 con 0x7eff9c15d730 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa2e9f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0c8700 con 0x7eff9c159b10 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa2e9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c9070 con 0x7eff9c06b420 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff9c159b10 0x7eff9c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7eff9c15d730 0x7eff9c159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34712/0 (socket says 172.21.15.46:34712) 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9bfff700 1 -- 172.21.15.46:0/1596814712 learned_addr learned my addr 172.21.15.46:0/1596814712 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:47.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa143c700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c06b420 0x7eff9c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 -- 172.21.15.46:0/1596814712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c06b420 msgr2=0x7eff9c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c06b420 0x7eff9c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 -- 172.21.15.46:0/1596814712 >> v1:172.21.15.46:6789/0 conn(0x7eff9c15d730 legacy=0x7eff9c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 -- 172.21.15.46:0/1596814712 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c15e0e0 con 0x7eff9c159b10 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9b7fe700 1 -- 172.21.15.46:0/1596814712 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733868881 0 0) 0x7eff9c0c74b0 con 0x7eff9c15d730 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7effa0c3b700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c159b10 0x7eff9c0cb3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff840098e0 tx=0x7eff840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9644735df6d4d8da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9b7fe700 1 -- 172.21.15.46:0/1596814712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84009e80 con 0x7eff9c159b10 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9b7fe700 1 -- 172.21.15.46:0/1596814712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400b8f0 con 0x7eff9c159b10 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.405+0000 7eff9b7fe700 1 -- 172.21.15.46:0/1596814712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bc70 con 0x7eff9c159b10 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 -- 172.21.15.46:0/1596814712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c159b10 msgr2=0x7eff9c0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c159b10 0x7eff9c0cb3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff840098e0 tx=0x7eff840091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 -- 172.21.15.46:0/1596814712 shutdown_connections 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c06b420 0x7eff9c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 --2- 172.21.15.46:0/1596814712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c159b10 0x7eff9c0cb3e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 -- 172.21.15.46:0/1596814712 >> 172.21.15.46:0/1596814712 conn(0x7eff9c0c9870 msgr2=0x7eff9c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 -- 172.21.15.46:0/1596814712 shutdown_connections 2023-10-07T08:59:47.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.406+0000 7effa2e9f700 1 -- 172.21.15.46:0/1596814712 wait complete. 2023-10-07T08:59:47.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.407+0000 7effa2e9f700 1 Processor -- start 2023-10-07T08:59:47.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.407+0000 7effa2e9f700 1 -- start start 2023-10-07T08:59:47.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 0x7eff9c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c159b10 0x7eff9c0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c3800 con 0x7eff9c15d730 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c149e30 con 0x7eff9c06b420 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa2e9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c15ad10 con 0x7eff9c159b10 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44832/0 (socket says 172.21.15.46:44832) 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 -- 172.21.15.46:0/2986024406 learned_addr learned my addr 172.21.15.46:0/2986024406 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa0c3b700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 0x7eff9c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7eff9bfff700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c159b10 0x7eff9c0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 -- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c159b10 msgr2=0x7eff9c0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c159b10 0x7eff9c0c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 -- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 msgr2=0x7eff9c1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 0x7eff9c1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 -- 172.21.15.46:0/2986024406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009420 con 0x7eff9c15d730 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa0c3b700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 0x7eff9c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.408+0000 7effa143c700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7eff94009fd0 tx=0x7eff94009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.409+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400eca0 con 0x7eff9c15d730 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.409+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400ee00 con 0x7eff9c15d730 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.409+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c15aff0 con 0x7eff9c15d730 2023-10-07T08:59:47.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.409+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94014670 con 0x7eff9c15d730 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.409+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c15b5b0 con 0x7eff9c15d730 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.410+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c063800 con 0x7eff9c15d730 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.410+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff94014a20 con 0x7eff9c15d730 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.411+0000 7eff98ff9700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.411+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7eff94084bd0 con 0x7eff9c15d730 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.411+0000 7effa0c3b700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.411+0000 7effa0c3b700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff840091e0 tx=0x7eff84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.415+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff94051df0 con 0x7eff9c15d730 2023-10-07T08:59:47.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.606+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff9c04c3c0 con 0x7eff9c15d730 2023-10-07T08:59:47.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.607+0000 7eff98ff9700 1 -- 172.21.15.46:0/2986024406 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff94055410 con 0x7eff9c15d730 2023-10-07T08:59:47.608 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 msgr2=0x7eff7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff840091e0 tx=0x7eff84017000 comp rx=0 tx=0).stop 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 msgr2=0x7eff9c0c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7eff94009fd0 tx=0x7eff94009900 comp rx=0 tx=0).stop 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 shutdown_connections 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff9c15d730 0x7eff9c0c2cf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff9c06b420 0x7eff9c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 --2- 172.21.15.46:0/2986024406 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff9c159b10 0x7eff9c0c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 >> 172.21.15.46:0/2986024406 conn(0x7eff9c0c9870 msgr2=0x7eff9c157660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 shutdown_connections 2023-10-07T08:59:47.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.609+0000 7effa2e9f700 1 -- 172.21.15.46:0/2986024406 wait complete. 2023-10-07T08:59:47.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:47.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.740+0000 7f0651af3700 1 Processor -- start 2023-10-07T08:59:47.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.740+0000 7f0651af3700 1 -- start start 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.740+0000 7f0651af3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f064c0aca80 0x7f064c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.740+0000 7f0651af3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f0651af3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c06bdb0 con 0x7f064c0c81f0 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f0651af3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0c8670 con 0x7f064c0aca80 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f0651af3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0cb370 con 0x7f064c069d60 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f064c0aca80 0x7f064c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f064c0aca80 0x7f064c06aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44838/0 (socket says 172.21.15.46:44838) 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 -- 172.21.15.46:0/2459122372 learned_addr learned my addr 172.21.15.46:0/2459122372 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064affd700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 -- 172.21.15.46:0/2459122372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 msgr2=0x7f064c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 -- 172.21.15.46:0/2459122372 >> v1:172.21.15.133:6789/0 conn(0x7f064c0c81f0 legacy=0x7f064c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 -- 172.21.15.46:0/2459122372 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c159f60 con 0x7f064c0aca80 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064affd700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064b7fe700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0aca80 0x7f064c06aba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f063c009990 tx=0x7f063c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa62eb93df2cb1c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064a7fc700 1 -- 172.21.15.46:0/2459122372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c005c10 con 0x7f064c0aca80 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064a7fc700 1 -- 172.21.15.46:0/2459122372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c005d70 con 0x7f064c0aca80 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.741+0000 7f064a7fc700 1 -- 172.21.15.46:0/2459122372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00b880 con 0x7f064c0aca80 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 -- 172.21.15.46:0/2459122372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0aca80 msgr2=0x7f064c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0aca80 0x7f064c06aba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f063c009990 tx=0x7f063c009220 comp rx=0 tx=0).stop 2023-10-07T08:59:47.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 -- 172.21.15.46:0/2459122372 shutdown_connections 2023-10-07T08:59:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0aca80 0x7f064c06aba0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 --2- 172.21.15.46:0/2459122372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 -- 172.21.15.46:0/2459122372 >> 172.21.15.46:0/2459122372 conn(0x7f064c0cd670 msgr2=0x7f064c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 -- 172.21.15.46:0/2459122372 shutdown_connections 2023-10-07T08:59:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.742+0000 7f0651af3700 1 -- 172.21.15.46:0/2459122372 wait complete. 2023-10-07T08:59:47.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.743+0000 7f0651af3700 1 Processor -- start 2023-10-07T08:59:47.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.743+0000 7f0651af3700 1 -- start start 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c0aca80 0x7f064c0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ad5a0 con 0x7f064c0c81f0 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0acf90 con 0x7f064c0aca80 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f0651af3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ae800 con 0x7f064c069d60 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44848/0 (socket says 172.21.15.46:44848) 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 -- 172.21.15.46:0/1981777586 learned_addr learned my addr 172.21.15.46:0/1981777586 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064affd700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c0aca80 0x7f064c0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 -- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 msgr2=0x7f064c0b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 -- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c0aca80 msgr2=0x7f064c0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c0aca80 0x7f064c0ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.744+0000 7f064bfff700 1 -- 172.21.15.46:0/1981777586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009480 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f064bfff700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f064400c840 tx=0x7f0644001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644012630 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440127b0 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0afa20 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644012b70 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.745+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c0afd00 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.746+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0ad750 con 0x7f064c0c81f0 2023-10-07T08:59:47.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.746+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f064401a3a0 con 0x7f064c0c81f0 2023-10-07T08:59:47.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.747+0000 7f06337fe700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 0x7f06380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:47.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.747+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f06440846b0 con 0x7f064c0c81f0 2023-10-07T08:59:47.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.747+0000 7f064b7fe700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 0x7f06380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:47.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.747+0000 7f064b7fe700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 0x7f06380693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c009260 tx=0x7f063c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:47.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.751+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06440518d0 con 0x7f064c0c81f0 2023-10-07T08:59:47.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.990+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f064c04c3c0 con 0x7f064c0c81f0 2023-10-07T08:59:47.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.991+0000 7f06337fe700 1 -- 172.21.15.46:0/1981777586 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f0644054ef0 con 0x7f064c0c81f0 2023-10-07T08:59:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:47.992 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4045627749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4045627749},{"type":"v1","addr":"172.21.15.133:6837","nonce":4045627749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 msgr2=0x7f06380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 0x7f06380693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c009260 tx=0x7f063c016000 comp rx=0 tx=0).stop 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 msgr2=0x7f064c0aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f064400c840 tx=0x7f0644001670 comp rx=0 tx=0).stop 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 shutdown_connections 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0638066f30 0x7f06380693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f064c0c81f0 0x7f064c0aeeb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f064c069d60 0x7f064c0b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 --2- 172.21.15.46:0/1981777586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c0aca80 0x7f064c0ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 >> 172.21.15.46:0/1981777586 conn(0x7f064c0cd670 msgr2=0x7f064c0c2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 shutdown_connections 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:47.993+0000 7f0651af3700 1 -- 172.21.15.46:0/1981777586 wait complete. 2023-10-07T08:59:47.995 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2023-10-07T08:59:48.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:48.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.123+0000 7f5ec66fc700 1 Processor -- start 2023-10-07T08:59:48.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 -- start start 2023-10-07T08:59:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ec0159c60 0x7f5ec015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 0x7f5ec0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec015a160 con 0x7f5ec0159890 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec015df50 con 0x7f5ec0159c60 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.124+0000 7f5ec66fc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00d13a0 con 0x7f5ec015db10 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ec0159c60 0x7f5ec015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ec0159c60 0x7f5ec015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44858/0 (socket says 172.21.15.46:44858) 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 -- 172.21.15.46:0/4233505844 learned_addr learned my addr 172.21.15.46:0/4233505844 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebffff700 1 --1- 172.21.15.46:0/4233505844 >> v1:172.21.15.46:6789/0 conn(0x7f5ec0159890 0x7f5ec015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34714/0 (socket says 172.21.15.46:34714) 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ec4c99700 1 --2- 172.21.15.46:0/4233505844 >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 0x7f5ec0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 -- 172.21.15.46:0/4233505844 >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 msgr2=0x7f5ec0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 --2- 172.21.15.46:0/4233505844 >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 0x7f5ec0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 -- 172.21.15.46:0/4233505844 >> v1:172.21.15.46:6789/0 conn(0x7f5ec0159890 legacy=0x7f5ec015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 -- 172.21.15.46:0/4233505844 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec015e140 con 0x7f5ec0159c60 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebeffd700 1 -- 172.21.15.46:0/4233505844 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159716266 0 0) 0x7f5ec015a160 con 0x7f5ec0159890 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ec4c99700 1 --2- 172.21.15.46:0/4233505844 >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 0x7f5ec0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebf7fe700 1 --2- 172.21.15.46:0/4233505844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec0159c60 0x7f5ec015d5d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006a890 tx=0x7f5eb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15149aefa33daf01 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebeffd700 1 -- 172.21.15.46:0/4233505844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000b860 con 0x7f5ec0159c60 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebeffd700 1 -- 172.21.15.46:0/4233505844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000b9c0 con 0x7f5ec0159c60 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.125+0000 7f5ebeffd700 1 -- 172.21.15.46:0/4233505844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000bd60 con 0x7f5ec0159c60 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 -- 172.21.15.46:0/4233505844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec0159c60 msgr2=0x7f5ec015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/4233505844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec0159c60 0x7f5ec015d5d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006a890 tx=0x7f5eb0009250 comp rx=0 tx=0).stop 2023-10-07T08:59:48.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 -- 172.21.15.46:0/4233505844 shutdown_connections 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/4233505844 >> v2:172.21.15.133:3300/0 conn(0x7f5ec015db10 0x7f5ec0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/4233505844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec0159c60 0x7f5ec015d5d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 -- 172.21.15.46:0/4233505844 >> 172.21.15.46:0/4233505844 conn(0x7f5ec0068e20 msgr2=0x7f5ec00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 -- 172.21.15.46:0/4233505844 shutdown_connections 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.126+0000 7f5ec66fc700 1 -- 172.21.15.46:0/4233505844 wait complete. 2023-10-07T08:59:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.127+0000 7f5ec66fc700 1 Processor -- start 2023-10-07T08:59:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.127+0000 7f5ec66fc700 1 -- start start 2023-10-07T08:59:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 0x7f5ec016aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 0x7f5ec00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec016d4d0 con 0x7f5ec015db10 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec016e050 con 0x7f5ec0159c60 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec66fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c7f00 con 0x7f5ec0159890 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44866/0 (socket says 172.21.15.46:44866) 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 -- 172.21.15.46:0/3895569559 learned_addr learned my addr 172.21.15.46:0/3895569559 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ebffff700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 0x7f5ec016aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ebf7fe700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 0x7f5ec00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 -- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 msgr2=0x7f5ec016aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 0x7f5ec016aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 -- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 msgr2=0x7f5ec00c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 0x7f5ec00c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 -- 172.21.15.46:0/3895569559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00094f0 con 0x7f5ec015db10 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ebf7fe700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 0x7f5ec00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:48.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ebffff700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 0x7f5ec016aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.128+0000 7f5ec4c99700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009fc0 tx=0x7f5eb80099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800dd40 con 0x7f5ec015db10 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800f040 con 0x7f5ec015db10 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec016d720 con 0x7f5ec015db10 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8015690 con 0x7f5ec015db10 2023-10-07T08:59:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec016dce0 con 0x7f5ec015db10 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.129+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec0064ed0 con 0x7f5ec015db10 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.130+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb801e3b0 con 0x7f5ec015db10 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.130+0000 7f5ea7fff700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.130+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f5eb8084ae0 con 0x7f5ec015db10 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.131+0000 7f5ebffff700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.131+0000 7f5ebffff700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 0x7f5eac0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ec01530c0 tx=0x7f5eb4007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.135+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb8051d00 con 0x7f5ec015db10 2023-10-07T08:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.330+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ec004c3c0 con 0x7f5ec015db10 2023-10-07T08:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.331+0000 7f5ea7fff700 1 -- 172.21.15.46:0/3895569559 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f5eb801a090 con 0x7f5ec015db10 2023-10-07T08:59:48.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:48.332 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:45.565981+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/1068755666":"2023-10-08T08:59:42.559381+0000","172.21.15.133:6835/1068755666":"2023-10-08T08:59:42.559381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 msgr2=0x7f5eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 0x7f5eac0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ec01530c0 tx=0x7f5eb4007cb0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 msgr2=0x7f5ec00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009fc0 tx=0x7f5eb80099b0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 shutdown_connections 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ec015db10 0x7f5ec00b1b70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec0159890 0x7f5ec016aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 --2- 172.21.15.46:0/3895569559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec0159c60 0x7f5ec00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 >> 172.21.15.46:0/3895569559 conn(0x7f5ec0068e20 msgr2=0x7f5ec00cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 shutdown_connections 2023-10-07T08:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.333+0000 7f5ec66fc700 1 -- 172.21.15.46:0/3895569559 wait complete. 2023-10-07T08:59:48.346 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:59:48.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.465+0000 7fed5b019700 1 Processor -- start 2023-10-07T08:59:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.465+0000 7fed5b019700 1 -- start start 2023-10-07T08:59:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed5b019700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed5406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed5b019700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed5406c1e0 0x7fed540cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed5b019700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5406c750 con 0x7fed540cbc10 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed5b019700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5406ca30 con 0x7fed5406c1e0 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed5b019700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5406cd10 con 0x7fed54157940 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed595b6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fed540cbc10 0x7fed5415baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34722/0 (socket says 172.21.15.46:34722) 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed595b6700 1 -- 172.21.15.46:0/2934956994 learned_addr learned my addr 172.21.15.46:0/2934956994 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> v2:172.21.15.133:3300/0 conn(0x7fed5406c1e0 0x7fed540cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed58db5700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed5406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047506900 0 0) 0x7fed5406c750 con 0x7fed540cbc10 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed44003570 con 0x7fed540cbc10 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3806478006 0 0) 0x7fed44003570 con 0x7fed540cbc10 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 msgr2=0x7fed5406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed5406f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 >> v2:172.21.15.133:3300/0 conn(0x7fed5406c1e0 msgr2=0x7fed540cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 --2- 172.21.15.46:0/2934956994 >> v2:172.21.15.133:3300/0 conn(0x7fed5406c1e0 0x7fed540cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5406cff0 con 0x7fed540cbc10 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fed4c0017f0 con 0x7fed540cbc10 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.466+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> v2:172.21.15.133:3300/0 conn(0x7fed5406c1e0 0x7fed540cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 >> v1:172.21.15.46:6789/0 conn(0x7fed540cbc10 legacy=0x7fed5415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed44003a60 0x7fed44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed44004810 0x7fed44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5406ca30 con 0x7fed44004810 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5406cd10 con 0x7fed44003a60 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4400ba60 con 0x7fed54157940 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed44004810 0x7fed44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed58db5700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed44003a60 0x7fed44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed595b6700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 -- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 msgr2=0x7fed440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 -- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed44003a60 msgr2=0x7fed44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed44003a60 0x7fed44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 -- 172.21.15.46:0/2934956994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44003570 con 0x7fed44004810 2023-10-07T08:59:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed595b6700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed54157940 0x7fed440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed53fff700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed44004810 0x7fed44004c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e20 tx=0x7fed400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf5d78ccc5e272d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000e920 con 0x7fed44004810 2023-10-07T08:59:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000ea80 con 0x7fed44004810 2023-10-07T08:59:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.467+0000 7fed537fe700 1 -- 172.21.15.46:0/2934956994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000ee20 con 0x7fed44004810 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 -- 172.21.15.46:0/2934956994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed44004810 msgr2=0x7fed44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 --2- 172.21.15.46:0/2934956994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed44004810 0x7fed44004c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e20 tx=0x7fed400091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed595b6700 1 -- 172.21.15.46:0/2934956994 reap_dead start 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 -- 172.21.15.46:0/2934956994 shutdown_connections 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 -- 172.21.15.46:0/2934956994 >> 172.21.15.46:0/2934956994 conn(0x7fed540cd480 msgr2=0x7fed540cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 -- 172.21.15.46:0/2934956994 shutdown_connections 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.468+0000 7fed5b019700 1 -- 172.21.15.46:0/2934956994 wait complete. 2023-10-07T08:59:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.469+0000 7fed5b019700 1 Processor -- start 2023-10-07T08:59:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.469+0000 7fed5b019700 1 -- start start 2023-10-07T08:59:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed44004810 0x7fed54144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed540c3260 0x7fed540c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c4be0 con 0x7fed540c84a0 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c8e50 con 0x7fed540c3260 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed5b019700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed54145460 con 0x7fed44004810 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44882/0 (socket says 172.21.15.46:44882) 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 -- 172.21.15.46:0/4018502578 learned_addr learned my addr 172.21.15.46:0/4018502578 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed595b6700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed540c3260 0x7fed540c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed58db5700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed44004810 0x7fed54144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 -- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed44004810 msgr2=0x7fed54144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed44004810 0x7fed54144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 -- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed540c3260 msgr2=0x7fed540c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed540c3260 0x7fed540c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 -- 172.21.15.46:0/4018502578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540c3fd0 con 0x7fed540c84a0 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.470+0000 7fed53fff700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fed40006ed0 tx=0x7fed4001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.471+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40022070 con 0x7fed540c84a0 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.471+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed40013b70 con 0x7fed540c84a0 2023-10-07T08:59:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.471+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540c42b0 con 0x7fed540c84a0 2023-10-07T08:59:48.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.471+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4001c450 con 0x7fed540c84a0 2023-10-07T08:59:48.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.471+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540c4870 con 0x7fed540c84a0 2023-10-07T08:59:48.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.472+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5404c3c0 con 0x7fed540c84a0 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.472+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed40026070 con 0x7fed540c84a0 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.472+0000 7fed50ff9700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 0x7fed380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.473+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fed40085d80 con 0x7fed540c84a0 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.473+0000 7fed58db5700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 0x7fed380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.473+0000 7fed58db5700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 0x7fed380693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed5415a9e0 tx=0x7fed480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.477+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed40053060 con 0x7fed540c84a0 2023-10-07T08:59:48.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.716+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed5415b580 con 0x7fed540c84a0 2023-10-07T08:59:48.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.716+0000 7fed50ff9700 1 -- 172.21.15.46:0/4018502578 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fed4002d090 con 0x7fed540c84a0 2023-10-07T08:59:48.717 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:48.718 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4045627749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4045627749},{"type":"v1","addr":"172.21.15.133:6837","nonce":4045627749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:48.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 msgr2=0x7fed380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 0x7fed380693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed5415a9e0 tx=0x7fed480091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 msgr2=0x7fed540c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fed40006ed0 tx=0x7fed4001a000 comp rx=0 tx=0).stop 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 shutdown_connections 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed38066f30 0x7fed380693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed540c3260 0x7fed540c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed44004810 0x7fed54144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 --2- 172.21.15.46:0/4018502578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed540c84a0 0x7fed540c8910 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 >> 172.21.15.46:0/4018502578 conn(0x7fed540cd480 msgr2=0x7fed540b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:48.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 shutdown_connections 2023-10-07T08:59:48.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.718+0000 7fed5b019700 1 -- 172.21.15.46:0/4018502578 wait complete. 2023-10-07T08:59:48.721 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2023-10-07T08:59:48.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:48.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.849+0000 7fa449123700 1 Processor -- start 2023-10-07T08:59:48.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 -- start start 2023-10-07T08:59:48.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44415c480 con 0x7fa4440b5ea0 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440b2a40 con 0x7fa444159c10 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.850+0000 7fa449123700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44415d290 con 0x7fa44415c910 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa442d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa4440b5ea0 0x7fa444068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39408/0 (socket says 172.21.15.46:39408) 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44259c700 1 -- 172.21.15.46:0/1148738645 learned_addr learned my addr 172.21.15.46:0/1148738645 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa442d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:52600/0 (socket says 172.21.15.46:52600) 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa441d9b700 1 -- 172.21.15.46:0/1148738645 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209144190 0 0) 0x7fa44415c480 con 0x7fa4440b5ea0 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa441d9b700 1 -- 172.21.15.46:0/1148738645 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa430003570 con 0x7fa4440b5ea0 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 -- 172.21.15.46:0/1148738645 >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 msgr2=0x7fa44415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 --2- 172.21.15.46:0/1148738645 >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 -- 172.21.15.46:0/1148738645 >> v1:172.21.15.133:6789/0 conn(0x7fa4440b5ea0 legacy=0x7fa444068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 -- 172.21.15.46:0/1148738645 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44415b5d0 con 0x7fa44415c910 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa442d9d700 1 --2- 172.21.15.46:0/1148738645 >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.851+0000 7fa44359e700 1 --2- 172.21.15.46:0/1148738645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44415cd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098e0 tx=0x7fa4340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecfd708331d95418 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa441d9b700 1 -- 172.21.15.46:0/1148738645 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011630 con 0x7fa44415c910 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa441d9b700 1 -- 172.21.15.46:0/1148738645 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434011790 con 0x7fa44415c910 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa441d9b700 1 -- 172.21.15.46:0/1148738645 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011b30 con 0x7fa44415c910 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 -- 172.21.15.46:0/1148738645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 msgr2=0x7fa44415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 --2- 172.21.15.46:0/1148738645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44415cd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098e0 tx=0x7fa4340091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 -- 172.21.15.46:0/1148738645 shutdown_connections 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 --2- 172.21.15.46:0/1148738645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44415cd50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 --2- 172.21.15.46:0/1148738645 >> v2:172.21.15.133:3300/0 conn(0x7fa444159c10 0x7fa44415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 -- 172.21.15.46:0/1148738645 >> 172.21.15.46:0/1148738645 conn(0x7fa444099a20 msgr2=0x7fa4440af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:48.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 -- 172.21.15.46:0/1148738645 shutdown_connections 2023-10-07T08:59:48.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.852+0000 7fa449123700 1 -- 172.21.15.46:0/1148738645 wait complete. 2023-10-07T08:59:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.853+0000 7fa449123700 1 Processor -- start 2023-10-07T08:59:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.853+0000 7fa449123700 1 -- start start 2023-10-07T08:59:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 0x7fa4441567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 0x7fa444168fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44409da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444156d20 con 0x7fa444159c10 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440af090 con 0x7fa4440b5ea0 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa449123700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440af370 con 0x7fa44415c910 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa442d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 0x7fa4441567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa44259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 0x7fa444168fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa442d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 0x7fa4441567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:52610/0 (socket says 172.21.15.46:52610) 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa44359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44409da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa44259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 0x7fa444168fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44892/0 (socket says 172.21.15.46:44892) 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.854+0000 7fa442d9d700 1 -- 172.21.15.46:0/1468607464 learned_addr learned my addr 172.21.15.46:0/1468607464 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 -- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 msgr2=0x7fa4441567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 0x7fa4441567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 -- 172.21.15.46:0/1468607464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 msgr2=0x7fa444168fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 0x7fa444168fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 -- 172.21.15.46:0/1468607464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a20 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa44359e700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44409da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa434016000 tx=0x7fa434017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011b10 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340233f0 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa434009420 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434023770 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.855+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440af930 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.856+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44404c3c0 con 0x7fa44415c910 2023-10-07T08:59:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.857+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa434042bd0 con 0x7fa44415c910 2023-10-07T08:59:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.857+0000 7fa43affd700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 0x7fa4240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.857+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa434085a30 con 0x7fa44415c910 2023-10-07T08:59:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.857+0000 7fa442d9d700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 0x7fa4240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.858+0000 7fa442d9d700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 0x7fa4240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00f800 tx=0x7fa43c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:48.861+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa434052cd0 con 0x7fa44415c910 2023-10-07T08:59:49.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.096+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa44415b870 con 0x7fa44415c910 2023-10-07T08:59:49.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.097+0000 7fa43affd700 1 -- 172.21.15.46:0/1468607464 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fa4340562f0 con 0x7fa44415c910 2023-10-07T08:59:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4045627749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4045627749},{"type":"v1","addr":"172.21.15.133:6837","nonce":4045627749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:59:22.349064+0000","modified":"2023-10-07T08:59:25.961353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6835/2054891740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2054891740},{"type":"v1","addr":"172.21.15.46:6835","nonce":2054891740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 msgr2=0x7fa4240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 0x7fa4240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00f800 tx=0x7fa43c00b040 comp rx=0 tx=0).stop 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 msgr2=0x7fa44409da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44409da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa434016000 tx=0x7fa434017000 comp rx=0 tx=0).stop 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 shutdown_connections 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa424066f30 0x7fa4240693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44415c910 0x7fa44409da40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5ea0 0x7fa4441567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 --2- 172.21.15.46:0/1468607464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa444159c10 0x7fa444168fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 >> 172.21.15.46:0/1468607464 conn(0x7fa444099a20 msgr2=0x7fa44409a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 shutdown_connections 2023-10-07T08:59:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.099+0000 7fa449123700 1 -- 172.21.15.46:0/1468607464 wait complete. 2023-10-07T08:59:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2023-10-07T08:59:49.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:49.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.229+0000 7f641fa8e700 1 Processor -- start 2023-10-07T08:59:49.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.230+0000 7f641fa8e700 1 -- start start 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.230+0000 7f641fa8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64180cbf30 0x7f64180ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.230+0000 7f641fa8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641fa8e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180cc300 con 0x7f641815a270 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641fa8e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418156bf0 con 0x7f64180cbf30 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641fa8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64180ae950 con 0x7f64180ccf90 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641e02b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f641815a270 0x7f64180c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34724/0 (socket says 172.21.15.46:34724) 2023-10-07T08:59:49.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641e02b700 1 -- 172.21.15.46:0/311787702 learned_addr learned my addr 172.21.15.46:0/311787702 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d82a700 1 --2- 172.21.15.46:0/311787702 >> v2:172.21.15.133:3300/0 conn(0x7f64180cbf30 0x7f64180ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 --2- 172.21.15.46:0/311787702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641c828700 1 -- 172.21.15.46:0/311787702 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268320674 0 0) 0x7f64180cc300 con 0x7f641815a270 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641c828700 1 -- 172.21.15.46:0/311787702 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6400003570 con 0x7f641815a270 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 -- 172.21.15.46:0/311787702 >> v2:172.21.15.133:3300/0 conn(0x7f64180cbf30 msgr2=0x7f64180ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 --2- 172.21.15.46:0/311787702 >> v2:172.21.15.133:3300/0 conn(0x7f64180cbf30 0x7f64180ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 -- 172.21.15.46:0/311787702 >> v1:172.21.15.46:6789/0 conn(0x7f641815a270 legacy=0x7f64180c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 -- 172.21.15.46:0/311787702 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180ad370 con 0x7f64180ccf90 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.231+0000 7f641d029700 1 --2- 172.21.15.46:0/311787702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180b0d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098e0 tx=0x7f640c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e1083eb24490ba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641c828700 1 -- 172.21.15.46:0/311787702 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c011630 con 0x7f64180ccf90 2023-10-07T08:59:49.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641c828700 1 -- 172.21.15.46:0/311787702 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c011790 con 0x7f64180ccf90 2023-10-07T08:59:49.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641c828700 1 -- 172.21.15.46:0/311787702 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c011b30 con 0x7f64180ccf90 2023-10-07T08:59:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 -- 172.21.15.46:0/311787702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 msgr2=0x7f64180b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 --2- 172.21.15.46:0/311787702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180b0d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098e0 tx=0x7f640c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 -- 172.21.15.46:0/311787702 shutdown_connections 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 --2- 172.21.15.46:0/311787702 >> v2:172.21.15.133:3300/0 conn(0x7f64180cbf30 0x7f64180ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 --2- 172.21.15.46:0/311787702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180b0d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 -- 172.21.15.46:0/311787702 >> 172.21.15.46:0/311787702 conn(0x7f641806a320 msgr2=0x7f64180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 -- 172.21.15.46:0/311787702 shutdown_connections 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.232+0000 7f641fa8e700 1 -- 172.21.15.46:0/311787702 wait complete. 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.233+0000 7f641fa8e700 1 Processor -- start 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.233+0000 7f641fa8e700 1 -- start start 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64180cbf30 0x7f64181426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c55d0 con 0x7f641815a270 2023-10-07T08:59:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c49c0 con 0x7f64180cbf30 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641fa8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c4ca0 con 0x7f64180ccf90 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44906/0 (socket says 172.21.15.46:44906) 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 -- 172.21.15.46:0/1057693840 learned_addr learned my addr 172.21.15.46:0/1057693840 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641d82a700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64180cbf30 0x7f64181426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641d029700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 -- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 msgr2=0x7f64180c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 -- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64180cbf30 msgr2=0x7f64181426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64180cbf30 0x7f64181426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.234+0000 7f641e02b700 1 -- 172.21.15.46:0/1057693840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c009420 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f641e02b700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6408001460 tx=0x7f6408001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800a950 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800aab0 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180c4f80 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800ae30 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.235+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6418142c20 con 0x7f641815a270 2023-10-07T08:59:49.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.236+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641804c3c0 con 0x7f641815a270 2023-10-07T08:59:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.236+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6408007300 con 0x7f641815a270 2023-10-07T08:59:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.237+0000 7f6415ffb700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.237+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6408084a80 con 0x7f641815a270 2023-10-07T08:59:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.237+0000 7f641d82a700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.237+0000 7f641d82a700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 0x7f64040693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d40 tx=0x7f6410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.241+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6408051c90 con 0x7f641815a270 2023-10-07T08:59:49.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.434+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64180c5710 con 0x7f641815a270 2023-10-07T08:59:49.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.435+0000 7f6415ffb700 1 -- 172.21.15.46:0/1057693840 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f64080552b0 con 0x7f641815a270 2023-10-07T08:59:49.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:49.437 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:45.565981+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:20.251974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:21.318290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/1068755666":"2023-10-08T08:59:42.559381+0000","172.21.15.133:6835/1068755666":"2023-10-08T08:59:42.559381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 msgr2=0x7f64040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 0x7f64040693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d40 tx=0x7f6410008040 comp rx=0 tx=0).stop 2023-10-07T08:59:49.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 msgr2=0x7f64180ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6408001460 tx=0x7f6408001a40 comp rx=0 tx=0).stop 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 shutdown_connections 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f641815a270 0x7f64180ca910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64180cbf30 0x7f64181426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 --2- 172.21.15.46:0/1057693840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64180ccf90 0x7f64180c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 >> 172.21.15.46:0/1057693840 conn(0x7f641806a320 msgr2=0x7f6418155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 shutdown_connections 2023-10-07T08:59:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.437+0000 7f641fa8e700 1 -- 172.21.15.46:0/1057693840 wait complete. 2023-10-07T08:59:49.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:59:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.570+0000 7fee733c7700 1 Processor -- start 2023-10-07T08:59:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.570+0000 7fee733c7700 1 -- start start 2023-10-07T08:59:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee733c7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee6c159420 0x7fee6c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee733c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c1597f0 0x7fee6c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee733c7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0b11d0 con 0x7fee6c15d230 2023-10-07T08:59:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee733c7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0b14b0 con 0x7fee6c159420 2023-10-07T08:59:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee733c7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0b1790 con 0x7fee6c1597f0 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee723c5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee6c159420 0x7fee6c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee72bc6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fee6c15d230 0x7fee6c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34740/0 (socket says 172.21.15.46:34740) 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee72bc6700 1 -- 172.21.15.46:0/2160006066 learned_addr learned my addr 172.21.15.46:0/2160006066 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee71bc4700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c1597f0 0x7fee6c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee723c5700 1 -- 172.21.15.46:0/2160006066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c1597f0 msgr2=0x7fee6c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee723c5700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c1597f0 0x7fee6c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee723c5700 1 -- 172.21.15.46:0/2160006066 >> v1:172.21.15.46:6789/0 conn(0x7fee6c15d230 legacy=0x7fee6c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee723c5700 1 -- 172.21.15.46:0/2160006066 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0b1a70 con 0x7fee6c159420 2023-10-07T08:59:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.571+0000 7fee713c3700 1 -- 172.21.15.46:0/2160006066 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156782887 0 0) 0x7fee6c0b11d0 con 0x7fee6c15d230 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee723c5700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c159420 0x7fee6c0b5f40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee640098e0 tx=0x7fee640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2b93cba73a7a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee713c3700 1 -- 172.21.15.46:0/2160006066 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64009e80 con 0x7fee6c159420 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee713c3700 1 -- 172.21.15.46:0/2160006066 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400b860 con 0x7fee6c159420 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee713c3700 1 -- 172.21.15.46:0/2160006066 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400bbe0 con 0x7fee6c159420 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 -- 172.21.15.46:0/2160006066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c159420 msgr2=0x7fee6c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c159420 0x7fee6c0b5f40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee640098e0 tx=0x7fee640091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 -- 172.21.15.46:0/2160006066 shutdown_connections 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c159420 0x7fee6c0b5f40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 --2- 172.21.15.46:0/2160006066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c1597f0 0x7fee6c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 -- 172.21.15.46:0/2160006066 >> 172.21.15.46:0/2160006066 conn(0x7fee6c0d0660 msgr2=0x7fee6c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 -- 172.21.15.46:0/2160006066 shutdown_connections 2023-10-07T08:59:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.572+0000 7fee733c7700 1 -- 172.21.15.46:0/2160006066 wait complete. 2023-10-07T08:59:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.573+0000 7fee733c7700 1 Processor -- start 2023-10-07T08:59:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 -- start start 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c159420 0x7fee6c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c15d230 0x7fee6c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c14d6e0 con 0x7fee6c1597f0 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c159cf0 con 0x7fee6c159420 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee733c7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c153be0 con 0x7fee6c15d230 2023-10-07T08:59:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee71bc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.574+0000 7fee71bc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44920/0 (socket says 172.21.15.46:44920) 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 -- 172.21.15.46:0/4004373458 learned_addr learned my addr 172.21.15.46:0/4004373458 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 -- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c15d230 msgr2=0x7fee6c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c15d230 0x7fee6c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee723c5700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c159420 0x7fee6c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 -- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c159420 msgr2=0x7fee6c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c159420 0x7fee6c151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 -- 172.21.15.46:0/4004373458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009420 con 0x7fee6c1597f0 2023-10-07T08:59:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee71bc4700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c800 tx=0x7fee60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60011600 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60011760 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c153ec0 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60011b20 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.575+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c154480 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.576+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c159e80 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.577+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee600193f0 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.577+0000 7fee6a7fc700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 0x7fee580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.577+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fee600849b0 con 0x7fee6c1597f0 2023-10-07T08:59:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.577+0000 7fee723c5700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 0x7fee580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.578+0000 7fee723c5700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 0x7fee580693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee64003080 tx=0x7fee64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.581+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee60051bd0 con 0x7fee6c1597f0 2023-10-07T08:59:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.819+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fee6c0b1d50 con 0x7fee6c1597f0 2023-10-07T08:59:49.821 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T08:59:49.819+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:59:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.823+0000 7fee6a7fc700 1 -- 172.21.15.46:0/4004373458 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fee600551f0 con 0x7fee6c1597f0 2023-10-07T08:59:49.826 INFO:tasks.ceph.mds.c.smithi046.stderr: -1274> 2023-10-07T08:59:24.919+0000 7efe0e0e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 msgr2=0x7fee580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 0x7fee580693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee64003080 tx=0x7fee64017000 comp rx=0 tx=0).stop 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 msgr2=0x7fee6c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c800 tx=0x7fee60008040 comp rx=0 tx=0).stop 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 shutdown_connections 2023-10-07T08:59:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee58066f30 0x7fee580693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c15d230 0x7fee6c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c159420 0x7fee6c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 --2- 172.21.15.46:0/4004373458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee6c1597f0 0x7fee6c153500 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 >> 172.21.15.46:0/4004373458 conn(0x7fee6c0d0660 msgr2=0x7fee6c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 shutdown_connections 2023-10-07T08:59:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.825+0000 7fee733c7700 1 -- 172.21.15.46:0/4004373458 wait complete. 2023-10-07T08:59:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:59:49.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:59:49.848 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T08:59:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.959+0000 7fc829fe7700 1 Processor -- start 2023-10-07T08:59:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.959+0000 7fc829fe7700 1 -- start start 2023-10-07T08:59:49.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc829fe7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc824159c60 0x7fc82415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc829fe7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 0x7fc824069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc829fe7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82415a160 con 0x7fc824159890 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc829fe7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82415df50 con 0x7fc824159c60 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc829fe7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240d13a0 con 0x7fc82415db10 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc822ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc824159c60 0x7fc82415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc8237fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc824159890 0x7fc82415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33906/0 (socket says 172.21.15.46:33906) 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc8237fe700 1 -- 172.21.15.46:0/2776811277 learned_addr learned my addr 172.21.15.46:0/2776811277 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc823fff700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 0x7fc824069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc822ffd700 1 -- 172.21.15.46:0/2776811277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 msgr2=0x7fc824069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc822ffd700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 0x7fc824069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc822ffd700 1 -- 172.21.15.46:0/2776811277 >> v1:172.21.15.46:6789/0 conn(0x7fc824159890 legacy=0x7fc82415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc822ffd700 1 -- 172.21.15.46:0/2776811277 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82415e140 con 0x7fc824159c60 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc8227fc700 1 -- 172.21.15.46:0/2776811277 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256365288 0 0) 0x7fc82415a160 con 0x7fc824159890 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.960+0000 7fc823fff700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 0x7fc824069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc822ffd700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc824159c60 0x7fc82415d5d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc8180098e0 tx=0x7fc8180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58af098934b6395 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc8227fc700 1 -- 172.21.15.46:0/2776811277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818009e80 con 0x7fc824159c60 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc8227fc700 1 -- 172.21.15.46:0/2776811277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800b860 con 0x7fc824159c60 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc8227fc700 1 -- 172.21.15.46:0/2776811277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800bbe0 con 0x7fc824159c60 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 -- 172.21.15.46:0/2776811277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc824159c60 msgr2=0x7fc82415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc824159c60 0x7fc82415d5d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc8180098e0 tx=0x7fc8180091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 -- 172.21.15.46:0/2776811277 shutdown_connections 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc82415db10 0x7fc824069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2776811277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc824159c60 0x7fc82415d5d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 -- 172.21.15.46:0/2776811277 >> 172.21.15.46:0/2776811277 conn(0x7fc824068e20 msgr2=0x7fc8240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:49.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 -- 172.21.15.46:0/2776811277 shutdown_connections 2023-10-07T08:59:49.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.961+0000 7fc829fe7700 1 -- 172.21.15.46:0/2776811277 wait complete. 2023-10-07T08:59:49.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 Processor -- start 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 -- start start 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 0x7fc82415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 0x7fc8240b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82415fcd0 con 0x7fc82415db10 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82415f300 con 0x7fc824159890 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc829fe7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240b0ac0 con 0x7fc824159c60 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc823fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc823fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43502/0 (socket says 172.21.15.46:43502) 2023-10-07T08:59:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.963+0000 7fc823fff700 1 -- 172.21.15.46:0/2836242043 learned_addr learned my addr 172.21.15.46:0/2836242043 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc822ffd700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 0x7fc8240b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc8237fe700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 0x7fc82415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 -- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 msgr2=0x7fc8240b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 0x7fc8240b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 -- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 msgr2=0x7fc82415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 0x7fc82415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 -- 172.21.15.46:0/2836242043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818009420 con 0x7fc82415db10 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc822ffd700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 0x7fc8240b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc8237fe700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 0x7fc82415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc823fff700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009fc0 tx=0x7fc81c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00dd40 con 0x7fc82415db10 2023-10-07T08:59:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00f040 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82415e6f0 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c015690 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.964+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82415ecb0 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.965+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82415f470 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.965+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc81c01e3b0 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.966+0000 7fc80b7fe700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 0x7fc8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.966+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fc81c084b10 con 0x7fc82415db10 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.966+0000 7fc8237fe700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 0x7fc8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.967+0000 7fc8237fe700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 0x7fc8100693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc8140011e0 tx=0x7fc814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:49.970+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc81c051cd0 con 0x7fc82415db10 2023-10-07T08:59:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.214+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc82404c3c0 con 0x7fc82415db10 2023-10-07T08:59:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.823+0000 7fc80b7fe700 1 -- 172.21.15.46:0/2836242043 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc81c0552f0 con 0x7fc82415db10 2023-10-07T08:59:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 msgr2=0x7fc8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 0x7fc8100693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc8140011e0 tx=0x7fc814009040 comp rx=0 tx=0).stop 2023-10-07T08:59:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 msgr2=0x7fc824152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009fc0 tx=0x7fc81c0099b0 comp rx=0 tx=0).stop 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 shutdown_connections 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc810066f30 0x7fc8100693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82415db10 0x7fc824152010 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc824159890 0x7fc82415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 --2- 172.21.15.46:0/2836242043 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc824159c60 0x7fc8240b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 >> 172.21.15.46:0/2836242043 conn(0x7fc824068e20 msgr2=0x7fc8241589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 shutdown_connections 2023-10-07T08:59:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:50.826+0000 7fc829fe7700 1 -- 172.21.15.46:0/2836242043 wait complete. 2023-10-07T08:59:50.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:59:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.012+0000 7f505f8c5700 1 Processor -- start 2023-10-07T08:59:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.013+0000 7f505f8c5700 1 -- start start 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.013+0000 7f505f8c5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50580cd910 0x7f50580ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.013+0000 7f505f8c5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580b5b00 con 0x7f50580b55a0 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.013+0000 7f505f8c5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580b5da0 con 0x7f5058159ec0 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.013+0000 7f505f8c5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580b6080 con 0x7f50580cd910 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505de62700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f50580b55a0 0x7f50580ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33912/0 (socket says 172.21.15.46:33912) 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505de62700 1 -- 172.21.15.46:0/1219106630 learned_addr learned my addr 172.21.15.46:0/1219106630 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505ce60700 1 --2- 172.21.15.46:0/1219106630 >> v2:172.21.15.133:3300/0 conn(0x7f50580cd910 0x7f50580ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728040204 0 0) 0x7f50580b5b00 con 0x7f50580b55a0 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5040003570 con 0x7f50580b55a0 2023-10-07T08:59:51.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393600573 0 0) 0x7f5040003570 con 0x7f50580b55a0 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 >> v2:172.21.15.133:3300/0 conn(0x7f50580cd910 msgr2=0x7f50580ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 --2- 172.21.15.46:0/1219106630 >> v2:172.21.15.133:3300/0 conn(0x7f50580cd910 0x7f50580ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 >> v1:172.21.15.133:6789/0 conn(0x7f5058159ec0 legacy=0x7f50580b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580cc100 con 0x7f50580b55a0 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5050001470 con 0x7f50580b55a0 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 >> v1:172.21.15.46:6789/0 conn(0x7f50580b55a0 legacy=0x7f50580ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040003a90 0x7f5040003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 0x7f5040004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5040005210 0x7f504000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580b6080 con 0x7f5040004810 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504000c130 con 0x7f5040003a90 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504000c2c0 con 0x7f5040005210 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505ce60700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 0x7f5040004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505d661700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040003a90 0x7f5040003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.014+0000 7f505de62700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5040005210 0x7f504000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 -- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5040005210 msgr2=0x7f504000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5040005210 0x7f504000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 -- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040003a90 msgr2=0x7f5040003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040003a90 0x7f5040003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 -- 172.21.15.46:0/1219106630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040003570 con 0x7f5040004810 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505de62700 1 -- 172.21.15.46:0/1219106630 reap_dead start 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505ce60700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 0x7f5040004c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f504c009c00 tx=0x7f504c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1a4a7051b3745a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0095b0 con 0x7f5040004810 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00e710 con 0x7f5040004810 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f5057fff700 1 -- 172.21.15.46:0/1219106630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00ead0 con 0x7f5040004810 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505f8c5700 1 -- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 msgr2=0x7f5040004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505f8c5700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 0x7f5040004c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f504c009c00 tx=0x7f504c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505f8c5700 1 -- 172.21.15.46:0/1219106630 shutdown_connections 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505f8c5700 1 --2- 172.21.15.46:0/1219106630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5040004810 0x7f5040004c80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.015+0000 7f505f8c5700 1 -- 172.21.15.46:0/1219106630 >> 172.21.15.46:0/1219106630 conn(0x7f50580999f0 msgr2=0x7f50580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:51.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.016+0000 7f505f8c5700 1 -- 172.21.15.46:0/1219106630 shutdown_connections 2023-10-07T08:59:51.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.016+0000 7f505f8c5700 1 -- 172.21.15.46:0/1219106630 wait complete. 2023-10-07T08:59:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.017+0000 7f505f8c5700 1 Processor -- start 2023-10-07T08:59:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.017+0000 7f505f8c5700 1 -- start start 2023-10-07T08:59:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 0x7f505816a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 0x7f505806a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505816c040 con 0x7f50581676c0 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505816b430 con 0x7f5040004810 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505816b710 con 0x7f505816ac50 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43516/0 (socket says 172.21.15.46:43516) 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 -- 172.21.15.46:0/800531769 learned_addr learned my addr 172.21.15.46:0/800531769 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505ce60700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 0x7f505806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505d661700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 0x7f505816a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 -- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 msgr2=0x7f505806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 0x7f505806a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 -- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 msgr2=0x7f505816a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 0x7f505816a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 -- 172.21.15.46:0/800531769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505816b9f0 con 0x7f50581676c0 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505ce60700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 0x7f505806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505d661700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 0x7f505816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505de62700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f505808ad70 tx=0x7f5050000fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000c600 con 0x7f50581676c0 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505000c780 con 0x7f50581676c0 2023-10-07T08:59:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505816bcd0 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000cb40 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.018+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505806ac70 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.020+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505816c1f0 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.020+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f505001d460 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.020+0000 7f50557fa700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.020+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f5050084480 con 0x7f50581676c0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.020+0000 7f505d661700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.021+0000 7f505d661700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5048001900 tx=0x7f5048001a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.024+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f505816c1f0 con 0x7f50581676c0 2023-10-07T08:59:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.219+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5058063c90 con 0x7f50581676c0 2023-10-07T08:59:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.825+0000 7f50557fa700 1 -- 172.21.15.46:0/800531769 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5050051640 con 0x7f50581676c0 2023-10-07T08:59:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 msgr2=0x7f50440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5048001900 tx=0x7f5048001a70 comp rx=0 tx=0).stop 2023-10-07T08:59:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 msgr2=0x7f505816c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f505808ad70 tx=0x7f5050000fd0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 shutdown_connections 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50581676c0 0x7f505816c4d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5040004810 0x7f505816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 --2- 172.21.15.46:0/800531769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f505816ac50 0x7f505806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 >> 172.21.15.46:0/800531769 conn(0x7f50580999f0 msgr2=0x7f50580b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 shutdown_connections 2023-10-07T08:59:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.828+0000 7f505f8c5700 1 -- 172.21.15.46:0/800531769 wait complete. 2023-10-07T08:59:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:59:51.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:59:51.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 Processor -- start 2023-10-07T08:59:51.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 -- start start 2023-10-07T08:59:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7b4153f50 0x7fb7b40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b406d840 0x7fb7b4069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40b4570 con 0x7fb7b4154320 2023-10-07T08:59:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b415a730 con 0x7fb7b4153f50 2023-10-07T08:59:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.969+0000 7fb7b92a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415aa10 con 0x7fb7b406d840 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7b4153f50 0x7fb7b40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b27fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb7b4154320 0x7fb7b406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33922/0 (socket says 172.21.15.46:33922) 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b27fc700 1 -- 172.21.15.46:0/693074688 learned_addr learned my addr 172.21.15.46:0/693074688 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b37fe700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b406d840 0x7fb7b4069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 -- 172.21.15.46:0/693074688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b406d840 msgr2=0x7fb7b4069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b406d840 0x7fb7b4069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 -- 172.21.15.46:0/693074688 >> v1:172.21.15.46:6789/0 conn(0x7fb7b4154320 legacy=0x7fb7b406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 -- 172.21.15.46:0/693074688 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b415acf0 con 0x7fb7b4153f50 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b2ffd700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4153f50 0x7fb7b40b2000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009e60 tx=0x7fb7a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887ecea9586a8f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b1ffb700 1 -- 172.21.15.46:0/693074688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400e070 con 0x7fb7b4153f50 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b1ffb700 1 -- 172.21.15.46:0/693074688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400bc30 con 0x7fb7b4153f50 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.970+0000 7fb7b1ffb700 1 -- 172.21.15.46:0/693074688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4012430 con 0x7fb7b4153f50 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 -- 172.21.15.46:0/693074688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4153f50 msgr2=0x7fb7b40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4153f50 0x7fb7b40b2000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009e60 tx=0x7fb7a4009780 comp rx=0 tx=0).stop 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 -- 172.21.15.46:0/693074688 shutdown_connections 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b406d840 0x7fb7b4069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/693074688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4153f50 0x7fb7b40b2000 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 -- 172.21.15.46:0/693074688 >> 172.21.15.46:0/693074688 conn(0x7fb7b406baf0 msgr2=0x7fb7b406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 -- 172.21.15.46:0/693074688 shutdown_connections 2023-10-07T08:59:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.971+0000 7fb7b92a3700 1 -- 172.21.15.46:0/693074688 wait complete. 2023-10-07T08:59:51.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.972+0000 7fb7b92a3700 1 Processor -- start 2023-10-07T08:59:51.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.972+0000 7fb7b92a3700 1 -- start start 2023-10-07T08:59:51.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b406d840 0x7fb7b40caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b4153f50 0x7fb7b4154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40cbf00 con 0x7fb7b4154320 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40cb2f0 con 0x7fb7b406d840 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b92a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40cb5d0 con 0x7fb7b4153f50 2023-10-07T08:59:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43526/0 (socket says 172.21.15.46:43526) 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 -- 172.21.15.46:0/2380685222 learned_addr learned my addr 172.21.15.46:0/2380685222 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b27fc700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b4153f50 0x7fb7b4154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b2ffd700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b406d840 0x7fb7b40caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 -- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b4153f50 msgr2=0x7fb7b4154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b4153f50 0x7fb7b4154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 -- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b406d840 msgr2=0x7fb7b40caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b406d840 0x7fb7b40caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 -- 172.21.15.46:0/2380685222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4009a20 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.973+0000 7fb7b37fe700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c880 tx=0x7fb7ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.974+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac011600 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.974+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac011780 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.974+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac011b40 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.974+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40cb8b0 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.974+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b41563a0 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.975+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40cc0b0 con 0x7fb7b4154320 2023-10-07T08:59:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.975+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7ac018360 con 0x7fb7b4154320 2023-10-07T08:59:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.975+0000 7fb7aaffd700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 0x7fb7940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.976+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5439+0+0 (secure 0 0 0) 0x7fb7ac084180 con 0x7fb7b4154320 2023-10-07T08:59:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.976+0000 7fb7b2ffd700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 0x7fb7940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.976+0000 7fb7b2ffd700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 0x7fb7940693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009e60 tx=0x7fb7a4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:51.980+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b40cc0b0 con 0x7fb7b4154320 2023-10-07T08:59:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.173+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7b40718b0 con 0x7fb7b4154320 2023-10-07T08:59:52.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.829+0000 7fb7aaffd700 1 -- 172.21.15.46:0/2380685222 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb7ac051500 con 0x7fb7b4154320 2023-10-07T08:59:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 msgr2=0x7fb7940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 0x7fb7940693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009e60 tx=0x7fb7a4019000 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 msgr2=0x7fb7b4154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c880 tx=0x7fb7ac008040 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 shutdown_connections 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb794066f30 0x7fb7940693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7b4154320 0x7fb7b4154ca0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b406d840 0x7fb7b40caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 --2- 172.21.15.46:0/2380685222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7b4153f50 0x7fb7b4154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.835+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 >> 172.21.15.46:0/2380685222 conn(0x7fb7b406baf0 msgr2=0x7fb7b40c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.840+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 shutdown_connections 2023-10-07T08:59:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.840+0000 7fb7b92a3700 1 -- 172.21.15.46:0/2380685222 wait complete. 2023-10-07T08:59:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T08:59:52.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:59:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.982+0000 7feda4027700 1 Processor -- start 2023-10-07T08:59:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.982+0000 7feda4027700 1 -- start start 2023-10-07T08:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda4027700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed9c15c910 0x7fed9c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda4027700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c15c480 con 0x7fed9c159c10 2023-10-07T08:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda4027700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c15d290 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda4027700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0b2a40 con 0x7fed9c15c910 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda1dc3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fed9c159c10 0x7fed9c15b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33932/0 (socket says 172.21.15.46:33932) 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda1dc3700 1 -- 172.21.15.46:0/858110833 learned_addr learned my addr 172.21.15.46:0/858110833 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda25c4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed9c15c910 0x7fed9c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda25c4700 1 -- 172.21.15.46:0/858110833 >> v1:172.21.15.133:6789/0 conn(0x7fed9c0b5ea0 legacy=0x7fed9c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda25c4700 1 -- 172.21.15.46:0/858110833 >> v1:172.21.15.46:6789/0 conn(0x7fed9c159c10 legacy=0x7fed9c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda0dc1700 1 -- 172.21.15.46:0/858110833 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874852125 0 0) 0x7fed9c15c480 con 0x7fed9c159c10 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.983+0000 7feda25c4700 1 -- 172.21.15.46:0/858110833 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c15b870 con 0x7fed9c15c910 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda25c4700 1 --2- 172.21.15.46:0/858110833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c15c910 0x7fed9c15cd50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed940098e0 tx=0x7fed940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91139a24f78dde0d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda0dc1700 1 -- 172.21.15.46:0/858110833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94009e80 con 0x7fed9c15c910 2023-10-07T08:59:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda0dc1700 1 -- 172.21.15.46:0/858110833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b860 con 0x7fed9c15c910 2023-10-07T08:59:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda0dc1700 1 -- 172.21.15.46:0/858110833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bbe0 con 0x7fed9c15c910 2023-10-07T08:59:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 -- 172.21.15.46:0/858110833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c15c910 msgr2=0x7fed9c15cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 --2- 172.21.15.46:0/858110833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c15c910 0x7fed9c15cd50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed940098e0 tx=0x7fed940091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 -- 172.21.15.46:0/858110833 shutdown_connections 2023-10-07T08:59:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 --2- 172.21.15.46:0/858110833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c15c910 0x7fed9c15cd50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 -- 172.21.15.46:0/858110833 >> 172.21.15.46:0/858110833 conn(0x7fed9c099a20 msgr2=0x7fed9c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 -- 172.21.15.46:0/858110833 shutdown_connections 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.984+0000 7feda4027700 1 -- 172.21.15.46:0/858110833 wait complete. 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.985+0000 7feda4027700 1 Processor -- start 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.985+0000 7feda4027700 1 -- start start 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159c10 0x7fed9c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c15c910 0x7fed9c09cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c154f10 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c15ec10 con 0x7fed9c15c910 2023-10-07T08:59:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda4027700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1533a0 con 0x7fed9c159c10 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda1dc3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda1dc3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43536/0 (socket says 172.21.15.46:43536) 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.986+0000 7feda1dc3700 1 -- 172.21.15.46:0/2392154021 learned_addr learned my addr 172.21.15.46:0/2392154021 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda15c2700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159c10 0x7fed9c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda25c4700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c15c910 0x7fed9c09cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 -- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159c10 msgr2=0x7fed9c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159c10 0x7fed9c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 -- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c15c910 msgr2=0x7fed9c09cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c15c910 0x7fed9c09cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 -- 172.21.15.46:0/2392154021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009420 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda1dc3700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00cd80 tx=0x7fed8c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00ab10 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00ac70 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c154c30 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0070f0 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.987+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c15e8a0 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.988+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c15eef0 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.988+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed8c0074a0 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.989+0000 7fed99ffb700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 0x7fed880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.989+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fed8c084790 con 0x7fed9c0b5ea0 2023-10-07T08:59:52.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.989+0000 7feda15c2700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 0x7fed880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:52.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.990+0000 7feda15c2700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 0x7fed880693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed9c16ce20 tx=0x7fed90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:52.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:52.993+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed8c051d20 con 0x7fed9c0b5ea0 2023-10-07T08:59:53.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.185+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fed9c04c3c0 con 0x7fed9c0b5ea0 2023-10-07T08:59:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.189+0000 7fed99ffb700 1 -- 172.21.15.46:0/2392154021 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed8c055340 con 0x7fed9c0b5ea0 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 msgr2=0x7fed880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 0x7fed880693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed9c16ce20 tx=0x7fed90009040 comp rx=0 tx=0).stop 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 msgr2=0x7fed9c152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00cd80 tx=0x7fed8c001ae0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 shutdown_connections 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fed88066f30 0x7fed880693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c15c910 0x7fed9c09cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed9c0b5ea0 0x7fed9c152e60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 --2- 172.21.15.46:0/2392154021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159c10 0x7fed9c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 >> 172.21.15.46:0/2392154021 conn(0x7fed9c099a20 msgr2=0x7fed9c15b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 shutdown_connections 2023-10-07T08:59:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.191+0000 7feda4027700 1 -- 172.21.15.46:0/2392154021 wait complete. 2023-10-07T08:59:53.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-07T08:59:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.322+0000 7f99429dc700 1 Processor -- start 2023-10-07T08:59:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.322+0000 7f99429dc700 1 -- start start 2023-10-07T08:59:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f99429dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f993c159c10 0x7f993c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f99429dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f99429dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c15c480 con 0x7f993c068bb0 2023-10-07T08:59:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f99429dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c0b2a40 con 0x7f993c159c10 2023-10-07T08:59:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f99429dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c15b5d0 con 0x7f993c0b5ea0 2023-10-07T08:59:53.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f993bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f993c159c10 0x7f993c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f993b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f993bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f993c159c10 0x7f993c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:46878/0 (socket says 172.21.15.46:46878) 2023-10-07T08:59:53.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f993b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39474/0 (socket says 172.21.15.46:39474) 2023-10-07T08:59:53.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f993bfff700 1 -- 172.21.15.46:0/3969835016 learned_addr learned my addr 172.21.15.46:0/3969835016 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.323+0000 7f9940f79700 1 --1- 172.21.15.46:0/3969835016 >> v1:172.21.15.133:6789/0 conn(0x7f993c068bb0 0x7f993c15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:35902/0 (socket says 172.21.15.46:35902) 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993bfff700 1 -- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 msgr2=0x7f993c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993bfff700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993bfff700 1 -- 172.21.15.46:0/3969835016 >> v1:172.21.15.133:6789/0 conn(0x7f993c068bb0 legacy=0x7f993c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993bfff700 1 -- 172.21.15.46:0/3969835016 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c15b870 con 0x7f993c159c10 2023-10-07T08:59:53.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993affd700 1 -- 172.21.15.46:0/3969835016 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699738162 0 0) 0x7f993c15c480 con 0x7f993c068bb0 2023-10-07T08:59:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993b7fe700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993bfff700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c159c10 0x7f993c15b090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f992c0099b0 tx=0x7f992c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fe28129ffc77d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993affd700 1 -- 172.21.15.46:0/3969835016 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c009ea0 con 0x7f993c159c10 2023-10-07T08:59:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993affd700 1 -- 172.21.15.46:0/3969835016 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b860 con 0x7f993c159c10 2023-10-07T08:59:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f993affd700 1 -- 172.21.15.46:0/3969835016 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00bc00 con 0x7f993c159c10 2023-10-07T08:59:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f99429dc700 1 -- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c159c10 msgr2=0x7f993c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.324+0000 7f99429dc700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c159c10 0x7f993c15b090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f992c0099b0 tx=0x7f992c009250 comp rx=0 tx=0).stop 2023-10-07T08:59:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 -- 172.21.15.46:0/3969835016 shutdown_connections 2023-10-07T08:59:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c159c10 0x7f993c15b090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 --2- 172.21.15.46:0/3969835016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 -- 172.21.15.46:0/3969835016 >> 172.21.15.46:0/3969835016 conn(0x7f993c099a20 msgr2=0x7f993c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 -- 172.21.15.46:0/3969835016 shutdown_connections 2023-10-07T08:59:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.325+0000 7f99429dc700 1 -- 172.21.15.46:0/3969835016 wait complete. 2023-10-07T08:59:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.326+0000 7f99429dc700 1 Processor -- start 2023-10-07T08:59:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.326+0000 7f99429dc700 1 -- start start 2023-10-07T08:59:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 0x7f993c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c14e6f0 con 0x7f993c159c10 2023-10-07T08:59:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c14e9d0 con 0x7f993c068bb0 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c14ecb0 con 0x7f993c0b5ea0 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43550/0 (socket says 172.21.15.46:43550) 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 -- 172.21.15.46:0/2564689685 learned_addr learned my addr 172.21.15.46:0/2564689685 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f993bfff700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 0x7f993c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f993b7fe700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 -- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 msgr2=0x7f993c14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 -- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 msgr2=0x7f993c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 0x7f993c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 -- 172.21.15.46:0/2564689685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009420 con 0x7f993c159c10 2023-10-07T08:59:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f993bfff700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 0x7f993c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9940f79700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f993400cd50 tx=0x7f9934001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934005df0 con 0x7f993c159c10 2023-10-07T08:59:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c0094f0 con 0x7f993c159c10 2023-10-07T08:59:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993400a960 con 0x7f993c159c10 2023-10-07T08:59:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.327+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400ad20 con 0x7f993c159c10 2023-10-07T08:59:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.328+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c14f270 con 0x7f993c159c10 2023-10-07T08:59:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.328+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c14f5e0 con 0x7f993c159c10 2023-10-07T08:59:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.329+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9934007300 con 0x7f993c159c10 2023-10-07T08:59:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.329+0000 7f9933fff700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.329+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9934084560 con 0x7f993c159c10 2023-10-07T08:59:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.329+0000 7f993bfff700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.330+0000 7f993bfff700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f992c0099b0 tx=0x7f992c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.333+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99340519d0 con 0x7f993c159c10 2023-10-07T08:59:53.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.604+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f993c04c3c0 con 0x7f993c159c10 2023-10-07T08:59:53.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.830+0000 7f9933fff700 1 -- 172.21.15.46:0/2564689685 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v91) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9934054ff0 con 0x7f993c159c10 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.832+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 msgr2=0x7f991c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.832+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f992c0099b0 tx=0x7f992c017000 comp rx=0 tx=0).stop 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.832+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 msgr2=0x7f993c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f993400cd50 tx=0x7f9934001b10 comp rx=0 tx=0).stop 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 shutdown_connections 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c159c10 0x7f993c0b0370 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c068bb0 0x7f993c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 --2- 172.21.15.46:0/2564689685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f993c0b5ea0 0x7f993c14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 >> 172.21.15.46:0/2564689685 conn(0x7f993c099a20 msgr2=0x7f993c09a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:53.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 shutdown_connections 2023-10-07T08:59:53.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.833+0000 7f99429dc700 1 -- 172.21.15.46:0/2564689685 wait complete. 2023-10-07T08:59:53.847 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-07T08:59:53.847 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-07T08:59:53.847 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T08:59:53.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-07T08:59:53.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.964+0000 7f06556c5700 1 Processor -- start 2023-10-07T08:59:53.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.964+0000 7f06556c5700 1 -- start start 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f06556c5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06500aef50 0x7f0650157af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f06556c5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 0x7f06500afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f06556c5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06500afa60 con 0x7f0650157720 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f06556c5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06500b1cf0 con 0x7f06500aef50 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f06556c5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650158030 con 0x7f065006e8c0 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f064f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06500aef50 0x7f0650157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f064ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0650157720 0x7f06500ae840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33934/0 (socket says 172.21.15.46:33934) 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.965+0000 7f064ffff700 1 -- 172.21.15.46:0/4190443173 learned_addr learned my addr 172.21.15.46:0/4190443173 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064effd700 1 -- 172.21.15.46:0/4190443173 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229317069 0 0) 0x7f06500afa60 con 0x7f0650157720 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064effd700 1 -- 172.21.15.46:0/4190443173 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f063c003570 con 0x7f0650157720 2023-10-07T08:59:53.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f0654ec4700 1 --2- 172.21.15.46:0/4190443173 >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 0x7f06500afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064f7fe700 1 -- 172.21.15.46:0/4190443173 >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 msgr2=0x7f06500afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064f7fe700 1 --2- 172.21.15.46:0/4190443173 >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 0x7f06500afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064f7fe700 1 -- 172.21.15.46:0/4190443173 >> v1:172.21.15.46:6789/0 conn(0x7f0650157720 legacy=0x7f06500ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064f7fe700 1 -- 172.21.15.46:0/4190443173 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650158240 con 0x7f06500aef50 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f0654ec4700 1 --2- 172.21.15.46:0/4190443173 >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 0x7f06500afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064f7fe700 1 --2- 172.21.15.46:0/4190443173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f0650157af0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f065006f170 tx=0x7f06400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60a0ad72275dea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064effd700 1 -- 172.21.15.46:0/4190443173 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640011630 con 0x7f06500aef50 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064effd700 1 -- 172.21.15.46:0/4190443173 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0640011790 con 0x7f06500aef50 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f064effd700 1 -- 172.21.15.46:0/4190443173 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640011b30 con 0x7f06500aef50 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.966+0000 7f06556c5700 1 -- 172.21.15.46:0/4190443173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 msgr2=0x7f0650157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 --2- 172.21.15.46:0/4190443173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f0650157af0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f065006f170 tx=0x7f06400091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 -- 172.21.15.46:0/4190443173 shutdown_connections 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 --2- 172.21.15.46:0/4190443173 >> v2:172.21.15.133:3300/0 conn(0x7f065006e8c0 0x7f06500afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 --2- 172.21.15.46:0/4190443173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f0650157af0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 -- 172.21.15.46:0/4190443173 >> 172.21.15.46:0/4190443173 conn(0x7f065006ddb0 msgr2=0x7f065006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 -- 172.21.15.46:0/4190443173 shutdown_connections 2023-10-07T08:59:53.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.967+0000 7f06556c5700 1 -- 172.21.15.46:0/4190443173 wait complete. 2023-10-07T08:59:53.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.968+0000 7f06556c5700 1 Processor -- start 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.968+0000 7f06556c5700 1 -- start start 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065006e8c0 0x7f0650069980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0650157720 0x7f065014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065006a710 con 0x7f06500aef50 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065006a9b0 con 0x7f0650157720 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065006ac90 con 0x7f065006e8c0 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43560/0 (socket says 172.21.15.46:43560) 2023-10-07T08:59:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 -- 172.21.15.46:0/1305297252 learned_addr learned my addr 172.21.15.46:0/1305297252 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064ffff700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065006e8c0 0x7f0650069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 -- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065006e8c0 msgr2=0x7f0650069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065006e8c0 0x7f0650069980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f0654ec4700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0650157720 0x7f065014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 -- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0650157720 msgr2=0x7f065014c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0650157720 0x7f065014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 -- 172.21.15.46:0/1305297252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009420 con 0x7f06500aef50 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f064f7fe700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0640013000 tx=0x7f0640017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640011b10 con 0x7f06500aef50 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06400253f0 con 0x7f06500aef50 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065006af70 con 0x7f06500aef50 2023-10-07T08:59:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640025790 con 0x7f06500aef50 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.969+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065006b530 con 0x7f06500aef50 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.970+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065006c2e0 con 0x7f06500aef50 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.971+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0640025b80 con 0x7f06500aef50 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.971+0000 7f0647fff700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 0x7f06300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.971+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0640085bd0 con 0x7f06500aef50 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.972+0000 7f064ffff700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 0x7f06300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.972+0000 7f064ffff700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 0x7f06300693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06380058d0 tx=0x7f0638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:53.976+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06400530e0 con 0x7f06500aef50 2023-10-07T08:59:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.253+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f065004c3c0 con 0x7f06500aef50 2023-10-07T08:59:54.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.832+0000 7f0647fff700 1 -- 172.21.15.46:0/1305297252 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v92) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0640056700 con 0x7f06500aef50 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 msgr2=0x7f06300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 0x7f06300693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06380058d0 tx=0x7f0638009040 comp rx=0 tx=0).stop 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 msgr2=0x7f065006a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0640013000 tx=0x7f0640017000 comp rx=0 tx=0).stop 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 shutdown_connections 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0630066f30 0x7f06300693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0650157720 0x7f065014c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065006e8c0 0x7f0650069980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 --2- 172.21.15.46:0/1305297252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06500aef50 0x7f065006a1d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 >> 172.21.15.46:0/1305297252 conn(0x7f065006ddb0 msgr2=0x7f065014f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:54.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 shutdown_connections 2023-10-07T08:59:54.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.835+0000 7f06556c5700 1 -- 172.21.15.46:0/1305297252 wait complete. 2023-10-07T08:59:54.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:59:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.982+0000 7fbb06f67700 1 Processor -- start 2023-10-07T08:59:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.982+0000 7fbb06f67700 1 -- start start 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbb06f67700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb00159c60 0x7fbb0015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbb06f67700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 0x7fbb00069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbb06f67700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0015a160 con 0x7fbb00159890 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbb06f67700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0015df50 con 0x7fbb00159c60 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbb06f67700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000d13a0 con 0x7fbb0015db10 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbafffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb00159c60 0x7fbb0015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbafffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb00159c60 0x7fbb0015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43568/0 (socket says 172.21.15.46:43568) 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.983+0000 7fbafffff700 1 -- 172.21.15.46:0/617466559 learned_addr learned my addr 172.21.15.46:0/617466559 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbb05504700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 0x7fbb00069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbafffff700 1 -- 172.21.15.46:0/617466559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 msgr2=0x7fbb00069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbafffff700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 0x7fbb00069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbafffff700 1 -- 172.21.15.46:0/617466559 >> v1:172.21.15.133:6789/0 conn(0x7fbb00159890 legacy=0x7fbb0015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbafffff700 1 -- 172.21.15.46:0/617466559 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0015e140 con 0x7fbb00159c60 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbb05504700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 0x7fbb00069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbafffff700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159c60 0x7fbb0015d5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40099b0 tx=0x7fbaf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f782039f13856e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbaff7fe700 1 -- 172.21.15.46:0/617466559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400b860 con 0x7fbb00159c60 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbaff7fe700 1 -- 172.21.15.46:0/617466559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400b9c0 con 0x7fbb00159c60 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.984+0000 7fbaff7fe700 1 -- 172.21.15.46:0/617466559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400bd60 con 0x7fbb00159c60 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 -- 172.21.15.46:0/617466559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159c60 msgr2=0x7fbb0015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159c60 0x7fbb0015d5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40099b0 tx=0x7fbaf4009250 comp rx=0 tx=0).stop 2023-10-07T08:59:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 -- 172.21.15.46:0/617466559 shutdown_connections 2023-10-07T08:59:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0015db10 0x7fbb00069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 --2- 172.21.15.46:0/617466559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159c60 0x7fbb0015d5d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 -- 172.21.15.46:0/617466559 >> 172.21.15.46:0/617466559 conn(0x7fbb00068e20 msgr2=0x7fbb000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 -- 172.21.15.46:0/617466559 shutdown_connections 2023-10-07T08:59:54.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.985+0000 7fbb06f67700 1 -- 172.21.15.46:0/617466559 wait complete. 2023-10-07T08:59:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.986+0000 7fbb06f67700 1 Processor -- start 2023-10-07T08:59:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.986+0000 7fbb06f67700 1 -- start start 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 0x7fbb000ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0015db10 0x7fbb00157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b59e0 con 0x7fbb00159890 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b63b0 con 0x7fbb0015db10 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb06f67700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c7e10 con 0x7fbb00159c60 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43584/0 (socket says 172.21.15.46:43584) 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 -- 172.21.15.46:0/982271035 learned_addr learned my addr 172.21.15.46:0/982271035 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbafffff700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 0x7fbb000ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb05504700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0015db10 0x7fbb00157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 -- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 msgr2=0x7fbb000ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 0x7fbb000ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 -- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0015db10 msgr2=0x7fbb00157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0015db10 0x7fbb00157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 -- 172.21.15.46:0/982271035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf40094f0 con 0x7fbb00159890 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbafffff700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 0x7fbb000ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.987+0000 7fbb04d03700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c790 tx=0x7fbaf0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0011590 con 0x7fbb00159890 2023-10-07T08:59:54.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0011710 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb000b50b0 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0011ad0 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb000b5670 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.988+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb000b3120 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.989+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaf001b3b0 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.989+0000 7fbafcff9700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 0x7fbaec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.989+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbaf00837b0 con 0x7fbb00159890 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.990+0000 7fbafffff700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 0x7fbaec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:54.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.990+0000 7fbafffff700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 0x7fbaec0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40099b0 tx=0x7fbaf4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:54.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:54.994+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaf0050cc0 con 0x7fbb00159890 2023-10-07T08:59:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.188+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbb0004c3c0 con 0x7fbb00159890 2023-10-07T08:59:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.192+0000 7fbafcff9700 1 -- 172.21.15.46:0/982271035 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbaf0017020 con 0x7fbb00159890 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 msgr2=0x7fbaec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 0x7fbaec0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40099b0 tx=0x7fbaf4017000 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 msgr2=0x7fbb000b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c790 tx=0x7fbaf0007f40 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 shutdown_connections 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaec066f30 0x7fbaec0693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0015db10 0x7fbb00157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb00159890 0x7fbb000b5e70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 --2- 172.21.15.46:0/982271035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb00159c60 0x7fbb000ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 >> 172.21.15.46:0/982271035 conn(0x7fbb00068e20 msgr2=0x7fbb001532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:55.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 shutdown_connections 2023-10-07T08:59:55.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.194+0000 7fbb06f67700 1 -- 172.21.15.46:0/982271035 wait complete. 2023-10-07T08:59:55.208 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:59:55.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:55.244 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:59:55.287 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:59:55.287 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:59:55.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:59:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.404+0000 7f3832c27700 1 Processor -- start 2023-10-07T08:59:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.404+0000 7f3832c27700 1 -- start start 2023-10-07T08:59:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f382c1599c0 0x7f382c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f382c069aa0 0x7f382c0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c15ab90 0x7f382c0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c06a220 con 0x7f382c069aa0 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c069f40 con 0x7f382c1599c0 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f3832c27700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c15a0b0 con 0x7f382c15ab90 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f382bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f382c069aa0 0x7f382c0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f382bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f382c069aa0 0x7f382c0cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43590/0 (socket says 172.21.15.46:43590) 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.405+0000 7f382bfff700 1 -- 172.21.15.46:0/2215283399 learned_addr learned my addr 172.21.15.46:0/2215283399 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f38309c3700 1 --2- 172.21.15.46:0/2215283399 >> v2:172.21.15.133:3300/0 conn(0x7f382c1599c0 0x7f382c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f38311c4700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c15ab90 0x7f382c0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 -- 172.21.15.46:0/2215283399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c15ab90 msgr2=0x7f382c0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c15ab90 0x7f382c0cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 -- 172.21.15.46:0/2215283399 >> v2:172.21.15.133:3300/0 conn(0x7f382c1599c0 msgr2=0x7f382c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 --2- 172.21.15.46:0/2215283399 >> v2:172.21.15.133:3300/0 conn(0x7f382c1599c0 0x7f382c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 -- 172.21.15.46:0/2215283399 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c15a390 con 0x7f382c069aa0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382bfff700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c069aa0 0x7f382c0cb5f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f381c009f20 tx=0x7f381c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f710e82511b4ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382b7fe700 1 -- 172.21.15.46:0/2215283399 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00e070 con 0x7f382c069aa0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382b7fe700 1 -- 172.21.15.46:0/2215283399 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00ba40 con 0x7f382c069aa0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f382b7fe700 1 -- 172.21.15.46:0/2215283399 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0092e0 con 0x7f382c069aa0 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f3832c27700 1 -- 172.21.15.46:0/2215283399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c069aa0 msgr2=0x7f382c0cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.406+0000 7f3832c27700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c069aa0 0x7f382c0cb5f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f381c009f20 tx=0x7f381c009840 comp rx=0 tx=0).stop 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 -- 172.21.15.46:0/2215283399 shutdown_connections 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c15ab90 0x7f382c0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 --2- 172.21.15.46:0/2215283399 >> v2:172.21.15.133:3300/0 conn(0x7f382c1599c0 0x7f382c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 --2- 172.21.15.46:0/2215283399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c069aa0 0x7f382c0cb5f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 -- 172.21.15.46:0/2215283399 >> 172.21.15.46:0/2215283399 conn(0x7f382c068e10 msgr2=0x7f382c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 -- 172.21.15.46:0/2215283399 shutdown_connections 2023-10-07T08:59:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.407+0000 7f3832c27700 1 -- 172.21.15.46:0/2215283399 wait complete. 2023-10-07T08:59:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.408+0000 7f3832c27700 1 Processor -- start 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.408+0000 7f3832c27700 1 -- start start 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c069aa0 0x7f382c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 0x7f382c145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c15d2a0 con 0x7f382c15ab90 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b2db0 con 0x7f382c069aa0 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c15c690 con 0x7f382c1599c0 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43592/0 (socket says 172.21.15.46:43592) 2023-10-07T08:59:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 -- 172.21.15.46:0/1881687106 learned_addr learned my addr 172.21.15.46:0/1881687106 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f382bfff700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 0x7f382c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38309c3700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c069aa0 0x7f382c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 -- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 msgr2=0x7f382c145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 0x7f382c145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 -- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c069aa0 msgr2=0x7f382c0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c069aa0 0x7f382c0b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 -- 172.21.15.46:0/1881687106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009ae0 con 0x7f382c15ab90 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f382bfff700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 0x7f382c145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f38311c4700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f382400c880 tx=0x7f3824008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824011600 con 0x7f382c15ab90 2023-10-07T08:59:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824011760 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c15c970 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824011b00 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.409+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c15cf30 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.410+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c064550 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.411+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3824018360 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.411+0000 7f3828ff9700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.411+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3824083f40 con 0x7f382c15ab90 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.411+0000 7f38309c3700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.412+0000 7f38309c3700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 0x7f380c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f381400ab30 tx=0x7f3814008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.415+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3824054ee0 con 0x7f382c15ab90 2023-10-07T08:59:55.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.650+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f382c04c3c0 con 0x7f382c15ab90 2023-10-07T08:59:55.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.651+0000 7f3828ff9700 1 -- 172.21.15.46:0/1881687106 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f382401e090 con 0x7f382c15ab90 2023-10-07T08:59:55.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:55.653 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4813,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3493325924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3493325924},{"type":"v1","addr":"172.21.15.46:6834","nonce":3493325924}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340729156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2340729156},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340729156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4045627749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4045627749},{"type":"v1","addr":"172.21.15.133:6837","nonce":4045627749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2412958069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2412958069},{"type":"v1","addr":"172.21.15.46:6835","nonce":2412958069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 msgr2=0x7f380c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 0x7f380c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f381400ab30 tx=0x7f3814008040 comp rx=0 tx=0).stop 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 msgr2=0x7f382c0b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f382400c880 tx=0x7f3824008040 comp rx=0 tx=0).stop 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 shutdown_connections 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382c15ab90 0x7f382c0b1540 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c069aa0 0x7f382c0b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 --2- 172.21.15.46:0/1881687106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f382c1599c0 0x7f382c145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 >> 172.21.15.46:0/1881687106 conn(0x7f382c068e10 msgr2=0x7f382c153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:55.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 shutdown_connections 2023-10-07T08:59:55.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.653+0000 7f3832c27700 1 -- 172.21.15.46:0/1881687106 wait complete. 2023-10-07T08:59:55.656 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2023-10-07T08:59:55.667 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:59:55.667 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:59:55.668 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:59:55.668 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:55.668 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:59:55.668 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:59:55.668 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:59:55.668 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:55.668 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:59:55.669 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:59:55.669 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:59:55.669 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:55.669 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:59:55.669 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:59:55.669 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:59:55.669 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:59:55.676 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:59:55.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:59:55.678 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:59:55.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:59:55.684 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:59:55.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:59:55.684 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:59:55.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:59:55.719 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:59:55.719 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:55.720 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:59:55.720 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:55.726 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:59:55.726 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:55.727 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:59:55.727 DEBUG:teuthology.parallel:result is None 2023-10-07T08:59:55.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:59:55.795 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T08:59:55.796 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T08:59:55.805 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T08:59:55.805 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T08:59:55.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.853+0000 7fcb662bb700 1 Processor -- start 2023-10-07T08:59:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.853+0000 7fcb662bb700 1 -- start start 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.853+0000 7fcb662bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb60159b10 0x7fcb600cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.853+0000 7fcb662bb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb6006b420 0x7fcb6015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb662bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600c74b0 con 0x7fcb6015d730 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb662bb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600c8700 con 0x7fcb6006b420 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb662bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c9070 con 0x7fcb60159b10 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb6006b420 0x7fcb6015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcb6015d730 0x7fcb60159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33940/0 (socket says 172.21.15.46:33940) 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5f7fe700 1 -- 172.21.15.46:0/2926479840 learned_addr learned my addr 172.21.15.46:0/2926479840 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5ffff700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb60159b10 0x7fcb600cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 -- 172.21.15.46:0/2926479840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb60159b10 msgr2=0x7fcb600cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb60159b10 0x7fcb600cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 -- 172.21.15.46:0/2926479840 >> v1:172.21.15.46:6789/0 conn(0x7fcb6015d730 legacy=0x7fcb60159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 -- 172.21.15.46:0/2926479840 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6015e0e0 con 0x7fcb6006b420 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb64858700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb6015dba0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009e60 tx=0x7fcb58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b851d0d5a586aa1e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5effd700 1 -- 172.21.15.46:0/2926479840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800e070 con 0x7fcb6006b420 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5effd700 1 -- 172.21.15.46:0/2926479840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800bcc0 con 0x7fcb6006b420 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.854+0000 7fcb5effd700 1 -- 172.21.15.46:0/2926479840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58012680 con 0x7fcb6006b420 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 -- 172.21.15.46:0/2926479840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 msgr2=0x7fcb6015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb6015dba0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009e60 tx=0x7fcb58009780 comp rx=0 tx=0).stop 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 -- 172.21.15.46:0/2926479840 shutdown_connections 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb6015dba0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 --2- 172.21.15.46:0/2926479840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb60159b10 0x7fcb600cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 -- 172.21.15.46:0/2926479840 >> 172.21.15.46:0/2926479840 conn(0x7fcb600c9870 msgr2=0x7fcb600c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 -- 172.21.15.46:0/2926479840 shutdown_connections 2023-10-07T08:59:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.855+0000 7fcb662bb700 1 -- 172.21.15.46:0/2926479840 wait complete. 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.856+0000 7fcb662bb700 1 Processor -- start 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.856+0000 7fcb662bb700 1 -- start start 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb60159b10 0x7fcb600c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb6015d730 0x7fcb600b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c4f50 con 0x7fcb6006b420 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c4340 con 0x7fcb60159b10 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb662bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c4620 con 0x7fcb6015d730 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43632/0 (socket says 172.21.15.46:43632) 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 -- 172.21.15.46:0/1079332954 learned_addr learned my addr 172.21.15.46:0/1079332954 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5f7fe700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb60159b10 0x7fcb600c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb64858700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb6015d730 0x7fcb600b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 -- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb6015d730 msgr2=0x7fcb600b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb6015d730 0x7fcb600b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 -- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb60159b10 msgr2=0x7fcb600c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb60159b10 0x7fcb600c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 -- 172.21.15.46:0/1079332954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009a20 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb5ffff700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000d890 tx=0x7fcb50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.857+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500125f0 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.858+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50012750 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.858+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50012af0 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.858+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600c4900 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.858+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb601414d0 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.858+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6004c3c0 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.859+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb5001e460 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.859+0000 7fcb47fff700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.859+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcb50084800 con 0x7fcb6006b420 2023-10-07T08:59:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.860+0000 7fcb5f7fe700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:55.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.860+0000 7fcb5f7fe700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb600c6ed0 tx=0x7fcb54000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:55.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:55.864+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb50051d10 con 0x7fcb6006b420 2023-10-07T08:59:56.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.075+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcb601567e0 con 0x7fcb6006b420 2023-10-07T08:59:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.842+0000 7fcb47fff700 1 -- 172.21.15.46:0/1079332954 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcb50055330 con 0x7fcb6006b420 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 msgr2=0x7fcb4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb600c6ed0 tx=0x7fcb54000bc0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 msgr2=0x7fcb60140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000d890 tx=0x7fcb50008040 comp rx=0 tx=0).stop 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 shutdown_connections 2023-10-07T08:59:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb6015d730 0x7fcb600b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6006b420 0x7fcb60140f90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 --2- 172.21.15.46:0/1079332954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb60159b10 0x7fcb600c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 >> 172.21.15.46:0/1079332954 conn(0x7fcb600c9870 msgr2=0x7fcb60068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 shutdown_connections 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.845+0000 7fcb662bb700 1 -- 172.21.15.46:0/1079332954 wait complete. 2023-10-07T08:59:56.848 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T08:59:56.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:59:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.984+0000 7f3154ce1700 1 Processor -- start 2023-10-07T08:59:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.984+0000 7f3154ce1700 1 -- start start 2023-10-07T08:59:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f3154ce1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3150069560 0x7f31500699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f3154ce1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3150069ee0 con 0x7f3150159c60 2023-10-07T08:59:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f3154ce1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315015a160 con 0x7f3150159890 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f3154ce1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31500d13a0 con 0x7f3150069560 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f314dd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3150159c60 0x7f315015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33946/0 (socket says 172.21.15.46:33946) 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f314dd9b700 1 -- 172.21.15.46:0/3750137552 learned_addr learned my addr 172.21.15.46:0/3750137552 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f314ed9d700 1 --2- 172.21.15.46:0/3750137552 >> v2:172.21.15.133:3300/0 conn(0x7f3150069560 0x7f31500699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.985+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911548810 0 0) 0x7f3150069ee0 con 0x7f3150159c60 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3138003570 con 0x7f3150159c60 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132448268 0 0) 0x7f315015a160 con 0x7f3150159890 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3150069ee0 con 0x7f3150159890 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314ed9d700 1 -- 172.21.15.46:0/3750137552 >> v1:172.21.15.133:6789/0 conn(0x7f3150159890 legacy=0x7f315015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314ed9d700 1 -- 172.21.15.46:0/3750137552 >> v1:172.21.15.46:6789/0 conn(0x7f3150159c60 legacy=0x7f315015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314ed9d700 1 -- 172.21.15.46:0/3750137552 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315015e140 con 0x7f3150069560 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314ed9d700 1 --2- 172.21.15.46:0/3750137552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150069560 0x7f31500699a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3148009e60 tx=0x7f3148009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=693c89f366192f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800e070 con 0x7f3150069560 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800bab0 con 0x7f3150069560 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.986+0000 7f314d59a700 1 -- 172.21.15.46:0/3750137552 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800be70 con 0x7f3150069560 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 -- 172.21.15.46:0/3750137552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150069560 msgr2=0x7f31500699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 --2- 172.21.15.46:0/3750137552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150069560 0x7f31500699a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3148009e60 tx=0x7f3148009780 comp rx=0 tx=0).stop 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 -- 172.21.15.46:0/3750137552 shutdown_connections 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 --2- 172.21.15.46:0/3750137552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150069560 0x7f31500699a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 -- 172.21.15.46:0/3750137552 >> 172.21.15.46:0/3750137552 conn(0x7f3150068e20 msgr2=0x7f31500d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 -- 172.21.15.46:0/3750137552 shutdown_connections 2023-10-07T08:59:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.987+0000 7f3154ce1700 1 -- 172.21.15.46:0/3750137552 wait complete. 2023-10-07T08:59:56.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 Processor -- start 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 -- start start 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3150069560 0x7f31501524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 0x7f31500cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500cd260 con 0x7f3150159890 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500cd540 con 0x7f3150159c60 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.988+0000 7f3154ce1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31500cd820 con 0x7f3150069560 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43646/0 (socket says 172.21.15.46:43646) 2023-10-07T08:59:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 -- 172.21.15.46:0/2073214910 learned_addr learned my addr 172.21.15.46:0/2073214910 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314ed9d700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 0x7f31500cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314e59c700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3150069560 0x7f31501524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 -- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3150069560 msgr2=0x7f31501524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3150069560 0x7f31501524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 -- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 msgr2=0x7f31500cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 0x7f31500cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 -- 172.21.15.46:0/2073214910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148009a20 con 0x7f3150159890 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314ed9d700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 0x7f31500cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f314dd9b700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f314400c790 tx=0x7f3144007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144005b30 con 0x7f3150159890 2023-10-07T08:59:56.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144005c90 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31500cdb00 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31440072e0 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.989+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31500ce000 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.990+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31500ce220 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.991+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3144007690 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.991+0000 7f313e7fc700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.991+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3144083640 con 0x7f3150159890 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.991+0000 7f314e59c700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:56.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.992+0000 7f314e59c700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31400027d0 tx=0x7f3140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:56.995+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f314404b5a0 con 0x7f3150159890 2023-10-07T08:59:57.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.264+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f31500cd3a0 con 0x7f3150159890 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.264+0000 7f313e7fc700 1 -- 172.21.15.46:0/2073214910 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f31500cd3a0 con 0x7f3150159890 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.266 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:57.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T08:59:57.270 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.271 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T08:59:57.273 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.274 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.275 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:57.276 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.277 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.278 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.279 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:57.280 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T08:59:57.281 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 msgr2=0x7f31300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31400027d0 tx=0x7f3140009040 comp rx=0 tx=0).stop 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 msgr2=0x7f31500ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f314400c790 tx=0x7f3144007ea0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 shutdown_connections 2023-10-07T08:59:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3150159c60 0x7f31500cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3150069560 0x7f31501524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 --2- 172.21.15.46:0/2073214910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3150159890 0x7f31500ce530 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 >> 172.21.15.46:0/2073214910 conn(0x7f3150068e20 msgr2=0x7f31500b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 shutdown_connections 2023-10-07T08:59:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.266+0000 7f3154ce1700 1 -- 172.21.15.46:0/2073214910 wait complete. 2023-10-07T08:59:57.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:59:57.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 Processor -- start 2023-10-07T08:59:57.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 -- start start 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e006bcd0 0x7ff1e00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 0x7ff1e015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e015d7e0 con 0x7ff1e006c0a0 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e015dac0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.401+0000 7ff1e71ca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e015aa30 con 0x7ff1e015df50 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e006bcd0 0x7ff1e00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e006bcd0 0x7ff1e00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43650/0 (socket says 172.21.15.46:43650) 2023-10-07T08:59:57.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1674283451 learned_addr learned my addr 172.21.15.46:0/1674283451 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e5767700 1 --2- 172.21.15.46:0/1674283451 >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 0x7ff1e015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1674283451 >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 msgr2=0x7ff1e015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 --2- 172.21.15.46:0/1674283451 >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 0x7ff1e015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1674283451 >> v1:172.21.15.133:6789/0 conn(0x7ff1e006c0a0 legacy=0x7ff1e015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1674283451 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e015ad10 con 0x7ff1e006bcd0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e5767700 1 --2- 172.21.15.46:0/1674283451 >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 0x7ff1e015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1e4f66700 1 --2- 172.21.15.46:0/1674283451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00caa90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff1e015d720 tx=0x7ff1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e2a144ba0afb0c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1df7fe700 1 -- 172.21.15.46:0/1674283451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000b820 con 0x7ff1e006bcd0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1df7fe700 1 -- 172.21.15.46:0/1674283451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000b980 con 0x7ff1e006bcd0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.402+0000 7ff1df7fe700 1 -- 172.21.15.46:0/1674283451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000bd40 con 0x7ff1e006bcd0 2023-10-07T08:59:57.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1674283451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 msgr2=0x7ff1e00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1674283451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00caa90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff1e015d720 tx=0x7ff1d0009250 comp rx=0 tx=0).stop 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1674283451 shutdown_connections 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1674283451 >> v2:172.21.15.133:3300/0 conn(0x7ff1e015df50 0x7ff1e015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1674283451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00caa90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1674283451 >> 172.21.15.46:0/1674283451 conn(0x7ff1e00ce600 msgr2=0x7ff1e00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1674283451 shutdown_connections 2023-10-07T08:59:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.403+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1674283451 wait complete. 2023-10-07T08:59:57.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.404+0000 7ff1e71ca700 1 Processor -- start 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.404+0000 7ff1e71ca700 1 -- start start 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 0x7ff1e0167670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 0x7ff1e00c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e016a5e0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00c62f0 con 0x7ff1e006c0a0 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e71ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e016a880 con 0x7ff1e015df50 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43664/0 (socket says 172.21.15.46:43664) 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1369191709 learned_addr learned my addr 172.21.15.46:0/1369191709 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e5767700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 0x7ff1e00c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1dffff700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 0x7ff1e0167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 msgr2=0x7ff1e00c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 0x7ff1e00c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 msgr2=0x7ff1e0167670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 0x7ff1e0167670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e4f66700 1 -- 172.21.15.46:0/1369191709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00094f0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1e5767700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 0x7ff1e00c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.405+0000 7ff1dffff700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 0x7ff1e0167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1e4f66700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0069220 tx=0x7ff1d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0006ab0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0020070 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e016ab60 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d001b450 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.406+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e00c65d0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.407+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e016ad70 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.407+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1d0022030 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.407+0000 7ff1dcff9700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.407+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff1d0085fe0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.408+0000 7ff1dffff700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.408+0000 7ff1dffff700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 0x7ff1cc0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4006fd0 tx=0x7ff1d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.412+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d00535a0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.605+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e016ad70 con 0x7ff1e006bcd0 2023-10-07T08:59:57.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.606+0000 7ff1dcff9700 1 -- 172.21.15.46:0/1369191709 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+12134 (secure 0 0 0) 0x7ff1d00092d0 con 0x7ff1e006bcd0 2023-10-07T08:59:57.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:57.608 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":48,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T08:59:56.841694+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 msgr2=0x7ff1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 0x7ff1cc0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4006fd0 tx=0x7ff1d4008040 comp rx=0 tx=0).stop 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 msgr2=0x7ff1e00c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0069220 tx=0x7ff1d0016000 comp rx=0 tx=0).stop 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 shutdown_connections 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e015df50 0x7ff1e00c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e006bcd0 0x7ff1e00c8660 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 --2- 172.21.15.46:0/1369191709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006c0a0 0x7ff1e0167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 >> 172.21.15.46:0/1369191709 conn(0x7ff1e00ce600 msgr2=0x7ff1e0159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 shutdown_connections 2023-10-07T08:59:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.608+0000 7ff1e71ca700 1 -- 172.21.15.46:0/1369191709 wait complete. 2023-10-07T08:59:57.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:59:57.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:59:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.742+0000 7f83d759e700 1 Processor -- start 2023-10-07T08:59:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.742+0000 7f83d759e700 1 -- start start 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83d80b4e70 0x7f83d80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b16d0 0x7f83d80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d759e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80b2080 con 0x7f83d815d240 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80cfb00 con 0x7f83d80b4e70 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80b5c40 con 0x7f83d80b16d0 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83d80b4e70 0x7f83d80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d6d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f83d815d240 0x7f83d815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33962/0 (socket says 172.21.15.46:33962) 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d6d9d700 1 -- 172.21.15.46:0/975554277 learned_addr learned my addr 172.21.15.46:0/975554277 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d5d9b700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b16d0 0x7f83d80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.743+0000 7f83d659c700 1 -- 172.21.15.46:0/975554277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b16d0 msgr2=0x7f83d80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d659c700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b16d0 0x7f83d80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d659c700 1 -- 172.21.15.46:0/975554277 >> v1:172.21.15.46:6789/0 conn(0x7f83d815d240 legacy=0x7f83d815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d659c700 1 -- 172.21.15.46:0/975554277 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80b5f20 con 0x7f83d80b4e70 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d559a700 1 -- 172.21.15.46:0/975554277 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983633531 0 0) 0x7f83d80b2080 con 0x7f83d815d240 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d659c700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d80b4e70 0x7f83d80ccff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e60 tx=0x7f83c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9774da049359b9b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d559a700 1 -- 172.21.15.46:0/975554277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800e070 con 0x7f83d80b4e70 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d559a700 1 -- 172.21.15.46:0/975554277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800bc30 con 0x7f83d80b4e70 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d559a700 1 -- 172.21.15.46:0/975554277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8012430 con 0x7f83d80b4e70 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d759e700 1 -- 172.21.15.46:0/975554277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d80b4e70 msgr2=0x7f83d80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d759e700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d80b4e70 0x7f83d80ccff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e60 tx=0x7f83c8009780 comp rx=0 tx=0).stop 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.744+0000 7f83d759e700 1 -- 172.21.15.46:0/975554277 shutdown_connections 2023-10-07T08:59:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.745+0000 7f83d759e700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d80b4e70 0x7f83d80ccff0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.745+0000 7f83d759e700 1 --2- 172.21.15.46:0/975554277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b16d0 0x7f83d80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.745+0000 7f83d759e700 1 -- 172.21.15.46:0/975554277 >> 172.21.15.46:0/975554277 conn(0x7f83d80d10c0 msgr2=0x7f83d80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:57.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.745+0000 7f83d759e700 1 -- 172.21.15.46:0/975554277 shutdown_connections 2023-10-07T08:59:57.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.745+0000 7f83d759e700 1 -- 172.21.15.46:0/975554277 wait complete. 2023-10-07T08:59:57.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 Processor -- start 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 -- start start 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d80b16d0 0x7f83d80a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b4e70 0x7f83d80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80c9690 con 0x7f83d815d240 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80af8f0 con 0x7f83d80b16d0 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80c98e0 con 0x7f83d80b4e70 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.746+0000 7f83d6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43688/0 (socket says 172.21.15.46:43688) 2023-10-07T08:59:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 -- 172.21.15.46:0/505248093 learned_addr learned my addr 172.21.15.46:0/505248093 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d659c700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d80b16d0 0x7f83d80a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d5d9b700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b4e70 0x7f83d80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 -- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b4e70 msgr2=0x7f83d80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b4e70 0x7f83d80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 -- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d80b16d0 msgr2=0x7f83d80a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d80b16d0 0x7f83d80a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 -- 172.21.15.46:0/505248093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009a20 con 0x7f83d815d240 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d6d9d700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c530 tx=0x7f83d0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0005b30 con 0x7f83d815d240 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0005c90 con 0x7f83d815d240 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d80c9bc0 con 0x7f83d815d240 2023-10-07T08:59:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0007320 con 0x7f83d815d240 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.747+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d80ca180 con 0x7f83d815d240 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.748+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8088990 con 0x7f83d815d240 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.749+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83d001b3b0 con 0x7f83d815d240 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.749+0000 7f83ce7fc700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.749+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f83d0083600 con 0x7f83d815d240 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.749+0000 7f83d659c700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.750+0000 7f83d659c700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 0x7f83b80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e60 tx=0x7f83c8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.753+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83d0050bc0 con 0x7f83d815d240 2023-10-07T08:59:57.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.944+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83d804bb80 con 0x7f83d815d240 2023-10-07T08:59:57.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.944+0000 7f83ce7fc700 1 -- 172.21.15.46:0/505248093 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83d00541e0 con 0x7f83d815d240 2023-10-07T08:59:57.946 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T08:59:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 msgr2=0x7f83b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 0x7f83b80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e60 tx=0x7f83c8019000 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 msgr2=0x7f83d81698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c530 tx=0x7f83d0007f90 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 shutdown_connections 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83d815d240 0x7f83d81698e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d80b16d0 0x7f83d80a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 --2- 172.21.15.46:0/505248093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d80b4e70 0x7f83d80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 >> 172.21.15.46:0/505248093 conn(0x7f83d80d10c0 msgr2=0x7f83d8159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 shutdown_connections 2023-10-07T08:59:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:57.946+0000 7f83d759e700 1 -- 172.21.15.46:0/505248093 wait complete. 2023-10-07T08:59:57.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:59:58.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.077+0000 7f5732685700 1 Processor -- start 2023-10-07T08:59:58.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.077+0000 7f5732685700 1 -- start start 2023-10-07T08:59:58.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5732685700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f572c159420 0x7f572c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5732685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5732685700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0b11d0 con 0x7f572c15d230 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5732685700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0b14b0 con 0x7f572c159420 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5732685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b1790 con 0x7f572c1597f0 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5730e82700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5731683700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f572c159420 0x7f572c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5731e84700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f572c15d230 0x7f572c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:35944/0 (socket says 172.21.15.46:35944) 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5730e82700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39614/0 (socket says 172.21.15.46:39614) 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.078+0000 7f5731e84700 1 -- 172.21.15.46:0/3879990699 learned_addr learned my addr 172.21.15.46:0/3879990699 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:58.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5731683700 1 -- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 msgr2=0x7f572c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5731683700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5731683700 1 -- 172.21.15.46:0/3879990699 >> v1:172.21.15.133:6789/0 conn(0x7f572c15d230 legacy=0x7f572c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5731683700 1 -- 172.21.15.46:0/3879990699 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0b1a70 con 0x7f572c159420 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5730e82700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5731683700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c0b5f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57280098e0 tx=0x7f57280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1abc38be8b723fa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5723fff700 1 -- 172.21.15.46:0/3879990699 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800b640 con 0x7f572c159420 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5723fff700 1 -- 172.21.15.46:0/3879990699 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800b7a0 con 0x7f572c159420 2023-10-07T08:59:58.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5723fff700 1 -- 172.21.15.46:0/3879990699 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800bb40 con 0x7f572c159420 2023-10-07T08:59:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5732685700 1 -- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 msgr2=0x7f572c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.079+0000 7f5732685700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c0b5f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57280098e0 tx=0x7f57280091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 -- 172.21.15.46:0/3879990699 shutdown_connections 2023-10-07T08:59:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c0b5f40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 --2- 172.21.15.46:0/3879990699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c1597f0 0x7f572c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 -- 172.21.15.46:0/3879990699 >> 172.21.15.46:0/3879990699 conn(0x7f572c0d0660 msgr2=0x7f572c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 -- 172.21.15.46:0/3879990699 shutdown_connections 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.080+0000 7f5732685700 1 -- 172.21.15.46:0/3879990699 wait complete. 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.081+0000 7f5732685700 1 Processor -- start 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.081+0000 7f5732685700 1 -- start start 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c15d230 0x7f572c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16dfb0 con 0x7f572c1597f0 2023-10-07T08:59:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16d3e0 con 0x7f572c159420 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5732685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16d680 con 0x7f572c15d230 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43696/0 (socket says 172.21.15.46:43696) 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 -- 172.21.15.46:0/2452301842 learned_addr learned my addr 172.21.15.46:0/2452301842 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5731683700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5731e84700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c15d230 0x7f572c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 -- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c15d230 msgr2=0x7f572c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c15d230 0x7f572c156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 -- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 msgr2=0x7f572c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 -- 172.21.15.46:0/2452301842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c009420 con 0x7f572c1597f0 2023-10-07T08:59:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5731683700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f5730e82700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f571c00ec80 tx=0x7f571c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00c9d0 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00cb30 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.082+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00ceb0 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.083+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728009420 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.083+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c16dc40 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.083+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c04c3c0 con 0x7f572c1597f0 2023-10-07T08:59:58.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.084+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f571c013680 con 0x7f572c1597f0 2023-10-07T08:59:58.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.084+0000 7f57217fa700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 0x7f57100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.084+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f571c084700 con 0x7f572c1597f0 2023-10-07T08:59:58.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.084+0000 7f5731683700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 0x7f57100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.085+0000 7f5731683700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 0x7f57100693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f57280093f0 tx=0x7f5728017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.088+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f571c051cc0 con 0x7f572c1597f0 2023-10-07T08:59:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.284+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f572c16e0f0 con 0x7f572c1597f0 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.285+0000 7f57217fa700 1 -- 172.21.15.46:0/2452301842 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7f571c0552e0 con 0x7f572c1597f0 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T08:59:58.287 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 msgr2=0x7f57100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 0x7f57100693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f57280093f0 tx=0x7f5728017000 comp rx=0 tx=0).stop 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 msgr2=0x7f572c0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f571c00ec80 tx=0x7f571c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 shutdown_connections 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5710066f30 0x7f57100693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f572c15d230 0x7f572c156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f572c159420 0x7f572c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 --2- 172.21.15.46:0/2452301842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f572c1597f0 0x7f572c0cf680 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 >> 172.21.15.46:0/2452301842 conn(0x7f572c0d0660 msgr2=0x7f572c15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 shutdown_connections 2023-10-07T08:59:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.287+0000 7f5732685700 1 -- 172.21.15.46:0/2452301842 wait complete. 2023-10-07T08:59:58.302 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:59:58.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:59:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 Processor -- start 2023-10-07T08:59:58.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 -- start start 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efd88155360 0x7efd880b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 0x7efd880cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8815c320 con 0x7efd880b40f0 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd880b4590 con 0x7efd88155360 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.423+0000 7efd8e986700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8815b710 con 0x7efd880ced30 2023-10-07T08:59:58.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efd88155360 0x7efd880b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd877fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efd880b40f0 0x7efd880ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33968/0 (socket says 172.21.15.46:33968) 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd877fe700 1 -- 172.21.15.46:0/1308688489 learned_addr learned my addr 172.21.15.46:0/1308688489 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd8cf23700 1 --2- 172.21.15.46:0/1308688489 >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 0x7efd880cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 -- 172.21.15.46:0/1308688489 >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 msgr2=0x7efd880cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 --2- 172.21.15.46:0/1308688489 >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 0x7efd880cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 -- 172.21.15.46:0/1308688489 >> v1:172.21.15.46:6789/0 conn(0x7efd880b40f0 legacy=0x7efd880ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd86ffd700 1 -- 172.21.15.46:0/1308688489 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908839613 0 0) 0x7efd8815c320 con 0x7efd880b40f0 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 -- 172.21.15.46:0/1308688489 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8815b9f0 con 0x7efd88155360 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd8cf23700 1 --2- 172.21.15.46:0/1308688489 >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 0x7efd880cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd87fff700 1 --2- 172.21.15.46:0/1308688489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd88155360 0x7efd880b3bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd8806f720 tx=0x7efd700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0f41a97f041e93 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd86ffd700 1 -- 172.21.15.46:0/1308688489 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000b6b0 con 0x7efd88155360 2023-10-07T08:59:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd86ffd700 1 -- 172.21.15.46:0/1308688489 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000b810 con 0x7efd88155360 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.424+0000 7efd86ffd700 1 -- 172.21.15.46:0/1308688489 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000bbb0 con 0x7efd88155360 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 -- 172.21.15.46:0/1308688489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd88155360 msgr2=0x7efd880b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 --2- 172.21.15.46:0/1308688489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd88155360 0x7efd880b3bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd8806f720 tx=0x7efd700091a0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 -- 172.21.15.46:0/1308688489 shutdown_connections 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 --2- 172.21.15.46:0/1308688489 >> v2:172.21.15.133:3300/0 conn(0x7efd880ced30 0x7efd880cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 --2- 172.21.15.46:0/1308688489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd88155360 0x7efd880b3bb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 -- 172.21.15.46:0/1308688489 >> 172.21.15.46:0/1308688489 conn(0x7efd8806baf0 msgr2=0x7efd8806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 -- 172.21.15.46:0/1308688489 shutdown_connections 2023-10-07T08:59:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.425+0000 7efd8e986700 1 -- 172.21.15.46:0/1308688489 wait complete. 2023-10-07T08:59:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.426+0000 7efd8e986700 1 Processor -- start 2023-10-07T08:59:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.426+0000 7efd8e986700 1 -- start start 2023-10-07T08:59:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd880b40f0 0x7efd88153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd88155360 0x7efd88156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c54e0 con 0x7efd880ced30 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880adee0 con 0x7efd880b40f0 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd88169600 con 0x7efd88155360 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43722/0 (socket says 172.21.15.46:43722) 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 -- 172.21.15.46:0/1548405695 learned_addr learned my addr 172.21.15.46:0/1548405695 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 -- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd88155360 msgr2=0x7efd88156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd88155360 0x7efd88156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 -- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd880b40f0 msgr2=0x7efd88153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd880b40f0 0x7efd88153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 -- 172.21.15.46:0/1548405695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009420 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd877fe700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c7e0 tx=0x7efd78007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78005b30 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78005c90 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd88168a10 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.427+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78007300 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.428+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88169030 con 0x7efd880ced30 2023-10-07T08:59:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.428+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd880718b0 con 0x7efd880ced30 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.429+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd7801b400 con 0x7efd880ced30 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.429+0000 7efd7ffff700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.429+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efd78083cf0 con 0x7efd880ced30 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.430+0000 7efd87fff700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.430+0000 7efd87fff700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efd700091e0 tx=0x7efd70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.434+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd78088070 con 0x7efd880ced30 2023-10-07T08:59:58.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.626+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efd88169770 con 0x7efd880ced30 2023-10-07T08:59:58.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.854+0000 7efd7ffff700 1 -- 172.21.15.46:0/1548405695 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7efd78054dc0 con 0x7efd880ced30 2023-10-07T08:59:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.857+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 msgr2=0x7efd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.857+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efd700091e0 tx=0x7efd70017000 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.857+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 msgr2=0x7efd88156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.857+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c7e0 tx=0x7efd78007df0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 shutdown_connections 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd88155360 0x7efd88156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd880b40f0 0x7efd88153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 --2- 172.21.15.46:0/1548405695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd880ced30 0x7efd88156700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 >> 172.21.15.46:0/1548405695 conn(0x7efd8806baf0 msgr2=0x7efd88159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:58.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 shutdown_connections 2023-10-07T08:59:58.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.858+0000 7efd8e986700 1 -- 172.21.15.46:0/1548405695 wait complete. 2023-10-07T08:59:58.861 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T08:59:58.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:59:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.996+0000 7fd05fac8700 1 Processor -- start 2023-10-07T08:59:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.996+0000 7fd05fac8700 1 -- start start 2023-10-07T08:59:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd058159950 0x7fd0580cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0580af320 0x7fd058069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058069aa0 0x7fd05815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd058069f20 con 0x7fd058159950 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580ce380 con 0x7fd0580af320 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05fac8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580cec20 con 0x7fd058069aa0 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd058159950 0x7fd0580cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd058159950 0x7fd0580cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43732/0 (socket says 172.21.15.46:43732) 2023-10-07T08:59:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 -- 172.21.15.46:0/839596793 learned_addr learned my addr 172.21.15.46:0/839596793 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d063700 1 --2- 172.21.15.46:0/839596793 >> v2:172.21.15.133:3300/0 conn(0x7fd0580af320 0x7fd058069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05e065700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058069aa0 0x7fd05815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 -- 172.21.15.46:0/839596793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058069aa0 msgr2=0x7fd05815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058069aa0 0x7fd05815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 -- 172.21.15.46:0/839596793 >> v2:172.21.15.133:3300/0 conn(0x7fd0580af320 msgr2=0x7fd058069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 --2- 172.21.15.46:0/839596793 >> v2:172.21.15.133:3300/0 conn(0x7fd0580af320 0x7fd058069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 -- 172.21.15.46:0/839596793 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580afa90 con 0x7fd058159950 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05d864700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd058159950 0x7fd0580cbb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd05815d450 tx=0x7fd048009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3d9566f94444b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.997+0000 7fd05c862700 1 -- 172.21.15.46:0/839596793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800e070 con 0x7fd058159950 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05c862700 1 -- 172.21.15.46:0/839596793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04800ba50 con 0x7fd058159950 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05c862700 1 -- 172.21.15.46:0/839596793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0480092e0 con 0x7fd058159950 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 -- 172.21.15.46:0/839596793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd058159950 msgr2=0x7fd0580cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd058159950 0x7fd0580cbb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd05815d450 tx=0x7fd048009840 comp rx=0 tx=0).stop 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 -- 172.21.15.46:0/839596793 shutdown_connections 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058069aa0 0x7fd05815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 --2- 172.21.15.46:0/839596793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd058159950 0x7fd0580cbb90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 --2- 172.21.15.46:0/839596793 >> v2:172.21.15.133:3300/0 conn(0x7fd0580af320 0x7fd058069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 -- 172.21.15.46:0/839596793 >> 172.21.15.46:0/839596793 conn(0x7fd058068e00 msgr2=0x7fd0580d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 -- 172.21.15.46:0/839596793 shutdown_connections 2023-10-07T08:59:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.998+0000 7fd05fac8700 1 -- 172.21.15.46:0/839596793 wait complete. 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.999+0000 7fd05fac8700 1 Processor -- start 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:58.999+0000 7fd05fac8700 1 -- start start 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd058069aa0 0x7fd05815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 0x7fd0581698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05816b180 con 0x7fd0580af320 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05815c2f0 con 0x7fd058069aa0 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05fac8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05815c5d0 con 0x7fd058159950 2023-10-07T08:59:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43736/0 (socket says 172.21.15.46:43736) 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 -- 172.21.15.46:0/3073375934 learned_addr learned my addr 172.21.15.46:0/3073375934 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d864700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd058069aa0 0x7fd05815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05e065700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 0x7fd0581698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 -- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 msgr2=0x7fd0581698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 0x7fd0581698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 -- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd058069aa0 msgr2=0x7fd05815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd058069aa0 0x7fd05815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05d063700 1 -- 172.21.15.46:0/3073375934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048009ae0 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.000+0000 7fd05e065700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 0x7fd0581698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd05d063700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00d890 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0125f0 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c012750 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05815c8b0 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c012ad0 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.001+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05815ce70 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.002+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05815d060 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.002+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd04c01e460 con 0x7fd0580af320 2023-10-07T08:59:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.003+0000 7fd055ffb700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:59:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.003+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd04c084970 con 0x7fd0580af320 2023-10-07T08:59:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.003+0000 7fd05d864700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:59:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.004+0000 7fd05d864700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd0580c6570 tx=0x7fd048018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:59:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.007+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd04c051dc0 con 0x7fd0580af320 2023-10-07T08:59:59.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.200+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0580718b0 con 0x7fd0580af320 2023-10-07T08:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.858+0000 7fd055ffb700 1 -- 172.21.15.46:0/3073375934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd04c0553e0 con 0x7fd0580af320 2023-10-07T08:59:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.863+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 msgr2=0x7fd0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.863+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd0580c6570 tx=0x7fd048018000 comp rx=0 tx=0).stop 2023-10-07T08:59:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.863+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 msgr2=0x7fd05816ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:59:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.863+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00d890 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 shutdown_connections 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd058159950 0x7fd0581698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd058069aa0 0x7fd05815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 --2- 172.21.15.46:0/3073375934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0580af320 0x7fd05816ac40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:59:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.865+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 >> 172.21.15.46:0/3073375934 conn(0x7fd058068e00 msgr2=0x7fd0581532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:59:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.867+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 shutdown_connections 2023-10-07T08:59:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T08:59:59.867+0000 7fd05fac8700 1 -- 172.21.15.46:0/3073375934 wait complete. 2023-10-07T08:59:59.871 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T08:59:59.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:00:00.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 Processor -- start 2023-10-07T09:00:00.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 -- start start 2023-10-07T09:00:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd50c159890 0x7fd50c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c069ee0 con 0x7fd50c159c60 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c15a160 con 0x7fd50c159890 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.015+0000 7fd512be2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0d13a0 con 0x7fd50c069560 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51117f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51097e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd50c159890 0x7fd50c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51117f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:53494/0 (socket says 172.21.15.46:53494) 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51117f700 1 -- 172.21.15.46:0/3329843294 learned_addr learned my addr 172.21.15.46:0/3329843294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd50bfff700 1 --1- 172.21.15.46:0/3329843294 >> v1:172.21.15.133:6789/0 conn(0x7fd50c159c60 0x7fd50c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33932/0 (socket says 172.21.15.46:33932) 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51097e700 1 -- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 msgr2=0x7fd50c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51097e700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51097e700 1 -- 172.21.15.46:0/3329843294 >> v1:172.21.15.133:6789/0 conn(0x7fd50c159c60 legacy=0x7fd50c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd50b7fe700 1 -- 172.21.15.46:0/3329843294 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430781083 0 0) 0x7fd50c069ee0 con 0x7fd50c159c60 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51097e700 1 -- 172.21.15.46:0/3329843294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c15e140 con 0x7fd50c159890 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.016+0000 7fd51117f700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd51097e700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159890 0x7fd50c15abd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0098e0 tx=0x7fd4fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e655079a17a1f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd50b7fe700 1 -- 172.21.15.46:0/3329843294 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00b640 con 0x7fd50c159890 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd50b7fe700 1 -- 172.21.15.46:0/3329843294 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00b7a0 con 0x7fd50c159890 2023-10-07T09:00:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd50b7fe700 1 -- 172.21.15.46:0/3329843294 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00bb40 con 0x7fd50c159890 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 -- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159890 msgr2=0x7fd50c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159890 0x7fd50c15abd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0098e0 tx=0x7fd4fc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 -- 172.21.15.46:0/3329843294 shutdown_connections 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 --2- 172.21.15.46:0/3329843294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159890 0x7fd50c15abd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 -- 172.21.15.46:0/3329843294 >> 172.21.15.46:0/3329843294 conn(0x7fd50c068e20 msgr2=0x7fd50c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 -- 172.21.15.46:0/3329843294 shutdown_connections 2023-10-07T09:00:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.017+0000 7fd512be2700 1 -- 172.21.15.46:0/3329843294 wait complete. 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.018+0000 7fd512be2700 1 Processor -- start 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 -- start start 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159c60 0x7fd50c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c15d6c0 con 0x7fd50c159890 2023-10-07T09:00:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c16a6a0 con 0x7fd50c159c60 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd512be2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c15cf50 con 0x7fd50c069560 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd50bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd50bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56792/0 (socket says 172.21.15.46:56792) 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd50bfff700 1 -- 172.21.15.46:0/1525104687 learned_addr learned my addr 172.21.15.46:0/1525104687 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd51097e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.019+0000 7fd51117f700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159c60 0x7fd50c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 -- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 msgr2=0x7fd50c1525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c1525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 -- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159c60 msgr2=0x7fd50c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159c60 0x7fd50c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 -- 172.21.15.46:0/1525104687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009ae0 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd50bfff700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c7e0 tx=0x7fd4f4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4005a70 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4005bd0 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc009420 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40070d0 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.020+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c16a8f0 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.021+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c15d3e0 con 0x7fd50c159890 2023-10-07T09:00:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.022+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4f4007440 con 0x7fd50c159890 2023-10-07T09:00:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.022+0000 7fd508ff9700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 0x7fd4ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.022+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd4f40838b0 con 0x7fd50c159890 2023-10-07T09:00:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.022+0000 7fd51097e700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 0x7fd4ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.023+0000 7fd51097e700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 0x7fd4ec0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0091e0 tx=0x7fd4fc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.027+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd50c15d3e0 con 0x7fd50c159890 2023-10-07T09:00:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.263+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd50c15d3e0 con 0x7fd50c159890 2023-10-07T09:00:00.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.884+0000 7fd508ff9700 1 -- 172.21.15.46:0/1525104687 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd50c15d3e0 con 0x7fd50c159890 2023-10-07T09:00:00.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.888+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 msgr2=0x7fd4ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.888+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 0x7fd4ec0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0091e0 tx=0x7fd4fc017000 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.888+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 msgr2=0x7fd50c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.888+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c7e0 tx=0x7fd4f4007e10 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 shutdown_connections 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4ec066f30 0x7fd4ec0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c159c60 0x7fd50c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd50c069560 0x7fd50c1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 --2- 172.21.15.46:0/1525104687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd50c159890 0x7fd50c154f60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 >> 172.21.15.46:0/1525104687 conn(0x7fd50c068e20 msgr2=0x7fd50c0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:00.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.889+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 shutdown_connections 2023-10-07T09:00:00.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:00.890+0000 7fd512be2700 1 -- 172.21.15.46:0/1525104687 wait complete. 2023-10-07T09:00:00.897 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 8 and data pool 9 2023-10-07T09:00:00.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.027+0000 7f16d0b87700 1 Processor -- start 2023-10-07T09:00:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.027+0000 7f16d0b87700 1 -- start start 2023-10-07T09:00:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.028+0000 7f16d0b87700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16cc159890 0x7f16cc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.028+0000 7f16d0b87700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16cc069560 0x7f16cc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.028+0000 7f16d0b87700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc069ee0 con 0x7f16cc159c60 2023-10-07T09:00:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.028+0000 7f16d0b87700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc15a160 con 0x7f16cc069560 2023-10-07T09:00:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.028+0000 7f16d0b87700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc0d13a0 con 0x7f16cc159890 2023-10-07T09:00:01.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16cc069560 0x7f16cc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16cc069560 0x7f16cc0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56808/0 (socket says 172.21.15.46:56808) 2023-10-07T09:00:01.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 -- 172.21.15.46:0/1921318977 learned_addr learned my addr 172.21.15.46:0/1921318977 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:01.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16ca59c700 1 --2- 172.21.15.46:0/1921318977 >> v2:172.21.15.133:3300/0 conn(0x7f16cc159890 0x7f16cc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 -- 172.21.15.46:0/1921318977 >> v2:172.21.15.133:3300/0 conn(0x7f16cc159890 msgr2=0x7f16cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 --2- 172.21.15.46:0/1921318977 >> v2:172.21.15.133:3300/0 conn(0x7f16cc159890 0x7f16cc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 -- 172.21.15.46:0/1921318977 >> v1:172.21.15.133:6789/0 conn(0x7f16cc159c60 legacy=0x7f16cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 -- 172.21.15.46:0/1921318977 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc15e140 con 0x7f16cc069560 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16cad9d700 1 --2- 172.21.15.46:0/1921318977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc069560 0x7f16cc0699a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0d1090 tx=0x7f16c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e5393f94916863 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16c959a700 1 -- 172.21.15.46:0/1921318977 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400e070 con 0x7f16cc069560 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16c959a700 1 -- 172.21.15.46:0/1921318977 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400ba50 con 0x7f16cc069560 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.029+0000 7f16c959a700 1 -- 172.21.15.46:0/1921318977 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40092e0 con 0x7f16cc069560 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 -- 172.21.15.46:0/1921318977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc069560 msgr2=0x7f16cc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 --2- 172.21.15.46:0/1921318977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc069560 0x7f16cc0699a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0d1090 tx=0x7f16c4009840 comp rx=0 tx=0).stop 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 -- 172.21.15.46:0/1921318977 shutdown_connections 2023-10-07T09:00:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 --2- 172.21.15.46:0/1921318977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc069560 0x7f16cc0699a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 --2- 172.21.15.46:0/1921318977 >> v2:172.21.15.133:3300/0 conn(0x7f16cc159890 0x7f16cc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 -- 172.21.15.46:0/1921318977 >> 172.21.15.46:0/1921318977 conn(0x7f16cc068e20 msgr2=0x7f16cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:01.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 -- 172.21.15.46:0/1921318977 shutdown_connections 2023-10-07T09:00:01.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.030+0000 7f16d0b87700 1 -- 172.21.15.46:0/1921318977 wait complete. 2023-10-07T09:00:01.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.031+0000 7f16d0b87700 1 Processor -- start 2023-10-07T09:00:01.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.031+0000 7f16d0b87700 1 -- start start 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16cc069560 0x7f16cc1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16cc159890 0x7f16cc0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0ce4a0 con 0x7f16cc159c60 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0b4430 con 0x7f16cc159890 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16d0b87700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0b4710 con 0x7f16cc069560 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56814/0 (socket says 172.21.15.46:56814) 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 -- 172.21.15.46:0/2312930364 learned_addr learned my addr 172.21.15.46:0/2312930364 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16c9d9b700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16cc159890 0x7f16cc0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16ca59c700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16cc069560 0x7f16cc1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 -- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16cc069560 msgr2=0x7f16cc1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16cc069560 0x7f16cc1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 -- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16cc159890 msgr2=0x7f16cc0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16cc159890 0x7f16cc0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.032+0000 7f16cad9d700 1 -- 172.21.15.46:0/2312930364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4009ae0 con 0x7f16cc159c60 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16cad9d700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f16cc070e20 tx=0x7f16c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400be60 con 0x7f16cc159c60 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4008d20 con 0x7f16cc159c60 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40266b0 con 0x7f16cc159c60 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0b49f0 con 0x7f16cc159c60 2023-10-07T09:00:01.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.033+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0b53c0 con 0x7f16cc159c60 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.034+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc0b5550 con 0x7f16cc159c60 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.034+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16c4003040 con 0x7f16cc159c60 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.035+0000 7f16ba7fc700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.035+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16c4085f40 con 0x7f16cc159c60 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.035+0000 7f16ca59c700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.035+0000 7f16ca59c700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16bc006fd0 tx=0x7f16bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.039+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16cc0b5550 con 0x7f16cc159c60 2023-10-07T09:00:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.234+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16cc0b5550 con 0x7f16cc159c60 2023-10-07T09:00:01.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.234+0000 7f16ba7fc700 1 -- 172.21.15.46:0/2312930364 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f16cc0b5550 con 0x7f16cc159c60 2023-10-07T09:00:01.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:01.237 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":51,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:00.265914+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 msgr2=0x7f16ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16bc006fd0 tx=0x7f16bc008040 comp rx=0 tx=0).stop 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 msgr2=0x7f16cc1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f16cc070e20 tx=0x7f16c4018000 comp rx=0 tx=0).stop 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 shutdown_connections 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16cc159c60 0x7f16cc1573b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16cc069560 0x7f16cc1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 --2- 172.21.15.46:0/2312930364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16cc159890 0x7f16cc0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.236+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 >> 172.21.15.46:0/2312930364 conn(0x7f16cc068e20 msgr2=0x7f16cc15d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.237+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 shutdown_connections 2023-10-07T09:00:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.237+0000 7f16d0b87700 1 -- 172.21.15.46:0/2312930364 wait complete. 2023-10-07T09:00:01.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:01.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.368+0000 7f3787c1d700 1 Processor -- start 2023-10-07T09:00:01.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.368+0000 7f3787c1d700 1 -- start start 2023-10-07T09:00:01.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f3787c1d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f3787c1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f3787c1d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378006ec70 con 0x7f378015e010 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f3787c1d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800b3430 con 0x7f3780068550 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f3787c1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378006fc70 con 0x7f378006f810 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37861ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37859b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37851b8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f378015e010 0x7f378006f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33954/0 (socket says 172.21.15.46:33954) 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37851b8700 1 -- 172.21.15.46:0/3403534793 learned_addr learned my addr 172.21.15.46:0/3403534793 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:01.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37859b9700 1 --2- 172.21.15.46:0/3403534793 >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:35390/0 (socket says 172.21.15.46:35390) 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.369+0000 7f37861ba700 1 --2- 172.21.15.46:0/3403534793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:53512/0 (socket says 172.21.15.46:53512) 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37861ba700 1 -- 172.21.15.46:0/3403534793 >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 msgr2=0x7f3780068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37861ba700 1 --2- 172.21.15.46:0/3403534793 >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37861ba700 1 -- 172.21.15.46:0/3403534793 >> v1:172.21.15.133:6789/0 conn(0x7f378015e010 legacy=0x7f378006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37861ba700 1 -- 172.21.15.46:0/3403534793 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800b2e70 con 0x7f378006f810 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37859b9700 1 --2- 172.21.15.46:0/3403534793 >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37861ba700 1 --2- 172.21.15.46:0/3403534793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37780098e0 tx=0x7f37780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92d165e997ea48b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37849b7700 1 -- 172.21.15.46:0/3403534793 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b640 con 0x7f378006f810 2023-10-07T09:00:01.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37849b7700 1 -- 172.21.15.46:0/3403534793 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b7a0 con 0x7f378006f810 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.370+0000 7f37849b7700 1 -- 172.21.15.46:0/3403534793 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800bb40 con 0x7f378006f810 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 -- 172.21.15.46:0/3403534793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 msgr2=0x7f3780159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 --2- 172.21.15.46:0/3403534793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37780098e0 tx=0x7f37780091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 -- 172.21.15.46:0/3403534793 shutdown_connections 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 --2- 172.21.15.46:0/3403534793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f378006f810 0x7f3780159510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 --2- 172.21.15.46:0/3403534793 >> v2:172.21.15.133:3300/0 conn(0x7f3780068550 0x7f3780068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 -- 172.21.15.46:0/3403534793 >> 172.21.15.46:0/3403534793 conn(0x7f37800cd480 msgr2=0x7f37800cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 -- 172.21.15.46:0/3403534793 shutdown_connections 2023-10-07T09:00:01.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.371+0000 7f3787c1d700 1 -- 172.21.15.46:0/3403534793 wait complete. 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.372+0000 7f3787c1d700 1 Processor -- start 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.372+0000 7f3787c1d700 1 -- start start 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3780068550 0x7f3780138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 0x7f3780157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378014d360 con 0x7f378015e010 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780138f40 con 0x7f378006f810 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f3787c1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378014c750 con 0x7f3780068550 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56818/0 (socket says 172.21.15.46:56818) 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 -- 172.21.15.46:0/1523859498 learned_addr learned my addr 172.21.15.46:0/1523859498 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37859b9700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3780068550 0x7f3780138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37851b8700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 0x7f3780157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 -- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3780068550 msgr2=0x7f3780138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3780068550 0x7f3780138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 -- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 msgr2=0x7f3780157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 0x7f3780157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 -- 172.21.15.46:0/1523859498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009a20 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37851b8700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 0x7f3780157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f37861ba700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f378006fdb0 tx=0x7f3778017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.373+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b640 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.374+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377801be40 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.374+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3778009420 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.374+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011860 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.374+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378014cd10 con 0x7f378015e010 2023-10-07T09:00:01.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.375+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378004c3c0 con 0x7f378015e010 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.375+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3778011bd0 con 0x7f378015e010 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.375+0000 7f377dffb700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.376+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3778085f90 con 0x7f378015e010 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.376+0000 7f37859b9700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.376+0000 7f37859b9700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 0x7f376c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f37700099f0 tx=0x7f377000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.380+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37780b75a0 con 0x7f378015e010 2023-10-07T09:00:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.573+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37800b3150 con 0x7f378015e010 2023-10-07T09:00:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.574+0000 7f377dffb700 1 -- 172.21.15.46:0/1523859498 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f3778053200 con 0x7f378015e010 2023-10-07T09:00:01.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:01.576 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":51,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:00.265914+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:01.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 msgr2=0x7f376c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 0x7f376c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f37700099f0 tx=0x7f377000b040 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 msgr2=0x7f3780158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f378006fdb0 tx=0x7f3778017000 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 shutdown_connections 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f378015e010 0x7f3780158380 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3780068550 0x7f3780138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 --2- 172.21.15.46:0/1523859498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f378006f810 0x7f3780157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 >> 172.21.15.46:0/1523859498 conn(0x7f37800cd480 msgr2=0x7f37800acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 shutdown_connections 2023-10-07T09:00:01.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.576+0000 7f3787c1d700 1 -- 172.21.15.46:0/1523859498 wait complete. 2023-10-07T09:00:01.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:00:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.712+0000 7f1d42007700 1 Processor -- start 2023-10-07T09:00:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.712+0000 7f1d42007700 1 -- start start 2023-10-07T09:00:01.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d42007700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06bcd0 0x7f1d3c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d42007700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d3c06c0a0 0x7f1d3c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d42007700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c15d7e0 con 0x7f1d3c15df50 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d42007700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c15dac0 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d42007700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15aa30 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d3c06c0a0 0x7f1d3c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1d3c15df50 0x7f1d3c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33362/0 (socket says 172.21.15.46:33362) 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3bfff700 1 -- 172.21.15.46:0/1331730717 learned_addr learned my addr 172.21.15.46:0/1331730717 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3b7fe700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06bcd0 0x7f1d3c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 -- 172.21.15.46:0/1331730717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06bcd0 msgr2=0x7f1d3c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06bcd0 0x7f1d3c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 -- 172.21.15.46:0/1331730717 >> v1:172.21.15.46:6789/0 conn(0x7f1d3c15df50 legacy=0x7f1d3c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 -- 172.21.15.46:0/1331730717 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c15ad10 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3a7fc700 1 -- 172.21.15.46:0/1331730717 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511921174 0 0) 0x7f1d3c15d7e0 con 0x7f1d3c15df50 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.713+0000 7f1d3affd700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06c0a0 0x7f1d3c15a1e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d300098e0 tx=0x7f1d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c8d0e7c4f685d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d3a7fc700 1 -- 172.21.15.46:0/1331730717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30009e80 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d3a7fc700 1 -- 172.21.15.46:0/1331730717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000b860 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d3a7fc700 1 -- 172.21.15.46:0/1331730717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000bbe0 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 -- 172.21.15.46:0/1331730717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06c0a0 msgr2=0x7f1d3c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06c0a0 0x7f1d3c15a1e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d300098e0 tx=0x7f1d300091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 -- 172.21.15.46:0/1331730717 shutdown_connections 2023-10-07T09:00:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06bcd0 0x7f1d3c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 --2- 172.21.15.46:0/1331730717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06c0a0 0x7f1d3c15a1e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 -- 172.21.15.46:0/1331730717 >> 172.21.15.46:0/1331730717 conn(0x7f1d3c0ce600 msgr2=0x7f1d3c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 -- 172.21.15.46:0/1331730717 shutdown_connections 2023-10-07T09:00:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.714+0000 7f1d42007700 1 -- 172.21.15.46:0/1331730717 wait complete. 2023-10-07T09:00:01.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.715+0000 7f1d42007700 1 Processor -- start 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.715+0000 7f1d42007700 1 -- start start 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 0x7f1d3c143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c15df50 0x7f1d3c143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c5010 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c75f0 con 0x7f1d3c15df50 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d42007700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c7870 con 0x7f1d3c06c0a0 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56838/0 (socket says 172.21.15.46:56838) 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d3b7fe700 1 -- 172.21.15.46:0/3592607913 learned_addr learned my addr 172.21.15.46:0/3592607913 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d3affd700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 0x7f1d3c143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.716+0000 7f1d3bfff700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c15df50 0x7f1d3c143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 -- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 msgr2=0x7f1d3c143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 0x7f1d3c143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 -- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c15df50 msgr2=0x7f1d3c143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c15df50 0x7f1d3c143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 -- 172.21.15.46:0/3592607913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009420 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3affd700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 0x7f1d3c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d3b7fe700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d860 tx=0x7f1d2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0125f0 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c012750 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0c4d30 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012b10 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.717+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c0c7df0 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.718+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c04c3c0 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.718+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d2c01e460 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.719+0000 7f1d237fe700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 0x7f1d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.719+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d2c084b90 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.719+0000 7f1d3affd700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 0x7f1d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.719+0000 7f1d3affd700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 0x7f1d280693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d300093a0 tx=0x7f1d30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.723+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d2c051e00 con 0x7f1d3c06bcd0 2023-10-07T09:00:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:01.962+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1d3c15aff0 con 0x7f1d3c06bcd0 2023-10-07T09:00:02.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.889+0000 7f1d237fe700 1 -- 172.21.15.46:0/3592607913 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1d2c055420 con 0x7f1d3c06bcd0 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 msgr2=0x7f1d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 0x7f1d280693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d300093a0 tx=0x7f1d30017000 comp rx=0 tx=0).stop 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 msgr2=0x7f1d3c0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d860 tx=0x7f1d2c008040 comp rx=0 tx=0).stop 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 shutdown_connections 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1d28066f30 0x7f1d280693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c15df50 0x7f1d3c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d3c06bcd0 0x7f1d3c0c5900 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:02.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 --2- 172.21.15.46:0/3592607913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d3c06c0a0 0x7f1d3c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:02.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 >> 172.21.15.46:0/3592607913 conn(0x7f1d3c0ce600 msgr2=0x7f1d3c156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:02.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 shutdown_connections 2023-10-07T09:00:02.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:02.892+0000 7f1d42007700 1 -- 172.21.15.46:0/3592607913 wait complete. 2023-10-07T09:00:02.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:00:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.036+0000 7fd6c3636700 1 Processor -- start 2023-10-07T09:00:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.036+0000 7fd6c3636700 1 -- start start 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c3636700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6bc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c3636700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc15a160 con 0x7fd6bc15db10 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c3636700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc0d13a0 con 0x7fd6bc159890 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c3636700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc15e140 con 0x7fd6bc159c60 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c1bd3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6bc15db10 0x7fd6bc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33372/0 (socket says 172.21.15.46:33372) 2023-10-07T09:00:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c1bd3700 1 -- 172.21.15.46:0/2110062215 learned_addr learned my addr 172.21.15.46:0/2110062215 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6c0bd1700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6bc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220771668 0 0) 0x7fd6bc15a160 con 0x7fd6bc15db10 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a4003570 con 0x7fd6bc15db10 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046220609 0 0) 0x7fd6a4003570 con 0x7fd6bc15db10 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 msgr2=0x7fd6bc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6bc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 >> v1:172.21.15.133:6789/0 conn(0x7fd6bc159890 legacy=0x7fd6bc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc15a3d0 con 0x7fd6bc15db10 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd6b4001470 con 0x7fd6bc15db10 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 >> v1:172.21.15.46:6789/0 conn(0x7fd6bc15db10 legacy=0x7fd6bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc15e140 con 0x7fd6a4003a90 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bb10 con 0x7fd6a4004810 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.037+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bcd0 con 0x7fd6bc159c60 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c0bd1700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c1bd3700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 -- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 msgr2=0x7fd6a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc159c60 0x7fd6a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 -- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a4004810 msgr2=0x7fd6a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 -- 172.21.15.46:0/2110062215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4003570 con 0x7fd6a4003a90 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0020a0 tx=0x7fd6ac0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c087b267178ab09 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0019e0 con 0x7fd6a4003a90 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00c8b0 con 0x7fd6a4003a90 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.038+0000 7fd6bbfff700 1 -- 172.21.15.46:0/2110062215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00cc50 con 0x7fd6a4003a90 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 -- 172.21.15.46:0/2110062215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 msgr2=0x7fd6a4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 --2- 172.21.15.46:0/2110062215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0020a0 tx=0x7fd6ac0016d0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c1bd3700 1 -- 172.21.15.46:0/2110062215 reap_dead start 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 -- 172.21.15.46:0/2110062215 shutdown_connections 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 -- 172.21.15.46:0/2110062215 >> 172.21.15.46:0/2110062215 conn(0x7fd6bc068e20 msgr2=0x7fd6bc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 -- 172.21.15.46:0/2110062215 shutdown_connections 2023-10-07T09:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.039+0000 7fd6c3636700 1 -- 172.21.15.46:0/2110062215 wait complete. 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.040+0000 7fd6c3636700 1 Processor -- start 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.040+0000 7fd6c3636700 1 -- start start 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6bc150c90 0x7fd6bc16cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc151100 0x7fd6bc16d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0b37c0 con 0x7fd6a4003a90 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0c7b80 con 0x7fd6bc150c90 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c3636700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1515a0 con 0x7fd6bc151100 2023-10-07T09:00:03.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c13d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c13d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56858/0 (socket says 172.21.15.46:56858) 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c13d2700 1 -- 172.21.15.46:0/559606863 learned_addr learned my addr 172.21.15.46:0/559606863 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c1bd3700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc151100 0x7fd6bc16d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.041+0000 7fd6c0bd1700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6bc150c90 0x7fd6bc16cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 -- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc151100 msgr2=0x7fd6bc16d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc151100 0x7fd6bc16d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 -- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6bc150c90 msgr2=0x7fd6bc16cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6bc150c90 0x7fd6bc16cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 -- 172.21.15.46:0/559606863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0b5f60 con 0x7fd6a4003a90 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c13d2700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c6a0 tx=0x7fd6ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0019e0 con 0x7fd6a4003a90 2023-10-07T09:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac022070 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc0b6240 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00ca20 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.042+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc16dc10 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.043+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc0b3aa0 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.043+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6ac01b460 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.044+0000 7fd6b97fa700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 0x7fd6a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.044+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6ac0860b0 con 0x7fd6a4003a90 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.044+0000 7fd6c0bd1700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 0x7fd6a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.045+0000 7fd6c0bd1700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 0x7fd6a80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc16cf30 tx=0x7fd6b00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.048+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6ac053320 con 0x7fd6a4003a90 2023-10-07T09:00:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.285+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd6bc16de30 con 0x7fd6a4003a90 2023-10-07T09:00:03.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.893+0000 7fd6b97fa700 1 -- 172.21.15.46:0/559606863 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6ac056940 con 0x7fd6a4003a90 2023-10-07T09:00:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 msgr2=0x7fd6a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 0x7fd6a80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc16cf30 tx=0x7fd6b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 msgr2=0x7fd6bc1518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c6a0 tx=0x7fd6ac016000 comp rx=0 tx=0).stop 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 shutdown_connections 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a8066f30 0x7fd6a80693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6bc151100 0x7fd6bc16d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4003a90 0x7fd6bc1518f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 --2- 172.21.15.46:0/559606863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6bc150c90 0x7fd6bc16cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 >> 172.21.15.46:0/559606863 conn(0x7fd6bc068e20 msgr2=0x7fd6bc0c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 shutdown_connections 2023-10-07T09:00:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:03.896+0000 7fd6c3636700 1 -- 172.21.15.46:0/559606863 wait complete. 2023-10-07T09:00:03.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.033+0000 7f2aa2a64700 1 Processor -- start 2023-10-07T09:00:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.033+0000 7f2aa2a64700 1 -- start start 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa2a64700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 0x7f2a9c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa2a64700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 0x7f2a9c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa2a64700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c06bdb0 con 0x7f2a9c0aca80 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa2a64700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c0c8670 con 0x7f2a9c0c81f0 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa2a64700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0cb370 con 0x7f2a9c069d60 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2a9bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 0x7f2a9c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa0800700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a9c0aca80 0x7f2a9c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:33978/0 (socket says 172.21.15.46:33978) 2023-10-07T09:00:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa0800700 1 -- 172.21.15.46:0/1050365554 learned_addr learned my addr 172.21.15.46:0/1050365554 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.034+0000 7f2aa1001700 1 --2- 172.21.15.46:0/1050365554 >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 0x7f2a9c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9b7fe700 1 -- 172.21.15.46:0/1050365554 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595214743 0 0) 0x7f2a9c06bdb0 con 0x7f2a9c0aca80 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9b7fe700 1 -- 172.21.15.46:0/1050365554 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8c003570 con 0x7f2a9c0aca80 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9bfff700 1 -- 172.21.15.46:0/1050365554 >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 msgr2=0x7f2a9c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9bfff700 1 --2- 172.21.15.46:0/1050365554 >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 0x7f2a9c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9bfff700 1 -- 172.21.15.46:0/1050365554 >> v1:172.21.15.133:6789/0 conn(0x7f2a9c0aca80 legacy=0x7f2a9c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9bfff700 1 -- 172.21.15.46:0/1050365554 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c159f60 con 0x7f2a9c069d60 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2aa1001700 1 --2- 172.21.15.46:0/1050365554 >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 0x7f2a9c0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9bfff700 1 --2- 172.21.15.46:0/1050365554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 0x7f2a9c0c7cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a880098e0 tx=0x7f2a880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c50805e60f5d583 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9b7fe700 1 -- 172.21.15.46:0/1050365554 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011630 con 0x7f2a9c069d60 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9b7fe700 1 -- 172.21.15.46:0/1050365554 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88011790 con 0x7f2a9c069d60 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.035+0000 7f2a9b7fe700 1 -- 172.21.15.46:0/1050365554 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011b30 con 0x7f2a9c069d60 2023-10-07T09:00:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 -- 172.21.15.46:0/1050365554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 msgr2=0x7f2a9c0c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/1050365554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 0x7f2a9c0c7cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a880098e0 tx=0x7f2a880091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 -- 172.21.15.46:0/1050365554 shutdown_connections 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/1050365554 >> v2:172.21.15.133:3300/0 conn(0x7f2a9c0c81f0 0x7f2a9c0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/1050365554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c069d60 0x7f2a9c0c7cb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 -- 172.21.15.46:0/1050365554 >> 172.21.15.46:0/1050365554 conn(0x7f2a9c0cd670 msgr2=0x7f2a9c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 -- 172.21.15.46:0/1050365554 shutdown_connections 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.036+0000 7f2aa2a64700 1 -- 172.21.15.46:0/1050365554 wait complete. 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.037+0000 7f2aa2a64700 1 Processor -- start 2023-10-07T09:00:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.037+0000 7f2aa2a64700 1 -- start start 2023-10-07T09:00:04.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a9c0aca80 0x7f2a9c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c0c81f0 0x7f2a9c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0c8050 con 0x7f2a9c069d60 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0b1fd0 con 0x7f2a9c0aca80 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa2a64700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0ad510 con 0x7f2a9c0c81f0 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56866/0 (socket says 172.21.15.46:56866) 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 -- 172.21.15.46:0/733417059 learned_addr learned my addr 172.21.15.46:0/733417059 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa1001700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c0c81f0 0x7f2a9c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2a9bfff700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a9c0aca80 0x7f2a9c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 -- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c0c81f0 msgr2=0x7f2a9c157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c0c81f0 0x7f2a9c157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 -- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a9c0aca80 msgr2=0x7f2a9c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a9c0aca80 0x7f2a9c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.038+0000 7f2aa0800700 1 -- 172.21.15.46:0/733417059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009a20 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2aa0800700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c790 tx=0x7f2a90007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90005b80 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90005ce0 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a88009420 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900072e0 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.039+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c1584c0 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.040+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c04c3c0 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.040+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a90007650 con 0x7f2a9c069d60 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.041+0000 7f2a98ff9700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 0x7f2a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.041+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a90083880 con 0x7f2a9c069d60 2023-10-07T09:00:04.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.041+0000 7f2a9bfff700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 0x7f2a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.041+0000 7f2a9bfff700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 0x7f2a800693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c06a130 tx=0x7f2a88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.045+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a9004b5a0 con 0x7f2a9c069d60 2023-10-07T09:00:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.281+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a9c0678d0 con 0x7f2a9c069d60 2023-10-07T09:00:04.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.282+0000 7f2a98ff9700 1 -- 172.21.15.46:0/733417059 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2a900546f0 con 0x7f2a9c069d60 2023-10-07T09:00:04.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:04.284 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 msgr2=0x7f2a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 0x7f2a800693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c06a130 tx=0x7f2a88017000 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 msgr2=0x7f2a9c0ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c790 tx=0x7f2a90007e00 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 shutdown_connections 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a80066f30 0x7f2a800693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a9c0c81f0 0x7f2a9c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9c069d60 0x7f2a9c0ace50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 --2- 172.21.15.46:0/733417059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a9c0aca80 0x7f2a9c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 >> 172.21.15.46:0/733417059 conn(0x7f2a9c0cd670 msgr2=0x7f2a9c0c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 shutdown_connections 2023-10-07T09:00:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.284+0000 7f2aa2a64700 1 -- 172.21.15.46:0/733417059 wait complete. 2023-10-07T09:00:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2023-10-07T09:00:04.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.416+0000 7f17bbdd9700 1 Processor -- start 2023-10-07T09:00:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.416+0000 7f17bbdd9700 1 -- start start 2023-10-07T09:00:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17b4159890 0x7f17b415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 0x7f17b415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17b415db10 0x7f17b4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b415a160 con 0x7f17b4159890 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40d13a0 con 0x7f17b415db10 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17bbdd9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b415e140 con 0x7f17b4159c60 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17b9b75700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17b4159890 0x7f17b415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17b9b75700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17b4159890 0x7f17b415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56870/0 (socket says 172.21.15.46:56870) 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17b9b75700 1 -- 172.21.15.46:0/4009773861 learned_addr learned my addr 172.21.15.46:0/4009773861 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17ba376700 1 --2- 172.21.15.46:0/4009773861 >> v2:172.21.15.133:3300/0 conn(0x7f17b415db10 0x7f17b4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.417+0000 7f17b9374700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 0x7f17b415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 -- 172.21.15.46:0/4009773861 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 msgr2=0x7f17b415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 0x7f17b415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 -- 172.21.15.46:0/4009773861 >> v2:172.21.15.133:3300/0 conn(0x7f17b415db10 msgr2=0x7f17b4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 --2- 172.21.15.46:0/4009773861 >> v2:172.21.15.133:3300/0 conn(0x7f17b415db10 0x7f17b4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 -- 172.21.15.46:0/4009773861 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b415a3d0 con 0x7f17b4159890 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9374700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 0x7f17b415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b9b75700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159890 0x7f17b415abd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f17b4089b50 tx=0x7f17a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b817d09c66a52cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b8b73700 1 -- 172.21.15.46:0/4009773861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400e070 con 0x7f17b4159890 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b8b73700 1 -- 172.21.15.46:0/4009773861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a400ba50 con 0x7f17b4159890 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17b8b73700 1 -- 172.21.15.46:0/4009773861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40092e0 con 0x7f17b4159890 2023-10-07T09:00:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 -- 172.21.15.46:0/4009773861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159890 msgr2=0x7f17b415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159890 0x7f17b415abd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f17b4089b50 tx=0x7f17a4009840 comp rx=0 tx=0).stop 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 -- 172.21.15.46:0/4009773861 shutdown_connections 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/4009773861 >> v2:172.21.15.133:3300/0 conn(0x7f17b415db10 0x7f17b4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159890 0x7f17b415abd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/4009773861 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b4159c60 0x7f17b415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 -- 172.21.15.46:0/4009773861 >> 172.21.15.46:0/4009773861 conn(0x7f17b4068e20 msgr2=0x7f17b40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 -- 172.21.15.46:0/4009773861 shutdown_connections 2023-10-07T09:00:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.418+0000 7f17bbdd9700 1 -- 172.21.15.46:0/4009773861 wait complete. 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 Processor -- start 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 -- start start 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17b4159890 0x7f17b40b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b415db10 0x7f17b4146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4156770 con 0x7f17b4159c60 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40b52e0 con 0x7f17b4159890 2023-10-07T09:00:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17bbdd9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4156120 con 0x7f17b415db10 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17b9374700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17b9374700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56882/0 (socket says 172.21.15.46:56882) 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17b9374700 1 -- 172.21.15.46:0/220897716 learned_addr learned my addr 172.21.15.46:0/220897716 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.420+0000 7f17b9b75700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17b4159890 0x7f17b40b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17ba376700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b415db10 0x7f17b4146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 -- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b415db10 msgr2=0x7f17b4146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b415db10 0x7f17b4146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 -- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17b4159890 msgr2=0x7f17b40b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17b4159890 0x7f17b40b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 -- 172.21.15.46:0/220897716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009ae0 con 0x7f17b4159c60 2023-10-07T09:00:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b9374700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f17a800c880 tx=0x7f17a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011600 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a8011760 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b4156400 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011b00 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.421+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b416cd10 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.422+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b41568e0 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.422+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17a8018360 con 0x7f17b4159c60 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.423+0000 7f17b1ffb700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 0x7f17a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.423+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17a8084550 con 0x7f17b4159c60 2023-10-07T09:00:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.423+0000 7f17b9b75700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 0x7f17a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.424+0000 7f17b9b75700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 0x7f17a00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009880 tx=0x7f17a4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.427+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17a8055250 con 0x7f17b4159c60 2023-10-07T09:00:04.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.621+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b404c3c0 con 0x7f17b4159c60 2023-10-07T09:00:04.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.622+0000 7f17b1ffb700 1 -- 172.21.15.46:0/220897716 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f17a8054de0 con 0x7f17b4159c60 2023-10-07T09:00:04.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:04.625 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:01.861371+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:04.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 msgr2=0x7f17a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 0x7f17a00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009880 tx=0x7f17a4018000 comp rx=0 tx=0).stop 2023-10-07T09:00:04.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 msgr2=0x7f17b40cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f17a800c880 tx=0x7f17a8008040 comp rx=0 tx=0).stop 2023-10-07T09:00:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 shutdown_connections 2023-10-07T09:00:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17a0066f30 0x7f17a00693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17b415db10 0x7f17b4146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17b4159890 0x7f17b40b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 --2- 172.21.15.46:0/220897716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b4159c60 0x7f17b40cf460 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.624+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 >> 172.21.15.46:0/220897716 conn(0x7f17b4068e20 msgr2=0x7f17b415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.625+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 shutdown_connections 2023-10-07T09:00:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.625+0000 7f17bbdd9700 1 -- 172.21.15.46:0/220897716 wait complete. 2023-10-07T09:00:04.639 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:00:04.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:04.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.756+0000 7f677b2e2700 1 Processor -- start 2023-10-07T09:00:04.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.756+0000 7f677b2e2700 1 -- start start 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677b2e2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6774159420 0x7f67740b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677b2e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67741597f0 0x7f67740b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677b2e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740b11d0 con 0x7f677415d230 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677b2e2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740b14b0 con 0x7f6774159420 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677b2e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740b1790 con 0x7f67741597f0 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6774159420 0x7f67740b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6774159420 0x7f67740b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56886/0 (socket says 172.21.15.46:56886) 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 -- 172.21.15.46:0/3574361956 learned_addr learned my addr 172.21.15.46:0/3574361956 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f6779adf700 1 --2- 172.21.15.46:0/3574361956 >> v2:172.21.15.133:3300/0 conn(0x7f67741597f0 0x7f67740b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 -- 172.21.15.46:0/3574361956 >> v2:172.21.15.133:3300/0 conn(0x7f67741597f0 msgr2=0x7f67740b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:04.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 --2- 172.21.15.46:0/3574361956 >> v2:172.21.15.133:3300/0 conn(0x7f67741597f0 0x7f67740b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 -- 172.21.15.46:0/3574361956 >> v1:172.21.15.133:6789/0 conn(0x7f677415d230 legacy=0x7f677415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.757+0000 7f677a2e0700 1 -- 172.21.15.46:0/3574361956 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740b1a70 con 0x7f6774159420 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677a2e0700 1 --2- 172.21.15.46:0/3574361956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740b5f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6774089750 tx=0x7f676c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faea426c67d337d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f67792de700 1 -- 172.21.15.46:0/3574361956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c009e70 con 0x7f6774159420 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f67792de700 1 -- 172.21.15.46:0/3574361956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00b860 con 0x7f6774159420 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f67792de700 1 -- 172.21.15.46:0/3574361956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bc00 con 0x7f6774159420 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 -- 172.21.15.46:0/3574361956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 msgr2=0x7f67740b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 --2- 172.21.15.46:0/3574361956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740b5f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6774089750 tx=0x7f676c009250 comp rx=0 tx=0).stop 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 -- 172.21.15.46:0/3574361956 shutdown_connections 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 --2- 172.21.15.46:0/3574361956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740b5f40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 --2- 172.21.15.46:0/3574361956 >> v2:172.21.15.133:3300/0 conn(0x7f67741597f0 0x7f67740b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 -- 172.21.15.46:0/3574361956 >> 172.21.15.46:0/3574361956 conn(0x7f67740d0660 msgr2=0x7f67740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:04.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 -- 172.21.15.46:0/3574361956 shutdown_connections 2023-10-07T09:00:04.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.758+0000 7f677b2e2700 1 -- 172.21.15.46:0/3574361956 wait complete. 2023-10-07T09:00:04.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.759+0000 7f677b2e2700 1 Processor -- start 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 -- start start 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67741597f0 0x7f67740c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f677415d230 0x7f6774146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740cb410 con 0x7f6774159420 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740d03a0 con 0x7f67741597f0 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677b2e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c6360 con 0x7f677415d230 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677a2e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677a2e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56888/0 (socket says 172.21.15.46:56888) 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.760+0000 7f677a2e0700 1 -- 172.21.15.46:0/152405513 learned_addr learned my addr 172.21.15.46:0/152405513 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f6779adf700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67741597f0 0x7f67740c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677aae1700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f677415d230 0x7f6774146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 -- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f677415d230 msgr2=0x7f6774146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f677415d230 0x7f6774146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 -- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67741597f0 msgr2=0x7f67740c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67741597f0 0x7f67740c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 -- 172.21.15.46:0/152405513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0094f0 con 0x7f6774159420 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677a2e0700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c011420 con 0x7f6774159420 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c0115a0 con 0x7f6774159420 2023-10-07T09:00:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67740caab0 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c011960 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.761+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67740cb030 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.762+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677404c3c0 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.762+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f676c0253f0 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.763+0000 7f67727fc700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 0x7f67600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.763+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f676c085e80 con 0x7f6774159420 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.763+0000 7f6779adf700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 0x7f67600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.763+0000 7f6779adf700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 0x7f67600693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67740c8810 tx=0x7f6768008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:04.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.767+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f676c0530f0 con 0x7f6774159420 2023-10-07T09:00:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.956+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67740b1d50 con 0x7f6760066f30 2023-10-07T09:00:05.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.965+0000 7f67727fc700 1 -- 172.21.15.46:0/152405513 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287217 (secure 0 0 0) 0x7f67740b1d50 con 0x7f6760066f30 2023-10-07T09:00:05.248 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 msgr2=0x7f67600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 0x7f67600693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67740c8810 tx=0x7f6768008040 comp rx=0 tx=0).stop 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 msgr2=0x7f67740c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c017000 comp rx=0 tx=0).stop 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 shutdown_connections 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6760066f30 0x7f67600693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f677415d230 0x7f6774146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774159420 0x7f67740c5e20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 --2- 172.21.15.46:0/152405513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67741597f0 0x7f67740c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 >> 172.21.15.46:0/152405513 conn(0x7f67740d0660 msgr2=0x7f6774069940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 shutdown_connections 2023-10-07T09:00:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:04.968+0000 7f677b2e2700 1 -- 172.21.15.46:0/152405513 wait complete. 2023-10-07T09:00:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:05.252 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-07T09:00:03.782914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3172352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929749"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.868694+0000","last_change":"2023-10-07T09:00:00.868817+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.868694+0000","last_undegraded":"2023-10-07T09:00:00.868694+0000","last_fullsized":"2023-10-07T09:00:00.868694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877084+0000","last_change":"2023-10-07T09:00:00.877084+0000","last_active":"2023-10-07T09:00:00.877084+0000","last_peered":"2023-10-07T09:00:00.877084+0000","last_clean":"2023-10-07T09:00:00.877084+0000","last_became_active":"2023-10-07T09:00:00.876802+0000","last_became_peered":"2023-10-07T09:00:00.876802+0000","last_unstale":"2023-10-07T09:00:00.877084+0000","last_undegraded":"2023-10-07T09:00:00.877084+0000","last_fullsized":"2023-10-07T09:00:00.877084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:44.814877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877110+0000","last_change":"2023-10-07T09:00:00.877258+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877110+0000","last_undegraded":"2023-10-07T09:00:00.877110+0000","last_fullsized":"2023-10-07T09:00:00.877110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871545+0000","last_change":"2023-10-07T09:00:00.872047+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871545+0000","last_undegraded":"2023-10-07T09:00:00.871545+0000","last_fullsized":"2023-10-07T09:00:00.871545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.865994+0000","last_change":"2023-10-07T09:00:00.866157+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.865994+0000","last_undegraded":"2023-10-07T09:00:00.865994+0000","last_fullsized":"2023-10-07T09:00:00.865994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873331+0000","last_change":"2023-10-07T09:00:00.873494+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873331+0000","last_undegraded":"2023-10-07T09:00:00.873331+0000","last_fullsized":"2023-10-07T09:00:00.873331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866693+0000","last_change":"2023-10-07T09:00:00.866830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866693+0000","last_undegraded":"2023-10-07T09:00:00.866693+0000","last_fullsized":"2023-10-07T09:00:00.866693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875755+0000","last_change":"2023-10-07T09:00:00.875825+0000","last_active":"2023-10-07T09:00:00.875755+0000","last_peered":"2023-10-07T09:00:00.875755+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.875535+0000","last_became_peered":"2023-10-07T09:00:00.875535+0000","last_unstale":"2023-10-07T09:00:00.875755+0000","last_undegraded":"2023-10-07T09:00:00.875755+0000","last_fullsized":"2023-10-07T09:00:00.875755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:28.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866577+0000","last_change":"2023-10-07T09:00:00.866723+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866577+0000","last_undegraded":"2023-10-07T09:00:00.866577+0000","last_fullsized":"2023-10-07T09:00:00.866577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863710+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863428+0000","last_change":"2023-10-07T09:00:00.863647+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863428+0000","last_undegraded":"2023-10-07T09:00:00.863428+0000","last_fullsized":"2023-10-07T09:00:00.863428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871500+0000","last_change":"2023-10-07T09:00:00.871633+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871500+0000","last_undegraded":"2023-10-07T09:00:00.871500+0000","last_fullsized":"2023-10-07T09:00:00.871500+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881702+0000","last_change":"2023-10-07T09:00:00.881702+0000","last_active":"2023-10-07T09:00:00.881702+0000","last_peered":"2023-10-07T09:00:00.881702+0000","last_clean":"2023-10-07T09:00:00.881702+0000","last_became_active":"2023-10-07T09:00:00.881391+0000","last_became_peered":"2023-10-07T09:00:00.881391+0000","last_unstale":"2023-10-07T09:00:00.881702+0000","last_undegraded":"2023-10-07T09:00:00.881702+0000","last_fullsized":"2023-10-07T09:00:00.881702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:54.280509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870477+0000","last_change":"2023-10-07T09:00:00.870579+0000","last_active":"2023-10-07T09:00:00.870477+0000","last_peered":"2023-10-07T09:00:00.870477+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870265+0000","last_became_peered":"2023-10-07T09:00:00.870265+0000","last_unstale":"2023-10-07T09:00:00.870477+0000","last_undegraded":"2023-10-07T09:00:00.870477+0000","last_fullsized":"2023-10-07T09:00:00.870477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870675+0000","last_change":"2023-10-07T09:00:00.870744+0000","last_active":"2023-10-07T09:00:00.870675+0000","last_peered":"2023-10-07T09:00:00.870675+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870486+0000","last_became_peered":"2023-10-07T09:00:00.870486+0000","last_unstale":"2023-10-07T09:00:00.870675+0000","last_undegraded":"2023-10-07T09:00:00.870675+0000","last_fullsized":"2023-10-07T09:00:00.870675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871905+0000","last_change":"2023-10-07T09:00:00.872069+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871905+0000","last_undegraded":"2023-10-07T09:00:00.871905+0000","last_fullsized":"2023-10-07T09:00:00.871905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878540+0000","last_change":"2023-10-07T09:00:00.878540+0000","last_active":"2023-10-07T09:00:00.878540+0000","last_peered":"2023-10-07T09:00:00.878540+0000","last_clean":"2023-10-07T09:00:00.878540+0000","last_became_active":"2023-10-07T09:00:00.878251+0000","last_became_peered":"2023-10-07T09:00:00.878251+0000","last_unstale":"2023-10-07T09:00:00.878540+0000","last_undegraded":"2023-10-07T09:00:00.878540+0000","last_fullsized":"2023-10-07T09:00:00.878540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:27.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877134+0000","last_change":"2023-10-07T09:00:00.877270+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877134+0000","last_undegraded":"2023-10-07T09:00:00.877134+0000","last_fullsized":"2023-10-07T09:00:00.877134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866029+0000","last_change":"2023-10-07T09:00:00.866161+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866029+0000","last_undegraded":"2023-10-07T09:00:00.866029+0000","last_fullsized":"2023-10-07T09:00:00.866029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876761+0000","last_change":"2023-10-07T09:00:00.876761+0000","last_active":"2023-10-07T09:00:00.876761+0000","last_peered":"2023-10-07T09:00:00.876761+0000","last_clean":"2023-10-07T09:00:00.876761+0000","last_became_active":"2023-10-07T09:00:00.876442+0000","last_became_peered":"2023-10-07T09:00:00.876442+0000","last_unstale":"2023-10-07T09:00:00.876761+0000","last_undegraded":"2023-10-07T09:00:00.876761+0000","last_fullsized":"2023-10-07T09:00:00.876761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:24.571544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875422+0000","last_change":"2023-10-07T09:00:00.875796+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875422+0000","last_undegraded":"2023-10-07T09:00:00.875422+0000","last_fullsized":"2023-10-07T09:00:00.875422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879332+0000","last_change":"2023-10-07T09:00:00.879332+0000","last_active":"2023-10-07T09:00:00.879332+0000","last_peered":"2023-10-07T09:00:00.879332+0000","last_clean":"2023-10-07T09:00:00.879332+0000","last_became_active":"2023-10-07T09:00:00.876325+0000","last_became_peered":"2023-10-07T09:00:00.876325+0000","last_unstale":"2023-10-07T09:00:00.879332+0000","last_undegraded":"2023-10-07T09:00:00.879332+0000","last_fullsized":"2023-10-07T09:00:00.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:59.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875959+0000","last_change":"2023-10-07T09:00:00.876088+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875959+0000","last_undegraded":"2023-10-07T09:00:00.875959+0000","last_fullsized":"2023-10-07T09:00:00.875959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881737+0000","last_change":"2023-10-07T09:00:00.881737+0000","last_active":"2023-10-07T09:00:00.881737+0000","last_peered":"2023-10-07T09:00:00.881737+0000","last_clean":"2023-10-07T09:00:00.881737+0000","last_became_active":"2023-10-07T09:00:00.881479+0000","last_became_peered":"2023-10-07T09:00:00.881479+0000","last_unstale":"2023-10-07T09:00:00.881737+0000","last_undegraded":"2023-10-07T09:00:00.881737+0000","last_fullsized":"2023-10-07T09:00:00.881737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:33.628371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873185+0000","last_change":"2023-10-07T09:00:00.873185+0000","last_active":"2023-10-07T09:00:00.873185+0000","last_peered":"2023-10-07T09:00:00.873185+0000","last_clean":"2023-10-07T09:00:00.873185+0000","last_became_active":"2023-10-07T09:00:00.872874+0000","last_became_peered":"2023-10-07T09:00:00.872874+0000","last_unstale":"2023-10-07T09:00:00.873185+0000","last_undegraded":"2023-10-07T09:00:00.873185+0000","last_fullsized":"2023-10-07T09:00:00.873185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:25:15.529282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871120+0000","last_change":"2023-10-07T09:00:00.871263+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871120+0000","last_undegraded":"2023-10-07T09:00:00.871120+0000","last_fullsized":"2023-10-07T09:00:00.871120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873365+0000","last_change":"2023-10-07T09:00:00.873460+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873365+0000","last_undegraded":"2023-10-07T09:00:00.873365+0000","last_fullsized":"2023-10-07T09:00:00.873365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866015+0000","last_change":"2023-10-07T09:00:00.866363+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866015+0000","last_undegraded":"2023-10-07T09:00:00.866015+0000","last_fullsized":"2023-10-07T09:00:00.866015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878311+0000","last_change":"2023-10-07T09:00:00.878311+0000","last_active":"2023-10-07T09:00:00.878311+0000","last_peered":"2023-10-07T09:00:00.878311+0000","last_clean":"2023-10-07T09:00:00.878311+0000","last_became_active":"2023-10-07T09:00:00.877748+0000","last_became_peered":"2023-10-07T09:00:00.877748+0000","last_unstale":"2023-10-07T09:00:00.878311+0000","last_undegraded":"2023-10-07T09:00:00.878311+0000","last_fullsized":"2023-10-07T09:00:00.878311+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:50.858102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875440+0000","last_change":"2023-10-07T09:00:00.875586+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875440+0000","last_undegraded":"2023-10-07T09:00:00.875440+0000","last_fullsized":"2023-10-07T09:00:00.875440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870666+0000","last_change":"2023-10-07T09:00:00.870666+0000","last_active":"2023-10-07T09:00:00.870666+0000","last_peered":"2023-10-07T09:00:00.870666+0000","last_clean":"2023-10-07T09:00:00.870666+0000","last_became_active":"2023-10-07T09:00:00.870437+0000","last_became_peered":"2023-10-07T09:00:00.870437+0000","last_unstale":"2023-10-07T09:00:00.870666+0000","last_undegraded":"2023-10-07T09:00:00.870666+0000","last_fullsized":"2023-10-07T09:00:00.870666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:09.591539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873428+0000","last_change":"2023-10-07T09:00:00.873570+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873428+0000","last_undegraded":"2023-10-07T09:00:00.873428+0000","last_fullsized":"2023-10-07T09:00:00.873428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872150+0000","last_change":"2023-10-07T09:00:00.872271+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872150+0000","last_undegraded":"2023-10-07T09:00:00.872150+0000","last_fullsized":"2023-10-07T09:00:00.872150+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882661+0000","last_change":"2023-10-07T08:59:59.878882+0000","last_active":"2023-10-07T08:59:59.882661+0000","last_peered":"2023-10-07T08:59:59.882661+0000","last_clean":"2023-10-07T08:59:59.882661+0000","last_became_active":"2023-10-07T08:59:59.878576+0000","last_became_peered":"2023-10-07T08:59:59.878576+0000","last_unstale":"2023-10-07T08:59:59.882661+0000","last_undegraded":"2023-10-07T08:59:59.882661+0000","last_fullsized":"2023-10-07T08:59:59.882661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:37.738910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863540+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882871+0000","last_change":"2023-10-07T08:59:59.877825+0000","last_active":"2023-10-07T08:59:59.882871+0000","last_peered":"2023-10-07T08:59:59.882871+0000","last_clean":"2023-10-07T08:59:59.882871+0000","last_became_active":"2023-10-07T08:59:59.877566+0000","last_became_peered":"2023-10-07T08:59:59.877566+0000","last_unstale":"2023-10-07T08:59:59.882871+0000","last_undegraded":"2023-10-07T08:59:59.882871+0000","last_fullsized":"2023-10-07T08:59:59.882871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:36.032547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872136+0000","last_change":"2023-10-07T09:00:00.873538+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872136+0000","last_undegraded":"2023-10-07T09:00:00.872136+0000","last_fullsized":"2023-10-07T09:00:00.872136+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.872832+0000","last_change":"2023-10-07T08:59:59.871943+0000","last_active":"2023-10-07T08:59:59.872832+0000","last_peered":"2023-10-07T08:59:59.872832+0000","last_clean":"2023-10-07T08:59:59.872832+0000","last_became_active":"2023-10-07T08:59:59.871526+0000","last_became_peered":"2023-10-07T08:59:59.871526+0000","last_unstale":"2023-10-07T08:59:59.872832+0000","last_undegraded":"2023-10-07T08:59:59.872832+0000","last_fullsized":"2023-10-07T08:59:59.872832+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:46:43.375628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873044+0000","last_change":"2023-10-07T09:00:00.873167+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873044+0000","last_undegraded":"2023-10-07T09:00:00.873044+0000","last_fullsized":"2023-10-07T09:00:00.873044+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881897+0000","last_change":"2023-10-07T08:59:59.879585+0000","last_active":"2023-10-07T08:59:59.881897+0000","last_peered":"2023-10-07T08:59:59.881897+0000","last_clean":"2023-10-07T08:59:59.881897+0000","last_became_active":"2023-10-07T08:59:59.879308+0000","last_became_peered":"2023-10-07T08:59:59.879308+0000","last_unstale":"2023-10-07T08:59:59.881897+0000","last_undegraded":"2023-10-07T08:59:59.881897+0000","last_fullsized":"2023-10-07T08:59:59.881897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876182+0000","last_change":"2023-10-07T09:00:00.876182+0000","last_active":"2023-10-07T09:00:00.876182+0000","last_peered":"2023-10-07T09:00:00.876182+0000","last_clean":"2023-10-07T09:00:00.876182+0000","last_became_active":"2023-10-07T09:00:00.875935+0000","last_became_peered":"2023-10-07T09:00:00.875935+0000","last_unstale":"2023-10-07T09:00:00.876182+0000","last_undegraded":"2023-10-07T09:00:00.876182+0000","last_fullsized":"2023-10-07T09:00:00.876182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:21.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881505+0000","last_change":"2023-10-07T08:59:59.878940+0000","last_active":"2023-10-07T08:59:59.881505+0000","last_peered":"2023-10-07T08:59:59.881505+0000","last_clean":"2023-10-07T08:59:59.881505+0000","last_became_active":"2023-10-07T08:59:59.878645+0000","last_became_peered":"2023-10-07T08:59:59.878645+0000","last_unstale":"2023-10-07T08:59:59.881505+0000","last_undegraded":"2023-10-07T08:59:59.881505+0000","last_fullsized":"2023-10-07T08:59:59.881505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:35.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878509+0000","last_change":"2023-10-07T09:00:00.878509+0000","last_active":"2023-10-07T09:00:00.878509+0000","last_peered":"2023-10-07T09:00:00.878509+0000","last_clean":"2023-10-07T09:00:00.878509+0000","last_became_active":"2023-10-07T09:00:00.878039+0000","last_became_peered":"2023-10-07T09:00:00.878039+0000","last_unstale":"2023-10-07T09:00:00.878509+0000","last_undegraded":"2023-10-07T09:00:00.878509+0000","last_fullsized":"2023-10-07T09:00:00.878509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:21.720280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882685+0000","last_change":"2023-10-07T08:59:59.881718+0000","last_active":"2023-10-07T08:59:59.882685+0000","last_peered":"2023-10-07T08:59:59.882685+0000","last_clean":"2023-10-07T08:59:59.882685+0000","last_became_active":"2023-10-07T08:59:59.881423+0000","last_became_peered":"2023-10-07T08:59:59.881423+0000","last_unstale":"2023-10-07T08:59:59.882685+0000","last_undegraded":"2023-10-07T08:59:59.882685+0000","last_fullsized":"2023-10-07T08:59:59.882685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881579+0000","last_change":"2023-10-07T09:00:00.881579+0000","last_active":"2023-10-07T09:00:00.881579+0000","last_peered":"2023-10-07T09:00:00.881579+0000","last_clean":"2023-10-07T09:00:00.881579+0000","last_became_active":"2023-10-07T09:00:00.881316+0000","last_became_peered":"2023-10-07T09:00:00.881316+0000","last_unstale":"2023-10-07T09:00:00.881579+0000","last_undegraded":"2023-10-07T09:00:00.881579+0000","last_fullsized":"2023-10-07T09:00:00.881579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:38:07.420548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881728+0000","last_change":"2023-10-07T08:59:59.877239+0000","last_active":"2023-10-07T08:59:59.881728+0000","last_peered":"2023-10-07T08:59:59.881728+0000","last_clean":"2023-10-07T08:59:59.881728+0000","last_became_active":"2023-10-07T08:59:59.876953+0000","last_became_peered":"2023-10-07T08:59:59.876953+0000","last_unstale":"2023-10-07T08:59:59.881728+0000","last_undegraded":"2023-10-07T08:59:59.881728+0000","last_fullsized":"2023-10-07T08:59:59.881728+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879470+0000","last_change":"2023-10-07T09:00:00.879470+0000","last_active":"2023-10-07T09:00:00.879470+0000","last_peered":"2023-10-07T09:00:00.879470+0000","last_clean":"2023-10-07T09:00:00.879470+0000","last_became_active":"2023-10-07T09:00:00.878300+0000","last_became_peered":"2023-10-07T09:00:00.878300+0000","last_unstale":"2023-10-07T09:00:00.879470+0000","last_undegraded":"2023-10-07T09:00:00.879470+0000","last_fullsized":"2023-10-07T09:00:00.879470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:29.483543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881353+0000","last_change":"2023-10-07T08:59:59.877871+0000","last_active":"2023-10-07T08:59:59.881353+0000","last_peered":"2023-10-07T08:59:59.881353+0000","last_clean":"2023-10-07T08:59:59.881353+0000","last_became_active":"2023-10-07T08:59:59.877531+0000","last_became_peered":"2023-10-07T08:59:59.877531+0000","last_unstale":"2023-10-07T08:59:59.881353+0000","last_undegraded":"2023-10-07T08:59:59.881353+0000","last_fullsized":"2023-10-07T08:59:59.881353+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:32.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873973+0000","last_change":"2023-10-07T09:00:00.874063+0000","last_active":"2023-10-07T09:00:00.873973+0000","last_peered":"2023-10-07T09:00:00.873973+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.873760+0000","last_became_peered":"2023-10-07T09:00:00.873760+0000","last_unstale":"2023-10-07T09:00:00.873973+0000","last_undegraded":"2023-10-07T09:00:00.873973+0000","last_fullsized":"2023-10-07T09:00:00.873973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882862+0000","last_change":"2023-10-07T08:59:59.882862+0000","last_active":"2023-10-07T08:59:59.882862+0000","last_peered":"2023-10-07T08:59:59.882862+0000","last_clean":"2023-10-07T08:59:59.882862+0000","last_became_active":"2023-10-07T08:59:59.882624+0000","last_became_peered":"2023-10-07T08:59:59.882624+0000","last_unstale":"2023-10-07T08:59:59.882862+0000","last_undegraded":"2023-10-07T08:59:59.882862+0000","last_fullsized":"2023-10-07T08:59:59.882862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:59:59.852436+0000","last_change":"2023-10-07T08:59:59.867558+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:59.852436+0000","last_undegraded":"2023-10-07T08:59:59.852436+0000","last_fullsized":"2023-10-07T08:59:59.852436+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:22.118543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882894+0000","last_change":"2023-10-07T08:59:59.878792+0000","last_active":"2023-10-07T08:59:59.882894+0000","last_peered":"2023-10-07T08:59:59.882894+0000","last_clean":"2023-10-07T08:59:59.882894+0000","last_became_active":"2023-10-07T08:59:59.878532+0000","last_became_peered":"2023-10-07T08:59:59.878532+0000","last_unstale":"2023-10-07T08:59:59.882894+0000","last_undegraded":"2023-10-07T08:59:59.882894+0000","last_fullsized":"2023-10-07T08:59:59.882894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:06.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869524+0000","last_change":"2023-10-07T09:00:00.869524+0000","last_active":"2023-10-07T09:00:00.869524+0000","last_peered":"2023-10-07T09:00:00.869524+0000","last_clean":"2023-10-07T09:00:00.869524+0000","last_became_active":"2023-10-07T09:00:00.868923+0000","last_became_peered":"2023-10-07T09:00:00.868923+0000","last_unstale":"2023-10-07T09:00:00.869524+0000","last_undegraded":"2023-10-07T09:00:00.869524+0000","last_fullsized":"2023-10-07T09:00:00.869524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883637+0000","last_change":"2023-10-07T08:59:59.881364+0000","last_active":"2023-10-07T08:59:59.883637+0000","last_peered":"2023-10-07T08:59:59.883637+0000","last_clean":"2023-10-07T08:59:59.883637+0000","last_became_active":"2023-10-07T08:59:59.881095+0000","last_became_peered":"2023-10-07T08:59:59.881095+0000","last_unstale":"2023-10-07T08:59:59.883637+0000","last_undegraded":"2023-10-07T08:59:59.883637+0000","last_fullsized":"2023-10-07T08:59:59.883637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877508+0000","last_change":"2023-10-07T09:00:00.877638+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877508+0000","last_undegraded":"2023-10-07T09:00:00.877508+0000","last_fullsized":"2023-10-07T09:00:00.877508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881251+0000","last_change":"2023-10-07T08:59:59.873067+0000","last_active":"2023-10-07T08:59:59.881251+0000","last_peered":"2023-10-07T08:59:59.881251+0000","last_clean":"2023-10-07T08:59:59.881251+0000","last_became_active":"2023-10-07T08:59:59.872789+0000","last_became_peered":"2023-10-07T08:59:59.872789+0000","last_unstale":"2023-10-07T08:59:59.881251+0000","last_undegraded":"2023-10-07T08:59:59.881251+0000","last_fullsized":"2023-10-07T08:59:59.881251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870941+0000","last_change":"2023-10-07T09:00:00.871072+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870941+0000","last_undegraded":"2023-10-07T09:00:00.870941+0000","last_fullsized":"2023-10-07T09:00:00.870941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883479+0000","last_change":"2023-10-07T08:59:59.880786+0000","last_active":"2023-10-07T08:59:59.883479+0000","last_peered":"2023-10-07T08:59:59.883479+0000","last_clean":"2023-10-07T08:59:59.883479+0000","last_became_active":"2023-10-07T08:59:59.880534+0000","last_became_peered":"2023-10-07T08:59:59.880534+0000","last_unstale":"2023-10-07T08:59:59.883479+0000","last_undegraded":"2023-10-07T08:59:59.883479+0000","last_fullsized":"2023-10-07T08:59:59.883479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:33.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875570+0000","last_change":"2023-10-07T09:00:00.875693+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875570+0000","last_undegraded":"2023-10-07T09:00:00.875570+0000","last_fullsized":"2023-10-07T09:00:00.875570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878077+0000","last_change":"2023-10-07T08:59:59.871360+0000","last_active":"2023-10-07T08:59:59.878077+0000","last_peered":"2023-10-07T08:59:59.878077+0000","last_clean":"2023-10-07T08:59:59.878077+0000","last_became_active":"2023-10-07T08:59:59.871077+0000","last_became_peered":"2023-10-07T08:59:59.871077+0000","last_unstale":"2023-10-07T08:59:59.878077+0000","last_undegraded":"2023-10-07T08:59:59.878077+0000","last_fullsized":"2023-10-07T08:59:59.878077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:25.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866397+0000","last_change":"2023-10-07T09:00:00.866546+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866397+0000","last_undegraded":"2023-10-07T09:00:00.866397+0000","last_fullsized":"2023-10-07T09:00:00.866397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881929+0000","last_change":"2023-10-07T08:59:59.879657+0000","last_active":"2023-10-07T08:59:59.881929+0000","last_peered":"2023-10-07T08:59:59.881929+0000","last_clean":"2023-10-07T08:59:59.881929+0000","last_became_active":"2023-10-07T08:59:59.879372+0000","last_became_peered":"2023-10-07T08:59:59.879372+0000","last_unstale":"2023-10-07T08:59:59.881929+0000","last_undegraded":"2023-10-07T08:59:59.881929+0000","last_fullsized":"2023-10-07T08:59:59.881929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.876296+0000","last_change":"2023-10-07T09:00:00.876419+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.876296+0000","last_undegraded":"2023-10-07T09:00:00.876296+0000","last_fullsized":"2023-10-07T09:00:00.876296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.886344+0000","last_change":"2023-10-07T08:59:59.882300+0000","last_active":"2023-10-07T08:59:59.886344+0000","last_peered":"2023-10-07T08:59:59.886344+0000","last_clean":"2023-10-07T08:59:59.886344+0000","last_became_active":"2023-10-07T08:59:59.882025+0000","last_became_peered":"2023-10-07T08:59:59.882025+0000","last_unstale":"2023-10-07T08:59:59.886344+0000","last_undegraded":"2023-10-07T08:59:59.886344+0000","last_fullsized":"2023-10-07T08:59:59.886344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877479+0000","last_change":"2023-10-07T09:00:00.877624+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877479+0000","last_undegraded":"2023-10-07T09:00:00.877479+0000","last_fullsized":"2023-10-07T09:00:00.877479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882975+0000","last_change":"2023-10-07T08:59:59.880542+0000","last_active":"2023-10-07T08:59:59.882975+0000","last_peered":"2023-10-07T08:59:59.882975+0000","last_clean":"2023-10-07T08:59:59.882975+0000","last_became_active":"2023-10-07T08:59:59.880259+0000","last_became_peered":"2023-10-07T08:59:59.880259+0000","last_unstale":"2023-10-07T08:59:59.882975+0000","last_undegraded":"2023-10-07T08:59:59.882975+0000","last_fullsized":"2023-10-07T08:59:59.882975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:27.985062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870587+0000","last_change":"2023-10-07T09:00:00.870830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870587+0000","last_undegraded":"2023-10-07T09:00:00.870587+0000","last_fullsized":"2023-10-07T09:00:00.870587+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882692+0000","last_change":"2023-10-07T08:59:59.879711+0000","last_active":"2023-10-07T08:59:59.882692+0000","last_peered":"2023-10-07T08:59:59.882692+0000","last_clean":"2023-10-07T08:59:59.882692+0000","last_became_active":"2023-10-07T08:59:59.879410+0000","last_became_peered":"2023-10-07T08:59:59.879410+0000","last_unstale":"2023-10-07T08:59:59.882692+0000","last_undegraded":"2023-10-07T08:59:59.882692+0000","last_fullsized":"2023-10-07T08:59:59.882692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:53.114711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874020+0000","last_change":"2023-10-07T09:00:00.874020+0000","last_active":"2023-10-07T09:00:00.874020+0000","last_peered":"2023-10-07T09:00:00.874020+0000","last_clean":"2023-10-07T09:00:00.874020+0000","last_became_active":"2023-10-07T09:00:00.873739+0000","last_became_peered":"2023-10-07T09:00:00.873739+0000","last_unstale":"2023-10-07T09:00:00.874020+0000","last_undegraded":"2023-10-07T09:00:00.874020+0000","last_fullsized":"2023-10-07T09:00:00.874020+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:12.366488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881914+0000","last_change":"2023-10-07T08:59:59.879611+0000","last_active":"2023-10-07T08:59:59.881914+0000","last_peered":"2023-10-07T08:59:59.881914+0000","last_clean":"2023-10-07T08:59:59.881914+0000","last_became_active":"2023-10-07T08:59:59.879301+0000","last_became_peered":"2023-10-07T08:59:59.879301+0000","last_unstale":"2023-10-07T08:59:59.881914+0000","last_undegraded":"2023-10-07T08:59:59.881914+0000","last_fullsized":"2023-10-07T08:59:59.881914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:34.395138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877849+0000","last_change":"2023-10-07T09:00:00.877970+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877849+0000","last_undegraded":"2023-10-07T09:00:00.877849+0000","last_fullsized":"2023-10-07T09:00:00.877849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.884007+0000","last_change":"2023-10-07T08:59:59.882939+0000","last_active":"2023-10-07T08:59:59.884007+0000","last_peered":"2023-10-07T08:59:59.884007+0000","last_clean":"2023-10-07T08:59:59.884007+0000","last_became_active":"2023-10-07T08:59:59.882525+0000","last_became_peered":"2023-10-07T08:59:59.882525+0000","last_unstale":"2023-10-07T08:59:59.884007+0000","last_undegraded":"2023-10-07T08:59:59.884007+0000","last_fullsized":"2023-10-07T08:59:59.884007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:27.723456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870534+0000","last_change":"2023-10-07T09:00:00.870726+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870534+0000","last_undegraded":"2023-10-07T09:00:00.870534+0000","last_fullsized":"2023-10-07T09:00:00.870534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882924+0000","last_change":"2023-10-07T08:59:59.876486+0000","last_active":"2023-10-07T08:59:59.882924+0000","last_peered":"2023-10-07T08:59:59.882924+0000","last_clean":"2023-10-07T08:59:59.882924+0000","last_became_active":"2023-10-07T08:59:59.876139+0000","last_became_peered":"2023-10-07T08:59:59.876139+0000","last_unstale":"2023-10-07T08:59:59.882924+0000","last_undegraded":"2023-10-07T08:59:59.882924+0000","last_fullsized":"2023-10-07T08:59:59.882924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:06.252338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872333+0000","last_change":"2023-10-07T09:00:00.872464+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872333+0000","last_undegraded":"2023-10-07T09:00:00.872333+0000","last_fullsized":"2023-10-07T09:00:00.872333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879743+0000","last_change":"2023-10-07T08:59:59.877521+0000","last_active":"2023-10-07T08:59:59.879743+0000","last_peered":"2023-10-07T08:59:59.879743+0000","last_clean":"2023-10-07T08:59:59.879743+0000","last_became_active":"2023-10-07T08:59:59.877269+0000","last_became_peered":"2023-10-07T08:59:59.877269+0000","last_unstale":"2023-10-07T08:59:59.879743+0000","last_undegraded":"2023-10-07T08:59:59.879743+0000","last_fullsized":"2023-10-07T08:59:59.879743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:28.720828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871913+0000","last_change":"2023-10-07T09:00:00.872070+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871913+0000","last_undegraded":"2023-10-07T09:00:00.871913+0000","last_fullsized":"2023-10-07T09:00:00.871913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881841+0000","last_change":"2023-10-07T08:59:59.878211+0000","last_active":"2023-10-07T08:59:59.881841+0000","last_peered":"2023-10-07T08:59:59.881841+0000","last_clean":"2023-10-07T08:59:59.881841+0000","last_became_active":"2023-10-07T08:59:59.877912+0000","last_became_peered":"2023-10-07T08:59:59.877912+0000","last_unstale":"2023-10-07T08:59:59.881841+0000","last_undegraded":"2023-10-07T08:59:59.881841+0000","last_fullsized":"2023-10-07T08:59:59.881841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:02.674160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871110+0000","last_change":"2023-10-07T09:00:00.871279+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871110+0000","last_undegraded":"2023-10-07T09:00:00.871110+0000","last_fullsized":"2023-10-07T09:00:00.871110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879696+0000","last_change":"2023-10-07T08:59:59.877982+0000","last_active":"2023-10-07T08:59:59.879696+0000","last_peered":"2023-10-07T08:59:59.879696+0000","last_clean":"2023-10-07T08:59:59.879696+0000","last_became_active":"2023-10-07T08:59:59.877677+0000","last_became_peered":"2023-10-07T08:59:59.877677+0000","last_unstale":"2023-10-07T08:59:59.879696+0000","last_undegraded":"2023-10-07T08:59:59.879696+0000","last_fullsized":"2023-10-07T08:59:59.879696+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:04.391970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870659+0000","last_change":"2023-10-07T09:00:00.870848+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870659+0000","last_undegraded":"2023-10-07T09:00:00.870659+0000","last_fullsized":"2023-10-07T09:00:00.870659+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882132+0000","last_change":"2023-10-07T08:59:59.873692+0000","last_active":"2023-10-07T08:59:59.882132+0000","last_peered":"2023-10-07T08:59:59.882132+0000","last_clean":"2023-10-07T08:59:59.882132+0000","last_became_active":"2023-10-07T08:59:59.873416+0000","last_became_peered":"2023-10-07T08:59:59.873416+0000","last_unstale":"2023-10-07T08:59:59.882132+0000","last_undegraded":"2023-10-07T08:59:59.882132+0000","last_fullsized":"2023-10-07T08:59:59.882132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:05.503904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869702+0000","last_change":"2023-10-07T09:00:00.869702+0000","last_active":"2023-10-07T09:00:00.869702+0000","last_peered":"2023-10-07T09:00:00.869702+0000","last_clean":"2023-10-07T09:00:00.869702+0000","last_became_active":"2023-10-07T09:00:00.869276+0000","last_became_peered":"2023-10-07T09:00:00.869276+0000","last_unstale":"2023-10-07T09:00:00.869702+0000","last_undegraded":"2023-10-07T09:00:00.869702+0000","last_fullsized":"2023-10-07T09:00:00.869702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878000+0000","last_change":"2023-10-07T08:59:59.870863+0000","last_active":"2023-10-07T08:59:59.878000+0000","last_peered":"2023-10-07T08:59:59.878000+0000","last_clean":"2023-10-07T08:59:59.878000+0000","last_became_active":"2023-10-07T08:59:59.870553+0000","last_became_peered":"2023-10-07T08:59:59.870553+0000","last_unstale":"2023-10-07T08:59:59.878000+0000","last_undegraded":"2023-10-07T08:59:59.878000+0000","last_fullsized":"2023-10-07T08:59:59.878000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:25.612939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872655+0000","last_change":"2023-10-07T09:00:00.872820+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872655+0000","last_undegraded":"2023-10-07T09:00:00.872655+0000","last_fullsized":"2023-10-07T09:00:00.872655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881847+0000","last_change":"2023-10-07T08:59:59.877544+0000","last_active":"2023-10-07T08:59:59.881847+0000","last_peered":"2023-10-07T08:59:59.881847+0000","last_clean":"2023-10-07T08:59:59.881847+0000","last_became_active":"2023-10-07T08:59:59.876631+0000","last_became_peered":"2023-10-07T08:59:59.876631+0000","last_unstale":"2023-10-07T08:59:59.881847+0000","last_undegraded":"2023-10-07T08:59:59.881847+0000","last_fullsized":"2023-10-07T08:59:59.881847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876334+0000","last_change":"2023-10-07T09:00:00.876334+0000","last_active":"2023-10-07T09:00:00.876334+0000","last_peered":"2023-10-07T09:00:00.876334+0000","last_clean":"2023-10-07T09:00:00.876334+0000","last_became_active":"2023-10-07T09:00:00.876055+0000","last_became_peered":"2023-10-07T09:00:00.876055+0000","last_unstale":"2023-10-07T09:00:00.876334+0000","last_undegraded":"2023-10-07T09:00:00.876334+0000","last_fullsized":"2023-10-07T09:00:00.876334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:05.377189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879769+0000","last_change":"2023-10-07T08:59:59.878174+0000","last_active":"2023-10-07T08:59:59.879769+0000","last_peered":"2023-10-07T08:59:59.879769+0000","last_clean":"2023-10-07T08:59:59.879769+0000","last_became_active":"2023-10-07T08:59:59.877621+0000","last_became_peered":"2023-10-07T08:59:59.877621+0000","last_unstale":"2023-10-07T08:59:59.879769+0000","last_undegraded":"2023-10-07T08:59:59.879769+0000","last_fullsized":"2023-10-07T08:59:59.879769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875885+0000","last_change":"2023-10-07T09:00:00.876001+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875885+0000","last_undegraded":"2023-10-07T09:00:00.875885+0000","last_fullsized":"2023-10-07T09:00:00.875885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.876448+0000","last_change":"2023-10-07T08:59:59.872199+0000","last_active":"2023-10-07T08:59:59.876448+0000","last_peered":"2023-10-07T08:59:59.876448+0000","last_clean":"2023-10-07T08:59:59.876448+0000","last_became_active":"2023-10-07T08:59:59.871880+0000","last_became_peered":"2023-10-07T08:59:59.871880+0000","last_unstale":"2023-10-07T08:59:59.876448+0000","last_undegraded":"2023-10-07T08:59:59.876448+0000","last_fullsized":"2023-10-07T08:59:59.876448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863213+0000","last_change":"2023-10-07T09:00:00.863417+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863213+0000","last_undegraded":"2023-10-07T09:00:00.863213+0000","last_fullsized":"2023-10-07T09:00:00.863213+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.875014+0000","last_change":"2023-10-07T08:59:59.873447+0000","last_active":"2023-10-07T08:59:59.875014+0000","last_peered":"2023-10-07T08:59:59.875014+0000","last_clean":"2023-10-07T08:59:59.875014+0000","last_became_active":"2023-10-07T08:59:59.873072+0000","last_became_peered":"2023-10-07T08:59:59.873072+0000","last_unstale":"2023-10-07T08:59:59.875014+0000","last_undegraded":"2023-10-07T08:59:59.875014+0000","last_fullsized":"2023-10-07T08:59:59.875014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878785+0000","last_change":"2023-10-07T09:00:00.878785+0000","last_active":"2023-10-07T09:00:00.878785+0000","last_peered":"2023-10-07T09:00:00.878785+0000","last_clean":"2023-10-07T09:00:00.878785+0000","last_became_active":"2023-10-07T09:00:00.878430+0000","last_became_peered":"2023-10-07T09:00:00.878430+0000","last_unstale":"2023-10-07T09:00:00.878785+0000","last_undegraded":"2023-10-07T09:00:00.878785+0000","last_fullsized":"2023-10-07T09:00:00.878785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:44.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882816+0000","last_change":"2023-10-07T08:59:59.876825+0000","last_active":"2023-10-07T08:59:59.882816+0000","last_peered":"2023-10-07T08:59:59.882816+0000","last_clean":"2023-10-07T08:59:59.882816+0000","last_became_active":"2023-10-07T08:59:59.876559+0000","last_became_peered":"2023-10-07T08:59:59.876559+0000","last_unstale":"2023-10-07T08:59:59.882816+0000","last_undegraded":"2023-10-07T08:59:59.882816+0000","last_fullsized":"2023-10-07T08:59:59.882816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:21.766641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877562+0000","last_change":"2023-10-07T09:00:00.877647+0000","last_active":"2023-10-07T09:00:00.877562+0000","last_peered":"2023-10-07T09:00:00.877562+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.877358+0000","last_became_peered":"2023-10-07T09:00:00.877358+0000","last_unstale":"2023-10-07T09:00:00.877562+0000","last_undegraded":"2023-10-07T09:00:00.877562+0000","last_fullsized":"2023-10-07T09:00:00.877562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:14.133478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881085+0000","last_change":"2023-10-07T08:59:59.877003+0000","last_active":"2023-10-07T08:59:59.881085+0000","last_peered":"2023-10-07T08:59:59.881085+0000","last_clean":"2023-10-07T08:59:59.881085+0000","last_became_active":"2023-10-07T08:59:59.876690+0000","last_became_peered":"2023-10-07T08:59:59.876690+0000","last_unstale":"2023-10-07T08:59:59.881085+0000","last_undegraded":"2023-10-07T08:59:59.881085+0000","last_fullsized":"2023-10-07T08:59:59.881085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:56.938318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.873423+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:59.873423+0000","last_peered":"2023-10-07T08:59:59.873423+0000","last_clean":"2023-10-07T08:59:59.873423+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:59.873423+0000","last_undegraded":"2023-10-07T08:59:59.873423+0000","last_fullsized":"2023-10-07T08:59:59.873423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.91900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.308},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.377}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.215},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.255}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.307},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.755}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.502},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:05.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:05.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.380+0000 7fad69e22700 1 Processor -- start 2023-10-07T09:00:05.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.380+0000 7fad69e22700 1 -- start start 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69e22700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 0x7fad640b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69e22700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad6415d230 0x7fad6415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69e22700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6415db70 con 0x7fad64159420 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69e22700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b11d0 con 0x7fad6415d230 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69e22700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b14b0 con 0x7fad641597f0 2023-10-07T09:00:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69621700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad6415d230 0x7fad6415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad68e20700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fad64159420 0x7fad640b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33374/0 (socket says 172.21.15.46:33374) 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad68e20700 1 -- 172.21.15.46:0/4080744044 learned_addr learned my addr 172.21.15.46:0/4080744044 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad63fff700 1 --2- 172.21.15.46:0/4080744044 >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 0x7fad640b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69621700 1 -- 172.21.15.46:0/4080744044 >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 msgr2=0x7fad640b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69621700 1 --2- 172.21.15.46:0/4080744044 >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 0x7fad640b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69621700 1 -- 172.21.15.46:0/4080744044 >> v1:172.21.15.46:6789/0 conn(0x7fad64159420 legacy=0x7fad640b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad637fe700 1 -- 172.21.15.46:0/4080744044 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821824435 0 0) 0x7fad6415db70 con 0x7fad64159420 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad69621700 1 -- 172.21.15.46:0/4080744044 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b1790 con 0x7fad6415d230 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.381+0000 7fad63fff700 1 --2- 172.21.15.46:0/4080744044 >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 0x7fad640b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69621700 1 --2- 172.21.15.46:0/4080744044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6415d230 0x7fad6415d630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad64089750 tx=0x7fad5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3095a8e2a0e2f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad637fe700 1 -- 172.21.15.46:0/4080744044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00b6b0 con 0x7fad6415d230 2023-10-07T09:00:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad637fe700 1 -- 172.21.15.46:0/4080744044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00b810 con 0x7fad6415d230 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad637fe700 1 -- 172.21.15.46:0/4080744044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00bbb0 con 0x7fad6415d230 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 -- 172.21.15.46:0/4080744044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6415d230 msgr2=0x7fad6415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 --2- 172.21.15.46:0/4080744044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6415d230 0x7fad6415d630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad64089750 tx=0x7fad5c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 -- 172.21.15.46:0/4080744044 shutdown_connections 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 --2- 172.21.15.46:0/4080744044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6415d230 0x7fad6415d630 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 --2- 172.21.15.46:0/4080744044 >> v2:172.21.15.133:3300/0 conn(0x7fad641597f0 0x7fad640b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 -- 172.21.15.46:0/4080744044 >> 172.21.15.46:0/4080744044 conn(0x7fad640d0660 msgr2=0x7fad640d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 -- 172.21.15.46:0/4080744044 shutdown_connections 2023-10-07T09:00:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.382+0000 7fad69e22700 1 -- 172.21.15.46:0/4080744044 wait complete. 2023-10-07T09:00:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.383+0000 7fad69e22700 1 Processor -- start 2023-10-07T09:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 -- start start 2023-10-07T09:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad64159420 0x7fad6414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6415d230 0x7fad64151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64150ee0 con 0x7fad641597f0 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64150260 con 0x7fad64159420 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad69e22700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64150540 con 0x7fad6415d230 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56910/0 (socket says 172.21.15.46:56910) 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.384+0000 7fad63fff700 1 -- 172.21.15.46:0/2447404573 learned_addr learned my addr 172.21.15.46:0/2447404573 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad68e20700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad64159420 0x7fad6414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad69621700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6415d230 0x7fad64151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 -- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6415d230 msgr2=0x7fad64151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6415d230 0x7fad64151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 -- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad64159420 msgr2=0x7fad6414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad64159420 0x7fad6414c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 -- 172.21.15.46:0/2447404573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009420 con 0x7fad641597f0 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad63fff700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad5400a400 tx=0x7fad540078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54015440 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540155a0 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64150820 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54015940 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.385+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6414fea0 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.386+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64151020 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.387+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad5400d440 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.387+0000 7fad60ff9700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 0x7fad440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.387+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad54084f20 con 0x7fad641597f0 2023-10-07T09:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.387+0000 7fad68e20700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 0x7fad440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.388+0000 7fad68e20700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 0x7fad440693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007fd0 tx=0x7fad4c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.392+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad5404e5a0 con 0x7fad641597f0 2023-10-07T09:00:05.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.579+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad64150a10 con 0x7fad44066f30 2023-10-07T09:00:05.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.587+0000 7fad60ff9700 1 -- 172.21.15.46:0/2447404573 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287217 (secure 0 0 0) 0x7fad64150a10 con 0x7fad44066f30 2023-10-07T09:00:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:05.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 msgr2=0x7fad440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 0x7fad440693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007fd0 tx=0x7fad4c007d30 comp rx=0 tx=0).stop 2023-10-07T09:00:05.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 msgr2=0x7fad64154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad5400a400 tx=0x7fad540078e0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 shutdown_connections 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad44066f30 0x7fad440693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6415d230 0x7fad64151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad64159420 0x7fad6414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 --2- 172.21.15.46:0/2447404573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad641597f0 0x7fad64154340 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.590+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 >> 172.21.15.46:0/2447404573 conn(0x7fad640d0660 msgr2=0x7fad64069340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.591+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 shutdown_connections 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.591+0000 7fad69e22700 1 -- 172.21.15.46:0/2447404573 wait complete. 2023-10-07T09:00:05.597 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:05.604 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-07T09:00:03.782914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3172352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929749"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.868694+0000","last_change":"2023-10-07T09:00:00.868817+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.868694+0000","last_undegraded":"2023-10-07T09:00:00.868694+0000","last_fullsized":"2023-10-07T09:00:00.868694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877084+0000","last_change":"2023-10-07T09:00:00.877084+0000","last_active":"2023-10-07T09:00:00.877084+0000","last_peered":"2023-10-07T09:00:00.877084+0000","last_clean":"2023-10-07T09:00:00.877084+0000","last_became_active":"2023-10-07T09:00:00.876802+0000","last_became_peered":"2023-10-07T09:00:00.876802+0000","last_unstale":"2023-10-07T09:00:00.877084+0000","last_undegraded":"2023-10-07T09:00:00.877084+0000","last_fullsized":"2023-10-07T09:00:00.877084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:44.814877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877110+0000","last_change":"2023-10-07T09:00:00.877258+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877110+0000","last_undegraded":"2023-10-07T09:00:00.877110+0000","last_fullsized":"2023-10-07T09:00:00.877110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871545+0000","last_change":"2023-10-07T09:00:00.872047+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871545+0000","last_undegraded":"2023-10-07T09:00:00.871545+0000","last_fullsized":"2023-10-07T09:00:00.871545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.865994+0000","last_change":"2023-10-07T09:00:00.866157+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.865994+0000","last_undegraded":"2023-10-07T09:00:00.865994+0000","last_fullsized":"2023-10-07T09:00:00.865994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873331+0000","last_change":"2023-10-07T09:00:00.873494+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873331+0000","last_undegraded":"2023-10-07T09:00:00.873331+0000","last_fullsized":"2023-10-07T09:00:00.873331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866693+0000","last_change":"2023-10-07T09:00:00.866830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866693+0000","last_undegraded":"2023-10-07T09:00:00.866693+0000","last_fullsized":"2023-10-07T09:00:00.866693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875755+0000","last_change":"2023-10-07T09:00:00.875825+0000","last_active":"2023-10-07T09:00:00.875755+0000","last_peered":"2023-10-07T09:00:00.875755+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.875535+0000","last_became_peered":"2023-10-07T09:00:00.875535+0000","last_unstale":"2023-10-07T09:00:00.875755+0000","last_undegraded":"2023-10-07T09:00:00.875755+0000","last_fullsized":"2023-10-07T09:00:00.875755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:28.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866577+0000","last_change":"2023-10-07T09:00:00.866723+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866577+0000","last_undegraded":"2023-10-07T09:00:00.866577+0000","last_fullsized":"2023-10-07T09:00:00.866577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863710+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863428+0000","last_change":"2023-10-07T09:00:00.863647+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863428+0000","last_undegraded":"2023-10-07T09:00:00.863428+0000","last_fullsized":"2023-10-07T09:00:00.863428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871500+0000","last_change":"2023-10-07T09:00:00.871633+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871500+0000","last_undegraded":"2023-10-07T09:00:00.871500+0000","last_fullsized":"2023-10-07T09:00:00.871500+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881702+0000","last_change":"2023-10-07T09:00:00.881702+0000","last_active":"2023-10-07T09:00:00.881702+0000","last_peered":"2023-10-07T09:00:00.881702+0000","last_clean":"2023-10-07T09:00:00.881702+0000","last_became_active":"2023-10-07T09:00:00.881391+0000","last_became_peered":"2023-10-07T09:00:00.881391+0000","last_unstale":"2023-10-07T09:00:00.881702+0000","last_undegraded":"2023-10-07T09:00:00.881702+0000","last_fullsized":"2023-10-07T09:00:00.881702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:54.280509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870477+0000","last_change":"2023-10-07T09:00:00.870579+0000","last_active":"2023-10-07T09:00:00.870477+0000","last_peered":"2023-10-07T09:00:00.870477+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870265+0000","last_became_peered":"2023-10-07T09:00:00.870265+0000","last_unstale":"2023-10-07T09:00:00.870477+0000","last_undegraded":"2023-10-07T09:00:00.870477+0000","last_fullsized":"2023-10-07T09:00:00.870477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870675+0000","last_change":"2023-10-07T09:00:00.870744+0000","last_active":"2023-10-07T09:00:00.870675+0000","last_peered":"2023-10-07T09:00:00.870675+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870486+0000","last_became_peered":"2023-10-07T09:00:00.870486+0000","last_unstale":"2023-10-07T09:00:00.870675+0000","last_undegraded":"2023-10-07T09:00:00.870675+0000","last_fullsized":"2023-10-07T09:00:00.870675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871905+0000","last_change":"2023-10-07T09:00:00.872069+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871905+0000","last_undegraded":"2023-10-07T09:00:00.871905+0000","last_fullsized":"2023-10-07T09:00:00.871905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878540+0000","last_change":"2023-10-07T09:00:00.878540+0000","last_active":"2023-10-07T09:00:00.878540+0000","last_peered":"2023-10-07T09:00:00.878540+0000","last_clean":"2023-10-07T09:00:00.878540+0000","last_became_active":"2023-10-07T09:00:00.878251+0000","last_became_peered":"2023-10-07T09:00:00.878251+0000","last_unstale":"2023-10-07T09:00:00.878540+0000","last_undegraded":"2023-10-07T09:00:00.878540+0000","last_fullsized":"2023-10-07T09:00:00.878540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:27.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877134+0000","last_change":"2023-10-07T09:00:00.877270+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877134+0000","last_undegraded":"2023-10-07T09:00:00.877134+0000","last_fullsized":"2023-10-07T09:00:00.877134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866029+0000","last_change":"2023-10-07T09:00:00.866161+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866029+0000","last_undegraded":"2023-10-07T09:00:00.866029+0000","last_fullsized":"2023-10-07T09:00:00.866029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876761+0000","last_change":"2023-10-07T09:00:00.876761+0000","last_active":"2023-10-07T09:00:00.876761+0000","last_peered":"2023-10-07T09:00:00.876761+0000","last_clean":"2023-10-07T09:00:00.876761+0000","last_became_active":"2023-10-07T09:00:00.876442+0000","last_became_peered":"2023-10-07T09:00:00.876442+0000","last_unstale":"2023-10-07T09:00:00.876761+0000","last_undegraded":"2023-10-07T09:00:00.876761+0000","last_fullsized":"2023-10-07T09:00:00.876761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:24.571544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875422+0000","last_change":"2023-10-07T09:00:00.875796+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875422+0000","last_undegraded":"2023-10-07T09:00:00.875422+0000","last_fullsized":"2023-10-07T09:00:00.875422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879332+0000","last_change":"2023-10-07T09:00:00.879332+0000","last_active":"2023-10-07T09:00:00.879332+0000","last_peered":"2023-10-07T09:00:00.879332+0000","last_clean":"2023-10-07T09:00:00.879332+0000","last_became_active":"2023-10-07T09:00:00.876325+0000","last_became_peered":"2023-10-07T09:00:00.876325+0000","last_unstale":"2023-10-07T09:00:00.879332+0000","last_undegraded":"2023-10-07T09:00:00.879332+0000","last_fullsized":"2023-10-07T09:00:00.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:59.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875959+0000","last_change":"2023-10-07T09:00:00.876088+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875959+0000","last_undegraded":"2023-10-07T09:00:00.875959+0000","last_fullsized":"2023-10-07T09:00:00.875959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881737+0000","last_change":"2023-10-07T09:00:00.881737+0000","last_active":"2023-10-07T09:00:00.881737+0000","last_peered":"2023-10-07T09:00:00.881737+0000","last_clean":"2023-10-07T09:00:00.881737+0000","last_became_active":"2023-10-07T09:00:00.881479+0000","last_became_peered":"2023-10-07T09:00:00.881479+0000","last_unstale":"2023-10-07T09:00:00.881737+0000","last_undegraded":"2023-10-07T09:00:00.881737+0000","last_fullsized":"2023-10-07T09:00:00.881737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:33.628371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873185+0000","last_change":"2023-10-07T09:00:00.873185+0000","last_active":"2023-10-07T09:00:00.873185+0000","last_peered":"2023-10-07T09:00:00.873185+0000","last_clean":"2023-10-07T09:00:00.873185+0000","last_became_active":"2023-10-07T09:00:00.872874+0000","last_became_peered":"2023-10-07T09:00:00.872874+0000","last_unstale":"2023-10-07T09:00:00.873185+0000","last_undegraded":"2023-10-07T09:00:00.873185+0000","last_fullsized":"2023-10-07T09:00:00.873185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:25:15.529282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871120+0000","last_change":"2023-10-07T09:00:00.871263+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871120+0000","last_undegraded":"2023-10-07T09:00:00.871120+0000","last_fullsized":"2023-10-07T09:00:00.871120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873365+0000","last_change":"2023-10-07T09:00:00.873460+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873365+0000","last_undegraded":"2023-10-07T09:00:00.873365+0000","last_fullsized":"2023-10-07T09:00:00.873365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866015+0000","last_change":"2023-10-07T09:00:00.866363+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866015+0000","last_undegraded":"2023-10-07T09:00:00.866015+0000","last_fullsized":"2023-10-07T09:00:00.866015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878311+0000","last_change":"2023-10-07T09:00:00.878311+0000","last_active":"2023-10-07T09:00:00.878311+0000","last_peered":"2023-10-07T09:00:00.878311+0000","last_clean":"2023-10-07T09:00:00.878311+0000","last_became_active":"2023-10-07T09:00:00.877748+0000","last_became_peered":"2023-10-07T09:00:00.877748+0000","last_unstale":"2023-10-07T09:00:00.878311+0000","last_undegraded":"2023-10-07T09:00:00.878311+0000","last_fullsized":"2023-10-07T09:00:00.878311+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:50.858102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875440+0000","last_change":"2023-10-07T09:00:00.875586+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875440+0000","last_undegraded":"2023-10-07T09:00:00.875440+0000","last_fullsized":"2023-10-07T09:00:00.875440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870666+0000","last_change":"2023-10-07T09:00:00.870666+0000","last_active":"2023-10-07T09:00:00.870666+0000","last_peered":"2023-10-07T09:00:00.870666+0000","last_clean":"2023-10-07T09:00:00.870666+0000","last_became_active":"2023-10-07T09:00:00.870437+0000","last_became_peered":"2023-10-07T09:00:00.870437+0000","last_unstale":"2023-10-07T09:00:00.870666+0000","last_undegraded":"2023-10-07T09:00:00.870666+0000","last_fullsized":"2023-10-07T09:00:00.870666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:09.591539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873428+0000","last_change":"2023-10-07T09:00:00.873570+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873428+0000","last_undegraded":"2023-10-07T09:00:00.873428+0000","last_fullsized":"2023-10-07T09:00:00.873428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872150+0000","last_change":"2023-10-07T09:00:00.872271+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872150+0000","last_undegraded":"2023-10-07T09:00:00.872150+0000","last_fullsized":"2023-10-07T09:00:00.872150+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882661+0000","last_change":"2023-10-07T08:59:59.878882+0000","last_active":"2023-10-07T08:59:59.882661+0000","last_peered":"2023-10-07T08:59:59.882661+0000","last_clean":"2023-10-07T08:59:59.882661+0000","last_became_active":"2023-10-07T08:59:59.878576+0000","last_became_peered":"2023-10-07T08:59:59.878576+0000","last_unstale":"2023-10-07T08:59:59.882661+0000","last_undegraded":"2023-10-07T08:59:59.882661+0000","last_fullsized":"2023-10-07T08:59:59.882661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:37.738910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863540+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882871+0000","last_change":"2023-10-07T08:59:59.877825+0000","last_active":"2023-10-07T08:59:59.882871+0000","last_peered":"2023-10-07T08:59:59.882871+0000","last_clean":"2023-10-07T08:59:59.882871+0000","last_became_active":"2023-10-07T08:59:59.877566+0000","last_became_peered":"2023-10-07T08:59:59.877566+0000","last_unstale":"2023-10-07T08:59:59.882871+0000","last_undegraded":"2023-10-07T08:59:59.882871+0000","last_fullsized":"2023-10-07T08:59:59.882871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:36.032547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872136+0000","last_change":"2023-10-07T09:00:00.873538+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872136+0000","last_undegraded":"2023-10-07T09:00:00.872136+0000","last_fullsized":"2023-10-07T09:00:00.872136+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.872832+0000","last_change":"2023-10-07T08:59:59.871943+0000","last_active":"2023-10-07T08:59:59.872832+0000","last_peered":"2023-10-07T08:59:59.872832+0000","last_clean":"2023-10-07T08:59:59.872832+0000","last_became_active":"2023-10-07T08:59:59.871526+0000","last_became_peered":"2023-10-07T08:59:59.871526+0000","last_unstale":"2023-10-07T08:59:59.872832+0000","last_undegraded":"2023-10-07T08:59:59.872832+0000","last_fullsized":"2023-10-07T08:59:59.872832+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:46:43.375628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873044+0000","last_change":"2023-10-07T09:00:00.873167+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873044+0000","last_undegraded":"2023-10-07T09:00:00.873044+0000","last_fullsized":"2023-10-07T09:00:00.873044+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881897+0000","last_change":"2023-10-07T08:59:59.879585+0000","last_active":"2023-10-07T08:59:59.881897+0000","last_peered":"2023-10-07T08:59:59.881897+0000","last_clean":"2023-10-07T08:59:59.881897+0000","last_became_active":"2023-10-07T08:59:59.879308+0000","last_became_peered":"2023-10-07T08:59:59.879308+0000","last_unstale":"2023-10-07T08:59:59.881897+0000","last_undegraded":"2023-10-07T08:59:59.881897+0000","last_fullsized":"2023-10-07T08:59:59.881897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876182+0000","last_change":"2023-10-07T09:00:00.876182+0000","last_active":"2023-10-07T09:00:00.876182+0000","last_peered":"2023-10-07T09:00:00.876182+0000","last_clean":"2023-10-07T09:00:00.876182+0000","last_became_active":"2023-10-07T09:00:00.875935+0000","last_became_peered":"2023-10-07T09:00:00.875935+0000","last_unstale":"2023-10-07T09:00:00.876182+0000","last_undegraded":"2023-10-07T09:00:00.876182+0000","last_fullsized":"2023-10-07T09:00:00.876182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:21.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881505+0000","last_change":"2023-10-07T08:59:59.878940+0000","last_active":"2023-10-07T08:59:59.881505+0000","last_peered":"2023-10-07T08:59:59.881505+0000","last_clean":"2023-10-07T08:59:59.881505+0000","last_became_active":"2023-10-07T08:59:59.878645+0000","last_became_peered":"2023-10-07T08:59:59.878645+0000","last_unstale":"2023-10-07T08:59:59.881505+0000","last_undegraded":"2023-10-07T08:59:59.881505+0000","last_fullsized":"2023-10-07T08:59:59.881505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:35.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878509+0000","last_change":"2023-10-07T09:00:00.878509+0000","last_active":"2023-10-07T09:00:00.878509+0000","last_peered":"2023-10-07T09:00:00.878509+0000","last_clean":"2023-10-07T09:00:00.878509+0000","last_became_active":"2023-10-07T09:00:00.878039+0000","last_became_peered":"2023-10-07T09:00:00.878039+0000","last_unstale":"2023-10-07T09:00:00.878509+0000","last_undegraded":"2023-10-07T09:00:00.878509+0000","last_fullsized":"2023-10-07T09:00:00.878509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:21.720280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882685+0000","last_change":"2023-10-07T08:59:59.881718+0000","last_active":"2023-10-07T08:59:59.882685+0000","last_peered":"2023-10-07T08:59:59.882685+0000","last_clean":"2023-10-07T08:59:59.882685+0000","last_became_active":"2023-10-07T08:59:59.881423+0000","last_became_peered":"2023-10-07T08:59:59.881423+0000","last_unstale":"2023-10-07T08:59:59.882685+0000","last_undegraded":"2023-10-07T08:59:59.882685+0000","last_fullsized":"2023-10-07T08:59:59.882685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881579+0000","last_change":"2023-10-07T09:00:00.881579+0000","last_active":"2023-10-07T09:00:00.881579+0000","last_peered":"2023-10-07T09:00:00.881579+0000","last_clean":"2023-10-07T09:00:00.881579+0000","last_became_active":"2023-10-07T09:00:00.881316+0000","last_became_peered":"2023-10-07T09:00:00.881316+0000","last_unstale":"2023-10-07T09:00:00.881579+0000","last_undegraded":"2023-10-07T09:00:00.881579+0000","last_fullsized":"2023-10-07T09:00:00.881579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:38:07.420548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881728+0000","last_change":"2023-10-07T08:59:59.877239+0000","last_active":"2023-10-07T08:59:59.881728+0000","last_peered":"2023-10-07T08:59:59.881728+0000","last_clean":"2023-10-07T08:59:59.881728+0000","last_became_active":"2023-10-07T08:59:59.876953+0000","last_became_peered":"2023-10-07T08:59:59.876953+0000","last_unstale":"2023-10-07T08:59:59.881728+0000","last_undegraded":"2023-10-07T08:59:59.881728+0000","last_fullsized":"2023-10-07T08:59:59.881728+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879470+0000","last_change":"2023-10-07T09:00:00.879470+0000","last_active":"2023-10-07T09:00:00.879470+0000","last_peered":"2023-10-07T09:00:00.879470+0000","last_clean":"2023-10-07T09:00:00.879470+0000","last_became_active":"2023-10-07T09:00:00.878300+0000","last_became_peered":"2023-10-07T09:00:00.878300+0000","last_unstale":"2023-10-07T09:00:00.879470+0000","last_undegraded":"2023-10-07T09:00:00.879470+0000","last_fullsized":"2023-10-07T09:00:00.879470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:29.483543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881353+0000","last_change":"2023-10-07T08:59:59.877871+0000","last_active":"2023-10-07T08:59:59.881353+0000","last_peered":"2023-10-07T08:59:59.881353+0000","last_clean":"2023-10-07T08:59:59.881353+0000","last_became_active":"2023-10-07T08:59:59.877531+0000","last_became_peered":"2023-10-07T08:59:59.877531+0000","last_unstale":"2023-10-07T08:59:59.881353+0000","last_undegraded":"2023-10-07T08:59:59.881353+0000","last_fullsized":"2023-10-07T08:59:59.881353+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:32.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873973+0000","last_change":"2023-10-07T09:00:00.874063+0000","last_active":"2023-10-07T09:00:00.873973+0000","last_peered":"2023-10-07T09:00:00.873973+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.873760+0000","last_became_peered":"2023-10-07T09:00:00.873760+0000","last_unstale":"2023-10-07T09:00:00.873973+0000","last_undegraded":"2023-10-07T09:00:00.873973+0000","last_fullsized":"2023-10-07T09:00:00.873973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882862+0000","last_change":"2023-10-07T08:59:59.882862+0000","last_active":"2023-10-07T08:59:59.882862+0000","last_peered":"2023-10-07T08:59:59.882862+0000","last_clean":"2023-10-07T08:59:59.882862+0000","last_became_active":"2023-10-07T08:59:59.882624+0000","last_became_peered":"2023-10-07T08:59:59.882624+0000","last_unstale":"2023-10-07T08:59:59.882862+0000","last_undegraded":"2023-10-07T08:59:59.882862+0000","last_fullsized":"2023-10-07T08:59:59.882862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:59:59.852436+0000","last_change":"2023-10-07T08:59:59.867558+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:59.852436+0000","last_undegraded":"2023-10-07T08:59:59.852436+0000","last_fullsized":"2023-10-07T08:59:59.852436+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:22.118543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882894+0000","last_change":"2023-10-07T08:59:59.878792+0000","last_active":"2023-10-07T08:59:59.882894+0000","last_peered":"2023-10-07T08:59:59.882894+0000","last_clean":"2023-10-07T08:59:59.882894+0000","last_became_active":"2023-10-07T08:59:59.878532+0000","last_became_peered":"2023-10-07T08:59:59.878532+0000","last_unstale":"2023-10-07T08:59:59.882894+0000","last_undegraded":"2023-10-07T08:59:59.882894+0000","last_fullsized":"2023-10-07T08:59:59.882894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:06.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869524+0000","last_change":"2023-10-07T09:00:00.869524+0000","last_active":"2023-10-07T09:00:00.869524+0000","last_peered":"2023-10-07T09:00:00.869524+0000","last_clean":"2023-10-07T09:00:00.869524+0000","last_became_active":"2023-10-07T09:00:00.868923+0000","last_became_peered":"2023-10-07T09:00:00.868923+0000","last_unstale":"2023-10-07T09:00:00.869524+0000","last_undegraded":"2023-10-07T09:00:00.869524+0000","last_fullsized":"2023-10-07T09:00:00.869524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883637+0000","last_change":"2023-10-07T08:59:59.881364+0000","last_active":"2023-10-07T08:59:59.883637+0000","last_peered":"2023-10-07T08:59:59.883637+0000","last_clean":"2023-10-07T08:59:59.883637+0000","last_became_active":"2023-10-07T08:59:59.881095+0000","last_became_peered":"2023-10-07T08:59:59.881095+0000","last_unstale":"2023-10-07T08:59:59.883637+0000","last_undegraded":"2023-10-07T08:59:59.883637+0000","last_fullsized":"2023-10-07T08:59:59.883637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877508+0000","last_change":"2023-10-07T09:00:00.877638+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877508+0000","last_undegraded":"2023-10-07T09:00:00.877508+0000","last_fullsized":"2023-10-07T09:00:00.877508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881251+0000","last_change":"2023-10-07T08:59:59.873067+0000","last_active":"2023-10-07T08:59:59.881251+0000","last_peered":"2023-10-07T08:59:59.881251+0000","last_clean":"2023-10-07T08:59:59.881251+0000","last_became_active":"2023-10-07T08:59:59.872789+0000","last_became_peered":"2023-10-07T08:59:59.872789+0000","last_unstale":"2023-10-07T08:59:59.881251+0000","last_undegraded":"2023-10-07T08:59:59.881251+0000","last_fullsized":"2023-10-07T08:59:59.881251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870941+0000","last_change":"2023-10-07T09:00:00.871072+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870941+0000","last_undegraded":"2023-10-07T09:00:00.870941+0000","last_fullsized":"2023-10-07T09:00:00.870941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883479+0000","last_change":"2023-10-07T08:59:59.880786+0000","last_active":"2023-10-07T08:59:59.883479+0000","last_peered":"2023-10-07T08:59:59.883479+0000","last_clean":"2023-10-07T08:59:59.883479+0000","last_became_active":"2023-10-07T08:59:59.880534+0000","last_became_peered":"2023-10-07T08:59:59.880534+0000","last_unstale":"2023-10-07T08:59:59.883479+0000","last_undegraded":"2023-10-07T08:59:59.883479+0000","last_fullsized":"2023-10-07T08:59:59.883479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:33.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875570+0000","last_change":"2023-10-07T09:00:00.875693+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875570+0000","last_undegraded":"2023-10-07T09:00:00.875570+0000","last_fullsized":"2023-10-07T09:00:00.875570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878077+0000","last_change":"2023-10-07T08:59:59.871360+0000","last_active":"2023-10-07T08:59:59.878077+0000","last_peered":"2023-10-07T08:59:59.878077+0000","last_clean":"2023-10-07T08:59:59.878077+0000","last_became_active":"2023-10-07T08:59:59.871077+0000","last_became_peered":"2023-10-07T08:59:59.871077+0000","last_unstale":"2023-10-07T08:59:59.878077+0000","last_undegraded":"2023-10-07T08:59:59.878077+0000","last_fullsized":"2023-10-07T08:59:59.878077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:25.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866397+0000","last_change":"2023-10-07T09:00:00.866546+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866397+0000","last_undegraded":"2023-10-07T09:00:00.866397+0000","last_fullsized":"2023-10-07T09:00:00.866397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881929+0000","last_change":"2023-10-07T08:59:59.879657+0000","last_active":"2023-10-07T08:59:59.881929+0000","last_peered":"2023-10-07T08:59:59.881929+0000","last_clean":"2023-10-07T08:59:59.881929+0000","last_became_active":"2023-10-07T08:59:59.879372+0000","last_became_peered":"2023-10-07T08:59:59.879372+0000","last_unstale":"2023-10-07T08:59:59.881929+0000","last_undegraded":"2023-10-07T08:59:59.881929+0000","last_fullsized":"2023-10-07T08:59:59.881929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.876296+0000","last_change":"2023-10-07T09:00:00.876419+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.876296+0000","last_undegraded":"2023-10-07T09:00:00.876296+0000","last_fullsized":"2023-10-07T09:00:00.876296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.886344+0000","last_change":"2023-10-07T08:59:59.882300+0000","last_active":"2023-10-07T08:59:59.886344+0000","last_peered":"2023-10-07T08:59:59.886344+0000","last_clean":"2023-10-07T08:59:59.886344+0000","last_became_active":"2023-10-07T08:59:59.882025+0000","last_became_peered":"2023-10-07T08:59:59.882025+0000","last_unstale":"2023-10-07T08:59:59.886344+0000","last_undegraded":"2023-10-07T08:59:59.886344+0000","last_fullsized":"2023-10-07T08:59:59.886344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877479+0000","last_change":"2023-10-07T09:00:00.877624+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877479+0000","last_undegraded":"2023-10-07T09:00:00.877479+0000","last_fullsized":"2023-10-07T09:00:00.877479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882975+0000","last_change":"2023-10-07T08:59:59.880542+0000","last_active":"2023-10-07T08:59:59.882975+0000","last_peered":"2023-10-07T08:59:59.882975+0000","last_clean":"2023-10-07T08:59:59.882975+0000","last_became_active":"2023-10-07T08:59:59.880259+0000","last_became_peered":"2023-10-07T08:59:59.880259+0000","last_unstale":"2023-10-07T08:59:59.882975+0000","last_undegraded":"2023-10-07T08:59:59.882975+0000","last_fullsized":"2023-10-07T08:59:59.882975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:27.985062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870587+0000","last_change":"2023-10-07T09:00:00.870830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870587+0000","last_undegraded":"2023-10-07T09:00:00.870587+0000","last_fullsized":"2023-10-07T09:00:00.870587+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882692+0000","last_change":"2023-10-07T08:59:59.879711+0000","last_active":"2023-10-07T08:59:59.882692+0000","last_peered":"2023-10-07T08:59:59.882692+0000","last_clean":"2023-10-07T08:59:59.882692+0000","last_became_active":"2023-10-07T08:59:59.879410+0000","last_became_peered":"2023-10-07T08:59:59.879410+0000","last_unstale":"2023-10-07T08:59:59.882692+0000","last_undegraded":"2023-10-07T08:59:59.882692+0000","last_fullsized":"2023-10-07T08:59:59.882692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:53.114711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874020+0000","last_change":"2023-10-07T09:00:00.874020+0000","last_active":"2023-10-07T09:00:00.874020+0000","last_peered":"2023-10-07T09:00:00.874020+0000","last_clean":"2023-10-07T09:00:00.874020+0000","last_became_active":"2023-10-07T09:00:00.873739+0000","last_became_peered":"2023-10-07T09:00:00.873739+0000","last_unstale":"2023-10-07T09:00:00.874020+0000","last_undegraded":"2023-10-07T09:00:00.874020+0000","last_fullsized":"2023-10-07T09:00:00.874020+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:12.366488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881914+0000","last_change":"2023-10-07T08:59:59.879611+0000","last_active":"2023-10-07T08:59:59.881914+0000","last_peered":"2023-10-07T08:59:59.881914+0000","last_clean":"2023-10-07T08:59:59.881914+0000","last_became_active":"2023-10-07T08:59:59.879301+0000","last_became_peered":"2023-10-07T08:59:59.879301+0000","last_unstale":"2023-10-07T08:59:59.881914+0000","last_undegraded":"2023-10-07T08:59:59.881914+0000","last_fullsized":"2023-10-07T08:59:59.881914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:34.395138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877849+0000","last_change":"2023-10-07T09:00:00.877970+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877849+0000","last_undegraded":"2023-10-07T09:00:00.877849+0000","last_fullsized":"2023-10-07T09:00:00.877849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.884007+0000","last_change":"2023-10-07T08:59:59.882939+0000","last_active":"2023-10-07T08:59:59.884007+0000","last_peered":"2023-10-07T08:59:59.884007+0000","last_clean":"2023-10-07T08:59:59.884007+0000","last_became_active":"2023-10-07T08:59:59.882525+0000","last_became_peered":"2023-10-07T08:59:59.882525+0000","last_unstale":"2023-10-07T08:59:59.884007+0000","last_undegraded":"2023-10-07T08:59:59.884007+0000","last_fullsized":"2023-10-07T08:59:59.884007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:27.723456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870534+0000","last_change":"2023-10-07T09:00:00.870726+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870534+0000","last_undegraded":"2023-10-07T09:00:00.870534+0000","last_fullsized":"2023-10-07T09:00:00.870534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882924+0000","last_change":"2023-10-07T08:59:59.876486+0000","last_active":"2023-10-07T08:59:59.882924+0000","last_peered":"2023-10-07T08:59:59.882924+0000","last_clean":"2023-10-07T08:59:59.882924+0000","last_became_active":"2023-10-07T08:59:59.876139+0000","last_became_peered":"2023-10-07T08:59:59.876139+0000","last_unstale":"2023-10-07T08:59:59.882924+0000","last_undegraded":"2023-10-07T08:59:59.882924+0000","last_fullsized":"2023-10-07T08:59:59.882924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:06.252338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872333+0000","last_change":"2023-10-07T09:00:00.872464+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872333+0000","last_undegraded":"2023-10-07T09:00:00.872333+0000","last_fullsized":"2023-10-07T09:00:00.872333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879743+0000","last_change":"2023-10-07T08:59:59.877521+0000","last_active":"2023-10-07T08:59:59.879743+0000","last_peered":"2023-10-07T08:59:59.879743+0000","last_clean":"2023-10-07T08:59:59.879743+0000","last_became_active":"2023-10-07T08:59:59.877269+0000","last_became_peered":"2023-10-07T08:59:59.877269+0000","last_unstale":"2023-10-07T08:59:59.879743+0000","last_undegraded":"2023-10-07T08:59:59.879743+0000","last_fullsized":"2023-10-07T08:59:59.879743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:28.720828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871913+0000","last_change":"2023-10-07T09:00:00.872070+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871913+0000","last_undegraded":"2023-10-07T09:00:00.871913+0000","last_fullsized":"2023-10-07T09:00:00.871913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881841+0000","last_change":"2023-10-07T08:59:59.878211+0000","last_active":"2023-10-07T08:59:59.881841+0000","last_peered":"2023-10-07T08:59:59.881841+0000","last_clean":"2023-10-07T08:59:59.881841+0000","last_became_active":"2023-10-07T08:59:59.877912+0000","last_became_peered":"2023-10-07T08:59:59.877912+0000","last_unstale":"2023-10-07T08:59:59.881841+0000","last_undegraded":"2023-10-07T08:59:59.881841+0000","last_fullsized":"2023-10-07T08:59:59.881841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:02.674160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871110+0000","last_change":"2023-10-07T09:00:00.871279+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871110+0000","last_undegraded":"2023-10-07T09:00:00.871110+0000","last_fullsized":"2023-10-07T09:00:00.871110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879696+0000","last_change":"2023-10-07T08:59:59.877982+0000","last_active":"2023-10-07T08:59:59.879696+0000","last_peered":"2023-10-07T08:59:59.879696+0000","last_clean":"2023-10-07T08:59:59.879696+0000","last_became_active":"2023-10-07T08:59:59.877677+0000","last_became_peered":"2023-10-07T08:59:59.877677+0000","last_unstale":"2023-10-07T08:59:59.879696+0000","last_undegraded":"2023-10-07T08:59:59.879696+0000","last_fullsized":"2023-10-07T08:59:59.879696+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:04.391970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870659+0000","last_change":"2023-10-07T09:00:00.870848+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870659+0000","last_undegraded":"2023-10-07T09:00:00.870659+0000","last_fullsized":"2023-10-07T09:00:00.870659+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882132+0000","last_change":"2023-10-07T08:59:59.873692+0000","last_active":"2023-10-07T08:59:59.882132+0000","last_peered":"2023-10-07T08:59:59.882132+0000","last_clean":"2023-10-07T08:59:59.882132+0000","last_became_active":"2023-10-07T08:59:59.873416+0000","last_became_peered":"2023-10-07T08:59:59.873416+0000","last_unstale":"2023-10-07T08:59:59.882132+0000","last_undegraded":"2023-10-07T08:59:59.882132+0000","last_fullsized":"2023-10-07T08:59:59.882132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:05.503904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869702+0000","last_change":"2023-10-07T09:00:00.869702+0000","last_active":"2023-10-07T09:00:00.869702+0000","last_peered":"2023-10-07T09:00:00.869702+0000","last_clean":"2023-10-07T09:00:00.869702+0000","last_became_active":"2023-10-07T09:00:00.869276+0000","last_became_peered":"2023-10-07T09:00:00.869276+0000","last_unstale":"2023-10-07T09:00:00.869702+0000","last_undegraded":"2023-10-07T09:00:00.869702+0000","last_fullsized":"2023-10-07T09:00:00.869702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878000+0000","last_change":"2023-10-07T08:59:59.870863+0000","last_active":"2023-10-07T08:59:59.878000+0000","last_peered":"2023-10-07T08:59:59.878000+0000","last_clean":"2023-10-07T08:59:59.878000+0000","last_became_active":"2023-10-07T08:59:59.870553+0000","last_became_peered":"2023-10-07T08:59:59.870553+0000","last_unstale":"2023-10-07T08:59:59.878000+0000","last_undegraded":"2023-10-07T08:59:59.878000+0000","last_fullsized":"2023-10-07T08:59:59.878000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:25.612939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872655+0000","last_change":"2023-10-07T09:00:00.872820+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872655+0000","last_undegraded":"2023-10-07T09:00:00.872655+0000","last_fullsized":"2023-10-07T09:00:00.872655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881847+0000","last_change":"2023-10-07T08:59:59.877544+0000","last_active":"2023-10-07T08:59:59.881847+0000","last_peered":"2023-10-07T08:59:59.881847+0000","last_clean":"2023-10-07T08:59:59.881847+0000","last_became_active":"2023-10-07T08:59:59.876631+0000","last_became_peered":"2023-10-07T08:59:59.876631+0000","last_unstale":"2023-10-07T08:59:59.881847+0000","last_undegraded":"2023-10-07T08:59:59.881847+0000","last_fullsized":"2023-10-07T08:59:59.881847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876334+0000","last_change":"2023-10-07T09:00:00.876334+0000","last_active":"2023-10-07T09:00:00.876334+0000","last_peered":"2023-10-07T09:00:00.876334+0000","last_clean":"2023-10-07T09:00:00.876334+0000","last_became_active":"2023-10-07T09:00:00.876055+0000","last_became_peered":"2023-10-07T09:00:00.876055+0000","last_unstale":"2023-10-07T09:00:00.876334+0000","last_undegraded":"2023-10-07T09:00:00.876334+0000","last_fullsized":"2023-10-07T09:00:00.876334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:05.377189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879769+0000","last_change":"2023-10-07T08:59:59.878174+0000","last_active":"2023-10-07T08:59:59.879769+0000","last_peered":"2023-10-07T08:59:59.879769+0000","last_clean":"2023-10-07T08:59:59.879769+0000","last_became_active":"2023-10-07T08:59:59.877621+0000","last_became_peered":"2023-10-07T08:59:59.877621+0000","last_unstale":"2023-10-07T08:59:59.879769+0000","last_undegraded":"2023-10-07T08:59:59.879769+0000","last_fullsized":"2023-10-07T08:59:59.879769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875885+0000","last_change":"2023-10-07T09:00:00.876001+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875885+0000","last_undegraded":"2023-10-07T09:00:00.875885+0000","last_fullsized":"2023-10-07T09:00:00.875885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.876448+0000","last_change":"2023-10-07T08:59:59.872199+0000","last_active":"2023-10-07T08:59:59.876448+0000","last_peered":"2023-10-07T08:59:59.876448+0000","last_clean":"2023-10-07T08:59:59.876448+0000","last_became_active":"2023-10-07T08:59:59.871880+0000","last_became_peered":"2023-10-07T08:59:59.871880+0000","last_unstale":"2023-10-07T08:59:59.876448+0000","last_undegraded":"2023-10-07T08:59:59.876448+0000","last_fullsized":"2023-10-07T08:59:59.876448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863213+0000","last_change":"2023-10-07T09:00:00.863417+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863213+0000","last_undegraded":"2023-10-07T09:00:00.863213+0000","last_fullsized":"2023-10-07T09:00:00.863213+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.875014+0000","last_change":"2023-10-07T08:59:59.873447+0000","last_active":"2023-10-07T08:59:59.875014+0000","last_peered":"2023-10-07T08:59:59.875014+0000","last_clean":"2023-10-07T08:59:59.875014+0000","last_became_active":"2023-10-07T08:59:59.873072+0000","last_became_peered":"2023-10-07T08:59:59.873072+0000","last_unstale":"2023-10-07T08:59:59.875014+0000","last_undegraded":"2023-10-07T08:59:59.875014+0000","last_fullsized":"2023-10-07T08:59:59.875014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878785+0000","last_change":"2023-10-07T09:00:00.878785+0000","last_active":"2023-10-07T09:00:00.878785+0000","last_peered":"2023-10-07T09:00:00.878785+0000","last_clean":"2023-10-07T09:00:00.878785+0000","last_became_active":"2023-10-07T09:00:00.878430+0000","last_became_peered":"2023-10-07T09:00:00.878430+0000","last_unstale":"2023-10-07T09:00:00.878785+0000","last_undegraded":"2023-10-07T09:00:00.878785+0000","last_fullsized":"2023-10-07T09:00:00.878785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:44.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882816+0000","last_change":"2023-10-07T08:59:59.876825+0000","last_active":"2023-10-07T08:59:59.882816+0000","last_peered":"2023-10-07T08:59:59.882816+0000","last_clean":"2023-10-07T08:59:59.882816+0000","last_became_active":"2023-10-07T08:59:59.876559+0000","last_became_peered":"2023-10-07T08:59:59.876559+0000","last_unstale":"2023-10-07T08:59:59.882816+0000","last_undegraded":"2023-10-07T08:59:59.882816+0000","last_fullsized":"2023-10-07T08:59:59.882816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:21.766641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877562+0000","last_change":"2023-10-07T09:00:00.877647+0000","last_active":"2023-10-07T09:00:00.877562+0000","last_peered":"2023-10-07T09:00:00.877562+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.877358+0000","last_became_peered":"2023-10-07T09:00:00.877358+0000","last_unstale":"2023-10-07T09:00:00.877562+0000","last_undegraded":"2023-10-07T09:00:00.877562+0000","last_fullsized":"2023-10-07T09:00:00.877562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:14.133478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881085+0000","last_change":"2023-10-07T08:59:59.877003+0000","last_active":"2023-10-07T08:59:59.881085+0000","last_peered":"2023-10-07T08:59:59.881085+0000","last_clean":"2023-10-07T08:59:59.881085+0000","last_became_active":"2023-10-07T08:59:59.876690+0000","last_became_peered":"2023-10-07T08:59:59.876690+0000","last_unstale":"2023-10-07T08:59:59.881085+0000","last_undegraded":"2023-10-07T08:59:59.881085+0000","last_fullsized":"2023-10-07T08:59:59.881085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:56.938318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.873423+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:59.873423+0000","last_peered":"2023-10-07T08:59:59.873423+0000","last_clean":"2023-10-07T08:59:59.873423+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:59.873423+0000","last_undegraded":"2023-10-07T08:59:59.873423+0000","last_fullsized":"2023-10-07T08:59:59.873423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.91900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.308},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.377}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.215},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.255}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.307},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.755}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.502},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:05.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.762+0000 7f4efae5c700 1 Processor -- start 2023-10-07T09:00:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.762+0000 7f4efae5c700 1 -- start start 2023-10-07T09:00:05.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4efae5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ef406bcd0 0x7f4ef40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4efae5c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef415d7e0 con 0x7f4ef415df50 2023-10-07T09:00:05.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4efae5c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef415dac0 con 0x7f4ef406c0a0 2023-10-07T09:00:05.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4efae5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef415aa30 con 0x7f4ef406bcd0 2023-10-07T09:00:05.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4ef93f9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4ef415df50 0x7f4ef40c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33376/0 (socket says 172.21.15.46:33376) 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4ef93f9700 1 -- 172.21.15.46:0/1657268958 learned_addr learned my addr 172.21.15.46:0/1657268958 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4ef8bf8700 1 --2- 172.21.15.46:0/1657268958 >> v2:172.21.15.133:3300/0 conn(0x7f4ef406bcd0 0x7f4ef40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138214173 0 0) 0x7f4ef415d7e0 con 0x7f4ef415df50 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.763+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee0003570 con 0x7f4ef415df50 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433495442 0 0) 0x7f4ee0003570 con 0x7f4ef415df50 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 >> v2:172.21.15.133:3300/0 conn(0x7f4ef406bcd0 msgr2=0x7f4ef40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 --2- 172.21.15.46:0/1657268958 >> v2:172.21.15.133:3300/0 conn(0x7f4ef406bcd0 0x7f4ef40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 >> v1:172.21.15.133:6789/0 conn(0x7f4ef406c0a0 legacy=0x7f4ef415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef415ad10 con 0x7f4ef415df50 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4eec001470 con 0x7f4ef415df50 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 >> v1:172.21.15.46:6789/0 conn(0x7f4ef415df50 legacy=0x7f4ef40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ee0003a60 0x7f4ee0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 0x7f4ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee00052e0 0x7f4ee000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef415aa30 con 0x7f4ee0004810 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee000c2a0 con 0x7f4ee0003a60 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee000c460 con 0x7f4ee00052e0 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 0x7f4ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef8bf8700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ee0003a60 0x7f4ee0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef93f9700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee00052e0 0x7f4ee000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee00052e0 msgr2=0x7f4ee000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee00052e0 0x7f4ee000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ee0003a60 msgr2=0x7f4ee0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ee0003a60 0x7f4ee0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1657268958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0003570 con 0x7f4ee0004810 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef93f9700 1 -- 172.21.15.46:0/1657268958 reap_dead start 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.764+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 0x7f4ee0004c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001fc0 tx=0x7f4ee4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e772862881c540c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4001950 con 0x7f4ee0004810 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400c8b0 con 0x7f4ee0004810 2023-10-07T09:00:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4ef37fe700 1 -- 172.21.15.46:0/1657268958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400cc50 con 0x7f4ee0004810 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 -- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 msgr2=0x7f4ee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 0x7f4ee0004c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001fc0 tx=0x7f4ee4001640 comp rx=0 tx=0).stop 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 -- 172.21.15.46:0/1657268958 shutdown_connections 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1657268958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ee0004810 0x7f4ee0004c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 -- 172.21.15.46:0/1657268958 >> 172.21.15.46:0/1657268958 conn(0x7f4ef40ce600 msgr2=0x7f4ef40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 -- 172.21.15.46:0/1657268958 shutdown_connections 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.765+0000 7f4efae5c700 1 -- 172.21.15.46:0/1657268958 wait complete. 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.766+0000 7f4efae5c700 1 Processor -- start 2023-10-07T09:00:05.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.766+0000 7f4efae5c700 1 -- start start 2023-10-07T09:00:05.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee0004810 0x7f4ef4159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 0x7f4ef414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4169ee0 con 0x7f4ef416abd0 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef416a740 con 0x7f4ef4154e40 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4efae5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef41553c0 con 0x7f4ee0004810 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56930/0 (socket says 172.21.15.46:56930) 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1469264797 learned_addr learned my addr 172.21.15.46:0/1469264797 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4ef8bf8700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee0004810 0x7f4ef4159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.767+0000 7f4ef93f9700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 0x7f4ef414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee0004810 msgr2=0x7f4ef4159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee0004810 0x7f4ef4159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 msgr2=0x7f4ef414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 0x7f4ef414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 -- 172.21.15.46:0/1469264797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef416a0f0 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef93f9700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 0x7f4ef414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef3fff700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c6a0 tx=0x7f4ee4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4001950 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400c6d0 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef416a3d0 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4026630 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.768+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4154560 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.769+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef416a8d0 con 0x7f4ef416abd0 2023-10-07T09:00:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.769+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ee4019030 con 0x7f4ef416abd0 2023-10-07T09:00:05.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.770+0000 7f4ef0ff9700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:05.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.770+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ee40860b0 con 0x7f4ef416abd0 2023-10-07T09:00:05.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.770+0000 7f4ef8bf8700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:05.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.770+0000 7f4ef8bf8700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4edc006f00 tx=0x7f4edc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:05.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.774+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ee4053320 con 0x7f4ef416abd0 2023-10-07T09:00:05.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.967+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ef404c3c0 con 0x7f4ed4066f30 2023-10-07T09:00:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.976+0000 7f4ef0ff9700 1 -- 172.21.15.46:0/1469264797 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287217 (secure 0 0 0) 0x7f4ef404c3c0 con 0x7f4ed4066f30 2023-10-07T09:00:05.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 msgr2=0x7f4ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4edc006f00 tx=0x7f4edc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 msgr2=0x7f4ef4154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c6a0 tx=0x7f4ee4015000 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 shutdown_connections 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4154e40 0x7f4ef414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ee0004810 0x7f4ef4159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 --2- 172.21.15.46:0/1469264797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef416abd0 0x7f4ef4154900 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.979+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 >> 172.21.15.46:0/1469264797 conn(0x7f4ef40ce600 msgr2=0x7f4ef415a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.980+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 shutdown_connections 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:05.980+0000 7f4efae5c700 1 -- 172.21.15.46:0/1469264797 wait complete. 2023-10-07T09:00:05.984 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:05.993 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-07T09:00:05.783465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3172352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001535"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.868694+0000","last_change":"2023-10-07T09:00:00.868817+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.868694+0000","last_undegraded":"2023-10-07T09:00:00.868694+0000","last_fullsized":"2023-10-07T09:00:00.868694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877084+0000","last_change":"2023-10-07T09:00:00.877084+0000","last_active":"2023-10-07T09:00:00.877084+0000","last_peered":"2023-10-07T09:00:00.877084+0000","last_clean":"2023-10-07T09:00:00.877084+0000","last_became_active":"2023-10-07T09:00:00.876802+0000","last_became_peered":"2023-10-07T09:00:00.876802+0000","last_unstale":"2023-10-07T09:00:00.877084+0000","last_undegraded":"2023-10-07T09:00:00.877084+0000","last_fullsized":"2023-10-07T09:00:00.877084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:44.814877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877110+0000","last_change":"2023-10-07T09:00:00.877258+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877110+0000","last_undegraded":"2023-10-07T09:00:00.877110+0000","last_fullsized":"2023-10-07T09:00:00.877110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871545+0000","last_change":"2023-10-07T09:00:00.872047+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871545+0000","last_undegraded":"2023-10-07T09:00:00.871545+0000","last_fullsized":"2023-10-07T09:00:00.871545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.865994+0000","last_change":"2023-10-07T09:00:00.866157+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.865994+0000","last_undegraded":"2023-10-07T09:00:00.865994+0000","last_fullsized":"2023-10-07T09:00:00.865994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873331+0000","last_change":"2023-10-07T09:00:00.873494+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873331+0000","last_undegraded":"2023-10-07T09:00:00.873331+0000","last_fullsized":"2023-10-07T09:00:00.873331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866693+0000","last_change":"2023-10-07T09:00:00.866830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866693+0000","last_undegraded":"2023-10-07T09:00:00.866693+0000","last_fullsized":"2023-10-07T09:00:00.866693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875755+0000","last_change":"2023-10-07T09:00:00.875825+0000","last_active":"2023-10-07T09:00:00.875755+0000","last_peered":"2023-10-07T09:00:00.875755+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.875535+0000","last_became_peered":"2023-10-07T09:00:00.875535+0000","last_unstale":"2023-10-07T09:00:00.875755+0000","last_undegraded":"2023-10-07T09:00:00.875755+0000","last_fullsized":"2023-10-07T09:00:00.875755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:28.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866577+0000","last_change":"2023-10-07T09:00:00.866723+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866577+0000","last_undegraded":"2023-10-07T09:00:00.866577+0000","last_fullsized":"2023-10-07T09:00:00.866577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863710+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863428+0000","last_change":"2023-10-07T09:00:00.863647+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863428+0000","last_undegraded":"2023-10-07T09:00:00.863428+0000","last_fullsized":"2023-10-07T09:00:00.863428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871500+0000","last_change":"2023-10-07T09:00:00.871633+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871500+0000","last_undegraded":"2023-10-07T09:00:00.871500+0000","last_fullsized":"2023-10-07T09:00:00.871500+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881702+0000","last_change":"2023-10-07T09:00:00.881702+0000","last_active":"2023-10-07T09:00:00.881702+0000","last_peered":"2023-10-07T09:00:00.881702+0000","last_clean":"2023-10-07T09:00:00.881702+0000","last_became_active":"2023-10-07T09:00:00.881391+0000","last_became_peered":"2023-10-07T09:00:00.881391+0000","last_unstale":"2023-10-07T09:00:00.881702+0000","last_undegraded":"2023-10-07T09:00:00.881702+0000","last_fullsized":"2023-10-07T09:00:00.881702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:54.280509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870477+0000","last_change":"2023-10-07T09:00:00.870579+0000","last_active":"2023-10-07T09:00:00.870477+0000","last_peered":"2023-10-07T09:00:00.870477+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870265+0000","last_became_peered":"2023-10-07T09:00:00.870265+0000","last_unstale":"2023-10-07T09:00:00.870477+0000","last_undegraded":"2023-10-07T09:00:00.870477+0000","last_fullsized":"2023-10-07T09:00:00.870477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870675+0000","last_change":"2023-10-07T09:00:00.870744+0000","last_active":"2023-10-07T09:00:00.870675+0000","last_peered":"2023-10-07T09:00:00.870675+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870486+0000","last_became_peered":"2023-10-07T09:00:00.870486+0000","last_unstale":"2023-10-07T09:00:00.870675+0000","last_undegraded":"2023-10-07T09:00:00.870675+0000","last_fullsized":"2023-10-07T09:00:00.870675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871905+0000","last_change":"2023-10-07T09:00:00.872069+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871905+0000","last_undegraded":"2023-10-07T09:00:00.871905+0000","last_fullsized":"2023-10-07T09:00:00.871905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878540+0000","last_change":"2023-10-07T09:00:00.878540+0000","last_active":"2023-10-07T09:00:00.878540+0000","last_peered":"2023-10-07T09:00:00.878540+0000","last_clean":"2023-10-07T09:00:00.878540+0000","last_became_active":"2023-10-07T09:00:00.878251+0000","last_became_peered":"2023-10-07T09:00:00.878251+0000","last_unstale":"2023-10-07T09:00:00.878540+0000","last_undegraded":"2023-10-07T09:00:00.878540+0000","last_fullsized":"2023-10-07T09:00:00.878540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:27.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877134+0000","last_change":"2023-10-07T09:00:00.877270+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877134+0000","last_undegraded":"2023-10-07T09:00:00.877134+0000","last_fullsized":"2023-10-07T09:00:00.877134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866029+0000","last_change":"2023-10-07T09:00:00.866161+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866029+0000","last_undegraded":"2023-10-07T09:00:00.866029+0000","last_fullsized":"2023-10-07T09:00:00.866029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876761+0000","last_change":"2023-10-07T09:00:00.876761+0000","last_active":"2023-10-07T09:00:00.876761+0000","last_peered":"2023-10-07T09:00:00.876761+0000","last_clean":"2023-10-07T09:00:00.876761+0000","last_became_active":"2023-10-07T09:00:00.876442+0000","last_became_peered":"2023-10-07T09:00:00.876442+0000","last_unstale":"2023-10-07T09:00:00.876761+0000","last_undegraded":"2023-10-07T09:00:00.876761+0000","last_fullsized":"2023-10-07T09:00:00.876761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:24.571544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875422+0000","last_change":"2023-10-07T09:00:00.875796+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875422+0000","last_undegraded":"2023-10-07T09:00:00.875422+0000","last_fullsized":"2023-10-07T09:00:00.875422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879332+0000","last_change":"2023-10-07T09:00:00.879332+0000","last_active":"2023-10-07T09:00:00.879332+0000","last_peered":"2023-10-07T09:00:00.879332+0000","last_clean":"2023-10-07T09:00:00.879332+0000","last_became_active":"2023-10-07T09:00:00.876325+0000","last_became_peered":"2023-10-07T09:00:00.876325+0000","last_unstale":"2023-10-07T09:00:00.879332+0000","last_undegraded":"2023-10-07T09:00:00.879332+0000","last_fullsized":"2023-10-07T09:00:00.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:59.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875959+0000","last_change":"2023-10-07T09:00:00.876088+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875959+0000","last_undegraded":"2023-10-07T09:00:00.875959+0000","last_fullsized":"2023-10-07T09:00:00.875959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881737+0000","last_change":"2023-10-07T09:00:00.881737+0000","last_active":"2023-10-07T09:00:00.881737+0000","last_peered":"2023-10-07T09:00:00.881737+0000","last_clean":"2023-10-07T09:00:00.881737+0000","last_became_active":"2023-10-07T09:00:00.881479+0000","last_became_peered":"2023-10-07T09:00:00.881479+0000","last_unstale":"2023-10-07T09:00:00.881737+0000","last_undegraded":"2023-10-07T09:00:00.881737+0000","last_fullsized":"2023-10-07T09:00:00.881737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:33.628371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873185+0000","last_change":"2023-10-07T09:00:00.873185+0000","last_active":"2023-10-07T09:00:00.873185+0000","last_peered":"2023-10-07T09:00:00.873185+0000","last_clean":"2023-10-07T09:00:00.873185+0000","last_became_active":"2023-10-07T09:00:00.872874+0000","last_became_peered":"2023-10-07T09:00:00.872874+0000","last_unstale":"2023-10-07T09:00:00.873185+0000","last_undegraded":"2023-10-07T09:00:00.873185+0000","last_fullsized":"2023-10-07T09:00:00.873185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:25:15.529282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871120+0000","last_change":"2023-10-07T09:00:00.871263+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871120+0000","last_undegraded":"2023-10-07T09:00:00.871120+0000","last_fullsized":"2023-10-07T09:00:00.871120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873365+0000","last_change":"2023-10-07T09:00:00.873460+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873365+0000","last_undegraded":"2023-10-07T09:00:00.873365+0000","last_fullsized":"2023-10-07T09:00:00.873365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866015+0000","last_change":"2023-10-07T09:00:00.866363+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866015+0000","last_undegraded":"2023-10-07T09:00:00.866015+0000","last_fullsized":"2023-10-07T09:00:00.866015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878311+0000","last_change":"2023-10-07T09:00:00.878311+0000","last_active":"2023-10-07T09:00:00.878311+0000","last_peered":"2023-10-07T09:00:00.878311+0000","last_clean":"2023-10-07T09:00:00.878311+0000","last_became_active":"2023-10-07T09:00:00.877748+0000","last_became_peered":"2023-10-07T09:00:00.877748+0000","last_unstale":"2023-10-07T09:00:00.878311+0000","last_undegraded":"2023-10-07T09:00:00.878311+0000","last_fullsized":"2023-10-07T09:00:00.878311+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:50.858102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875440+0000","last_change":"2023-10-07T09:00:00.875586+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875440+0000","last_undegraded":"2023-10-07T09:00:00.875440+0000","last_fullsized":"2023-10-07T09:00:00.875440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870666+0000","last_change":"2023-10-07T09:00:00.870666+0000","last_active":"2023-10-07T09:00:00.870666+0000","last_peered":"2023-10-07T09:00:00.870666+0000","last_clean":"2023-10-07T09:00:00.870666+0000","last_became_active":"2023-10-07T09:00:00.870437+0000","last_became_peered":"2023-10-07T09:00:00.870437+0000","last_unstale":"2023-10-07T09:00:00.870666+0000","last_undegraded":"2023-10-07T09:00:00.870666+0000","last_fullsized":"2023-10-07T09:00:00.870666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:09.591539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873428+0000","last_change":"2023-10-07T09:00:00.873570+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873428+0000","last_undegraded":"2023-10-07T09:00:00.873428+0000","last_fullsized":"2023-10-07T09:00:00.873428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872150+0000","last_change":"2023-10-07T09:00:00.872271+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872150+0000","last_undegraded":"2023-10-07T09:00:00.872150+0000","last_fullsized":"2023-10-07T09:00:00.872150+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882661+0000","last_change":"2023-10-07T08:59:59.878882+0000","last_active":"2023-10-07T08:59:59.882661+0000","last_peered":"2023-10-07T08:59:59.882661+0000","last_clean":"2023-10-07T08:59:59.882661+0000","last_became_active":"2023-10-07T08:59:59.878576+0000","last_became_peered":"2023-10-07T08:59:59.878576+0000","last_unstale":"2023-10-07T08:59:59.882661+0000","last_undegraded":"2023-10-07T08:59:59.882661+0000","last_fullsized":"2023-10-07T08:59:59.882661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:37.738910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863540+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882871+0000","last_change":"2023-10-07T08:59:59.877825+0000","last_active":"2023-10-07T08:59:59.882871+0000","last_peered":"2023-10-07T08:59:59.882871+0000","last_clean":"2023-10-07T08:59:59.882871+0000","last_became_active":"2023-10-07T08:59:59.877566+0000","last_became_peered":"2023-10-07T08:59:59.877566+0000","last_unstale":"2023-10-07T08:59:59.882871+0000","last_undegraded":"2023-10-07T08:59:59.882871+0000","last_fullsized":"2023-10-07T08:59:59.882871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:36.032547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872136+0000","last_change":"2023-10-07T09:00:00.873538+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872136+0000","last_undegraded":"2023-10-07T09:00:00.872136+0000","last_fullsized":"2023-10-07T09:00:00.872136+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.872832+0000","last_change":"2023-10-07T08:59:59.871943+0000","last_active":"2023-10-07T08:59:59.872832+0000","last_peered":"2023-10-07T08:59:59.872832+0000","last_clean":"2023-10-07T08:59:59.872832+0000","last_became_active":"2023-10-07T08:59:59.871526+0000","last_became_peered":"2023-10-07T08:59:59.871526+0000","last_unstale":"2023-10-07T08:59:59.872832+0000","last_undegraded":"2023-10-07T08:59:59.872832+0000","last_fullsized":"2023-10-07T08:59:59.872832+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:46:43.375628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873044+0000","last_change":"2023-10-07T09:00:00.873167+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873044+0000","last_undegraded":"2023-10-07T09:00:00.873044+0000","last_fullsized":"2023-10-07T09:00:00.873044+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881897+0000","last_change":"2023-10-07T08:59:59.879585+0000","last_active":"2023-10-07T08:59:59.881897+0000","last_peered":"2023-10-07T08:59:59.881897+0000","last_clean":"2023-10-07T08:59:59.881897+0000","last_became_active":"2023-10-07T08:59:59.879308+0000","last_became_peered":"2023-10-07T08:59:59.879308+0000","last_unstale":"2023-10-07T08:59:59.881897+0000","last_undegraded":"2023-10-07T08:59:59.881897+0000","last_fullsized":"2023-10-07T08:59:59.881897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876182+0000","last_change":"2023-10-07T09:00:00.876182+0000","last_active":"2023-10-07T09:00:00.876182+0000","last_peered":"2023-10-07T09:00:00.876182+0000","last_clean":"2023-10-07T09:00:00.876182+0000","last_became_active":"2023-10-07T09:00:00.875935+0000","last_became_peered":"2023-10-07T09:00:00.875935+0000","last_unstale":"2023-10-07T09:00:00.876182+0000","last_undegraded":"2023-10-07T09:00:00.876182+0000","last_fullsized":"2023-10-07T09:00:00.876182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:21.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881505+0000","last_change":"2023-10-07T08:59:59.878940+0000","last_active":"2023-10-07T08:59:59.881505+0000","last_peered":"2023-10-07T08:59:59.881505+0000","last_clean":"2023-10-07T08:59:59.881505+0000","last_became_active":"2023-10-07T08:59:59.878645+0000","last_became_peered":"2023-10-07T08:59:59.878645+0000","last_unstale":"2023-10-07T08:59:59.881505+0000","last_undegraded":"2023-10-07T08:59:59.881505+0000","last_fullsized":"2023-10-07T08:59:59.881505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:35.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878509+0000","last_change":"2023-10-07T09:00:00.878509+0000","last_active":"2023-10-07T09:00:00.878509+0000","last_peered":"2023-10-07T09:00:00.878509+0000","last_clean":"2023-10-07T09:00:00.878509+0000","last_became_active":"2023-10-07T09:00:00.878039+0000","last_became_peered":"2023-10-07T09:00:00.878039+0000","last_unstale":"2023-10-07T09:00:00.878509+0000","last_undegraded":"2023-10-07T09:00:00.878509+0000","last_fullsized":"2023-10-07T09:00:00.878509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:21.720280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882685+0000","last_change":"2023-10-07T08:59:59.881718+0000","last_active":"2023-10-07T08:59:59.882685+0000","last_peered":"2023-10-07T08:59:59.882685+0000","last_clean":"2023-10-07T08:59:59.882685+0000","last_became_active":"2023-10-07T08:59:59.881423+0000","last_became_peered":"2023-10-07T08:59:59.881423+0000","last_unstale":"2023-10-07T08:59:59.882685+0000","last_undegraded":"2023-10-07T08:59:59.882685+0000","last_fullsized":"2023-10-07T08:59:59.882685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881579+0000","last_change":"2023-10-07T09:00:00.881579+0000","last_active":"2023-10-07T09:00:00.881579+0000","last_peered":"2023-10-07T09:00:00.881579+0000","last_clean":"2023-10-07T09:00:00.881579+0000","last_became_active":"2023-10-07T09:00:00.881316+0000","last_became_peered":"2023-10-07T09:00:00.881316+0000","last_unstale":"2023-10-07T09:00:00.881579+0000","last_undegraded":"2023-10-07T09:00:00.881579+0000","last_fullsized":"2023-10-07T09:00:00.881579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:38:07.420548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881728+0000","last_change":"2023-10-07T08:59:59.877239+0000","last_active":"2023-10-07T08:59:59.881728+0000","last_peered":"2023-10-07T08:59:59.881728+0000","last_clean":"2023-10-07T08:59:59.881728+0000","last_became_active":"2023-10-07T08:59:59.876953+0000","last_became_peered":"2023-10-07T08:59:59.876953+0000","last_unstale":"2023-10-07T08:59:59.881728+0000","last_undegraded":"2023-10-07T08:59:59.881728+0000","last_fullsized":"2023-10-07T08:59:59.881728+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879470+0000","last_change":"2023-10-07T09:00:00.879470+0000","last_active":"2023-10-07T09:00:00.879470+0000","last_peered":"2023-10-07T09:00:00.879470+0000","last_clean":"2023-10-07T09:00:00.879470+0000","last_became_active":"2023-10-07T09:00:00.878300+0000","last_became_peered":"2023-10-07T09:00:00.878300+0000","last_unstale":"2023-10-07T09:00:00.879470+0000","last_undegraded":"2023-10-07T09:00:00.879470+0000","last_fullsized":"2023-10-07T09:00:00.879470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:29.483543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881353+0000","last_change":"2023-10-07T08:59:59.877871+0000","last_active":"2023-10-07T08:59:59.881353+0000","last_peered":"2023-10-07T08:59:59.881353+0000","last_clean":"2023-10-07T08:59:59.881353+0000","last_became_active":"2023-10-07T08:59:59.877531+0000","last_became_peered":"2023-10-07T08:59:59.877531+0000","last_unstale":"2023-10-07T08:59:59.881353+0000","last_undegraded":"2023-10-07T08:59:59.881353+0000","last_fullsized":"2023-10-07T08:59:59.881353+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:32.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873973+0000","last_change":"2023-10-07T09:00:00.874063+0000","last_active":"2023-10-07T09:00:00.873973+0000","last_peered":"2023-10-07T09:00:00.873973+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.873760+0000","last_became_peered":"2023-10-07T09:00:00.873760+0000","last_unstale":"2023-10-07T09:00:00.873973+0000","last_undegraded":"2023-10-07T09:00:00.873973+0000","last_fullsized":"2023-10-07T09:00:00.873973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882862+0000","last_change":"2023-10-07T08:59:59.882862+0000","last_active":"2023-10-07T08:59:59.882862+0000","last_peered":"2023-10-07T08:59:59.882862+0000","last_clean":"2023-10-07T08:59:59.882862+0000","last_became_active":"2023-10-07T08:59:59.882624+0000","last_became_peered":"2023-10-07T08:59:59.882624+0000","last_unstale":"2023-10-07T08:59:59.882862+0000","last_undegraded":"2023-10-07T08:59:59.882862+0000","last_fullsized":"2023-10-07T08:59:59.882862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:59:59.852436+0000","last_change":"2023-10-07T08:59:59.867558+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:59.852436+0000","last_undegraded":"2023-10-07T08:59:59.852436+0000","last_fullsized":"2023-10-07T08:59:59.852436+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:22.118543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882894+0000","last_change":"2023-10-07T08:59:59.878792+0000","last_active":"2023-10-07T08:59:59.882894+0000","last_peered":"2023-10-07T08:59:59.882894+0000","last_clean":"2023-10-07T08:59:59.882894+0000","last_became_active":"2023-10-07T08:59:59.878532+0000","last_became_peered":"2023-10-07T08:59:59.878532+0000","last_unstale":"2023-10-07T08:59:59.882894+0000","last_undegraded":"2023-10-07T08:59:59.882894+0000","last_fullsized":"2023-10-07T08:59:59.882894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:06.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869524+0000","last_change":"2023-10-07T09:00:00.869524+0000","last_active":"2023-10-07T09:00:00.869524+0000","last_peered":"2023-10-07T09:00:00.869524+0000","last_clean":"2023-10-07T09:00:00.869524+0000","last_became_active":"2023-10-07T09:00:00.868923+0000","last_became_peered":"2023-10-07T09:00:00.868923+0000","last_unstale":"2023-10-07T09:00:00.869524+0000","last_undegraded":"2023-10-07T09:00:00.869524+0000","last_fullsized":"2023-10-07T09:00:00.869524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883637+0000","last_change":"2023-10-07T08:59:59.881364+0000","last_active":"2023-10-07T08:59:59.883637+0000","last_peered":"2023-10-07T08:59:59.883637+0000","last_clean":"2023-10-07T08:59:59.883637+0000","last_became_active":"2023-10-07T08:59:59.881095+0000","last_became_peered":"2023-10-07T08:59:59.881095+0000","last_unstale":"2023-10-07T08:59:59.883637+0000","last_undegraded":"2023-10-07T08:59:59.883637+0000","last_fullsized":"2023-10-07T08:59:59.883637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877508+0000","last_change":"2023-10-07T09:00:00.877638+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877508+0000","last_undegraded":"2023-10-07T09:00:00.877508+0000","last_fullsized":"2023-10-07T09:00:00.877508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881251+0000","last_change":"2023-10-07T08:59:59.873067+0000","last_active":"2023-10-07T08:59:59.881251+0000","last_peered":"2023-10-07T08:59:59.881251+0000","last_clean":"2023-10-07T08:59:59.881251+0000","last_became_active":"2023-10-07T08:59:59.872789+0000","last_became_peered":"2023-10-07T08:59:59.872789+0000","last_unstale":"2023-10-07T08:59:59.881251+0000","last_undegraded":"2023-10-07T08:59:59.881251+0000","last_fullsized":"2023-10-07T08:59:59.881251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870941+0000","last_change":"2023-10-07T09:00:00.871072+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870941+0000","last_undegraded":"2023-10-07T09:00:00.870941+0000","last_fullsized":"2023-10-07T09:00:00.870941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883479+0000","last_change":"2023-10-07T08:59:59.880786+0000","last_active":"2023-10-07T08:59:59.883479+0000","last_peered":"2023-10-07T08:59:59.883479+0000","last_clean":"2023-10-07T08:59:59.883479+0000","last_became_active":"2023-10-07T08:59:59.880534+0000","last_became_peered":"2023-10-07T08:59:59.880534+0000","last_unstale":"2023-10-07T08:59:59.883479+0000","last_undegraded":"2023-10-07T08:59:59.883479+0000","last_fullsized":"2023-10-07T08:59:59.883479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:33.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875570+0000","last_change":"2023-10-07T09:00:00.875693+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875570+0000","last_undegraded":"2023-10-07T09:00:00.875570+0000","last_fullsized":"2023-10-07T09:00:00.875570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878077+0000","last_change":"2023-10-07T08:59:59.871360+0000","last_active":"2023-10-07T08:59:59.878077+0000","last_peered":"2023-10-07T08:59:59.878077+0000","last_clean":"2023-10-07T08:59:59.878077+0000","last_became_active":"2023-10-07T08:59:59.871077+0000","last_became_peered":"2023-10-07T08:59:59.871077+0000","last_unstale":"2023-10-07T08:59:59.878077+0000","last_undegraded":"2023-10-07T08:59:59.878077+0000","last_fullsized":"2023-10-07T08:59:59.878077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:25.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866397+0000","last_change":"2023-10-07T09:00:00.866546+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866397+0000","last_undegraded":"2023-10-07T09:00:00.866397+0000","last_fullsized":"2023-10-07T09:00:00.866397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881929+0000","last_change":"2023-10-07T08:59:59.879657+0000","last_active":"2023-10-07T08:59:59.881929+0000","last_peered":"2023-10-07T08:59:59.881929+0000","last_clean":"2023-10-07T08:59:59.881929+0000","last_became_active":"2023-10-07T08:59:59.879372+0000","last_became_peered":"2023-10-07T08:59:59.879372+0000","last_unstale":"2023-10-07T08:59:59.881929+0000","last_undegraded":"2023-10-07T08:59:59.881929+0000","last_fullsized":"2023-10-07T08:59:59.881929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.876296+0000","last_change":"2023-10-07T09:00:00.876419+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.876296+0000","last_undegraded":"2023-10-07T09:00:00.876296+0000","last_fullsized":"2023-10-07T09:00:00.876296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.886344+0000","last_change":"2023-10-07T08:59:59.882300+0000","last_active":"2023-10-07T08:59:59.886344+0000","last_peered":"2023-10-07T08:59:59.886344+0000","last_clean":"2023-10-07T08:59:59.886344+0000","last_became_active":"2023-10-07T08:59:59.882025+0000","last_became_peered":"2023-10-07T08:59:59.882025+0000","last_unstale":"2023-10-07T08:59:59.886344+0000","last_undegraded":"2023-10-07T08:59:59.886344+0000","last_fullsized":"2023-10-07T08:59:59.886344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877479+0000","last_change":"2023-10-07T09:00:00.877624+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877479+0000","last_undegraded":"2023-10-07T09:00:00.877479+0000","last_fullsized":"2023-10-07T09:00:00.877479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882975+0000","last_change":"2023-10-07T08:59:59.880542+0000","last_active":"2023-10-07T08:59:59.882975+0000","last_peered":"2023-10-07T08:59:59.882975+0000","last_clean":"2023-10-07T08:59:59.882975+0000","last_became_active":"2023-10-07T08:59:59.880259+0000","last_became_peered":"2023-10-07T08:59:59.880259+0000","last_unstale":"2023-10-07T08:59:59.882975+0000","last_undegraded":"2023-10-07T08:59:59.882975+0000","last_fullsized":"2023-10-07T08:59:59.882975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:27.985062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870587+0000","last_change":"2023-10-07T09:00:00.870830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870587+0000","last_undegraded":"2023-10-07T09:00:00.870587+0000","last_fullsized":"2023-10-07T09:00:00.870587+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882692+0000","last_change":"2023-10-07T08:59:59.879711+0000","last_active":"2023-10-07T08:59:59.882692+0000","last_peered":"2023-10-07T08:59:59.882692+0000","last_clean":"2023-10-07T08:59:59.882692+0000","last_became_active":"2023-10-07T08:59:59.879410+0000","last_became_peered":"2023-10-07T08:59:59.879410+0000","last_unstale":"2023-10-07T08:59:59.882692+0000","last_undegraded":"2023-10-07T08:59:59.882692+0000","last_fullsized":"2023-10-07T08:59:59.882692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:53.114711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874020+0000","last_change":"2023-10-07T09:00:00.874020+0000","last_active":"2023-10-07T09:00:00.874020+0000","last_peered":"2023-10-07T09:00:00.874020+0000","last_clean":"2023-10-07T09:00:00.874020+0000","last_became_active":"2023-10-07T09:00:00.873739+0000","last_became_peered":"2023-10-07T09:00:00.873739+0000","last_unstale":"2023-10-07T09:00:00.874020+0000","last_undegraded":"2023-10-07T09:00:00.874020+0000","last_fullsized":"2023-10-07T09:00:00.874020+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:12.366488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881914+0000","last_change":"2023-10-07T08:59:59.879611+0000","last_active":"2023-10-07T08:59:59.881914+0000","last_peered":"2023-10-07T08:59:59.881914+0000","last_clean":"2023-10-07T08:59:59.881914+0000","last_became_active":"2023-10-07T08:59:59.879301+0000","last_became_peered":"2023-10-07T08:59:59.879301+0000","last_unstale":"2023-10-07T08:59:59.881914+0000","last_undegraded":"2023-10-07T08:59:59.881914+0000","last_fullsized":"2023-10-07T08:59:59.881914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:34.395138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877849+0000","last_change":"2023-10-07T09:00:00.877970+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877849+0000","last_undegraded":"2023-10-07T09:00:00.877849+0000","last_fullsized":"2023-10-07T09:00:00.877849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.884007+0000","last_change":"2023-10-07T08:59:59.882939+0000","last_active":"2023-10-07T08:59:59.884007+0000","last_peered":"2023-10-07T08:59:59.884007+0000","last_clean":"2023-10-07T08:59:59.884007+0000","last_became_active":"2023-10-07T08:59:59.882525+0000","last_became_peered":"2023-10-07T08:59:59.882525+0000","last_unstale":"2023-10-07T08:59:59.884007+0000","last_undegraded":"2023-10-07T08:59:59.884007+0000","last_fullsized":"2023-10-07T08:59:59.884007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:27.723456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870534+0000","last_change":"2023-10-07T09:00:00.870726+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870534+0000","last_undegraded":"2023-10-07T09:00:00.870534+0000","last_fullsized":"2023-10-07T09:00:00.870534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882924+0000","last_change":"2023-10-07T08:59:59.876486+0000","last_active":"2023-10-07T08:59:59.882924+0000","last_peered":"2023-10-07T08:59:59.882924+0000","last_clean":"2023-10-07T08:59:59.882924+0000","last_became_active":"2023-10-07T08:59:59.876139+0000","last_became_peered":"2023-10-07T08:59:59.876139+0000","last_unstale":"2023-10-07T08:59:59.882924+0000","last_undegraded":"2023-10-07T08:59:59.882924+0000","last_fullsized":"2023-10-07T08:59:59.882924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:06.252338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872333+0000","last_change":"2023-10-07T09:00:00.872464+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872333+0000","last_undegraded":"2023-10-07T09:00:00.872333+0000","last_fullsized":"2023-10-07T09:00:00.872333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879743+0000","last_change":"2023-10-07T08:59:59.877521+0000","last_active":"2023-10-07T08:59:59.879743+0000","last_peered":"2023-10-07T08:59:59.879743+0000","last_clean":"2023-10-07T08:59:59.879743+0000","last_became_active":"2023-10-07T08:59:59.877269+0000","last_became_peered":"2023-10-07T08:59:59.877269+0000","last_unstale":"2023-10-07T08:59:59.879743+0000","last_undegraded":"2023-10-07T08:59:59.879743+0000","last_fullsized":"2023-10-07T08:59:59.879743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:28.720828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871913+0000","last_change":"2023-10-07T09:00:00.872070+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871913+0000","last_undegraded":"2023-10-07T09:00:00.871913+0000","last_fullsized":"2023-10-07T09:00:00.871913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881841+0000","last_change":"2023-10-07T08:59:59.878211+0000","last_active":"2023-10-07T08:59:59.881841+0000","last_peered":"2023-10-07T08:59:59.881841+0000","last_clean":"2023-10-07T08:59:59.881841+0000","last_became_active":"2023-10-07T08:59:59.877912+0000","last_became_peered":"2023-10-07T08:59:59.877912+0000","last_unstale":"2023-10-07T08:59:59.881841+0000","last_undegraded":"2023-10-07T08:59:59.881841+0000","last_fullsized":"2023-10-07T08:59:59.881841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:02.674160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871110+0000","last_change":"2023-10-07T09:00:00.871279+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871110+0000","last_undegraded":"2023-10-07T09:00:00.871110+0000","last_fullsized":"2023-10-07T09:00:00.871110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879696+0000","last_change":"2023-10-07T08:59:59.877982+0000","last_active":"2023-10-07T08:59:59.879696+0000","last_peered":"2023-10-07T08:59:59.879696+0000","last_clean":"2023-10-07T08:59:59.879696+0000","last_became_active":"2023-10-07T08:59:59.877677+0000","last_became_peered":"2023-10-07T08:59:59.877677+0000","last_unstale":"2023-10-07T08:59:59.879696+0000","last_undegraded":"2023-10-07T08:59:59.879696+0000","last_fullsized":"2023-10-07T08:59:59.879696+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:04.391970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870659+0000","last_change":"2023-10-07T09:00:00.870848+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870659+0000","last_undegraded":"2023-10-07T09:00:00.870659+0000","last_fullsized":"2023-10-07T09:00:00.870659+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882132+0000","last_change":"2023-10-07T08:59:59.873692+0000","last_active":"2023-10-07T08:59:59.882132+0000","last_peered":"2023-10-07T08:59:59.882132+0000","last_clean":"2023-10-07T08:59:59.882132+0000","last_became_active":"2023-10-07T08:59:59.873416+0000","last_became_peered":"2023-10-07T08:59:59.873416+0000","last_unstale":"2023-10-07T08:59:59.882132+0000","last_undegraded":"2023-10-07T08:59:59.882132+0000","last_fullsized":"2023-10-07T08:59:59.882132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:05.503904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869702+0000","last_change":"2023-10-07T09:00:00.869702+0000","last_active":"2023-10-07T09:00:00.869702+0000","last_peered":"2023-10-07T09:00:00.869702+0000","last_clean":"2023-10-07T09:00:00.869702+0000","last_became_active":"2023-10-07T09:00:00.869276+0000","last_became_peered":"2023-10-07T09:00:00.869276+0000","last_unstale":"2023-10-07T09:00:00.869702+0000","last_undegraded":"2023-10-07T09:00:00.869702+0000","last_fullsized":"2023-10-07T09:00:00.869702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878000+0000","last_change":"2023-10-07T08:59:59.870863+0000","last_active":"2023-10-07T08:59:59.878000+0000","last_peered":"2023-10-07T08:59:59.878000+0000","last_clean":"2023-10-07T08:59:59.878000+0000","last_became_active":"2023-10-07T08:59:59.870553+0000","last_became_peered":"2023-10-07T08:59:59.870553+0000","last_unstale":"2023-10-07T08:59:59.878000+0000","last_undegraded":"2023-10-07T08:59:59.878000+0000","last_fullsized":"2023-10-07T08:59:59.878000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:25.612939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872655+0000","last_change":"2023-10-07T09:00:00.872820+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872655+0000","last_undegraded":"2023-10-07T09:00:00.872655+0000","last_fullsized":"2023-10-07T09:00:00.872655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881847+0000","last_change":"2023-10-07T08:59:59.877544+0000","last_active":"2023-10-07T08:59:59.881847+0000","last_peered":"2023-10-07T08:59:59.881847+0000","last_clean":"2023-10-07T08:59:59.881847+0000","last_became_active":"2023-10-07T08:59:59.876631+0000","last_became_peered":"2023-10-07T08:59:59.876631+0000","last_unstale":"2023-10-07T08:59:59.881847+0000","last_undegraded":"2023-10-07T08:59:59.881847+0000","last_fullsized":"2023-10-07T08:59:59.881847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876334+0000","last_change":"2023-10-07T09:00:00.876334+0000","last_active":"2023-10-07T09:00:00.876334+0000","last_peered":"2023-10-07T09:00:00.876334+0000","last_clean":"2023-10-07T09:00:00.876334+0000","last_became_active":"2023-10-07T09:00:00.876055+0000","last_became_peered":"2023-10-07T09:00:00.876055+0000","last_unstale":"2023-10-07T09:00:00.876334+0000","last_undegraded":"2023-10-07T09:00:00.876334+0000","last_fullsized":"2023-10-07T09:00:00.876334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:05.377189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879769+0000","last_change":"2023-10-07T08:59:59.878174+0000","last_active":"2023-10-07T08:59:59.879769+0000","last_peered":"2023-10-07T08:59:59.879769+0000","last_clean":"2023-10-07T08:59:59.879769+0000","last_became_active":"2023-10-07T08:59:59.877621+0000","last_became_peered":"2023-10-07T08:59:59.877621+0000","last_unstale":"2023-10-07T08:59:59.879769+0000","last_undegraded":"2023-10-07T08:59:59.879769+0000","last_fullsized":"2023-10-07T08:59:59.879769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875885+0000","last_change":"2023-10-07T09:00:00.876001+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875885+0000","last_undegraded":"2023-10-07T09:00:00.875885+0000","last_fullsized":"2023-10-07T09:00:00.875885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.876448+0000","last_change":"2023-10-07T08:59:59.872199+0000","last_active":"2023-10-07T08:59:59.876448+0000","last_peered":"2023-10-07T08:59:59.876448+0000","last_clean":"2023-10-07T08:59:59.876448+0000","last_became_active":"2023-10-07T08:59:59.871880+0000","last_became_peered":"2023-10-07T08:59:59.871880+0000","last_unstale":"2023-10-07T08:59:59.876448+0000","last_undegraded":"2023-10-07T08:59:59.876448+0000","last_fullsized":"2023-10-07T08:59:59.876448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863213+0000","last_change":"2023-10-07T09:00:00.863417+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863213+0000","last_undegraded":"2023-10-07T09:00:00.863213+0000","last_fullsized":"2023-10-07T09:00:00.863213+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.875014+0000","last_change":"2023-10-07T08:59:59.873447+0000","last_active":"2023-10-07T08:59:59.875014+0000","last_peered":"2023-10-07T08:59:59.875014+0000","last_clean":"2023-10-07T08:59:59.875014+0000","last_became_active":"2023-10-07T08:59:59.873072+0000","last_became_peered":"2023-10-07T08:59:59.873072+0000","last_unstale":"2023-10-07T08:59:59.875014+0000","last_undegraded":"2023-10-07T08:59:59.875014+0000","last_fullsized":"2023-10-07T08:59:59.875014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878785+0000","last_change":"2023-10-07T09:00:00.878785+0000","last_active":"2023-10-07T09:00:00.878785+0000","last_peered":"2023-10-07T09:00:00.878785+0000","last_clean":"2023-10-07T09:00:00.878785+0000","last_became_active":"2023-10-07T09:00:00.878430+0000","last_became_peered":"2023-10-07T09:00:00.878430+0000","last_unstale":"2023-10-07T09:00:00.878785+0000","last_undegraded":"2023-10-07T09:00:00.878785+0000","last_fullsized":"2023-10-07T09:00:00.878785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:44.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882816+0000","last_change":"2023-10-07T08:59:59.876825+0000","last_active":"2023-10-07T08:59:59.882816+0000","last_peered":"2023-10-07T08:59:59.882816+0000","last_clean":"2023-10-07T08:59:59.882816+0000","last_became_active":"2023-10-07T08:59:59.876559+0000","last_became_peered":"2023-10-07T08:59:59.876559+0000","last_unstale":"2023-10-07T08:59:59.882816+0000","last_undegraded":"2023-10-07T08:59:59.882816+0000","last_fullsized":"2023-10-07T08:59:59.882816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:21.766641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877562+0000","last_change":"2023-10-07T09:00:00.877647+0000","last_active":"2023-10-07T09:00:00.877562+0000","last_peered":"2023-10-07T09:00:00.877562+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.877358+0000","last_became_peered":"2023-10-07T09:00:00.877358+0000","last_unstale":"2023-10-07T09:00:00.877562+0000","last_undegraded":"2023-10-07T09:00:00.877562+0000","last_fullsized":"2023-10-07T09:00:00.877562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:14.133478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881085+0000","last_change":"2023-10-07T08:59:59.877003+0000","last_active":"2023-10-07T08:59:59.881085+0000","last_peered":"2023-10-07T08:59:59.881085+0000","last_clean":"2023-10-07T08:59:59.881085+0000","last_became_active":"2023-10-07T08:59:59.876690+0000","last_became_peered":"2023-10-07T08:59:59.876690+0000","last_unstale":"2023-10-07T08:59:59.881085+0000","last_undegraded":"2023-10-07T08:59:59.881085+0000","last_fullsized":"2023-10-07T08:59:59.881085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:56.938318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.873423+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:59.873423+0000","last_peered":"2023-10-07T08:59:59.873423+0000","last_clean":"2023-10-07T08:59:59.873423+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:59.873423+0000","last_undegraded":"2023-10-07T08:59:59.873423+0000","last_fullsized":"2023-10-07T08:59:59.873423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.91900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.308},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.377}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.215},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.255}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.307},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.755}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.502},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.868694+0000', 'last_change': '2023-10-07T09:00:00.868817+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.868694+0000', 'last_undegraded': '2023-10-07T09:00:00.868694+0000', 'last_fullsized': '2023-10-07T09:00:00.868694+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.877110+0000', 'last_change': '2023-10-07T09:00:00.877258+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.877110+0000', 'last_undegraded': '2023-10-07T09:00:00.877110+0000', 'last_fullsized': '2023-10-07T09:00:00.877110+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871545+0000', 'last_change': '2023-10-07T09:00:00.872047+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871545+0000', 'last_undegraded': '2023-10-07T09:00:00.871545+0000', 'last_fullsized': '2023-10-07T09:00:00.871545+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.865994+0000', 'last_change': '2023-10-07T09:00:00.866157+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.865994+0000', 'last_undegraded': '2023-10-07T09:00:00.865994+0000', 'last_fullsized': '2023-10-07T09:00:00.865994+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.873331+0000', 'last_change': '2023-10-07T09:00:00.873494+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.873331+0000', 'last_undegraded': '2023-10-07T09:00:00.873331+0000', 'last_fullsized': '2023-10-07T09:00:00.873331+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.866693+0000', 'last_change': '2023-10-07T09:00:00.866830+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.866693+0000', 'last_undegraded': '2023-10-07T09:00:00.866693+0000', 'last_fullsized': '2023-10-07T09:00:00.866693+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.866577+0000', 'last_change': '2023-10-07T09:00:00.866723+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.866577+0000', 'last_undegraded': '2023-10-07T09:00:00.866577+0000', 'last_fullsized': '2023-10-07T09:00:00.866577+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-07T09:00:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.863394+0000', 'last_change': '2023-10-07T09:00:00.863710+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.863394+0000', 'last_undegraded': '2023-10-07T09:00:00.863394+0000', 'last_fullsized': '2023-10-07T09:00:00.863394+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.863428+0000', 'last_change': '2023-10-07T09:00:00.863647+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.863428+0000', 'last_undegraded': '2023-10-07T09:00:00.863428+0000', 'last_fullsized': '2023-10-07T09:00:00.863428+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871500+0000', 'last_change': '2023-10-07T09:00:00.871633+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871500+0000', 'last_undegraded': '2023-10-07T09:00:00.871500+0000', 'last_fullsized': '2023-10-07T09:00:00.871500+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871905+0000', 'last_change': '2023-10-07T09:00:00.872069+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871905+0000', 'last_undegraded': '2023-10-07T09:00:00.871905+0000', 'last_fullsized': '2023-10-07T09:00:00.871905+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.877134+0000', 'last_change': '2023-10-07T09:00:00.877270+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.877134+0000', 'last_undegraded': '2023-10-07T09:00:00.877134+0000', 'last_fullsized': '2023-10-07T09:00:00.877134+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-07T09:00:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.866029+0000', 'last_change': '2023-10-07T09:00:00.866161+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.866029+0000', 'last_undegraded': '2023-10-07T09:00:00.866029+0000', 'last_fullsized': '2023-10-07T09:00:00.866029+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.875422+0000', 'last_change': '2023-10-07T09:00:00.875796+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.875422+0000', 'last_undegraded': '2023-10-07T09:00:00.875422+0000', 'last_fullsized': '2023-10-07T09:00:00.875422+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.875959+0000', 'last_change': '2023-10-07T09:00:00.876088+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.875959+0000', 'last_undegraded': '2023-10-07T09:00:00.875959+0000', 'last_fullsized': '2023-10-07T09:00:00.875959+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871120+0000', 'last_change': '2023-10-07T09:00:00.871263+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871120+0000', 'last_undegraded': '2023-10-07T09:00:00.871120+0000', 'last_fullsized': '2023-10-07T09:00:00.871120+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.873365+0000', 'last_change': '2023-10-07T09:00:00.873460+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.873365+0000', 'last_undegraded': '2023-10-07T09:00:00.873365+0000', 'last_fullsized': '2023-10-07T09:00:00.873365+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-07T09:00:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.866015+0000', 'last_change': '2023-10-07T09:00:00.866363+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.866015+0000', 'last_undegraded': '2023-10-07T09:00:00.866015+0000', 'last_fullsized': '2023-10-07T09:00:00.866015+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.875440+0000', 'last_change': '2023-10-07T09:00:00.875586+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.875440+0000', 'last_undegraded': '2023-10-07T09:00:00.875440+0000', 'last_fullsized': '2023-10-07T09:00:00.875440+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.873428+0000', 'last_change': '2023-10-07T09:00:00.873570+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.873428+0000', 'last_undegraded': '2023-10-07T09:00:00.873428+0000', 'last_fullsized': '2023-10-07T09:00:00.873428+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.872150+0000', 'last_change': '2023-10-07T09:00:00.872271+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.872150+0000', 'last_undegraded': '2023-10-07T09:00:00.872150+0000', 'last_fullsized': '2023-10-07T09:00:00.872150+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.863394+0000', 'last_change': '2023-10-07T09:00:00.863540+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.863394+0000', 'last_undegraded': '2023-10-07T09:00:00.863394+0000', 'last_fullsized': '2023-10-07T09:00:00.863394+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.872136+0000', 'last_change': '2023-10-07T09:00:00.873538+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.872136+0000', 'last_undegraded': '2023-10-07T09:00:00.872136+0000', 'last_fullsized': '2023-10-07T09:00:00.872136+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.873044+0000', 'last_change': '2023-10-07T09:00:00.873167+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.873044+0000', 'last_undegraded': '2023-10-07T09:00:00.873044+0000', 'last_fullsized': '2023-10-07T09:00:00.873044+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:59:59.852436+0000', 'last_change': '2023-10-07T08:59:59.867558+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:59:59.852436+0000', 'last_undegraded': '2023-10-07T08:59:59.852436+0000', 'last_fullsized': '2023-10-07T08:59:59.852436+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:34:22.118543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.877508+0000', 'last_change': '2023-10-07T09:00:00.877638+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.877508+0000', 'last_undegraded': '2023-10-07T09:00:00.877508+0000', 'last_fullsized': '2023-10-07T09:00:00.877508+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-07T09:00:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.870941+0000', 'last_change': '2023-10-07T09:00:00.871072+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.870941+0000', 'last_undegraded': '2023-10-07T09:00:00.870941+0000', 'last_fullsized': '2023-10-07T09:00:00.870941+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.875570+0000', 'last_change': '2023-10-07T09:00:00.875693+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.875570+0000', 'last_undegraded': '2023-10-07T09:00:00.875570+0000', 'last_fullsized': '2023-10-07T09:00:00.875570+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.866397+0000', 'last_change': '2023-10-07T09:00:00.866546+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.866397+0000', 'last_undegraded': '2023-10-07T09:00:00.866397+0000', 'last_fullsized': '2023-10-07T09:00:00.866397+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.876296+0000', 'last_change': '2023-10-07T09:00:00.876419+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.876296+0000', 'last_undegraded': '2023-10-07T09:00:00.876296+0000', 'last_fullsized': '2023-10-07T09:00:00.876296+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.877479+0000', 'last_change': '2023-10-07T09:00:00.877624+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.877479+0000', 'last_undegraded': '2023-10-07T09:00:00.877479+0000', 'last_fullsized': '2023-10-07T09:00:00.877479+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-07T09:00:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.870587+0000', 'last_change': '2023-10-07T09:00:00.870830+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.870587+0000', 'last_undegraded': '2023-10-07T09:00:00.870587+0000', 'last_fullsized': '2023-10-07T09:00:00.870587+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.877849+0000', 'last_change': '2023-10-07T09:00:00.877970+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.877849+0000', 'last_undegraded': '2023-10-07T09:00:00.877849+0000', 'last_fullsized': '2023-10-07T09:00:00.877849+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.870534+0000', 'last_change': '2023-10-07T09:00:00.870726+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.870534+0000', 'last_undegraded': '2023-10-07T09:00:00.870534+0000', 'last_fullsized': '2023-10-07T09:00:00.870534+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.872333+0000', 'last_change': '2023-10-07T09:00:00.872464+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.872333+0000', 'last_undegraded': '2023-10-07T09:00:00.872333+0000', 'last_fullsized': '2023-10-07T09:00:00.872333+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871913+0000', 'last_change': '2023-10-07T09:00:00.872070+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871913+0000', 'last_undegraded': '2023-10-07T09:00:00.871913+0000', 'last_fullsized': '2023-10-07T09:00:00.871913+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.871110+0000', 'last_change': '2023-10-07T09:00:00.871279+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.871110+0000', 'last_undegraded': '2023-10-07T09:00:00.871110+0000', 'last_fullsized': '2023-10-07T09:00:00.871110+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.870659+0000', 'last_change': '2023-10-07T09:00:00.870848+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.870659+0000', 'last_undegraded': '2023-10-07T09:00:00.870659+0000', 'last_fullsized': '2023-10-07T09:00:00.870659+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.872655+0000', 'last_change': '2023-10-07T09:00:00.872820+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.872655+0000', 'last_undegraded': '2023-10-07T09:00:00.872655+0000', 'last_fullsized': '2023-10-07T09:00:00.872655+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.875885+0000', 'last_change': '2023-10-07T09:00:00.876001+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.875885+0000', 'last_undegraded': '2023-10-07T09:00:00.875885+0000', 'last_fullsized': '2023-10-07T09:00:00.875885+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-07T09:00:06.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2023-10-07T09:00:00.863213+0000', 'last_change': '2023-10-07T09:00:00.863417+0000', 'last_active': '2023-10-07T08:59:59.852436+0000', 'last_peered': '2023-10-07T08:59:59.852436+0000', 'last_clean': '2023-10-07T08:59:59.852436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:00.863213+0000', 'last_undegraded': '2023-10-07T09:00:00.863213+0000', 'last_fullsized': '2023-10-07T09:00:00.863213+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'last_clean_scrub_stamp': '2023-10-07T08:59:59.852436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:06.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T09:00:06.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 Processor -- start 2023-10-07T09:00:06.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 -- start start 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc406ab40 0x7f6dc415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dc4159c00 0x7f6dc4068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40c8b70 con 0x7f6dc40afaa0 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc415de80 con 0x7f6dc4159c00 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.150+0000 7f6dc928e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc415e160 con 0x7f6dc406ab40 2023-10-07T09:00:06.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dc4159c00 0x7f6dc4068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc27fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6dc40afaa0 0x7f6dc41594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33378/0 (socket says 172.21.15.46:33378) 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc27fc700 1 -- 172.21.15.46:0/2797058358 learned_addr learned my addr 172.21.15.46:0/2797058358 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dc4159c00 0x7f6dc4068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56944/0 (socket says 172.21.15.46:56944) 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc2ffd700 1 --2- 172.21.15.46:0/2797058358 >> v2:172.21.15.133:3300/0 conn(0x7f6dc406ab40 0x7f6dc415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 -- 172.21.15.46:0/2797058358 >> v2:172.21.15.133:3300/0 conn(0x7f6dc406ab40 msgr2=0x7f6dc415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 --2- 172.21.15.46:0/2797058358 >> v2:172.21.15.133:3300/0 conn(0x7f6dc406ab40 0x7f6dc415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 -- 172.21.15.46:0/2797058358 >> v1:172.21.15.46:6789/0 conn(0x7f6dc40afaa0 legacy=0x7f6dc41594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 -- 172.21.15.46:0/2797058358 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc415e440 con 0x7f6dc4159c00 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc1ffb700 1 -- 172.21.15.46:0/2797058358 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288023741 0 0) 0x7f6dac001110 con 0x7f6dc40afaa0 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc37fe700 1 --2- 172.21.15.46:0/2797058358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4068b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406e6b0 tx=0x7f6dbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5229d2c2a6f1ce99 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc1ffb700 1 -- 172.21.15.46:0/2797058358 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00e070 con 0x7f6dc4159c00 2023-10-07T09:00:06.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc1ffb700 1 -- 172.21.15.46:0/2797058358 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00bc30 con 0x7f6dc4159c00 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.151+0000 7f6dc1ffb700 1 -- 172.21.15.46:0/2797058358 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc012430 con 0x7f6dc4159c00 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 -- 172.21.15.46:0/2797058358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 msgr2=0x7f6dc4068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 --2- 172.21.15.46:0/2797058358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4068b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406e6b0 tx=0x7f6dbc009780 comp rx=0 tx=0).stop 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 -- 172.21.15.46:0/2797058358 shutdown_connections 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 --2- 172.21.15.46:0/2797058358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4068b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 --2- 172.21.15.46:0/2797058358 >> v2:172.21.15.133:3300/0 conn(0x7f6dc406ab40 0x7f6dc415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 -- 172.21.15.46:0/2797058358 >> 172.21.15.46:0/2797058358 conn(0x7f6dc40cd640 msgr2=0x7f6dc40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 -- 172.21.15.46:0/2797058358 shutdown_connections 2023-10-07T09:00:06.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.152+0000 7f6dc928e700 1 -- 172.21.15.46:0/2797058358 wait complete. 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.153+0000 7f6dc928e700 1 Processor -- start 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.153+0000 7f6dc928e700 1 -- start start 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc406ab40 0x7f6dc40c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 0x7f6dc4169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c3920 con 0x7f6dc4159c00 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c11c0 con 0x7f6dc406ab40 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc928e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc416a530 con 0x7f6dc40afaa0 2023-10-07T09:00:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56950/0 (socket says 172.21.15.46:56950) 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 -- 172.21.15.46:0/3281536757 learned_addr learned my addr 172.21.15.46:0/3281536757 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc2ffd700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc406ab40 0x7f6dc40c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc27fc700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 0x7f6dc4169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 -- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 msgr2=0x7f6dc4169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 0x7f6dc4169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 -- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc406ab40 msgr2=0x7f6dc40c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc406ab40 0x7f6dc40c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 -- 172.21.15.46:0/3281536757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009a20 con 0x7f6dc4159c00 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc27fc700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 0x7f6dc4169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dc37fe700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406d740 tx=0x7f6dbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.154+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc012ea0 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.155+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc01d630 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.155+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc40c3d40 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.155+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01d9f0 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.155+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40c2d50 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.156+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc40c3a60 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.156+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dbc024070 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.156+0000 7f6dbaffd700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.156+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6dbc086dc0 con 0x7f6dc4159c00 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.157+0000 7f6dc2ffd700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.157+0000 7f6dc2ffd700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 0x7f6da40693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006aa0 tx=0x7f6db4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.161+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dbc053f90 con 0x7f6dc4159c00 2023-10-07T09:00:06.201 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-10-07T09:00:06.200+0000 7fd5a1be2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:00:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.435+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6dc404c3c0 con 0x7f6dc4159c00 2023-10-07T09:00:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.435+0000 7f6dbaffd700 1 -- 172.21.15.46:0/3281536757 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7f6dbc02c670 con 0x7f6dc4159c00 2023-10-07T09:00:06.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:06.437 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":106,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1696669110,"num_in_osds":8,"osd_in_since":1696669102,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":56},{"state_name":"creating+activating","count":40},{"state_name":"creating+peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2449743872,"bytes_avail":770644369408,"bytes_total":773094113280,"inactive_pgs_ratio":0.42268040776252747},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":5334}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-07T08:59:31.775749+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-07T09:00:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 msgr2=0x7f6da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 0x7f6da40693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006aa0 tx=0x7f6db4008040 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 msgr2=0x7f6dc4168db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406d740 tx=0x7f6dbc019000 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 shutdown_connections 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dc4159c00 0x7f6dc4168db0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc406ab40 0x7f6dc40c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 --2- 172.21.15.46:0/3281536757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc40afaa0 0x7f6dc4169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.437+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 >> 172.21.15.46:0/3281536757 conn(0x7f6dc40cd640 msgr2=0x7f6dc4069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.438+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 shutdown_connections 2023-10-07T09:00:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.438+0000 7f6dc928e700 1 -- 172.21.15.46:0/3281536757 wait complete. 2023-10-07T09:00:06.451 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T09:00:06.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:06.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.568+0000 7f481df7f700 1 Processor -- start 2023-10-07T09:00:06.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.568+0000 7f481df7f700 1 -- start start 2023-10-07T09:00:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f481df7f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4818159a40 0x7f48180c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f481df7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 0x7f48180c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f481df7f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481815dc40 con 0x7f481815d7b0 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f481df7f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481815df20 con 0x7f4818159a40 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f481df7f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481815e200 con 0x7f4818159e10 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f48177fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4818159a40 0x7f48180c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f48177fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4818159a40 0x7f48180c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56964/0 (socket says 172.21.15.46:56964) 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.569+0000 7f48177fe700 1 -- 172.21.15.46:0/3631595486 learned_addr learned my addr 172.21.15.46:0/3631595486 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f4817fff700 1 --2- 172.21.15.46:0/3631595486 >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 0x7f48180c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48177fe700 1 -- 172.21.15.46:0/3631595486 >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 msgr2=0x7f48180c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48177fe700 1 --2- 172.21.15.46:0/3631595486 >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 0x7f48180c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48177fe700 1 -- 172.21.15.46:0/3631595486 >> v1:172.21.15.133:6789/0 conn(0x7f481815d7b0 legacy=0x7f48180c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48177fe700 1 -- 172.21.15.46:0/3631595486 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481815e4e0 con 0x7f4818159a40 2023-10-07T09:00:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f4817fff700 1 --2- 172.21.15.46:0/3631595486 >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 0x7f48180c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48177fe700 1 --2- 172.21.15.46:0/3631595486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818159a40 0x7f48180c9510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4818071480 tx=0x7f4808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf0af63076c5fd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48167fc700 1 -- 172.21.15.46:0/3631595486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480800b8f0 con 0x7f4818159a40 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48167fc700 1 -- 172.21.15.46:0/3631595486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480800ba50 con 0x7f4818159a40 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f48167fc700 1 -- 172.21.15.46:0/3631595486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480800bdf0 con 0x7f4818159a40 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f481df7f700 1 -- 172.21.15.46:0/3631595486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818159a40 msgr2=0x7f48180c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.570+0000 7f481df7f700 1 --2- 172.21.15.46:0/3631595486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818159a40 0x7f48180c9510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4818071480 tx=0x7f4808009250 comp rx=0 tx=0).stop 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 -- 172.21.15.46:0/3631595486 shutdown_connections 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 --2- 172.21.15.46:0/3631595486 >> v2:172.21.15.133:3300/0 conn(0x7f4818159e10 0x7f48180c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 --2- 172.21.15.46:0/3631595486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818159a40 0x7f48180c9510 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 -- 172.21.15.46:0/3631595486 >> 172.21.15.46:0/3631595486 conn(0x7f481806b450 msgr2=0x7f48180cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 -- 172.21.15.46:0/3631595486 shutdown_connections 2023-10-07T09:00:06.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.571+0000 7f481df7f700 1 -- 172.21.15.46:0/3631595486 wait complete. 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.572+0000 7f481df7f700 1 Processor -- start 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.572+0000 7f481df7f700 1 -- start start 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 0x7f4818150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 0x7f48180c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c5e60 con 0x7f481815d7b0 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c6140 con 0x7f4818159a40 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c6420 con 0x7f4818159e10 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56968/0 (socket says 172.21.15.46:56968) 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 -- 172.21.15.46:0/3656270816 learned_addr learned my addr 172.21.15.46:0/3656270816 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f48177fe700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 0x7f4818150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4816ffd700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 0x7f48180c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 -- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 msgr2=0x7f48180c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 0x7f48180c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 -- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 msgr2=0x7f4818150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 0x7f4818150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 -- 172.21.15.46:0/3656270816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080094f0 con 0x7f481815d7b0 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f48177fe700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 0x7f4818150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4816ffd700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 0x7f48180c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f4817fff700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f481000d180 tx=0x7f4810009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000ddc0 con 0x7f481815d7b0 2023-10-07T09:00:06.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000f040 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48180c6700 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810015650 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.573+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48180c4fc0 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.574+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481804c3c0 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.575+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4810015a40 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.575+0000 7f47ff7fe700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.575+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4810084dd0 con 0x7f481815d7b0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.575+0000 7f48177fe700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:06.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.576+0000 7f48177fe700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 0x7f48040693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4818071480 tx=0x7f4808017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:06.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.579+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4810052040 con 0x7f481815d7b0 2023-10-07T09:00:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.767+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4818069130 con 0x7f4804066f30 2023-10-07T09:00:06.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.775+0000 7f47ff7fe700 1 -- 172.21.15.46:0/3656270816 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287217 (secure 0 0 0) 0x7f4818069130 con 0x7f4804066f30 2023-10-07T09:00:06.780 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:06.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 msgr2=0x7f48040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 0x7f48040693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4818071480 tx=0x7f4808017000 comp rx=0 tx=0).stop 2023-10-07T09:00:06.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 msgr2=0x7f481815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f481000d180 tx=0x7f4810009a50 comp rx=0 tx=0).stop 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 shutdown_connections 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f481815d7b0 0x7f481815c3e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4818159a40 0x7f4818150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 --2- 172.21.15.46:0/3656270816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4818159e10 0x7f48180c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:06.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 >> 172.21.15.46:0/3656270816 conn(0x7f481806b450 msgr2=0x7f48180c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:06.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 shutdown_connections 2023-10-07T09:00:06.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:06.778+0000 7f481df7f700 1 -- 172.21.15.46:0/3656270816 wait complete. 2023-10-07T09:00:06.784 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:06.792 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-07T09:00:05.783465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3172352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001535"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.868694+0000","last_change":"2023-10-07T09:00:00.868817+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.868694+0000","last_undegraded":"2023-10-07T09:00:00.868694+0000","last_fullsized":"2023-10-07T09:00:00.868694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877084+0000","last_change":"2023-10-07T09:00:00.877084+0000","last_active":"2023-10-07T09:00:00.877084+0000","last_peered":"2023-10-07T09:00:00.877084+0000","last_clean":"2023-10-07T09:00:00.877084+0000","last_became_active":"2023-10-07T09:00:00.876802+0000","last_became_peered":"2023-10-07T09:00:00.876802+0000","last_unstale":"2023-10-07T09:00:00.877084+0000","last_undegraded":"2023-10-07T09:00:00.877084+0000","last_fullsized":"2023-10-07T09:00:00.877084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:44.814877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877110+0000","last_change":"2023-10-07T09:00:00.877258+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877110+0000","last_undegraded":"2023-10-07T09:00:00.877110+0000","last_fullsized":"2023-10-07T09:00:00.877110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871545+0000","last_change":"2023-10-07T09:00:00.872047+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871545+0000","last_undegraded":"2023-10-07T09:00:00.871545+0000","last_fullsized":"2023-10-07T09:00:00.871545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.865994+0000","last_change":"2023-10-07T09:00:00.866157+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.865994+0000","last_undegraded":"2023-10-07T09:00:00.865994+0000","last_fullsized":"2023-10-07T09:00:00.865994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873331+0000","last_change":"2023-10-07T09:00:00.873494+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873331+0000","last_undegraded":"2023-10-07T09:00:00.873331+0000","last_fullsized":"2023-10-07T09:00:00.873331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866693+0000","last_change":"2023-10-07T09:00:00.866830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866693+0000","last_undegraded":"2023-10-07T09:00:00.866693+0000","last_fullsized":"2023-10-07T09:00:00.866693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875755+0000","last_change":"2023-10-07T09:00:00.875825+0000","last_active":"2023-10-07T09:00:00.875755+0000","last_peered":"2023-10-07T09:00:00.875755+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.875535+0000","last_became_peered":"2023-10-07T09:00:00.875535+0000","last_unstale":"2023-10-07T09:00:00.875755+0000","last_undegraded":"2023-10-07T09:00:00.875755+0000","last_fullsized":"2023-10-07T09:00:00.875755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:28.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866577+0000","last_change":"2023-10-07T09:00:00.866723+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866577+0000","last_undegraded":"2023-10-07T09:00:00.866577+0000","last_fullsized":"2023-10-07T09:00:00.866577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863710+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863428+0000","last_change":"2023-10-07T09:00:00.863647+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863428+0000","last_undegraded":"2023-10-07T09:00:00.863428+0000","last_fullsized":"2023-10-07T09:00:00.863428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871500+0000","last_change":"2023-10-07T09:00:00.871633+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871500+0000","last_undegraded":"2023-10-07T09:00:00.871500+0000","last_fullsized":"2023-10-07T09:00:00.871500+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881702+0000","last_change":"2023-10-07T09:00:00.881702+0000","last_active":"2023-10-07T09:00:00.881702+0000","last_peered":"2023-10-07T09:00:00.881702+0000","last_clean":"2023-10-07T09:00:00.881702+0000","last_became_active":"2023-10-07T09:00:00.881391+0000","last_became_peered":"2023-10-07T09:00:00.881391+0000","last_unstale":"2023-10-07T09:00:00.881702+0000","last_undegraded":"2023-10-07T09:00:00.881702+0000","last_fullsized":"2023-10-07T09:00:00.881702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:54.280509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870477+0000","last_change":"2023-10-07T09:00:00.870579+0000","last_active":"2023-10-07T09:00:00.870477+0000","last_peered":"2023-10-07T09:00:00.870477+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870265+0000","last_became_peered":"2023-10-07T09:00:00.870265+0000","last_unstale":"2023-10-07T09:00:00.870477+0000","last_undegraded":"2023-10-07T09:00:00.870477+0000","last_fullsized":"2023-10-07T09:00:00.870477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870675+0000","last_change":"2023-10-07T09:00:00.870744+0000","last_active":"2023-10-07T09:00:00.870675+0000","last_peered":"2023-10-07T09:00:00.870675+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.870486+0000","last_became_peered":"2023-10-07T09:00:00.870486+0000","last_unstale":"2023-10-07T09:00:00.870675+0000","last_undegraded":"2023-10-07T09:00:00.870675+0000","last_fullsized":"2023-10-07T09:00:00.870675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871905+0000","last_change":"2023-10-07T09:00:00.872069+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871905+0000","last_undegraded":"2023-10-07T09:00:00.871905+0000","last_fullsized":"2023-10-07T09:00:00.871905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878540+0000","last_change":"2023-10-07T09:00:00.878540+0000","last_active":"2023-10-07T09:00:00.878540+0000","last_peered":"2023-10-07T09:00:00.878540+0000","last_clean":"2023-10-07T09:00:00.878540+0000","last_became_active":"2023-10-07T09:00:00.878251+0000","last_became_peered":"2023-10-07T09:00:00.878251+0000","last_unstale":"2023-10-07T09:00:00.878540+0000","last_undegraded":"2023-10-07T09:00:00.878540+0000","last_fullsized":"2023-10-07T09:00:00.878540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:27.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877134+0000","last_change":"2023-10-07T09:00:00.877270+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877134+0000","last_undegraded":"2023-10-07T09:00:00.877134+0000","last_fullsized":"2023-10-07T09:00:00.877134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866029+0000","last_change":"2023-10-07T09:00:00.866161+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866029+0000","last_undegraded":"2023-10-07T09:00:00.866029+0000","last_fullsized":"2023-10-07T09:00:00.866029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876761+0000","last_change":"2023-10-07T09:00:00.876761+0000","last_active":"2023-10-07T09:00:00.876761+0000","last_peered":"2023-10-07T09:00:00.876761+0000","last_clean":"2023-10-07T09:00:00.876761+0000","last_became_active":"2023-10-07T09:00:00.876442+0000","last_became_peered":"2023-10-07T09:00:00.876442+0000","last_unstale":"2023-10-07T09:00:00.876761+0000","last_undegraded":"2023-10-07T09:00:00.876761+0000","last_fullsized":"2023-10-07T09:00:00.876761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:24.571544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875422+0000","last_change":"2023-10-07T09:00:00.875796+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875422+0000","last_undegraded":"2023-10-07T09:00:00.875422+0000","last_fullsized":"2023-10-07T09:00:00.875422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879332+0000","last_change":"2023-10-07T09:00:00.879332+0000","last_active":"2023-10-07T09:00:00.879332+0000","last_peered":"2023-10-07T09:00:00.879332+0000","last_clean":"2023-10-07T09:00:00.879332+0000","last_became_active":"2023-10-07T09:00:00.876325+0000","last_became_peered":"2023-10-07T09:00:00.876325+0000","last_unstale":"2023-10-07T09:00:00.879332+0000","last_undegraded":"2023-10-07T09:00:00.879332+0000","last_fullsized":"2023-10-07T09:00:00.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:59.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875959+0000","last_change":"2023-10-07T09:00:00.876088+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875959+0000","last_undegraded":"2023-10-07T09:00:00.875959+0000","last_fullsized":"2023-10-07T09:00:00.875959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881737+0000","last_change":"2023-10-07T09:00:00.881737+0000","last_active":"2023-10-07T09:00:00.881737+0000","last_peered":"2023-10-07T09:00:00.881737+0000","last_clean":"2023-10-07T09:00:00.881737+0000","last_became_active":"2023-10-07T09:00:00.881479+0000","last_became_peered":"2023-10-07T09:00:00.881479+0000","last_unstale":"2023-10-07T09:00:00.881737+0000","last_undegraded":"2023-10-07T09:00:00.881737+0000","last_fullsized":"2023-10-07T09:00:00.881737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:33.628371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873185+0000","last_change":"2023-10-07T09:00:00.873185+0000","last_active":"2023-10-07T09:00:00.873185+0000","last_peered":"2023-10-07T09:00:00.873185+0000","last_clean":"2023-10-07T09:00:00.873185+0000","last_became_active":"2023-10-07T09:00:00.872874+0000","last_became_peered":"2023-10-07T09:00:00.872874+0000","last_unstale":"2023-10-07T09:00:00.873185+0000","last_undegraded":"2023-10-07T09:00:00.873185+0000","last_fullsized":"2023-10-07T09:00:00.873185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:25:15.529282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871120+0000","last_change":"2023-10-07T09:00:00.871263+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871120+0000","last_undegraded":"2023-10-07T09:00:00.871120+0000","last_fullsized":"2023-10-07T09:00:00.871120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873365+0000","last_change":"2023-10-07T09:00:00.873460+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873365+0000","last_undegraded":"2023-10-07T09:00:00.873365+0000","last_fullsized":"2023-10-07T09:00:00.873365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866015+0000","last_change":"2023-10-07T09:00:00.866363+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866015+0000","last_undegraded":"2023-10-07T09:00:00.866015+0000","last_fullsized":"2023-10-07T09:00:00.866015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878311+0000","last_change":"2023-10-07T09:00:00.878311+0000","last_active":"2023-10-07T09:00:00.878311+0000","last_peered":"2023-10-07T09:00:00.878311+0000","last_clean":"2023-10-07T09:00:00.878311+0000","last_became_active":"2023-10-07T09:00:00.877748+0000","last_became_peered":"2023-10-07T09:00:00.877748+0000","last_unstale":"2023-10-07T09:00:00.878311+0000","last_undegraded":"2023-10-07T09:00:00.878311+0000","last_fullsized":"2023-10-07T09:00:00.878311+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:50.858102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875440+0000","last_change":"2023-10-07T09:00:00.875586+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875440+0000","last_undegraded":"2023-10-07T09:00:00.875440+0000","last_fullsized":"2023-10-07T09:00:00.875440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.870666+0000","last_change":"2023-10-07T09:00:00.870666+0000","last_active":"2023-10-07T09:00:00.870666+0000","last_peered":"2023-10-07T09:00:00.870666+0000","last_clean":"2023-10-07T09:00:00.870666+0000","last_became_active":"2023-10-07T09:00:00.870437+0000","last_became_peered":"2023-10-07T09:00:00.870437+0000","last_unstale":"2023-10-07T09:00:00.870666+0000","last_undegraded":"2023-10-07T09:00:00.870666+0000","last_fullsized":"2023-10-07T09:00:00.870666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:09.591539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873428+0000","last_change":"2023-10-07T09:00:00.873570+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873428+0000","last_undegraded":"2023-10-07T09:00:00.873428+0000","last_fullsized":"2023-10-07T09:00:00.873428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872150+0000","last_change":"2023-10-07T09:00:00.872271+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872150+0000","last_undegraded":"2023-10-07T09:00:00.872150+0000","last_fullsized":"2023-10-07T09:00:00.872150+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882661+0000","last_change":"2023-10-07T08:59:59.878882+0000","last_active":"2023-10-07T08:59:59.882661+0000","last_peered":"2023-10-07T08:59:59.882661+0000","last_clean":"2023-10-07T08:59:59.882661+0000","last_became_active":"2023-10-07T08:59:59.878576+0000","last_became_peered":"2023-10-07T08:59:59.878576+0000","last_unstale":"2023-10-07T08:59:59.882661+0000","last_undegraded":"2023-10-07T08:59:59.882661+0000","last_fullsized":"2023-10-07T08:59:59.882661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:37.738910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863394+0000","last_change":"2023-10-07T09:00:00.863540+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863394+0000","last_undegraded":"2023-10-07T09:00:00.863394+0000","last_fullsized":"2023-10-07T09:00:00.863394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882871+0000","last_change":"2023-10-07T08:59:59.877825+0000","last_active":"2023-10-07T08:59:59.882871+0000","last_peered":"2023-10-07T08:59:59.882871+0000","last_clean":"2023-10-07T08:59:59.882871+0000","last_became_active":"2023-10-07T08:59:59.877566+0000","last_became_peered":"2023-10-07T08:59:59.877566+0000","last_unstale":"2023-10-07T08:59:59.882871+0000","last_undegraded":"2023-10-07T08:59:59.882871+0000","last_fullsized":"2023-10-07T08:59:59.882871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:36.032547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872136+0000","last_change":"2023-10-07T09:00:00.873538+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872136+0000","last_undegraded":"2023-10-07T09:00:00.872136+0000","last_fullsized":"2023-10-07T09:00:00.872136+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.872832+0000","last_change":"2023-10-07T08:59:59.871943+0000","last_active":"2023-10-07T08:59:59.872832+0000","last_peered":"2023-10-07T08:59:59.872832+0000","last_clean":"2023-10-07T08:59:59.872832+0000","last_became_active":"2023-10-07T08:59:59.871526+0000","last_became_peered":"2023-10-07T08:59:59.871526+0000","last_unstale":"2023-10-07T08:59:59.872832+0000","last_undegraded":"2023-10-07T08:59:59.872832+0000","last_fullsized":"2023-10-07T08:59:59.872832+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:46:43.375628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.873044+0000","last_change":"2023-10-07T09:00:00.873167+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.873044+0000","last_undegraded":"2023-10-07T09:00:00.873044+0000","last_fullsized":"2023-10-07T09:00:00.873044+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881897+0000","last_change":"2023-10-07T08:59:59.879585+0000","last_active":"2023-10-07T08:59:59.881897+0000","last_peered":"2023-10-07T08:59:59.881897+0000","last_clean":"2023-10-07T08:59:59.881897+0000","last_became_active":"2023-10-07T08:59:59.879308+0000","last_became_peered":"2023-10-07T08:59:59.879308+0000","last_unstale":"2023-10-07T08:59:59.881897+0000","last_undegraded":"2023-10-07T08:59:59.881897+0000","last_fullsized":"2023-10-07T08:59:59.881897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876182+0000","last_change":"2023-10-07T09:00:00.876182+0000","last_active":"2023-10-07T09:00:00.876182+0000","last_peered":"2023-10-07T09:00:00.876182+0000","last_clean":"2023-10-07T09:00:00.876182+0000","last_became_active":"2023-10-07T09:00:00.875935+0000","last_became_peered":"2023-10-07T09:00:00.875935+0000","last_unstale":"2023-10-07T09:00:00.876182+0000","last_undegraded":"2023-10-07T09:00:00.876182+0000","last_fullsized":"2023-10-07T09:00:00.876182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:21.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881505+0000","last_change":"2023-10-07T08:59:59.878940+0000","last_active":"2023-10-07T08:59:59.881505+0000","last_peered":"2023-10-07T08:59:59.881505+0000","last_clean":"2023-10-07T08:59:59.881505+0000","last_became_active":"2023-10-07T08:59:59.878645+0000","last_became_peered":"2023-10-07T08:59:59.878645+0000","last_unstale":"2023-10-07T08:59:59.881505+0000","last_undegraded":"2023-10-07T08:59:59.881505+0000","last_fullsized":"2023-10-07T08:59:59.881505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:35.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878509+0000","last_change":"2023-10-07T09:00:00.878509+0000","last_active":"2023-10-07T09:00:00.878509+0000","last_peered":"2023-10-07T09:00:00.878509+0000","last_clean":"2023-10-07T09:00:00.878509+0000","last_became_active":"2023-10-07T09:00:00.878039+0000","last_became_peered":"2023-10-07T09:00:00.878039+0000","last_unstale":"2023-10-07T09:00:00.878509+0000","last_undegraded":"2023-10-07T09:00:00.878509+0000","last_fullsized":"2023-10-07T09:00:00.878509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:21.720280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882685+0000","last_change":"2023-10-07T08:59:59.881718+0000","last_active":"2023-10-07T08:59:59.882685+0000","last_peered":"2023-10-07T08:59:59.882685+0000","last_clean":"2023-10-07T08:59:59.882685+0000","last_became_active":"2023-10-07T08:59:59.881423+0000","last_became_peered":"2023-10-07T08:59:59.881423+0000","last_unstale":"2023-10-07T08:59:59.882685+0000","last_undegraded":"2023-10-07T08:59:59.882685+0000","last_fullsized":"2023-10-07T08:59:59.882685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881579+0000","last_change":"2023-10-07T09:00:00.881579+0000","last_active":"2023-10-07T09:00:00.881579+0000","last_peered":"2023-10-07T09:00:00.881579+0000","last_clean":"2023-10-07T09:00:00.881579+0000","last_became_active":"2023-10-07T09:00:00.881316+0000","last_became_peered":"2023-10-07T09:00:00.881316+0000","last_unstale":"2023-10-07T09:00:00.881579+0000","last_undegraded":"2023-10-07T09:00:00.881579+0000","last_fullsized":"2023-10-07T09:00:00.881579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:38:07.420548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881728+0000","last_change":"2023-10-07T08:59:59.877239+0000","last_active":"2023-10-07T08:59:59.881728+0000","last_peered":"2023-10-07T08:59:59.881728+0000","last_clean":"2023-10-07T08:59:59.881728+0000","last_became_active":"2023-10-07T08:59:59.876953+0000","last_became_peered":"2023-10-07T08:59:59.876953+0000","last_unstale":"2023-10-07T08:59:59.881728+0000","last_undegraded":"2023-10-07T08:59:59.881728+0000","last_fullsized":"2023-10-07T08:59:59.881728+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879470+0000","last_change":"2023-10-07T09:00:00.879470+0000","last_active":"2023-10-07T09:00:00.879470+0000","last_peered":"2023-10-07T09:00:00.879470+0000","last_clean":"2023-10-07T09:00:00.879470+0000","last_became_active":"2023-10-07T09:00:00.878300+0000","last_became_peered":"2023-10-07T09:00:00.878300+0000","last_unstale":"2023-10-07T09:00:00.879470+0000","last_undegraded":"2023-10-07T09:00:00.879470+0000","last_fullsized":"2023-10-07T09:00:00.879470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:29.483543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881353+0000","last_change":"2023-10-07T08:59:59.877871+0000","last_active":"2023-10-07T08:59:59.881353+0000","last_peered":"2023-10-07T08:59:59.881353+0000","last_clean":"2023-10-07T08:59:59.881353+0000","last_became_active":"2023-10-07T08:59:59.877531+0000","last_became_peered":"2023-10-07T08:59:59.877531+0000","last_unstale":"2023-10-07T08:59:59.881353+0000","last_undegraded":"2023-10-07T08:59:59.881353+0000","last_fullsized":"2023-10-07T08:59:59.881353+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:32.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873973+0000","last_change":"2023-10-07T09:00:00.874063+0000","last_active":"2023-10-07T09:00:00.873973+0000","last_peered":"2023-10-07T09:00:00.873973+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.873760+0000","last_became_peered":"2023-10-07T09:00:00.873760+0000","last_unstale":"2023-10-07T09:00:00.873973+0000","last_undegraded":"2023-10-07T09:00:00.873973+0000","last_fullsized":"2023-10-07T09:00:00.873973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882862+0000","last_change":"2023-10-07T08:59:59.882862+0000","last_active":"2023-10-07T08:59:59.882862+0000","last_peered":"2023-10-07T08:59:59.882862+0000","last_clean":"2023-10-07T08:59:59.882862+0000","last_became_active":"2023-10-07T08:59:59.882624+0000","last_became_peered":"2023-10-07T08:59:59.882624+0000","last_unstale":"2023-10-07T08:59:59.882862+0000","last_undegraded":"2023-10-07T08:59:59.882862+0000","last_fullsized":"2023-10-07T08:59:59.882862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:59:59.852436+0000","last_change":"2023-10-07T08:59:59.867558+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:59:59.852436+0000","last_undegraded":"2023-10-07T08:59:59.852436+0000","last_fullsized":"2023-10-07T08:59:59.852436+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:22.118543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882894+0000","last_change":"2023-10-07T08:59:59.878792+0000","last_active":"2023-10-07T08:59:59.882894+0000","last_peered":"2023-10-07T08:59:59.882894+0000","last_clean":"2023-10-07T08:59:59.882894+0000","last_became_active":"2023-10-07T08:59:59.878532+0000","last_became_peered":"2023-10-07T08:59:59.878532+0000","last_unstale":"2023-10-07T08:59:59.882894+0000","last_undegraded":"2023-10-07T08:59:59.882894+0000","last_fullsized":"2023-10-07T08:59:59.882894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:06.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869524+0000","last_change":"2023-10-07T09:00:00.869524+0000","last_active":"2023-10-07T09:00:00.869524+0000","last_peered":"2023-10-07T09:00:00.869524+0000","last_clean":"2023-10-07T09:00:00.869524+0000","last_became_active":"2023-10-07T09:00:00.868923+0000","last_became_peered":"2023-10-07T09:00:00.868923+0000","last_unstale":"2023-10-07T09:00:00.869524+0000","last_undegraded":"2023-10-07T09:00:00.869524+0000","last_fullsized":"2023-10-07T09:00:00.869524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883637+0000","last_change":"2023-10-07T08:59:59.881364+0000","last_active":"2023-10-07T08:59:59.883637+0000","last_peered":"2023-10-07T08:59:59.883637+0000","last_clean":"2023-10-07T08:59:59.883637+0000","last_became_active":"2023-10-07T08:59:59.881095+0000","last_became_peered":"2023-10-07T08:59:59.881095+0000","last_unstale":"2023-10-07T08:59:59.883637+0000","last_undegraded":"2023-10-07T08:59:59.883637+0000","last_fullsized":"2023-10-07T08:59:59.883637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877508+0000","last_change":"2023-10-07T09:00:00.877638+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877508+0000","last_undegraded":"2023-10-07T09:00:00.877508+0000","last_fullsized":"2023-10-07T09:00:00.877508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881251+0000","last_change":"2023-10-07T08:59:59.873067+0000","last_active":"2023-10-07T08:59:59.881251+0000","last_peered":"2023-10-07T08:59:59.881251+0000","last_clean":"2023-10-07T08:59:59.881251+0000","last_became_active":"2023-10-07T08:59:59.872789+0000","last_became_peered":"2023-10-07T08:59:59.872789+0000","last_unstale":"2023-10-07T08:59:59.881251+0000","last_undegraded":"2023-10-07T08:59:59.881251+0000","last_fullsized":"2023-10-07T08:59:59.881251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870941+0000","last_change":"2023-10-07T09:00:00.871072+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870941+0000","last_undegraded":"2023-10-07T09:00:00.870941+0000","last_fullsized":"2023-10-07T09:00:00.870941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.883479+0000","last_change":"2023-10-07T08:59:59.880786+0000","last_active":"2023-10-07T08:59:59.883479+0000","last_peered":"2023-10-07T08:59:59.883479+0000","last_clean":"2023-10-07T08:59:59.883479+0000","last_became_active":"2023-10-07T08:59:59.880534+0000","last_became_peered":"2023-10-07T08:59:59.880534+0000","last_unstale":"2023-10-07T08:59:59.883479+0000","last_undegraded":"2023-10-07T08:59:59.883479+0000","last_fullsized":"2023-10-07T08:59:59.883479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:33.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875570+0000","last_change":"2023-10-07T09:00:00.875693+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875570+0000","last_undegraded":"2023-10-07T09:00:00.875570+0000","last_fullsized":"2023-10-07T09:00:00.875570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878077+0000","last_change":"2023-10-07T08:59:59.871360+0000","last_active":"2023-10-07T08:59:59.878077+0000","last_peered":"2023-10-07T08:59:59.878077+0000","last_clean":"2023-10-07T08:59:59.878077+0000","last_became_active":"2023-10-07T08:59:59.871077+0000","last_became_peered":"2023-10-07T08:59:59.871077+0000","last_unstale":"2023-10-07T08:59:59.878077+0000","last_undegraded":"2023-10-07T08:59:59.878077+0000","last_fullsized":"2023-10-07T08:59:59.878077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:25.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.866397+0000","last_change":"2023-10-07T09:00:00.866546+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.866397+0000","last_undegraded":"2023-10-07T09:00:00.866397+0000","last_fullsized":"2023-10-07T09:00:00.866397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881929+0000","last_change":"2023-10-07T08:59:59.879657+0000","last_active":"2023-10-07T08:59:59.881929+0000","last_peered":"2023-10-07T08:59:59.881929+0000","last_clean":"2023-10-07T08:59:59.881929+0000","last_became_active":"2023-10-07T08:59:59.879372+0000","last_became_peered":"2023-10-07T08:59:59.879372+0000","last_unstale":"2023-10-07T08:59:59.881929+0000","last_undegraded":"2023-10-07T08:59:59.881929+0000","last_fullsized":"2023-10-07T08:59:59.881929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.876296+0000","last_change":"2023-10-07T09:00:00.876419+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.876296+0000","last_undegraded":"2023-10-07T09:00:00.876296+0000","last_fullsized":"2023-10-07T09:00:00.876296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.886344+0000","last_change":"2023-10-07T08:59:59.882300+0000","last_active":"2023-10-07T08:59:59.886344+0000","last_peered":"2023-10-07T08:59:59.886344+0000","last_clean":"2023-10-07T08:59:59.886344+0000","last_became_active":"2023-10-07T08:59:59.882025+0000","last_became_peered":"2023-10-07T08:59:59.882025+0000","last_unstale":"2023-10-07T08:59:59.886344+0000","last_undegraded":"2023-10-07T08:59:59.886344+0000","last_fullsized":"2023-10-07T08:59:59.886344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877479+0000","last_change":"2023-10-07T09:00:00.877624+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877479+0000","last_undegraded":"2023-10-07T09:00:00.877479+0000","last_fullsized":"2023-10-07T09:00:00.877479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882975+0000","last_change":"2023-10-07T08:59:59.880542+0000","last_active":"2023-10-07T08:59:59.882975+0000","last_peered":"2023-10-07T08:59:59.882975+0000","last_clean":"2023-10-07T08:59:59.882975+0000","last_became_active":"2023-10-07T08:59:59.880259+0000","last_became_peered":"2023-10-07T08:59:59.880259+0000","last_unstale":"2023-10-07T08:59:59.882975+0000","last_undegraded":"2023-10-07T08:59:59.882975+0000","last_fullsized":"2023-10-07T08:59:59.882975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:27.985062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870587+0000","last_change":"2023-10-07T09:00:00.870830+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870587+0000","last_undegraded":"2023-10-07T09:00:00.870587+0000","last_fullsized":"2023-10-07T09:00:00.870587+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882692+0000","last_change":"2023-10-07T08:59:59.879711+0000","last_active":"2023-10-07T08:59:59.882692+0000","last_peered":"2023-10-07T08:59:59.882692+0000","last_clean":"2023-10-07T08:59:59.882692+0000","last_became_active":"2023-10-07T08:59:59.879410+0000","last_became_peered":"2023-10-07T08:59:59.879410+0000","last_unstale":"2023-10-07T08:59:59.882692+0000","last_undegraded":"2023-10-07T08:59:59.882692+0000","last_fullsized":"2023-10-07T08:59:59.882692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:53.114711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874020+0000","last_change":"2023-10-07T09:00:00.874020+0000","last_active":"2023-10-07T09:00:00.874020+0000","last_peered":"2023-10-07T09:00:00.874020+0000","last_clean":"2023-10-07T09:00:00.874020+0000","last_became_active":"2023-10-07T09:00:00.873739+0000","last_became_peered":"2023-10-07T09:00:00.873739+0000","last_unstale":"2023-10-07T09:00:00.874020+0000","last_undegraded":"2023-10-07T09:00:00.874020+0000","last_fullsized":"2023-10-07T09:00:00.874020+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:12.366488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881914+0000","last_change":"2023-10-07T08:59:59.879611+0000","last_active":"2023-10-07T08:59:59.881914+0000","last_peered":"2023-10-07T08:59:59.881914+0000","last_clean":"2023-10-07T08:59:59.881914+0000","last_became_active":"2023-10-07T08:59:59.879301+0000","last_became_peered":"2023-10-07T08:59:59.879301+0000","last_unstale":"2023-10-07T08:59:59.881914+0000","last_undegraded":"2023-10-07T08:59:59.881914+0000","last_fullsized":"2023-10-07T08:59:59.881914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:34.395138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.877849+0000","last_change":"2023-10-07T09:00:00.877970+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.877849+0000","last_undegraded":"2023-10-07T09:00:00.877849+0000","last_fullsized":"2023-10-07T09:00:00.877849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.884007+0000","last_change":"2023-10-07T08:59:59.882939+0000","last_active":"2023-10-07T08:59:59.884007+0000","last_peered":"2023-10-07T08:59:59.884007+0000","last_clean":"2023-10-07T08:59:59.884007+0000","last_became_active":"2023-10-07T08:59:59.882525+0000","last_became_peered":"2023-10-07T08:59:59.882525+0000","last_unstale":"2023-10-07T08:59:59.884007+0000","last_undegraded":"2023-10-07T08:59:59.884007+0000","last_fullsized":"2023-10-07T08:59:59.884007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:27.723456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870534+0000","last_change":"2023-10-07T09:00:00.870726+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870534+0000","last_undegraded":"2023-10-07T09:00:00.870534+0000","last_fullsized":"2023-10-07T09:00:00.870534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882924+0000","last_change":"2023-10-07T08:59:59.876486+0000","last_active":"2023-10-07T08:59:59.882924+0000","last_peered":"2023-10-07T08:59:59.882924+0000","last_clean":"2023-10-07T08:59:59.882924+0000","last_became_active":"2023-10-07T08:59:59.876139+0000","last_became_peered":"2023-10-07T08:59:59.876139+0000","last_unstale":"2023-10-07T08:59:59.882924+0000","last_undegraded":"2023-10-07T08:59:59.882924+0000","last_fullsized":"2023-10-07T08:59:59.882924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:06.252338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872333+0000","last_change":"2023-10-07T09:00:00.872464+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872333+0000","last_undegraded":"2023-10-07T09:00:00.872333+0000","last_fullsized":"2023-10-07T09:00:00.872333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879743+0000","last_change":"2023-10-07T08:59:59.877521+0000","last_active":"2023-10-07T08:59:59.879743+0000","last_peered":"2023-10-07T08:59:59.879743+0000","last_clean":"2023-10-07T08:59:59.879743+0000","last_became_active":"2023-10-07T08:59:59.877269+0000","last_became_peered":"2023-10-07T08:59:59.877269+0000","last_unstale":"2023-10-07T08:59:59.879743+0000","last_undegraded":"2023-10-07T08:59:59.879743+0000","last_fullsized":"2023-10-07T08:59:59.879743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:28.720828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871913+0000","last_change":"2023-10-07T09:00:00.872070+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871913+0000","last_undegraded":"2023-10-07T09:00:00.871913+0000","last_fullsized":"2023-10-07T09:00:00.871913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881841+0000","last_change":"2023-10-07T08:59:59.878211+0000","last_active":"2023-10-07T08:59:59.881841+0000","last_peered":"2023-10-07T08:59:59.881841+0000","last_clean":"2023-10-07T08:59:59.881841+0000","last_became_active":"2023-10-07T08:59:59.877912+0000","last_became_peered":"2023-10-07T08:59:59.877912+0000","last_unstale":"2023-10-07T08:59:59.881841+0000","last_undegraded":"2023-10-07T08:59:59.881841+0000","last_fullsized":"2023-10-07T08:59:59.881841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:02.674160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.871110+0000","last_change":"2023-10-07T09:00:00.871279+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.871110+0000","last_undegraded":"2023-10-07T09:00:00.871110+0000","last_fullsized":"2023-10-07T09:00:00.871110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879696+0000","last_change":"2023-10-07T08:59:59.877982+0000","last_active":"2023-10-07T08:59:59.879696+0000","last_peered":"2023-10-07T08:59:59.879696+0000","last_clean":"2023-10-07T08:59:59.879696+0000","last_became_active":"2023-10-07T08:59:59.877677+0000","last_became_peered":"2023-10-07T08:59:59.877677+0000","last_unstale":"2023-10-07T08:59:59.879696+0000","last_undegraded":"2023-10-07T08:59:59.879696+0000","last_fullsized":"2023-10-07T08:59:59.879696+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:04.391970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.870659+0000","last_change":"2023-10-07T09:00:00.870848+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.870659+0000","last_undegraded":"2023-10-07T09:00:00.870659+0000","last_fullsized":"2023-10-07T09:00:00.870659+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882132+0000","last_change":"2023-10-07T08:59:59.873692+0000","last_active":"2023-10-07T08:59:59.882132+0000","last_peered":"2023-10-07T08:59:59.882132+0000","last_clean":"2023-10-07T08:59:59.882132+0000","last_became_active":"2023-10-07T08:59:59.873416+0000","last_became_peered":"2023-10-07T08:59:59.873416+0000","last_unstale":"2023-10-07T08:59:59.882132+0000","last_undegraded":"2023-10-07T08:59:59.882132+0000","last_fullsized":"2023-10-07T08:59:59.882132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:05.503904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.869702+0000","last_change":"2023-10-07T09:00:00.869702+0000","last_active":"2023-10-07T09:00:00.869702+0000","last_peered":"2023-10-07T09:00:00.869702+0000","last_clean":"2023-10-07T09:00:00.869702+0000","last_became_active":"2023-10-07T09:00:00.869276+0000","last_became_peered":"2023-10-07T09:00:00.869276+0000","last_unstale":"2023-10-07T09:00:00.869702+0000","last_undegraded":"2023-10-07T09:00:00.869702+0000","last_fullsized":"2023-10-07T09:00:00.869702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.878000+0000","last_change":"2023-10-07T08:59:59.870863+0000","last_active":"2023-10-07T08:59:59.878000+0000","last_peered":"2023-10-07T08:59:59.878000+0000","last_clean":"2023-10-07T08:59:59.878000+0000","last_became_active":"2023-10-07T08:59:59.870553+0000","last_became_peered":"2023-10-07T08:59:59.870553+0000","last_unstale":"2023-10-07T08:59:59.878000+0000","last_undegraded":"2023-10-07T08:59:59.878000+0000","last_fullsized":"2023-10-07T08:59:59.878000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:25.612939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.872655+0000","last_change":"2023-10-07T09:00:00.872820+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.872655+0000","last_undegraded":"2023-10-07T09:00:00.872655+0000","last_fullsized":"2023-10-07T09:00:00.872655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881847+0000","last_change":"2023-10-07T08:59:59.877544+0000","last_active":"2023-10-07T08:59:59.881847+0000","last_peered":"2023-10-07T08:59:59.881847+0000","last_clean":"2023-10-07T08:59:59.881847+0000","last_became_active":"2023-10-07T08:59:59.876631+0000","last_became_peered":"2023-10-07T08:59:59.876631+0000","last_unstale":"2023-10-07T08:59:59.881847+0000","last_undegraded":"2023-10-07T08:59:59.881847+0000","last_fullsized":"2023-10-07T08:59:59.881847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876334+0000","last_change":"2023-10-07T09:00:00.876334+0000","last_active":"2023-10-07T09:00:00.876334+0000","last_peered":"2023-10-07T09:00:00.876334+0000","last_clean":"2023-10-07T09:00:00.876334+0000","last_became_active":"2023-10-07T09:00:00.876055+0000","last_became_peered":"2023-10-07T09:00:00.876055+0000","last_unstale":"2023-10-07T09:00:00.876334+0000","last_undegraded":"2023-10-07T09:00:00.876334+0000","last_fullsized":"2023-10-07T09:00:00.876334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:05.377189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.879769+0000","last_change":"2023-10-07T08:59:59.878174+0000","last_active":"2023-10-07T08:59:59.879769+0000","last_peered":"2023-10-07T08:59:59.879769+0000","last_clean":"2023-10-07T08:59:59.879769+0000","last_became_active":"2023-10-07T08:59:59.877621+0000","last_became_peered":"2023-10-07T08:59:59.877621+0000","last_unstale":"2023-10-07T08:59:59.879769+0000","last_undegraded":"2023-10-07T08:59:59.879769+0000","last_fullsized":"2023-10-07T08:59:59.879769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.875885+0000","last_change":"2023-10-07T09:00:00.876001+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.875885+0000","last_undegraded":"2023-10-07T09:00:00.875885+0000","last_fullsized":"2023-10-07T09:00:00.875885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.876448+0000","last_change":"2023-10-07T08:59:59.872199+0000","last_active":"2023-10-07T08:59:59.876448+0000","last_peered":"2023-10-07T08:59:59.876448+0000","last_clean":"2023-10-07T08:59:59.876448+0000","last_became_active":"2023-10-07T08:59:59.871880+0000","last_became_peered":"2023-10-07T08:59:59.871880+0000","last_unstale":"2023-10-07T08:59:59.876448+0000","last_undegraded":"2023-10-07T08:59:59.876448+0000","last_fullsized":"2023-10-07T08:59:59.876448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":2,"reported_epoch":51,"state":"creating+activating","last_fresh":"2023-10-07T09:00:00.863213+0000","last_change":"2023-10-07T09:00:00.863417+0000","last_active":"2023-10-07T08:59:59.852436+0000","last_peered":"2023-10-07T08:59:59.852436+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:00.863213+0000","last_undegraded":"2023-10-07T09:00:00.863213+0000","last_fullsized":"2023-10-07T09:00:00.863213+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.875014+0000","last_change":"2023-10-07T08:59:59.873447+0000","last_active":"2023-10-07T08:59:59.875014+0000","last_peered":"2023-10-07T08:59:59.875014+0000","last_clean":"2023-10-07T08:59:59.875014+0000","last_became_active":"2023-10-07T08:59:59.873072+0000","last_became_peered":"2023-10-07T08:59:59.873072+0000","last_unstale":"2023-10-07T08:59:59.875014+0000","last_undegraded":"2023-10-07T08:59:59.875014+0000","last_fullsized":"2023-10-07T08:59:59.875014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878785+0000","last_change":"2023-10-07T09:00:00.878785+0000","last_active":"2023-10-07T09:00:00.878785+0000","last_peered":"2023-10-07T09:00:00.878785+0000","last_clean":"2023-10-07T09:00:00.878785+0000","last_became_active":"2023-10-07T09:00:00.878430+0000","last_became_peered":"2023-10-07T09:00:00.878430+0000","last_unstale":"2023-10-07T09:00:00.878785+0000","last_undegraded":"2023-10-07T09:00:00.878785+0000","last_fullsized":"2023-10-07T09:00:00.878785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:44.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.882816+0000","last_change":"2023-10-07T08:59:59.876825+0000","last_active":"2023-10-07T08:59:59.882816+0000","last_peered":"2023-10-07T08:59:59.882816+0000","last_clean":"2023-10-07T08:59:59.882816+0000","last_became_active":"2023-10-07T08:59:59.876559+0000","last_became_peered":"2023-10-07T08:59:59.876559+0000","last_unstale":"2023-10-07T08:59:59.882816+0000","last_undegraded":"2023-10-07T08:59:59.882816+0000","last_fullsized":"2023-10-07T08:59:59.882816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:21.766641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":7,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.877562+0000","last_change":"2023-10-07T09:00:00.877647+0000","last_active":"2023-10-07T09:00:00.877562+0000","last_peered":"2023-10-07T09:00:00.877562+0000","last_clean":"2023-10-07T08:59:59.852436+0000","last_became_active":"2023-10-07T09:00:00.877358+0000","last_became_peered":"2023-10-07T09:00:00.877358+0000","last_unstale":"2023-10-07T09:00:00.877562+0000","last_undegraded":"2023-10-07T09:00:00.877562+0000","last_fullsized":"2023-10-07T09:00:00.877562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:14.133478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.881085+0000","last_change":"2023-10-07T08:59:59.877003+0000","last_active":"2023-10-07T08:59:59.881085+0000","last_peered":"2023-10-07T08:59:59.881085+0000","last_clean":"2023-10-07T08:59:59.881085+0000","last_became_active":"2023-10-07T08:59:59.876690+0000","last_became_peered":"2023-10-07T08:59:59.876690+0000","last_unstale":"2023-10-07T08:59:59.881085+0000","last_undegraded":"2023-10-07T08:59:59.881085+0000","last_fullsized":"2023-10-07T08:59:59.881085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:56.938318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-07T08:59:59.873423+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T08:59:59.873423+0000","last_peered":"2023-10-07T08:59:59.873423+0000","last_clean":"2023-10-07T08:59:59.873423+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T08:59:59.873423+0000","last_undegraded":"2023-10-07T08:59:59.873423+0000","last_fullsized":"2023-10-07T08:59:59.873423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.91900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.308},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":839320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.377}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.215},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.255}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.307},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.755}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.502},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":248952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:09.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:09.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.936+0000 7f329d62a700 1 Processor -- start 2023-10-07T09:00:09.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.936+0000 7f329d62a700 1 -- start start 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f329d62a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32980cd0f0 0x7f32981598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f329d62a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3298159de0 0x7f329815a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f329d62a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32980d01f0 con 0x7f32981594d0 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f329d62a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32980cd540 con 0x7f3298159de0 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f329d62a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980cf5e0 con 0x7f32980cd0f0 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.937+0000 7f32977fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3298159de0 0x7f329815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3298159de0 0x7f329815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42028/0 (socket says 172.21.15.46:42028) 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 -- 172.21.15.46:0/4141251137 learned_addr learned my addr 172.21.15.46:0/4141251137 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32967fc700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32980cd0f0 0x7f32981598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 -- 172.21.15.46:0/4141251137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32980cd0f0 msgr2=0x7f32981598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32980cd0f0 0x7f32981598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 -- 172.21.15.46:0/4141251137 >> v1:172.21.15.133:6789/0 conn(0x7f32981594d0 legacy=0x7f32980b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 -- 172.21.15.46:0/4141251137 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32980cf8c0 con 0x7f3298159de0 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f32977fe700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3298159de0 0x7f329815a240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3290009f20 tx=0x7f3290009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bafd0acb8c8fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f3295ffb700 1 -- 172.21.15.46:0/4141251137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000e070 con 0x7f3298159de0 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f3295ffb700 1 -- 172.21.15.46:0/4141251137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329000b9d0 con 0x7f3298159de0 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.938+0000 7f3295ffb700 1 -- 172.21.15.46:0/4141251137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900092e0 con 0x7f3298159de0 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 -- 172.21.15.46:0/4141251137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3298159de0 msgr2=0x7f329815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3298159de0 0x7f329815a240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3290009f20 tx=0x7f3290009840 comp rx=0 tx=0).stop 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 -- 172.21.15.46:0/4141251137 shutdown_connections 2023-10-07T09:00:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3298159de0 0x7f329815a240 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:09.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 --2- 172.21.15.46:0/4141251137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32980cd0f0 0x7f32981598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:09.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 -- 172.21.15.46:0/4141251137 >> 172.21.15.46:0/4141251137 conn(0x7f32980d05f0 msgr2=0x7f32980d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:09.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 -- 172.21.15.46:0/4141251137 shutdown_connections 2023-10-07T09:00:09.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.939+0000 7f329d62a700 1 -- 172.21.15.46:0/4141251137 wait complete. 2023-10-07T09:00:09.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.940+0000 7f329d62a700 1 Processor -- start 2023-10-07T09:00:09.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.940+0000 7f329d62a700 1 -- start start 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32981594d0 0x7f3298152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 0x7f3298157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3298158ca0 con 0x7f32980cd0f0 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980b4ab0 con 0x7f3298159de0 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f329d62a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32981589c0 con 0x7f32981594d0 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42036/0 (socket says 172.21.15.46:42036) 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 -- 172.21.15.46:0/495539163 learned_addr learned my addr 172.21.15.46:0/495539163 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f32967fc700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32981594d0 0x7f3298152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f32977fe700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 0x7f3298157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 -- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32981594d0 msgr2=0x7f3298152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32981594d0 0x7f3298152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 -- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 msgr2=0x7f3298157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 0x7f3298157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f3296ffd700 1 -- 172.21.15.46:0/495539163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290009ae0 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.941+0000 7f32977fe700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 0x7f3298157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f3296ffd700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f328800c590 tx=0x7f328800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288011590 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288011710 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32980b4d50 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288011ad0 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.942+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32981577c0 con 0x7f32980cd0f0 2023-10-07T09:00:09.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.943+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32980b4910 con 0x7f32980cd0f0 2023-10-07T09:00:09.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.943+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f328801b3b0 con 0x7f32980cd0f0 2023-10-07T09:00:09.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.943+0000 7f327effd700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 0x7f32840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:09.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.944+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3288083a60 con 0x7f32980cd0f0 2023-10-07T09:00:09.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.944+0000 7f32967fc700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 0x7f32840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:09.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.944+0000 7f32967fc700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 0x7f32840693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3298157bc0 tx=0x7f328c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:09.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:09.948+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32980b4910 con 0x7f32980cd0f0 2023-10-07T09:00:10.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.136+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32980b4910 con 0x7f3284066f30 2023-10-07T09:00:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.145+0000 7f327effd700 1 -- 172.21.15.46:0/495539163 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288643 (secure 0 0 0) 0x7f32980b4910 con 0x7f3284066f30 2023-10-07T09:00:10.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:10.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 msgr2=0x7f32840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 0x7f32840693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3298157bc0 tx=0x7f328c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 msgr2=0x7f32980b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f328800c590 tx=0x7f328800c8a0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 shutdown_connections 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3284066f30 0x7f32840693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3298159de0 0x7f3298157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32980cd0f0 0x7f32980b5550 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 --2- 172.21.15.46:0/495539163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32981594d0 0x7f3298152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 >> 172.21.15.46:0/495539163 conn(0x7f32980d05f0 msgr2=0x7f32980b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 shutdown_connections 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.148+0000 7f329d62a700 1 -- 172.21.15.46:0/495539163 wait complete. 2023-10-07T09:00:10.156 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:10.162 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-07T09:00:09.784499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392584,"kb_used_data":6088,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582136,"statfs":{"total":773094113280,"available":770644107264,"internally_reserved":0,"allocated":6234112,"data_stored":3281372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.919786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881439+0000","last_change":"2023-10-07T09:00:00.878121+0000","last_active":"2023-10-07T09:00:00.881439+0000","last_peered":"2023-10-07T09:00:00.881439+0000","last_clean":"2023-10-07T09:00:00.881439+0000","last_became_active":"2023-10-07T09:00:00.877855+0000","last_became_peered":"2023-10-07T09:00:00.877855+0000","last_unstale":"2023-10-07T09:00:00.881439+0000","last_undegraded":"2023-10-07T09:00:00.881439+0000","last_fullsized":"2023-10-07T09:00:00.881439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:03.342083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882792+0000","last_change":"2023-10-07T09:00:00.877084+0000","last_active":"2023-10-07T09:00:00.882792+0000","last_peered":"2023-10-07T09:00:00.882792+0000","last_clean":"2023-10-07T09:00:00.882792+0000","last_became_active":"2023-10-07T09:00:00.876802+0000","last_became_peered":"2023-10-07T09:00:00.876802+0000","last_unstale":"2023-10-07T09:00:00.882792+0000","last_undegraded":"2023-10-07T09:00:00.882792+0000","last_fullsized":"2023-10-07T09:00:00.882792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:44.814877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.891298+0000","last_change":"2023-10-07T09:00:00.885602+0000","last_active":"2023-10-07T09:00:00.891298+0000","last_peered":"2023-10-07T09:00:00.891298+0000","last_clean":"2023-10-07T09:00:00.891298+0000","last_became_active":"2023-10-07T09:00:00.885170+0000","last_became_peered":"2023-10-07T09:00:00.885170+0000","last_unstale":"2023-10-07T09:00:00.891298+0000","last_undegraded":"2023-10-07T09:00:00.891298+0000","last_fullsized":"2023-10-07T09:00:00.891298+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:14.896995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.880308+0000","last_change":"2023-10-07T09:00:00.877108+0000","last_active":"2023-10-07T09:00:00.880308+0000","last_peered":"2023-10-07T09:00:00.880308+0000","last_clean":"2023-10-07T09:00:00.880308+0000","last_became_active":"2023-10-07T09:00:00.876865+0000","last_became_peered":"2023-10-07T09:00:00.876865+0000","last_unstale":"2023-10-07T09:00:00.880308+0000","last_undegraded":"2023-10-07T09:00:00.880308+0000","last_fullsized":"2023-10-07T09:00:00.880308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881375+0000","last_change":"2023-10-07T09:00:00.878173+0000","last_active":"2023-10-07T09:00:00.881375+0000","last_peered":"2023-10-07T09:00:00.881375+0000","last_clean":"2023-10-07T09:00:00.881375+0000","last_became_active":"2023-10-07T09:00:00.877897+0000","last_became_peered":"2023-10-07T09:00:00.877897+0000","last_unstale":"2023-10-07T09:00:00.881375+0000","last_undegraded":"2023-10-07T09:00:00.881375+0000","last_fullsized":"2023-10-07T09:00:00.881375+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:28.743649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881811+0000","last_change":"2023-10-07T09:00:00.879834+0000","last_active":"2023-10-07T09:00:00.881811+0000","last_peered":"2023-10-07T09:00:00.881811+0000","last_clean":"2023-10-07T09:00:00.881811+0000","last_became_active":"2023-10-07T09:00:00.878868+0000","last_became_peered":"2023-10-07T09:00:00.878868+0000","last_unstale":"2023-10-07T09:00:00.881811+0000","last_undegraded":"2023-10-07T09:00:00.881811+0000","last_fullsized":"2023-10-07T09:00:00.881811+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882888+0000","last_change":"2023-10-07T09:00:00.879247+0000","last_active":"2023-10-07T09:00:00.882888+0000","last_peered":"2023-10-07T09:00:00.882888+0000","last_clean":"2023-10-07T09:00:00.882888+0000","last_became_active":"2023-10-07T09:00:00.878985+0000","last_became_peered":"2023-10-07T09:00:00.878985+0000","last_unstale":"2023-10-07T09:00:00.882888+0000","last_undegraded":"2023-10-07T09:00:00.882888+0000","last_fullsized":"2023-10-07T09:00:00.882888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883168+0000","last_change":"2023-10-07T09:00:00.875825+0000","last_active":"2023-10-07T09:00:00.883168+0000","last_peered":"2023-10-07T09:00:00.883168+0000","last_clean":"2023-10-07T09:00:00.883168+0000","last_became_active":"2023-10-07T09:00:00.875535+0000","last_became_peered":"2023-10-07T09:00:00.875535+0000","last_unstale":"2023-10-07T09:00:00.883168+0000","last_undegraded":"2023-10-07T09:00:00.883168+0000","last_fullsized":"2023-10-07T09:00:00.883168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:28.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882411+0000","last_change":"2023-10-07T09:00:00.876363+0000","last_active":"2023-10-07T09:00:00.882411+0000","last_peered":"2023-10-07T09:00:00.882411+0000","last_clean":"2023-10-07T09:00:00.882411+0000","last_became_active":"2023-10-07T09:00:00.876101+0000","last_became_peered":"2023-10-07T09:00:00.876101+0000","last_unstale":"2023-10-07T09:00:00.882411+0000","last_undegraded":"2023-10-07T09:00:00.882411+0000","last_fullsized":"2023-10-07T09:00:00.882411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.884889+0000","last_change":"2023-10-07T09:00:00.882721+0000","last_active":"2023-10-07T09:00:00.884889+0000","last_peered":"2023-10-07T09:00:00.884889+0000","last_clean":"2023-10-07T09:00:00.884889+0000","last_became_active":"2023-10-07T09:00:00.882463+0000","last_became_peered":"2023-10-07T09:00:00.882463+0000","last_unstale":"2023-10-07T09:00:00.884889+0000","last_undegraded":"2023-10-07T09:00:00.884889+0000","last_fullsized":"2023-10-07T09:00:00.884889+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:35.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883529+0000","last_change":"2023-10-07T09:00:00.879613+0000","last_active":"2023-10-07T09:00:00.883529+0000","last_peered":"2023-10-07T09:00:00.883529+0000","last_clean":"2023-10-07T09:00:00.883529+0000","last_became_active":"2023-10-07T09:00:00.879346+0000","last_became_peered":"2023-10-07T09:00:00.879346+0000","last_unstale":"2023-10-07T09:00:00.883529+0000","last_undegraded":"2023-10-07T09:00:00.883529+0000","last_fullsized":"2023-10-07T09:00:00.883529+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883591+0000","last_change":"2023-10-07T09:00:00.881093+0000","last_active":"2023-10-07T09:00:00.883591+0000","last_peered":"2023-10-07T09:00:00.883591+0000","last_clean":"2023-10-07T09:00:00.883591+0000","last_became_active":"2023-10-07T09:00:00.880478+0000","last_became_peered":"2023-10-07T09:00:00.880478+0000","last_unstale":"2023-10-07T09:00:00.883591+0000","last_undegraded":"2023-10-07T09:00:00.883591+0000","last_fullsized":"2023-10-07T09:00:00.883591+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883792+0000","last_change":"2023-10-07T09:00:00.881702+0000","last_active":"2023-10-07T09:00:00.883792+0000","last_peered":"2023-10-07T09:00:00.883792+0000","last_clean":"2023-10-07T09:00:00.883792+0000","last_became_active":"2023-10-07T09:00:00.881391+0000","last_became_peered":"2023-10-07T09:00:00.881391+0000","last_unstale":"2023-10-07T09:00:00.883792+0000","last_undegraded":"2023-10-07T09:00:00.883792+0000","last_fullsized":"2023-10-07T09:00:00.883792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:54.280509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875554+0000","last_change":"2023-10-07T09:00:00.870579+0000","last_active":"2023-10-07T09:00:00.875554+0000","last_peered":"2023-10-07T09:00:00.875554+0000","last_clean":"2023-10-07T09:00:00.875554+0000","last_became_active":"2023-10-07T09:00:00.870265+0000","last_became_peered":"2023-10-07T09:00:00.870265+0000","last_unstale":"2023-10-07T09:00:00.875554+0000","last_undegraded":"2023-10-07T09:00:00.875554+0000","last_fullsized":"2023-10-07T09:00:00.875554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875526+0000","last_change":"2023-10-07T09:00:00.870744+0000","last_active":"2023-10-07T09:00:00.875526+0000","last_peered":"2023-10-07T09:00:00.875526+0000","last_clean":"2023-10-07T09:00:00.875526+0000","last_became_active":"2023-10-07T09:00:00.870486+0000","last_became_peered":"2023-10-07T09:00:00.870486+0000","last_unstale":"2023-10-07T09:00:00.875526+0000","last_undegraded":"2023-10-07T09:00:00.875526+0000","last_fullsized":"2023-10-07T09:00:00.875526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887222+0000","last_change":"2023-10-07T09:00:00.886628+0000","last_active":"2023-10-07T09:00:00.887222+0000","last_peered":"2023-10-07T09:00:00.887222+0000","last_clean":"2023-10-07T09:00:00.887222+0000","last_became_active":"2023-10-07T09:00:00.886045+0000","last_became_peered":"2023-10-07T09:00:00.886045+0000","last_unstale":"2023-10-07T09:00:00.887222+0000","last_undegraded":"2023-10-07T09:00:00.887222+0000","last_fullsized":"2023-10-07T09:00:00.887222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:52.089173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882861+0000","last_change":"2023-10-07T09:00:00.878540+0000","last_active":"2023-10-07T09:00:00.882861+0000","last_peered":"2023-10-07T09:00:00.882861+0000","last_clean":"2023-10-07T09:00:00.882861+0000","last_became_active":"2023-10-07T09:00:00.878251+0000","last_became_peered":"2023-10-07T09:00:00.878251+0000","last_unstale":"2023-10-07T09:00:00.882861+0000","last_undegraded":"2023-10-07T09:00:00.882861+0000","last_fullsized":"2023-10-07T09:00:00.882861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:27.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.886876+0000","last_change":"2023-10-07T09:00:00.883815+0000","last_active":"2023-10-07T09:00:00.886876+0000","last_peered":"2023-10-07T09:00:00.886876+0000","last_clean":"2023-10-07T09:00:00.886876+0000","last_became_active":"2023-10-07T09:00:00.883561+0000","last_became_peered":"2023-10-07T09:00:00.883561+0000","last_unstale":"2023-10-07T09:00:00.886876+0000","last_undegraded":"2023-10-07T09:00:00.886876+0000","last_fullsized":"2023-10-07T09:00:00.886876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:07.257533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.885506+0000","last_change":"2023-10-07T09:00:00.883932+0000","last_active":"2023-10-07T09:00:00.885506+0000","last_peered":"2023-10-07T09:00:00.885506+0000","last_clean":"2023-10-07T09:00:00.885506+0000","last_became_active":"2023-10-07T09:00:00.883612+0000","last_became_peered":"2023-10-07T09:00:00.883612+0000","last_unstale":"2023-10-07T09:00:00.885506+0000","last_undegraded":"2023-10-07T09:00:00.885506+0000","last_fullsized":"2023-10-07T09:00:00.885506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:09.110839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.880979+0000","last_change":"2023-10-07T09:00:00.876761+0000","last_active":"2023-10-07T09:00:00.880979+0000","last_peered":"2023-10-07T09:00:00.880979+0000","last_clean":"2023-10-07T09:00:00.880979+0000","last_became_active":"2023-10-07T09:00:00.876442+0000","last_became_peered":"2023-10-07T09:00:00.876442+0000","last_unstale":"2023-10-07T09:00:00.880979+0000","last_undegraded":"2023-10-07T09:00:00.880979+0000","last_fullsized":"2023-10-07T09:00:00.880979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:24.571544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.885438+0000","last_change":"2023-10-07T09:00:00.882953+0000","last_active":"2023-10-07T09:00:00.885438+0000","last_peered":"2023-10-07T09:00:00.885438+0000","last_clean":"2023-10-07T09:00:00.885438+0000","last_became_active":"2023-10-07T09:00:00.882701+0000","last_became_peered":"2023-10-07T09:00:00.882701+0000","last_unstale":"2023-10-07T09:00:00.885438+0000","last_undegraded":"2023-10-07T09:00:00.885438+0000","last_fullsized":"2023-10-07T09:00:00.885438+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882818+0000","last_change":"2023-10-07T09:00:00.879332+0000","last_active":"2023-10-07T09:00:00.882818+0000","last_peered":"2023-10-07T09:00:00.882818+0000","last_clean":"2023-10-07T09:00:00.882818+0000","last_became_active":"2023-10-07T09:00:00.876325+0000","last_became_peered":"2023-10-07T09:00:00.876325+0000","last_unstale":"2023-10-07T09:00:00.882818+0000","last_undegraded":"2023-10-07T09:00:00.882818+0000","last_fullsized":"2023-10-07T09:00:00.882818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:59.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887017+0000","last_change":"2023-10-07T09:00:00.884562+0000","last_active":"2023-10-07T09:00:00.887017+0000","last_peered":"2023-10-07T09:00:00.887017+0000","last_clean":"2023-10-07T09:00:00.887017+0000","last_became_active":"2023-10-07T09:00:00.883466+0000","last_became_peered":"2023-10-07T09:00:00.883466+0000","last_unstale":"2023-10-07T09:00:00.887017+0000","last_undegraded":"2023-10-07T09:00:00.887017+0000","last_fullsized":"2023-10-07T09:00:00.887017+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:09.465511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.884019+0000","last_change":"2023-10-07T09:00:00.881737+0000","last_active":"2023-10-07T09:00:00.884019+0000","last_peered":"2023-10-07T09:00:00.884019+0000","last_clean":"2023-10-07T09:00:00.884019+0000","last_became_active":"2023-10-07T09:00:00.881479+0000","last_became_peered":"2023-10-07T09:00:00.881479+0000","last_unstale":"2023-10-07T09:00:00.884019+0000","last_undegraded":"2023-10-07T09:00:00.884019+0000","last_fullsized":"2023-10-07T09:00:00.884019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:33.628371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874721+0000","last_change":"2023-10-07T09:00:00.873185+0000","last_active":"2023-10-07T09:00:00.874721+0000","last_peered":"2023-10-07T09:00:00.874721+0000","last_clean":"2023-10-07T09:00:00.874721+0000","last_became_active":"2023-10-07T09:00:00.872874+0000","last_became_peered":"2023-10-07T09:00:00.872874+0000","last_unstale":"2023-10-07T09:00:00.874721+0000","last_undegraded":"2023-10-07T09:00:00.874721+0000","last_fullsized":"2023-10-07T09:00:00.874721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:25:15.529282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881215+0000","last_change":"2023-10-07T09:00:00.878452+0000","last_active":"2023-10-07T09:00:00.881215+0000","last_peered":"2023-10-07T09:00:00.881215+0000","last_clean":"2023-10-07T09:00:00.881215+0000","last_became_active":"2023-10-07T09:00:00.878010+0000","last_became_peered":"2023-10-07T09:00:00.878010+0000","last_unstale":"2023-10-07T09:00:00.881215+0000","last_undegraded":"2023-10-07T09:00:00.881215+0000","last_fullsized":"2023-10-07T09:00:00.881215+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887201+0000","last_change":"2023-10-07T09:00:00.886442+0000","last_active":"2023-10-07T09:00:00.887201+0000","last_peered":"2023-10-07T09:00:00.887201+0000","last_clean":"2023-10-07T09:00:00.887201+0000","last_became_active":"2023-10-07T09:00:00.886147+0000","last_became_peered":"2023-10-07T09:00:00.886147+0000","last_unstale":"2023-10-07T09:00:00.887201+0000","last_undegraded":"2023-10-07T09:00:00.887201+0000","last_fullsized":"2023-10-07T09:00:00.887201+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881414+0000","last_change":"2023-10-07T09:00:00.877577+0000","last_active":"2023-10-07T09:00:00.881414+0000","last_peered":"2023-10-07T09:00:00.881414+0000","last_clean":"2023-10-07T09:00:00.881414+0000","last_became_active":"2023-10-07T09:00:00.877291+0000","last_became_peered":"2023-10-07T09:00:00.877291+0000","last_unstale":"2023-10-07T09:00:00.881414+0000","last_undegraded":"2023-10-07T09:00:00.881414+0000","last_fullsized":"2023-10-07T09:00:00.881414+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:00.464523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882856+0000","last_change":"2023-10-07T09:00:00.878311+0000","last_active":"2023-10-07T09:00:00.882856+0000","last_peered":"2023-10-07T09:00:00.882856+0000","last_clean":"2023-10-07T09:00:00.882856+0000","last_became_active":"2023-10-07T09:00:00.877748+0000","last_became_peered":"2023-10-07T09:00:00.877748+0000","last_unstale":"2023-10-07T09:00:00.882856+0000","last_undegraded":"2023-10-07T09:00:00.882856+0000","last_fullsized":"2023-10-07T09:00:00.882856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:50.858102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887242+0000","last_change":"2023-10-07T09:00:00.883708+0000","last_active":"2023-10-07T09:00:00.887242+0000","last_peered":"2023-10-07T09:00:00.887242+0000","last_clean":"2023-10-07T09:00:00.887242+0000","last_became_active":"2023-10-07T09:00:00.883432+0000","last_became_peered":"2023-10-07T09:00:00.883432+0000","last_unstale":"2023-10-07T09:00:00.887242+0000","last_undegraded":"2023-10-07T09:00:00.887242+0000","last_fullsized":"2023-10-07T09:00:00.887242+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.871628+0000","last_change":"2023-10-07T09:00:00.870666+0000","last_active":"2023-10-07T09:00:00.871628+0000","last_peered":"2023-10-07T09:00:00.871628+0000","last_clean":"2023-10-07T09:00:00.871628+0000","last_became_active":"2023-10-07T09:00:00.870437+0000","last_became_peered":"2023-10-07T09:00:00.870437+0000","last_unstale":"2023-10-07T09:00:00.871628+0000","last_undegraded":"2023-10-07T09:00:00.871628+0000","last_fullsized":"2023-10-07T09:00:00.871628+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:09.591539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.886895+0000","last_change":"2023-10-07T09:00:00.884041+0000","last_active":"2023-10-07T09:00:00.886895+0000","last_peered":"2023-10-07T09:00:00.886895+0000","last_clean":"2023-10-07T09:00:00.886895+0000","last_became_active":"2023-10-07T09:00:00.883792+0000","last_became_peered":"2023-10-07T09:00:00.883792+0000","last_unstale":"2023-10-07T09:00:00.886895+0000","last_undegraded":"2023-10-07T09:00:00.886895+0000","last_fullsized":"2023-10-07T09:00:00.886895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.886448+0000","last_change":"2023-10-07T09:00:00.882128+0000","last_active":"2023-10-07T09:00:00.886448+0000","last_peered":"2023-10-07T09:00:00.886448+0000","last_clean":"2023-10-07T09:00:00.886448+0000","last_became_active":"2023-10-07T09:00:00.881858+0000","last_became_peered":"2023-10-07T09:00:00.881858+0000","last_unstale":"2023-10-07T09:00:00.886448+0000","last_undegraded":"2023-10-07T09:00:00.886448+0000","last_fullsized":"2023-10-07T09:00:00.886448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.898006+0000","last_change":"2023-10-07T08:59:59.878882+0000","last_active":"2023-10-07T09:00:00.898006+0000","last_peered":"2023-10-07T09:00:00.898006+0000","last_clean":"2023-10-07T09:00:00.898006+0000","last_became_active":"2023-10-07T08:59:59.878576+0000","last_became_peered":"2023-10-07T08:59:59.878576+0000","last_unstale":"2023-10-07T09:00:00.898006+0000","last_undegraded":"2023-10-07T09:00:00.898006+0000","last_fullsized":"2023-10-07T09:00:00.898006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:37.738910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.885614+0000","last_change":"2023-10-07T09:00:00.884563+0000","last_active":"2023-10-07T09:00:00.885614+0000","last_peered":"2023-10-07T09:00:00.885614+0000","last_clean":"2023-10-07T09:00:00.885614+0000","last_became_active":"2023-10-07T09:00:00.883878+0000","last_became_peered":"2023-10-07T09:00:00.883878+0000","last_unstale":"2023-10-07T09:00:00.885614+0000","last_undegraded":"2023-10-07T09:00:00.885614+0000","last_fullsized":"2023-10-07T09:00:00.885614+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:58.221641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.894767+0000","last_change":"2023-10-07T08:59:59.877825+0000","last_active":"2023-10-07T09:00:00.894767+0000","last_peered":"2023-10-07T09:00:00.894767+0000","last_clean":"2023-10-07T09:00:00.894767+0000","last_became_active":"2023-10-07T08:59:59.877566+0000","last_became_peered":"2023-10-07T08:59:59.877566+0000","last_unstale":"2023-10-07T09:00:00.894767+0000","last_undegraded":"2023-10-07T09:00:00.894767+0000","last_fullsized":"2023-10-07T09:00:00.894767+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:36.032547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.886966+0000","last_change":"2023-10-07T09:00:00.884729+0000","last_active":"2023-10-07T09:00:00.886966+0000","last_peered":"2023-10-07T09:00:00.886966+0000","last_clean":"2023-10-07T09:00:00.886966+0000","last_became_active":"2023-10-07T09:00:00.884437+0000","last_became_peered":"2023-10-07T09:00:00.884437+0000","last_unstale":"2023-10-07T09:00:00.886966+0000","last_undegraded":"2023-10-07T09:00:00.886966+0000","last_fullsized":"2023-10-07T09:00:00.886966+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:28.990257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.895363+0000","last_change":"2023-10-07T08:59:59.871943+0000","last_active":"2023-10-07T09:00:00.895363+0000","last_peered":"2023-10-07T09:00:00.895363+0000","last_clean":"2023-10-07T09:00:00.895363+0000","last_became_active":"2023-10-07T08:59:59.871526+0000","last_became_peered":"2023-10-07T08:59:59.871526+0000","last_unstale":"2023-10-07T09:00:00.895363+0000","last_undegraded":"2023-10-07T09:00:00.895363+0000","last_fullsized":"2023-10-07T09:00:00.895363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:46:43.375628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.880669+0000","last_change":"2023-10-07T09:00:00.878757+0000","last_active":"2023-10-07T09:00:00.880669+0000","last_peered":"2023-10-07T09:00:00.880669+0000","last_clean":"2023-10-07T09:00:00.880669+0000","last_became_active":"2023-10-07T09:00:00.878459+0000","last_became_peered":"2023-10-07T09:00:00.878459+0000","last_unstale":"2023-10-07T09:00:00.880669+0000","last_undegraded":"2023-10-07T09:00:00.880669+0000","last_fullsized":"2023-10-07T09:00:00.880669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:01.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.893554+0000","last_change":"2023-10-07T08:59:59.879585+0000","last_active":"2023-10-07T09:00:00.893554+0000","last_peered":"2023-10-07T09:00:00.893554+0000","last_clean":"2023-10-07T09:00:00.893554+0000","last_became_active":"2023-10-07T08:59:59.879308+0000","last_became_peered":"2023-10-07T08:59:59.879308+0000","last_unstale":"2023-10-07T09:00:00.893554+0000","last_undegraded":"2023-10-07T09:00:00.893554+0000","last_fullsized":"2023-10-07T09:00:00.893554+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882295+0000","last_change":"2023-10-07T09:00:00.876182+0000","last_active":"2023-10-07T09:00:00.882295+0000","last_peered":"2023-10-07T09:00:00.882295+0000","last_clean":"2023-10-07T09:00:00.882295+0000","last_became_active":"2023-10-07T09:00:00.875935+0000","last_became_peered":"2023-10-07T09:00:00.875935+0000","last_unstale":"2023-10-07T09:00:00.882295+0000","last_undegraded":"2023-10-07T09:00:00.882295+0000","last_fullsized":"2023-10-07T09:00:00.882295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:21.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.893576+0000","last_change":"2023-10-07T08:59:59.878940+0000","last_active":"2023-10-07T09:00:00.893576+0000","last_peered":"2023-10-07T09:00:00.893576+0000","last_clean":"2023-10-07T09:00:00.893576+0000","last_became_active":"2023-10-07T08:59:59.878645+0000","last_became_peered":"2023-10-07T08:59:59.878645+0000","last_unstale":"2023-10-07T09:00:00.893576+0000","last_undegraded":"2023-10-07T09:00:00.893576+0000","last_fullsized":"2023-10-07T09:00:00.893576+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:35.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882874+0000","last_change":"2023-10-07T09:00:00.878509+0000","last_active":"2023-10-07T09:00:00.882874+0000","last_peered":"2023-10-07T09:00:00.882874+0000","last_clean":"2023-10-07T09:00:00.882874+0000","last_became_active":"2023-10-07T09:00:00.878039+0000","last_became_peered":"2023-10-07T09:00:00.878039+0000","last_unstale":"2023-10-07T09:00:00.882874+0000","last_undegraded":"2023-10-07T09:00:00.882874+0000","last_fullsized":"2023-10-07T09:00:00.882874+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:21.720280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.894498+0000","last_change":"2023-10-07T08:59:59.881718+0000","last_active":"2023-10-07T09:00:00.894498+0000","last_peered":"2023-10-07T09:00:00.894498+0000","last_clean":"2023-10-07T09:00:00.894498+0000","last_became_active":"2023-10-07T08:59:59.881423+0000","last_became_peered":"2023-10-07T08:59:59.881423+0000","last_unstale":"2023-10-07T09:00:00.894498+0000","last_undegraded":"2023-10-07T09:00:00.894498+0000","last_fullsized":"2023-10-07T09:00:00.894498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.884002+0000","last_change":"2023-10-07T09:00:00.881579+0000","last_active":"2023-10-07T09:00:00.884002+0000","last_peered":"2023-10-07T09:00:00.884002+0000","last_clean":"2023-10-07T09:00:00.884002+0000","last_became_active":"2023-10-07T09:00:00.881316+0000","last_became_peered":"2023-10-07T09:00:00.881316+0000","last_unstale":"2023-10-07T09:00:00.884002+0000","last_undegraded":"2023-10-07T09:00:00.884002+0000","last_fullsized":"2023-10-07T09:00:00.884002+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:38:07.420548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.872740+0000","last_change":"2023-10-07T08:59:59.877239+0000","last_active":"2023-10-07T09:00:00.872740+0000","last_peered":"2023-10-07T09:00:00.872740+0000","last_clean":"2023-10-07T09:00:00.872740+0000","last_became_active":"2023-10-07T08:59:59.876953+0000","last_became_peered":"2023-10-07T08:59:59.876953+0000","last_unstale":"2023-10-07T09:00:00.872740+0000","last_undegraded":"2023-10-07T09:00:00.872740+0000","last_fullsized":"2023-10-07T09:00:00.872740+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882679+0000","last_change":"2023-10-07T09:00:00.879470+0000","last_active":"2023-10-07T09:00:00.882679+0000","last_peered":"2023-10-07T09:00:00.882679+0000","last_clean":"2023-10-07T09:00:00.882679+0000","last_became_active":"2023-10-07T09:00:00.878300+0000","last_became_peered":"2023-10-07T09:00:00.878300+0000","last_unstale":"2023-10-07T09:00:00.882679+0000","last_undegraded":"2023-10-07T09:00:00.882679+0000","last_fullsized":"2023-10-07T09:00:00.882679+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:29.483543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.867773+0000","last_change":"2023-10-07T08:59:59.877871+0000","last_active":"2023-10-07T09:00:00.867773+0000","last_peered":"2023-10-07T09:00:00.867773+0000","last_clean":"2023-10-07T09:00:00.867773+0000","last_became_active":"2023-10-07T08:59:59.877531+0000","last_became_peered":"2023-10-07T08:59:59.877531+0000","last_unstale":"2023-10-07T09:00:00.867773+0000","last_undegraded":"2023-10-07T09:00:00.867773+0000","last_fullsized":"2023-10-07T09:00:00.867773+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:32.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876490+0000","last_change":"2023-10-07T09:00:00.874063+0000","last_active":"2023-10-07T09:00:00.876490+0000","last_peered":"2023-10-07T09:00:00.876490+0000","last_clean":"2023-10-07T09:00:00.876490+0000","last_became_active":"2023-10-07T09:00:00.873760+0000","last_became_peered":"2023-10-07T09:00:00.873760+0000","last_unstale":"2023-10-07T09:00:00.876490+0000","last_undegraded":"2023-10-07T09:00:00.876490+0000","last_fullsized":"2023-10-07T09:00:00.876490+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:54.420952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878582+0000","last_change":"2023-10-07T08:59:59.882862+0000","last_active":"2023-10-07T09:00:00.878582+0000","last_peered":"2023-10-07T09:00:00.878582+0000","last_clean":"2023-10-07T09:00:00.878582+0000","last_became_active":"2023-10-07T08:59:59.882624+0000","last_became_peered":"2023-10-07T08:59:59.882624+0000","last_unstale":"2023-10-07T09:00:00.878582+0000","last_undegraded":"2023-10-07T09:00:00.878582+0000","last_fullsized":"2023-10-07T09:00:00.878582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:37.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.892192+0000","last_change":"2023-10-07T09:00:00.890112+0000","last_active":"2023-10-07T09:00:00.892192+0000","last_peered":"2023-10-07T09:00:00.892192+0000","last_clean":"2023-10-07T09:00:00.892192+0000","last_became_active":"2023-10-07T09:00:00.889903+0000","last_became_peered":"2023-10-07T09:00:00.889903+0000","last_unstale":"2023-10-07T09:00:00.892192+0000","last_undegraded":"2023-10-07T09:00:00.892192+0000","last_fullsized":"2023-10-07T09:00:00.892192+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:36.005345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.868192+0000","last_change":"2023-10-07T08:59:59.878792+0000","last_active":"2023-10-07T09:00:00.868192+0000","last_peered":"2023-10-07T09:00:00.868192+0000","last_clean":"2023-10-07T09:00:00.868192+0000","last_became_active":"2023-10-07T08:59:59.878532+0000","last_became_peered":"2023-10-07T08:59:59.878532+0000","last_unstale":"2023-10-07T09:00:00.868192+0000","last_undegraded":"2023-10-07T09:00:00.868192+0000","last_fullsized":"2023-10-07T09:00:00.868192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:06.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.871632+0000","last_change":"2023-10-07T09:00:00.869524+0000","last_active":"2023-10-07T09:00:00.871632+0000","last_peered":"2023-10-07T09:00:00.871632+0000","last_clean":"2023-10-07T09:00:00.871632+0000","last_became_active":"2023-10-07T09:00:00.868923+0000","last_became_peered":"2023-10-07T09:00:00.868923+0000","last_unstale":"2023-10-07T09:00:00.871632+0000","last_undegraded":"2023-10-07T09:00:00.871632+0000","last_fullsized":"2023-10-07T09:00:00.871632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.895474+0000","last_change":"2023-10-07T08:59:59.881364+0000","last_active":"2023-10-07T09:00:00.895474+0000","last_peered":"2023-10-07T09:00:00.895474+0000","last_clean":"2023-10-07T09:00:00.895474+0000","last_became_active":"2023-10-07T08:59:59.881095+0000","last_became_peered":"2023-10-07T08:59:59.881095+0000","last_unstale":"2023-10-07T09:00:00.895474+0000","last_undegraded":"2023-10-07T09:00:00.895474+0000","last_fullsized":"2023-10-07T09:00:00.895474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:57.216446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.891279+0000","last_change":"2023-10-07T09:00:00.885420+0000","last_active":"2023-10-07T09:00:00.891279+0000","last_peered":"2023-10-07T09:00:00.891279+0000","last_clean":"2023-10-07T09:00:00.891279+0000","last_became_active":"2023-10-07T09:00:00.884018+0000","last_became_peered":"2023-10-07T09:00:00.884018+0000","last_unstale":"2023-10-07T09:00:00.891279+0000","last_undegraded":"2023-10-07T09:00:00.891279+0000","last_fullsized":"2023-10-07T09:00:00.891279+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:38.123891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.899498+0000","last_change":"2023-10-07T08:59:59.873067+0000","last_active":"2023-10-07T09:00:00.899498+0000","last_peered":"2023-10-07T09:00:00.899498+0000","last_clean":"2023-10-07T09:00:00.899498+0000","last_became_active":"2023-10-07T08:59:59.872789+0000","last_became_peered":"2023-10-07T08:59:59.872789+0000","last_unstale":"2023-10-07T09:00:00.899498+0000","last_undegraded":"2023-10-07T09:00:00.899498+0000","last_fullsized":"2023-10-07T09:00:00.899498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876688+0000","last_change":"2023-10-07T09:00:00.875612+0000","last_active":"2023-10-07T09:00:00.876688+0000","last_peered":"2023-10-07T09:00:00.876688+0000","last_clean":"2023-10-07T09:00:00.876688+0000","last_became_active":"2023-10-07T09:00:00.875361+0000","last_became_peered":"2023-10-07T09:00:00.875361+0000","last_unstale":"2023-10-07T09:00:00.876688+0000","last_undegraded":"2023-10-07T09:00:00.876688+0000","last_fullsized":"2023-10-07T09:00:00.876688+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.890985+0000","last_change":"2023-10-07T08:59:59.880786+0000","last_active":"2023-10-07T09:00:00.890985+0000","last_peered":"2023-10-07T09:00:00.890985+0000","last_clean":"2023-10-07T09:00:00.890985+0000","last_became_active":"2023-10-07T08:59:59.880534+0000","last_became_peered":"2023-10-07T08:59:59.880534+0000","last_unstale":"2023-10-07T09:00:00.890985+0000","last_undegraded":"2023-10-07T09:00:00.890985+0000","last_fullsized":"2023-10-07T09:00:00.890985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:33.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887108+0000","last_change":"2023-10-07T09:00:00.885306+0000","last_active":"2023-10-07T09:00:00.887108+0000","last_peered":"2023-10-07T09:00:00.887108+0000","last_clean":"2023-10-07T09:00:00.887108+0000","last_became_active":"2023-10-07T09:00:00.884367+0000","last_became_peered":"2023-10-07T09:00:00.884367+0000","last_unstale":"2023-10-07T09:00:00.887108+0000","last_undegraded":"2023-10-07T09:00:00.887108+0000","last_fullsized":"2023-10-07T09:00:00.887108+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:09.247675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.872514+0000","last_change":"2023-10-07T08:59:59.871360+0000","last_active":"2023-10-07T09:00:00.872514+0000","last_peered":"2023-10-07T09:00:00.872514+0000","last_clean":"2023-10-07T09:00:00.872514+0000","last_became_active":"2023-10-07T08:59:59.871077+0000","last_became_peered":"2023-10-07T08:59:59.871077+0000","last_unstale":"2023-10-07T09:00:00.872514+0000","last_undegraded":"2023-10-07T09:00:00.872514+0000","last_fullsized":"2023-10-07T09:00:00.872514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:25.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883942+0000","last_change":"2023-10-07T09:00:00.880443+0000","last_active":"2023-10-07T09:00:00.883942+0000","last_peered":"2023-10-07T09:00:00.883942+0000","last_clean":"2023-10-07T09:00:00.883942+0000","last_became_active":"2023-10-07T09:00:00.880166+0000","last_became_peered":"2023-10-07T09:00:00.880166+0000","last_unstale":"2023-10-07T09:00:00.883942+0000","last_undegraded":"2023-10-07T09:00:00.883942+0000","last_fullsized":"2023-10-07T09:00:00.883942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:54.732014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.872819+0000","last_change":"2023-10-07T08:59:59.879657+0000","last_active":"2023-10-07T09:00:00.872819+0000","last_peered":"2023-10-07T09:00:00.872819+0000","last_clean":"2023-10-07T09:00:00.872819+0000","last_became_active":"2023-10-07T08:59:59.879372+0000","last_became_peered":"2023-10-07T08:59:59.879372+0000","last_unstale":"2023-10-07T09:00:00.872819+0000","last_undegraded":"2023-10-07T09:00:00.872819+0000","last_fullsized":"2023-10-07T09:00:00.872819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:53.415757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887005+0000","last_change":"2023-10-07T09:00:00.884381+0000","last_active":"2023-10-07T09:00:00.887005+0000","last_peered":"2023-10-07T09:00:00.887005+0000","last_clean":"2023-10-07T09:00:00.887005+0000","last_became_active":"2023-10-07T09:00:00.883480+0000","last_became_peered":"2023-10-07T09:00:00.883480+0000","last_unstale":"2023-10-07T09:00:00.887005+0000","last_undegraded":"2023-10-07T09:00:00.887005+0000","last_fullsized":"2023-10-07T09:00:00.887005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:46.053391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.896033+0000","last_change":"2023-10-07T08:59:59.882300+0000","last_active":"2023-10-07T09:00:00.896033+0000","last_peered":"2023-10-07T09:00:00.896033+0000","last_clean":"2023-10-07T09:00:00.896033+0000","last_became_active":"2023-10-07T08:59:59.882025+0000","last_became_peered":"2023-10-07T08:59:59.882025+0000","last_unstale":"2023-10-07T09:00:00.896033+0000","last_undegraded":"2023-10-07T09:00:00.896033+0000","last_fullsized":"2023-10-07T09:00:00.896033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887116+0000","last_change":"2023-10-07T09:00:00.884743+0000","last_active":"2023-10-07T09:00:00.887116+0000","last_peered":"2023-10-07T09:00:00.887116+0000","last_clean":"2023-10-07T09:00:00.887116+0000","last_became_active":"2023-10-07T09:00:00.884346+0000","last_became_peered":"2023-10-07T09:00:00.884346+0000","last_unstale":"2023-10-07T09:00:00.887116+0000","last_undegraded":"2023-10-07T09:00:00.887116+0000","last_fullsized":"2023-10-07T09:00:00.887116+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:51.785920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.891028+0000","last_change":"2023-10-07T08:59:59.880542+0000","last_active":"2023-10-07T09:00:00.891028+0000","last_peered":"2023-10-07T09:00:00.891028+0000","last_clean":"2023-10-07T09:00:00.891028+0000","last_became_active":"2023-10-07T08:59:59.880259+0000","last_became_peered":"2023-10-07T08:59:59.880259+0000","last_unstale":"2023-10-07T09:00:00.891028+0000","last_undegraded":"2023-10-07T09:00:00.891028+0000","last_fullsized":"2023-10-07T09:00:00.891028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:38:27.985062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878384+0000","last_change":"2023-10-07T09:00:00.876416+0000","last_active":"2023-10-07T09:00:00.878384+0000","last_peered":"2023-10-07T09:00:00.878384+0000","last_clean":"2023-10-07T09:00:00.878384+0000","last_became_active":"2023-10-07T09:00:00.876172+0000","last_became_peered":"2023-10-07T09:00:00.876172+0000","last_unstale":"2023-10-07T09:00:00.878384+0000","last_undegraded":"2023-10-07T09:00:00.878384+0000","last_fullsized":"2023-10-07T09:00:00.878384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:27.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.894564+0000","last_change":"2023-10-07T08:59:59.879711+0000","last_active":"2023-10-07T09:00:00.894564+0000","last_peered":"2023-10-07T09:00:00.894564+0000","last_clean":"2023-10-07T09:00:00.894564+0000","last_became_active":"2023-10-07T08:59:59.879410+0000","last_became_peered":"2023-10-07T08:59:59.879410+0000","last_unstale":"2023-10-07T09:00:00.894564+0000","last_undegraded":"2023-10-07T09:00:00.894564+0000","last_fullsized":"2023-10-07T09:00:00.894564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:53.114711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.879992+0000","last_change":"2023-10-07T09:00:00.874020+0000","last_active":"2023-10-07T09:00:00.879992+0000","last_peered":"2023-10-07T09:00:00.879992+0000","last_clean":"2023-10-07T09:00:00.879992+0000","last_became_active":"2023-10-07T09:00:00.873739+0000","last_became_peered":"2023-10-07T09:00:00.873739+0000","last_unstale":"2023-10-07T09:00:00.879992+0000","last_undegraded":"2023-10-07T09:00:00.879992+0000","last_fullsized":"2023-10-07T09:00:00.879992+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:12.366488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.894659+0000","last_change":"2023-10-07T08:59:59.879611+0000","last_active":"2023-10-07T09:00:00.894659+0000","last_peered":"2023-10-07T09:00:00.894659+0000","last_clean":"2023-10-07T09:00:00.894659+0000","last_became_active":"2023-10-07T08:59:59.879301+0000","last_became_peered":"2023-10-07T08:59:59.879301+0000","last_unstale":"2023-10-07T09:00:00.894659+0000","last_undegraded":"2023-10-07T09:00:00.894659+0000","last_fullsized":"2023-10-07T09:00:00.894659+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:34.395138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.891317+0000","last_change":"2023-10-07T09:00:00.885926+0000","last_active":"2023-10-07T09:00:00.891317+0000","last_peered":"2023-10-07T09:00:00.891317+0000","last_clean":"2023-10-07T09:00:00.891317+0000","last_became_active":"2023-10-07T09:00:00.885701+0000","last_became_peered":"2023-10-07T09:00:00.885701+0000","last_unstale":"2023-10-07T09:00:00.891317+0000","last_undegraded":"2023-10-07T09:00:00.891317+0000","last_fullsized":"2023-10-07T09:00:00.891317+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.874268+0000","last_change":"2023-10-07T08:59:59.882939+0000","last_active":"2023-10-07T09:00:00.874268+0000","last_peered":"2023-10-07T09:00:00.874268+0000","last_clean":"2023-10-07T09:00:00.874268+0000","last_became_active":"2023-10-07T08:59:59.882525+0000","last_became_peered":"2023-10-07T08:59:59.882525+0000","last_unstale":"2023-10-07T09:00:00.874268+0000","last_undegraded":"2023-10-07T09:00:00.874268+0000","last_fullsized":"2023-10-07T09:00:00.874268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:27.723456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.876668+0000","last_change":"2023-10-07T09:00:00.875480+0000","last_active":"2023-10-07T09:00:00.876668+0000","last_peered":"2023-10-07T09:00:00.876668+0000","last_clean":"2023-10-07T09:00:00.876668+0000","last_became_active":"2023-10-07T09:00:00.875019+0000","last_became_peered":"2023-10-07T09:00:00.875019+0000","last_unstale":"2023-10-07T09:00:00.876668+0000","last_undegraded":"2023-10-07T09:00:00.876668+0000","last_fullsized":"2023-10-07T09:00:00.876668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:07.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.894998+0000","last_change":"2023-10-07T08:59:59.876486+0000","last_active":"2023-10-07T09:00:00.894998+0000","last_peered":"2023-10-07T09:00:00.894998+0000","last_clean":"2023-10-07T09:00:00.894998+0000","last_became_active":"2023-10-07T08:59:59.876139+0000","last_became_peered":"2023-10-07T08:59:59.876139+0000","last_unstale":"2023-10-07T09:00:00.894998+0000","last_undegraded":"2023-10-07T09:00:00.894998+0000","last_fullsized":"2023-10-07T09:00:00.894998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:06.252338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.886990+0000","last_change":"2023-10-07T09:00:00.885111+0000","last_active":"2023-10-07T09:00:00.886990+0000","last_peered":"2023-10-07T09:00:00.886990+0000","last_clean":"2023-10-07T09:00:00.886990+0000","last_became_active":"2023-10-07T09:00:00.884461+0000","last_became_peered":"2023-10-07T09:00:00.884461+0000","last_unstale":"2023-10-07T09:00:00.886990+0000","last_undegraded":"2023-10-07T09:00:00.886990+0000","last_fullsized":"2023-10-07T09:00:00.886990+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:34.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.863601+0000","last_change":"2023-10-07T08:59:59.877521+0000","last_active":"2023-10-07T09:00:00.863601+0000","last_peered":"2023-10-07T09:00:00.863601+0000","last_clean":"2023-10-07T09:00:00.863601+0000","last_became_active":"2023-10-07T08:59:59.877269+0000","last_became_peered":"2023-10-07T08:59:59.877269+0000","last_unstale":"2023-10-07T09:00:00.863601+0000","last_undegraded":"2023-10-07T09:00:00.863601+0000","last_fullsized":"2023-10-07T09:00:00.863601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:28.720828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882395+0000","last_change":"2023-10-07T09:00:00.881506+0000","last_active":"2023-10-07T09:00:00.882395+0000","last_peered":"2023-10-07T09:00:00.882395+0000","last_clean":"2023-10-07T09:00:00.882395+0000","last_became_active":"2023-10-07T09:00:00.881237+0000","last_became_peered":"2023-10-07T09:00:00.881237+0000","last_unstale":"2023-10-07T09:00:00.882395+0000","last_undegraded":"2023-10-07T09:00:00.882395+0000","last_fullsized":"2023-10-07T09:00:00.882395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:01.619445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.871955+0000","last_change":"2023-10-07T08:59:59.878211+0000","last_active":"2023-10-07T09:00:00.871955+0000","last_peered":"2023-10-07T09:00:00.871955+0000","last_clean":"2023-10-07T09:00:00.871955+0000","last_became_active":"2023-10-07T08:59:59.877912+0000","last_became_peered":"2023-10-07T08:59:59.877912+0000","last_unstale":"2023-10-07T09:00:00.871955+0000","last_undegraded":"2023-10-07T09:00:00.871955+0000","last_fullsized":"2023-10-07T09:00:00.871955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:02.674160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.878226+0000","last_change":"2023-10-07T09:00:00.876149+0000","last_active":"2023-10-07T09:00:00.878226+0000","last_peered":"2023-10-07T09:00:00.878226+0000","last_clean":"2023-10-07T09:00:00.878226+0000","last_became_active":"2023-10-07T09:00:00.875881+0000","last_became_peered":"2023-10-07T09:00:00.875881+0000","last_unstale":"2023-10-07T09:00:00.878226+0000","last_undegraded":"2023-10-07T09:00:00.878226+0000","last_fullsized":"2023-10-07T09:00:00.878226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:37.037742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.896743+0000","last_change":"2023-10-07T08:59:59.877982+0000","last_active":"2023-10-07T09:00:00.896743+0000","last_peered":"2023-10-07T09:00:00.896743+0000","last_clean":"2023-10-07T09:00:00.896743+0000","last_became_active":"2023-10-07T08:59:59.877677+0000","last_became_peered":"2023-10-07T08:59:59.877677+0000","last_unstale":"2023-10-07T09:00:00.896743+0000","last_undegraded":"2023-10-07T09:00:00.896743+0000","last_fullsized":"2023-10-07T09:00:00.896743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:04.391970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883113+0000","last_change":"2023-10-07T09:00:00.881072+0000","last_active":"2023-10-07T09:00:00.883113+0000","last_peered":"2023-10-07T09:00:00.883113+0000","last_clean":"2023-10-07T09:00:00.883113+0000","last_became_active":"2023-10-07T09:00:00.880808+0000","last_became_peered":"2023-10-07T09:00:00.880808+0000","last_unstale":"2023-10-07T09:00:00.883113+0000","last_undegraded":"2023-10-07T09:00:00.883113+0000","last_fullsized":"2023-10-07T09:00:00.883113+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:55.530597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-07T09:00:02.103518+0000","last_change":"2023-10-07T08:59:59.873692+0000","last_active":"2023-10-07T09:00:02.103518+0000","last_peered":"2023-10-07T09:00:02.103518+0000","last_clean":"2023-10-07T09:00:02.103518+0000","last_became_active":"2023-10-07T08:59:59.873416+0000","last_became_peered":"2023-10-07T08:59:59.873416+0000","last_unstale":"2023-10-07T09:00:02.103518+0000","last_undegraded":"2023-10-07T09:00:02.103518+0000","last_fullsized":"2023-10-07T09:00:02.103518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:05.503904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.871663+0000","last_change":"2023-10-07T09:00:00.869702+0000","last_active":"2023-10-07T09:00:00.871663+0000","last_peered":"2023-10-07T09:00:00.871663+0000","last_clean":"2023-10-07T09:00:00.871663+0000","last_became_active":"2023-10-07T09:00:00.869276+0000","last_became_peered":"2023-10-07T09:00:00.869276+0000","last_unstale":"2023-10-07T09:00:00.871663+0000","last_undegraded":"2023-10-07T09:00:00.871663+0000","last_fullsized":"2023-10-07T09:00:00.871663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:06.509100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.872398+0000","last_change":"2023-10-07T08:59:59.870863+0000","last_active":"2023-10-07T09:00:00.872398+0000","last_peered":"2023-10-07T09:00:00.872398+0000","last_clean":"2023-10-07T09:00:00.872398+0000","last_became_active":"2023-10-07T08:59:59.870553+0000","last_became_peered":"2023-10-07T08:59:59.870553+0000","last_unstale":"2023-10-07T09:00:00.872398+0000","last_undegraded":"2023-10-07T09:00:00.872398+0000","last_fullsized":"2023-10-07T09:00:00.872398+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:25.612939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.881786+0000","last_change":"2023-10-07T09:00:00.878704+0000","last_active":"2023-10-07T09:00:00.881786+0000","last_peered":"2023-10-07T09:00:00.881786+0000","last_clean":"2023-10-07T09:00:00.881786+0000","last_became_active":"2023-10-07T09:00:00.878406+0000","last_became_peered":"2023-10-07T09:00:00.878406+0000","last_unstale":"2023-10-07T09:00:00.881786+0000","last_undegraded":"2023-10-07T09:00:00.881786+0000","last_fullsized":"2023-10-07T09:00:00.881786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:44.521081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.873332+0000","last_change":"2023-10-07T08:59:59.877544+0000","last_active":"2023-10-07T09:00:00.873332+0000","last_peered":"2023-10-07T09:00:00.873332+0000","last_clean":"2023-10-07T09:00:00.873332+0000","last_became_active":"2023-10-07T08:59:59.876631+0000","last_became_peered":"2023-10-07T08:59:59.876631+0000","last_unstale":"2023-10-07T09:00:00.873332+0000","last_undegraded":"2023-10-07T09:00:00.873332+0000","last_fullsized":"2023-10-07T09:00:00.873332+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:01.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882317+0000","last_change":"2023-10-07T09:00:00.876334+0000","last_active":"2023-10-07T09:00:00.882317+0000","last_peered":"2023-10-07T09:00:00.882317+0000","last_clean":"2023-10-07T09:00:00.882317+0000","last_became_active":"2023-10-07T09:00:00.876055+0000","last_became_peered":"2023-10-07T09:00:00.876055+0000","last_unstale":"2023-10-07T09:00:00.882317+0000","last_undegraded":"2023-10-07T09:00:00.882317+0000","last_fullsized":"2023-10-07T09:00:00.882317+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:05.377189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.863219+0000","last_change":"2023-10-07T08:59:59.878174+0000","last_active":"2023-10-07T09:00:00.863219+0000","last_peered":"2023-10-07T09:00:00.863219+0000","last_clean":"2023-10-07T09:00:00.863219+0000","last_became_active":"2023-10-07T08:59:59.877621+0000","last_became_peered":"2023-10-07T08:59:59.877621+0000","last_unstale":"2023-10-07T09:00:00.863219+0000","last_undegraded":"2023-10-07T09:00:00.863219+0000","last_fullsized":"2023-10-07T09:00:00.863219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:37.844461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.887084+0000","last_change":"2023-10-07T09:00:00.884954+0000","last_active":"2023-10-07T09:00:00.887084+0000","last_peered":"2023-10-07T09:00:00.887084+0000","last_clean":"2023-10-07T09:00:00.887084+0000","last_became_active":"2023-10-07T09:00:00.884033+0000","last_became_peered":"2023-10-07T09:00:00.884033+0000","last_unstale":"2023-10-07T09:00:00.887084+0000","last_undegraded":"2023-10-07T09:00:00.887084+0000","last_fullsized":"2023-10-07T09:00:00.887084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:43:44.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.867136+0000","last_change":"2023-10-07T08:59:59.872199+0000","last_active":"2023-10-07T09:00:00.867136+0000","last_peered":"2023-10-07T09:00:00.867136+0000","last_clean":"2023-10-07T09:00:00.867136+0000","last_became_active":"2023-10-07T08:59:59.871880+0000","last_became_peered":"2023-10-07T08:59:59.871880+0000","last_unstale":"2023-10-07T09:00:00.867136+0000","last_undegraded":"2023-10-07T09:00:00.867136+0000","last_fullsized":"2023-10-07T09:00:00.867136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883566+0000","last_change":"2023-10-07T09:00:00.880986+0000","last_active":"2023-10-07T09:00:00.883566+0000","last_peered":"2023-10-07T09:00:00.883566+0000","last_clean":"2023-10-07T09:00:00.883566+0000","last_became_active":"2023-10-07T09:00:00.880735+0000","last_became_peered":"2023-10-07T09:00:00.880735+0000","last_unstale":"2023-10-07T09:00:00.883566+0000","last_undegraded":"2023-10-07T09:00:00.883566+0000","last_fullsized":"2023-10-07T09:00:00.883566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:03.679355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.863247+0000","last_change":"2023-10-07T08:59:59.873447+0000","last_active":"2023-10-07T09:00:00.863247+0000","last_peered":"2023-10-07T09:00:00.863247+0000","last_clean":"2023-10-07T09:00:00.863247+0000","last_became_active":"2023-10-07T08:59:59.873072+0000","last_became_peered":"2023-10-07T08:59:59.873072+0000","last_unstale":"2023-10-07T09:00:00.863247+0000","last_undegraded":"2023-10-07T09:00:00.863247+0000","last_fullsized":"2023-10-07T09:00:00.863247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:52.628819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.882656+0000","last_change":"2023-10-07T09:00:00.878785+0000","last_active":"2023-10-07T09:00:00.882656+0000","last_peered":"2023-10-07T09:00:00.882656+0000","last_clean":"2023-10-07T09:00:00.882656+0000","last_became_active":"2023-10-07T09:00:00.878430+0000","last_became_peered":"2023-10-07T09:00:00.878430+0000","last_unstale":"2023-10-07T09:00:00.882656+0000","last_undegraded":"2023-10-07T09:00:00.882656+0000","last_fullsized":"2023-10-07T09:00:00.882656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:01:44.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.868516+0000","last_change":"2023-10-07T08:59:59.876825+0000","last_active":"2023-10-07T09:00:00.868516+0000","last_peered":"2023-10-07T09:00:00.868516+0000","last_clean":"2023-10-07T09:00:00.868516+0000","last_became_active":"2023-10-07T08:59:59.876559+0000","last_became_peered":"2023-10-07T08:59:59.876559+0000","last_unstale":"2023-10-07T09:00:00.868516+0000","last_undegraded":"2023-10-07T09:00:00.868516+0000","last_fullsized":"2023-10-07T09:00:00.868516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:21.766641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.883189+0000","last_change":"2023-10-07T09:00:00.877647+0000","last_active":"2023-10-07T09:00:00.883189+0000","last_peered":"2023-10-07T09:00:00.883189+0000","last_clean":"2023-10-07T09:00:00.883189+0000","last_became_active":"2023-10-07T09:00:00.877358+0000","last_became_peered":"2023-10-07T09:00:00.877358+0000","last_unstale":"2023-10-07T09:00:00.883189+0000","last_undegraded":"2023-10-07T09:00:00.883189+0000","last_fullsized":"2023-10-07T09:00:00.883189+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:59.852436+0000","last_clean_scrub_stamp":"2023-10-07T08:59:59.852436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:14.133478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.872694+0000","last_change":"2023-10-07T08:59:59.877003+0000","last_active":"2023-10-07T09:00:00.872694+0000","last_peered":"2023-10-07T09:00:00.872694+0000","last_clean":"2023-10-07T09:00:00.872694+0000","last_became_active":"2023-10-07T08:59:59.876690+0000","last_became_peered":"2023-10-07T08:59:59.876690+0000","last_unstale":"2023-10-07T09:00:00.872694+0000","last_undegraded":"2023-10-07T09:00:00.872694+0000","last_fullsized":"2023-10-07T09:00:00.872694+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:59:58.847241+0000","last_clean_scrub_stamp":"2023-10-07T08:59:58.847241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:56.938318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-07T09:00:00.875595+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:00.875595+0000","last_peered":"2023-10-07T09:00:00.875595+0000","last_clean":"2023-10-07T09:00:00.875595+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:00.875595+0000","last_undegraded":"2023-10-07T09:00:00.875595+0000","last_fullsized":"2023-10-07T09:00:00.875595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298484,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073356,"statfs":{"total":96636764160,"available":96331116544,"internally_reserved":0,"allocated":1224704,"data_stored":852531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.502},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.621}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297896,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":622592,"data_stored":262003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.42899999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53900000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.62},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297900,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":626688,"data_stored":262093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.248}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":854461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.245},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.377}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.629},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":262059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.215},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.255}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.307},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.755}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":630784,"data_stored":262059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.377},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.747}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.73599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297908,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073932,"statfs":{"total":96636764160,"available":96331706368,"internally_reserved":0,"allocated":634880,"data_stored":263539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.751}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.76400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":262627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.746}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79100000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.621},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:00:10.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:00:10.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.327+0000 7f5f81142700 1 Processor -- start 2023-10-07T09:00:10.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.327+0000 7f5f81142700 1 -- start start 2023-10-07T09:00:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f81142700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f7c069c70 0x7f5f7c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f81142700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0ce380 con 0x7f5f7c159950 2023-10-07T09:00:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f81142700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0cec20 con 0x7f5f7c0af320 2023-10-07T09:00:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f81142700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0afa90 con 0x7f5f7c069c70 2023-10-07T09:00:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f7ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5f7c159950 0x7f5f7c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52758/0 (socket says 172.21.15.46:52758) 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f7ad9d700 1 -- 172.21.15.46:0/1578693131 learned_addr learned my addr 172.21.15.46:0/1578693131 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272906583 0 0) 0x7f5f7c0ce380 con 0x7f5f7c159950 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f7a59c700 1 --2- 172.21.15.46:0/1578693131 >> v2:172.21.15.133:3300/0 conn(0x7f5f7c069c70 0x7f5f7c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.328+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f68003570 con 0x7f5f7c159950 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1081737926 0 0) 0x7f5f68003570 con 0x7f5f7c159950 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 >> v2:172.21.15.133:3300/0 conn(0x7f5f7c069c70 msgr2=0x7f5f7c0cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 --2- 172.21.15.46:0/1578693131 >> v2:172.21.15.133:3300/0 conn(0x7f5f7c069c70 0x7f5f7c0cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 >> v1:172.21.15.133:6789/0 conn(0x7f5f7c0af320 legacy=0x7f5f7c0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0ce5d0 con 0x7f5f7c159950 2023-10-07T09:00:10.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5f6c0017f0 con 0x7f5f7c159950 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 >> v1:172.21.15.46:6789/0 conn(0x7f5f7c159950 legacy=0x7f5f7c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 0x7f5f68003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68004810 0x7f5f68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f68005210 0x7f5f6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0afa90 con 0x7f5f68003ab0 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6800c1b0 con 0x7f5f68004810 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6800c370 con 0x7f5f68005210 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 0x7f5f68003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7a59c700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68004810 0x7f5f68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7b59e700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f68005210 0x7f5f6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 -- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f68005210 msgr2=0x7f5f6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f68005210 0x7f5f6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 -- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68004810 msgr2=0x7f5f68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68004810 0x7f5f68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 -- 172.21.15.46:0/1578693131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68003570 con 0x7f5f68003ab0 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7b59e700 1 -- 172.21.15.46:0/1578693131 reap_dead start 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 0x7f5f68003ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00a830 tx=0x7f5f7c0ceb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c0bb3a11873605 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0070f0 con 0x7f5f68003ab0 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c007250 con 0x7f5f68003ab0 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.329+0000 7f5f79d9b700 1 -- 172.21.15.46:0/1578693131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c007610 con 0x7f5f68003ab0 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 -- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 msgr2=0x7f5f68003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 0x7f5f68003ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00a830 tx=0x7f5f7c0ceb90 comp rx=0 tx=0).stop 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 -- 172.21.15.46:0/1578693131 shutdown_connections 2023-10-07T09:00:10.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 --2- 172.21.15.46:0/1578693131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f68003ab0 0x7f5f68003ec0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 -- 172.21.15.46:0/1578693131 >> 172.21.15.46:0/1578693131 conn(0x7f5f7c068e00 msgr2=0x7f5f7c0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:10.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 -- 172.21.15.46:0/1578693131 shutdown_connections 2023-10-07T09:00:10.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.330+0000 7f5f81142700 1 -- 172.21.15.46:0/1578693131 wait complete. 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.331+0000 7f5f81142700 1 Processor -- start 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.331+0000 7f5f81142700 1 -- start start 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68003ab0 0x7f5f7c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f7c0c91c0 0x7f5f7c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c5f00 con 0x7f5f7c0c5550 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1562d0 con 0x7f5f68003ab0 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f81142700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c16b0c0 con 0x7f5f7c0c91c0 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42062/0 (socket says 172.21.15.46:42062) 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68003ab0 0x7f5f7c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 -- 172.21.15.46:0/2995883795 learned_addr learned my addr 172.21.15.46:0/2995883795 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7a59c700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f7c0c91c0 0x7f5f7c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 -- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f7c0c91c0 msgr2=0x7f5f7c0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f7c0c91c0 0x7f5f7c0c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 -- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68003ab0 msgr2=0x7f5f7c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68003ab0 0x7f5f7c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.332+0000 7f5f7b59e700 1 -- 172.21.15.46:0/2995883795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c16a4b0 con 0x7f5f7c0c5550 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f7b59e700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0cad80 tx=0x7f5f74009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74013420 con 0x7f5f7c0c5550 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f740135a0 con 0x7f5f7c0c5550 2023-10-07T09:00:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c16a790 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74013960 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.333+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c16ad50 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.334+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c0c7860 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.334+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f74013d10 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.335+0000 7f5f72ffd700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 0x7f5f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.335+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f740841a0 con 0x7f5f7c0c5550 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.335+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 0x7f5f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.335+0000 7f5f7ad9d700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 0x7f5f5c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00afd0 tx=0x7f5f6c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.339+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f7c0c7860 con 0x7f5f7c0c5550 2023-10-07T09:00:10.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.611+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5f7c0c7860 con 0x7f5f7c0c5550 2023-10-07T09:00:10.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.614+0000 7f5f72ffd700 1 -- 172.21.15.46:0/2995883795 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5f7c0c7860 con 0x7f5f7c0c5550 2023-10-07T09:00:10.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 msgr2=0x7f5f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 0x7f5f5c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00afd0 tx=0x7f5f6c016000 comp rx=0 tx=0).stop 2023-10-07T09:00:10.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 msgr2=0x7f5f7c0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0cad80 tx=0x7f5f74009040 comp rx=0 tx=0).stop 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 shutdown_connections 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f5c066f30 0x7f5f5c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f7c0c5550 0x7f5f7c0c59c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f68003ab0 0x7f5f7c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 --2- 172.21.15.46:0/2995883795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f7c0c91c0 0x7f5f7c0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.616+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 >> 172.21.15.46:0/2995883795 conn(0x7f5f7c068e00 msgr2=0x7f5f7c153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.617+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 shutdown_connections 2023-10-07T09:00:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.617+0000 7f5f81142700 1 -- 172.21.15.46:0/2995883795 wait complete. 2023-10-07T09:00:10.620 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:00:10.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:10.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.747+0000 7f40c4ef8700 1 Processor -- start 2023-10-07T09:00:10.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.747+0000 7f40c4ef8700 1 -- start start 2023-10-07T09:00:10.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40c0159890 0x7f40c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 0x7f40c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c015df50 con 0x7f40c0159890 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c015a160 con 0x7f40c0159c60 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40c4ef8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00d13a0 con 0x7f40c015db10 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40be59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40c0159890 0x7f40c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40be59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40c0159890 0x7f40c015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42064/0 (socket says 172.21.15.46:42064) 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.748+0000 7f40be59c700 1 -- 172.21.15.46:0/202777388 learned_addr learned my addr 172.21.15.46:0/202777388 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bdd9b700 1 --2- 172.21.15.46:0/202777388 >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 0x7f40c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 -- 172.21.15.46:0/202777388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 msgr2=0x7f40c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bed9d700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 -- 172.21.15.46:0/202777388 >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 msgr2=0x7f40c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 --2- 172.21.15.46:0/202777388 >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 0x7f40c015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 -- 172.21.15.46:0/202777388 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c015e140 con 0x7f40c0159890 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bdd9b700 1 --2- 172.21.15.46:0/202777388 >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 0x7f40c015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bed9d700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40be59c700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159890 0x7f40c015abd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b67f0 tx=0x7f40b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21d47cf18390670 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bd59a700 1 -- 172.21.15.46:0/202777388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000e070 con 0x7f40c0159890 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bd59a700 1 -- 172.21.15.46:0/202777388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b000ba50 con 0x7f40c0159890 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.749+0000 7f40bd59a700 1 -- 172.21.15.46:0/202777388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00092e0 con 0x7f40c0159890 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 -- 172.21.15.46:0/202777388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159890 msgr2=0x7f40c015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159890 0x7f40c015abd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b67f0 tx=0x7f40b0009840 comp rx=0 tx=0).stop 2023-10-07T09:00:10.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 -- 172.21.15.46:0/202777388 shutdown_connections 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/202777388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159890 0x7f40c015abd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/202777388 >> v2:172.21.15.133:3300/0 conn(0x7f40c0159c60 0x7f40c015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 -- 172.21.15.46:0/202777388 >> 172.21.15.46:0/202777388 conn(0x7f40c0068e20 msgr2=0x7f40c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 -- 172.21.15.46:0/202777388 shutdown_connections 2023-10-07T09:00:10.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.750+0000 7f40c4ef8700 1 -- 172.21.15.46:0/202777388 wait complete. 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 Processor -- start 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 -- start start 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c0159890 0x7f40c0142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c01577d0 con 0x7f40c0159c60 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.751+0000 7f40c4ef8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c01430f0 con 0x7f40c0159890 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40c4ef8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0156bc0 con 0x7f40c015db10 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42074/0 (socket says 172.21.15.46:42074) 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 -- 172.21.15.46:0/80646702 learned_addr learned my addr 172.21.15.46:0/80646702 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 -- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 msgr2=0x7f40c00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 -- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c0159890 msgr2=0x7f40c0142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c0159890 0x7f40c0142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 -- 172.21.15.46:0/80646702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0009ae0 con 0x7f40c0159c60 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40bdd9b700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c8b0 tx=0x7f40a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8011660 con 0x7f40c0159c60 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a80117c0 con 0x7f40c0159c60 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8011b40 con 0x7f40c0159c60 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c0156ea0 con 0x7f40c0159c60 2023-10-07T09:00:10.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.752+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c0157460 con 0x7f40c0159c60 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.753+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c004c3c0 con 0x7f40c0159c60 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.754+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40a8010350 con 0x7f40c0159c60 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.754+0000 7f40b67fc700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 0x7f40a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.754+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40a8084460 con 0x7f40c0159c60 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.754+0000 7f40be59c700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 0x7f40a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:10.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.755+0000 7f40be59c700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 0x7f40a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b67f0 tx=0x7f40b0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.758+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a8055160 con 0x7f40c0159c60 2023-10-07T09:00:11.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.998+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40c01575f0 con 0x7f40c0159c60 2023-10-07T09:00:11.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:10.999+0000 7f40b67fc700 1 -- 172.21.15.46:0/80646702 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f40a8054cf0 con 0x7f40c0159c60 2023-10-07T09:00:11.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 msgr2=0x7f40a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 0x7f40a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b67f0 tx=0x7f40b0018000 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 msgr2=0x7f40c0156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c8b0 tx=0x7f40a8008040 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 shutdown_connections 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f40a0066f30 0x7f40a00693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c015db10 0x7f40c00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c0159890 0x7f40c0142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 --2- 172.21.15.46:0/80646702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c0159c60 0x7f40c0156390 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 >> 172.21.15.46:0/80646702 conn(0x7f40c0068e20 msgr2=0x7f40c00cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 shutdown_connections 2023-10-07T09:00:11.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.001+0000 7f40c4ef8700 1 -- 172.21.15.46:0/80646702 wait complete. 2023-10-07T09:00:11.004 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2023-10-07T09:00:11.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:00:00.266223+0000', 'modified': '2023-10-07T09:00:03.889584+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5334': {'gid': 5334, 'name': 'd', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2348769252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 2348769252}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2348769252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:00:11.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:00:11.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-07T09:00:11.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 Processor -- start 2023-10-07T09:00:11.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 -- start start 2023-10-07T09:00:11.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f68159890 0x7f7f6815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f68069560 0x7f7f680699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f68069ee0 con 0x7f7f68159c60 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6815a160 con 0x7f7f68069560 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.540+0000 7f7f6d028700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f680d13a0 con 0x7f7f68159890 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f68069560 0x7f7f680699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f68069560 0x7f7f680699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42090/0 (socket says 172.21.15.46:42090) 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 -- 172.21.15.46:0/827765113 learned_addr learned my addr 172.21.15.46:0/827765113 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 -- 172.21.15.46:0/827765113 >> v2:172.21.15.133:3300/0 conn(0x7f7f68159890 msgr2=0x7f7f6815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/827765113 >> v2:172.21.15.133:3300/0 conn(0x7f7f68159890 0x7f7f6815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 --2- 172.21.15.46:0/827765113 >> v2:172.21.15.133:3300/0 conn(0x7f7f68159890 0x7f7f6815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 -- 172.21.15.46:0/827765113 >> v1:172.21.15.133:6789/0 conn(0x7f7f68159c60 legacy=0x7f7f6815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 -- 172.21.15.46:0/827765113 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6815e140 con 0x7f7f68069560 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f6759e700 1 --2- 172.21.15.46:0/827765113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680699a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f680d1090 tx=0x7f7f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc557d25cfc40112 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f65d9b700 1 -- 172.21.15.46:0/827765113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000b820 con 0x7f7f68069560 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f65d9b700 1 -- 172.21.15.46:0/827765113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000b980 con 0x7f7f68069560 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.541+0000 7f7f65d9b700 1 -- 172.21.15.46:0/827765113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000bd20 con 0x7f7f68069560 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 -- 172.21.15.46:0/827765113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 msgr2=0x7f7f680699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 --2- 172.21.15.46:0/827765113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680699a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f680d1090 tx=0x7f7f60009250 comp rx=0 tx=0).stop 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 -- 172.21.15.46:0/827765113 shutdown_connections 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 --2- 172.21.15.46:0/827765113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680699a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 --2- 172.21.15.46:0/827765113 >> v2:172.21.15.133:3300/0 conn(0x7f7f68159890 0x7f7f6815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 -- 172.21.15.46:0/827765113 >> 172.21.15.46:0/827765113 conn(0x7f7f68068e20 msgr2=0x7f7f680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 -- 172.21.15.46:0/827765113 shutdown_connections 2023-10-07T09:00:11.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.542+0000 7f7f6d028700 1 -- 172.21.15.46:0/827765113 wait complete. 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.543+0000 7f7f6d028700 1 Processor -- start 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.543+0000 7f7f6d028700 1 -- start start 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 0x7f7f68140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f68159c60 0x7f7f680b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680cd8b0 con 0x7f7f68069560 2023-10-07T09:00:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680cdb90 con 0x7f7f68159c60 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680cde70 con 0x7f7f68159890 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42106/0 (socket says 172.21.15.46:42106) 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 -- 172.21.15.46:0/1610207774 learned_addr learned my addr 172.21.15.46:0/1610207774 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6759e700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f68159c60 0x7f7f680b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 0x7f7f68140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 -- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 msgr2=0x7f7f68140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 0x7f7f68140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 -- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f68159c60 msgr2=0x7f7f680b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f68159c60 0x7f7f680b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 -- 172.21.15.46:0/1610207774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f600094f0 con 0x7f7f68069560 2023-10-07T09:00:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 0x7f7f68140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800cfc0 tx=0x7f7f580078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f5effd700 1 -- 172.21.15.46:0/1610207774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58016430 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f5effd700 1 -- 172.21.15.46:0/1610207774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58016590 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f680ce150 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f5effd700 1 -- 172.21.15.46:0/1610207774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58016930 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.544+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680b3bb0 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.546+0000 7f7f5effd700 1 -- 172.21.15.46:0/1610207774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f58003020 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.546+0000 7f7f5effd700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 0x7f7f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.546+0000 7f7f5effd700 1 -- 172.21.15.46:0/1610207774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f58012070 con 0x7f7f68069560 2023-10-07T09:00:11.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.546+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 0x7f7f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.547+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 0x7f7f480693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006fd0 tx=0x7f7f50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.548+0000 7f7f76320b80 1 Processor -- start 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.548+0000 7f7f76320b80 1 -- start start 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21b7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21b78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21ad3a70 con 0x564a21bc6d00 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21ad1270 con 0x564a21ba5f60 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a21acd060 con 0x564a21b7ca50 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42122/0 (socket says 172.21.15.46:42122) 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 -- 172.21.15.46:0/1909113031 learned_addr learned my addr 172.21.15.46:0/1909113031 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6759e700 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21b78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21b7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 -- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 msgr2=0x564a21b7ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21b7ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 -- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 msgr2=0x564a21b78cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21b78cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.549+0000 7f7f6659c700 1 -- 172.21.15.46:0/1909113031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a21967270 con 0x564a21bc6d00 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f6659c700 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000cb00 tx=0x7f7f50012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2836bb67a1bca7c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f47fff700 1 -- 172.21.15.46:0/1909113031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000cee0 con 0x564a21bc6d00 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f47fff700 1 -- 172.21.15.46:0/1909113031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f50011880 con 0x564a21bc6d00 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f47fff700 1 -- 172.21.15.46:0/1909113031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50011c00 con 0x564a21bc6d00 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 -- 172.21.15.46:0/1909113031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 msgr2=0x564a21ba5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000cb00 tx=0x7f7f50012000 comp rx=0 tx=0).stop 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 -- 172.21.15.46:0/1909113031 shutdown_connections 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21b78cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21b7ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 --2- 172.21.15.46:0/1909113031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21ba5a20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.550+0000 7f7f76320b80 1 -- 172.21.15.46:0/1909113031 >> 172.21.15.46:0/1909113031 conn(0x564a21b7e370 msgr2=0x564a21b7e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.551+0000 7f7f76320b80 1 -- 172.21.15.46:0/1909113031 shutdown_connections 2023-10-07T09:00:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.551+0000 7f7f76320b80 1 -- 172.21.15.46:0/1909113031 wait complete. 2023-10-07T09:00:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.551+0000 7f7f76320b80 1 -- start start 2023-10-07T09:00:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.551+0000 7f7f76320b80 1 Processor -- start 2023-10-07T09:00:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21bc5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21bbce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21a78890 con 0x564a21bc6d00 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21a93ea0 con 0x564a21ba5f60 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2194fe30 con 0x564a21b7ca50 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f76320b80 10 client.0 _ll_register_callbacks cb 0x564a21b40110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f6759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f6759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42134/0 (socket says 172.21.15.46:42134) 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f6759e700 1 -- 172.21.15.46:0/2374624294 learned_addr learned my addr 172.21.15.46:0/2374624294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21bc5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.552+0000 7f7f6659c700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21bbce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 -- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 msgr2=0x564a21bc5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21bc5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 -- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 msgr2=0x564a21bbce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21bbce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 -- 172.21.15.46:0/2374624294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5000c660 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6659c700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21bbce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f6759e700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7f60006fa0 tx=0x7f7f60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f94d118a840d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60023070 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f60028ad0 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a21b71b70 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f60011a10 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 10 client.5487 fetch_fsmap learned FSMap version 30 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x564a21909fe0 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a21b71b70 con 0x564a21bc6d00 2023-10-07T09:00:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7f60018070 con 0x564a21bc6d00 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 10 client.5487 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 10 client.5487 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 20 client.5487 populate_metadata read hostname 'smithi046' 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bbfb00 0x564a21bc3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 4 client.5487 mds_command: new command op to 5334 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.553+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 --> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a21b4eaa0 con 0x564a21bbfb00 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.554+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bbfb00 0x564a21bc3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.554+0000 7f7f457fa700 10 client.5487 ms_handle_connect on v2:172.21.15.133:6835/2348769252 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.554+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bbfb00 0x564a21bc3c80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11ea82a62ee2540 server_cookie=f4a1b007f3d4c761 in_seq=0 out_seq=0 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f457fa700 1 -- 172.21.15.46:0/2374624294 <== mds.0 v2:172.21.15.133:6835/2348769252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564a21b4eaa0 con 0x564a21bbfb00 2023-10-07T09:00:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f457fa700 10 client.5487 handle_command_reply: tid=0 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 client.5487 shutdown 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 msgr2=0x564a21bbd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7f60006fa0 tx=0x7f7f60016000 comp rx=0 tx=0).stop 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 shutdown_connections 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bbfb00 0x564a21bc3c80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21bc6d00 0x564a21bbd3b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21b7ca50 0x564a21bc5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 --2- 172.21.15.46:0/2374624294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21bbce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f457fa700 0 client.5487 ms_handle_reset on v2:172.21.15.133:6835/2348769252 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 >> 172.21.15.46:0/2374624294 conn(0x564a21b7e370 msgr2=0x564a21b79850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 shutdown_connections 2023-10-07T09:00:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 1 -- 172.21.15.46:0/2374624294 wait complete. 2023-10-07T09:00:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.555+0000 7f7f76320b80 20 client.5487 trim_cache size 0 max 16384 2023-10-07T09:00:11.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:00:11.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:00:11.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.572+0000 7f7f76320b80 1 Processor -- start 2023-10-07T09:00:11.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.572+0000 7f7f76320b80 1 -- start start 2023-10-07T09:00:11.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21ba5f60 0x564a21ba1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 0x564a21bc25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21ba5020 con 0x564a21b7ca50 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21ba5d50 con 0x564a21bbfb00 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a21b80470 con 0x564a21ba5f60 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42148/0 (socket says 172.21.15.46:42148) 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3158489011 learned_addr learned my addr 172.21.15.46:0/3158489011 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f6759e700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 0x564a21bc25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f6659c700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21ba5f60 0x564a21ba1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21ba5f60 msgr2=0x564a21ba1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21ba5f60 0x564a21ba1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 msgr2=0x564a21bc25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 0x564a21bc25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3158489011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a21a9b780 con 0x564a21b7ca50 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f6759e700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 0x564a21bc25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7f580528b0 tx=0x7f7f5806a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6117e3d8ca8151eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.573+0000 7f7f5cff9700 1 -- 172.21.15.46:0/3158489011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5805d3d0 con 0x564a21b7ca50 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f5cff9700 1 -- 172.21.15.46:0/3158489011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58080070 con 0x564a21b7ca50 2023-10-07T09:00:11.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f5cff9700 1 -- 172.21.15.46:0/3158489011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f580544f0 con 0x564a21b7ca50 2023-10-07T09:00:11.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 -- 172.21.15.46:0/3158489011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 msgr2=0x564a21b7ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7f580528b0 tx=0x7f7f5806a040 comp rx=0 tx=0).stop 2023-10-07T09:00:11.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 -- 172.21.15.46:0/3158489011 shutdown_connections 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21bbfb00 0x564a21bc25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21b7ad90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3158489011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21ba5f60 0x564a21ba1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 -- 172.21.15.46:0/3158489011 >> 172.21.15.46:0/3158489011 conn(0x564a21b7e370 msgr2=0x564a21b78f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 -- 172.21.15.46:0/3158489011 shutdown_connections 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.574+0000 7f7f76320b80 1 -- 172.21.15.46:0/3158489011 wait complete. 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.575+0000 7f7f76320b80 1 -- start start 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.575+0000 7f7f76320b80 1 Processor -- start 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21ba08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21bbfb00 0x564a21ba0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21bc3e00 con 0x564a21b7ca50 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a21c299a0 con 0x564a21ba5f60 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a21c22220 con 0x564a21bbfb00 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f76320b80 10 client.0 _ll_register_callbacks cb 0x564a21b40110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42158/0 (socket says 172.21.15.46:42158) 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3686030480 learned_addr learned my addr 172.21.15.46:0/3686030480 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f6659c700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21ba08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f6759e700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21bbfb00 0x564a21ba0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21bbfb00 msgr2=0x564a21ba0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21bbfb00 0x564a21ba0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 msgr2=0x564a21ba08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21ba08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 -- 172.21.15.46:0/3686030480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680b3bb0 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f66d9d700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f580528b0 tx=0x7f7f58070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9316edfe406c697d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.576+0000 7f7f457fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f580544f0 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f58054750 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f50011880 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f58056820 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 10 client.5493 fetch_fsmap learned FSMap version 30 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x564a21a82470 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f50011880 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7f58066020 con 0x564a21b7ca50 2023-10-07T09:00:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 10 client.5493 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 10 client.5493 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 20 client.5493 populate_metadata read hostname 'smithi046' 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bc6d00 0x564a21c28b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 4 client.5493 mds_command: new command op to 5334 tid=0[{"prefix": "status"}] 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 --> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564a21a6fe00 con 0x564a21bc6d00 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.577+0000 7f7f6659c700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bc6d00 0x564a21c28b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f457fa700 10 client.5493 ms_handle_connect on v2:172.21.15.133:6835/2348769252 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f6659c700 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bc6d00 0x564a21c28b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3961a3a38d35068 server_cookie=61d61afbd7b42bcc in_seq=0 out_seq=0 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f457fa700 1 -- 172.21.15.46:0/3686030480 <== mds.0 v2:172.21.15.133:6835/2348769252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564a21a6fe00 con 0x564a21bc6d00 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f457fa700 10 client.5493 handle_command_reply: tid=0 2023-10-07T09:00:11.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 client.5493 shutdown 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 msgr2=0x564a21c21ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f580528b0 tx=0x7f7f58070000 comp rx=0 tx=0).stop 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 shutdown_connections 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:6835/2348769252,v1:172.21.15.133:6837/2348769252] conn(0x564a21bc6d00 0x564a21c28b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564a21bbfb00 0x564a21ba0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a21b7ca50 0x564a21c21ce0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 --2- 172.21.15.46:0/3686030480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564a21ba5f60 0x564a21ba08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f457fa700 0 client.5493 ms_handle_reset on v2:172.21.15.133:6835/2348769252 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 >> 172.21.15.46:0/3686030480 conn(0x564a21b7e370 msgr2=0x564a21bc20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 shutdown_connections 2023-10-07T09:00:11.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 1 -- 172.21.15.46:0/3686030480 wait complete. 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.578+0000 7f7f76320b80 20 client.5493 trim_cache size 0 max 16384 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5334, 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:00:11.587 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 10.695859219999999, 2023-10-07T09:00:11.588 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 30, 2023-10-07T09:00:11.588 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 52, 2023-10-07T09:00:11.588 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 52, 2023-10-07T09:00:11.588 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 15.772900153 2023-10-07T09:00:11.588 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 msgr2=0x7f7f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 0x7f7f480693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006fd0 tx=0x7f7f50008040 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 msgr2=0x7f7f680b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800cfc0 tx=0x7f7f580078b0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 shutdown_connections 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7f48066f30 0x7f7f480693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f68159c60 0x7f7f680b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f68069560 0x7f7f680b3670 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 --2- 172.21.15.46:0/1610207774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f68159890 0x7f7f68140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 >> 172.21.15.46:0/1610207774 conn(0x7f7f68068e20 msgr2=0x7f7f68152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 shutdown_connections 2023-10-07T09:00:11.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.579+0000 7f7f6d028700 1 -- 172.21.15.46:0/1610207774 wait complete. 2023-10-07T09:00:11.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:00:11.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.784+0000 7eff203ab700 1 Processor -- start 2023-10-07T09:00:11.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.785+0000 7eff203ab700 1 -- start start 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff203ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff180c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff203ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff180c81f0 0x7eff180cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff203ab700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1806bdb0 con 0x7eff180aca80 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff203ab700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180c8670 con 0x7eff180c81f0 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff203ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180cb370 con 0x7eff18069d60 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff180c81f0 0x7eff180cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e147700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7eff180aca80 0x7eff1806aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52766/0 (socket says 172.21.15.46:52766) 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e147700 1 -- 172.21.15.46:0/1551757852 learned_addr learned my addr 172.21.15.46:0/1551757852 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1d946700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff180c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 -- 172.21.15.46:0/1551757852 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 msgr2=0x7eff180c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:11.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff180c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 -- 172.21.15.46:0/1551757852 >> v1:172.21.15.46:6789/0 conn(0x7eff180aca80 legacy=0x7eff1806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1d145700 1 -- 172.21.15.46:0/1551757852 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609370716 0 0) 0x7eff1806bdb0 con 0x7eff180aca80 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 -- 172.21.15.46:0/1551757852 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18159f60 con 0x7eff180c81f0 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1e948700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180cb800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e60 tx=0x7eff10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e3cf87950f05e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1d145700 1 -- 172.21.15.46:0/1551757852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000e070 con 0x7eff180c81f0 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1d145700 1 -- 172.21.15.46:0/1551757852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000bc30 con 0x7eff180c81f0 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.786+0000 7eff1d145700 1 -- 172.21.15.46:0/1551757852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012430 con 0x7eff180c81f0 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 -- 172.21.15.46:0/1551757852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 msgr2=0x7eff180cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180cb800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e60 tx=0x7eff10009780 comp rx=0 tx=0).stop 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 -- 172.21.15.46:0/1551757852 shutdown_connections 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180cb800 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 --2- 172.21.15.46:0/1551757852 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff180c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 -- 172.21.15.46:0/1551757852 >> 172.21.15.46:0/1551757852 conn(0x7eff180cd670 msgr2=0x7eff180cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:11.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 -- 172.21.15.46:0/1551757852 shutdown_connections 2023-10-07T09:00:11.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.787+0000 7eff203ab700 1 -- 172.21.15.46:0/1551757852 wait complete. 2023-10-07T09:00:11.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.788+0000 7eff203ab700 1 Processor -- start 2023-10-07T09:00:11.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.788+0000 7eff203ab700 1 -- start start 2023-10-07T09:00:11.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff1815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 0x7eff18159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1815d5e0 con 0x7eff180c81f0 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1815dba0 con 0x7eff180aca80 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1815fdf0 con 0x7eff18069d60 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42182/0 (socket says 172.21.15.46:42182) 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 -- 172.21.15.46:0/2519168967 learned_addr learned my addr 172.21.15.46:0/2519168967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1d946700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 0x7eff18159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e147700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff1815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 -- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 msgr2=0x7eff1815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff1815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 -- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 msgr2=0x7eff18159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 0x7eff18159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 -- 172.21.15.46:0/2519168967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009a20 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1d946700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 0x7eff18159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e147700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff1815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff1e948700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff1806c6a0 tx=0x7eff10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012e10 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1001d630 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18159bc0 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.789+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1001d9f0 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.790+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff180b28a0 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.790+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1804c3c0 con 0x7eff180c81f0 2023-10-07T09:00:11.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.791+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff10024070 con 0x7eff180c81f0 2023-10-07T09:00:11.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.791+0000 7eff0e7fc700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:11.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.791+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff10086d10 con 0x7eff180c81f0 2023-10-07T09:00:11.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.791+0000 7eff1e147700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:11.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.792+0000 7eff1e147700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 0x7efefc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff140018b0 tx=0x7eff14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:11.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:11.795+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff10053f80 con 0x7eff180c81f0 2023-10-07T09:00:12.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.035+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff180678d0 con 0x7eff180c81f0 2023-10-07T09:00:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.036+0000 7eff0e7fc700 1 -- 172.21.15.46:0/2519168967 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff100575a0 con 0x7eff180c81f0 2023-10-07T09:00:12.038 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 msgr2=0x7efefc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 0x7efefc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff140018b0 tx=0x7eff14009040 comp rx=0 tx=0).stop 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 msgr2=0x7eff180b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff1806c6a0 tx=0x7eff10019000 comp rx=0 tx=0).stop 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 shutdown_connections 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff180c81f0 0x7eff180b0410 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff18069d60 0x7eff1815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 --2- 172.21.15.46:0/2519168967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff180aca80 0x7eff18159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 >> 172.21.15.46:0/2519168967 conn(0x7eff180cd670 msgr2=0x7eff180cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 shutdown_connections 2023-10-07T09:00:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.038+0000 7eff203ab700 1 -- 172.21.15.46:0/2519168967 wait complete. 2023-10-07T09:00:12.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:00:12.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:00:12.052 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:12.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.052 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:00:12.068 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42401sec preferred_lft 42401sec 2023-10-07T09:00:12.069 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.070 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:12.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.071 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:00:12.132 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:00:12.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.134 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:00:12.190 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:00:12.190 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:00:12.190 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:00:12.190 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:00:12.191 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:00:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:00:12.191 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:00:12.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.293 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:00:12.307 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:00:12.307 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:00:12.308 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:12.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:00:12.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:12.375 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:12.431 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:12.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:12.431 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:12.486 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:00:12.487 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:00:12.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:12.567 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:12.567 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:12.586 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:12.586 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:12.586 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:12.587 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:12.587 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:12.587 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:12.587 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:12.587 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:12.609 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:12.610 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:00:12.610 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:00:12.610 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:00:12.611 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:00:12.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:12.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:12.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:00:12.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.835+0000 7fdc7f3d1700 1 Processor -- start 2023-10-07T09:00:12.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.835+0000 7fdc7f3d1700 1 -- start start 2023-10-07T09:00:12.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7f3d1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc781593b0 0x7fdc78159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7f3d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc780b1e50 0x7fdc780b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7f3d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc780b6570 con 0x7fdc780ceaa0 2023-10-07T09:00:12.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7f3d1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc780cfe20 con 0x7fdc781593b0 2023-10-07T09:00:12.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7f3d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc780cf210 con 0x7fdc780b1e50 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc781593b0 0x7fdc78159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc781593b0 0x7fdc78159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42198/0 (socket says 172.21.15.46:42198) 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 -- 172.21.15.46:0/122591497 learned_addr learned my addr 172.21.15.46:0/122591497 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7ebd0700 1 --2- 172.21.15.46:0/122591497 >> v2:172.21.15.133:3300/0 conn(0x7fdc780b1e50 0x7fdc780b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 -- 172.21.15.46:0/122591497 >> v2:172.21.15.133:3300/0 conn(0x7fdc780b1e50 msgr2=0x7fdc780b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/122591497 >> v2:172.21.15.133:3300/0 conn(0x7fdc780b1e50 0x7fdc780b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 -- 172.21.15.46:0/122591497 >> v1:172.21.15.133:6789/0 conn(0x7fdc780ceaa0 legacy=0x7fdc780b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.836+0000 7fdc7e3cf700 1 -- 172.21.15.46:0/122591497 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780cf4f0 con 0x7fdc781593b0 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/122591497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc78159780 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdc780d1700 tx=0x7fdc70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d7e702e1a2689f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7d3cd700 1 -- 172.21.15.46:0/122591497 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70009e70 con 0x7fdc781593b0 2023-10-07T09:00:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7d3cd700 1 -- 172.21.15.46:0/122591497 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7000b860 con 0x7fdc781593b0 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7d3cd700 1 -- 172.21.15.46:0/122591497 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000bc00 con 0x7fdc781593b0 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/122591497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 msgr2=0x7fdc78159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/122591497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc78159780 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdc780d1700 tx=0x7fdc70009250 comp rx=0 tx=0).stop 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/122591497 shutdown_connections 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/122591497 >> v2:172.21.15.133:3300/0 conn(0x7fdc780b1e50 0x7fdc780b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/122591497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc78159780 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/122591497 >> 172.21.15.46:0/122591497 conn(0x7fdc780d1130 msgr2=0x7fdc780b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/122591497 shutdown_connections 2023-10-07T09:00:12.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.837+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/122591497 wait complete. 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 Processor -- start 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 -- start start 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 0x7fdc78156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc780ceaa0 0x7fdc780c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780c9e50 con 0x7fdc781593b0 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780c8b30 con 0x7fdc780b1e50 2023-10-07T09:00:12.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7f3d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780ca4f0 con 0x7fdc780ceaa0 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.839+0000 7fdc7ebd0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42202/0 (socket says 172.21.15.46:42202) 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 -- 172.21.15.46:0/2707844060 learned_addr learned my addr 172.21.15.46:0/2707844060 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 0x7fdc78156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 -- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc780ceaa0 msgr2=0x7fdc780c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc780ceaa0 0x7fdc780c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 -- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 msgr2=0x7fdc78156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 0x7fdc78156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 -- 172.21.15.46:0/2707844060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700094f0 con 0x7fdc781593b0 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 0x7fdc78156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7ebd0700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009e90 tx=0x7fdc6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:12.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800cc20 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800f040 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68014480 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc780ca7d0 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.840+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc780c8e90 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.841+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc780cacd0 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.842+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc68014830 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.842+0000 7fdc767fc700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 0x7fdc640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.842+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc68084fc0 con 0x7fdc781593b0 2023-10-07T09:00:12.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.842+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 0x7fdc640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:12.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.843+0000 7fdc7e3cf700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 0x7fdc640693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc780d1700 tx=0x7fdc70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:12.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:12.846+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc68055cc0 con 0x7fdc781593b0 2023-10-07T09:00:13.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.086+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc7804c3c0 con 0x7fdc781593b0 2023-10-07T09:00:13.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.086+0000 7fdc767fc700 1 -- 172.21.15.46:0/2707844060 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc68018060 con 0x7fdc781593b0 2023-10-07T09:00:13.672 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 msgr2=0x7fdc640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 0x7fdc640693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc780d1700 tx=0x7fdc70017000 comp rx=0 tx=0).stop 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 msgr2=0x7fdc780cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009e90 tx=0x7fdc6800b040 comp rx=0 tx=0).stop 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 shutdown_connections 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc64066f30 0x7fdc640693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc781593b0 0x7fdc780cafd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc780b1e50 0x7fdc78156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 --2- 172.21.15.46:0/2707844060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc780ceaa0 0x7fdc780c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 >> 172.21.15.46:0/2707844060 conn(0x7fdc780d1130 msgr2=0x7fdc78068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 shutdown_connections 2023-10-07T09:00:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:13.088+0000 7fdc7f3d1700 1 -- 172.21.15.46:0/2707844060 wait complete. 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:13.674 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:00:13.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:00:13.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:00:13.675 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:13.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.675 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:00:13.694 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:00:13.695 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42392sec preferred_lft 42392sec 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.696 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:13.697 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:00:13.697 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:00:13.697 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:13.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.697 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:00:13.762 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:00:13.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.764 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:00:13.822 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:00:13.822 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:00:13.823 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:00:13.823 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:00:13.823 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:00:13.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.823 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:00:13.823 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:00:13.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:00:13.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:00:13.824 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:00:13.824 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:00:13.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.931 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:00:13.946 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:00:13.946 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:00:13.947 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:13.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:13.947 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:00:14.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:14.012 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:14.068 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:14.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:14.068 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:14.122 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:00:14.123 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:00:14.123 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:14.202 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:14.203 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:14.221 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:14.221 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:14.221 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:14.221 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:14.221 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:14.222 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:14.222 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:14.222 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:14.243 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:00:14.244 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:00:14.244 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:00:14.245 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:00:14.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:14.245 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:14.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:00:14.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.443+0000 7f19ef2f5700 1 Processor -- start 2023-10-07T09:00:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.443+0000 7f19ef2f5700 1 -- start start 2023-10-07T09:00:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ef2f5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19e8153f50 0x7f19e80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ef2f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80b4570 con 0x7f19e8154320 2023-10-07T09:00:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ef2f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e815a730 con 0x7f19e806d840 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ef2f5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e815aa10 con 0x7f19e8153f50 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ec890700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f19e8154320 0x7f19e806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52776/0 (socket says 172.21.15.46:52776) 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ec890700 1 -- 172.21.15.46:0/4237158666 learned_addr learned my addr 172.21.15.46:0/4237158666 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ed091700 1 --2- 172.21.15.46:0/4237158666 >> v2:172.21.15.133:3300/0 conn(0x7f19e8153f50 0x7f19e80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101398453 0 0) 0x7f19e80b4570 con 0x7f19e8154320 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d4003570 con 0x7f19e8154320 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ed091700 1 -- 172.21.15.46:0/4237158666 >> v1:172.21.15.133:6789/0 conn(0x7f19e806d840 legacy=0x7f19e8069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967086957 0 0) 0x7f19e815a730 con 0x7f19e806d840 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ed091700 1 -- 172.21.15.46:0/4237158666 >> v1:172.21.15.46:6789/0 conn(0x7f19e8154320 legacy=0x7f19e806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.444+0000 7f19ed091700 1 -- 172.21.15.46:0/4237158666 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e815acf0 con 0x7f19e8153f50 2023-10-07T09:00:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ed091700 1 --2- 172.21.15.46:0/4237158666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8153f50 0x7f19e80b2000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009910 tx=0x7f19e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9255236e5dc02b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400b640 con 0x7f19e8153f50 2023-10-07T09:00:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400b7a0 con 0x7f19e8153f50 2023-10-07T09:00:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19dffff700 1 -- 172.21.15.46:0/4237158666 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400bb60 con 0x7f19e8153f50 2023-10-07T09:00:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 -- 172.21.15.46:0/4237158666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8153f50 msgr2=0x7f19e80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/4237158666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8153f50 0x7f19e80b2000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009910 tx=0x7f19e40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 -- 172.21.15.46:0/4237158666 shutdown_connections 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/4237158666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8153f50 0x7f19e80b2000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 -- 172.21.15.46:0/4237158666 >> 172.21.15.46:0/4237158666 conn(0x7f19e806baf0 msgr2=0x7f19e806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 -- 172.21.15.46:0/4237158666 shutdown_connections 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.445+0000 7f19ef2f5700 1 -- 172.21.15.46:0/4237158666 wait complete. 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.446+0000 7f19ef2f5700 1 Processor -- start 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 -- start start 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 0x7f19e80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8154320 0x7f19e81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80ae900 con 0x7f19e806d840 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e816a950 con 0x7f19e8154320 2023-10-07T09:00:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ef2f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80adfd0 con 0x7f19e8153f50 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ed091700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.447+0000 7f19ed091700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42218/0 (socket says 172.21.15.46:42218) 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 -- 172.21.15.46:0/3752923560 learned_addr learned my addr 172.21.15.46:0/3752923560 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed892700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8154320 0x7f19e81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ec890700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 0x7f19e80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 -- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 msgr2=0x7f19e80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 0x7f19e80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 -- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8154320 msgr2=0x7f19e81511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8154320 0x7f19e81511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 -- 172.21.15.46:0/3752923560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009420 con 0x7f19e806d840 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ec890700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 0x7f19e80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ed091700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19e806f610 tx=0x7f19e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e401f070 con 0x7f19e806d840 2023-10-07T09:00:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400bb20 con 0x7f19e806d840 2023-10-07T09:00:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80ae2b0 con 0x7f19e806d840 2023-10-07T09:00:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4011670 con 0x7f19e806d840 2023-10-07T09:00:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.448+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80cd680 con 0x7f19e806d840 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.449+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e806b220 con 0x7f19e806d840 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.450+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19e4011a60 con 0x7f19e806d840 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.450+0000 7f19dd7fa700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.450+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19e40858a0 con 0x7f19e806d840 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.450+0000 7f19ec890700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.451+0000 7f19ec890700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19d80058d0 tx=0x7f19d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:14.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.454+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19e4052bc0 con 0x7f19e806d840 2023-10-07T09:00:14.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.691+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19e806d640 con 0x7f19e806d840 2023-10-07T09:00:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.921+0000 7f19dd7fa700 1 -- 172.21.15.46:0/3752923560 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 136+0+0 (secure 0 0 0) 0x7f19e40150c0 con 0x7f19e806d840 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 msgr2=0x7f19cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19d80058d0 tx=0x7f19d8009040 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 msgr2=0x7f19e816a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19e806f610 tx=0x7f19e4017000 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 shutdown_connections 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19e8154320 0x7f19e81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19e806d840 0x7f19e816a410 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 --2- 172.21.15.46:0/3752923560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19e8153f50 0x7f19e80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 >> 172.21.15.46:0/3752923560 conn(0x7f19e806baf0 msgr2=0x7f19e8151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 shutdown_connections 2023-10-07T09:00:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:14.924+0000 7f19ef2f5700 1 -- 172.21.15.46:0/3752923560 wait complete. 2023-10-07T09:00:14.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:00:15.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.056+0000 7f52d58fc700 1 Processor -- start 2023-10-07T09:00:15.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.057+0000 7f52d58fc700 1 -- start start 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.057+0000 7f52d58fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f52d0159890 0x7f52d015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.057+0000 7f52d58fc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d015a160 con 0x7f52d0069560 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.057+0000 7f52d58fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00d13a0 con 0x7f52d0159c60 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.057+0000 7f52d58fc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015e140 con 0x7f52d0159890 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52ceffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f52d0159890 0x7f52d015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cf7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f52d0069560 0x7f52d00ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52792/0 (socket says 172.21.15.46:52792) 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cf7fe700 1 -- 172.21.15.46:0/3602356318 learned_addr learned my addr 172.21.15.46:0/3602356318 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:15.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52ceffd700 1 -- 172.21.15.46:0/3602356318 >> v1:172.21.15.133:6789/0 conn(0x7f52d0159c60 legacy=0x7f52d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52ceffd700 1 -- 172.21.15.46:0/3602356318 >> v1:172.21.15.46:6789/0 conn(0x7f52d0069560 legacy=0x7f52d00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cdffb700 1 -- 172.21.15.46:0/3602356318 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470118490 0 0) 0x7f52d015a160 con 0x7f52d0069560 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52ceffd700 1 -- 172.21.15.46:0/3602356318 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d015a3d0 con 0x7f52d0159890 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52ceffd700 1 --2- 172.21.15.46:0/3602356318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d015abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098e0 tx=0x7f52c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb81e12da9d1aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cdffb700 1 -- 172.21.15.46:0/3602356318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8009e80 con 0x7f52d0159890 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cdffb700 1 -- 172.21.15.46:0/3602356318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800b860 con 0x7f52d0159890 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.058+0000 7f52cdffb700 1 -- 172.21.15.46:0/3602356318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800bbe0 con 0x7f52d0159890 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 -- 172.21.15.46:0/3602356318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 msgr2=0x7f52d015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 --2- 172.21.15.46:0/3602356318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d015abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098e0 tx=0x7f52c80091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 -- 172.21.15.46:0/3602356318 shutdown_connections 2023-10-07T09:00:15.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 --2- 172.21.15.46:0/3602356318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d015abd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 -- 172.21.15.46:0/3602356318 >> 172.21.15.46:0/3602356318 conn(0x7f52d0068e20 msgr2=0x7f52d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:15.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 -- 172.21.15.46:0/3602356318 shutdown_connections 2023-10-07T09:00:15.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.059+0000 7f52d58fc700 1 -- 172.21.15.46:0/3602356318 wait complete. 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.060+0000 7f52d58fc700 1 Processor -- start 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.060+0000 7f52d58fc700 1 -- start start 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52d0069560 0x7f52d0141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52d0159c60 0x7f52d00b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015dae0 con 0x7f52d0159890 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015d650 con 0x7f52d0069560 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52d58fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0141750 con 0x7f52d0159c60 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42230/0 (socket says 172.21.15.46:42230) 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 -- 172.21.15.46:0/74015858 learned_addr learned my addr 172.21.15.46:0/74015858 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ceffd700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52d0069560 0x7f52d0141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52cf7fe700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52d0159c60 0x7f52d00b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 -- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52d0159c60 msgr2=0x7f52d00b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52d0159c60 0x7f52d00b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 -- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52d0069560 msgr2=0x7f52d0141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52d0069560 0x7f52d0141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 -- 172.21.15.46:0/74015858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8009420 con 0x7f52d0159890 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.061+0000 7f52ce7fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c4e0 tx=0x7f52b800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.062+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011590 con 0x7f52d0159890 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.062+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011710 con 0x7f52d0159890 2023-10-07T09:00:15.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.062+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d015ca40 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.062+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011ad0 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.062+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d015d080 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.063+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d004c3c0 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.063+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52b801b3b0 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.063+0000 7f52c6ffd700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.064+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52b80838c0 con 0x7f52d0159890 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.064+0000 7f52ceffd700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.064+0000 7f52ceffd700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52c80093f0 tx=0x7f52c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.068+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52b8050b30 con 0x7f52d0159890 2023-10-07T09:00:15.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.289+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f52d015d790 con 0x7f52b0066f30 2023-10-07T09:00:15.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.292+0000 7f52c6ffd700 1 -- 172.21.15.46:0/74015858 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f52d015d790 con 0x7f52b0066f30 2023-10-07T09:00:15.293 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:00:15.293 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:15.293 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:00:15.293 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:15.293 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:00:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 msgr2=0x7f52b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52c80093f0 tx=0x7f52c8017000 comp rx=0 tx=0).stop 2023-10-07T09:00:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 msgr2=0x7f52d00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c4e0 tx=0x7f52b800c7f0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 shutdown_connections 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52d0159c60 0x7f52d00b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52d0069560 0x7f52d0141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 --2- 172.21.15.46:0/74015858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d0159890 0x7f52d00b3750 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 >> 172.21.15.46:0/74015858 conn(0x7f52d0068e20 msgr2=0x7f52d00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 shutdown_connections 2023-10-07T09:00:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.293+0000 7f52d58fc700 1 -- 172.21.15.46:0/74015858 wait complete. 2023-10-07T09:00:15.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:00:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 Processor -- start 2023-10-07T09:00:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 -- start start 2023-10-07T09:00:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc159c10 0x7f20fc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc0b5ea0 0x7f20fc068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc15c480 con 0x7f20fc068bb0 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0b2a40 con 0x7f20fc159c10 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.427+0000 7f2102685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc15b5d0 con 0x7f20fc0b5ea0 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc159c10 0x7f20fc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc159c10 0x7f20fc15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42238/0 (socket says 172.21.15.46:42238) 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 -- 172.21.15.46:0/2838124170 learned_addr learned my addr 172.21.15.46:0/2838124170 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 -- 172.21.15.46:0/2838124170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc0b5ea0 msgr2=0x7f20fc068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 --2- 172.21.15.46:0/2838124170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc0b5ea0 0x7f20fc068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 -- 172.21.15.46:0/2838124170 >> v1:172.21.15.133:6789/0 conn(0x7f20fc068bb0 legacy=0x7f20fc15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 -- 172.21.15.46:0/2838124170 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc15b870 con 0x7f20fc159c10 2023-10-07T09:00:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20fbfff700 1 --2- 172.21.15.46:0/2838124170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc159c10 0x7f20fc15b090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f20e40099b0 tx=0x7f20e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f61e7860c0d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20faffd700 1 -- 172.21.15.46:0/2838124170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400b820 con 0x7f20fc159c10 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20faffd700 1 -- 172.21.15.46:0/2838124170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400b980 con 0x7f20fc159c10 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.428+0000 7f20faffd700 1 -- 172.21.15.46:0/2838124170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400bd20 con 0x7f20fc159c10 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 -- 172.21.15.46:0/2838124170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc159c10 msgr2=0x7f20fc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 --2- 172.21.15.46:0/2838124170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc159c10 0x7f20fc15b090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f20e40099b0 tx=0x7f20e4009250 comp rx=0 tx=0).stop 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 -- 172.21.15.46:0/2838124170 shutdown_connections 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 --2- 172.21.15.46:0/2838124170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc159c10 0x7f20fc15b090 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 --2- 172.21.15.46:0/2838124170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc0b5ea0 0x7f20fc068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 -- 172.21.15.46:0/2838124170 >> 172.21.15.46:0/2838124170 conn(0x7f20fc099a20 msgr2=0x7f20fc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 -- 172.21.15.46:0/2838124170 shutdown_connections 2023-10-07T09:00:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.429+0000 7f2102685700 1 -- 172.21.15.46:0/2838124170 wait complete. 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.430+0000 7f2102685700 1 Processor -- start 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.430+0000 7f2102685700 1 -- start start 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20fc0b5ea0 0x7f20fc148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc159c10 0x7f20fc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1487c0 con 0x7f20fc068bb0 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0afe90 con 0x7f20fc0b5ea0 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2102685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c5ae0 con 0x7f20fc159c10 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42240/0 (socket says 172.21.15.46:42240) 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 -- 172.21.15.46:0/791840202 learned_addr learned my addr 172.21.15.46:0/791840202 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fb7fe700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20fc0b5ea0 0x7f20fc148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f2100c22700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc159c10 0x7f20fc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 -- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc159c10 msgr2=0x7f20fc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc159c10 0x7f20fc15f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 -- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20fc0b5ea0 msgr2=0x7f20fc148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20fc0b5ea0 0x7f20fc148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 -- 172.21.15.46:0/791840202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40094f0 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.431+0000 7f20fbfff700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009290 tx=0x7f20e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.432+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4011e10 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.432+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e401f070 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.432+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc0af840 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.432+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e401a8a0 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.432+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc149090 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.433+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc04c3c0 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.433+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20e401ac90 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.433+0000 7f20f3fff700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.433+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20e4021070 con 0x7f20fc068bb0 2023-10-07T09:00:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.433+0000 7f20fb7fe700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.434+0000 7f20fb7fe700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006fd0 tx=0x7f20ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.438+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20e4053990 con 0x7f20fc068bb0 2023-10-07T09:00:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.632+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f20fc15bb50 con 0x7f20fc068bb0 2023-10-07T09:00:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.632+0000 7f20f3fff700 1 -- 172.21.15.46:0/791840202 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20e4056fb0 con 0x7f20fc068bb0 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 msgr2=0x7f20dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006fd0 tx=0x7f20ec008040 comp rx=0 tx=0).stop 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 msgr2=0x7f20fc148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009290 tx=0x7f20e4016000 comp rx=0 tx=0).stop 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 shutdown_connections 2023-10-07T09:00:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20fc159c10 0x7f20fc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc068bb0 0x7f20fc148280 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 --2- 172.21.15.46:0/791840202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20fc0b5ea0 0x7f20fc148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 >> 172.21.15.46:0/791840202 conn(0x7f20fc099a20 msgr2=0x7f20fc09b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 shutdown_connections 2023-10-07T09:00:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.634+0000 7f2102685700 1 -- 172.21.15.46:0/791840202 wait complete. 2023-10-07T09:00:15.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000710308 2023-10-07T09:00:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.768+0000 7fd9e6696700 1 Processor -- start 2023-10-07T09:00:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.768+0000 7fd9e6696700 1 -- start start 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 0x7fd9e00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9e015d240 0x7fd9e015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00b2080 con 0x7fd9e015d240 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00cfb00 con 0x7fd9e00b4e70 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e6696700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00b5c40 con 0x7fd9e00b16d0 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e5e95700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9e015d240 0x7fd9e015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e5e95700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9e015d240 0x7fd9e015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42242/0 (socket says 172.21.15.46:42242) 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.769+0000 7fd9e5e95700 1 -- 172.21.15.46:0/464526313 learned_addr learned my addr 172.21.15.46:0/464526313 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e4e93700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5694700 1 --2- 172.21.15.46:0/464526313 >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 0x7fd9e00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 -- 172.21.15.46:0/464526313 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 msgr2=0x7fd9e00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 -- 172.21.15.46:0/464526313 >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 msgr2=0x7fd9e00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 --2- 172.21.15.46:0/464526313 >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 0x7fd9e00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 -- 172.21.15.46:0/464526313 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00b5f20 con 0x7fd9e015d240 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5694700 1 --2- 172.21.15.46:0/464526313 >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 0x7fd9e00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e4e93700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e5e95700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e015d240 0x7fd9e015d6c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0064910 tx=0x7fd9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7d328b4156a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9dffff700 1 -- 172.21.15.46:0/464526313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800b860 con 0x7fd9e015d240 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9dffff700 1 -- 172.21.15.46:0/464526313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d800b9c0 con 0x7fd9e015d240 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9dffff700 1 -- 172.21.15.46:0/464526313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800bd60 con 0x7fd9e015d240 2023-10-07T09:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e6696700 1 -- 172.21.15.46:0/464526313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e015d240 msgr2=0x7fd9e015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.770+0000 7fd9e6696700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e015d240 0x7fd9e015d6c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0064910 tx=0x7fd9d8009250 comp rx=0 tx=0).stop 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 -- 172.21.15.46:0/464526313 shutdown_connections 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e015d240 0x7fd9e015d6c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 --2- 172.21.15.46:0/464526313 >> v2:172.21.15.133:3300/0 conn(0x7fd9e00b4e70 0x7fd9e00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 --2- 172.21.15.46:0/464526313 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 -- 172.21.15.46:0/464526313 >> 172.21.15.46:0/464526313 conn(0x7fd9e00d10c0 msgr2=0x7fd9e00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 -- 172.21.15.46:0/464526313 shutdown_connections 2023-10-07T09:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.771+0000 7fd9e6696700 1 -- 172.21.15.46:0/464526313 wait complete. 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.772+0000 7fd9e6696700 1 Processor -- start 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.772+0000 7fd9e6696700 1 -- start start 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9e015d240 0x7fd9e00cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c5950 con 0x7fd9e00b4e70 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c5c30 con 0x7fd9e015d240 2023-10-07T09:00:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c5f10 con 0x7fd9e00b16d0 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42254/0 (socket says 172.21.15.46:42254) 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 -- 172.21.15.46:0/613465657 learned_addr learned my addr 172.21.15.46:0/613465657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e5e95700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9e015d240 0x7fd9e00cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e5694700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 -- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 msgr2=0x7fd9e015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 -- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9e015d240 msgr2=0x7fd9e00cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9e015d240 0x7fd9e00cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 -- 172.21.15.46:0/613465657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80094f0 con 0x7fd9e00b4e70 2023-10-07T09:00:15.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e5694700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e4e93700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e8d0 tx=0x7fd9d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4013410 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4013570 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4013910 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e00c61f0 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.773+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e0148800 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.774+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e0088990 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.775+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9d4013d00 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.775+0000 7fd9dd7fa700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.775+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9d40842a0 con 0x7fd9e00b4e70 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.775+0000 7fd9e5694700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.776+0000 7fd9e5694700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00076e0 tx=0x7fd9d00098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:15.779+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d4051510 con 0x7fd9e00b4e70 2023-10-07T09:00:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.005+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000710308", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9e004bb80 con 0x7fd9cc066f30 2023-10-07T09:00:16.011 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:16.011+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:16.011 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:16.011+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:16.011 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:16.011+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:16.011 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:16.011+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:16.011 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:16.011+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:16.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.024+0000 7fd9dd7fa700 1 -- 172.21.15.46:0/613465657 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd9e004bb80 con 0x7fd9cc066f30 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 msgr2=0x7fd9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00076e0 tx=0x7fd9d00098f0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 msgr2=0x7fd9e01482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e8d0 tx=0x7fd9d4008040 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 shutdown_connections 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9e015d240 0x7fd9e00cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9e00b16d0 0x7fd9e015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 --2- 172.21.15.46:0/613465657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9e00b4e70 0x7fd9e01482c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 >> 172.21.15.46:0/613465657 conn(0x7fd9e00d10c0 msgr2=0x7fd9e00b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:16.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 shutdown_connections 2023-10-07T09:00:16.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.027+0000 7fd9e6696700 1 -- 172.21.15.46:0/613465657 wait complete. 2023-10-07T09:00:16.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-07T09:00:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.159+0000 7f15ba25d700 1 Processor -- start 2023-10-07T09:00:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.159+0000 7f15ba25d700 1 -- start start 2023-10-07T09:00:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15ba25d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4159890 0x7f15b415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15ba25d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15ba25d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b415a160 con 0x7f15b415db10 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15ba25d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b40d13a0 con 0x7f15b4159890 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15ba25d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b415e140 con 0x7f15b4159c60 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15b37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4159890 0x7f15b415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15b37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4159890 0x7f15b415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42268/0 (socket says 172.21.15.46:42268) 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15b37fe700 1 -- 172.21.15.46:0/3393505967 learned_addr learned my addr 172.21.15.46:0/3393505967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15b2ffd700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.160+0000 7f15b3fff700 1 --1- 172.21.15.46:0/3393505967 >> v1:172.21.15.133:6789/0 conn(0x7f15b415db10 0x7f15b4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:55076/0 (socket says 172.21.15.46:55076) 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b37fe700 1 -- 172.21.15.46:0/3393505967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 msgr2=0x7f15b415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b37fe700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b37fe700 1 -- 172.21.15.46:0/3393505967 >> v1:172.21.15.133:6789/0 conn(0x7f15b415db10 legacy=0x7f15b4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b27fc700 1 -- 172.21.15.46:0/3393505967 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080095987 0 0) 0x7f15b415a160 con 0x7f15b415db10 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b37fe700 1 -- 172.21.15.46:0/3393505967 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b415a3d0 con 0x7f15b4159890 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b37fe700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4159890 0x7f15b415abd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099b0 tx=0x7f15a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b497e125efd72e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b27fc700 1 -- 172.21.15.46:0/3393505967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4009ea0 con 0x7f15b4159890 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b27fc700 1 -- 172.21.15.46:0/3393505967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400b860 con 0x7f15b4159890 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.161+0000 7f15b27fc700 1 -- 172.21.15.46:0/3393505967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400bc00 con 0x7f15b4159890 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 -- 172.21.15.46:0/3393505967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4159890 msgr2=0x7f15b415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4159890 0x7f15b415abd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099b0 tx=0x7f15a4009250 comp rx=0 tx=0).stop 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 -- 172.21.15.46:0/3393505967 shutdown_connections 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4159890 0x7f15b415abd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 --2- 172.21.15.46:0/3393505967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 -- 172.21.15.46:0/3393505967 >> 172.21.15.46:0/3393505967 conn(0x7f15b4068e20 msgr2=0x7f15b40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:16.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 -- 172.21.15.46:0/3393505967 shutdown_connections 2023-10-07T09:00:16.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.162+0000 7f15ba25d700 1 -- 172.21.15.46:0/3393505967 wait complete. 2023-10-07T09:00:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.163+0000 7f15ba25d700 1 Processor -- start 2023-10-07T09:00:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.163+0000 7f15ba25d700 1 -- start start 2023-10-07T09:00:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b4159890 0x7f15b414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40c6bf0 con 0x7f15b415db10 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40c5fe0 con 0x7f15b4159890 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40c62c0 con 0x7f15b4159c60 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42270/0 (socket says 172.21.15.46:42270) 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 -- 172.21.15.46:0/105726934 learned_addr learned my addr 172.21.15.46:0/105726934 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b2ffd700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b37fe700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b4159890 0x7f15b414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 -- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 msgr2=0x7f15b40c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b40c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 -- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b4159890 msgr2=0x7f15b414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b4159890 0x7f15b414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 -- 172.21.15.46:0/105726934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40094f0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b2ffd700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b40c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15b3fff700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00ccc0 tx=0x7f15ac001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00ce00 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac005df0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b40c65a0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00abb0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.164+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b415c740 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.165+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b404c3c0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.166+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15ac0070f0 con 0x7f15b415db10 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.166+0000 7f159b7fe700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 0x7f15a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.166+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15ac0846c0 con 0x7f15b415db10 2023-10-07T09:00:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.166+0000 7f15b37fe700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 0x7f15a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.167+0000 7f15b37fe700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 0x7f15a00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099b0 tx=0x7f15a4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.170+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15ac0519b0 con 0x7f15b415db10 2023-10-07T09:00:16.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.393+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f15b40c6d30 con 0x7f15a0066f30 2023-10-07T09:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.397+0000 7f159b7fe700 1 -- 172.21.15.46:0/105726934 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+530 (secure 0 0 0) 0x7f15b40c6d30 con 0x7f15a0066f30 2023-10-07T09:00:16.398 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_addrs": [ 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.46:6789", 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6789", 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6790" 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pending_subvolume_deletions": 0, 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": { 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "data": [ 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365980286976, 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_data", 2023-10-07T09:00:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 0 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": [ 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365980286976, 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_metadata", 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 65536 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout: "used_size": 0 2023-10-07T09:00:16.400 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:00:16.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 msgr2=0x7f15a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 0x7f15a00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099b0 tx=0x7f15a4017000 comp rx=0 tx=0).stop 2023-10-07T09:00:16.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 msgr2=0x7f15b40ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00ccc0 tx=0x7f15ac001a70 comp rx=0 tx=0).stop 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 shutdown_connections 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f15a0066f30 0x7f15a00693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b415db10 0x7f15b40ce410 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b4159890 0x7f15b414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 --2- 172.21.15.46:0/105726934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15b4159c60 0x7f15b40c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 >> 172.21.15.46:0/105726934 conn(0x7f15b4068e20 msgr2=0x7f15b414d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 shutdown_connections 2023-10-07T09:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.399+0000 7f15ba25d700 1 -- 172.21.15.46:0/105726934 wait complete. 2023-10-07T09:00:16.412 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:00:16.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:00:16.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:00:16.496 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:00:16.496 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:00:16.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:16.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:16.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:00:16.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:16.537 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:00:16.592 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:00:16.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:16.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:16.635 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:00:16.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:16.635 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:00:16.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:16.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.809+0000 7fc1b0422700 1 Processor -- start 2023-10-07T09:00:16.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.809+0000 7fc1b0422700 1 -- start start 2023-10-07T09:00:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1b0422700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1a8159890 0x7fc1a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1b0422700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1a8069560 0x7fc1a80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1b0422700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a8069ee0 con 0x7fc1a8159c60 2023-10-07T09:00:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1b0422700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a815a160 con 0x7fc1a8159890 2023-10-07T09:00:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1b0422700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a80d13a0 con 0x7fc1a8069560 2023-10-07T09:00:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1ae1be700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1a8159890 0x7fc1a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1ae1be700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1a8159890 0x7fc1a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42284/0 (socket says 172.21.15.46:42284) 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1ae1be700 1 -- 172.21.15.46:0/260902926 learned_addr learned my addr 172.21.15.46:0/260902926 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.810+0000 7fc1ae9bf700 1 --2- 172.21.15.46:0/260902926 >> v2:172.21.15.133:3300/0 conn(0x7fc1a8069560 0x7fc1a80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ae1be700 1 -- 172.21.15.46:0/260902926 >> v2:172.21.15.133:3300/0 conn(0x7fc1a8069560 msgr2=0x7fc1a80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ae1be700 1 --2- 172.21.15.46:0/260902926 >> v2:172.21.15.133:3300/0 conn(0x7fc1a8069560 0x7fc1a80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ae1be700 1 -- 172.21.15.46:0/260902926 >> v1:172.21.15.133:6789/0 conn(0x7fc1a8159c60 legacy=0x7fc1a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ae1be700 1 -- 172.21.15.46:0/260902926 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a815e140 con 0x7fc1a8159890 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ae1be700 1 --2- 172.21.15.46:0/260902926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a815abd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc1a806a890 tx=0x7fc198009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ad1181e7fdf61c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ad1bc700 1 -- 172.21.15.46:0/260902926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800e070 con 0x7fc1a8159890 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ad1bc700 1 -- 172.21.15.46:0/260902926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19800ba20 con 0x7fc1a8159890 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1ad1bc700 1 -- 172.21.15.46:0/260902926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1980092e0 con 0x7fc1a8159890 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1b0422700 1 -- 172.21.15.46:0/260902926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 msgr2=0x7fc1a815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.811+0000 7fc1b0422700 1 --2- 172.21.15.46:0/260902926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a815abd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc1a806a890 tx=0x7fc198009840 comp rx=0 tx=0).stop 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 -- 172.21.15.46:0/260902926 shutdown_connections 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 --2- 172.21.15.46:0/260902926 >> v2:172.21.15.133:3300/0 conn(0x7fc1a8069560 0x7fc1a80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 --2- 172.21.15.46:0/260902926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a815abd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 -- 172.21.15.46:0/260902926 >> 172.21.15.46:0/260902926 conn(0x7fc1a8068e20 msgr2=0x7fc1a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 -- 172.21.15.46:0/260902926 shutdown_connections 2023-10-07T09:00:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.812+0000 7fc1b0422700 1 -- 172.21.15.46:0/260902926 wait complete. 2023-10-07T09:00:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 Processor -- start 2023-10-07T09:00:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 -- start start 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1a8069560 0x7fc1a80b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1a8159c60 0x7fc1a8169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a816ab30 con 0x7fc1a8159890 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a8152550 con 0x7fc1a8159c60 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1b0422700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a816a080 con 0x7fc1a8069560 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.813+0000 7fc1ad9bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42294/0 (socket says 172.21.15.46:42294) 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 -- 172.21.15.46:0/4044532919 learned_addr learned my addr 172.21.15.46:0/4044532919 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ae9bf700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1a8159c60 0x7fc1a8169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ae1be700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1a8069560 0x7fc1a80b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 -- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1a8069560 msgr2=0x7fc1a80b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1a8069560 0x7fc1a80b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 -- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1a8159c60 msgr2=0x7fc1a8169b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1a8159c60 0x7fc1a8169b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 -- 172.21.15.46:0/4044532919 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198009ae0 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1ad9bd700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c4e0 tx=0x7fc19c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c011590 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c011710 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a80c7a60 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c011ad0 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.814+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a816a570 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.815+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a80c7bf0 con 0x7fc1a8159890 2023-10-07T09:00:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.816+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc19c01c440 con 0x7fc1a8159890 2023-10-07T09:00:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.816+0000 7fc1a67fc700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 0x7fc1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.816+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc19c083860 con 0x7fc1a8159890 2023-10-07T09:00:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.816+0000 7fc1ae1be700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 0x7fc1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.817+0000 7fc1ae1be700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 0x7fc1940693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc198009880 tx=0x7fc198018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.820+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc19c050ad0 con 0x7fc1a8159890 2023-10-07T09:00:16.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:16.934+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc19c050ea0 con 0x7fc1a8159890 2023-10-07T09:00:17.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.064+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1a804c3c0 con 0x7fc1a8159890 2023-10-07T09:00:17.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.064+0000 7fc1a67fc700 1 -- 172.21.15.46:0/4044532919 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc19c017090 con 0x7fc1a8159890 2023-10-07T09:00:17.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:17.066 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:17.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 msgr2=0x7fc1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 0x7fc1940693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc198009880 tx=0x7fc198018000 comp rx=0 tx=0).stop 2023-10-07T09:00:17.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 msgr2=0x7fc1a8152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c4e0 tx=0x7fc19c00c7f0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 shutdown_connections 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc194066f30 0x7fc1940693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1a8159c60 0x7fc1a8169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1a8069560 0x7fc1a80b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 --2- 172.21.15.46:0/4044532919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a8159890 0x7fc1a8152010 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 >> 172.21.15.46:0/4044532919 conn(0x7fc1a8068e20 msgr2=0x7fc1a81534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 shutdown_connections 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.066+0000 7fc1b0422700 1 -- 172.21.15.46:0/4044532919 wait complete. 2023-10-07T09:00:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2023-10-07T09:00:17.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:17.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.197+0000 7f19db9bb700 1 Processor -- start 2023-10-07T09:00:17.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 -- start start 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159890 0x7f19d415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19d4069560 0x7f19d40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d415a160 con 0x7f19d4159c60 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d4069f20 con 0x7f19d4069560 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.198+0000 7f19db9bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40d13a0 con 0x7f19d4159890 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19d4069560 0x7f19d40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d8f56700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f19d4159c60 0x7f19d415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52808/0 (socket says 172.21.15.46:52808) 2023-10-07T09:00:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d8f56700 1 -- 172.21.15.46:0/3368844346 learned_addr learned my addr 172.21.15.46:0/3368844346 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9757700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159890 0x7f19d415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 -- 172.21.15.46:0/3368844346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159890 msgr2=0x7f19d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159890 0x7f19d415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 -- 172.21.15.46:0/3368844346 >> v1:172.21.15.46:6789/0 conn(0x7f19d4159c60 legacy=0x7f19d415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 -- 172.21.15.46:0/3368844346 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d415e140 con 0x7f19d4069560 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d3fff700 1 -- 172.21.15.46:0/3368844346 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71117932 0 0) 0x7f19d415a160 con 0x7f19d4159c60 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d9f58700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4069560 0x7f19d40699e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009e60 tx=0x7f19c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90357dbd0ed06f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d3fff700 1 -- 172.21.15.46:0/3368844346 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400e070 con 0x7f19d4069560 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d3fff700 1 -- 172.21.15.46:0/3368844346 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400bc30 con 0x7f19d4069560 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.199+0000 7f19d3fff700 1 -- 172.21.15.46:0/3368844346 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4012430 con 0x7f19d4069560 2023-10-07T09:00:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 -- 172.21.15.46:0/3368844346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4069560 msgr2=0x7f19d40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4069560 0x7f19d40699e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009e60 tx=0x7f19c4009780 comp rx=0 tx=0).stop 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 -- 172.21.15.46:0/3368844346 shutdown_connections 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4069560 0x7f19d40699e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 --2- 172.21.15.46:0/3368844346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159890 0x7f19d415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 -- 172.21.15.46:0/3368844346 >> 172.21.15.46:0/3368844346 conn(0x7f19d4068e20 msgr2=0x7f19d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 -- 172.21.15.46:0/3368844346 shutdown_connections 2023-10-07T09:00:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.200+0000 7f19db9bb700 1 -- 172.21.15.46:0/3368844346 wait complete. 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.201+0000 7f19db9bb700 1 Processor -- start 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.201+0000 7f19db9bb700 1 -- start start 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d4069560 0x7f19d415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159c60 0x7f19d4154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4155770 con 0x7f19d4159890 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415efc0 con 0x7f19d4069560 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19db9bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4154cc0 con 0x7f19d4159c60 2023-10-07T09:00:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42322/0 (socket says 172.21.15.46:42322) 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 -- 172.21.15.46:0/207917443 learned_addr learned my addr 172.21.15.46:0/207917443 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d9f58700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159c60 0x7f19d4154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 -- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159c60 msgr2=0x7f19d4154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159c60 0x7f19d4154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 -- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d4069560 msgr2=0x7f19d415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d4069560 0x7f19d415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 -- 172.21.15.46:0/207917443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4009a20 con 0x7f19d4159890 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.202+0000 7f19d8f56700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c840 tx=0x7f19c8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.203+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8005c00 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.203+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8005d60 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.203+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d40b3fe0 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.203+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80072e0 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.203+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d415b8a0 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.204+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d40b4500 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.204+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f19c8007690 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.204+0000 7f19d17fa700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 0x7f19c0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.205+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19c8083970 con 0x7f19d4159890 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.205+0000 7f19d9757700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 0x7f19c0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.205+0000 7f19d9757700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 0x7f19c0069470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009a60 tx=0x7f19cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.210+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c804b5a0 con 0x7f19d4159890 2023-10-07T09:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.403+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19d415ed90 con 0x7f19d4159890 2023-10-07T09:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.404+0000 7f19d17fa700 1 -- 172.21.15.46:0/207917443 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f19d415ed90 con 0x7f19d4159890 2023-10-07T09:00:17.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:17.406 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:01.861371+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 msgr2=0x7f19c0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 0x7f19c0069470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009a60 tx=0x7f19cc008040 comp rx=0 tx=0).stop 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 msgr2=0x7f19d40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c840 tx=0x7f19c8007db0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 shutdown_connections 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19c0066fc0 0x7f19c0069470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d4159c60 0x7f19d4154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d4069560 0x7f19d415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 --2- 172.21.15.46:0/207917443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19d4159890 0x7f19d40b3590 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 >> 172.21.15.46:0/207917443 conn(0x7f19d4068e20 msgr2=0x7f19d41580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 shutdown_connections 2023-10-07T09:00:17.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.406+0000 7f19db9bb700 1 -- 172.21.15.46:0/207917443 wait complete. 2023-10-07T09:00:17.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:59:58.657442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:59:59.232425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:00:17.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:00:17.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.540+0000 7f07a44dd700 1 Processor -- start 2023-10-07T09:00:17.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.540+0000 7f07a44dd700 1 -- start start 2023-10-07T09:00:17.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a44dd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f079c159890 0x7f079c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a44dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f079c069560 0x7f079c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a44dd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c069ee0 con 0x7f079c159c60 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a44dd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c15a160 con 0x7f079c159890 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a44dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0d13a0 con 0x7f079c069560 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a2279700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f079c159890 0x7f079c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a2279700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f079c159890 0x7f079c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42334/0 (socket says 172.21.15.46:42334) 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.541+0000 7f07a2279700 1 -- 172.21.15.46:0/3231848912 learned_addr learned my addr 172.21.15.46:0/3231848912 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a2279700 1 -- 172.21.15.46:0/3231848912 >> v2:172.21.15.133:3300/0 conn(0x7f079c069560 msgr2=0x7f079c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a2279700 1 --2- 172.21.15.46:0/3231848912 >> v2:172.21.15.133:3300/0 conn(0x7f079c069560 0x7f079c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a2279700 1 -- 172.21.15.46:0/3231848912 >> v1:172.21.15.133:6789/0 conn(0x7f079c159c60 legacy=0x7f079c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:17.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a2279700 1 -- 172.21.15.46:0/3231848912 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c15e140 con 0x7f079c159890 2023-10-07T09:00:17.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a2279700 1 --2- 172.21.15.46:0/3231848912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c15abd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f079c06a890 tx=0x7f0798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72493149fd62dadd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a1277700 1 -- 172.21.15.46:0/3231848912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800b820 con 0x7f079c159890 2023-10-07T09:00:17.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a1277700 1 -- 172.21.15.46:0/3231848912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800b980 con 0x7f079c159890 2023-10-07T09:00:17.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a1277700 1 -- 172.21.15.46:0/3231848912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800bd20 con 0x7f079c159890 2023-10-07T09:00:17.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a44dd700 1 -- 172.21.15.46:0/3231848912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 msgr2=0x7f079c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.542+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3231848912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c15abd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f079c06a890 tx=0x7f0798009250 comp rx=0 tx=0).stop 2023-10-07T09:00:17.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 -- 172.21.15.46:0/3231848912 shutdown_connections 2023-10-07T09:00:17.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3231848912 >> v2:172.21.15.133:3300/0 conn(0x7f079c069560 0x7f079c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3231848912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c15abd0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 -- 172.21.15.46:0/3231848912 >> 172.21.15.46:0/3231848912 conn(0x7f079c068e20 msgr2=0x7f079c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 -- 172.21.15.46:0/3231848912 shutdown_connections 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.543+0000 7f07a44dd700 1 -- 172.21.15.46:0/3231848912 wait complete. 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 Processor -- start 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 -- start start 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f079c069560 0x7f079c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f079c159c60 0x7f079c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c14d920 con 0x7f079c159890 2023-10-07T09:00:17.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0cf9c0 con 0x7f079c069560 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a44dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c155a30 con 0x7f079c159c60 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.544+0000 7f07a1a78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42346/0 (socket says 172.21.15.46:42346) 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 -- 172.21.15.46:0/3973691147 learned_addr learned my addr 172.21.15.46:0/3973691147 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a2a7a700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f079c159c60 0x7f079c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a2279700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f079c069560 0x7f079c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 -- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f079c159c60 msgr2=0x7f079c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f079c159c60 0x7f079c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 -- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f079c069560 msgr2=0x7f079c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f079c069560 0x7f079c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 -- 172.21.15.46:0/3973691147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07980094f0 con 0x7f079c159890 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a1a78700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f078c00b5e0 tx=0x7f078c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00f510 con 0x7f079c159890 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c00f690 con 0x7f079c159890 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c0b5070 con 0x7f079c159890 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00fa50 con 0x7f079c159890 2023-10-07T09:00:17.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.545+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c0b5630 con 0x7f079c159890 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.546+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c155be0 con 0x7f079c159890 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.546+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f078c01a400 con 0x7f079c159890 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.547+0000 7f07927fc700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 0x7f0780069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.547+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f078c083ec0 con 0x7f079c159890 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.547+0000 7f07a2279700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 0x7f0780069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.547+0000 7f07a2279700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 0x7f0780069470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f079c06a890 tx=0x7f0798016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.551+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f079c155be0 con 0x7f079c159890 2023-10-07T09:00:17.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.742+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f079c155ba0 con 0x7f079c159890 2023-10-07T09:00:17.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.743+0000 7f07927fc700 1 -- 172.21.15.46:0/3973691147 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f078c0511c0 con 0x7f079c159890 2023-10-07T09:00:17.745 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 msgr2=0x7f0780069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 0x7f0780069470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f079c06a890 tx=0x7f0798016000 comp rx=0 tx=0).stop 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 msgr2=0x7f079c14d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f078c00b5e0 tx=0x7f078c0090f0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 shutdown_connections 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0780066fc0 0x7f0780069470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f079c159c60 0x7f079c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f079c069560 0x7f079c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 --2- 172.21.15.46:0/3973691147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f079c159890 0x7f079c14d3e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 >> 172.21.15.46:0/3973691147 conn(0x7f079c068e20 msgr2=0x7f079c1585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 shutdown_connections 2023-10-07T09:00:17.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.745+0000 7f07a44dd700 1 -- 172.21.15.46:0/3973691147 wait complete. 2023-10-07T09:00:17.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:00:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.879+0000 7f55f84db700 1 Processor -- start 2023-10-07T09:00:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.879+0000 7f55f84db700 1 -- start start 2023-10-07T09:00:17.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f84db700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f0141500 0x7f55f00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f84db700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f006c0a0 0x7f55f00c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f84db700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f015c2a0 con 0x7f55f006bcd0 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f84db700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00c9880 con 0x7f55f006c0a0 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f84db700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f015b690 con 0x7f55f0141500 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f6a78700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f006c0a0 0x7f55f00c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f6277700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f55f006bcd0 0x7f55f0140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52814/0 (socket says 172.21.15.46:52814) 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.880+0000 7f55f6277700 1 -- 172.21.15.46:0/1151900762 learned_addr learned my addr 172.21.15.46:0/1151900762 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f5a76700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f0141500 0x7f55f00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f6a78700 1 -- 172.21.15.46:0/1151900762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f0141500 msgr2=0x7f55f00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f6a78700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f0141500 0x7f55f00c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f6a78700 1 -- 172.21.15.46:0/1151900762 >> v1:172.21.15.46:6789/0 conn(0x7f55f006bcd0 legacy=0x7f55f0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f6a78700 1 -- 172.21.15.46:0/1151900762 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f015b970 con 0x7f55f006c0a0 2023-10-07T09:00:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f5275700 1 -- 172.21.15.46:0/1151900762 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326519415 0 0) 0x7f55f015c2a0 con 0x7f55f006bcd0 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f6a78700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f006c0a0 0x7f55f00c9340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009e60 tx=0x7f55e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514001273d18e5dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f5275700 1 -- 172.21.15.46:0/1151900762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800e070 con 0x7f55f006c0a0 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f5275700 1 -- 172.21.15.46:0/1151900762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800bc30 con 0x7f55f006c0a0 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.881+0000 7f55f5275700 1 -- 172.21.15.46:0/1151900762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8012430 con 0x7f55f006c0a0 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 -- 172.21.15.46:0/1151900762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f006c0a0 msgr2=0x7f55f00c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f006c0a0 0x7f55f00c9340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009e60 tx=0x7f55e8009780 comp rx=0 tx=0).stop 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 -- 172.21.15.46:0/1151900762 shutdown_connections 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f006c0a0 0x7f55f00c9340 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 --2- 172.21.15.46:0/1151900762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f0141500 0x7f55f00c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 -- 172.21.15.46:0/1151900762 >> 172.21.15.46:0/1151900762 conn(0x7f55f00ce600 msgr2=0x7f55f00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 -- 172.21.15.46:0/1151900762 shutdown_connections 2023-10-07T09:00:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.882+0000 7f55f84db700 1 -- 172.21.15.46:0/1151900762 wait complete. 2023-10-07T09:00:17.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.883+0000 7f55f84db700 1 Processor -- start 2023-10-07T09:00:17.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.883+0000 7f55f84db700 1 -- start start 2023-10-07T09:00:17.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.883+0000 7f55f84db700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 0x7f55f006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.883+0000 7f55f84db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f006c0a0 0x7f55f013f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f006aa40 con 0x7f55f0141500 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f013fa30 con 0x7f55f006c0a0 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00699a0 con 0x7f55f006bcd0 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42370/0 (socket says 172.21.15.46:42370) 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 -- 172.21.15.46:0/4024561220 learned_addr learned my addr 172.21.15.46:0/4024561220 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f5a76700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f006c0a0 0x7f55f013f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6277700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 0x7f55f006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 -- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 msgr2=0x7f55f006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 0x7f55f006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 -- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f006c0a0 msgr2=0x7f55f013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:17.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f006c0a0 0x7f55f013f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 -- 172.21.15.46:0/4024561220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009a20 con 0x7f55f0141500 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6277700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 0x7f55f006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f6a78700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013000 tx=0x7f55e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e801d630 con 0x7f55f0141500 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e801d790 con 0x7f55f0141500 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0069c80 con 0x7f55f0141500 2023-10-07T09:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e801db50 con 0x7f55f0141500 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.884+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f006a240 con 0x7f55f0141500 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.885+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00c6240 con 0x7f55f0141500 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.886+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f55e8024070 con 0x7f55f0141500 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.886+0000 7f55e67fc700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 0x7f55d4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.886+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55e8086db0 con 0x7f55f0141500 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.886+0000 7f55f6277700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 0x7f55d4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:17.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.887+0000 7f55f6277700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 0x7f55d4069470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0018d0 tx=0x7f55ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:17.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:17.890+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55f00c6240 con 0x7f55f0141500 2023-10-07T09:00:18.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.085+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55f00c6240 con 0x7f55f0141500 2023-10-07T09:00:18.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.085+0000 7f55e67fc700 1 -- 172.21.15.46:0/4024561220 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55f00c6240 con 0x7f55f0141500 2023-10-07T09:00:18.087 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:00:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 msgr2=0x7f55d4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 0x7f55d4069470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0018d0 tx=0x7f55ec009040 comp rx=0 tx=0).stop 2023-10-07T09:00:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 msgr2=0x7f55f00b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013000 tx=0x7f55e8019000 comp rx=0 tx=0).stop 2023-10-07T09:00:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 shutdown_connections 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f55d4066fc0 0x7f55d4069470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f0141500 0x7f55f00b34f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55f006bcd0 0x7f55f006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 --2- 172.21.15.46:0/4024561220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f006c0a0 0x7f55f013f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 >> 172.21.15.46:0/4024561220 conn(0x7f55f00ce600 msgr2=0x7f55f00c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 shutdown_connections 2023-10-07T09:00:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.087+0000 7f55f84db700 1 -- 172.21.15.46:0/4024561220 wait complete. 2023-10-07T09:00:18.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:00:18.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.221+0000 7f34a3cda700 1 Processor -- start 2023-10-07T09:00:18.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.221+0000 7f34a3cda700 1 -- start start 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f349c159890 0x7f349c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c159c60 0x7f349c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 0x7f349c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c15a160 con 0x7f349c159890 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c0d13a0 con 0x7f349c15db10 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a3cda700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c15e140 con 0x7f349c159c60 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a1a76700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f349c159890 0x7f349c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a1a76700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f349c159890 0x7f349c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42374/0 (socket says 172.21.15.46:42374) 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.222+0000 7f34a1a76700 1 -- 172.21.15.46:0/1780244940 learned_addr learned my addr 172.21.15.46:0/1780244940 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1275700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c159c60 0x7f349c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a2277700 1 --2- 172.21.15.46:0/1780244940 >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 0x7f349c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 -- 172.21.15.46:0/1780244940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c159c60 msgr2=0x7f349c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c159c60 0x7f349c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 -- 172.21.15.46:0/1780244940 >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 msgr2=0x7f349c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 --2- 172.21.15.46:0/1780244940 >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 0x7f349c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 -- 172.21.15.46:0/1780244940 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c15a3d0 con 0x7f349c159890 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a2277700 1 --2- 172.21.15.46:0/1780244940 >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 0x7f349c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a1a76700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159890 0x7f349c15abd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f349c089b50 tx=0x7f3494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9753feffb9f0663 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a0a74700 1 -- 172.21.15.46:0/1780244940 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400b860 con 0x7f349c159890 2023-10-07T09:00:18.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a0a74700 1 -- 172.21.15.46:0/1780244940 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400b9c0 con 0x7f349c159890 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.223+0000 7f34a0a74700 1 -- 172.21.15.46:0/1780244940 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bd60 con 0x7f349c159890 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 -- 172.21.15.46:0/1780244940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159890 msgr2=0x7f349c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159890 0x7f349c15abd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f349c089b50 tx=0x7f3494009250 comp rx=0 tx=0).stop 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 -- 172.21.15.46:0/1780244940 shutdown_connections 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 --2- 172.21.15.46:0/1780244940 >> v2:172.21.15.133:3300/0 conn(0x7f349c15db10 0x7f349c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159890 0x7f349c15abd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 --2- 172.21.15.46:0/1780244940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c159c60 0x7f349c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 -- 172.21.15.46:0/1780244940 >> 172.21.15.46:0/1780244940 conn(0x7f349c068e20 msgr2=0x7f349c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 -- 172.21.15.46:0/1780244940 shutdown_connections 2023-10-07T09:00:18.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.224+0000 7f34a3cda700 1 -- 172.21.15.46:0/1780244940 wait complete. 2023-10-07T09:00:18.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.225+0000 7f34a3cda700 1 Processor -- start 2023-10-07T09:00:18.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.225+0000 7f34a3cda700 1 -- start start 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 0x7f349c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c15db10 0x7f349c152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0cff40 con 0x7f349c159c60 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b3a30 con 0x7f349c159890 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0cf980 con 0x7f349c15db10 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42384/0 (socket says 172.21.15.46:42384) 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 -- 172.21.15.46:0/2449629803 learned_addr learned my addr 172.21.15.46:0/2449629803 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a2277700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c15db10 0x7f349c152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1a76700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 0x7f349c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 -- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c15db10 msgr2=0x7f349c152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c15db10 0x7f349c152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 -- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 msgr2=0x7f349c13f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 0x7f349c13f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 -- 172.21.15.46:0/2449629803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940094f0 con 0x7f349c159c60 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1a76700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 0x7f349c13f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a1275700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f349000d890 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900125f0 con 0x7f349c159c60 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490012750 con 0x7f349c159c60 2023-10-07T09:00:18.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c0cfc60 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.226+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490012af0 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.227+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c13f610 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.228+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c0b3bc0 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.228+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f349001e460 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.228+0000 7f3499ffb700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 0x7f3488069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.228+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3490084b40 con 0x7f349c159c60 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.229+0000 7f34a1a76700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 0x7f3488069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.229+0000 7f34a1a76700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 0x7f3488069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f349c089b50 tx=0x7f3494017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.232+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3490055850 con 0x7f349c159c60 2023-10-07T09:00:18.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.424+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f349c04c3c0 con 0x7f349c159c60 2023-10-07T09:00:18.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.424+0000 7f3499ffb700 1 -- 172.21.15.46:0/2449629803 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34900553e0 con 0x7f349c159c60 2023-10-07T09:00:18.426 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:00:18.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 msgr2=0x7f3488069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 0x7f3488069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f349c089b50 tx=0x7f3494017000 comp rx=0 tx=0).stop 2023-10-07T09:00:18.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 msgr2=0x7f349c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f349000d890 tx=0x7f3490008040 comp rx=0 tx=0).stop 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 shutdown_connections 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3488066fc0 0x7f3488069470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f349c15db10 0x7f349c152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f349c159890 0x7f349c13f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 --2- 172.21.15.46:0/2449629803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349c159c60 0x7f349c1523d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 >> 172.21.15.46:0/2449629803 conn(0x7f349c068e20 msgr2=0x7f349c0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 shutdown_connections 2023-10-07T09:00:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.426+0000 7f34a3cda700 1 -- 172.21.15.46:0/2449629803 wait complete. 2023-10-07T09:00:18.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.557+0000 7f7196f06700 1 Processor -- start 2023-10-07T09:00:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.557+0000 7f7196f06700 1 -- start start 2023-10-07T09:00:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7196f06700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f719006bcd0 0x7f7190140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7196f06700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 0x7f7190141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7196f06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719015c2a0 con 0x7f719006c0a0 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7196f06700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719015b690 con 0x7f719006bcd0 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7196f06700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719015b970 con 0x7f71900c9510 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.558+0000 7f7194ca2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f719006bcd0 0x7f7190140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f719006bcd0 0x7f7190140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42388/0 (socket says 172.21.15.46:42388) 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 -- 172.21.15.46:0/1782863585 learned_addr learned my addr 172.21.15.46:0/1782863585 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f71954a3700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 0x7f7190141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 -- 172.21.15.46:0/1782863585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 msgr2=0x7f7190141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 0x7f7190141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 -- 172.21.15.46:0/1782863585 >> v1:172.21.15.133:6789/0 conn(0x7f719006c0a0 legacy=0x7f71900c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 -- 172.21.15.46:0/1782863585 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719015bc50 con 0x7f719006bcd0 2023-10-07T09:00:18.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f71954a3700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 0x7f7190141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f7194ca2700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f7190140df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7188009f20 tx=0x7f7188009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b392dde41019266 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f718f7fe700 1 -- 172.21.15.46:0/1782863585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800e070 con 0x7f719006bcd0 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f718f7fe700 1 -- 172.21.15.46:0/1782863585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800ba80 con 0x7f719006bcd0 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.559+0000 7f718f7fe700 1 -- 172.21.15.46:0/1782863585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880092e0 con 0x7f719006bcd0 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 -- 172.21.15.46:0/1782863585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 msgr2=0x7f7190140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f7190140df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7188009f20 tx=0x7f7188009840 comp rx=0 tx=0).stop 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 -- 172.21.15.46:0/1782863585 shutdown_connections 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71900c9510 0x7f7190141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 --2- 172.21.15.46:0/1782863585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f7190140df0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 -- 172.21.15.46:0/1782863585 >> 172.21.15.46:0/1782863585 conn(0x7f71900ce600 msgr2=0x7f71900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 -- 172.21.15.46:0/1782863585 shutdown_connections 2023-10-07T09:00:18.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.560+0000 7f7196f06700 1 -- 172.21.15.46:0/1782863585 wait complete. 2023-10-07T09:00:18.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.561+0000 7f7196f06700 1 Processor -- start 2023-10-07T09:00:18.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.561+0000 7f7196f06700 1 -- start start 2023-10-07T09:00:18.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719006c0a0 0x7f7190157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 0x7f719013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719013eed0 con 0x7f719006bcd0 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190157dd0 con 0x7f71900c9510 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7196f06700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719013ebf0 con 0x7f719006c0a0 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42402/0 (socket says 172.21.15.46:42402) 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 -- 172.21.15.46:0/4284750648 learned_addr learned my addr 172.21.15.46:0/4284750648 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f71954a3700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 0x7f719013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f718ffff700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719006c0a0 0x7f7190157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 -- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719006c0a0 msgr2=0x7f7190157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719006c0a0 0x7f7190157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 -- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 msgr2=0x7f719013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 0x7f719013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 -- 172.21.15.46:0/4284750648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009ae0 con 0x7f719006bcd0 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f71954a3700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 0x7f719013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.562+0000 7f7194ca2700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f718800b6c0 tx=0x7f7188018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.563+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188008bb0 con 0x7f719006bcd0 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.563+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188008d10 con 0x7f719006bcd0 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.563+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880266b0 con 0x7f719006bcd0 2023-10-07T09:00:18.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.563+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900c57e0 con 0x7f719006bcd0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.563+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71900c5da0 con 0x7f719006bcd0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.564+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719004c3c0 con 0x7f719006bcd0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.564+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7188003040 con 0x7f719006bcd0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.564+0000 7f718cff9700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 0x7f717c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.564+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7188086440 con 0x7f719006bcd0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.565+0000 7f718ffff700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 0x7f717c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.565+0000 7f718ffff700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 0x7f717c069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f719013fff0 tx=0x7f7184009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.569+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71880535b0 con 0x7f719006bcd0 2023-10-07T09:00:18.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.804+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f719006c9d0 con 0x7f719006bcd0 2023-10-07T09:00:18.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.804+0000 7f718cff9700 1 -- 172.21.15.46:0/4284750648 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f7188056bd0 con 0x7f719006bcd0 2023-10-07T09:00:18.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:18.806 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:18.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 msgr2=0x7f717c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 0x7f717c069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f719013fff0 tx=0x7f7184009040 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 msgr2=0x7f71900c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f718800b6c0 tx=0x7f7188018000 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 shutdown_connections 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f717c066fc0 0x7f717c069470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71900c9510 0x7f719013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f719006bcd0 0x7f71900c62c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 --2- 172.21.15.46:0/4284750648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719006c0a0 0x7f7190157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 >> 172.21.15.46:0/4284750648 conn(0x7f71900ce600 msgr2=0x7f71900c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 shutdown_connections 2023-10-07T09:00:18.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.806+0000 7f7196f06700 1 -- 172.21.15.46:0/4284750648 wait complete. 2023-10-07T09:00:18.810 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2023-10-07T09:00:18.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.938+0000 7fdad8478700 1 Processor -- start 2023-10-07T09:00:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.938+0000 7fdad8478700 1 -- start start 2023-10-07T09:00:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdad006bcd0 0x7fdad0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad00c8e00 0x7fdad00c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad015c2a0 con 0x7fdad00c8e00 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad015b690 con 0x7fdad006bcd0 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad8478700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad015b970 con 0x7fdad006c0a0 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.939+0000 7fdad6a15700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad00c8e00 0x7fdad00c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad00c8e00 0x7fdad00c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42408/0 (socket says 172.21.15.46:42408) 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 -- 172.21.15.46:0/1087282865 learned_addr learned my addr 172.21.15.46:0/1087282865 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad5a13700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6214700 1 --2- 172.21.15.46:0/1087282865 >> v2:172.21.15.133:3300/0 conn(0x7fdad006bcd0 0x7fdad0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 -- 172.21.15.46:0/1087282865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 msgr2=0x7fdad0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad0141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 -- 172.21.15.46:0/1087282865 >> v2:172.21.15.133:3300/0 conn(0x7fdad006bcd0 msgr2=0x7fdad0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 --2- 172.21.15.46:0/1087282865 >> v2:172.21.15.133:3300/0 conn(0x7fdad006bcd0 0x7fdad0140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 -- 172.21.15.46:0/1087282865 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad015bc50 con 0x7fdad00c8e00 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad6a15700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad00c9260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdad00cafd0 tx=0x7fdac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f072cc963ffd94a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad5212700 1 -- 172.21.15.46:0/1087282865 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800b860 con 0x7fdad00c8e00 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad5212700 1 -- 172.21.15.46:0/1087282865 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800b9c0 con 0x7fdad00c8e00 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.940+0000 7fdad5212700 1 -- 172.21.15.46:0/1087282865 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800bd60 con 0x7fdad00c8e00 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 -- 172.21.15.46:0/1087282865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 msgr2=0x7fdad00c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad00c9260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdad00cafd0 tx=0x7fdac8009250 comp rx=0 tx=0).stop 2023-10-07T09:00:18.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 -- 172.21.15.46:0/1087282865 shutdown_connections 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad00c9260 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 --2- 172.21.15.46:0/1087282865 >> v2:172.21.15.133:3300/0 conn(0x7fdad006bcd0 0x7fdad0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 --2- 172.21.15.46:0/1087282865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 -- 172.21.15.46:0/1087282865 >> 172.21.15.46:0/1087282865 conn(0x7fdad00ce600 msgr2=0x7fdad00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 -- 172.21.15.46:0/1087282865 shutdown_connections 2023-10-07T09:00:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.941+0000 7fdad8478700 1 -- 172.21.15.46:0/1087282865 wait complete. 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.942+0000 7fdad8478700 1 Processor -- start 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.942+0000 7fdad8478700 1 -- start start 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad006bcd0 0x7fdad006a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad006ae60 con 0x7fdad00c8e00 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00c5a00 con 0x7fdad006bcd0 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad006a490 con 0x7fdad006c0a0 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42418/0 (socket says 172.21.15.46:42418) 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 -- 172.21.15.46:0/2178092102 learned_addr learned my addr 172.21.15.46:0/2178092102 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad5a13700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6214700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad006bcd0 0x7fdad006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 -- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 msgr2=0x7fdad00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad00c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 -- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad006bcd0 msgr2=0x7fdad006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad006bcd0 0x7fdad006a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 -- 172.21.15.46:0/2178092102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80094f0 con 0x7fdad00c8e00 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad6a15700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdad0069220 tx=0x7fdac8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac801a700 con 0x7fdad00c8e00 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac801a860 con 0x7fdad00c8e00 2023-10-07T09:00:18.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad0069880 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac801ac20 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.943+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad0069e40 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.944+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad004c3c0 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.945+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fdac8024440 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.946+0000 7fdace7fc700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 0x7fdabc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.946+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdac8086250 con 0x7fdad00c8e00 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.946+0000 7fdad6214700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 0x7fdabc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.946+0000 7fdad6214700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 0x7fdabc069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdac000e4d0 tx=0x7fdac0007680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:18.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:18.951+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac80534d0 con 0x7fdad00c8e00 2023-10-07T09:00:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.144+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad006a5d0 con 0x7fdad00c8e00 2023-10-07T09:00:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.145+0000 7fdace7fc700 1 -- 172.21.15.46:0/2178092102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fdac8056af0 con 0x7fdad00c8e00 2023-10-07T09:00:19.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:19.147 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:01.861371+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 msgr2=0x7fdabc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 0x7fdabc069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdac000e4d0 tx=0x7fdac0007680 comp rx=0 tx=0).stop 2023-10-07T09:00:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 msgr2=0x7fdad016d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdad0069220 tx=0x7fdac8017000 comp rx=0 tx=0).stop 2023-10-07T09:00:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 shutdown_connections 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdabc066fc0 0x7fdabc069470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad00c8e00 0x7fdad016d3c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad006bcd0 0x7fdad006a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 --2- 172.21.15.46:0/2178092102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad006c0a0 0x7fdad00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 >> 172.21.15.46:0/2178092102 conn(0x7fdad00ce600 msgr2=0x7fdad0140bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 shutdown_connections 2023-10-07T09:00:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.147+0000 7fdad8478700 1 -- 172.21.15.46:0/2178092102 wait complete. 2023-10-07T09:00:19.161 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:00:19.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.278+0000 7f8fb54ae700 1 Processor -- start 2023-10-07T09:00:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.278+0000 7f8fb54ae700 1 -- start start 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fb54ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 0x7f8fb015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fb54ae700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fb0069560 0x7f8fb00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fb54ae700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb0069ee0 con 0x7f8fb0159c60 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fb54ae700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb015a160 con 0x7f8fb0069560 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fb54ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00d13a0 con 0x7f8fb0159890 2023-10-07T09:00:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fae7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8fb0159c60 0x7f8fb015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52830/0 (socket says 172.21.15.46:52830) 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8faf7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fb0069560 0x7f8fb00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fae7fc700 1 -- 172.21.15.46:0/1321913537 learned_addr learned my addr 172.21.15.46:0/1321913537 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8faeffd700 1 --2- 172.21.15.46:0/1321913537 >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 0x7f8fb015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.279+0000 7f8fadffb700 1 -- 172.21.15.46:0/1321913537 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845725461 0 0) 0x7f8fb0069ee0 con 0x7f8fb0159c60 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fadffb700 1 -- 172.21.15.46:0/1321913537 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f98003570 con 0x7f8fb0159c60 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faf7fe700 1 -- 172.21.15.46:0/1321913537 >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 msgr2=0x7f8fb015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faf7fe700 1 --2- 172.21.15.46:0/1321913537 >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 0x7f8fb015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faf7fe700 1 -- 172.21.15.46:0/1321913537 >> v1:172.21.15.46:6789/0 conn(0x7f8fb0159c60 legacy=0x7f8fb015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faf7fe700 1 -- 172.21.15.46:0/1321913537 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb015e140 con 0x7f8fb0069560 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faeffd700 1 --2- 172.21.15.46:0/1321913537 >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 0x7f8fb015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8faf7fe700 1 --2- 172.21.15.46:0/1321913537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0069560 0x7f8fb00699a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00d1090 tx=0x7f8fa8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5e679a204fcd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fadffb700 1 -- 172.21.15.46:0/1321913537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800e070 con 0x7f8fb0069560 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fadffb700 1 -- 172.21.15.46:0/1321913537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800bb60 con 0x7f8fb0069560 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fadffb700 1 -- 172.21.15.46:0/1321913537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8012430 con 0x7f8fb0069560 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fb54ae700 1 -- 172.21.15.46:0/1321913537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0069560 msgr2=0x7f8fb00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/1321913537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0069560 0x7f8fb00699a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00d1090 tx=0x7f8fa8009780 comp rx=0 tx=0).stop 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fb54ae700 1 -- 172.21.15.46:0/1321913537 shutdown_connections 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/1321913537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0069560 0x7f8fb00699a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.280+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/1321913537 >> v2:172.21.15.133:3300/0 conn(0x7f8fb0159890 0x7f8fb015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.281+0000 7f8fb54ae700 1 -- 172.21.15.46:0/1321913537 >> 172.21.15.46:0/1321913537 conn(0x7f8fb0068e20 msgr2=0x7f8fb00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:19.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.281+0000 7f8fb54ae700 1 -- 172.21.15.46:0/1321913537 shutdown_connections 2023-10-07T09:00:19.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.281+0000 7f8fb54ae700 1 -- 172.21.15.46:0/1321913537 wait complete. 2023-10-07T09:00:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.282+0000 7f8fb54ae700 1 Processor -- start 2023-10-07T09:00:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.282+0000 7f8fb54ae700 1 -- start start 2023-10-07T09:00:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fb0069560 0x7f8fb0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 0x7f8fb00b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0153970 con 0x7f8fb0159c60 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b5cc0 con 0x7f8fb0069560 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b4df0 con 0x7f8fb0159890 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42432/0 (socket says 172.21.15.46:42432) 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 -- 172.21.15.46:0/3757288343 learned_addr learned my addr 172.21.15.46:0/3757288343 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faeffd700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fb0069560 0x7f8fb0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fae7fc700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 0x7f8fb00b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 -- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 msgr2=0x7f8fb00b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 0x7f8fb00b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 -- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fb0069560 msgr2=0x7f8fb0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fb0069560 0x7f8fb0153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 -- 172.21.15.46:0/3757288343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009a20 con 0x7f8fb0159c60 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fae7fc700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 0x7f8fb00b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8faf7fe700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0070e20 tx=0x7f8fa8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8012e00 con 0x7f8fb0159c60 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa801e630 con 0x7f8fb0159c60 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb00b50b0 con 0x7f8fb0159c60 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.283+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa801e9f0 con 0x7f8fb0159c60 2023-10-07T09:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.284+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb00b5670 con 0x7f8fb0159c60 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.284+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb00cd1e0 con 0x7f8fb0159c60 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.285+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8fa8024070 con 0x7f8fb0159c60 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.285+0000 7f8f96ffd700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 0x7f8f9c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.285+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fa8086cb0 con 0x7f8fb0159c60 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.285+0000 7f8faeffd700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 0x7f8f9c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.286+0000 7f8faeffd700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 0x7f8f9c069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006f00 tx=0x7f8fa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.290+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fa8053f30 con 0x7f8fb0159c60 2023-10-07T09:00:19.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.525+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb004c3c0 con 0x7f8fb0159c60 2023-10-07T09:00:19.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.526+0000 7f8f96ffd700 1 -- 172.21.15.46:0/3757288343 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8fa8057550 con 0x7f8fb0159c60 2023-10-07T09:00:19.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:19.528 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 msgr2=0x7f8f9c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 0x7f8f9c069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006f00 tx=0x7f8fa0008040 comp rx=0 tx=0).stop 2023-10-07T09:00:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 msgr2=0x7f8fb01577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0070e20 tx=0x7f8fa8019000 comp rx=0 tx=0).stop 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 shutdown_connections 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f9c066fc0 0x7f8f9c069470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fb0159c60 0x7f8fb01577a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fb0069560 0x7f8fb0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 --2- 172.21.15.46:0/3757288343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8fb0159890 0x7f8fb00b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 >> 172.21.15.46:0/3757288343 conn(0x7f8fb0068e20 msgr2=0x7f8fb0155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:19.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 shutdown_connections 2023-10-07T09:00:19.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.528+0000 7f8fb54ae700 1 -- 172.21.15.46:0/3757288343 wait complete. 2023-10-07T09:00:19.535 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2023-10-07T09:00:19.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:19.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.659+0000 7f427d9fc700 1 Processor -- start 2023-10-07T09:00:19.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.659+0000 7f427d9fc700 1 -- start start 2023-10-07T09:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f427d9fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42781594d0 0x7f42780cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f427d9fc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780d01f0 con 0x7f42780b5fb0 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f427d9fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780cf5e0 con 0x7f4278159fb0 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f427d9fc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780cf8c0 con 0x7f42781594d0 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f4276ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42781594d0 0x7f42780cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f42767fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f42780b5fb0 0x7f42781598a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35672/0 (socket says 172.21.15.46:35672) 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f42767fc700 1 -- 172.21.15.46:0/3625386934 learned_addr learned my addr 172.21.15.46:0/3625386934 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f4276ffd700 1 -- 172.21.15.46:0/3625386934 >> v1:172.21.15.133:6789/0 conn(0x7f4278159fb0 legacy=0x7f42780b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f4276ffd700 1 -- 172.21.15.46:0/3625386934 >> v1:172.21.15.46:6789/0 conn(0x7f42780b5fb0 legacy=0x7f42781598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.660+0000 7f4275ffb700 1 -- 172.21.15.46:0/3625386934 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246610656 0 0) 0x7f42780d01f0 con 0x7f42780b5fb0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f4276ffd700 1 -- 172.21.15.46:0/3625386934 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780cfba0 con 0x7f42781594d0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f4276ffd700 1 --2- 172.21.15.46:0/3625386934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42781594d0 0x7f42780cd0f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e60 tx=0x7f4268009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46dfc97d01046bd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f4275ffb700 1 -- 172.21.15.46:0/3625386934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800e070 con 0x7f42781594d0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f4275ffb700 1 -- 172.21.15.46:0/3625386934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800bbf0 con 0x7f42781594d0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f4275ffb700 1 -- 172.21.15.46:0/3625386934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268012430 con 0x7f42781594d0 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 -- 172.21.15.46:0/3625386934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42781594d0 msgr2=0x7f42780cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 --2- 172.21.15.46:0/3625386934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42781594d0 0x7f42780cd0f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e60 tx=0x7f4268009780 comp rx=0 tx=0).stop 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 -- 172.21.15.46:0/3625386934 shutdown_connections 2023-10-07T09:00:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 --2- 172.21.15.46:0/3625386934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42781594d0 0x7f42780cd0f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 -- 172.21.15.46:0/3625386934 >> 172.21.15.46:0/3625386934 conn(0x7f42780d05f0 msgr2=0x7f42780d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:19.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 -- 172.21.15.46:0/3625386934 shutdown_connections 2023-10-07T09:00:19.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.661+0000 7f427d9fc700 1 -- 172.21.15.46:0/3625386934 wait complete. 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 Processor -- start 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 -- start start 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 0x7f42780b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 0x7f427816d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.663+0000 7f427d9fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278156820 con 0x7f42780b5fb0 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f427d9fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278169c30 con 0x7f42781594d0 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f427d9fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427816dd00 con 0x7f4278159fb0 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46220/0 (socket says 172.21.15.46:46220) 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 -- 172.21.15.46:0/27173897 learned_addr learned my addr 172.21.15.46:0/27173897 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 -- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 msgr2=0x7f427816d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f42777fe700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 0x7f427816d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f42767fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 0x7f42780b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 0x7f427816d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 -- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 msgr2=0x7f42780b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 0x7f42780b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 -- 172.21.15.46:0/27173897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009a20 con 0x7f42780b5fb0 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f42777fe700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 0x7f427816d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:19.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f42767fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 0x7f42780b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f4276ffd700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f426800b6c0 tx=0x7f4268018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268012e80 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426801e640 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4278169ed0 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426801e9e0 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.664+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427816dfe0 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.665+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427816a3f0 con 0x7f42780b5fb0 2023-10-07T09:00:19.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.666+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4268024070 con 0x7f42780b5fb0 2023-10-07T09:00:19.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.666+0000 7f426effd700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 0x7f4258069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:19.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.666+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4268086ee0 con 0x7f42780b5fb0 2023-10-07T09:00:19.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.666+0000 7f42767fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 0x7f4258069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:19.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.667+0000 7f42767fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 0x7f4258069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f427816d080 tx=0x7f4260009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:19.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.670+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f427816a3f0 con 0x7f42780b5fb0 2023-10-07T09:00:19.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.911+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f427804c3c0 con 0x7f42780b5fb0 2023-10-07T09:00:19.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.912+0000 7f426effd700 1 -- 172.21.15.46:0/27173897 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f4268054210 con 0x7f42780b5fb0 2023-10-07T09:00:19.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:19.914 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:00.266223+0000","modified":"2023-10-07T09:00:03.889584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2348769252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2348769252},{"type":"v1","addr":"172.21.15.133:6837","nonce":2348769252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T09:00:19.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 msgr2=0x7f4258069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 0x7f4258069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f427816d080 tx=0x7f4260009040 comp rx=0 tx=0).stop 2023-10-07T09:00:19.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 msgr2=0x7f427816a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f426800b6c0 tx=0x7f4268018000 comp rx=0 tx=0).stop 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 shutdown_connections 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4258066fc0 0x7f4258069470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4278159fb0 0x7f427816d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42780b5fb0 0x7f427816a6d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 --2- 172.21.15.46:0/27173897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42781594d0 0x7f42780b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 >> 172.21.15.46:0/27173897 conn(0x7f42780d05f0 msgr2=0x7f4278158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 shutdown_connections 2023-10-07T09:00:19.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:19.914+0000 7f427d9fc700 1 -- 172.21.15.46:0/27173897 wait complete. 2023-10-07T09:00:19.918 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2023-10-07T09:00:19.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:20.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.046+0000 7f4d687eb700 1 Processor -- start 2023-10-07T09:00:20.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.046+0000 7f4d687eb700 1 -- start start 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d687eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d6006f810 0x7f4d601649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d687eb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6006ec70 con 0x7f4d60068920 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d687eb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600b2e70 con 0x7f4d60068550 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d687eb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60068d90 con 0x7f4d6006f810 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d65d86700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4d60068920 0x7f4d6006f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35678/0 (socket says 172.21.15.46:35678) 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d65d86700 1 -- 172.21.15.46:0/2739579822 learned_addr learned my addr 172.21.15.46:0/2739579822 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.047+0000 7f4d66d88700 1 --2- 172.21.15.46:0/2739579822 >> v2:172.21.15.133:3300/0 conn(0x7f4d6006f810 0x7f4d601649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262600994 0 0) 0x7f4d6006ec70 con 0x7f4d60068920 2023-10-07T09:00:20.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d48003570 con 0x7f4d60068920 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325468747 0 0) 0x7f4d600b2e70 con 0x7f4d60068550 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6006ec70 con 0x7f4d60068550 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515055574 0 0) 0x7f4d48003570 con 0x7f4d60068920 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 >> v2:172.21.15.133:3300/0 conn(0x7f4d6006f810 msgr2=0x7f4d601649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 --2- 172.21.15.46:0/2739579822 >> v2:172.21.15.133:3300/0 conn(0x7f4d6006f810 0x7f4d601649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 >> v1:172.21.15.133:6789/0 conn(0x7f4d60068550 legacy=0x7f4d6015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600b3150 con 0x7f4d60068920 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4d54001470 con 0x7f4d60068920 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d66d88700 1 --2- 172.21.15.46:0/2739579822 >> v2:172.21.15.133:3300/0 conn(0x7f4d6006f810 0x7f4d601649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 >> v1:172.21.15.46:6789/0 conn(0x7f4d60068920 legacy=0x7f4d6006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 0x7f4d48003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48004810 0x7f4d48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d480051c0 0x7f4d4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60068d90 con 0x7f4d48003bf0 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4800c160 con 0x7f4d48004810 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4800c320 con 0x7f4d480051c0 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d66587700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 0x7f4d48003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d65d86700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48004810 0x7f4d48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.048+0000 7f4d66d88700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d480051c0 0x7f4d4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 -- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d480051c0 msgr2=0x7f4d4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d480051c0 0x7f4d4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 -- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48004810 msgr2=0x7f4d48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48004810 0x7f4d48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 -- 172.21.15.46:0/2739579822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48003570 con 0x7f4d48003bf0 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66d88700 1 -- 172.21.15.46:0/2739579822 reap_dead start 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d66587700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 0x7f4d48003fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4d500020f0 tx=0x7f4d500017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b650a773f91a1cd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000c8b0 con 0x7f4d48003bf0 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000ca10 con 0x7f4d48003bf0 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d65585700 1 -- 172.21.15.46:0/2739579822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000cdd0 con 0x7f4d48003bf0 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 -- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 msgr2=0x7f4d48003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 0x7f4d48003fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4d500020f0 tx=0x7f4d500017a0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 -- 172.21.15.46:0/2739579822 shutdown_connections 2023-10-07T09:00:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 --2- 172.21.15.46:0/2739579822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d48003bf0 0x7f4d48003fe0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 -- 172.21.15.46:0/2739579822 >> 172.21.15.46:0/2739579822 conn(0x7f4d600cd480 msgr2=0x7f4d600cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:20.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 -- 172.21.15.46:0/2739579822 shutdown_connections 2023-10-07T09:00:20.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.049+0000 7f4d687eb700 1 -- 172.21.15.46:0/2739579822 wait complete. 2023-10-07T09:00:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 Processor -- start 2023-10-07T09:00:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 -- start start 2023-10-07T09:00:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48003bf0 0x7f4d6014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d60169920 0x7f4d60150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6016a930 con 0x7f4d6016aaf0 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6014ed80 con 0x7f4d48003bf0 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d687eb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601514c0 con 0x7f4d60169920 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d66d88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d66d88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46234/0 (socket says 172.21.15.46:46234) 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.051+0000 7f4d66d88700 1 -- 172.21.15.46:0/1079856285 learned_addr learned my addr 172.21.15.46:0/1079856285 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66587700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48003bf0 0x7f4d6014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d65d86700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d60169920 0x7f4d60150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 -- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d60169920 msgr2=0x7f4d60150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d60169920 0x7f4d60150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 -- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48003bf0 msgr2=0x7f4d6014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48003bf0 0x7f4d6014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 -- 172.21.15.46:0/1079856285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6016a090 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d66d88700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d58006f00 tx=0x7f4d580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800f8e0 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5800fa60 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6016a370 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800fe20 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.052+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d60169d90 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.053+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6014eb50 con 0x7f4d6016aaf0 2023-10-07T09:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.053+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4d58014650 con 0x7f4d6016aaf0 2023-10-07T09:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.054+0000 7f4d5e7fc700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 0x7f4d4c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.054+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d58084b30 con 0x7f4d6016aaf0 2023-10-07T09:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.054+0000 7f4d66587700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 0x7f4d4c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.055+0000 7f4d66587700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 0x7f4d4c069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000f80 tx=0x7f4d50016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.058+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d6014eb50 con 0x7f4d6016aaf0 2023-10-07T09:00:20.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.254+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d6014eb50 con 0x7f4d6016aaf0 2023-10-07T09:00:20.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.254+0000 7f4d5e7fc700 1 -- 172.21.15.46:0/1079856285 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4d6014eb50 con 0x7f4d6016aaf0 2023-10-07T09:00:20.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:20.257 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:01.861371+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:59:58.657442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:59:59.232425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 msgr2=0x7f4d4c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 0x7f4d4c069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000f80 tx=0x7f4d50016000 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 msgr2=0x7f4d6014a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d58006f00 tx=0x7f4d580091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 shutdown_connections 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d4c066fc0 0x7f4d4c069470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6016aaf0 0x7f4d6014a940 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d48003bf0 0x7f4d6014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 --2- 172.21.15.46:0/1079856285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d60169920 0x7f4d60150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 >> 172.21.15.46:0/1079856285 conn(0x7f4d600cd480 msgr2=0x7f4d60158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:20.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 shutdown_connections 2023-10-07T09:00:20.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.257+0000 7f4d687eb700 1 -- 172.21.15.46:0/1079856285 wait complete. 2023-10-07T09:00:20.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:00:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.389+0000 7f8f3d6f5700 1 Processor -- start 2023-10-07T09:00:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.389+0000 7f8f3d6f5700 1 -- start start 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f3d6f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f3d6f5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f3815db10 0x7f8f38069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f3d6f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3815a160 con 0x7f8f38159890 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f3d6f5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f380d13a0 con 0x7f8f3815db10 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f3d6f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3815e140 con 0x7f8f38159c60 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f36ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8f38159890 0x7f8f3815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35692/0 (socket says 172.21.15.46:35692) 2023-10-07T09:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f377fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f3815db10 0x7f8f38069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f36ffd700 1 -- 172.21.15.46:0/2263567089 learned_addr learned my addr 172.21.15.46:0/2263567089 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.390+0000 7f8f35ffb700 1 -- 172.21.15.46:0/2263567089 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594958129 0 0) 0x7f8f3815a160 con 0x7f8f38159890 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f35ffb700 1 -- 172.21.15.46:0/2263567089 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f24003570 con 0x7f8f38159890 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f377fe700 1 -- 172.21.15.46:0/2263567089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 msgr2=0x7f8f3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f367fc700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f377fe700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f3815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f377fe700 1 -- 172.21.15.46:0/2263567089 >> v1:172.21.15.46:6789/0 conn(0x7f8f38159890 legacy=0x7f8f3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f377fe700 1 -- 172.21.15.46:0/2263567089 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3815a3d0 con 0x7f8f3815db10 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f367fc700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f377fe700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f3815db10 0x7f8f38069560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e60 tx=0x7f8f28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644805635794e6b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f35ffb700 1 -- 172.21.15.46:0/2263567089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800e070 con 0x7f8f3815db10 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f35ffb700 1 -- 172.21.15.46:0/2263567089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800bb60 con 0x7f8f3815db10 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f35ffb700 1 -- 172.21.15.46:0/2263567089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28012430 con 0x7f8f3815db10 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/2263567089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f3815db10 msgr2=0x7f8f38069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.391+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f3815db10 0x7f8f38069560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e60 tx=0x7f8f28009780 comp rx=0 tx=0).stop 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/2263567089 shutdown_connections 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f3815db10 0x7f8f38069560 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/2263567089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/2263567089 >> 172.21.15.46:0/2263567089 conn(0x7f8f38068e20 msgr2=0x7f8f380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/2263567089 shutdown_connections 2023-10-07T09:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.392+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/2263567089 wait complete. 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.393+0000 7f8f3d6f5700 1 Processor -- start 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.393+0000 7f8f3d6f5700 1 -- start start 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f380cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f3815db10 0x7f8f3815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cff40 con 0x7f8f38159890 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b3ff0 con 0x7f8f3815db10 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b36c0 con 0x7f8f38159c60 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46244/0 (socket says 172.21.15.46:46244) 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 -- 172.21.15.46:0/81314973 learned_addr learned my addr 172.21.15.46:0/81314973 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f377fe700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f3815db10 0x7f8f3815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f367fc700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f380cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 -- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 msgr2=0x7f8f380cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f380cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 -- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f3815db10 msgr2=0x7f8f3815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f3815db10 0x7f8f3815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 -- 172.21.15.46:0/81314973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009a20 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f36ffd700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8f300011e0 tx=0x7f8f30007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30005b30 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30005c90 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380b39a0 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300072e0 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.394+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380c7de0 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.395+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3804c3c0 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.396+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8f30007650 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.396+0000 7f8f2effd700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 0x7f8f18069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.396+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f30083a30 con 0x7f8f38159890 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.396+0000 7f8f367fc700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 0x7f8f18069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.397+0000 7f8f367fc700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 0x7f8f18069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f3816cbb0 tx=0x7f8f20006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.400+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f30050d60 con 0x7f8f38159890 2023-10-07T09:00:20.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.636+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8f3815b0c0 con 0x7f8f38159890 2023-10-07T09:00:20.638 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:00:20.636+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:00:20.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.640+0000 7f8f2effd700 1 -- 172.21.15.46:0/81314973 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8f30017020 con 0x7f8f38159890 2023-10-07T09:00:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 msgr2=0x7f8f18069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 0x7f8f18069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f3816cbb0 tx=0x7f8f20006f90 comp rx=0 tx=0).stop 2023-10-07T09:00:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 msgr2=0x7f8f380c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8f300011e0 tx=0x7f8f30007df0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 shutdown_connections 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18066fc0 0x7f8f18069470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f3815db10 0x7f8f3815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f38159890 0x7f8f380c78a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 --2- 172.21.15.46:0/81314973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f38159c60 0x7f8f380cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 >> 172.21.15.46:0/81314973 conn(0x7f8f38068e20 msgr2=0x7f8f380c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 shutdown_connections 2023-10-07T09:00:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.642+0000 7f8f3d6f5700 1 -- 172.21.15.46:0/81314973 wait complete. 2023-10-07T09:00:20.646 INFO:tasks.ceph.mds.d.smithi133.stderr: -1878> 2023-10-07T09:00:06.200+0000 7fd5a1be2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:00:20.646 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:00:20.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:00:20.669 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:00:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.775+0000 7f9a0630e700 1 Processor -- start 2023-10-07T09:00:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.775+0000 7f9a0630e700 1 -- start start 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a0630e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a000c70b0 0x7f9a00069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a0630e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a00069cb0 0x7f9a000ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a0630e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0006e950 con 0x7f9a00155eb0 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a0630e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0006a130 con 0x7f9a00069cb0 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a0630e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0006eb90 con 0x7f9a000c70b0 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f99fffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a00155eb0 0x7f9a0006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35706/0 (socket says 172.21.15.46:35706) 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f99fffff700 1 -- 172.21.15.46:0/291324939 learned_addr learned my addr 172.21.15.46:0/291324939 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.776+0000 7f9a048ab700 1 --2- 172.21.15.46:0/291324939 >> v2:172.21.15.46:3300/0 conn(0x7f9a00069cb0 0x7f9a000ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99ff7fe700 1 --2- 172.21.15.46:0/291324939 >> v2:172.21.15.133:3300/0 conn(0x7f9a000c70b0 0x7f9a00069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99feffd700 1 -- 172.21.15.46:0/291324939 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561806657 0 0) 0x7f99f0001110 con 0x7f9a00155eb0 2023-10-07T09:00:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99feffd700 1 -- 172.21.15.46:0/291324939 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e8004680 con 0x7f9a00155eb0 2023-10-07T09:00:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f9a048ab700 1 -- 172.21.15.46:0/291324939 >> v2:172.21.15.133:3300/0 conn(0x7f9a000c70b0 msgr2=0x7f9a00069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f9a048ab700 1 --2- 172.21.15.46:0/291324939 >> v2:172.21.15.133:3300/0 conn(0x7f9a000c70b0 0x7f9a00069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f9a048ab700 1 -- 172.21.15.46:0/291324939 >> v1:172.21.15.46:6789/0 conn(0x7f9a00155eb0 legacy=0x7f9a0006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f9a048ab700 1 -- 172.21.15.46:0/291324939 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0006ee70 con 0x7f9a00069cb0 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f9a048ab700 1 --2- 172.21.15.46:0/291324939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a00069cb0 0x7f9a000ca4c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9a00065130 tx=0x7f99f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5d7d0d8004ce98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99feffd700 1 -- 172.21.15.46:0/291324939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800e070 con 0x7f9a00069cb0 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99feffd700 1 -- 172.21.15.46:0/291324939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800bab0 con 0x7f9a00069cb0 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.777+0000 7f99feffd700 1 -- 172.21.15.46:0/291324939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800be30 con 0x7f9a00069cb0 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 -- 172.21.15.46:0/291324939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a00069cb0 msgr2=0x7f9a000ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 --2- 172.21.15.46:0/291324939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a00069cb0 0x7f9a000ca4c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9a00065130 tx=0x7f99f8009780 comp rx=0 tx=0).stop 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 -- 172.21.15.46:0/291324939 shutdown_connections 2023-10-07T09:00:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 --2- 172.21.15.46:0/291324939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a00069cb0 0x7f9a000ca4c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 --2- 172.21.15.46:0/291324939 >> v2:172.21.15.133:3300/0 conn(0x7f9a000c70b0 0x7f9a00069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 -- 172.21.15.46:0/291324939 >> 172.21.15.46:0/291324939 conn(0x7f9a00068e10 msgr2=0x7f9a000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:20.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 -- 172.21.15.46:0/291324939 shutdown_connections 2023-10-07T09:00:20.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.778+0000 7f9a0630e700 1 -- 172.21.15.46:0/291324939 wait complete. 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.779+0000 7f9a0630e700 1 Processor -- start 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.779+0000 7f9a0630e700 1 -- start start 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 0x7f9a00168300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 0x7f9a000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0013cdc0 con 0x7f9a000c70b0 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0016ab50 con 0x7f9a00069cb0 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a0630e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00151660 con 0x7f9a00155eb0 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46258/0 (socket says 172.21.15.46:46258) 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 -- 172.21.15.46:0/1034136635 learned_addr learned my addr 172.21.15.46:0/1034136635 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:20.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a048ab700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 0x7f9a000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99fffff700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 0x7f9a00168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 -- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 msgr2=0x7f9a000cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 0x7f9a000cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 -- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 msgr2=0x7f9a00168300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 0x7f9a00168300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 -- 172.21.15.46:0/1034136635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009a20 con 0x7f9a000c70b0 2023-10-07T09:00:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f9a048ab700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 0x7f9a000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99fffff700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 0x7f9a00168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.780+0000 7f99ff7fe700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f99f400ec80 tx=0x7f99f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.781+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400c9d0 con 0x7f9a000c70b0 2023-10-07T09:00:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.781+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400cb30 con 0x7f9a000c70b0 2023-10-07T09:00:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.781+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a001519a0 con 0x7f9a000c70b0 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.781+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4013470 con 0x7f9a000c70b0 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.781+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a001521e0 con 0x7f9a000c70b0 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.782+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0004c3c0 con 0x7f9a000c70b0 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.782+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f99f4013820 con 0x7f9a000c70b0 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.782+0000 7f99e7fff700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 0x7f99ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.783+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f99f4084990 con 0x7f9a000c70b0 2023-10-07T09:00:20.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.783+0000 7f99fffff700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 0x7f99ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:20.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.783+0000 7f99fffff700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 0x7f99ec069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f99f0001270 tx=0x7f99f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:20.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:20.787+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f4051bc0 con 0x7f9a000c70b0 2023-10-07T09:00:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.028+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a0006f150 con 0x7f9a000c70b0 2023-10-07T09:00:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.641+0000 7f99e7fff700 1 -- 172.21.15.46:0/1034136635 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f99f40551e0 con 0x7f9a000c70b0 2023-10-07T09:00:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 msgr2=0x7f99ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 0x7f99ec069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f99f0001270 tx=0x7f99f0009040 comp rx=0 tx=0).stop 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 msgr2=0x7f9a00150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f99f400ec80 tx=0x7f99f40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 shutdown_connections 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99ec066fc0 0x7f99ec069470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a00155eb0 0x7f9a000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00069cb0 0x7f9a00168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 --2- 172.21.15.46:0/1034136635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a000c70b0 0x7f9a00150d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 >> 172.21.15.46:0/1034136635 conn(0x7f9a00068e10 msgr2=0x7f9a000b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 shutdown_connections 2023-10-07T09:00:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.643+0000 7f9a0630e700 1 -- 172.21.15.46:0/1034136635 wait complete. 2023-10-07T09:00:21.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:00:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.783+0000 7f2f8945f700 1 Processor -- start 2023-10-07T09:00:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.783+0000 7f2f8945f700 1 -- start start 2023-10-07T09:00:21.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f8945f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f84159ec0 0x7f2f840b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f8945f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2f840cf350 0x7f2f840cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f8945f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840b5b00 con 0x7f2f840b53d0 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f8945f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840b5850 con 0x7f2f840cf350 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f8945f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840b5da0 con 0x7f2f84159ec0 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2f840cf350 0x7f2f840cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f827fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2f840b53d0 0x7f2f840cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35714/0 (socket says 172.21.15.46:35714) 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2f840cf350 0x7f2f840cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46266/0 (socket says 172.21.15.46:46266) 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f827fc700 1 -- 172.21.15.46:0/4291167330 learned_addr learned my addr 172.21.15.46:0/4291167330 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f82ffd700 1 --2- 172.21.15.46:0/4291167330 >> v2:172.21.15.133:3300/0 conn(0x7f2f84159ec0 0x7f2f840b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 -- 172.21.15.46:0/4291167330 >> v2:172.21.15.133:3300/0 conn(0x7f2f84159ec0 msgr2=0x7f2f840b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 --2- 172.21.15.46:0/4291167330 >> v2:172.21.15.133:3300/0 conn(0x7f2f84159ec0 0x7f2f840b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 -- 172.21.15.46:0/4291167330 >> v1:172.21.15.46:6789/0 conn(0x7f2f840b53d0 legacy=0x7f2f840cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f837fe700 1 -- 172.21.15.46:0/4291167330 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840b6080 con 0x7f2f840cf350 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.784+0000 7f2f81ffb700 1 -- 172.21.15.46:0/4291167330 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446661921 0 0) 0x7f2f840b5b00 con 0x7f2f840b53d0 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f837fe700 1 --2- 172.21.15.46:0/4291167330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840cf350 0x7f2f840cd010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2f84089120 tx=0x7f2f7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49e2856445f0507 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f81ffb700 1 -- 172.21.15.46:0/4291167330 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00e070 con 0x7f2f840cf350 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f81ffb700 1 -- 172.21.15.46:0/4291167330 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00bb60 con 0x7f2f840cf350 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f81ffb700 1 -- 172.21.15.46:0/4291167330 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c012430 con 0x7f2f840cf350 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 -- 172.21.15.46:0/4291167330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840cf350 msgr2=0x7f2f840cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4291167330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840cf350 0x7f2f840cd010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2f84089120 tx=0x7f2f7c009780 comp rx=0 tx=0).stop 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 -- 172.21.15.46:0/4291167330 shutdown_connections 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4291167330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840cf350 0x7f2f840cd010 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4291167330 >> v2:172.21.15.133:3300/0 conn(0x7f2f84159ec0 0x7f2f840b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 -- 172.21.15.46:0/4291167330 >> 172.21.15.46:0/4291167330 conn(0x7f2f840999f0 msgr2=0x7f2f840b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 -- 172.21.15.46:0/4291167330 shutdown_connections 2023-10-07T09:00:21.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.785+0000 7f2f8945f700 1 -- 172.21.15.46:0/4291167330 wait complete. 2023-10-07T09:00:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 Processor -- start 2023-10-07T09:00:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 -- start start 2023-10-07T09:00:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 0x7f2f84156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 0x7f2f8409c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84069290 con 0x7f2f840b53d0 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84069d50 con 0x7f2f84159ec0 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f8945f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840694b0 con 0x7f2f840cf350 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.787+0000 7f2f82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46282/0 (socket says 172.21.15.46:46282) 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 -- 172.21.15.46:0/4150243859 learned_addr learned my addr 172.21.15.46:0/4150243859 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f827fc700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 0x7f2f84156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f837fe700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 0x7f2f8409c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 -- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 msgr2=0x7f2f84156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 0x7f2f84156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 -- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 msgr2=0x7f2f8409c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 0x7f2f8409c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 -- 172.21.15.46:0/4150243859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c009a20 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f837fe700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 0x7f2f8409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f827fc700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 0x7f2f84156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f82ffd700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400ec80 tx=0x7f2f74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400c9d0 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400cb30 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f84069790 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74013470 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.788+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f84169e00 con 0x7f2f840b53d0 2023-10-07T09:00:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.789+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84063c90 con 0x7f2f840b53d0 2023-10-07T09:00:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.790+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2f74013820 con 0x7f2f840b53d0 2023-10-07T09:00:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.790+0000 7f2f7affd700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 0x7f2f64069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.790+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2f74084c50 con 0x7f2f840b53d0 2023-10-07T09:00:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.790+0000 7f2f827fc700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 0x7f2f64069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.791+0000 7f2f827fc700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 0x7f2f64069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f8406a550 tx=0x7f2f6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:21.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.794+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f74051e80 con 0x7f2f840b53d0 2023-10-07T09:00:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:21.989+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f840718b0 con 0x7f2f840b53d0 2023-10-07T09:00:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.958+0000 7f2f7affd700 1 -- 172.21.15.46:0/4150243859 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2f740210d0 con 0x7f2f840b53d0 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 msgr2=0x7f2f64069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 0x7f2f64069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f8406a550 tx=0x7f2f6c009040 comp rx=0 tx=0).stop 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 msgr2=0x7f2f84068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400ec80 tx=0x7f2f74009120 comp rx=0 tx=0).stop 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 shutdown_connections 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2f64066fc0 0x7f2f64069470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f84159ec0 0x7f2f8409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f840b53d0 0x7f2f84068d50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 --2- 172.21.15.46:0/4150243859 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f840cf350 0x7f2f84156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 >> 172.21.15.46:0/4150243859 conn(0x7f2f840999f0 msgr2=0x7f2f84158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 shutdown_connections 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:22.962+0000 7f2f8945f700 1 -- 172.21.15.46:0/4150243859 wait complete. 2023-10-07T09:00:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:00:22.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:00:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.107+0000 7f04271a9700 1 Processor -- start 2023-10-07T09:00:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.107+0000 7f04271a9700 1 -- start start 2023-10-07T09:00:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0420153f50 0x7f04200b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0420154320 0x7f042006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f042015a190 0x7f042006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200b4570 con 0x7f042015a190 2023-10-07T09:00:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042015a730 con 0x7f0420154320 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f04271a9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042015aa10 con 0x7f0420153f50 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f042015a190 0x7f042006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f042015a190 0x7f042006d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46294/0 (socket says 172.21.15.46:46294) 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 -- 172.21.15.46:0/402195464 learned_addr learned my addr 172.21.15.46:0/402195464 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 -- 172.21.15.46:0/402195464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0420153f50 msgr2=0x7f04200b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 --2- 172.21.15.46:0/402195464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0420153f50 0x7f04200b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 -- 172.21.15.46:0/402195464 >> v2:172.21.15.133:3300/0 conn(0x7f0420154320 msgr2=0x7f042006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 --2- 172.21.15.46:0/402195464 >> v2:172.21.15.133:3300/0 conn(0x7f0420154320 0x7f042006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 -- 172.21.15.46:0/402195464 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042015acf0 con 0x7f042015a190 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.108+0000 7f0425746700 1 --2- 172.21.15.46:0/402195464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042015a190 0x7f042006d670 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f042006f4f0 tx=0x7f0418009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65cc5a76ff9454a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:23.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f041f7fe700 1 -- 172.21.15.46:0/402195464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800e070 con 0x7f042015a190 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f041f7fe700 1 -- 172.21.15.46:0/402195464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800ba50 con 0x7f042015a190 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f041f7fe700 1 -- 172.21.15.46:0/402195464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180092e0 con 0x7f042015a190 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 -- 172.21.15.46:0/402195464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042015a190 msgr2=0x7f042006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 --2- 172.21.15.46:0/402195464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042015a190 0x7f042006d670 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f042006f4f0 tx=0x7f0418009840 comp rx=0 tx=0).stop 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 -- 172.21.15.46:0/402195464 shutdown_connections 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 --2- 172.21.15.46:0/402195464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042015a190 0x7f042006d670 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 --2- 172.21.15.46:0/402195464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0420153f50 0x7f04200b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 --2- 172.21.15.46:0/402195464 >> v2:172.21.15.133:3300/0 conn(0x7f0420154320 0x7f042006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 -- 172.21.15.46:0/402195464 >> 172.21.15.46:0/402195464 conn(0x7f042006baf0 msgr2=0x7f042006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 -- 172.21.15.46:0/402195464 shutdown_connections 2023-10-07T09:00:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.109+0000 7f04271a9700 1 -- 172.21.15.46:0/402195464 wait complete. 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.110+0000 7f04271a9700 1 Processor -- start 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.110+0000 7f04271a9700 1 -- start start 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0420153f50 0x7f0420169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 0x7f04200ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200caad0 con 0x7f0420154320 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200cc270 con 0x7f0420153f50 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f04271a9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200cc550 con 0x7f042015a190 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f041ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f041ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46304/0 (socket says 172.21.15.46:46304) 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f041ffff700 1 -- 172.21.15.46:0/870795097 learned_addr learned my addr 172.21.15.46:0/870795097 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f0424f45700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0420153f50 0x7f0420169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.111+0000 7f0425746700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 0x7f04200ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 -- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 msgr2=0x7f04200ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 0x7f04200ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 -- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0420153f50 msgr2=0x7f0420169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0420153f50 0x7f0420169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 -- 172.21.15.46:0/870795097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009ae0 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f0425746700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 0x7f04200ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041ffff700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f041400b600 tx=0x7f04140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400f510 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400f690 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04200cc830 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400fa50 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.112+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04200ccb10 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.113+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200cac80 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.113+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f041401a400 con 0x7f0420154320 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.114+0000 7f041cff9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 0x7f040c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:23.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.114+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f0414084050 con 0x7f0420154320 2023-10-07T09:00:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.114+0000 7f0424f45700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 0x7f040c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.114+0000 7f0424f45700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 0x7f040c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0410006fd0 tx=0x7f0410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:23.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.118+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04200cac80 con 0x7f0420154320 2023-10-07T09:00:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.311+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04200718b0 con 0x7f0420154320 2023-10-07T09:00:23.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.965+0000 7f041cff9700 1 -- 172.21.15.46:0/870795097 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0414054e40 con 0x7f0420154320 2023-10-07T09:00:23.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 msgr2=0x7f040c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:23.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 0x7f040c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0410006fd0 tx=0x7f0410008040 comp rx=0 tx=0).stop 2023-10-07T09:00:23.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 msgr2=0x7f0420145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:23.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f041400b600 tx=0x7f04140091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 shutdown_connections 2023-10-07T09:00:23.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f040c066fc0 0x7f040c069470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f042015a190 0x7f04200ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0420153f50 0x7f0420169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 --2- 172.21.15.46:0/870795097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0420154320 0x7f0420145100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.970+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 >> 172.21.15.46:0/870795097 conn(0x7f042006baf0 msgr2=0x7f0420153490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.971+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 shutdown_connections 2023-10-07T09:00:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:23.971+0000 7f04271a9700 1 -- 172.21.15.46:0/870795097 wait complete. 2023-10-07T09:00:23.974 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:00:23.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:00:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.114+0000 7f4afda11700 1 Processor -- start 2023-10-07T09:00:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.114+0000 7f4afda11700 1 -- start start 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4afda11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 0x7f4af815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4afda11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4afda11700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af8069ee0 con 0x7f4af8159c60 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4afda11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af815a160 con 0x7f4af8159890 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4afda11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80d13a0 con 0x7f4af8069560 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4af67fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4af8159c60 0x7f4af815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35720/0 (socket says 172.21.15.46:35720) 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.115+0000 7f4af67fc700 1 -- 172.21.15.46:0/1369975788 learned_addr learned my addr 172.21.15.46:0/1369975788 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 --2- 172.21.15.46:0/1369975788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/1369975788 >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 0x7f4af815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292210694 0 0) 0x7f4af8069ee0 con 0x7f4af8159c60 2023-10-07T09:00:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae4003570 con 0x7f4af8159c60 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332634952 0 0) 0x7f4ae4003570 con 0x7f4af8159c60 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 -- 172.21.15.46:0/1369975788 >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 msgr2=0x7f4af815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 --2- 172.21.15.46:0/1369975788 >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 0x7f4af815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 -- 172.21.15.46:0/1369975788 >> v1:172.21.15.46:6789/0 conn(0x7f4af8159c60 legacy=0x7f4af815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 -- 172.21.15.46:0/1369975788 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af815e140 con 0x7f4af8069560 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/1369975788 >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 0x7f4af815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af77fe700 1 --2- 172.21.15.46:0/1369975788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af80699a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009e60 tx=0x7f4af0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=108a5a699442719d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000e070 con 0x7f4af8069560 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af000b7a0 con 0x7f4af8069560 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.116+0000 7f4af5ffb700 1 -- 172.21.15.46:0/1369975788 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0001470 con 0x7f4af8069560 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 -- 172.21.15.46:0/1369975788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 msgr2=0x7f4af80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 --2- 172.21.15.46:0/1369975788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af80699a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009e60 tx=0x7f4af0009780 comp rx=0 tx=0).stop 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 -- 172.21.15.46:0/1369975788 shutdown_connections 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 --2- 172.21.15.46:0/1369975788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af80699a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 --2- 172.21.15.46:0/1369975788 >> v2:172.21.15.133:3300/0 conn(0x7f4af8159890 0x7f4af815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 -- 172.21.15.46:0/1369975788 >> 172.21.15.46:0/1369975788 conn(0x7f4af8068e20 msgr2=0x7f4af80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 -- 172.21.15.46:0/1369975788 shutdown_connections 2023-10-07T09:00:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.117+0000 7f4afda11700 1 -- 172.21.15.46:0/1369975788 wait complete. 2023-10-07T09:00:24.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.118+0000 7f4afda11700 1 Processor -- start 2023-10-07T09:00:24.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.118+0000 7f4afda11700 1 -- start start 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 0x7f4af80cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80c6a20 con 0x7f4af8159890 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80c6d00 con 0x7f4af8159c60 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4afda11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af815c0b0 con 0x7f4af8069560 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46314/0 (socket says 172.21.15.46:46314) 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 -- 172.21.15.46:0/241935561 learned_addr learned my addr 172.21.15.46:0/241935561 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af77fe700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 0x7f4af80cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 -- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 msgr2=0x7f4af814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 -- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 msgr2=0x7f4af80cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 0x7f4af80cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 -- 172.21.15.46:0/241935561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae8009420 con 0x7f4af8159890 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af77fe700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 0x7f4af80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.119+0000 7f4af67fc700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000cb90 tx=0x7f4ae0001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.120+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0007360 con 0x7f4af8159890 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.120+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00074e0 con 0x7f4af8159890 2023-10-07T09:00:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.120+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0009a20 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.120+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004830 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.120+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8150370 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.121+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af815c5d0 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.121+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4ae0004ba0 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.121+0000 7f4aeeffd700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 0x7f4ad8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.122+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ae0083bb0 con 0x7f4af8159890 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.122+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 0x7f4ad8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.122+0000 7f4af6ffd700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 0x7f4ad8069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80093f0 tx=0x7f4ae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.127+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4af815c5d0 con 0x7f4af8159890 2023-10-07T09:00:24.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.325+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4af815c5d0 con 0x7f4af8159890 2023-10-07T09:00:24.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.329+0000 7f4aeeffd700 1 -- 172.21.15.46:0/241935561 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4af815c5d0 con 0x7f4af8159890 2023-10-07T09:00:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 msgr2=0x7f4ad8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 0x7f4ad8069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80093f0 tx=0x7f4ae8008040 comp rx=0 tx=0).stop 2023-10-07T09:00:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 msgr2=0x7f4af80c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000cb90 tx=0x7f4ae0001b50 comp rx=0 tx=0).stop 2023-10-07T09:00:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 shutdown_connections 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ad8066fc0 0x7f4ad8069470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af8159c60 0x7f4af80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4af8069560 0x7f4af814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 --2- 172.21.15.46:0/241935561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4af8159890 0x7f4af80c5f70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 >> 172.21.15.46:0/241935561 conn(0x7f4af8068e20 msgr2=0x7f4af80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 shutdown_connections 2023-10-07T09:00:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.332+0000 7f4afda11700 1 -- 172.21.15.46:0/241935561 wait complete. 2023-10-07T09:00:24.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-07T09:00:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 Processor -- start 2023-10-07T09:00:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 -- start start 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f282c159c10 0x7f282c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f282c0699e0 0x7f282c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c069e40 con 0x7f282c159840 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0cfb30 con 0x7f282c159c10 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.463+0000 7f2832d24700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0cbc40 con 0x7f282c0699e0 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f282c159c10 0x7f282c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f2830ac0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f282c159840 0x7f282c0cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35722/0 (socket says 172.21.15.46:35722) 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f2830ac0700 1 -- 172.21.15.46:0/1525087742 learned_addr learned my addr 172.21.15.46:0/1525087742 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f28312c1700 1 --2- 172.21.15.46:0/1525087742 >> v2:172.21.15.133:3300/0 conn(0x7f282c0699e0 0x7f282c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 -- 172.21.15.46:0/1525087742 >> v2:172.21.15.133:3300/0 conn(0x7f282c0699e0 msgr2=0x7f282c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 --2- 172.21.15.46:0/1525087742 >> v2:172.21.15.133:3300/0 conn(0x7f282c0699e0 0x7f282c0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 -- 172.21.15.46:0/1525087742 >> v1:172.21.15.46:6789/0 conn(0x7f282c159840 legacy=0x7f282c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 -- 172.21.15.46:0/1525087742 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0cbf10 con 0x7f282c159c10 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282bfff700 1 --2- 172.21.15.46:0/1525087742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159c10 0x7f282c0694a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f282c0cc330 tx=0x7f281c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f806308edcaefa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282b7fe700 1 -- 172.21.15.46:0/1525087742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00e070 con 0x7f282c159c10 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282b7fe700 1 -- 172.21.15.46:0/1525087742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00bc30 con 0x7f282c159c10 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.464+0000 7f282b7fe700 1 -- 172.21.15.46:0/1525087742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c012430 con 0x7f282c159c10 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 -- 172.21.15.46:0/1525087742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159c10 msgr2=0x7f282c0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 --2- 172.21.15.46:0/1525087742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159c10 0x7f282c0694a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f282c0cc330 tx=0x7f281c009780 comp rx=0 tx=0).stop 2023-10-07T09:00:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 -- 172.21.15.46:0/1525087742 shutdown_connections 2023-10-07T09:00:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 --2- 172.21.15.46:0/1525087742 >> v2:172.21.15.133:3300/0 conn(0x7f282c0699e0 0x7f282c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 --2- 172.21.15.46:0/1525087742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159c10 0x7f282c0694a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 -- 172.21.15.46:0/1525087742 >> 172.21.15.46:0/1525087742 conn(0x7f282c068e10 msgr2=0x7f282c0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 -- 172.21.15.46:0/1525087742 shutdown_connections 2023-10-07T09:00:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.465+0000 7f2832d24700 1 -- 172.21.15.46:0/1525087742 wait complete. 2023-10-07T09:00:24.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.466+0000 7f2832d24700 1 Processor -- start 2023-10-07T09:00:24.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.466+0000 7f2832d24700 1 -- start start 2023-10-07T09:00:24.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f282c0699e0 0x7f282c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 0x7f282c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0c9350 con 0x7f282c159840 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0b49d0 con 0x7f282c0699e0 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0b4cb0 con 0x7f282c159c10 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46334/0 (socket says 172.21.15.46:46334) 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 -- 172.21.15.46:0/2415907339 learned_addr learned my addr 172.21.15.46:0/2415907339 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2830ac0700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f282c0699e0 0x7f282c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f28312c1700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 0x7f282c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 -- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 msgr2=0x7f282c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 0x7f282c156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 -- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f282c0699e0 msgr2=0x7f282c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f282c0699e0 0x7f282c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 -- 172.21.15.46:0/2415907339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c009a20 con 0x7f282c159840 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f28312c1700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 0x7f282c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f282bfff700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f282c067c20 tx=0x7f281c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c012ea0 con 0x7f282c159840 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c0263f0 con 0x7f282c159840 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0b4f90 con 0x7f282c159840 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0267d0 con 0x7f282c159840 2023-10-07T09:00:24.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.468+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c169940 con 0x7f282c159840 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c169ba0 con 0x7f282c159840 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f281c026c00 con 0x7f282c159840 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2828ff9700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 0x7f280c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f281c0862e0 con 0x7f282c159840 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2830ac0700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 0x7f280c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.470+0000 7f2830ac0700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 0x7f280c069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2814001820 tx=0x7f2814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.474+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f282c169ba0 con 0x7f282c159840 2023-10-07T09:00:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.744+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f282c169ba0 con 0x7f282c159840 2023-10-07T09:00:24.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.965+0000 7f2828ff9700 1 -- 172.21.15.46:0/2415907339 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f282c169ba0 con 0x7f282c159840 2023-10-07T09:00:24.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 msgr2=0x7f280c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 0x7f280c069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2814001820 tx=0x7f2814009040 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 msgr2=0x7f282c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f282c067c20 tx=0x7f281c019000 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 shutdown_connections 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f280c066fc0 0x7f280c069470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f282c159c10 0x7f282c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.967+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f282c0699e0 0x7f282c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.968+0000 7f2832d24700 1 --2- 172.21.15.46:0/2415907339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282c159840 0x7f282c148040 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.968+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 >> 172.21.15.46:0/2415907339 conn(0x7f282c068e10 msgr2=0x7f282c0d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.968+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 shutdown_connections 2023-10-07T09:00:24.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:24.968+0000 7f2832d24700 1 -- 172.21.15.46:0/2415907339 wait complete. 2023-10-07T09:00:24.981 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-07T09:00:24.981 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-07T09:00:24.981 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:00:24.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-07T09:00:25.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.100+0000 7efcbe497700 1 Processor -- start 2023-10-07T09:00:25.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.100+0000 7efcbe497700 1 -- start start 2023-10-07T09:00:25.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcbe497700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efcb8068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcbe497700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb815c480 con 0x7efcb8159c10 2023-10-07T09:00:25.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcbe497700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb815b870 con 0x7efcb8068bb0 2023-10-07T09:00:25.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcbe497700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80b2a40 con 0x7efcb80b5ea0 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efcb8159c10 0x7efcb815b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35736/0 (socket says 172.21.15.46:35736) 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb7fff700 1 -- 172.21.15.46:0/717998793 learned_addr learned my addr 172.21.15.46:0/717998793 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb77fe700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efcb8068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569477667 0 0) 0x7efcb815c480 con 0x7efcb8159c10 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca4003570 con 0x7efcb8159c10 2023-10-07T09:00:25.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496338325 0 0) 0x7efca4003570 con 0x7efcb8159c10 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 msgr2=0x7efcb8068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efcb8068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 >> v1:172.21.15.133:6789/0 conn(0x7efcb8068bb0 legacy=0x7efcb815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb815bb50 con 0x7efcb8159c10 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7efca0001470 con 0x7efcb8159c10 2023-10-07T09:00:25.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.101+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 >> v1:172.21.15.46:6789/0 conn(0x7efcb8159c10 legacy=0x7efcb815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efca4003a90 0x7efca4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efca4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4004d50 0x7efca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca400bb10 con 0x7efca4003a90 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca400bc50 con 0x7efca4004d50 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca400be10 con 0x7efcb80b5ea0 2023-10-07T09:00:25.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efca4003a90 0x7efca4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb77fe700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efca4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcbca34700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4004d50 0x7efca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 -- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 msgr2=0x7efca4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb80b5ea0 0x7efca4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 -- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4004d50 msgr2=0x7efca40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:25.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4004d50 0x7efca40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 -- 172.21.15.46:0/717998793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4003570 con 0x7efca4003a90 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcbca34700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4004d50 0x7efca40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb7fff700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efca4003a90 0x7efca4003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efca000c2d0 tx=0x7efca0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e61ef7025fbba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000cbc0 con 0x7efca4003a90 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000cd40 con 0x7efca4003a90 2023-10-07T09:00:25.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.102+0000 7efcb6ffd700 1 -- 172.21.15.46:0/717998793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005b70 con 0x7efca4003a90 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 -- 172.21.15.46:0/717998793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efca4003a90 msgr2=0x7efca4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 --2- 172.21.15.46:0/717998793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efca4003a90 0x7efca4003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efca000c2d0 tx=0x7efca0001df0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbca34700 1 -- 172.21.15.46:0/717998793 reap_dead start 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 -- 172.21.15.46:0/717998793 shutdown_connections 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 -- 172.21.15.46:0/717998793 >> 172.21.15.46:0/717998793 conn(0x7efcb8099a20 msgr2=0x7efcb80af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 -- 172.21.15.46:0/717998793 shutdown_connections 2023-10-07T09:00:25.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.103+0000 7efcbe497700 1 -- 172.21.15.46:0/717998793 wait complete. 2023-10-07T09:00:25.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.104+0000 7efcbe497700 1 Processor -- start 2023-10-07T09:00:25.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.104+0000 7efcbe497700 1 -- start start 2023-10-07T09:00:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4003a90 0x7efcb80c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb8157a30 0x7efcb80c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80b0530 con 0x7efcb80afb50 2023-10-07T09:00:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb81584b0 con 0x7efca4003a90 2023-10-07T09:00:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbe497700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb816d6a0 con 0x7efcb8157a30 2023-10-07T09:00:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46358/0 (socket says 172.21.15.46:46358) 2023-10-07T09:00:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 -- 172.21.15.46:0/18793549 learned_addr learned my addr 172.21.15.46:0/18793549 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcb77fe700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb8157a30 0x7efcb80c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcb7fff700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4003a90 0x7efcb80c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 -- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb8157a30 msgr2=0x7efcb80c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb8157a30 0x7efcb80c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 -- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4003a90 msgr2=0x7efcb80c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4003a90 0x7efcb80c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.105+0000 7efcbca34700 1 -- 172.21.15.46:0/18793549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb816d980 con 0x7efcb80afb50 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcbca34700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efcb815c3f0 tx=0x7efcb0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0018070 con 0x7efcb80afb50 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0006ba0 con 0x7efcb80afb50 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0013630 con 0x7efcb80afb50 2023-10-07T09:00:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb816dc60 con 0x7efcb80afb50 2023-10-07T09:00:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.106+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb8157ea0 con 0x7efcb80afb50 2023-10-07T09:00:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.107+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb80c5570 con 0x7efcb80afb50 2023-10-07T09:00:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.107+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7efcb0003030 con 0x7efcb80afb50 2023-10-07T09:00:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.108+0000 7efcaffff700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 0x7efc98069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.108+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efcb0083bb0 con 0x7efcb80afb50 2023-10-07T09:00:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.108+0000 7efcb7fff700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 0x7efc98069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.108+0000 7efcb7fff700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 0x7efc98069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efca0008fd0 tx=0x7efca0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.112+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcb008a080 con 0x7efcb80afb50 2023-10-07T09:00:25.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.385+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7efcb804c3c0 con 0x7efcb80afb50 2023-10-07T09:00:25.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.971+0000 7efcaffff700 1 -- 172.21.15.46:0/18793549 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v122) v1 ==== 161+0+0 (secure 0 0 0) 0x7efcb0054bc0 con 0x7efcb80afb50 2023-10-07T09:00:25.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 msgr2=0x7efc98069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 0x7efc98069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efca0008fd0 tx=0x7efca0015000 comp rx=0 tx=0).stop 2023-10-07T09:00:25.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 msgr2=0x7efcb80afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:25.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efcb815c3f0 tx=0x7efcb0009040 comp rx=0 tx=0).stop 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 shutdown_connections 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc98066fc0 0x7efc98069470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcb80afb50 0x7efcb80afff0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca4003a90 0x7efcb80c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 --2- 172.21.15.46:0/18793549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcb8157a30 0x7efcb80c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 >> 172.21.15.46:0/18793549 conn(0x7efcb8099a20 msgr2=0x7efcb809b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 shutdown_connections 2023-10-07T09:00:25.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:25.973+0000 7efcbe497700 1 -- 172.21.15.46:0/18793549 wait complete. 2023-10-07T09:00:25.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:00:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.116+0000 7f8e4f59e700 1 Processor -- start 2023-10-07T09:00:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.116+0000 7f8e4f59e700 1 -- start start 2023-10-07T09:00:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 0x7f8e500b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e500b33b0 0x7f8e500b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4f59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500b2080 con 0x7f8e500b4e70 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500cfb00 con 0x7f8e500b33b0 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b5c40 con 0x7f8e500b16d0 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4e59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8e500b4e70 0x7f8e500ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35750/0 (socket says 172.21.15.46:35750) 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4e59c700 1 -- 172.21.15.46:0/2119177259 learned_addr learned my addr 172.21.15.46:0/2119177259 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4ed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e500b33b0 0x7f8e500b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4d59a700 1 -- 172.21.15.46:0/2119177259 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626439530 0 0) 0x7f8e500b2080 con 0x7f8e500b4e70 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4d59a700 1 -- 172.21.15.46:0/2119177259 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e3c003570 con 0x7f8e500b4e70 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4dd9b700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 0x7f8e500b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4ed9d700 1 -- 172.21.15.46:0/2119177259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 msgr2=0x7f8e500b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4ed9d700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 0x7f8e500b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4ed9d700 1 -- 172.21.15.46:0/2119177259 >> v1:172.21.15.46:6789/0 conn(0x7f8e500b4e70 legacy=0x7f8e500ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4ed9d700 1 -- 172.21.15.46:0/2119177259 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500b5f20 con 0x7f8e500b33b0 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.117+0000 7f8e4dd9b700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 0x7f8e500b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4ed9d700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500b3830 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02a133af404888a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4d59a700 1 -- 172.21.15.46:0/2119177259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800b640 con 0x7f8e500b33b0 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4d59a700 1 -- 172.21.15.46:0/2119177259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800b7a0 con 0x7f8e500b33b0 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4d59a700 1 -- 172.21.15.46:0/2119177259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800bb40 con 0x7f8e500b33b0 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 -- 172.21.15.46:0/2119177259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 msgr2=0x7f8e500b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500b3830 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 -- 172.21.15.46:0/2119177259 shutdown_connections 2023-10-07T09:00:26.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500b3830 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/2119177259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b16d0 0x7f8e500b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 -- 172.21.15.46:0/2119177259 >> 172.21.15.46:0/2119177259 conn(0x7f8e500d10c0 msgr2=0x7f8e500affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:26.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 -- 172.21.15.46:0/2119177259 shutdown_connections 2023-10-07T09:00:26.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.118+0000 7f8e4f59e700 1 -- 172.21.15.46:0/2119177259 wait complete. 2023-10-07T09:00:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.119+0000 7f8e4f59e700 1 Processor -- start 2023-10-07T09:00:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 -- start start 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e500b16d0 0x7f8e500af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b4e70 0x7f8e500cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500ca360 con 0x7f8e500b33b0 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015d5c0 con 0x7f8e500b16d0 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015d8a0 con 0x7f8e500b4e70 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46378/0 (socket says 172.21.15.46:46378) 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.120+0000 7f8e4dd9b700 1 -- 172.21.15.46:0/89014162 learned_addr learned my addr 172.21.15.46:0/89014162 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4e59c700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e500b16d0 0x7f8e500af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4ed9d700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b4e70 0x7f8e500cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 -- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b4e70 msgr2=0x7f8e500cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b4e70 0x7f8e500cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 -- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e500b16d0 msgr2=0x7f8e500af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e500b16d0 0x7f8e500af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 -- 172.21.15.46:0/89014162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009420 con 0x7f8e500b33b0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4dd9b700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c830 tx=0x7f8e38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011600 con 0x7f8e500b33b0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38011760 con 0x7f8e500b33b0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e500c9d10 con 0x7f8e500b33b0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011b20 con 0x7f8e500b33b0 2023-10-07T09:00:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.121+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e500af880 con 0x7f8e500b33b0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.122+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e500ca4d0 con 0x7f8e500b33b0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.122+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8e3800a3e0 con 0x7f8e500b33b0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.123+0000 7f8e467fc700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 0x7f8e30069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.123+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8e38084820 con 0x7f8e500b33b0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.123+0000 7f8e4e59c700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 0x7f8e30069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.124+0000 7f8e4e59c700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 0x7f8e30069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005c50 tx=0x7f8e40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.127+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e38051c90 con 0x7f8e500b33b0 2023-10-07T09:00:26.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.319+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e500b14b0 con 0x7f8e500b33b0 2023-10-07T09:00:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.323+0000 7f8e467fc700 1 -- 172.21.15.46:0/89014162 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e380150c0 con 0x7f8e500b33b0 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 msgr2=0x7f8e30069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 0x7f8e30069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005c50 tx=0x7f8e40009040 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 msgr2=0x7f8e500ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c830 tx=0x7f8e38008040 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 shutdown_connections 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e30066fc0 0x7f8e30069470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e500b4e70 0x7f8e500cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e500b16d0 0x7f8e500af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 --2- 172.21.15.46:0/89014162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e500b33b0 0x7f8e500ca7f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 >> 172.21.15.46:0/89014162 conn(0x7f8e500d10c0 msgr2=0x7f8e50158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 shutdown_connections 2023-10-07T09:00:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.325+0000 7f8e4f59e700 1 -- 172.21.15.46:0/89014162 wait complete. 2023-10-07T09:00:26.337 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:00:26.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:00:26.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:00:26.421 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:00:26.422 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:00:26.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.540+0000 7fa3f1b7b700 1 Processor -- start 2023-10-07T09:00:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.540+0000 7fa3f1b7b700 1 -- start start 2023-10-07T09:00:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3f1b7b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3ec159db0 0x7fa3ec069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3f1b7b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0c96a0 con 0x7fa3ec06a2b0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3f1b7b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0cb9e0 con 0x7fa3ec1599e0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3f1b7b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0cab60 con 0x7fa3ec159db0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3ebfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa3ec06a2b0 0x7fa3ec06a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35754/0 (socket says 172.21.15.46:35754) 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3ebfff700 1 -- 172.21.15.46:0/1656723689 learned_addr learned my addr 172.21.15.46:0/1656723689 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3eaffd700 1 --2- 172.21.15.46:0/1656723689 >> v2:172.21.15.133:3300/0 conn(0x7fa3ec159db0 0x7fa3ec069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.541+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631710267 0 0) 0x7fa3ec0c96a0 con 0x7fa3ec06a2b0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d4003570 con 0x7fa3ec06a2b0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3eaffd700 1 -- 172.21.15.46:0/1656723689 >> v1:172.21.15.133:6789/0 conn(0x7fa3ec1599e0 legacy=0x7fa3ec069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3eaffd700 1 -- 172.21.15.46:0/1656723689 >> v1:172.21.15.46:6789/0 conn(0x7fa3ec06a2b0 legacy=0x7fa3ec06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3291705478 0 0) 0x7fa3d4003570 con 0x7fa3ec06a2b0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3eaffd700 1 -- 172.21.15.46:0/1656723689 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0cb420 con 0x7fa3ec159db0 2023-10-07T09:00:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3eaffd700 1 --2- 172.21.15.46:0/1656723689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec159db0 0x7fa3ec069ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00098e0 tx=0x7fa3e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f876a29507810f11 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40017f0 con 0x7fa3ec159db0 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0011420 con 0x7fa3ec159db0 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.542+0000 7fa3ea7fc700 1 -- 172.21.15.46:0/1656723689 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00117c0 con 0x7fa3ec159db0 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/1656723689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec159db0 msgr2=0x7fa3ec069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/1656723689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec159db0 0x7fa3ec069ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00098e0 tx=0x7fa3e00091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/1656723689 shutdown_connections 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/1656723689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec159db0 0x7fa3ec069ac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/1656723689 >> 172.21.15.46:0/1656723689 conn(0x7fa3ec0c9860 msgr2=0x7fa3ec0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/1656723689 shutdown_connections 2023-10-07T09:00:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.543+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/1656723689 wait complete. 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.544+0000 7fa3f1b7b700 1 Processor -- start 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.544+0000 7fa3f1b7b700 1 -- start start 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec06a2b0 0x7fa3ec06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 0x7fa3ec0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c2f60 con 0x7fa3ec159db0 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c51f0 con 0x7fa3ec06a2b0 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3f1b7b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c26c0 con 0x7fa3ec1599e0 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46392/0 (socket says 172.21.15.46:46392) 2023-10-07T09:00:26.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 -- 172.21.15.46:0/782079269 learned_addr learned my addr 172.21.15.46:0/782079269 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3eb7fe700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec06a2b0 0x7fa3ec06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3eaffd700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 0x7fa3ec0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 -- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 msgr2=0x7fa3ec0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 0x7fa3ec0c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 -- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec06a2b0 msgr2=0x7fa3ec06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec06a2b0 0x7fa3ec06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 -- 172.21.15.46:0/782079269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009420 con 0x7fa3ec159db0 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3eaffd700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 0x7fa3ec0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.545+0000 7fa3ebfff700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4001560 tx=0x7fa3e4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.546+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4004dc0 con 0x7fa3ec159db0 2023-10-07T09:00:26.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.546+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400a6a0 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.546+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400aa60 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.546+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec0c29a0 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.546+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec0c33d0 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.547+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec0c5360 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.547+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa3e4007150 con 0x7fa3ec159db0 2023-10-07T09:00:26.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.547+0000 7fa3d37fe700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 0x7fa3d8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.547+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa3e4083910 con 0x7fa3ec159db0 2023-10-07T09:00:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.548+0000 7fa3eb7fe700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 0x7fa3d8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.548+0000 7fa3eb7fe700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 0x7fa3d8069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc003a80 tx=0x7fa3dc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.552+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e4050f10 con 0x7fa3ec159db0 2023-10-07T09:00:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.787+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3ec04c3c0 con 0x7fa3ec159db0 2023-10-07T09:00:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.788+0000 7fa3d37fe700 1 -- 172.21.15.46:0/782079269 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa3e4018090 con 0x7fa3ec159db0 2023-10-07T09:00:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:26.789 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/623191639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":623191639},{"type":"v1","addr":"172.21.15.133:6837","nonce":623191639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3334876705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3334876705},{"type":"v1","addr":"172.21.15.133:6836","nonce":3334876705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5319,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/807477472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":807477472},{"type":"v1","addr":"172.21.15.46:6834","nonce":807477472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2258390581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2258390581},{"type":"v1","addr":"172.21.15.46:6835","nonce":2258390581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 msgr2=0x7fa3d8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 0x7fa3d8069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc003a80 tx=0x7fa3dc007ec0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 msgr2=0x7fa3ec14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4001560 tx=0x7fa3e4001640 comp rx=0 tx=0).stop 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 shutdown_connections 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa3d8066fc0 0x7fa3d8069470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec159db0 0x7fa3ec14e990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3ec06a2b0 0x7fa3ec06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 --2- 172.21.15.46:0/782079269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3ec1599e0 0x7fa3ec0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 >> 172.21.15.46:0/782079269 conn(0x7fa3ec0c9860 msgr2=0x7fa3ec0c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 shutdown_connections 2023-10-07T09:00:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.790+0000 7fa3f1b7b700 1 -- 172.21.15.46:0/782079269 wait complete. 2023-10-07T09:00:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 33 2023-10-07T09:00:26.803 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:00:26.803 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:00:26.803 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:00:26.804 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:00:26.804 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:00:26.804 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:00:26.804 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:00:26.804 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:00:26.805 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:00:26.805 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:00:26.805 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:00:26.805 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:00:26.806 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:00:26.806 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:00:26.806 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:00:26.806 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:00:26.812 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:00:26.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:00:26.813 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:00:26.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:00:26.817 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:00:26.817 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:00:26.818 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:00:26.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:00:26.855 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:00:26.856 DEBUG:teuthology.parallel:result is None 2023-10-07T09:00:26.857 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:00:26.857 DEBUG:teuthology.parallel:result is None 2023-10-07T09:00:26.859 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:00:26.859 DEBUG:teuthology.parallel:result is None 2023-10-07T09:00:26.860 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:00:26.860 DEBUG:teuthology.parallel:result is None 2023-10-07T09:00:26.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:00:26.930 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:00:26.931 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:00:26.941 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:00:26.942 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:00:26.942 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-10-07T09:00:26.941+0000 7f9424f28700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-07T09:00:26.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.987+0000 7fb2b449c700 1 Processor -- start 2023-10-07T09:00:26.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.987+0000 7fb2b449c700 1 -- start start 2023-10-07T09:00:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b449c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 0x7fb2ac0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b449c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac069ee0 con 0x7fb2ac159890 2023-10-07T09:00:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b449c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac15a160 con 0x7fb2ac159c60 2023-10-07T09:00:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b449c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0d13a0 con 0x7fb2ac069560 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2238700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb2ac159890 0x7fb2ac15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35788/0 (socket says 172.21.15.46:35788) 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2238700 1 -- 172.21.15.46:0/4120497291 learned_addr learned my addr 172.21.15.46:0/4120497291 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2a39700 1 --2- 172.21.15.46:0/4120497291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 0x7fb2ac0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930573987 0 0) 0x7fb2ac069ee0 con 0x7fb2ac159890 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb298003570 con 0x7fb2ac159890 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743733874 0 0) 0x7fb2ac15a160 con 0x7fb2ac159c60 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ac069ee0 con 0x7fb2ac159c60 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2a39700 1 -- 172.21.15.46:0/4120497291 >> v1:172.21.15.133:6789/0 conn(0x7fb2ac159c60 legacy=0x7fb2ac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2a39700 1 -- 172.21.15.46:0/4120497291 >> v1:172.21.15.46:6789/0 conn(0x7fb2ac159890 legacy=0x7fb2ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594883650 0 0) 0x7fb298003570 con 0x7fb2ac159890 2023-10-07T09:00:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.988+0000 7fb2b2a39700 1 -- 172.21.15.46:0/4120497291 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac15e140 con 0x7fb2ac069560 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b2a39700 1 --2- 172.21.15.46:0/4120497291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 0x7fb2ac0699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009e90 tx=0x7fb2a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1afd26ab5820553 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400e070 con 0x7fb2ac069560 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400b870 con 0x7fb2ac069560 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b1236700 1 -- 172.21.15.46:0/4120497291 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8001470 con 0x7fb2ac069560 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 -- 172.21.15.46:0/4120497291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 msgr2=0x7fb2ac0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 --2- 172.21.15.46:0/4120497291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 0x7fb2ac0699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009e90 tx=0x7fb2a4009780 comp rx=0 tx=0).stop 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 -- 172.21.15.46:0/4120497291 shutdown_connections 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 --2- 172.21.15.46:0/4120497291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac069560 0x7fb2ac0699a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 -- 172.21.15.46:0/4120497291 >> 172.21.15.46:0/4120497291 conn(0x7fb2ac068e20 msgr2=0x7fb2ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 -- 172.21.15.46:0/4120497291 shutdown_connections 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.989+0000 7fb2b449c700 1 -- 172.21.15.46:0/4120497291 wait complete. 2023-10-07T09:00:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.990+0000 7fb2b449c700 1 Processor -- start 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.990+0000 7fb2b449c700 1 -- start start 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 0x7fb2ac0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 0x7fb2ac154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0b3ab0 con 0x7fb2ac069560 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0cd600 con 0x7fb2ac159c60 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b449c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1549d0 con 0x7fb2ac159890 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b2238700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b2238700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46436/0 (socket says 172.21.15.46:46436) 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b2238700 1 -- 172.21.15.46:0/2367713943 learned_addr learned my addr 172.21.15.46:0/2367713943 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b2a39700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 0x7fb2ac154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.991+0000 7fb2b1a37700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 0x7fb2ac0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 -- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 msgr2=0x7fb2ac0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 0x7fb2ac0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 -- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 msgr2=0x7fb2ac154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 0x7fb2ac154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 -- 172.21.15.46:0/2367713943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009a20 con 0x7fb2ac069560 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2a39700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 0x7fb2ac154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b1a37700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 0x7fb2ac0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b2238700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800cb90 tx=0x7fb2a8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007360 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a80074e0 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac0cd8a0 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004830 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.992+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac0cde60 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.993+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac04c3c0 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.993+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb2a8004be0 con 0x7fb2ac069560 2023-10-07T09:00:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.994+0000 7fb2a27fc700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 0x7fb290069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.994+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb2a8083960 con 0x7fb2ac069560 2023-10-07T09:00:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.994+0000 7fb2b1a37700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 0x7fb290069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.995+0000 7fb2b1a37700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 0x7fb290069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac16cb90 tx=0x7fb29c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:26.998+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2a8050f60 con 0x7fb2ac069560 2023-10-07T09:00:27.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.206+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb2ac06a5b0 con 0x7fb2ac069560 2023-10-07T09:00:27.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.984+0000 7fb2a27fc700 1 -- 172.21.15.46:0/2367713943 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb2a8018080 con 0x7fb2ac069560 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.986+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 msgr2=0x7fb290069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.986+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 0x7fb290069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac16cb90 tx=0x7fb29c009040 comp rx=0 tx=0).stop 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.986+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 msgr2=0x7fb2ac0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.986+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800cb90 tx=0x7fb2a8001b50 comp rx=0 tx=0).stop 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 shutdown_connections 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb290066fc0 0x7fb290069470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2ac159c60 0x7fb2ac154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:27.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2ac069560 0x7fb2ac0c91f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:27.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 --2- 172.21.15.46:0/2367713943 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2ac159890 0x7fb2ac0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:27.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 >> 172.21.15.46:0/2367713943 conn(0x7fb2ac068e20 msgr2=0x7fb2ac157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:27.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 shutdown_connections 2023-10-07T09:00:27.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:27.987+0000 7fb2b449c700 1 -- 172.21.15.46:0/2367713943 wait complete. 2023-10-07T09:00:27.989 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:00:28.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:00:28.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.128+0000 7f4f0deba700 1 Processor -- start 2023-10-07T09:00:28.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.128+0000 7f4f0deba700 1 -- start start 2023-10-07T09:00:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f0deba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4f0806c0a0 0x7f4f080caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f0deba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0815df50 0x7f4f0815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f0deba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0815d7e0 con 0x7f4f0806bcd0 2023-10-07T09:00:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f0deba700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0815dac0 con 0x7f4f0806c0a0 2023-10-07T09:00:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f0deba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0815aa30 con 0x7f4f0815df50 2023-10-07T09:00:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4f0806c0a0 0x7f4f080caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4f0806c0a0 0x7f4f080caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46450/0 (socket says 172.21.15.46:46450) 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f077fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4f0806bcd0 0x7f4f0815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35790/0 (socket says 172.21.15.46:35790) 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 -- 172.21.15.46:0/4236746616 learned_addr learned my addr 172.21.15.46:0/4236746616 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 -- 172.21.15.46:0/4236746616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0815df50 msgr2=0x7f4f0815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f07fff700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0815df50 0x7f4f0815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f067fc700 1 -- 172.21.15.46:0/4236746616 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291303227 0 0) 0x7f4f0815d7e0 con 0x7f4f0806bcd0 2023-10-07T09:00:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0815df50 0x7f4f0815e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 -- 172.21.15.46:0/4236746616 >> v1:172.21.15.46:6789/0 conn(0x7f4f0806bcd0 legacy=0x7f4f0815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 -- 172.21.15.46:0/4236746616 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0815ad10 con 0x7f4f0806c0a0 2023-10-07T09:00:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.129+0000 7f4f06ffd700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0806c0a0 0x7f4f080caa90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80099b0 tx=0x7f4ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370acccfefee5fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f067fc700 1 -- 172.21.15.46:0/4236746616 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800b860 con 0x7f4f0806c0a0 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f067fc700 1 -- 172.21.15.46:0/4236746616 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800b9c0 con 0x7f4f0806c0a0 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f067fc700 1 -- 172.21.15.46:0/4236746616 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800bd80 con 0x7f4f0806c0a0 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 -- 172.21.15.46:0/4236746616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0806c0a0 msgr2=0x7f4f080caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0806c0a0 0x7f4f080caa90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80099b0 tx=0x7f4ef8009250 comp rx=0 tx=0).stop 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 -- 172.21.15.46:0/4236746616 shutdown_connections 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0815df50 0x7f4f0815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 --2- 172.21.15.46:0/4236746616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0806c0a0 0x7f4f080caa90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 -- 172.21.15.46:0/4236746616 >> 172.21.15.46:0/4236746616 conn(0x7f4f080ce600 msgr2=0x7f4f080cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 -- 172.21.15.46:0/4236746616 shutdown_connections 2023-10-07T09:00:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.130+0000 7f4f0deba700 1 -- 172.21.15.46:0/4236746616 wait complete. 2023-10-07T09:00:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.131+0000 7f4f0deba700 1 Processor -- start 2023-10-07T09:00:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.131+0000 7f4f0deba700 1 -- start start 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 0x7f4f0814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 0x7f4f080b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0814c8c0 con 0x7f4f0815df50 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080c56b0 con 0x7f4f0806c0a0 2023-10-07T09:00:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f0deba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080c5990 con 0x7f4f0806bcd0 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f07fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f07fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46466/0 (socket says 172.21.15.46:46466) 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f07fff700 1 -- 172.21.15.46:0/1089454719 learned_addr learned my addr 172.21.15.46:0/1089454719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f077fe700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 0x7f4f0814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f06ffd700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 0x7f4f080b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.132+0000 7f4f07fff700 1 -- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 msgr2=0x7f4f0814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f07fff700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 0x7f4f0814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f07fff700 1 -- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 msgr2=0x7f4f080b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f07fff700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 0x7f4f080b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f07fff700 1 -- 172.21.15.46:0/1089454719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80094f0 con 0x7f4f0815df50 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f077fe700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 0x7f4f0814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f06ffd700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 0x7f4f080b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f07fff700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000cee0 tx=0x7f4f00007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0000ae60 con 0x7f4f0815df50 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00016430 con 0x7f4f0815df50 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f080b28b0 con 0x7f4f0815df50 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000167d0 con 0x7f4f0815df50 2023-10-07T09:00:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.133+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f080b2bd0 con 0x7f4f0815df50 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.134+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0815c240 con 0x7f4f0815df50 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.134+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4f00003020 con 0x7f4f0815df50 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.135+0000 7f4eff7fe700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 0x7f4ee8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.135+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f00012070 con 0x7f4f0815df50 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.135+0000 7f4f077fe700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 0x7f4ee8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.135+0000 7f4f077fe700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 0x7f4ee8069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.139+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f000526a0 con 0x7f4f0815df50 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.411+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f0804c3f0 con 0x7f4f0815df50 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.411+0000 7f4eff7fe700 1 -- 172.21.15.46:0/1089454719 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4f00055cc0 con 0x7f4f0815df50 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:00:28.412 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.413 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:00:28.414 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.416 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.417 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:00:28.418 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.419 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:00:28.421 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:00:28.423 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:00:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.426 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:28.428 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:00:28.428 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:00:28.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 msgr2=0x7f4ee8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 0x7f4ee8069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0007e30 comp rx=0 tx=0).stop 2023-10-07T09:00:28.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 msgr2=0x7f4f0816a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000cee0 tx=0x7f4f00007870 comp rx=0 tx=0).stop 2023-10-07T09:00:28.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 shutdown_connections 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4ee8066fc0 0x7f4ee8069470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0815df50 0x7f4f0816a5b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f0806bcd0 0x7f4f0814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 --2- 172.21.15.46:0/1089454719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0806c0a0 0x7f4f080b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.413+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 >> 172.21.15.46:0/1089454719 conn(0x7f4f080ce600 msgr2=0x7f4f0815bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.414+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 shutdown_connections 2023-10-07T09:00:28.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.414+0000 7f4f0deba700 1 -- 172.21.15.46:0/1089454719 wait complete. 2023-10-07T09:00:28.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.548+0000 7f229f065700 1 Processor -- start 2023-10-07T09:00:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.548+0000 7f229f065700 1 -- start start 2023-10-07T09:00:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229f065700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f22980b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229f065700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980b2980 con 0x7f22981597f0 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229f065700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980b11d0 con 0x7f229815d230 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229f065700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22980b14b0 con 0x7f2298159420 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229d862700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f22981597f0 0x7f22980b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35802/0 (socket says 172.21.15.46:35802) 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229d862700 1 -- 172.21.15.46:0/2993594232 learned_addr learned my addr 172.21.15.46:0/2993594232 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229e063700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f22980b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.549+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138657789 0 0) 0x7f22980b2980 con 0x7f22981597f0 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003570 con 0x7f22981597f0 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540058230 0 0) 0x7f2280003570 con 0x7f22981597f0 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 msgr2=0x7f22980b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f22980b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 >> v1:172.21.15.133:6789/0 conn(0x7f229815d230 legacy=0x7f22980b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980b1790 con 0x7f22981597f0 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f228c001470 con 0x7f22981597f0 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 >> v1:172.21.15.46:6789/0 conn(0x7f22981597f0 legacy=0x7f22980b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2280003a90 0x7f2280003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f2280004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22980b14b0 con 0x7f2280003a90 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228000bb70 con 0x7f2280004d50 2023-10-07T09:00:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228000bd30 con 0x7f2298159420 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2280003a90 0x7f2280003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d862700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f2280004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e864700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 -- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 msgr2=0x7f2280004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f2280004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 -- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280004d50 msgr2=0x7f22800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 -- 172.21.15.46:0/2993594232 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280003570 con 0x7f2280003a90 2023-10-07T09:00:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e864700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229d862700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2298159420 0x7f2280004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.550+0000 7f229e063700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2280003a90 0x7f2280003ea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2290009c00 tx=0x7f22900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36834be1f1c9508b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000e710 con 0x7f2280003a90 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229000e870 con 0x7f2280003a90 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229d061700 1 -- 172.21.15.46:0/2993594232 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000ec30 con 0x7f2280003a90 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 -- 172.21.15.46:0/2993594232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2280003a90 msgr2=0x7f2280003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 --2- 172.21.15.46:0/2993594232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2280003a90 0x7f2280003ea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2290009c00 tx=0x7f22900091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229e864700 1 -- 172.21.15.46:0/2993594232 reap_dead start 2023-10-07T09:00:28.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 -- 172.21.15.46:0/2993594232 shutdown_connections 2023-10-07T09:00:28.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 -- 172.21.15.46:0/2993594232 >> 172.21.15.46:0/2993594232 conn(0x7f22980d0660 msgr2=0x7f22980d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:28.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 -- 172.21.15.46:0/2993594232 shutdown_connections 2023-10-07T09:00:28.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.551+0000 7f229f065700 1 -- 172.21.15.46:0/2993594232 wait complete. 2023-10-07T09:00:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.552+0000 7f229f065700 1 Processor -- start 2023-10-07T09:00:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.552+0000 7f229f065700 1 -- start start 2023-10-07T09:00:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 0x7f2298150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 0x7f229815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229815a5c0 con 0x7f229814c2a0 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298068670 con 0x7f2280003a90 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229f065700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298151350 con 0x7f229815a140 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229d862700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229d862700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46486/0 (socket says 172.21.15.46:46486) 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229d862700 1 -- 172.21.15.46:0/363207697 learned_addr learned my addr 172.21.15.46:0/363207697 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229e063700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 0x7f2298150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229e864700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 0x7f229815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229d862700 1 -- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 msgr2=0x7f229815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.553+0000 7f229d862700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 0x7f229815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229d862700 1 -- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 msgr2=0x7f2298150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229d862700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 0x7f2298150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229d862700 1 -- 172.21.15.46:0/363207697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229815cda0 con 0x7f229814c2a0 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229e864700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 0x7f229815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229e063700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 0x7f2298150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229d862700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f228c00eb90 tx=0x7f228c000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c017070 con 0x7f229814c2a0 2023-10-07T09:00:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00c8b0 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22980688c0 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00cc50 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.554+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2298068e80 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.555+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229804c3c0 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.555+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f228c004830 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.556+0000 7f22967fc700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 0x7f22840694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.556+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f228c083ef0 con 0x7f229814c2a0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.556+0000 7f229e063700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 0x7f22840694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.556+0000 7f229e063700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 0x7f22840694a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22980b4b30 tx=0x7f229001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.560+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f228c0514c0 con 0x7f229814c2a0 2023-10-07T09:00:28.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.754+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22980b1a70 con 0x7f229814c2a0 2023-10-07T09:00:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.755+0000 7f22967fc700 1 -- 172.21.15.46:0/363207697 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f228c054ae0 con 0x7f229814c2a0 2023-10-07T09:00:28.755 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:28.756 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":60,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:27.981465+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 msgr2=0x7f22840694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 0x7f22840694a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22980b4b30 tx=0x7f229001a000 comp rx=0 tx=0).stop 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 msgr2=0x7f2298159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f228c00eb90 tx=0x7f228c000c30 comp rx=0 tx=0).stop 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 shutdown_connections 2023-10-07T09:00:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2284066ff0 0x7f22840694a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f229815a140 0x7f229815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2280003a90 0x7f2298150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 --2- 172.21.15.46:0/363207697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229814c2a0 0x7f2298159c00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 >> 172.21.15.46:0/363207697 conn(0x7f22980d0660 msgr2=0x7f22980d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 shutdown_connections 2023-10-07T09:00:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.757+0000 7f229f065700 1 -- 172.21.15.46:0/363207697 wait complete. 2023-10-07T09:00:28.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:00:28.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:00:28.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.891+0000 7f3e529db700 1 Processor -- start 2023-10-07T09:00:28.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.891+0000 7f3e529db700 1 -- start start 2023-10-07T09:00:28.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e529db700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e4c159c60 0x7f3e4c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e529db700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c15a160 con 0x7f3e4c15db10 2023-10-07T09:00:28.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e529db700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0d13a0 con 0x7f3e4c159890 2023-10-07T09:00:28.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e529db700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15df50 con 0x7f3e4c159c60 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e4b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e4c159c60 0x7f3e4c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e50f78700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e4c15db10 0x7f3e4c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35810/0 (socket says 172.21.15.46:35810) 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e4b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e4c159c60 0x7f3e4c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46494/0 (socket says 172.21.15.46:46494) 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.892+0000 7f3e50f78700 1 -- 172.21.15.46:0/2829363741 learned_addr learned my addr 172.21.15.46:0/2829363741 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/2829363741 >> v1:172.21.15.133:6789/0 conn(0x7f3e4c159890 legacy=0x7f3e4c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/2829363741 >> v1:172.21.15.46:6789/0 conn(0x7f3e4c15db10 legacy=0x7f3e4c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/2829363741 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c15e140 con 0x7f3e4c159c60 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4affd700 1 -- 172.21.15.46:0/2829363741 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226185649 0 0) 0x7f3e4c15a160 con 0x7f3e4c15db10 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4b7fe700 1 --2- 172.21.15.46:0/2829363741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c15d5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098e0 tx=0x7f3e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fa608fbbcb05c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4affd700 1 -- 172.21.15.46:0/2829363741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34009e80 con 0x7f3e4c159c60 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4affd700 1 -- 172.21.15.46:0/2829363741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400b860 con 0x7f3e4c159c60 2023-10-07T09:00:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e4affd700 1 -- 172.21.15.46:0/2829363741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bbe0 con 0x7f3e4c159c60 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e529db700 1 -- 172.21.15.46:0/2829363741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 msgr2=0x7f3e4c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.893+0000 7f3e529db700 1 --2- 172.21.15.46:0/2829363741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c15d5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098e0 tx=0x7f3e340091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.894+0000 7f3e529db700 1 -- 172.21.15.46:0/2829363741 shutdown_connections 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.894+0000 7f3e529db700 1 --2- 172.21.15.46:0/2829363741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c15d5d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.894+0000 7f3e529db700 1 -- 172.21.15.46:0/2829363741 >> 172.21.15.46:0/2829363741 conn(0x7f3e4c068e20 msgr2=0x7f3e4c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.894+0000 7f3e529db700 1 -- 172.21.15.46:0/2829363741 shutdown_connections 2023-10-07T09:00:28.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.894+0000 7f3e529db700 1 -- 172.21.15.46:0/2829363741 wait complete. 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.895+0000 7f3e529db700 1 Processor -- start 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.895+0000 7f3e529db700 1 -- start start 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.895+0000 7f3e529db700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 0x7f3e4c0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 0x7f3e4c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b26c0 con 0x7f3e4c159c60 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b5c00 con 0x7f3e4c15db10 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b5ee0 con 0x7f3e4c159890 2023-10-07T09:00:28.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46496/0 (socket says 172.21.15.46:46496) 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/3846507673 learned_addr learned my addr 172.21.15.46:0/3846507673 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e50f78700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 0x7f3e4c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4bfff700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 0x7f3e4c0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 msgr2=0x7f3e4c0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 0x7f3e4c0b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 msgr2=0x7f3e4c0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 0x7f3e4c0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 -- 172.21.15.46:0/3846507673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009420 con 0x7f3e4c159c60 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e50f78700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 0x7f3e4c0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4bfff700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 0x7f3e4c0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e4b7fe700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c070e20 tx=0x7f3e34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3401f070 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34011420 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0b61c0 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bbe0 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.896+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c147750 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.897+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c04c3c0 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.898+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3e34011a50 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.898+0000 7f3e43fff700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 0x7f3e2c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.898+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e34085830 con 0x7f3e4c159c60 2023-10-07T09:00:28.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.898+0000 7f3e4bfff700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 0x7f3e2c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:28.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.899+0000 7f3e4bfff700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 0x7f3e2c069470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007fd0 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:28.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:28.903+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e34052e00 con 0x7f3e4c159c60 2023-10-07T09:00:29.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.094+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e4c06a5b0 con 0x7f3e4c159c60 2023-10-07T09:00:29.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.094+0000 7f3e43fff700 1 -- 172.21.15.46:0/3846507673 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e34015020 con 0x7f3e4c159c60 2023-10-07T09:00:29.095 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:00:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 msgr2=0x7f3e2c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 0x7f3e2c069470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007fd0 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-10-07T09:00:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 msgr2=0x7f3e4c147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c070e20 tx=0x7f3e34017000 comp rx=0 tx=0).stop 2023-10-07T09:00:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 shutdown_connections 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e2c066fc0 0x7f3e2c069470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c15db10 0x7f3e4c0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c159890 0x7f3e4c0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 --2- 172.21.15.46:0/3846507673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e4c159c60 0x7f3e4c147210 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 >> 172.21.15.46:0/3846507673 conn(0x7f3e4c068e20 msgr2=0x7f3e4c153420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 shutdown_connections 2023-10-07T09:00:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.096+0000 7f3e529db700 1 -- 172.21.15.46:0/3846507673 wait complete. 2023-10-07T09:00:29.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:00:29.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.228+0000 7f2d95e62700 1 Processor -- start 2023-10-07T09:00:29.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.228+0000 7f2d95e62700 1 -- start start 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159890 0x7f2d9015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d90159c60 0x7f2d9015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d9015db10 0x7f2d90069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9015a160 con 0x7f2d90159c60 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900d13a0 con 0x7f2d9015db10 2023-10-07T09:00:29.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d95e62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9015e140 con 0x7f2d90159890 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d90159c60 0x7f2d9015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d90159c60 0x7f2d9015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46512/0 (socket says 172.21.15.46:46512) 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 -- 172.21.15.46:0/3750302504 learned_addr learned my addr 172.21.15.46:0/3750302504 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8f7fe700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159890 0x7f2d9015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8ffff700 1 --2- 172.21.15.46:0/3750302504 >> v2:172.21.15.133:3300/0 conn(0x7f2d9015db10 0x7f2d90069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 -- 172.21.15.46:0/3750302504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159890 msgr2=0x7f2d9015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159890 0x7f2d9015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 -- 172.21.15.46:0/3750302504 >> v2:172.21.15.133:3300/0 conn(0x7f2d9015db10 msgr2=0x7f2d90069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 --2- 172.21.15.46:0/3750302504 >> v2:172.21.15.133:3300/0 conn(0x7f2d9015db10 0x7f2d90069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.229+0000 7f2d8effd700 1 -- 172.21.15.46:0/3750302504 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9015a3d0 con 0x7f2d90159c60 2023-10-07T09:00:29.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d8effd700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d90159c60 0x7f2d9015d5d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d90089b50 tx=0x7f2d84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30d930f9430256c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d8e7fc700 1 -- 172.21.15.46:0/3750302504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400b860 con 0x7f2d90159c60 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d8e7fc700 1 -- 172.21.15.46:0/3750302504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400b9c0 con 0x7f2d90159c60 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d8e7fc700 1 -- 172.21.15.46:0/3750302504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bd60 con 0x7f2d90159c60 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 -- 172.21.15.46:0/3750302504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d90159c60 msgr2=0x7f2d9015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d90159c60 0x7f2d9015d5d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d90089b50 tx=0x7f2d84009250 comp rx=0 tx=0).stop 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 -- 172.21.15.46:0/3750302504 shutdown_connections 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 --2- 172.21.15.46:0/3750302504 >> v2:172.21.15.133:3300/0 conn(0x7f2d9015db10 0x7f2d90069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159890 0x7f2d9015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 --2- 172.21.15.46:0/3750302504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d90159c60 0x7f2d9015d5d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 -- 172.21.15.46:0/3750302504 >> 172.21.15.46:0/3750302504 conn(0x7f2d90068e20 msgr2=0x7f2d900d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 -- 172.21.15.46:0/3750302504 shutdown_connections 2023-10-07T09:00:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.230+0000 7f2d95e62700 1 -- 172.21.15.46:0/3750302504 wait complete. 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 Processor -- start 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 -- start start 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90159890 0x7f2d900cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159c60 0x7f2d900cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900ce3d0 con 0x7f2d9015db10 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900cd7c0 con 0x7f2d90159890 2023-10-07T09:00:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d95e62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900cdaa0 con 0x7f2d90159c60 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46526/0 (socket says 172.21.15.46:46526) 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.232+0000 7f2d8ffff700 1 -- 172.21.15.46:0/685943407 learned_addr learned my addr 172.21.15.46:0/685943407 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8f7fe700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90159890 0x7f2d900cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 -- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159c60 msgr2=0x7f2d900cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8effd700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159c60 0x7f2d900cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159c60 0x7f2d900cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 -- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90159890 msgr2=0x7f2d900cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90159890 0x7f2d900cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 -- 172.21.15.46:0/685943407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840094f0 con 0x7f2d9015db10 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d8ffff700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d88007f20 tx=0x7f2d88009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800eca0 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8800ee20 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d900cdd80 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88014670 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.233+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9014cab0 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.234+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9004c3c0 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.234+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2d880149e0 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.235+0000 7f2d777fe700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 0x7f2d7c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.235+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2d880848f0 con 0x7f2d9015db10 2023-10-07T09:00:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.235+0000 7f2d8f7fe700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 0x7f2d7c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.236+0000 7f2d8f7fe700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 0x7f2d7c069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.239+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d88051ec0 con 0x7f2d9015db10 2023-10-07T09:00:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.433+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2d9006a5b0 con 0x7f2d9015db10 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.433+0000 7f2d777fe700 1 -- 172.21.15.46:0/685943407 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2d880554e0 con 0x7f2d9015db10 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:29.434 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 msgr2=0x7f2d7c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 0x7f2d7c069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).stop 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 msgr2=0x7f2d9014c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d88007f20 tx=0x7f2d88009860 comp rx=0 tx=0).stop 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 shutdown_connections 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d7c066fc0 0x7f2d7c069470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d9015db10 0x7f2d9014c570 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90159890 0x7f2d900cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 --2- 172.21.15.46:0/685943407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d90159c60 0x7f2d900cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 >> 172.21.15.46:0/685943407 conn(0x7f2d90068e20 msgr2=0x7f2d9015ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 shutdown_connections 2023-10-07T09:00:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.435+0000 7f2d95e62700 1 -- 172.21.15.46:0/685943407 wait complete. 2023-10-07T09:00:29.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:00:29.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:00:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.569+0000 7fc6e8b66700 1 Processor -- start 2023-10-07T09:00:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.569+0000 7fc6e8b66700 1 -- start start 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e8b66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 0x7fc6e4162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e8b66700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e415c320 con 0x7fc6e40b42c0 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e8b66700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e415b710 con 0x7fc6e4155360 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e8b66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e415b9f0 con 0x7fc6e40ced30 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e1d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc6e40b42c0 0x7fc6e40ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35818/0 (socket says 172.21.15.46:35818) 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e1d9b700 1 -- 172.21.15.46:0/318095626 learned_addr learned my addr 172.21.15.46:0/318095626 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.570+0000 7fc6e2d9d700 1 --2- 172.21.15.46:0/318095626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 0x7fc6e4162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039790659 0 0) 0x7fc6e415c320 con 0x7fc6e40b42c0 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d0003570 con 0x7fc6e40b42c0 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643981936 0 0) 0x7fc6e415b710 con 0x7fc6e4155360 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e415c320 con 0x7fc6e4155360 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/318095626 >> v1:172.21.15.133:6789/0 conn(0x7fc6e4155360 legacy=0x7fc6e40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/318095626 >> v1:172.21.15.46:6789/0 conn(0x7fc6e40b42c0 legacy=0x7fc6e40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1607656480 0 0) 0x7fc6d0003570 con 0x7fc6e40b42c0 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/318095626 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e415bcd0 con 0x7fc6e40ced30 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e2d9d700 1 --2- 172.21.15.46:0/318095626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 0x7fc6e4162910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009e90 tx=0x7fc6d4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c0b29ce31aa57c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400e070 con 0x7fc6e40ced30 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d400b870 con 0x7fc6e40ced30 2023-10-07T09:00:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.571+0000 7fc6e159a700 1 -- 172.21.15.46:0/318095626 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc001470 con 0x7fc6e40ced30 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 -- 172.21.15.46:0/318095626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 msgr2=0x7fc6e4162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/318095626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 0x7fc6e4162910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009e90 tx=0x7fc6d4009780 comp rx=0 tx=0).stop 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 -- 172.21.15.46:0/318095626 shutdown_connections 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/318095626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40ced30 0x7fc6e4162910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 -- 172.21.15.46:0/318095626 >> 172.21.15.46:0/318095626 conn(0x7fc6e406baf0 msgr2=0x7fc6e406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 -- 172.21.15.46:0/318095626 shutdown_connections 2023-10-07T09:00:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.572+0000 7fc6e8b66700 1 -- 172.21.15.46:0/318095626 wait complete. 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.573+0000 7fc6e8b66700 1 Processor -- start 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.573+0000 7fc6e8b66700 1 -- start start 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40b42c0 0x7fc6e40c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40ced30 0x7fc6e40c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40b0ae0 con 0x7fc6e4155360 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40afed0 con 0x7fc6e40ced30 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e8b66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40b01b0 con 0x7fc6e40b42c0 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46528/0 (socket says 172.21.15.46:46528) 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/3518611073 learned_addr learned my addr 172.21.15.46:0/3518611073 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e1d9b700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40ced30 0x7fc6e40c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e259c700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40b42c0 0x7fc6e40c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40b42c0 msgr2=0x7fc6e40c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40b42c0 0x7fc6e40c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40ced30 msgr2=0x7fc6e40c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40ced30 0x7fc6e40c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 -- 172.21.15.46:0/3518611073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4009a20 con 0x7fc6e4155360 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6e2d9d700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009de0 tx=0x7fc6d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.574+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4012c20 con 0x7fc6e4155360 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.575+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40b0490 con 0x7fc6e4155360 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.575+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d4012d80 con 0x7fc6e4155360 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.575+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d401e6a0 con 0x7fc6e4155360 2023-10-07T09:00:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.575+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40ca090 con 0x7fc6e4155360 2023-10-07T09:00:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.575+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e40b0c90 con 0x7fc6e4155360 2023-10-07T09:00:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.576+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc6d401ead0 con 0x7fc6e4155360 2023-10-07T09:00:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.576+0000 7fc6da7fc700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 0x7fc6c4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.576+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6d40861b0 con 0x7fc6e4155360 2023-10-07T09:00:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.576+0000 7fc6e259c700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 0x7fc6c4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.577+0000 7fc6e259c700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 0x7fc6c4069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007fd0 tx=0x7fc6dc007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.580+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6e40b0c90 con 0x7fc6e4155360 2023-10-07T09:00:29.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.772+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc6e40718b0 con 0x7fc6e4155360 2023-10-07T09:00:29.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.989+0000 7fc6da7fc700 1 -- 172.21.15.46:0/3518611073 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc6d4053670 con 0x7fc6e4155360 2023-10-07T09:00:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 msgr2=0x7fc6c4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 0x7fc6c4069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007fd0 tx=0x7fc6dc007d50 comp rx=0 tx=0).stop 2023-10-07T09:00:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 msgr2=0x7fc6e40c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009de0 tx=0x7fc6d4017000 comp rx=0 tx=0).stop 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 shutdown_connections 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6c4066fc0 0x7fc6c4069470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e4155360 0x7fc6e40c3900 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6e40b42c0 0x7fc6e40c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 --2- 172.21.15.46:0/3518611073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40ced30 0x7fc6e40c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 >> 172.21.15.46:0/3518611073 conn(0x7fc6e406baf0 msgr2=0x7fc6e40b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 shutdown_connections 2023-10-07T09:00:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:29.993+0000 7fc6e8b66700 1 -- 172.21.15.46:0/3518611073 wait complete. 2023-10-07T09:00:29.996 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:00:30.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:00:30.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.132+0000 7ff4cac37700 1 Processor -- start 2023-10-07T09:00:30.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4cac37700 1 -- start start 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4cac37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4c4157630 0x7ff4c4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4cac37700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4158590 con 0x7ff4c4068390 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4cac37700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4157f80 con 0x7ff4c4157a00 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4cac37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40ac7a0 con 0x7ff4c4157630 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.133+0000 7ff4c91d4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff4c4068390 0x7ff4c40687b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42554/0 (socket says 172.21.15.46:42554) 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c91d4700 1 -- 172.21.15.46:0/2894516102 learned_addr learned my addr 172.21.15.46:0/2894516102 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271933028 0 0) 0x7ff4c4158590 con 0x7ff4c4068390 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/2894516102 >> v2:172.21.15.133:3300/0 conn(0x7ff4c4157630 0x7ff4c4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac003570 con 0x7ff4c4068390 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908792149 0 0) 0x7ff4ac003570 con 0x7ff4c4068390 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 >> v2:172.21.15.133:3300/0 conn(0x7ff4c4157630 msgr2=0x7ff4c4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2894516102 >> v2:172.21.15.133:3300/0 conn(0x7ff4c4157630 0x7ff4c4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 >> v1:172.21.15.133:6789/0 conn(0x7ff4c4157a00 legacy=0x7ff4c40abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4158220 con 0x7ff4c4068390 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7ff4bc0017f0 con 0x7ff4c4068390 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 >> v1:172.21.15.46:6789/0 conn(0x7ff4c4068390 legacy=0x7ff4c40687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 0x7ff4ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac004810 0x7ff4ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ac0051c0 0x7ff4ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40ac7a0 con 0x7ff4ac003a60 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac00c0d0 con 0x7ff4ac0051c0 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac00c290 con 0x7ff4ac004810 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 0x7ff4ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c91d4700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ac0051c0 0x7ff4ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.134+0000 7ff4c3fff700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac004810 0x7ff4ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 -- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac004810 msgr2=0x7ff4ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac004810 0x7ff4ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 -- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ac0051c0 msgr2=0x7ff4ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ac0051c0 0x7ff4ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 -- 172.21.15.46:0/2894516102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac003570 con 0x7ff4ac003a60 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c91d4700 1 -- 172.21.15.46:0/2894516102 reap_dead start 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 0x7ff4ac003e70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009c00 tx=0x7ff4b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dad02035c32e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4013720 con 0x7ff4ac003a60 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4013880 con 0x7ff4ac003a60 2023-10-07T09:00:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4c37fe700 1 -- 172.21.15.46:0/2894516102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4013c40 con 0x7ff4ac003a60 2023-10-07T09:00:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4cac37700 1 -- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 msgr2=0x7ff4ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.135+0000 7ff4cac37700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 0x7ff4ac003e70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009c00 tx=0x7ff4b40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.136+0000 7ff4cac37700 1 -- 172.21.15.46:0/2894516102 shutdown_connections 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.136+0000 7ff4cac37700 1 --2- 172.21.15.46:0/2894516102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ac003a60 0x7ff4ac003e70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.136+0000 7ff4cac37700 1 -- 172.21.15.46:0/2894516102 >> 172.21.15.46:0/2894516102 conn(0x7ff4c40cc540 msgr2=0x7ff4c40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.136+0000 7ff4cac37700 1 -- 172.21.15.46:0/2894516102 shutdown_connections 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.136+0000 7ff4cac37700 1 -- 172.21.15.46:0/2894516102 wait complete. 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.137+0000 7ff4cac37700 1 Processor -- start 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.137+0000 7ff4cac37700 1 -- start start 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.137+0000 7ff4cac37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac003a60 0x7ff4c40af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4169cd0 0x7ff4c40c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c4590 con 0x7ff4c40c2970 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c416a140 con 0x7ff4c4169cd0 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40af980 con 0x7ff4ac003a60 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53328/0 (socket says 172.21.15.46:53328) 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 -- 172.21.15.46:0/1253283689 learned_addr learned my addr 172.21.15.46:0/1253283689 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac003a60 0x7ff4c40af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c3fff700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4169cd0 0x7ff4c40c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 -- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac003a60 msgr2=0x7ff4c40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac003a60 0x7ff4c40af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 -- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4169cd0 msgr2=0x7ff4c40c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4169cd0 0x7ff4c40c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 -- 172.21.15.46:0/1253283689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40afc60 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c91d4700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40abb40 tx=0x7ff4bc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00ace0 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00ae40 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc013620 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40aff40 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.138+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c406efb0 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.139+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c40718b0 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.140+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff4bc0139d0 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.140+0000 7ff4c0ff9700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 0x7ff4b0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.140+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff4bc085630 con 0x7ff4c40c2970 2023-10-07T09:00:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.141+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 0x7ff4b0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:30.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.141+0000 7ff4c89d3700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 0x7ff4b0069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff4b401e040 tx=0x7ff4b401b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:30.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.144+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4bc052bd0 con 0x7ff4c40c2970 2023-10-07T09:00:30.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.336+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff4c40aca80 con 0x7ff4c40c2970 2023-10-07T09:00:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.993+0000 7ff4c0ff9700 1 -- 172.21.15.46:0/1253283689 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff4bc083e60 con 0x7ff4c40c2970 2023-10-07T09:00:30.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.998+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 msgr2=0x7ff4b0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.998+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 0x7ff4b0069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff4b401e040 tx=0x7ff4b401b000 comp rx=0 tx=0).stop 2023-10-07T09:00:30.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.998+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 msgr2=0x7ff4c406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:30.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:30.998+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40abb40 tx=0x7ff4bc0021d0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 shutdown_connections 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff4b0066fc0 0x7ff4b0069470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c40c2970 0x7ff4c406ea70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ac003a60 0x7ff4c40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 --2- 172.21.15.46:0/1253283689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4169cd0 0x7ff4c40c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.002+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 >> 172.21.15.46:0/1253283689 conn(0x7ff4c40cc540 msgr2=0x7ff4c406d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:31.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.005+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 shutdown_connections 2023-10-07T09:00:31.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.005+0000 7ff4cac37700 1 -- 172.21.15.46:0/1253283689 wait complete. 2023-10-07T09:00:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:00:31.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:00:31.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.152+0000 7f8424399700 1 Processor -- start 2023-10-07T09:00:31.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.152+0000 7f8424399700 1 -- start start 2023-10-07T09:00:31.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8424399700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 0x7f841c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8424399700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f841c069560 0x7f841c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8424399700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c069ee0 con 0x7f841c159c60 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8424399700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c15a160 con 0x7f841c069560 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8424399700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0d13a0 con 0x7f841c159890 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8422936700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f841c069560 0x7f841c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8421934700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f841c159c60 0x7f841c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42560/0 (socket says 172.21.15.46:42560) 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.153+0000 7f8421934700 1 -- 172.21.15.46:0/4148508999 learned_addr learned my addr 172.21.15.46:0/4148508999 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422135700 1 --2- 172.21.15.46:0/4148508999 >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 0x7f841c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422936700 1 -- 172.21.15.46:0/4148508999 >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 msgr2=0x7f841c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:31.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422936700 1 --2- 172.21.15.46:0/4148508999 >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 0x7f841c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422936700 1 -- 172.21.15.46:0/4148508999 >> v1:172.21.15.46:6789/0 conn(0x7f841c159c60 legacy=0x7f841c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8421133700 1 -- 172.21.15.46:0/4148508999 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610346372 0 0) 0x7f841c069ee0 con 0x7f841c159c60 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422936700 1 -- 172.21.15.46:0/4148508999 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c15e140 con 0x7f841c069560 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422135700 1 --2- 172.21.15.46:0/4148508999 >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 0x7f841c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8422936700 1 --2- 172.21.15.46:0/4148508999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c0699a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f841c0d1090 tx=0x7f840c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d93c10dc8bdb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8421133700 1 -- 172.21.15.46:0/4148508999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00e070 con 0x7f841c069560 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8421133700 1 -- 172.21.15.46:0/4148508999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c00bc30 con 0x7f841c069560 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8421133700 1 -- 172.21.15.46:0/4148508999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c012430 con 0x7f841c069560 2023-10-07T09:00:31.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.154+0000 7f8424399700 1 -- 172.21.15.46:0/4148508999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 msgr2=0x7f841c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 --2- 172.21.15.46:0/4148508999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c0699a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f841c0d1090 tx=0x7f840c009780 comp rx=0 tx=0).stop 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 -- 172.21.15.46:0/4148508999 shutdown_connections 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 --2- 172.21.15.46:0/4148508999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c0699a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 --2- 172.21.15.46:0/4148508999 >> v2:172.21.15.133:3300/0 conn(0x7f841c159890 0x7f841c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 -- 172.21.15.46:0/4148508999 >> 172.21.15.46:0/4148508999 conn(0x7f841c068e20 msgr2=0x7f841c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 -- 172.21.15.46:0/4148508999 shutdown_connections 2023-10-07T09:00:31.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.155+0000 7f8424399700 1 -- 172.21.15.46:0/4148508999 wait complete. 2023-10-07T09:00:31.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 Processor -- start 2023-10-07T09:00:31.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 -- start start 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c159890 0x7f841c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f841c159c60 0x7f841c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c154960 con 0x7f841c069560 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0cec30 con 0x7f841c159890 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.156+0000 7f8424399700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0cef10 con 0x7f841c159c60 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53340/0 (socket says 172.21.15.46:53340) 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 -- 172.21.15.46:0/1184495750 learned_addr learned my addr 172.21.15.46:0/1184495750 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 -- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f841c159c60 msgr2=0x7f841c0ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f841c159c60 0x7f841c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 -- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c159890 msgr2=0x7f841c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8421934700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c159890 0x7f841c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c159890 0x7f841c0ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 -- 172.21.15.46:0/1184495750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009a20 con 0x7f841c069560 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8422135700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f841400e8d0 tx=0x7f8414008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400ee70 con 0x7f841c069560 2023-10-07T09:00:31.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400c5e0 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c0cf1f0 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400c980 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.157+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c0cf7b0 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.158+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c04c3c0 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.159+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8414013410 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.159+0000 7f841a7fc700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 0x7f8408069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.159+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8414084510 con 0x7f841c069560 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.160+0000 7f8421934700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 0x7f8408069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:31.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.160+0000 7f8421934700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 0x7f8408069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c0c6fe0 tx=0x7f8410009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:31.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.164+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84140515e0 con 0x7f841c069560 2023-10-07T09:00:31.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:31.404+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f841c0d1570 con 0x7f841c069560 2023-10-07T09:00:32.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.012+0000 7f841a7fc700 1 -- 172.21.15.46:0/1184495750 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8414054c00 con 0x7f841c069560 2023-10-07T09:00:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 msgr2=0x7f8408069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 0x7f8408069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c0c6fe0 tx=0x7f8410009040 comp rx=0 tx=0).stop 2023-10-07T09:00:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 msgr2=0x7f841c1460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f841400e8d0 tx=0x7f8414008040 comp rx=0 tx=0).stop 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 shutdown_connections 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8408066fc0 0x7f8408069470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f841c159c60 0x7f841c0ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f841c069560 0x7f841c1460d0 secure :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f841400e8d0 tx=0x7f8414008040 comp rx=0 tx=0).stop 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 --2- 172.21.15.46:0/1184495750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c159890 0x7f841c0ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.022+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 >> 172.21.15.46:0/1184495750 conn(0x7f841c068e20 msgr2=0x7f841c1553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.023+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 shutdown_connections 2023-10-07T09:00:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.023+0000 7f8424399700 1 -- 172.21.15.46:0/1184495750 wait complete. 2023-10-07T09:00:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 10 and data pool 11 2023-10-07T09:00:32.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.159+0000 7f542b59e700 1 Processor -- start 2023-10-07T09:00:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.159+0000 7f542b59e700 1 -- start start 2023-10-07T09:00:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f542c142ea0 0x7f542c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542b59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0b40f0 con 0x7f542c06c0f0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c069640 con 0x7f542c0ad870 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c069920 con 0x7f542c142ea0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f542c06c0f0 0x7f542c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42574/0 (socket says 172.21.15.46:42574) 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542ad9d700 1 -- 172.21.15.46:0/2109179491 learned_addr learned my addr 172.21.15.46:0/2109179491 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542a59c700 1 --2- 172.21.15.46:0/2109179491 >> v2:172.21.15.133:3300/0 conn(0x7f542c142ea0 0x7f542c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538692349 0 0) 0x7f542c0b40f0 con 0x7f542c06c0f0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.160+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5414003570 con 0x7f542c06c0f0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925881927 0 0) 0x7f5414003570 con 0x7f542c06c0f0 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542a59c700 1 -- 172.21.15.46:0/2109179491 >> v1:172.21.15.133:6789/0 conn(0x7f542c0ad870 legacy=0x7f542c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542a59c700 1 -- 172.21.15.46:0/2109179491 >> v1:172.21.15.46:6789/0 conn(0x7f542c06c0f0 legacy=0x7f542c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542a59c700 1 -- 172.21.15.46:0/2109179491 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c069c00 con 0x7f542c142ea0 2023-10-07T09:00:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542a59c700 1 --2- 172.21.15.46:0/2109179491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c142ea0 0x7f542c0b3630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f541c0098e0 tx=0x7f541c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c12e69cc9795ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240017f0 con 0x7f542c142ea0 2023-10-07T09:00:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c011420 con 0x7f542c142ea0 2023-10-07T09:00:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542959a700 1 -- 172.21.15.46:0/2109179491 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0117c0 con 0x7f542c142ea0 2023-10-07T09:00:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542b59e700 1 -- 172.21.15.46:0/2109179491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c142ea0 msgr2=0x7f542c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.161+0000 7f542b59e700 1 --2- 172.21.15.46:0/2109179491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c142ea0 0x7f542c0b3630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f541c0098e0 tx=0x7f541c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.162+0000 7f542b59e700 1 -- 172.21.15.46:0/2109179491 shutdown_connections 2023-10-07T09:00:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.162+0000 7f542b59e700 1 --2- 172.21.15.46:0/2109179491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c142ea0 0x7f542c0b3630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.162+0000 7f542b59e700 1 -- 172.21.15.46:0/2109179491 >> 172.21.15.46:0/2109179491 conn(0x7f542c0ce430 msgr2=0x7f542c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.162+0000 7f542b59e700 1 -- 172.21.15.46:0/2109179491 shutdown_connections 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.162+0000 7f542b59e700 1 -- 172.21.15.46:0/2109179491 wait complete. 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 Processor -- start 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 -- start start 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 0x7f542c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c13f0d0 0x7f542c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0c8c30 con 0x7f542c142ea0 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0c8930 con 0x7f542c13f0d0 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.163+0000 7f542b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c159590 con 0x7f542c06c0f0 2023-10-07T09:00:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53356/0 (socket says 172.21.15.46:53356) 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 -- 172.21.15.46:0/709913551 learned_addr learned my addr 172.21.15.46:0/709913551 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f542a59c700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 0x7f542c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 -- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 msgr2=0x7f542c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f542ad9d700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c13f0d0 0x7f542c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 0x7f542c159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 -- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c13f0d0 msgr2=0x7f542c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c13f0d0 0x7f542c15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 -- 172.21.15.46:0/709913551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009420 con 0x7f542c142ea0 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f542a59c700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 0x7f542c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f5429d9b700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f542000c7f0 tx=0x7f5420007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420011590 con 0x7f542c142ea0 2023-10-07T09:00:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200116f0 con 0x7f542c142ea0 2023-10-07T09:00:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c16a440 con 0x7f542c142ea0 2023-10-07T09:00:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420011ab0 con 0x7f542c142ea0 2023-10-07T09:00:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.164+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c16aa00 con 0x7f542c142ea0 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.165+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0c8de0 con 0x7f542c142ea0 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.166+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f542001b3b0 con 0x7f542c142ea0 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.166+0000 7f541a7fc700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 0x7f540c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.166+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5420083aa0 con 0x7f542c142ea0 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.166+0000 7f542a59c700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 0x7f540c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.167+0000 7f542a59c700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 0x7f540c069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f542c0cc630 tx=0x7f541c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.170+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f542c0c8de0 con 0x7f542c142ea0 2023-10-07T09:00:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.363+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f542c0c8de0 con 0x7f542c142ea0 2023-10-07T09:00:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.364+0000 7f541a7fc700 1 -- 172.21.15.46:0/709913551 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f542c0c8de0 con 0x7f542c142ea0 2023-10-07T09:00:32.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:32.365 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":63,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:31.405804+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 msgr2=0x7f540c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 0x7f540c069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f542c0cc630 tx=0x7f541c016000 comp rx=0 tx=0).stop 2023-10-07T09:00:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 msgr2=0x7f542c169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f542000c7f0 tx=0x7f5420007f50 comp rx=0 tx=0).stop 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 shutdown_connections 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f540c066fc0 0x7f540c069470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f542c13f0d0 0x7f542c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f542c06c0f0 0x7f542c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 --2- 172.21.15.46:0/709913551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f542c142ea0 0x7f542c169ae0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 >> 172.21.15.46:0/709913551 conn(0x7f542c0ce430 msgr2=0x7f542c141f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 shutdown_connections 2023-10-07T09:00:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.366+0000 7f542b59e700 1 -- 172.21.15.46:0/709913551 wait complete. 2023-10-07T09:00:32.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.498+0000 7f4165a0b700 1 Processor -- start 2023-10-07T09:00:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.498+0000 7f4165a0b700 1 -- start start 2023-10-07T09:00:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4165a0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4165a0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 0x7f41600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4165a0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b11d0 con 0x7f416015d230 2023-10-07T09:00:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4165a0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41600b14b0 con 0x7f41601597f0 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4165a0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600b1790 con 0x7f4160159420 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f415ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 0x7f41600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:60210/0 (socket says 172.21.15.46:60210) 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f415ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 0x7f41600b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:44916/0 (socket says 172.21.15.46:44916) 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 -- 172.21.15.46:0/3428881799 learned_addr learned my addr 172.21.15.46:0/3428881799 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 -- 172.21.15.46:0/3428881799 >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 msgr2=0x7f41600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 --2- 172.21.15.46:0/3428881799 >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 0x7f41600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 -- 172.21.15.46:0/3428881799 >> v1:172.21.15.133:6789/0 conn(0x7f416015d230 legacy=0x7f41600b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.499+0000 7f4164a09700 1 -- 172.21.15.46:0/3428881799 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600b1a70 con 0x7f4160159420 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4164a09700 1 --2- 172.21.15.46:0/3428881799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41540099b0 tx=0x7f4154009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2f81eca9384689 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f415f7fe700 1 -- 172.21.15.46:0/3428881799 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154009ea0 con 0x7f4160159420 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f415f7fe700 1 -- 172.21.15.46:0/3428881799 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400b860 con 0x7f4160159420 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f415f7fe700 1 -- 172.21.15.46:0/3428881799 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400bc00 con 0x7f4160159420 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 -- 172.21.15.46:0/3428881799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 msgr2=0x7f41600b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 --2- 172.21.15.46:0/3428881799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41540099b0 tx=0x7f4154009250 comp rx=0 tx=0).stop 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 -- 172.21.15.46:0/3428881799 shutdown_connections 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 --2- 172.21.15.46:0/3428881799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f41600b5f40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 --2- 172.21.15.46:0/3428881799 >> v2:172.21.15.133:3300/0 conn(0x7f41601597f0 0x7f41600b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 -- 172.21.15.46:0/3428881799 >> 172.21.15.46:0/3428881799 conn(0x7f41600d0660 msgr2=0x7f41600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 -- 172.21.15.46:0/3428881799 shutdown_connections 2023-10-07T09:00:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.500+0000 7f4165a0b700 1 -- 172.21.15.46:0/3428881799 wait complete. 2023-10-07T09:00:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 Processor -- start 2023-10-07T09:00:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 -- start start 2023-10-07T09:00:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f416014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41601597f0 0x7f416014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416015cfb0 con 0x7f416015d230 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160152ba0 con 0x7f41601597f0 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.502+0000 7f4165a0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160152d30 con 0x7f4160159420 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53358/0 (socket says 172.21.15.46:53358) 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 -- 172.21.15.46:0/1582111849 learned_addr learned my addr 172.21.15.46:0/1582111849 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f4164a09700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f416014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f415ffff700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41601597f0 0x7f416014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 -- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 msgr2=0x7f416014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f416014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 -- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41601597f0 msgr2=0x7f416014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41601597f0 0x7f416014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 -- 172.21.15.46:0/1582111849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540094f0 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f4164a09700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f416014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f416520a700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f415800c840 tx=0x7f4158001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158012630 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580127b0 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416014f2c0 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158012b70 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.503+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416014fb60 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.504+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416014f4b0 con 0x7f416015d230 2023-10-07T09:00:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.505+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4158003030 con 0x7f416015d230 2023-10-07T09:00:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.505+0000 7f415cff9700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 0x7f4144069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.505+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4158084510 con 0x7f416015d230 2023-10-07T09:00:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.505+0000 7f4164a09700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 0x7f4144069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.506+0000 7f4164a09700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 0x7f4144069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41540099b0 tx=0x7f4154017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.509+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4158051790 con 0x7f416015d230 2023-10-07T09:00:32.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.702+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f416004c3c0 con 0x7f416015d230 2023-10-07T09:00:32.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.703+0000 7f415cff9700 1 -- 172.21.15.46:0/1582111849 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f4158054db0 con 0x7f416015d230 2023-10-07T09:00:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:32.704 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":63,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:31.405804+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 msgr2=0x7f4144069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 0x7f4144069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41540099b0 tx=0x7f4154017000 comp rx=0 tx=0).stop 2023-10-07T09:00:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 msgr2=0x7f416014de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f415800c840 tx=0x7f4158001670 comp rx=0 tx=0).stop 2023-10-07T09:00:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 shutdown_connections 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4144066fc0 0x7f4144069470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f416015d230 0x7f416014de60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4160159420 0x7f416014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 --2- 172.21.15.46:0/1582111849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41601597f0 0x7f416014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 >> 172.21.15.46:0/1582111849 conn(0x7f41600d0660 msgr2=0x7f41600b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 shutdown_connections 2023-10-07T09:00:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.705+0000 7f4165a0b700 1 -- 172.21.15.46:0/1582111849 wait complete. 2023-10-07T09:00:32.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:00:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.839+0000 7fad0759e700 1 Processor -- start 2023-10-07T09:00:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.839+0000 7fad0759e700 1 -- start start 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 0x7fad08069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080c9cb0 con 0x7fad0806a020 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0806dfc0 con 0x7fad080ccc00 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080c9f30 con 0x7fad08159a60 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad05d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 0x7fad08069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad05d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 0x7fad08069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:44938/0 (socket says 172.21.15.46:44938) 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad0659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:60230/0 (socket says 172.21.15.46:60230) 2023-10-07T09:00:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.840+0000 7fad05d9b700 1 -- 172.21.15.46:0/653979306 learned_addr learned my addr 172.21.15.46:0/653979306 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0659c700 1 -- 172.21.15.46:0/653979306 >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 msgr2=0x7fad08069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0659c700 1 --2- 172.21.15.46:0/653979306 >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 0x7fad08069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0659c700 1 -- 172.21.15.46:0/653979306 >> v1:172.21.15.133:6789/0 conn(0x7fad0806a020 legacy=0x7fad080cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0659c700 1 -- 172.21.15.46:0/653979306 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080ca470 con 0x7fad08159a60 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0659c700 1 --2- 172.21.15.46:0/653979306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0454499c6452dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0559a700 1 -- 172.21.15.46:0/653979306 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800b6d0 con 0x7fad08159a60 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0559a700 1 -- 172.21.15.46:0/653979306 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800b830 con 0x7fad08159a60 2023-10-07T09:00:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.841+0000 7fad0559a700 1 -- 172.21.15.46:0/653979306 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800bbd0 con 0x7fad08159a60 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 -- 172.21.15.46:0/653979306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 msgr2=0x7fad080c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 --2- 172.21.15.46:0/653979306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 -- 172.21.15.46:0/653979306 shutdown_connections 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 --2- 172.21.15.46:0/653979306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080c9770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 --2- 172.21.15.46:0/653979306 >> v2:172.21.15.133:3300/0 conn(0x7fad080ccc00 0x7fad08069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 -- 172.21.15.46:0/653979306 >> 172.21.15.46:0/653979306 conn(0x7fad0806baa0 msgr2=0x7fad0806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 -- 172.21.15.46:0/653979306 shutdown_connections 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.842+0000 7fad0759e700 1 -- 172.21.15.46:0/653979306 wait complete. 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 Processor -- start 2023-10-07T09:00:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 -- start start 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 0x7fad080c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b3980 con 0x7fad080ccc00 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b2d70 con 0x7fad0806a020 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.843+0000 7fad0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b3050 con 0x7fad08159a60 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53368/0 (socket says 172.21.15.46:53368) 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 -- 172.21.15.46:0/850714996 learned_addr learned my addr 172.21.15.46:0/850714996 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad06d9d700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad0659c700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 0x7fad080c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 -- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 msgr2=0x7fad080a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 -- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 msgr2=0x7fad080c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 0x7fad080c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 -- 172.21.15.46:0/850714996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009420 con 0x7fad080ccc00 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad0659c700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 0x7fad080c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad05d9b700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7facf000ea50 tx=0x7facf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000c850 con 0x7fad080ccc00 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000c9b0 con 0x7fad080ccc00 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080b3330 con 0x7fad080ccc00 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000cd30 con 0x7fad080ccc00 2023-10-07T09:00:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.844+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080b3e10 con 0x7fad080ccc00 2023-10-07T09:00:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.845+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0806eba0 con 0x7fad080ccc00 2023-10-07T09:00:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.846+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7facf0013680 con 0x7fad080ccc00 2023-10-07T09:00:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.846+0000 7facfe7fc700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 0x7face8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.846+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7facf0084850 con 0x7fad080ccc00 2023-10-07T09:00:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.847+0000 7fad0659c700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 0x7face8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.847+0000 7fad0659c700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 0x7face8069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7facf8003080 tx=0x7facf8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:32.851+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf0051ad0 con 0x7fad080ccc00 2023-10-07T09:00:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:33.090+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fad080b3ac0 con 0x7fad080ccc00 2023-10-07T09:00:34.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.021+0000 7facfe7fc700 1 -- 172.21.15.46:0/850714996 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7facf00550f0 con 0x7fad080ccc00 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 msgr2=0x7face8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 0x7face8069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7facf8003080 tx=0x7facf8017000 comp rx=0 tx=0).stop 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 msgr2=0x7fad080b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7facf000ea50 tx=0x7facf0009250 comp rx=0 tx=0).stop 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 shutdown_connections 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7face8066fc0 0x7face8069470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad08159a60 0x7fad080a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad0806a020 0x7fad080c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 --2- 172.21.15.46:0/850714996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad080ccc00 0x7fad080b2400 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 >> 172.21.15.46:0/850714996 conn(0x7fad0806baa0 msgr2=0x7fad08158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:34.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 shutdown_connections 2023-10-07T09:00:34.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.024+0000 7fad0759e700 1 -- 172.21.15.46:0/850714996 wait complete. 2023-10-07T09:00:34.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:00:34.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.167+0000 7f957de69700 1 Processor -- start 2023-10-07T09:00:34.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.167+0000 7f957de69700 1 -- start start 2023-10-07T09:00:34.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957de69700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95780b4e70 0x7f95780ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957de69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b1b40 0x7f957815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957de69700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95780cfb00 con 0x7f95780b16d0 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957de69700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95780b5c40 con 0x7f95780b4e70 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957de69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780b5f20 con 0x7f95780b1b40 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957ce67700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95780b4e70 0x7f95780ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957ce67700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95780b4e70 0x7f95780ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53380/0 (socket says 172.21.15.46:53380) 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f9577fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95780b16d0 0x7f957815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42580/0 (socket says 172.21.15.46:42580) 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.168+0000 7f957ce67700 1 -- 172.21.15.46:0/3109266554 learned_addr learned my addr 172.21.15.46:0/3109266554 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957ce67700 1 -- 172.21.15.46:0/3109266554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b1b40 msgr2=0x7f957815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957ce67700 1 --2- 172.21.15.46:0/3109266554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b1b40 0x7f957815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957ce67700 1 -- 172.21.15.46:0/3109266554 >> v1:172.21.15.46:6789/0 conn(0x7f95780b16d0 legacy=0x7f957815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957ce67700 1 -- 172.21.15.46:0/3109266554 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780b6200 con 0x7f95780b4e70 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f95777fe700 1 -- 172.21.15.46:0/3109266554 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499989967 0 0) 0x7f95780cfb00 con 0x7f95780b16d0 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957ce67700 1 --2- 172.21.15.46:0/3109266554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b4e70 0x7f95780ccff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f95680099b0 tx=0x7f9568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108bc9d950b2f7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f95777fe700 1 -- 172.21.15.46:0/3109266554 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800b860 con 0x7f95780b4e70 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f95777fe700 1 -- 172.21.15.46:0/3109266554 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800b9c0 con 0x7f95780b4e70 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f95777fe700 1 -- 172.21.15.46:0/3109266554 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800bd60 con 0x7f95780b4e70 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 -- 172.21.15.46:0/3109266554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b4e70 msgr2=0x7f95780ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 --2- 172.21.15.46:0/3109266554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b4e70 0x7f95780ccff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f95680099b0 tx=0x7f9568009250 comp rx=0 tx=0).stop 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 -- 172.21.15.46:0/3109266554 shutdown_connections 2023-10-07T09:00:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 --2- 172.21.15.46:0/3109266554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b1b40 0x7f957815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 --2- 172.21.15.46:0/3109266554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b4e70 0x7f95780ccff0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.169+0000 7f957de69700 1 -- 172.21.15.46:0/3109266554 >> 172.21.15.46:0/3109266554 conn(0x7f95780d10c0 msgr2=0x7f95780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.170+0000 7f957de69700 1 -- 172.21.15.46:0/3109266554 shutdown_connections 2023-10-07T09:00:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.170+0000 7f957de69700 1 -- 172.21.15.46:0/3109266554 wait complete. 2023-10-07T09:00:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 Processor -- start 2023-10-07T09:00:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 -- start start 2023-10-07T09:00:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95780b1b40 0x7f95780c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b4e70 0x7f957815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780cadb0 con 0x7f95780b16d0 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780c9ec0 con 0x7f95780b1b40 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.171+0000 7f957de69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780ca1a0 con 0x7f95780b4e70 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53396/0 (socket says 172.21.15.46:53396) 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 -- 172.21.15.46:0/1700331922 learned_addr learned my addr 172.21.15.46:0/1700331922 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 -- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b4e70 msgr2=0x7f957815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b4e70 0x7f957815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 -- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95780b1b40 msgr2=0x7f95780c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95780b1b40 0x7f95780c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 -- 172.21.15.46:0/1700331922 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094f0 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957ce67700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f95680090b0 tx=0x7f9568017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011e10 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956801a660 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780ca480 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956801aa20 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.172+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780caa40 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.173+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9578088990 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.174+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f956801b430 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.174+0000 7f9574ff9700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 0x7f9564069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.174+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9568085d00 con 0x7f95780b16d0 2023-10-07T09:00:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.174+0000 7f9577fff700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 0x7f9564069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.175+0000 7f9577fff700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 0x7f9564069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f956c0011e0 tx=0x7f956c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:34.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.178+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9568089030 con 0x7f95780b16d0 2023-10-07T09:00:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:34.417+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f957814e610 con 0x7f95780b16d0 2023-10-07T09:00:35.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.022+0000 7f9574ff9700 1 -- 172.21.15.46:0/1700331922 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9568052f80 con 0x7f95780b16d0 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 msgr2=0x7f9564069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 0x7f9564069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f956c0011e0 tx=0x7f956c0079b0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 msgr2=0x7f9578147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f95680090b0 tx=0x7f9568017000 comp rx=0 tx=0).stop 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 shutdown_connections 2023-10-07T09:00:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9564066fc0 0x7f9564069470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95780b4e70 0x7f957815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95780b16d0 0x7f9578147a00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 --2- 172.21.15.46:0/1700331922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95780b1b40 0x7f95780c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 >> 172.21.15.46:0/1700331922 conn(0x7f95780d10c0 msgr2=0x7f9578069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 shutdown_connections 2023-10-07T09:00:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.024+0000 7f957de69700 1 -- 172.21.15.46:0/1700331922 wait complete. 2023-10-07T09:00:35.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.161+0000 7feabdcf2700 1 Processor -- start 2023-10-07T09:00:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.161+0000 7feabdcf2700 1 -- start start 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feabdcf2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159c60 0x7feab815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feabdcf2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab815db10 0x7feab8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feabdcf2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab815a160 con 0x7feab8159890 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feabdcf2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80d13a0 con 0x7feab815db10 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feabdcf2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab815e140 con 0x7feab8159c60 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feab7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab815db10 0x7feab8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feab7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab815db10 0x7feab8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53400/0 (socket says 172.21.15.46:53400) 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feab7fff700 1 -- 172.21.15.46:0/2066326474 learned_addr learned my addr 172.21.15.46:0/2066326474 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.162+0000 7feab6ffd700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159c60 0x7feab815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab7fff700 1 -- 172.21.15.46:0/2066326474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159c60 msgr2=0x7feab815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab7fff700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159c60 0x7feab815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab7fff700 1 -- 172.21.15.46:0/2066326474 >> v1:172.21.15.133:6789/0 conn(0x7feab8159890 legacy=0x7feab815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab7fff700 1 -- 172.21.15.46:0/2066326474 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab815a3d0 con 0x7feab815db10 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab7fff700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab815db10 0x7feab8069560 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feab0009f20 tx=0x7feab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5d9c4cf00d523a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab67fc700 1 -- 172.21.15.46:0/2066326474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000e070 con 0x7feab815db10 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab67fc700 1 -- 172.21.15.46:0/2066326474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000b9d0 con 0x7feab815db10 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feab67fc700 1 -- 172.21.15.46:0/2066326474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab00092e0 con 0x7feab815db10 2023-10-07T09:00:35.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feabdcf2700 1 -- 172.21.15.46:0/2066326474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab815db10 msgr2=0x7feab8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab815db10 0x7feab8069560 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feab0009f20 tx=0x7feab0009840 comp rx=0 tx=0).stop 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feabdcf2700 1 -- 172.21.15.46:0/2066326474 shutdown_connections 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.163+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab815db10 0x7feab8069560 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.164+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2066326474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159c60 0x7feab815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.164+0000 7feabdcf2700 1 -- 172.21.15.46:0/2066326474 >> 172.21.15.46:0/2066326474 conn(0x7feab8068e20 msgr2=0x7feab80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.164+0000 7feabdcf2700 1 -- 172.21.15.46:0/2066326474 shutdown_connections 2023-10-07T09:00:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.164+0000 7feabdcf2700 1 -- 172.21.15.46:0/2066326474 wait complete. 2023-10-07T09:00:35.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.165+0000 7feabdcf2700 1 Processor -- start 2023-10-07T09:00:35.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.165+0000 7feabdcf2700 1 -- start start 2023-10-07T09:00:35.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159890 0x7feab80b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 0x7feab80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab816e450 con 0x7feab8159c60 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80b0c50 con 0x7feab815db10 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab80b0f30 con 0x7feab8159890 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53416/0 (socket says 172.21.15.46:53416) 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 -- 172.21.15.46:0/2757731721 learned_addr learned my addr 172.21.15.46:0/2757731721 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab77fe700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159890 0x7feab80b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab7fff700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 0x7feab80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 -- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159890 msgr2=0x7feab80b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159890 0x7feab80b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 -- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 msgr2=0x7feab80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 0x7feab80cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 -- 172.21.15.46:0/2757731721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009ae0 con 0x7feab8159c60 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab7fff700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 0x7feab80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feab6ffd700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feaac00ec50 tx=0x7feaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00c850 con 0x7feab8159c60 2023-10-07T09:00:35.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00c9b0 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab80b1210 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00cd70 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.166+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80b17d0 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.167+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab804c3c0 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.168+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7feaac013680 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.168+0000 7fea9f7fe700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 0x7feaa4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.168+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feaac084820 con 0x7feab8159c60 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.168+0000 7feab77fe700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 0x7feaa4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.169+0000 7feab77fe700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 0x7feaa4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003a80 tx=0x7feaa8007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.172+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaac051aa0 con 0x7feab8159c60 2023-10-07T09:00:35.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.407+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feab80b2270 con 0x7feab8159c60 2023-10-07T09:00:35.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.408+0000 7fea9f7fe700 1 -- 172.21.15.46:0/2757731721 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4602 (secure 0 0 0) 0x7feaac0550c0 con 0x7feab8159c60 2023-10-07T09:00:35.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:35.409 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 msgr2=0x7feaa4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 0x7feaa4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003a80 tx=0x7feaa8007ec0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 msgr2=0x7feab816d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feaac00ec50 tx=0x7feaac0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 shutdown_connections 2023-10-07T09:00:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaa4066fc0 0x7feaa4069470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab815db10 0x7feab80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feab8159890 0x7feab80b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 --2- 172.21.15.46:0/2757731721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab8159c60 0x7feab816d7b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 >> 172.21.15.46:0/2757731721 conn(0x7feab8068e20 msgr2=0x7feab8153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 shutdown_connections 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.410+0000 7feabdcf2700 1 -- 172.21.15.46:0/2757731721 wait complete. 2023-10-07T09:00:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 39 2023-10-07T09:00:35.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:00:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.541+0000 7f4e69bf0700 1 Processor -- start 2023-10-07T09:00:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.541+0000 7f4e69bf0700 1 -- start start 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e69bf0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4e64141500 0x7f4e640c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e69bf0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6415c2a0 con 0x7f4e6406c0a0 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e69bf0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6415b690 con 0x7f4e6406bcd0 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e69bf0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6415b970 con 0x7f4e64141500 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e63fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e6406c0a0 0x7f4e640c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42582/0 (socket says 172.21.15.46:42582) 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e63fff700 1 -- 172.21.15.46:0/3579258237 learned_addr learned my addr 172.21.15.46:0/3579258237 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.542+0000 7f4e62ffd700 1 --2- 172.21.15.46:0/3579258237 >> v2:172.21.15.133:3300/0 conn(0x7f4e64141500 0x7f4e640c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e627fc700 1 -- 172.21.15.46:0/3579258237 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866643091 0 0) 0x7f4e6415c2a0 con 0x7f4e6406c0a0 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e627fc700 1 -- 172.21.15.46:0/3579258237 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4c003570 con 0x7f4e6406c0a0 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e62ffd700 1 -- 172.21.15.46:0/3579258237 >> v1:172.21.15.133:6789/0 conn(0x7f4e6406bcd0 legacy=0x7f4e64140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e62ffd700 1 -- 172.21.15.46:0/3579258237 >> v1:172.21.15.46:6789/0 conn(0x7f4e6406c0a0 legacy=0x7f4e640c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e62ffd700 1 -- 172.21.15.46:0/3579258237 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6415bc50 con 0x7f4e64141500 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e62ffd700 1 --2- 172.21.15.46:0/3579258237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e64141500 0x7f4e640c8e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e580098e0 tx=0x7f4e580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23c5a2ebf9808436 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e627fc700 1 -- 172.21.15.46:0/3579258237 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800b640 con 0x7f4e64141500 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e627fc700 1 -- 172.21.15.46:0/3579258237 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800b7a0 con 0x7f4e64141500 2023-10-07T09:00:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.543+0000 7f4e627fc700 1 -- 172.21.15.46:0/3579258237 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800bb40 con 0x7f4e64141500 2023-10-07T09:00:35.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 -- 172.21.15.46:0/3579258237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e64141500 msgr2=0x7f4e640c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/3579258237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e64141500 0x7f4e640c8e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e580098e0 tx=0x7f4e580091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 -- 172.21.15.46:0/3579258237 shutdown_connections 2023-10-07T09:00:35.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/3579258237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e64141500 0x7f4e640c8e00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 -- 172.21.15.46:0/3579258237 >> 172.21.15.46:0/3579258237 conn(0x7f4e640ce600 msgr2=0x7f4e640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 -- 172.21.15.46:0/3579258237 shutdown_connections 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.544+0000 7f4e69bf0700 1 -- 172.21.15.46:0/3579258237 wait complete. 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.545+0000 7f4e69bf0700 1 Processor -- start 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.545+0000 7f4e69bf0700 1 -- start start 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 0x7f4e64169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6406c0a0 0x7f4e641569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6416d890 con 0x7f4e64141500 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6416e410 con 0x7f4e6406bcd0 2023-10-07T09:00:35.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e69bf0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6416dae0 con 0x7f4e6406c0a0 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53428/0 (socket says 172.21.15.46:53428) 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 -- 172.21.15.46:0/1037081144 learned_addr learned my addr 172.21.15.46:0/1037081144 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e62ffd700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6406c0a0 0x7f4e641569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e637fe700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 0x7f4e64169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 -- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6406c0a0 msgr2=0x7f4e641569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6406c0a0 0x7f4e641569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 -- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 msgr2=0x7f4e64169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 0x7f4e64169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 -- 172.21.15.46:0/1037081144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58009420 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e637fe700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 0x7f4e64169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e63fff700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c001460 tx=0x7f4e5c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.546+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00ce80 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.547+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00ab70 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.547+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6416ddc0 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.547+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0070f0 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.547+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6416a090 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.547+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6416e580 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.548+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4e5c007520 con 0x7f4e64141500 2023-10-07T09:00:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.548+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 0x7f4e50069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.548+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e5c084a80 con 0x7f4e64141500 2023-10-07T09:00:35.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.549+0000 7f4e637fe700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 0x7f4e50069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.549+0000 7f4e637fe700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 0x7f4e50069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007fd0 tx=0x7f4e54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.553+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e5c051d00 con 0x7f4e64141500 2023-10-07T09:00:35.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.749+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6404c3c0 con 0x7f4e64141500 2023-10-07T09:00:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.750+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1037081144 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f4e5c055320 con 0x7f4e64141500 2023-10-07T09:00:35.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":64,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:00:32.999586+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:00:35.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 msgr2=0x7f4e50069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 0x7f4e50069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007fd0 tx=0x7f4e54009040 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 msgr2=0x7f4e64156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c001460 tx=0x7f4e5c001ae0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 shutdown_connections 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e50066fc0 0x7f4e50069470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e64141500 0x7f4e64156f10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6406bcd0 0x7f4e64169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 --2- 172.21.15.46:0/1037081144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6406c0a0 0x7f4e641569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 >> 172.21.15.46:0/1037081144 conn(0x7f4e640ce600 msgr2=0x7f4e640cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 shutdown_connections 2023-10-07T09:00:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.752+0000 7f4e69bf0700 1 -- 172.21.15.46:0/1037081144 wait complete. 2023-10-07T09:00:35.765 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:00:35.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.883+0000 7fe23490c700 1 Processor -- start 2023-10-07T09:00:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.883+0000 7fe23490c700 1 -- start start 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe23490c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 0x7fe230140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe23490c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe23006c0a0 0x7fe230141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe23490c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23015c2a0 con 0x7fe2300c8e00 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe23490c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2300c9900 con 0x7fe23006c0a0 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe23490c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23015b690 con 0x7fe23006bcd0 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe22dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe23006c0a0 0x7fe230141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe22dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe23006c0a0 0x7fe230141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53436/0 (socket says 172.21.15.46:53436) 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.884+0000 7fe22dd9b700 1 -- 172.21.15.46:0/4148779773 learned_addr learned my addr 172.21.15.46:0/4148779773 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22e59c700 1 --2- 172.21.15.46:0/4148779773 >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 0x7fe230140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22dd9b700 1 -- 172.21.15.46:0/4148779773 >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 msgr2=0x7fe230140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22dd9b700 1 --2- 172.21.15.46:0/4148779773 >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 0x7fe230140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22dd9b700 1 -- 172.21.15.46:0/4148779773 >> v1:172.21.15.133:6789/0 conn(0x7fe2300c8e00 legacy=0x7fe2300c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22dd9b700 1 -- 172.21.15.46:0/4148779773 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23015b970 con 0x7fe23006c0a0 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22e59c700 1 --2- 172.21.15.46:0/4148779773 >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 0x7fe230140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22dd9b700 1 --2- 172.21.15.46:0/4148779773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006c0a0 0x7fe230141330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2300cafd0 tx=0x7fe218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a0f09ae9a7e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22d59a700 1 -- 172.21.15.46:0/4148779773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800b860 con 0x7fe23006c0a0 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22d59a700 1 -- 172.21.15.46:0/4148779773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21800b9c0 con 0x7fe23006c0a0 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.885+0000 7fe22d59a700 1 -- 172.21.15.46:0/4148779773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800bd60 con 0x7fe23006c0a0 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 -- 172.21.15.46:0/4148779773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006c0a0 msgr2=0x7fe230141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 --2- 172.21.15.46:0/4148779773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006c0a0 0x7fe230141330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2300cafd0 tx=0x7fe218009250 comp rx=0 tx=0).stop 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 -- 172.21.15.46:0/4148779773 shutdown_connections 2023-10-07T09:00:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 --2- 172.21.15.46:0/4148779773 >> v2:172.21.15.133:3300/0 conn(0x7fe23006bcd0 0x7fe230140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 --2- 172.21.15.46:0/4148779773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006c0a0 0x7fe230141330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 -- 172.21.15.46:0/4148779773 >> 172.21.15.46:0/4148779773 conn(0x7fe2300ce600 msgr2=0x7fe2300cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 -- 172.21.15.46:0/4148779773 shutdown_connections 2023-10-07T09:00:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.886+0000 7fe23490c700 1 -- 172.21.15.46:0/4148779773 wait complete. 2023-10-07T09:00:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.887+0000 7fe23490c700 1 Processor -- start 2023-10-07T09:00:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.887+0000 7fe23490c700 1 -- start start 2023-10-07T09:00:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.887+0000 7fe23490c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe23006c0a0 0x7fe2300c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c8e00 0x7fe2300ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23016bb10 con 0x7fe23006bcd0 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301687f0 con 0x7fe2300c8e00 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23013d120 con 0x7fe23006c0a0 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53448/0 (socket says 172.21.15.46:53448) 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 -- 172.21.15.46:0/57204562 learned_addr learned my addr 172.21.15.46:0/57204562 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 -- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe23006c0a0 msgr2=0x7fe2300c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22dd9b700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe23006c0a0 0x7fe2300c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe23006c0a0 0x7fe2300c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 -- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c8e00 msgr2=0x7fe2300ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c8e00 0x7fe2300ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 -- 172.21.15.46:0/57204562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2180094f0 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe22e59c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe22800e8d0 tx=0x7fe228008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800ee70 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22800c5e0 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe230168a50 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800c980 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.888+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe230169010 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.889+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe230169200 con 0x7fe23006bcd0 2023-10-07T09:00:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.890+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe228013410 con 0x7fe23006bcd0 2023-10-07T09:00:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.890+0000 7fe2267fc700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 0x7fe210069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.890+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe228084450 con 0x7fe23006bcd0 2023-10-07T09:00:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.890+0000 7fe22dd9b700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 0x7fe210069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.891+0000 7fe22dd9b700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 0x7fe210069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2300cafd0 tx=0x7fe218017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:35.894+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2280515c0 con 0x7fe23006bcd0 2023-10-07T09:00:36.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.084+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe23016bc50 con 0x7fe210066fc0 2023-10-07T09:00:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.093+0000 7fe2267fc700 1 -- 172.21.15.46:0/57204562 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278119 (secure 0 0 0) 0x7fe21800bb30 con 0x7fe210066fc0 2023-10-07T09:00:36.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 msgr2=0x7fe210069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 0x7fe210069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2300cafd0 tx=0x7fe218017000 comp rx=0 tx=0).stop 2023-10-07T09:00:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 msgr2=0x7fe2301682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe22800e8d0 tx=0x7fe228008040 comp rx=0 tx=0).stop 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 shutdown_connections 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe210066fc0 0x7fe210069470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c8e00 0x7fe2300ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe23006bcd0 0x7fe2301682b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 --2- 172.21.15.46:0/57204562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe23006c0a0 0x7fe2300c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 >> 172.21.15.46:0/57204562 conn(0x7fe2300ce600 msgr2=0x7fe23015df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 shutdown_connections 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.096+0000 7fe23490c700 1 -- 172.21.15.46:0/57204562 wait complete. 2023-10-07T09:00:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-10-07T09:00:35.790840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393424,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752581296,"statfs":{"total":773094113280,"available":770643247104,"internally_reserved":0,"allocated":7094272,"data_stored":3657606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.800733"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993617+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:09.913296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995272+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993131+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995883+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:16.185286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991430+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:19.548965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.998040+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991244+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993320+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:18:14.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992915+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996200+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:14.912450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991581+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:58.660682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991265+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991258+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.997585+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:35.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994936+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992376+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996427+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:11.064865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992893+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996543+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:50.460347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993730+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:13.434403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996988+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.424325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994358+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995182+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:55.998851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995808+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:08.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994496+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:57.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995217+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:36.980187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993089+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:52.250438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991273+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996285+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:39.597406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996024+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:45.028890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-07T09:00:29.641373+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:29.641373+0000","last_peered":"2023-10-07T09:00:29.641373+0000","last_clean":"2023-10-07T09:00:29.641373+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:29.641373+0000","last_undegraded":"2023-10-07T09:00:29.641373+0000","last_fullsized":"2023-10-07T09:00:29.641373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":895623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.436}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.503}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.246}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.224},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.27600000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.627}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":901428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.31}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.436},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.372},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.31}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":305255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.434},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:36.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:36.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.267+0000 7f38b5cd2700 1 Processor -- start 2023-10-07T09:00:36.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 -- start start 2023-10-07T09:00:36.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38b006c0a0 0x7f38b00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f38b015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b015d7e0 con 0x7f38b006bcd0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b015dac0 con 0x7f38b006c0a0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.268+0000 7f38b5cd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b015aa30 con 0x7f38b015df50 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38af7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f38b006bcd0 0x7f38b015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42592/0 (socket says 172.21.15.46:42592) 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38af7fe700 1 -- 172.21.15.46:0/1199713014 learned_addr learned my addr 172.21.15.46:0/1199713014 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644701953 0 0) 0x7f38b015d7e0 con 0x7f38b006bcd0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38aeffd700 1 --2- 172.21.15.46:0/1199713014 >> v2:172.21.15.133:3300/0 conn(0x7f38b006c0a0 0x7f38b00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3898003570 con 0x7f38b006bcd0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38affff700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f38b015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719581694 0 0) 0x7f3898003570 con 0x7f38b006bcd0 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 msgr2=0x7f38b015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f38b015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 >> v2:172.21.15.133:3300/0 conn(0x7f38b006c0a0 msgr2=0x7f38b00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 --2- 172.21.15.46:0/1199713014 >> v2:172.21.15.133:3300/0 conn(0x7f38b006c0a0 0x7f38b00caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b015ad10 con 0x7f38b006bcd0 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f38a0001470 con 0x7f38b006bcd0 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 >> v1:172.21.15.46:6789/0 conn(0x7f38b006bcd0 legacy=0x7f38b015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f3898003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3898003fe0 0x7f3898004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3898004d50 0x7f38980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b015dac0 con 0x7f3898004d50 2023-10-07T09:00:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b015aa30 con 0x7f3898003fe0 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389800bb40 con 0x7f38b015df50 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38affff700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3898004d50 0x7f38980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.269+0000 7f38af7fe700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f3898003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38aeffd700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3898003fe0 0x7f3898004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 -- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 msgr2=0x7f3898003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b015df50 0x7f3898003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 -- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3898003fe0 msgr2=0x7f3898004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3898003fe0 0x7f3898004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 -- 172.21.15.46:0/1199713014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898003570 con 0x7f3898004d50 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38affff700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3898004d50 0x7f38980051c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38a80094d0 tx=0x7f38a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c2a07a3a626d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800ea90 con 0x7f3898004d50 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a800f040 con 0x7f3898004d50 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.270+0000 7f38ae7fc700 1 -- 172.21.15.46:0/1199713014 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800ee20 con 0x7f3898004d50 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 -- 172.21.15.46:0/1199713014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3898004d50 msgr2=0x7f38980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/1199713014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3898004d50 0x7f38980051c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38a80094d0 tx=0x7f38a800b040 comp rx=0 tx=0).stop 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38affff700 1 -- 172.21.15.46:0/1199713014 reap_dead start 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 -- 172.21.15.46:0/1199713014 shutdown_connections 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 -- 172.21.15.46:0/1199713014 >> 172.21.15.46:0/1199713014 conn(0x7f38b00ce600 msgr2=0x7f38b00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 -- 172.21.15.46:0/1199713014 shutdown_connections 2023-10-07T09:00:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.271+0000 7f38b5cd2700 1 -- 172.21.15.46:0/1199713014 wait complete. 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.272+0000 7f38b5cd2700 1 Processor -- start 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.272+0000 7f38b5cd2700 1 -- start start 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b016daf0 0x7f38b00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38b0156a50 0x7f38b00c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00c9640 con 0x7f38b0156680 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00b24f0 con 0x7f38b0156a50 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b016df90 con 0x7f38b016daf0 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53470/0 (socket says 172.21.15.46:53470) 2023-10-07T09:00:36.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 -- 172.21.15.46:0/2043142736 learned_addr learned my addr 172.21.15.46:0/2043142736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 -- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b016daf0 msgr2=0x7f38b00c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b016daf0 0x7f38b00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 -- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38b0156a50 msgr2=0x7f38b00c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38b0156a50 0x7f38b00c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 -- 172.21.15.46:0/2043142736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b016e270 con 0x7f38b0156680 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38af7fe700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f38a0000fd0 tx=0x7f38a0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0018030 con 0x7f38b0156680 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000f8a0 con 0x7f38b0156680 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b00b27b0 con 0x7f38b0156680 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000fc60 con 0x7f38b0156680 2023-10-07T09:00:36.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.273+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b0169fd0 con 0x7f38b0156680 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.274+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b00648d0 con 0x7f38b0156680 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.275+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f38a001b070 con 0x7f38b0156680 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.275+0000 7f38977fe700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 0x7f389c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.275+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38a0019070 con 0x7f38b0156680 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.275+0000 7f38aeffd700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 0x7f389c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.276+0000 7f38aeffd700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 0x7f389c069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009170 tx=0x7f38a40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.280+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38a00517f0 con 0x7f38b0156680 2023-10-07T09:00:36.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.468+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38b00b2370 con 0x7f389c066fc0 2023-10-07T09:00:36.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.476+0000 7f38977fe700 1 -- 172.21.15.46:0/2043142736 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278119 (secure 0 0 0) 0x7f38a4011740 con 0x7f389c066fc0 2023-10-07T09:00:36.480 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 msgr2=0x7f389c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 0x7f389c069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009170 tx=0x7f38a40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 msgr2=0x7f38b016d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f38a0000fd0 tx=0x7f38a0001e90 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 shutdown_connections 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f389c066fc0 0x7f389c069470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38b0156a50 0x7f38b00c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b0156680 0x7f38b016d5b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.479+0000 7f38b5cd2700 1 --2- 172.21.15.46:0/2043142736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38b016daf0 0x7f38b00c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.480+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 >> 172.21.15.46:0/2043142736 conn(0x7f38b00ce600 msgr2=0x7f38b006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.480+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 shutdown_connections 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.480+0000 7f38b5cd2700 1 -- 172.21.15.46:0/2043142736 wait complete. 2023-10-07T09:00:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:36.492 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-10-07T09:00:35.790840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393424,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752581296,"statfs":{"total":773094113280,"available":770643247104,"internally_reserved":0,"allocated":7094272,"data_stored":3657606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.800733"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993617+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:09.913296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995272+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993131+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995883+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:16.185286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991430+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:19.548965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.998040+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991244+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993320+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:18:14.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992915+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996200+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:14.912450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991581+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:58.660682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991265+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991258+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.997585+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:35.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994936+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992376+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996427+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:11.064865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992893+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996543+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:50.460347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993730+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:13.434403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996988+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.424325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994358+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995182+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:55.998851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995808+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:08.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994496+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:57.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995217+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:36.980187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993089+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:52.250438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991273+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996285+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:39.597406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996024+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:45.028890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-07T09:00:29.641373+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:29.641373+0000","last_peered":"2023-10-07T09:00:29.641373+0000","last_clean":"2023-10-07T09:00:29.641373+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:29.641373+0000","last_undegraded":"2023-10-07T09:00:29.641373+0000","last_fullsized":"2023-10-07T09:00:29.641373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":895623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.436}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.503}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.246}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.224},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.27600000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.627}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":901428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.31}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.436},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.372},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.31}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":305255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.434},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:36.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.651+0000 7fad467f3700 1 Processor -- start 2023-10-07T09:00:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.651+0000 7fad467f3700 1 -- start start 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad467f3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad401597f0 0x7fad400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad467f3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad4015d230 0x7fad4015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad467f3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4015db70 con 0x7fad40159420 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad467f3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad400b11d0 con 0x7fad401597f0 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad467f3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad400b14b0 con 0x7fad4015d230 2023-10-07T09:00:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad401597f0 0x7fad400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad401597f0 0x7fad400b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53482/0 (socket says 172.21.15.46:53482) 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 -- 172.21.15.46:0/1639820238 learned_addr learned my addr 172.21.15.46:0/1639820238 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad45ff2700 1 --2- 172.21.15.46:0/1639820238 >> v2:172.21.15.133:3300/0 conn(0x7fad4015d230 0x7fad4015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 -- 172.21.15.46:0/1639820238 >> v2:172.21.15.133:3300/0 conn(0x7fad4015d230 msgr2=0x7fad4015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 --2- 172.21.15.46:0/1639820238 >> v2:172.21.15.133:3300/0 conn(0x7fad4015d230 0x7fad4015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 -- 172.21.15.46:0/1639820238 >> v1:172.21.15.133:6789/0 conn(0x7fad40159420 legacy=0x7fad400b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 -- 172.21.15.46:0/1639820238 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400b1790 con 0x7fad401597f0 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.652+0000 7fad44ff0700 1 --2- 172.21.15.46:0/1639820238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400b2270 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fad4015d170 tx=0x7fad30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38b0cf4edd5911e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad37fff700 1 -- 172.21.15.46:0/1639820238 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30009e70 con 0x7fad401597f0 2023-10-07T09:00:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad37fff700 1 -- 172.21.15.46:0/1639820238 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000b860 con 0x7fad401597f0 2023-10-07T09:00:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad37fff700 1 -- 172.21.15.46:0/1639820238 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3000bc00 con 0x7fad401597f0 2023-10-07T09:00:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 -- 172.21.15.46:0/1639820238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 msgr2=0x7fad400b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 --2- 172.21.15.46:0/1639820238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400b2270 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fad4015d170 tx=0x7fad30009250 comp rx=0 tx=0).stop 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 -- 172.21.15.46:0/1639820238 shutdown_connections 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 --2- 172.21.15.46:0/1639820238 >> v2:172.21.15.133:3300/0 conn(0x7fad4015d230 0x7fad4015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 --2- 172.21.15.46:0/1639820238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400b2270 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 -- 172.21.15.46:0/1639820238 >> 172.21.15.46:0/1639820238 conn(0x7fad400d0660 msgr2=0x7fad400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 -- 172.21.15.46:0/1639820238 shutdown_connections 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.653+0000 7fad467f3700 1 -- 172.21.15.46:0/1639820238 wait complete. 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.654+0000 7fad467f3700 1 Processor -- start 2023-10-07T09:00:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 -- start start 2023-10-07T09:00:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad40159420 0x7fad40154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4015d230 0x7fad400b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400c66f0 con 0x7fad401597f0 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400c6f00 con 0x7fad4015d230 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad467f3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad40154940 con 0x7fad40159420 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad44ff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.655+0000 7fad44ff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53496/0 (socket says 172.21.15.46:53496) 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 -- 172.21.15.46:0/410998796 learned_addr learned my addr 172.21.15.46:0/410998796 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad457f1700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad40159420 0x7fad40154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad45ff2700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4015d230 0x7fad400b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 -- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad40159420 msgr2=0x7fad40154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad40159420 0x7fad40154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 -- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4015d230 msgr2=0x7fad400b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4015d230 0x7fad400b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 -- 172.21.15.46:0/410998796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300094f0 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad44ff0700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad30006fd0 tx=0x7fad30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011420 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300115a0 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad400c5e50 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011960 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.656+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad400c6410 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.657+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400c70b0 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.658+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fad300253f0 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.658+0000 7fad357fa700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.658+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad30085e90 con 0x7fad401597f0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.658+0000 7fad457f1700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.659+0000 7fad457f1700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 0x7fad24069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad4016ad80 tx=0x7fad3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:36.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.662+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad400c70b0 con 0x7fad401597f0 2023-10-07T09:00:36.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.848+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad400c7070 con 0x7fad24066fc0 2023-10-07T09:00:36.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.856+0000 7fad357fa700 1 -- 172.21.15.46:0/410998796 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278119 (secure 0 0 0) 0x7fad400c7070 con 0x7fad24066fc0 2023-10-07T09:00:36.860 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 msgr2=0x7fad24069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 0x7fad24069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad4016ad80 tx=0x7fad3c009040 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 msgr2=0x7fad400c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad30006fd0 tx=0x7fad30017000 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 shutdown_connections 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4015d230 0x7fad400b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad40159420 0x7fad40154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 --2- 172.21.15.46:0/410998796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad401597f0 0x7fad400c5400 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.859+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 >> 172.21.15.46:0/410998796 conn(0x7fad400d0660 msgr2=0x7fad400b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.860+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 shutdown_connections 2023-10-07T09:00:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:36.860+0000 7fad467f3700 1 -- 172.21.15.46:0/410998796 wait complete. 2023-10-07T09:00:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:36.872 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-10-07T09:00:35.790840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393424,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752581296,"statfs":{"total":773094113280,"available":770643247104,"internally_reserved":0,"allocated":7094272,"data_stored":3657606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.800733"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993617+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:09.913296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995272+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993131+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995883+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:16.185286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991430+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:19.548965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.998040+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991244+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993320+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:18:14.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992915+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996200+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:14.912450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991581+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:58.660682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991265+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991258+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.997585+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:35.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994936+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992376+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996427+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:11.064865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992893+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996543+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:50.460347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993730+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:13.434403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996988+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.424325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994358+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995182+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:55.998851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995808+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:08.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994496+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:57.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995217+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:36.980187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993089+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:52.250438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991273+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996285+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:39.597406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996024+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:45.028890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-07T09:00:29.641373+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:29.641373+0000","last_peered":"2023-10-07T09:00:29.641373+0000","last_clean":"2023-10-07T09:00:29.641373+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:29.641373+0000","last_undegraded":"2023-10-07T09:00:29.641373+0000","last_fullsized":"2023-10-07T09:00:29.641373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":895623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.436}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.503}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.246}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.224},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.27600000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.627}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":901428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.31}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.436},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.372},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.31}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":305255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.434},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-07T09:00:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-07T09:00:36.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-07T09:00:36.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-07T09:00:36.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-07T09:00:36.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-07T09:00:36.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993617+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:59:09.913296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.995272+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993131+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-07T09:00:36.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.995883+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:41:16.185286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991430+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:45:19.548965+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.998040+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991244+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-07T09:00:36.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993320+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:18:14.652977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.992915+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996200+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:44:14.912450+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-07T09:00:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991581+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:27:58.660682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991265+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991258+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.997585+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:20:35.509084+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.994936+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:36.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.992376+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996427+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:28:11.064865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-07T09:00:36.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.992893+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996543+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:13:50.460347+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-07T09:00:36.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993730+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:48:13.434403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996988+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:27:43.424325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.994358+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:36.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.995182+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:21:55.998851+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.995808+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:32:08.255786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.994496+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993367+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:06:57.975405+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-07T09:00:36.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.995217+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:10:36.980187+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.993089+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:34:52.250438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.991273+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T09:00:36.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.992367+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996285+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:54:39.597406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-07T09:00:36.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T09:00:30.988478+0000', 'last_change': '2023-10-07T09:00:30.988478+0000', 'last_active': '2023-10-07T09:00:30.988478+0000', 'last_peered': '2023-10-07T09:00:30.988478+0000', 'last_clean': '2023-10-07T09:00:30.988478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:30.988478+0000', 'last_undegraded': '2023-10-07T09:00:30.988478+0000', 'last_fullsized': '2023-10-07T09:00:30.988478+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:30.988478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T09:00:36.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-07T09:00:36.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T09:00:29.984331+0000', 'last_change': '2023-10-07T09:00:29.996024+0000', 'last_active': '2023-10-07T09:00:29.984331+0000', 'last_peered': '2023-10-07T09:00:29.984331+0000', 'last_clean': '2023-10-07T09:00:29.984331+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T09:00:29.984331+0000', 'last_undegraded': '2023-10-07T09:00:29.984331+0000', 'last_fullsized': '2023-10-07T09:00:29.984331+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'last_clean_scrub_stamp': '2023-10-07T09:00:29.984331+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:25:45.028890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T09:00:36.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T09:00:37.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.031+0000 7fba61922700 1 Processor -- start 2023-10-07T09:00:37.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.031+0000 7fba61922700 1 -- start start 2023-10-07T09:00:37.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.031+0000 7fba61922700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba5c157ac0 0x7fba5c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.031+0000 7fba61922700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c06ea90 con 0x7fba5c0ce080 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba61922700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c06c6a0 con 0x7fba5c1576f0 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba61922700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c06cf40 con 0x7fba5c157ac0 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba5c157ac0 0x7fba5c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fba5c0ce080 0x7fba5c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42596/0 (socket says 172.21.15.46:42596) 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba5c157ac0 0x7fba5c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53508/0 (socket says 172.21.15.46:53508) 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5b7fe700 1 -- 172.21.15.46:0/3492421431 learned_addr learned my addr 172.21.15.46:0/3492421431 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 -- 172.21.15.46:0/3492421431 >> v1:172.21.15.133:6789/0 conn(0x7fba5c1576f0 legacy=0x7fba5c0ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 -- 172.21.15.46:0/3492421431 >> v1:172.21.15.46:6789/0 conn(0x7fba5c0ce080 legacy=0x7fba5c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 -- 172.21.15.46:0/3492421431 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c06c980 con 0x7fba5c157ac0 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba59ffb700 1 -- 172.21.15.46:0/3492421431 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848418483 0 0) 0x7fba5c06ea90 con 0x7fba5c0ce080 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba5a7fc700 1 --2- 172.21.15.46:0/3492421431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c06bfa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba500098e0 tx=0x7fba500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf1a91eb168e20d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba59ffb700 1 -- 172.21.15.46:0/3492421431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50009e80 con 0x7fba5c157ac0 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba59ffb700 1 -- 172.21.15.46:0/3492421431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000b820 con 0x7fba5c157ac0 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.032+0000 7fba59ffb700 1 -- 172.21.15.46:0/3492421431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000bba0 con 0x7fba5c157ac0 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 -- 172.21.15.46:0/3492421431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 msgr2=0x7fba5c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 --2- 172.21.15.46:0/3492421431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c06bfa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba500098e0 tx=0x7fba500091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 -- 172.21.15.46:0/3492421431 shutdown_connections 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 --2- 172.21.15.46:0/3492421431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c06bfa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 -- 172.21.15.46:0/3492421431 >> 172.21.15.46:0/3492421431 conn(0x7fba5c06b450 msgr2=0x7fba5c0cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:37.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 -- 172.21.15.46:0/3492421431 shutdown_connections 2023-10-07T09:00:37.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.033+0000 7fba61922700 1 -- 172.21.15.46:0/3492421431 wait complete. 2023-10-07T09:00:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.034+0000 7fba61922700 1 Processor -- start 2023-10-07T09:00:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.034+0000 7fba61922700 1 -- start start 2023-10-07T09:00:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 0x7fba5c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 0x7fba5c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c154b80 con 0x7fba5c157ac0 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c153f70 con 0x7fba5c1576f0 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba61922700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c154250 con 0x7fba5c0ce080 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53520/0 (socket says 172.21.15.46:53520) 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 -- 172.21.15.46:0/1217089423 learned_addr learned my addr 172.21.15.46:0/1217089423 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5affd700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 0x7fba5c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5a7fc700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 0x7fba5c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 -- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 msgr2=0x7fba5c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 0x7fba5c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 -- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 msgr2=0x7fba5c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 0x7fba5c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 -- 172.21.15.46:0/1217089423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009420 con 0x7fba5c157ac0 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5a7fc700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 0x7fba5c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5affd700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 0x7fba5c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.035+0000 7fba5b7fe700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba5400cc90 tx=0x7fba54001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400cea0 con 0x7fba5c157ac0 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5400ab30 con 0x7fba5c157ac0 2023-10-07T09:00:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c154530 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540070f0 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c0cd050 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.036+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c04c3c0 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.037+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fba540074a0 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.037+0000 7fba42ffd700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 0x7fba48069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.037+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba54084970 con 0x7fba5c157ac0 2023-10-07T09:00:37.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.038+0000 7fba5affd700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 0x7fba48069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.038+0000 7fba5affd700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 0x7fba48069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba4c002880 tx=0x7fba4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.042+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba54051c70 con 0x7fba5c157ac0 2023-10-07T09:00:37.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.311+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fba5c068fa0 con 0x7fba5c157ac0 2023-10-07T09:00:37.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.312+0000 7fba42ffd700 1 -- 172.21.15.46:0/1217089423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1659 (secure 0 0 0) 0x7fba54055290 con 0x7fba5c157ac0 2023-10-07T09:00:37.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:37.313 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":137,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1696669110,"num_in_osds":8,"osd_in_since":1696669102,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2450866176,"bytes_avail":770643247104,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":5721}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-07T08:59:31.775749+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 msgr2=0x7fba48069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 0x7fba48069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba4c002880 tx=0x7fba4c009040 comp rx=0 tx=0).stop 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 msgr2=0x7fba5c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba5400cc90 tx=0x7fba54001a20 comp rx=0 tx=0).stop 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 shutdown_connections 2023-10-07T09:00:37.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fba48066fc0 0x7fba48069470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba5c157ac0 0x7fba5c155890 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba5c0ce080 0x7fba5c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 --2- 172.21.15.46:0/1217089423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba5c1576f0 0x7fba5c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 >> 172.21.15.46:0/1217089423 conn(0x7fba5c06b450 msgr2=0x7fba5c0ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 shutdown_connections 2023-10-07T09:00:37.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.314+0000 7fba61922700 1 -- 172.21.15.46:0/1217089423 wait complete. 2023-10-07T09:00:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T09:00:37.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:37.329 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-10-07T09:00:37.328+0000 7fd333e25700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:00:37.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.445+0000 7f2a87924700 1 Processor -- start 2023-10-07T09:00:37.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.445+0000 7f2a87924700 1 -- start start 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a87924700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a80155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a87924700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800ad930 con 0x7f2a80155c10 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a87924700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800acd20 con 0x7f2a800af2f0 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a87924700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ad000 con 0x7f2a801578b0 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a856c0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2a80155c10 0x7f2a800ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42604/0 (socket says 172.21.15.46:42604) 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a856c0700 1 -- 172.21.15.46:0/3198687586 learned_addr learned my addr 172.21.15.46:0/3198687586 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a84ebf700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a80155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155580044 0 0) 0x7f2a800ad930 con 0x7f2a80155c10 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a68004680 con 0x7f2a80155c10 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243037974 0 0) 0x7f2a68004680 con 0x7f2a80155c10 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 msgr2=0x7f2a80155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a80155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 >> v1:172.21.15.133:6789/0 conn(0x7f2a800af2f0 legacy=0x7f2a800af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800ad2e0 con 0x7f2a80155c10 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f2a70001470 con 0x7f2a80155c10 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 >> v1:172.21.15.46:6789/0 conn(0x7f2a80155c10 legacy=0x7f2a800ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a68004ba0 0x7f2a68004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a68005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a68005e60 0x7f2a680062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ad000 con 0x7f2a68004ba0 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6800cc50 con 0x7f2a68005e60 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.446+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6800ce10 con 0x7f2a801578b0 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a68004ba0 0x7f2a68004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a84ebf700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a68005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a85ec1700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a68005e60 0x7f2a680062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 -- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 msgr2=0x7f2a68005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a801578b0 0x7f2a68005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 -- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a68005e60 msgr2=0x7f2a680062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a68005e60 0x7f2a680062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 -- 172.21.15.46:0/3198687586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68004680 con 0x7f2a68004ba0 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a856c0700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a68004ba0 0x7f2a68004f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c390 tx=0x7f2a800ad8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de27a0867ebfd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000cc60 con 0x7f2a68004ba0 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7000cde0 con 0x7f2a68004ba0 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.447+0000 7f2a7ffff700 1 -- 172.21.15.46:0/3198687586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70005b70 con 0x7f2a68004ba0 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 -- 172.21.15.46:0/3198687586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a68004ba0 msgr2=0x7f2a68004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 --2- 172.21.15.46:0/3198687586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a68004ba0 0x7f2a68004f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c390 tx=0x7f2a800ad8a0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a85ec1700 1 -- 172.21.15.46:0/3198687586 reap_dead start 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 -- 172.21.15.46:0/3198687586 shutdown_connections 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 -- 172.21.15.46:0/3198687586 >> 172.21.15.46:0/3198687586 conn(0x7f2a8006a320 msgr2=0x7f2a800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 -- 172.21.15.46:0/3198687586 shutdown_connections 2023-10-07T09:00:37.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.448+0000 7f2a87924700 1 -- 172.21.15.46:0/3198687586 wait complete. 2023-10-07T09:00:37.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.449+0000 7f2a87924700 1 Processor -- start 2023-10-07T09:00:37.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.449+0000 7f2a87924700 1 -- start start 2023-10-07T09:00:37.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a80149bd0 0x7f2a8016a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a8015a9b0 0x7f2a8014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ab2b0 con 0x7f2a8015ae20 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8016ae10 con 0x7f2a8015a9b0 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a87924700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801598c0 con 0x7f2a80149bd0 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53540/0 (socket says 172.21.15.46:53540) 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 -- 172.21.15.46:0/1094298424 learned_addr learned my addr 172.21.15.46:0/1094298424 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a84ebf700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a8015a9b0 0x7f2a8014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a856c0700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a80149bd0 0x7f2a8016a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 -- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a80149bd0 msgr2=0x7f2a8016a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a80149bd0 0x7f2a8016a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 -- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a8015a9b0 msgr2=0x7f2a8014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a8015a9b0 0x7f2a8014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 -- 172.21.15.46:0/1094298424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a80159ba0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.450+0000 7f2a85ec1700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006d2a0 tx=0x7f2a780016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.451+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800eec0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.451+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7800c7b0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.451+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8015a1b0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.451+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800cb70 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.451+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a80159eb0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.452+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8015a6d0 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.452+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2a7801f460 con 0x7f2a8015ae20 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.452+0000 7f2a7d7fa700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.453+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a78084ba0 con 0x7f2a8015ae20 2023-10-07T09:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.453+0000 7f2a856c0700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.453+0000 7f2a856c0700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006fd20 tx=0x7f2a70015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.457+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a8015a6d0 con 0x7f2a8015ae20 2023-10-07T09:00:37.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.644+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a8015a6d0 con 0x7f2a6c066fc0 2023-10-07T09:00:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.652+0000 7f2a7d7fa700 1 -- 172.21.15.46:0/1094298424 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278119 (secure 0 0 0) 0x7f2a8015a6d0 con 0x7f2a6c066fc0 2023-10-07T09:00:37.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:37.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.655+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 msgr2=0x7f2a6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.655+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006fd20 tx=0x7f2a70015000 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 msgr2=0x7f2a8014e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006d2a0 tx=0x7f2a780016d0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 shutdown_connections 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a8015ae20 0x7f2a8014e8c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a80149bd0 0x7f2a8016a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 --2- 172.21.15.46:0/1094298424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a8015a9b0 0x7f2a8014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 >> 172.21.15.46:0/1094298424 conn(0x7f2a8006a320 msgr2=0x7f2a80154720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 shutdown_connections 2023-10-07T09:00:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:37.656+0000 7f2a87924700 1 -- 172.21.15.46:0/1094298424 wait complete. 2023-10-07T09:00:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-10-07T09:00:35.790840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393424,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752581296,"statfs":{"total":773094113280,"available":770643247104,"internally_reserved":0,"allocated":7094272,"data_stored":3657606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.800733"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993617+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:09.913296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995272+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993131+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995883+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:16.185286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991430+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:19.548965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.998040+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991244+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993320+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:18:14.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992915+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996200+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:14.912450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991581+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:58.660682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991265+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991258+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.997585+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:35.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994936+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992376+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996427+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:11.064865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992893+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996543+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:50.460347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993730+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:13.434403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996988+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.424325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994358+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:43.012895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995182+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:55.998851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995808+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:08.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.994496+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:57.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.995217+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:36.980187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.993089+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:52.250438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.991273+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.992367+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:57.775171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996285+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:39.597406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T09:00:30.988478+0000","last_change":"2023-10-07T09:00:30.988478+0000","last_active":"2023-10-07T09:00:30.988478+0000","last_peered":"2023-10-07T09:00:30.988478+0000","last_clean":"2023-10-07T09:00:30.988478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:30.988478+0000","last_undegraded":"2023-10-07T09:00:30.988478+0000","last_fullsized":"2023-10-07T09:00:30.988478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T09:00:29.984331+0000","last_change":"2023-10-07T09:00:29.996024+0000","last_active":"2023-10-07T09:00:29.984331+0000","last_peered":"2023-10-07T09:00:29.984331+0000","last_clean":"2023-10-07T09:00:29.984331+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T09:00:29.984331+0000","last_undegraded":"2023-10-07T09:00:29.984331+0000","last_fullsized":"2023-10-07T09:00:29.984331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:25:45.028890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-07T09:00:29.641373+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:29.641373+0000","last_peered":"2023-10-07T09:00:29.641373+0000","last_clean":"2023-10-07T09:00:29.641373+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:29.641373+0000","last_undegraded":"2023-10-07T09:00:29.641373+0000","last_fullsized":"2023-10-07T09:00:29.641373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":895623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.436}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.503}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0880000000000001,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.246}]},{"osd":2,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.224},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":11.32,"5min":11.32,"15min":11.32},"last":0.27600000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.880000000000001,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.4850000000000003,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.627}]},{"osd":6,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.3920000000000003,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":901428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.31}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.071,"5min":10.071,"15min":10.071},"last":0.436},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":10.183,"5min":10.183,"15min":10.183},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":20.922000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.372},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.038,"5min":12.038,"15min":12.038},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.1230000000000002,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.31}]},{"osd":4,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.973000000000001,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":305255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":9.7040000000000006,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.434},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":9.8439999999999994,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.01,"5min":10.01,"15min":10.01},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.131,"5min":10.131,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":311060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:40.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:00:40.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.808+0000 7f8b26b0a700 1 Processor -- start 2023-10-07T09:00:40.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.808+0000 7f8b26b0a700 1 -- start start 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b26b0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159c60 0x7f8b2015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b26b0a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b2015db10 0x7f8b20069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b26b0a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2015a160 con 0x7f8b20159890 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b26b0a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200d13a0 con 0x7f8b2015db10 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b26b0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2015e140 con 0x7f8b20159c60 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b2015db10 0x7f8b20069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b2015db10 0x7f8b20069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60920/0 (socket says 172.21.15.46:60920) 2023-10-07T09:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 -- 172.21.15.46:0/1364654743 learned_addr learned my addr 172.21.15.46:0/1364654743 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b1ffff700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159c60 0x7f8b2015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 -- 172.21.15.46:0/1364654743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159c60 msgr2=0x7f8b2015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159c60 0x7f8b2015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 -- 172.21.15.46:0/1364654743 >> v1:172.21.15.133:6789/0 conn(0x7f8b20159890 legacy=0x7f8b2015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 -- 172.21.15.46:0/1364654743 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2015a3d0 con 0x7f8b2015db10 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.809+0000 7f8b250a7700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20069560 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009f20 tx=0x7f8b18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8d0ed72d9c2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b1f7fe700 1 -- 172.21.15.46:0/1364654743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800e070 con 0x7f8b2015db10 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b1f7fe700 1 -- 172.21.15.46:0/1364654743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800ba80 con 0x7f8b2015db10 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b1f7fe700 1 -- 172.21.15.46:0/1364654743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180092e0 con 0x7f8b2015db10 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 -- 172.21.15.46:0/1364654743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 msgr2=0x7f8b20069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20069560 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009f20 tx=0x7f8b18009840 comp rx=0 tx=0).stop 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 -- 172.21.15.46:0/1364654743 shutdown_connections 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20069560 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/1364654743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159c60 0x7f8b2015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 -- 172.21.15.46:0/1364654743 >> 172.21.15.46:0/1364654743 conn(0x7f8b20068e20 msgr2=0x7f8b200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 -- 172.21.15.46:0/1364654743 shutdown_connections 2023-10-07T09:00:40.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.810+0000 7f8b26b0a700 1 -- 172.21.15.46:0/1364654743 wait complete. 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.811+0000 7f8b26b0a700 1 Processor -- start 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 -- start start 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159890 0x7f8b201496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 0x7f8b20151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20149c10 con 0x7f8b2015db10 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200cdf20 con 0x7f8b20159c60 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b26b0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20152a90 con 0x7f8b20159890 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.812+0000 7f8b250a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60934/0 (socket says 172.21.15.46:60934) 2023-10-07T09:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 -- 172.21.15.46:0/506512662 learned_addr learned my addr 172.21.15.46:0/506512662 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b248a6700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159890 0x7f8b201496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b1ffff700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 0x7f8b20151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 -- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159890 msgr2=0x7f8b201496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159890 0x7f8b201496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 -- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 msgr2=0x7f8b20151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 0x7f8b20151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 -- 172.21.15.46:0/506512662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18009ae0 con 0x7f8b2015db10 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b1ffff700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 0x7f8b20151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b250a7700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b6c0 tx=0x7f8b18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180032f0 con 0x7f8b2015db10 2023-10-07T09:00:40.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18008e80 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b200cd160 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1801c620 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.813+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b200cd720 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.814+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2004c3c0 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.815+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8b18003040 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.815+0000 7f8b1cff9700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 0x7f8b00069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.815+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b18085e70 con 0x7f8b2015db10 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.815+0000 7f8b248a6700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 0x7f8b00069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:40.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.816+0000 7f8b248a6700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 0x7f8b00069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8b08003860 tx=0x7f8b08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:40.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:40.819+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b18052fe0 con 0x7f8b2015db10 2023-10-07T09:00:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.008+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b2015d2d0 con 0x7f8b00066fc0 2023-10-07T09:00:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.017+0000 7f8b1cff9700 1 -- 172.21.15.46:0/506512662 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289238 (secure 0 0 0) 0x7f8b2015d2d0 con 0x7f8b00066fc0 2023-10-07T09:00:41.022 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:41.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.020+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 msgr2=0x7f8b00069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.020+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 0x7f8b00069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8b08003860 tx=0x7f8b08009040 comp rx=0 tx=0).stop 2023-10-07T09:00:41.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.020+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 msgr2=0x7f8b20152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.020+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b6c0 tx=0x7f8b18018000 comp rx=0 tx=0).stop 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 shutdown_connections 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8b00066fc0 0x7f8b00069470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b2015db10 0x7f8b20152460 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b20159890 0x7f8b201496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 --2- 172.21.15.46:0/506512662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b20159c60 0x7f8b20151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 >> 172.21.15.46:0/506512662 conn(0x7f8b20068e20 msgr2=0x7f8b201538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 shutdown_connections 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.021+0000 7f8b26b0a700 1 -- 172.21.15.46:0/506512662 wait complete. 2023-10-07T09:00:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:00:41.033 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-07T09:00:39.791835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397896,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752576824,"statfs":{"total":773094113280,"available":770638667776,"internally_reserved":0,"allocated":7479296,"data_stored":3828340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002138"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019876+0000","last_change":"2023-10-07T09:00:32.010459+0000","last_active":"2023-10-07T09:00:32.019876+0000","last_peered":"2023-10-07T09:00:32.019876+0000","last_clean":"2023-10-07T09:00:32.019876+0000","last_became_active":"2023-10-07T09:00:32.010264+0000","last_became_peered":"2023-10-07T09:00:32.010264+0000","last_unstale":"2023-10-07T09:00:32.019876+0000","last_undegraded":"2023-10-07T09:00:32.019876+0000","last_fullsized":"2023-10-07T09:00:32.019876+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:12:28.606059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034125+0000","last_change":"2023-10-07T09:00:32.033034+0000","last_active":"2023-10-07T09:00:32.034125+0000","last_peered":"2023-10-07T09:00:32.034125+0000","last_clean":"2023-10-07T09:00:32.034125+0000","last_became_active":"2023-10-07T09:00:32.032771+0000","last_became_peered":"2023-10-07T09:00:32.032771+0000","last_unstale":"2023-10-07T09:00:32.034125+0000","last_undegraded":"2023-10-07T09:00:32.034125+0000","last_fullsized":"2023-10-07T09:00:32.034125+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:54:15.922485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.022884+0000","last_change":"2023-10-07T09:00:32.019612+0000","last_active":"2023-10-07T09:00:32.022884+0000","last_peered":"2023-10-07T09:00:32.022884+0000","last_clean":"2023-10-07T09:00:32.022884+0000","last_became_active":"2023-10-07T09:00:32.019355+0000","last_became_peered":"2023-10-07T09:00:32.019355+0000","last_unstale":"2023-10-07T09:00:32.022884+0000","last_undegraded":"2023-10-07T09:00:32.022884+0000","last_fullsized":"2023-10-07T09:00:32.022884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:32.515603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032785+0000","last_change":"2023-10-07T09:00:32.029499+0000","last_active":"2023-10-07T09:00:32.032785+0000","last_peered":"2023-10-07T09:00:32.032785+0000","last_clean":"2023-10-07T09:00:32.032785+0000","last_became_active":"2023-10-07T09:00:32.029214+0000","last_became_peered":"2023-10-07T09:00:32.029214+0000","last_unstale":"2023-10-07T09:00:32.032785+0000","last_undegraded":"2023-10-07T09:00:32.032785+0000","last_fullsized":"2023-10-07T09:00:32.032785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:49:30.577068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.021413+0000","last_change":"2023-10-07T09:00:32.018556+0000","last_active":"2023-10-07T09:00:32.021413+0000","last_peered":"2023-10-07T09:00:32.021413+0000","last_clean":"2023-10-07T09:00:32.021413+0000","last_became_active":"2023-10-07T09:00:32.018278+0000","last_became_peered":"2023-10-07T09:00:32.018278+0000","last_unstale":"2023-10-07T09:00:32.021413+0000","last_undegraded":"2023-10-07T09:00:32.021413+0000","last_fullsized":"2023-10-07T09:00:32.021413+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:12.069012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032220+0000","last_change":"2023-10-07T09:00:32.025763+0000","last_active":"2023-10-07T09:00:32.032220+0000","last_peered":"2023-10-07T09:00:32.032220+0000","last_clean":"2023-10-07T09:00:32.032220+0000","last_became_active":"2023-10-07T09:00:32.025531+0000","last_became_peered":"2023-10-07T09:00:32.025531+0000","last_unstale":"2023-10-07T09:00:32.032220+0000","last_undegraded":"2023-10-07T09:00:32.032220+0000","last_fullsized":"2023-10-07T09:00:32.032220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:20.963993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019685+0000","last_change":"2023-10-07T09:00:32.010131+0000","last_active":"2023-10-07T09:00:32.019685+0000","last_peered":"2023-10-07T09:00:32.019685+0000","last_clean":"2023-10-07T09:00:32.019685+0000","last_became_active":"2023-10-07T09:00:32.009826+0000","last_became_peered":"2023-10-07T09:00:32.009826+0000","last_unstale":"2023-10-07T09:00:32.019685+0000","last_undegraded":"2023-10-07T09:00:32.019685+0000","last_fullsized":"2023-10-07T09:00:32.019685+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:17:10.871535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031192+0000","last_change":"2023-10-07T09:00:32.027855+0000","last_active":"2023-10-07T09:00:32.031192+0000","last_peered":"2023-10-07T09:00:32.031192+0000","last_clean":"2023-10-07T09:00:32.031192+0000","last_became_active":"2023-10-07T09:00:32.027591+0000","last_became_peered":"2023-10-07T09:00:32.027591+0000","last_unstale":"2023-10-07T09:00:32.031192+0000","last_undegraded":"2023-10-07T09:00:32.031192+0000","last_fullsized":"2023-10-07T09:00:32.031192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:44.017042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.016645+0000","last_change":"2023-10-07T09:00:32.015063+0000","last_active":"2023-10-07T09:00:32.016645+0000","last_peered":"2023-10-07T09:00:32.016645+0000","last_clean":"2023-10-07T09:00:32.016645+0000","last_became_active":"2023-10-07T09:00:32.014569+0000","last_became_peered":"2023-10-07T09:00:32.014569+0000","last_unstale":"2023-10-07T09:00:32.016645+0000","last_undegraded":"2023-10-07T09:00:32.016645+0000","last_fullsized":"2023-10-07T09:00:32.016645+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:13.929298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034476+0000","last_change":"2023-10-07T09:00:32.029810+0000","last_active":"2023-10-07T09:00:32.034476+0000","last_peered":"2023-10-07T09:00:32.034476+0000","last_clean":"2023-10-07T09:00:32.034476+0000","last_became_active":"2023-10-07T09:00:32.029516+0000","last_became_peered":"2023-10-07T09:00:32.029516+0000","last_unstale":"2023-10-07T09:00:32.034476+0000","last_undegraded":"2023-10-07T09:00:32.034476+0000","last_fullsized":"2023-10-07T09:00:32.034476+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:36.452717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019632+0000","last_change":"2023-10-07T09:00:32.012914+0000","last_active":"2023-10-07T09:00:32.019632+0000","last_peered":"2023-10-07T09:00:32.019632+0000","last_clean":"2023-10-07T09:00:32.019632+0000","last_became_active":"2023-10-07T09:00:32.012646+0000","last_became_peered":"2023-10-07T09:00:32.012646+0000","last_unstale":"2023-10-07T09:00:32.019632+0000","last_undegraded":"2023-10-07T09:00:32.019632+0000","last_fullsized":"2023-10-07T09:00:32.019632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:15.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.006910+0000","last_change":"2023-10-07T09:00:32.005913+0000","last_active":"2023-10-07T09:00:32.006910+0000","last_peered":"2023-10-07T09:00:32.006910+0000","last_clean":"2023-10-07T09:00:32.006910+0000","last_became_active":"2023-10-07T09:00:32.005631+0000","last_became_peered":"2023-10-07T09:00:32.005631+0000","last_unstale":"2023-10-07T09:00:32.006910+0000","last_undegraded":"2023-10-07T09:00:32.006910+0000","last_fullsized":"2023-10-07T09:00:32.006910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:54:15.922485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031103+0000","last_change":"2023-10-07T09:00:32.030449+0000","last_active":"2023-10-07T09:00:32.031103+0000","last_peered":"2023-10-07T09:00:32.031103+0000","last_clean":"2023-10-07T09:00:32.031103+0000","last_became_active":"2023-10-07T09:00:32.030201+0000","last_became_peered":"2023-10-07T09:00:32.030201+0000","last_unstale":"2023-10-07T09:00:32.031103+0000","last_undegraded":"2023-10-07T09:00:32.031103+0000","last_fullsized":"2023-10-07T09:00:32.031103+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:36.306395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.015100+0000","last_change":"2023-10-07T09:00:32.010308+0000","last_active":"2023-10-07T09:00:32.015100+0000","last_peered":"2023-10-07T09:00:32.015100+0000","last_clean":"2023-10-07T09:00:32.015100+0000","last_became_active":"2023-10-07T09:00:32.010042+0000","last_became_peered":"2023-10-07T09:00:32.010042+0000","last_unstale":"2023-10-07T09:00:32.015100+0000","last_undegraded":"2023-10-07T09:00:32.015100+0000","last_fullsized":"2023-10-07T09:00:32.015100+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:44.428472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.020023+0000","last_change":"2023-10-07T09:00:32.017084+0000","last_active":"2023-10-07T09:00:32.020023+0000","last_peered":"2023-10-07T09:00:32.020023+0000","last_clean":"2023-10-07T09:00:32.020023+0000","last_became_active":"2023-10-07T09:00:32.016797+0000","last_became_peered":"2023-10-07T09:00:32.016797+0000","last_unstale":"2023-10-07T09:00:32.020023+0000","last_undegraded":"2023-10-07T09:00:32.020023+0000","last_fullsized":"2023-10-07T09:00:32.020023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:27.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.036139+0000","last_change":"2023-10-07T09:00:32.033829+0000","last_active":"2023-10-07T09:00:32.036139+0000","last_peered":"2023-10-07T09:00:32.036139+0000","last_clean":"2023-10-07T09:00:32.036139+0000","last_became_active":"2023-10-07T09:00:32.033512+0000","last_became_peered":"2023-10-07T09:00:32.033512+0000","last_unstale":"2023-10-07T09:00:32.036139+0000","last_undegraded":"2023-10-07T09:00:32.036139+0000","last_fullsized":"2023-10-07T09:00:32.036139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:59.845002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.016601+0000","last_change":"2023-10-07T09:00:32.014892+0000","last_active":"2023-10-07T09:00:32.016601+0000","last_peered":"2023-10-07T09:00:32.016601+0000","last_clean":"2023-10-07T09:00:32.016601+0000","last_became_active":"2023-10-07T09:00:32.014301+0000","last_became_peered":"2023-10-07T09:00:32.014301+0000","last_unstale":"2023-10-07T09:00:32.016601+0000","last_undegraded":"2023-10-07T09:00:32.016601+0000","last_fullsized":"2023-10-07T09:00:32.016601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:46.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032734+0000","last_change":"2023-10-07T09:00:32.028929+0000","last_active":"2023-10-07T09:00:32.032734+0000","last_peered":"2023-10-07T09:00:32.032734+0000","last_clean":"2023-10-07T09:00:32.032734+0000","last_became_active":"2023-10-07T09:00:32.028669+0000","last_became_peered":"2023-10-07T09:00:32.028669+0000","last_unstale":"2023-10-07T09:00:32.032734+0000","last_undegraded":"2023-10-07T09:00:32.032734+0000","last_fullsized":"2023-10-07T09:00:32.032734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:57:17.508338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032422+0000","last_change":"2023-10-07T09:00:32.026664+0000","last_active":"2023-10-07T09:00:32.032422+0000","last_peered":"2023-10-07T09:00:32.032422+0000","last_clean":"2023-10-07T09:00:32.032422+0000","last_became_active":"2023-10-07T09:00:32.026386+0000","last_became_peered":"2023-10-07T09:00:32.026386+0000","last_unstale":"2023-10-07T09:00:32.032422+0000","last_undegraded":"2023-10-07T09:00:32.032422+0000","last_fullsized":"2023-10-07T09:00:32.032422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:37.984335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.021739+0000","last_change":"2023-10-07T09:00:32.020738+0000","last_active":"2023-10-07T09:00:32.021739+0000","last_peered":"2023-10-07T09:00:32.021739+0000","last_clean":"2023-10-07T09:00:32.021739+0000","last_became_active":"2023-10-07T09:00:32.020469+0000","last_became_peered":"2023-10-07T09:00:32.020469+0000","last_unstale":"2023-10-07T09:00:32.021739+0000","last_undegraded":"2023-10-07T09:00:32.021739+0000","last_fullsized":"2023-10-07T09:00:32.021739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:34:52.304369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034382+0000","last_change":"2023-10-07T09:00:32.026196+0000","last_active":"2023-10-07T09:00:32.034382+0000","last_peered":"2023-10-07T09:00:32.034382+0000","last_clean":"2023-10-07T09:00:32.034382+0000","last_became_active":"2023-10-07T09:00:32.025695+0000","last_became_peered":"2023-10-07T09:00:32.025695+0000","last_unstale":"2023-10-07T09:00:32.034382+0000","last_undegraded":"2023-10-07T09:00:32.034382+0000","last_fullsized":"2023-10-07T09:00:32.034382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:57.002998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030138+0000","last_change":"2023-10-07T09:00:32.023160+0000","last_active":"2023-10-07T09:00:32.030138+0000","last_peered":"2023-10-07T09:00:32.030138+0000","last_clean":"2023-10-07T09:00:32.030138+0000","last_became_active":"2023-10-07T09:00:32.022891+0000","last_became_peered":"2023-10-07T09:00:32.022891+0000","last_unstale":"2023-10-07T09:00:32.030138+0000","last_undegraded":"2023-10-07T09:00:32.030138+0000","last_fullsized":"2023-10-07T09:00:32.030138+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:54:15.922485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.018820+0000","last_change":"2023-10-07T09:00:32.012747+0000","last_active":"2023-10-07T09:00:32.018820+0000","last_peered":"2023-10-07T09:00:32.018820+0000","last_clean":"2023-10-07T09:00:32.018820+0000","last_became_active":"2023-10-07T09:00:32.011406+0000","last_became_peered":"2023-10-07T09:00:32.011406+0000","last_unstale":"2023-10-07T09:00:32.018820+0000","last_undegraded":"2023-10-07T09:00:32.018820+0000","last_fullsized":"2023-10-07T09:00:32.018820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:54.538592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033071+0000","last_change":"2023-10-07T09:00:32.027700+0000","last_active":"2023-10-07T09:00:32.033071+0000","last_peered":"2023-10-07T09:00:32.033071+0000","last_clean":"2023-10-07T09:00:32.033071+0000","last_became_active":"2023-10-07T09:00:32.027452+0000","last_became_peered":"2023-10-07T09:00:32.027452+0000","last_unstale":"2023-10-07T09:00:32.033071+0000","last_undegraded":"2023-10-07T09:00:32.033071+0000","last_fullsized":"2023-10-07T09:00:32.033071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:26.017331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034346+0000","last_change":"2023-10-07T09:00:32.025834+0000","last_active":"2023-10-07T09:00:32.034346+0000","last_peered":"2023-10-07T09:00:32.034346+0000","last_clean":"2023-10-07T09:00:32.034346+0000","last_became_active":"2023-10-07T09:00:32.025522+0000","last_became_peered":"2023-10-07T09:00:32.025522+0000","last_unstale":"2023-10-07T09:00:32.034346+0000","last_undegraded":"2023-10-07T09:00:32.034346+0000","last_fullsized":"2023-10-07T09:00:32.034346+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:10:37.984335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033404+0000","last_change":"2023-10-07T09:00:32.028612+0000","last_active":"2023-10-07T09:00:32.033404+0000","last_peered":"2023-10-07T09:00:32.033404+0000","last_clean":"2023-10-07T09:00:32.033404+0000","last_became_active":"2023-10-07T09:00:32.028366+0000","last_became_peered":"2023-10-07T09:00:32.028366+0000","last_unstale":"2023-10-07T09:00:32.033404+0000","last_undegraded":"2023-10-07T09:00:32.033404+0000","last_fullsized":"2023-10-07T09:00:32.033404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:04.557372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.024990+0000","last_change":"2023-10-07T09:00:32.023644+0000","last_active":"2023-10-07T09:00:32.024990+0000","last_peered":"2023-10-07T09:00:32.024990+0000","last_clean":"2023-10-07T09:00:32.024990+0000","last_became_active":"2023-10-07T09:00:32.023364+0000","last_became_peered":"2023-10-07T09:00:32.023364+0000","last_unstale":"2023-10-07T09:00:32.024990+0000","last_undegraded":"2023-10-07T09:00:32.024990+0000","last_fullsized":"2023-10-07T09:00:32.024990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:16:00.049516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034390+0000","last_change":"2023-10-07T09:00:32.025693+0000","last_active":"2023-10-07T09:00:32.034390+0000","last_peered":"2023-10-07T09:00:32.034390+0000","last_clean":"2023-10-07T09:00:32.034390+0000","last_became_active":"2023-10-07T09:00:32.025489+0000","last_became_peered":"2023-10-07T09:00:32.025489+0000","last_unstale":"2023-10-07T09:00:32.034390+0000","last_undegraded":"2023-10-07T09:00:32.034390+0000","last_fullsized":"2023-10-07T09:00:32.034390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:37.601870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.024208+0000","last_change":"2023-10-07T09:00:32.021109+0000","last_active":"2023-10-07T09:00:32.024208+0000","last_peered":"2023-10-07T09:00:32.024208+0000","last_clean":"2023-10-07T09:00:32.024208+0000","last_became_active":"2023-10-07T09:00:32.020713+0000","last_became_peered":"2023-10-07T09:00:32.020713+0000","last_unstale":"2023-10-07T09:00:32.024208+0000","last_undegraded":"2023-10-07T09:00:32.024208+0000","last_fullsized":"2023-10-07T09:00:32.024208+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:32.792473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031175+0000","last_change":"2023-10-07T09:00:32.026230+0000","last_active":"2023-10-07T09:00:32.031175+0000","last_peered":"2023-10-07T09:00:32.031175+0000","last_clean":"2023-10-07T09:00:32.031175+0000","last_became_active":"2023-10-07T09:00:32.025976+0000","last_became_peered":"2023-10-07T09:00:32.025976+0000","last_unstale":"2023-10-07T09:00:32.031175+0000","last_undegraded":"2023-10-07T09:00:32.031175+0000","last_fullsized":"2023-10-07T09:00:32.031175+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:36.306395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.014723+0000","last_change":"2023-10-07T09:00:32.009605+0000","last_active":"2023-10-07T09:00:32.014723+0000","last_peered":"2023-10-07T09:00:32.014723+0000","last_clean":"2023-10-07T09:00:32.014723+0000","last_became_active":"2023-10-07T09:00:32.009321+0000","last_became_peered":"2023-10-07T09:00:32.009321+0000","last_unstale":"2023-10-07T09:00:32.014723+0000","last_undegraded":"2023-10-07T09:00:32.014723+0000","last_fullsized":"2023-10-07T09:00:32.014723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:26:41.237086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031170+0000","last_change":"2023-10-07T09:00:32.027342+0000","last_active":"2023-10-07T09:00:32.031170+0000","last_peered":"2023-10-07T09:00:32.031170+0000","last_clean":"2023-10-07T09:00:32.031170+0000","last_became_active":"2023-10-07T09:00:32.027073+0000","last_became_peered":"2023-10-07T09:00:32.027073+0000","last_unstale":"2023-10-07T09:00:32.031170+0000","last_undegraded":"2023-10-07T09:00:32.031170+0000","last_fullsized":"2023-10-07T09:00:32.031170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:57:17.508338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030272+0000","last_change":"2023-10-07T09:00:32.026592+0000","last_active":"2023-10-07T09:00:32.030272+0000","last_peered":"2023-10-07T09:00:32.030272+0000","last_clean":"2023-10-07T09:00:32.030272+0000","last_became_active":"2023-10-07T09:00:32.026299+0000","last_became_peered":"2023-10-07T09:00:32.026299+0000","last_unstale":"2023-10-07T09:00:32.030272+0000","last_undegraded":"2023-10-07T09:00:32.030272+0000","last_fullsized":"2023-10-07T09:00:32.030272+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:57.462583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.028890+0000","last_change":"2023-10-07T09:00:31.006311+0000","last_active":"2023-10-07T09:00:32.028890+0000","last_peered":"2023-10-07T09:00:32.028890+0000","last_clean":"2023-10-07T09:00:32.028890+0000","last_became_active":"2023-10-07T09:00:31.005933+0000","last_became_peered":"2023-10-07T09:00:31.005933+0000","last_unstale":"2023-10-07T09:00:32.028890+0000","last_undegraded":"2023-10-07T09:00:32.028890+0000","last_fullsized":"2023-10-07T09:00:32.028890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:38:15.426399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.016619+0000","last_change":"2023-10-07T09:00:32.014892+0000","last_active":"2023-10-07T09:00:32.016619+0000","last_peered":"2023-10-07T09:00:32.016619+0000","last_clean":"2023-10-07T09:00:32.016619+0000","last_became_active":"2023-10-07T09:00:32.014202+0000","last_became_peered":"2023-10-07T09:00:32.014202+0000","last_unstale":"2023-10-07T09:00:32.016619+0000","last_undegraded":"2023-10-07T09:00:32.016619+0000","last_fullsized":"2023-10-07T09:00:32.016619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:30.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.024098+0000","last_change":"2023-10-07T09:00:31.009770+0000","last_active":"2023-10-07T09:00:32.024098+0000","last_peered":"2023-10-07T09:00:32.024098+0000","last_clean":"2023-10-07T09:00:32.024098+0000","last_became_active":"2023-10-07T09:00:31.009456+0000","last_became_peered":"2023-10-07T09:00:31.009456+0000","last_unstale":"2023-10-07T09:00:32.024098+0000","last_undegraded":"2023-10-07T09:00:32.024098+0000","last_fullsized":"2023-10-07T09:00:32.024098+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:35.448569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032398+0000","last_change":"2023-10-07T09:00:32.027496+0000","last_active":"2023-10-07T09:00:32.032398+0000","last_peered":"2023-10-07T09:00:32.032398+0000","last_clean":"2023-10-07T09:00:32.032398+0000","last_became_active":"2023-10-07T09:00:32.027182+0000","last_became_peered":"2023-10-07T09:00:32.027182+0000","last_unstale":"2023-10-07T09:00:32.032398+0000","last_undegraded":"2023-10-07T09:00:32.032398+0000","last_fullsized":"2023-10-07T09:00:32.032398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:32.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034056+0000","last_change":"2023-10-07T09:00:31.012900+0000","last_active":"2023-10-07T09:00:32.034056+0000","last_peered":"2023-10-07T09:00:32.034056+0000","last_clean":"2023-10-07T09:00:32.034056+0000","last_became_active":"2023-10-07T09:00:31.012623+0000","last_became_peered":"2023-10-07T09:00:31.012623+0000","last_unstale":"2023-10-07T09:00:32.034056+0000","last_undegraded":"2023-10-07T09:00:32.034056+0000","last_fullsized":"2023-10-07T09:00:32.034056+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:29.378800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.028016+0000","last_change":"2023-10-07T09:00:32.019742+0000","last_active":"2023-10-07T09:00:32.028016+0000","last_peered":"2023-10-07T09:00:32.028016+0000","last_clean":"2023-10-07T09:00:32.028016+0000","last_became_active":"2023-10-07T09:00:32.018913+0000","last_became_peered":"2023-10-07T09:00:32.018913+0000","last_unstale":"2023-10-07T09:00:32.028016+0000","last_undegraded":"2023-10-07T09:00:32.028016+0000","last_fullsized":"2023-10-07T09:00:32.028016+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:07:15.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032353+0000","last_change":"2023-10-07T09:00:31.013790+0000","last_active":"2023-10-07T09:00:32.032353+0000","last_peered":"2023-10-07T09:00:32.032353+0000","last_clean":"2023-10-07T09:00:32.032353+0000","last_became_active":"2023-10-07T09:00:31.013530+0000","last_became_peered":"2023-10-07T09:00:31.013530+0000","last_unstale":"2023-10-07T09:00:32.032353+0000","last_undegraded":"2023-10-07T09:00:32.032353+0000","last_fullsized":"2023-10-07T09:00:32.032353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:45.812291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019798+0000","last_change":"2023-10-07T09:00:32.014009+0000","last_active":"2023-10-07T09:00:32.019798+0000","last_peered":"2023-10-07T09:00:32.019798+0000","last_clean":"2023-10-07T09:00:32.019798+0000","last_became_active":"2023-10-07T09:00:32.013712+0000","last_became_peered":"2023-10-07T09:00:32.013712+0000","last_unstale":"2023-10-07T09:00:32.019798+0000","last_undegraded":"2023-10-07T09:00:32.019798+0000","last_fullsized":"2023-10-07T09:00:32.019798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:39.958391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031517+0000","last_change":"2023-10-07T09:00:31.006767+0000","last_active":"2023-10-07T09:00:32.031517+0000","last_peered":"2023-10-07T09:00:32.031517+0000","last_clean":"2023-10-07T09:00:32.031517+0000","last_became_active":"2023-10-07T09:00:31.006482+0000","last_became_peered":"2023-10-07T09:00:31.006482+0000","last_unstale":"2023-10-07T09:00:32.031517+0000","last_undegraded":"2023-10-07T09:00:32.031517+0000","last_fullsized":"2023-10-07T09:00:32.031517+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:12:27.601912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034359+0000","last_change":"2023-10-07T09:00:32.026016+0000","last_active":"2023-10-07T09:00:32.034359+0000","last_peered":"2023-10-07T09:00:32.034359+0000","last_clean":"2023-10-07T09:00:32.034359+0000","last_became_active":"2023-10-07T09:00:32.025379+0000","last_became_peered":"2023-10-07T09:00:32.025379+0000","last_unstale":"2023-10-07T09:00:32.034359+0000","last_undegraded":"2023-10-07T09:00:32.034359+0000","last_fullsized":"2023-10-07T09:00:32.034359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:49:30.577068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031448+0000","last_change":"2023-10-07T09:00:31.008283+0000","last_active":"2023-10-07T09:00:32.031448+0000","last_peered":"2023-10-07T09:00:32.031448+0000","last_clean":"2023-10-07T09:00:32.031448+0000","last_became_active":"2023-10-07T09:00:31.007669+0000","last_became_peered":"2023-10-07T09:00:31.007669+0000","last_unstale":"2023-10-07T09:00:32.031448+0000","last_undegraded":"2023-10-07T09:00:32.031448+0000","last_fullsized":"2023-10-07T09:00:32.031448+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:51.852175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.020965+0000","last_change":"2023-10-07T09:00:32.017918+0000","last_active":"2023-10-07T09:00:32.020965+0000","last_peered":"2023-10-07T09:00:32.020965+0000","last_clean":"2023-10-07T09:00:32.020965+0000","last_became_active":"2023-10-07T09:00:32.017612+0000","last_became_peered":"2023-10-07T09:00:32.017612+0000","last_unstale":"2023-10-07T09:00:32.020965+0000","last_undegraded":"2023-10-07T09:00:32.020965+0000","last_fullsized":"2023-10-07T09:00:32.020965+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:29:10.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.001308+0000","last_change":"2023-10-07T09:00:31.007502+0000","last_active":"2023-10-07T09:00:32.001308+0000","last_peered":"2023-10-07T09:00:32.001308+0000","last_clean":"2023-10-07T09:00:32.001308+0000","last_became_active":"2023-10-07T09:00:31.007231+0000","last_became_peered":"2023-10-07T09:00:31.007231+0000","last_unstale":"2023-10-07T09:00:32.001308+0000","last_undegraded":"2023-10-07T09:00:32.001308+0000","last_fullsized":"2023-10-07T09:00:32.001308+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:51.577111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.021284+0000","last_change":"2023-10-07T09:00:32.019897+0000","last_active":"2023-10-07T09:00:32.021284+0000","last_peered":"2023-10-07T09:00:32.021284+0000","last_clean":"2023-10-07T09:00:32.021284+0000","last_became_active":"2023-10-07T09:00:32.019622+0000","last_became_peered":"2023-10-07T09:00:32.019622+0000","last_unstale":"2023-10-07T09:00:32.021284+0000","last_undegraded":"2023-10-07T09:00:32.021284+0000","last_fullsized":"2023-10-07T09:00:32.021284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:39.958391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.004458+0000","last_change":"2023-10-07T09:00:31.003587+0000","last_active":"2023-10-07T09:00:32.004458+0000","last_peered":"2023-10-07T09:00:32.004458+0000","last_clean":"2023-10-07T09:00:32.004458+0000","last_became_active":"2023-10-07T09:00:31.003296+0000","last_became_peered":"2023-10-07T09:00:31.003296+0000","last_unstale":"2023-10-07T09:00:32.004458+0000","last_undegraded":"2023-10-07T09:00:32.004458+0000","last_fullsized":"2023-10-07T09:00:32.004458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:31.234439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.024684+0000","last_change":"2023-10-07T09:00:32.018685+0000","last_active":"2023-10-07T09:00:32.024684+0000","last_peered":"2023-10-07T09:00:32.024684+0000","last_clean":"2023-10-07T09:00:32.024684+0000","last_became_active":"2023-10-07T09:00:32.018430+0000","last_became_peered":"2023-10-07T09:00:32.018430+0000","last_unstale":"2023-10-07T09:00:32.024684+0000","last_undegraded":"2023-10-07T09:00:32.024684+0000","last_fullsized":"2023-10-07T09:00:32.024684+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:12:26.013391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.017385+0000","last_change":"2023-10-07T09:00:31.008763+0000","last_active":"2023-10-07T09:00:32.017385+0000","last_peered":"2023-10-07T09:00:32.017385+0000","last_clean":"2023-10-07T09:00:32.017385+0000","last_became_active":"2023-10-07T09:00:31.008508+0000","last_became_peered":"2023-10-07T09:00:31.008508+0000","last_unstale":"2023-10-07T09:00:32.017385+0000","last_undegraded":"2023-10-07T09:00:32.017385+0000","last_fullsized":"2023-10-07T09:00:32.017385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:44.265373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033032+0000","last_change":"2023-10-07T09:00:32.027860+0000","last_active":"2023-10-07T09:00:32.033032+0000","last_peered":"2023-10-07T09:00:32.033032+0000","last_clean":"2023-10-07T09:00:32.033032+0000","last_became_active":"2023-10-07T09:00:32.027286+0000","last_became_peered":"2023-10-07T09:00:32.027286+0000","last_unstale":"2023-10-07T09:00:32.033032+0000","last_undegraded":"2023-10-07T09:00:32.033032+0000","last_fullsized":"2023-10-07T09:00:32.033032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:06.278221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.021621+0000","last_change":"2023-10-07T09:00:31.012610+0000","last_active":"2023-10-07T09:00:32.021621+0000","last_peered":"2023-10-07T09:00:32.021621+0000","last_clean":"2023-10-07T09:00:32.021621+0000","last_became_active":"2023-10-07T09:00:31.012331+0000","last_became_peered":"2023-10-07T09:00:31.012331+0000","last_unstale":"2023-10-07T09:00:32.021621+0000","last_undegraded":"2023-10-07T09:00:32.021621+0000","last_fullsized":"2023-10-07T09:00:32.021621+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:12.925151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033547+0000","last_change":"2023-10-07T09:00:32.030070+0000","last_active":"2023-10-07T09:00:32.033547+0000","last_peered":"2023-10-07T09:00:32.033547+0000","last_clean":"2023-10-07T09:00:32.033547+0000","last_became_active":"2023-10-07T09:00:32.029457+0000","last_became_peered":"2023-10-07T09:00:32.029457+0000","last_unstale":"2023-10-07T09:00:32.033547+0000","last_undegraded":"2023-10-07T09:00:32.033547+0000","last_fullsized":"2023-10-07T09:00:32.033547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:49:30.577068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"63'3","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031267+0000","last_change":"2023-10-07T09:00:31.012240+0000","last_active":"2023-10-07T09:00:32.031267+0000","last_peered":"2023-10-07T09:00:32.031267+0000","last_clean":"2023-10-07T09:00:32.031267+0000","last_became_active":"2023-10-07T09:00:31.011964+0000","last_became_peered":"2023-10-07T09:00:31.011964+0000","last_unstale":"2023-10-07T09:00:32.031267+0000","last_undegraded":"2023-10-07T09:00:32.031267+0000","last_fullsized":"2023-10-07T09:00:32.031267+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:25.013183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.007539+0000","last_change":"2023-10-07T09:00:32.006607+0000","last_active":"2023-10-07T09:00:32.007539+0000","last_peered":"2023-10-07T09:00:32.007539+0000","last_clean":"2023-10-07T09:00:32.007539+0000","last_became_active":"2023-10-07T09:00:32.006353+0000","last_became_peered":"2023-10-07T09:00:32.006353+0000","last_unstale":"2023-10-07T09:00:32.007539+0000","last_undegraded":"2023-10-07T09:00:32.007539+0000","last_fullsized":"2023-10-07T09:00:32.007539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:15.916597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"63'6","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.035727+0000","last_change":"2023-10-07T09:00:31.009978+0000","last_active":"2023-10-07T09:00:32.035727+0000","last_peered":"2023-10-07T09:00:32.035727+0000","last_clean":"2023-10-07T09:00:32.035727+0000","last_became_active":"2023-10-07T09:00:31.009326+0000","last_became_peered":"2023-10-07T09:00:31.009326+0000","last_unstale":"2023-10-07T09:00:32.035727+0000","last_undegraded":"2023-10-07T09:00:32.035727+0000","last_fullsized":"2023-10-07T09:00:32.035727+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:54.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019617+0000","last_change":"2023-10-07T09:00:32.010968+0000","last_active":"2023-10-07T09:00:32.019617+0000","last_peered":"2023-10-07T09:00:32.019617+0000","last_clean":"2023-10-07T09:00:32.019617+0000","last_became_active":"2023-10-07T09:00:32.010762+0000","last_became_peered":"2023-10-07T09:00:32.010762+0000","last_unstale":"2023-10-07T09:00:32.019617+0000","last_undegraded":"2023-10-07T09:00:32.019617+0000","last_fullsized":"2023-10-07T09:00:32.019617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:20.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033041+0000","last_change":"2023-10-07T09:00:31.006523+0000","last_active":"2023-10-07T09:00:32.033041+0000","last_peered":"2023-10-07T09:00:32.033041+0000","last_clean":"2023-10-07T09:00:32.033041+0000","last_became_active":"2023-10-07T09:00:31.006119+0000","last_became_peered":"2023-10-07T09:00:31.006119+0000","last_unstale":"2023-10-07T09:00:32.033041+0000","last_undegraded":"2023-10-07T09:00:32.033041+0000","last_fullsized":"2023-10-07T09:00:32.033041+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:20.989997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033426+0000","last_change":"2023-10-07T09:00:32.028948+0000","last_active":"2023-10-07T09:00:32.033426+0000","last_peered":"2023-10-07T09:00:32.033426+0000","last_clean":"2023-10-07T09:00:32.033426+0000","last_became_active":"2023-10-07T09:00:32.028642+0000","last_became_peered":"2023-10-07T09:00:32.028642+0000","last_unstale":"2023-10-07T09:00:32.033426+0000","last_undegraded":"2023-10-07T09:00:32.033426+0000","last_fullsized":"2023-10-07T09:00:32.033426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:46:04.071969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.013241+0000","last_change":"2023-10-07T09:00:31.015253+0000","last_active":"2023-10-07T09:00:32.013241+0000","last_peered":"2023-10-07T09:00:32.013241+0000","last_clean":"2023-10-07T09:00:32.013241+0000","last_became_active":"2023-10-07T09:00:31.014893+0000","last_became_peered":"2023-10-07T09:00:31.014893+0000","last_unstale":"2023-10-07T09:00:32.013241+0000","last_undegraded":"2023-10-07T09:00:32.013241+0000","last_fullsized":"2023-10-07T09:00:32.013241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:42.498383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030579+0000","last_change":"2023-10-07T09:00:32.029821+0000","last_active":"2023-10-07T09:00:32.030579+0000","last_peered":"2023-10-07T09:00:32.030579+0000","last_clean":"2023-10-07T09:00:32.030579+0000","last_became_active":"2023-10-07T09:00:32.029542+0000","last_became_peered":"2023-10-07T09:00:32.029542+0000","last_unstale":"2023-10-07T09:00:32.030579+0000","last_undegraded":"2023-10-07T09:00:32.030579+0000","last_fullsized":"2023-10-07T09:00:32.030579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:01:30.711609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.006574+0000","last_change":"2023-10-07T09:00:31.010022+0000","last_active":"2023-10-07T09:00:32.006574+0000","last_peered":"2023-10-07T09:00:32.006574+0000","last_clean":"2023-10-07T09:00:32.006574+0000","last_became_active":"2023-10-07T09:00:31.009747+0000","last_became_peered":"2023-10-07T09:00:31.009747+0000","last_unstale":"2023-10-07T09:00:32.006574+0000","last_undegraded":"2023-10-07T09:00:32.006574+0000","last_fullsized":"2023-10-07T09:00:32.006574+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:42.122476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.016541+0000","last_change":"2023-10-07T09:00:32.015356+0000","last_active":"2023-10-07T09:00:32.016541+0000","last_peered":"2023-10-07T09:00:32.016541+0000","last_clean":"2023-10-07T09:00:32.016541+0000","last_became_active":"2023-10-07T09:00:32.015038+0000","last_became_peered":"2023-10-07T09:00:32.015038+0000","last_unstale":"2023-10-07T09:00:32.016541+0000","last_undegraded":"2023-10-07T09:00:32.016541+0000","last_fullsized":"2023-10-07T09:00:32.016541+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:51.464494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"63'8","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.036429+0000","last_change":"2023-10-07T09:00:31.005385+0000","last_active":"2023-10-07T09:00:32.036429+0000","last_peered":"2023-10-07T09:00:32.036429+0000","last_clean":"2023-10-07T09:00:32.036429+0000","last_became_active":"2023-10-07T09:00:31.004891+0000","last_became_peered":"2023-10-07T09:00:31.004891+0000","last_unstale":"2023-10-07T09:00:32.036429+0000","last_undegraded":"2023-10-07T09:00:32.036429+0000","last_fullsized":"2023-10-07T09:00:32.036429+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:20.989997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.034460+0000","last_change":"2023-10-07T09:00:32.029336+0000","last_active":"2023-10-07T09:00:32.034460+0000","last_peered":"2023-10-07T09:00:32.034460+0000","last_clean":"2023-10-07T09:00:32.034460+0000","last_became_active":"2023-10-07T09:00:32.029073+0000","last_became_peered":"2023-10-07T09:00:32.029073+0000","last_unstale":"2023-10-07T09:00:32.034460+0000","last_undegraded":"2023-10-07T09:00:32.034460+0000","last_fullsized":"2023-10-07T09:00:32.034460+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:44.017042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030657+0000","last_change":"2023-10-07T09:00:31.015323+0000","last_active":"2023-10-07T09:00:32.030657+0000","last_peered":"2023-10-07T09:00:32.030657+0000","last_clean":"2023-10-07T09:00:32.030657+0000","last_became_active":"2023-10-07T09:00:31.015024+0000","last_became_peered":"2023-10-07T09:00:31.015024+0000","last_unstale":"2023-10-07T09:00:32.030657+0000","last_undegraded":"2023-10-07T09:00:32.030657+0000","last_fullsized":"2023-10-07T09:00:32.030657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:29.601866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.022660+0000","last_change":"2023-10-07T09:00:32.017181+0000","last_active":"2023-10-07T09:00:32.022660+0000","last_peered":"2023-10-07T09:00:32.022660+0000","last_clean":"2023-10-07T09:00:32.022660+0000","last_became_active":"2023-10-07T09:00:32.016900+0000","last_became_peered":"2023-10-07T09:00:32.016900+0000","last_unstale":"2023-10-07T09:00:32.022660+0000","last_undegraded":"2023-10-07T09:00:32.022660+0000","last_fullsized":"2023-10-07T09:00:32.022660+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:52.668953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033685+0000","last_change":"2023-10-07T09:00:31.014034+0000","last_active":"2023-10-07T09:00:32.033685+0000","last_peered":"2023-10-07T09:00:32.033685+0000","last_clean":"2023-10-07T09:00:32.033685+0000","last_became_active":"2023-10-07T09:00:31.013764+0000","last_became_peered":"2023-10-07T09:00:31.013764+0000","last_unstale":"2023-10-07T09:00:32.033685+0000","last_undegraded":"2023-10-07T09:00:32.033685+0000","last_fullsized":"2023-10-07T09:00:32.033685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:33:51.577111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.005997+0000","last_change":"2023-10-07T09:00:32.005095+0000","last_active":"2023-10-07T09:00:32.005997+0000","last_peered":"2023-10-07T09:00:32.005997+0000","last_clean":"2023-10-07T09:00:32.005997+0000","last_became_active":"2023-10-07T09:00:32.004838+0000","last_became_peered":"2023-10-07T09:00:32.004838+0000","last_unstale":"2023-10-07T09:00:32.005997+0000","last_undegraded":"2023-10-07T09:00:32.005997+0000","last_fullsized":"2023-10-07T09:00:32.005997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:20.963993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.032716+0000","last_change":"2023-10-07T09:00:31.013609+0000","last_active":"2023-10-07T09:00:32.032716+0000","last_peered":"2023-10-07T09:00:32.032716+0000","last_clean":"2023-10-07T09:00:32.032716+0000","last_became_active":"2023-10-07T09:00:31.013104+0000","last_became_peered":"2023-10-07T09:00:31.013104+0000","last_unstale":"2023-10-07T09:00:32.032716+0000","last_undegraded":"2023-10-07T09:00:32.032716+0000","last_fullsized":"2023-10-07T09:00:32.032716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:59.025279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.027129+0000","last_change":"2023-10-07T09:00:32.026510+0000","last_active":"2023-10-07T09:00:32.027129+0000","last_peered":"2023-10-07T09:00:32.027129+0000","last_clean":"2023-10-07T09:00:32.027129+0000","last_became_active":"2023-10-07T09:00:32.026189+0000","last_became_peered":"2023-10-07T09:00:32.026189+0000","last_unstale":"2023-10-07T09:00:32.027129+0000","last_undegraded":"2023-10-07T09:00:32.027129+0000","last_fullsized":"2023-10-07T09:00:32.027129+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:17.189434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.005704+0000","last_change":"2023-10-07T09:00:31.009440+0000","last_active":"2023-10-07T09:00:32.005704+0000","last_peered":"2023-10-07T09:00:32.005704+0000","last_clean":"2023-10-07T09:00:32.005704+0000","last_became_active":"2023-10-07T09:00:31.009189+0000","last_became_peered":"2023-10-07T09:00:31.009189+0000","last_unstale":"2023-10-07T09:00:32.005704+0000","last_undegraded":"2023-10-07T09:00:32.005704+0000","last_fullsized":"2023-10-07T09:00:32.005704+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:38.954244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.023570+0000","last_change":"2023-10-07T09:00:32.020759+0000","last_active":"2023-10-07T09:00:32.023570+0000","last_peered":"2023-10-07T09:00:32.023570+0000","last_clean":"2023-10-07T09:00:32.023570+0000","last_became_active":"2023-10-07T09:00:32.020351+0000","last_became_peered":"2023-10-07T09:00:32.020351+0000","last_unstale":"2023-10-07T09:00:32.023570+0000","last_undegraded":"2023-10-07T09:00:32.023570+0000","last_fullsized":"2023-10-07T09:00:32.023570+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:54.731600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.013334+0000","last_change":"2023-10-07T09:00:31.007764+0000","last_active":"2023-10-07T09:00:32.013334+0000","last_peered":"2023-10-07T09:00:32.013334+0000","last_clean":"2023-10-07T09:00:32.013334+0000","last_became_active":"2023-10-07T09:00:31.007321+0000","last_became_peered":"2023-10-07T09:00:31.007321+0000","last_unstale":"2023-10-07T09:00:32.013334+0000","last_undegraded":"2023-10-07T09:00:32.013334+0000","last_fullsized":"2023-10-07T09:00:32.013334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:59.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030207+0000","last_change":"2023-10-07T09:00:32.029185+0000","last_active":"2023-10-07T09:00:32.030207+0000","last_peered":"2023-10-07T09:00:32.030207+0000","last_clean":"2023-10-07T09:00:32.030207+0000","last_became_active":"2023-10-07T09:00:32.028675+0000","last_became_peered":"2023-10-07T09:00:32.028675+0000","last_unstale":"2023-10-07T09:00:32.030207+0000","last_undegraded":"2023-10-07T09:00:32.030207+0000","last_fullsized":"2023-10-07T09:00:32.030207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:41.004225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.006694+0000","last_change":"2023-10-07T09:00:31.010079+0000","last_active":"2023-10-07T09:00:32.006694+0000","last_peered":"2023-10-07T09:00:32.006694+0000","last_clean":"2023-10-07T09:00:32.006694+0000","last_became_active":"2023-10-07T09:00:31.009818+0000","last_became_peered":"2023-10-07T09:00:31.009818+0000","last_unstale":"2023-10-07T09:00:32.006694+0000","last_undegraded":"2023-10-07T09:00:32.006694+0000","last_fullsized":"2023-10-07T09:00:32.006694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:58.840855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030578+0000","last_change":"2023-10-07T09:00:32.029332+0000","last_active":"2023-10-07T09:00:32.030578+0000","last_peered":"2023-10-07T09:00:32.030578+0000","last_clean":"2023-10-07T09:00:32.030578+0000","last_became_active":"2023-10-07T09:00:32.028941+0000","last_became_peered":"2023-10-07T09:00:32.028941+0000","last_unstale":"2023-10-07T09:00:32.030578+0000","last_undegraded":"2023-10-07T09:00:32.030578+0000","last_fullsized":"2023-10-07T09:00:32.030578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:56.373078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.013366+0000","last_change":"2023-10-07T09:00:31.009796+0000","last_active":"2023-10-07T09:00:32.013366+0000","last_peered":"2023-10-07T09:00:32.013366+0000","last_clean":"2023-10-07T09:00:32.013366+0000","last_became_active":"2023-10-07T09:00:31.009454+0000","last_became_peered":"2023-10-07T09:00:31.009454+0000","last_unstale":"2023-10-07T09:00:32.013366+0000","last_undegraded":"2023-10-07T09:00:32.013366+0000","last_fullsized":"2023-10-07T09:00:32.013366+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:36.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.019995+0000","last_change":"2023-10-07T09:00:32.017751+0000","last_active":"2023-10-07T09:00:32.019995+0000","last_peered":"2023-10-07T09:00:32.019995+0000","last_clean":"2023-10-07T09:00:32.019995+0000","last_became_active":"2023-10-07T09:00:32.017460+0000","last_became_peered":"2023-10-07T09:00:32.017460+0000","last_unstale":"2023-10-07T09:00:32.019995+0000","last_undegraded":"2023-10-07T09:00:32.019995+0000","last_fullsized":"2023-10-07T09:00:32.019995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:04.677499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031179+0000","last_change":"2023-10-07T09:00:31.014885+0000","last_active":"2023-10-07T09:00:32.031179+0000","last_peered":"2023-10-07T09:00:32.031179+0000","last_clean":"2023-10-07T09:00:32.031179+0000","last_became_active":"2023-10-07T09:00:31.014621+0000","last_became_peered":"2023-10-07T09:00:31.014621+0000","last_unstale":"2023-10-07T09:00:32.031179+0000","last_undegraded":"2023-10-07T09:00:32.031179+0000","last_fullsized":"2023-10-07T09:00:32.031179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:29:09.434050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.014641+0000","last_change":"2023-10-07T09:00:32.009607+0000","last_active":"2023-10-07T09:00:32.014641+0000","last_peered":"2023-10-07T09:00:32.014641+0000","last_clean":"2023-10-07T09:00:32.014641+0000","last_became_active":"2023-10-07T09:00:32.009347+0000","last_became_peered":"2023-10-07T09:00:32.009347+0000","last_unstale":"2023-10-07T09:00:32.014641+0000","last_undegraded":"2023-10-07T09:00:32.014641+0000","last_fullsized":"2023-10-07T09:00:32.014641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:51.082415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.005753+0000","last_change":"2023-10-07T09:00:31.011629+0000","last_active":"2023-10-07T09:00:32.005753+0000","last_peered":"2023-10-07T09:00:32.005753+0000","last_clean":"2023-10-07T09:00:32.005753+0000","last_became_active":"2023-10-07T09:00:31.011087+0000","last_became_peered":"2023-10-07T09:00:31.011087+0000","last_unstale":"2023-10-07T09:00:32.005753+0000","last_undegraded":"2023-10-07T09:00:32.005753+0000","last_fullsized":"2023-10-07T09:00:32.005753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:18.389369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.033263+0000","last_change":"2023-10-07T09:00:32.029847+0000","last_active":"2023-10-07T09:00:32.033263+0000","last_peered":"2023-10-07T09:00:32.033263+0000","last_clean":"2023-10-07T09:00:32.033263+0000","last_became_active":"2023-10-07T09:00:32.029388+0000","last_became_peered":"2023-10-07T09:00:32.029388+0000","last_unstale":"2023-10-07T09:00:32.033263+0000","last_undegraded":"2023-10-07T09:00:32.033263+0000","last_fullsized":"2023-10-07T09:00:32.033263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:59.664829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.004724+0000","last_change":"2023-10-07T09:00:31.006436+0000","last_active":"2023-10-07T09:00:32.004724+0000","last_peered":"2023-10-07T09:00:32.004724+0000","last_clean":"2023-10-07T09:00:32.004724+0000","last_became_active":"2023-10-07T09:00:31.006173+0000","last_became_peered":"2023-10-07T09:00:31.006173+0000","last_unstale":"2023-10-07T09:00:32.004724+0000","last_undegraded":"2023-10-07T09:00:32.004724+0000","last_fullsized":"2023-10-07T09:00:32.004724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:22.221068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.020587+0000","last_change":"2023-10-07T09:00:32.017178+0000","last_active":"2023-10-07T09:00:32.020587+0000","last_peered":"2023-10-07T09:00:32.020587+0000","last_clean":"2023-10-07T09:00:32.020587+0000","last_became_active":"2023-10-07T09:00:32.016887+0000","last_became_peered":"2023-10-07T09:00:32.016887+0000","last_unstale":"2023-10-07T09:00:32.020587+0000","last_undegraded":"2023-10-07T09:00:32.020587+0000","last_fullsized":"2023-10-07T09:00:32.020587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:21:06.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.013684+0000","last_change":"2023-10-07T09:00:31.007981+0000","last_active":"2023-10-07T09:00:32.013684+0000","last_peered":"2023-10-07T09:00:32.013684+0000","last_clean":"2023-10-07T09:00:32.013684+0000","last_became_active":"2023-10-07T09:00:31.007704+0000","last_became_peered":"2023-10-07T09:00:31.007704+0000","last_unstale":"2023-10-07T09:00:32.013684+0000","last_undegraded":"2023-10-07T09:00:32.013684+0000","last_fullsized":"2023-10-07T09:00:32.013684+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:58.840855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.021057+0000","last_change":"2023-10-07T09:00:32.015743+0000","last_active":"2023-10-07T09:00:32.021057+0000","last_peered":"2023-10-07T09:00:32.021057+0000","last_clean":"2023-10-07T09:00:32.021057+0000","last_became_active":"2023-10-07T09:00:32.015194+0000","last_became_peered":"2023-10-07T09:00:32.015194+0000","last_unstale":"2023-10-07T09:00:32.021057+0000","last_undegraded":"2023-10-07T09:00:32.021057+0000","last_fullsized":"2023-10-07T09:00:32.021057+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:40.601553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.004485+0000","last_change":"2023-10-07T09:00:31.009111+0000","last_active":"2023-10-07T09:00:32.004485+0000","last_peered":"2023-10-07T09:00:32.004485+0000","last_clean":"2023-10-07T09:00:32.004485+0000","last_became_active":"2023-10-07T09:00:31.008321+0000","last_became_peered":"2023-10-07T09:00:31.008321+0000","last_unstale":"2023-10-07T09:00:32.004485+0000","last_undegraded":"2023-10-07T09:00:32.004485+0000","last_fullsized":"2023-10-07T09:00:32.004485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:31.751341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031102+0000","last_change":"2023-10-07T09:00:32.026477+0000","last_active":"2023-10-07T09:00:32.031102+0000","last_peered":"2023-10-07T09:00:32.031102+0000","last_clean":"2023-10-07T09:00:32.031102+0000","last_became_active":"2023-10-07T09:00:32.025174+0000","last_became_peered":"2023-10-07T09:00:32.025174+0000","last_unstale":"2023-10-07T09:00:32.031102+0000","last_undegraded":"2023-10-07T09:00:32.031102+0000","last_fullsized":"2023-10-07T09:00:32.031102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:29.721529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.001274+0000","last_change":"2023-10-07T09:00:31.012689+0000","last_active":"2023-10-07T09:00:32.001274+0000","last_peered":"2023-10-07T09:00:32.001274+0000","last_clean":"2023-10-07T09:00:32.001274+0000","last_became_active":"2023-10-07T09:00:31.012342+0000","last_became_peered":"2023-10-07T09:00:31.012342+0000","last_unstale":"2023-10-07T09:00:32.001274+0000","last_undegraded":"2023-10-07T09:00:32.001274+0000","last_fullsized":"2023-10-07T09:00:32.001274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:44.265373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.017151+0000","last_change":"2023-10-07T09:00:32.013462+0000","last_active":"2023-10-07T09:00:32.017151+0000","last_peered":"2023-10-07T09:00:32.017151+0000","last_clean":"2023-10-07T09:00:32.017151+0000","last_became_active":"2023-10-07T09:00:32.013144+0000","last_became_peered":"2023-10-07T09:00:32.013144+0000","last_unstale":"2023-10-07T09:00:32.017151+0000","last_undegraded":"2023-10-07T09:00:32.017151+0000","last_fullsized":"2023-10-07T09:00:32.017151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:32.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.017255+0000","last_change":"2023-10-07T09:00:31.005500+0000","last_active":"2023-10-07T09:00:32.017255+0000","last_peered":"2023-10-07T09:00:32.017255+0000","last_clean":"2023-10-07T09:00:32.017255+0000","last_became_active":"2023-10-07T09:00:31.004754+0000","last_became_peered":"2023-10-07T09:00:31.004754+0000","last_unstale":"2023-10-07T09:00:32.017255+0000","last_undegraded":"2023-10-07T09:00:32.017255+0000","last_fullsized":"2023-10-07T09:00:32.017255+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:03:54.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.031242+0000","last_change":"2023-10-07T09:00:32.025628+0000","last_active":"2023-10-07T09:00:32.031242+0000","last_peered":"2023-10-07T09:00:32.031242+0000","last_clean":"2023-10-07T09:00:32.031242+0000","last_became_active":"2023-10-07T09:00:32.025353+0000","last_became_peered":"2023-10-07T09:00:32.025353+0000","last_unstale":"2023-10-07T09:00:32.031242+0000","last_undegraded":"2023-10-07T09:00:32.031242+0000","last_fullsized":"2023-10-07T09:00:32.031242+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:57.002998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.014205+0000","last_change":"2023-10-07T09:00:31.015048+0000","last_active":"2023-10-07T09:00:32.014205+0000","last_peered":"2023-10-07T09:00:32.014205+0000","last_clean":"2023-10-07T09:00:32.014205+0000","last_became_active":"2023-10-07T09:00:31.014747+0000","last_became_peered":"2023-10-07T09:00:31.014747+0000","last_unstale":"2023-10-07T09:00:32.014205+0000","last_undegraded":"2023-10-07T09:00:32.014205+0000","last_fullsized":"2023-10-07T09:00:32.014205+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:14.946772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030177+0000","last_change":"2023-10-07T09:00:32.029225+0000","last_active":"2023-10-07T09:00:32.030177+0000","last_peered":"2023-10-07T09:00:32.030177+0000","last_clean":"2023-10-07T09:00:32.030177+0000","last_became_active":"2023-10-07T09:00:32.028933+0000","last_became_peered":"2023-10-07T09:00:32.028933+0000","last_unstale":"2023-10-07T09:00:32.030177+0000","last_undegraded":"2023-10-07T09:00:32.030177+0000","last_fullsized":"2023-10-07T09:00:32.030177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:30.988478+0000","last_clean_scrub_stamp":"2023-10-07T09:00:30.988478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:53.831474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.030648+0000","last_change":"2023-10-07T09:00:31.014547+0000","last_active":"2023-10-07T09:00:32.030648+0000","last_peered":"2023-10-07T09:00:32.030648+0000","last_clean":"2023-10-07T09:00:32.030648+0000","last_became_active":"2023-10-07T09:00:31.014258+0000","last_became_peered":"2023-10-07T09:00:31.014258+0000","last_unstale":"2023-10-07T09:00:32.030648+0000","last_undegraded":"2023-10-07T09:00:32.030648+0000","last_fullsized":"2023-10-07T09:00:32.030648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:00:29.984331+0000","last_clean_scrub_stamp":"2023-10-07T09:00:29.984331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:14.507309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-07T09:00:32.005825+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:00:32.005825+0000","last_peered":"2023-10-07T09:00:32.005825+0000","last_clean":"2023-10-07T09:00:32.005825+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:00:32.005825+0000","last_undegraded":"2023-10-07T09:00:32.005825+0000","last_fullsized":"2023-10-07T09:00:32.005825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":921330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.443},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":330466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.505,"15min":0.505},"min":{"1min":0.32700000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":1.29,"15min":1.29},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.74299999999999999,"15min":0.77000000000000002},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80700000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.85899999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.625},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069676,"statfs":{"total":96636764160,"available":96327348224,"internally_reserved":0,"allocated":798720,"data_stored":332498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.49199999999999999,"5min":0.63,"15min":0.63},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.246,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51800000000000002,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.874,"15min":0.95399999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81799999999999995,"5min":11.32,"15min":11.32},"last":0.26200000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.90700000000000003,"15min":0.98899999999999999},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79300000000000004,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28699999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.84299999999999997,"15min":0.88},"min":{"1min":0.44700000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85799999999999998,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.83599999999999997,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.79500000000000004,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83599999999999997,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":920742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.372,"15min":0.379},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.48699999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.318}]},{"osd":2,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58999999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":0.625,"15min":0.625},"last":0.372}]},{"osd":3,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.435,"15min":0.442},"min":{"1min":0.316,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.626},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96899999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89300000000000002,"5min":1,"15min":1},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.006,"15min":1.006},"last":0.625}]},{"osd":7,"last update":"Sat Oct 7 09:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83899999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298060,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073780,"statfs":{"total":96636764160,"available":96331550720,"internally_reserved":0,"allocated":790528,"data_stored":331910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.68400000000000005,"15min":0.73999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.497,"5min":10.214,"15min":10.214},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.374},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.56899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.374}]},{"osd":1,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59299999999999997,"5min":0.755,"15min":0.755},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.74399999999999999,"15min":0.79700000000000004},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":10.144,"15min":10.144},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.81000000000000005,"15min":0.876},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59199999999999997,"5min":10.071,"15min":10.071},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.82399999999999995,"15min":0.88800000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60799999999999998,"5min":10.183,"15min":10.183},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.432,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":1.319,"15min":1.4299999999999999},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96399999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.70099999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.371,"15min":1.4810000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97199999999999998,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.98799999999999999,"5min":1.125,"15min":1.125},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.84699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":786432,"data_stored":330486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.48299999999999998,"15min":0.46400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":5.5709999999999997,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.85999999999999999,"15min":0.90400000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.4269999999999996,"5min":12.038,"15min":12.038},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.1389999999999998,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.66600000000000004,"15min":0.69999999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.859,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64700000000000002,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":1.0129999999999999,"15min":1.079},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9059999999999999,"5min":2.081,"15min":2.081},"last":0.505}]},{"osd":5,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.9379999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":1.069,"15min":1.137},"min":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":12.007,"15min":12.007},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9670000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.48599999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":1.0820000000000001,"15min":1.1559999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96799999999999997,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.68000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":330444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.433},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.39000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":3.024,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.98299999999999998,"15min":1.052},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76200000000000001,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":1.0289999999999999,"15min":1.087},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.976,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.97699999999999998,"15min":1.0429999999999999},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71199999999999997,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.014,"15min":1.0860000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.76400000000000001,"5min":10.01,"15min":10.01},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.77500000000000002,"15min":0.81499999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":5.569,"15min":5.569},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.97799999999999998,"15min":1.048},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":10.131,"15min":10.131},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65700000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.33100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63500000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.63200000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":330464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78000000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.746,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.627}]},{"osd":2,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.38300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73299999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.432,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.441}]},{"osd":4,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.502,"15min":0.502},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.41899999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:00:41.040 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:00:41.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:00:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.199+0000 7f43bf2f9700 1 Processor -- start 2023-10-07T09:00:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.199+0000 7f43bf2f9700 1 -- start start 2023-10-07T09:00:41.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bf2f9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43b8159950 0x7f43b80cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bf2f9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80ce380 con 0x7f43b8069c70 2023-10-07T09:00:41.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bf2f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80cec20 con 0x7f43b80af320 2023-10-07T09:00:41.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bf2f9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80afa90 con 0x7f43b8159950 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bd095700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43b8159950 0x7f43b80cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bd896700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f43b8069c70 0x7f43b80cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54836/0 (socket says 172.21.15.46:54836) 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bd095700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43b8159950 0x7f43b80cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60942/0 (socket says 172.21.15.46:60942) 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.200+0000 7f43bd896700 1 -- 172.21.15.46:0/3529896424 learned_addr learned my addr 172.21.15.46:0/3529896424 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bd095700 1 -- 172.21.15.46:0/3529896424 >> v1:172.21.15.133:6789/0 conn(0x7f43b80af320 legacy=0x7f43b8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bd095700 1 -- 172.21.15.46:0/3529896424 >> v1:172.21.15.46:6789/0 conn(0x7f43b8069c70 legacy=0x7f43b80cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43b7fff700 1 -- 172.21.15.46:0/3529896424 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008840310 0 0) 0x7f43b80ce380 con 0x7f43b8069c70 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bd095700 1 -- 172.21.15.46:0/3529896424 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80ce5d0 con 0x7f43b8159950 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bd095700 1 --2- 172.21.15.46:0/3529896424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8159950 0x7f43b80cbb90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009e60 tx=0x7f43a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdfc9277ca00d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43b7fff700 1 -- 172.21.15.46:0/3529896424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800e070 con 0x7f43b8159950 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43b7fff700 1 -- 172.21.15.46:0/3529896424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800bc30 con 0x7f43b8159950 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43b7fff700 1 -- 172.21.15.46:0/3529896424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8012430 con 0x7f43b8159950 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bf2f9700 1 -- 172.21.15.46:0/3529896424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8159950 msgr2=0x7f43b80cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.201+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/3529896424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8159950 0x7f43b80cbb90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009e60 tx=0x7f43a8009780 comp rx=0 tx=0).stop 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.202+0000 7f43bf2f9700 1 -- 172.21.15.46:0/3529896424 shutdown_connections 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.202+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/3529896424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8159950 0x7f43b80cbb90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.202+0000 7f43bf2f9700 1 -- 172.21.15.46:0/3529896424 >> 172.21.15.46:0/3529896424 conn(0x7f43b8068e00 msgr2=0x7f43b80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.202+0000 7f43bf2f9700 1 -- 172.21.15.46:0/3529896424 shutdown_connections 2023-10-07T09:00:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.202+0000 7f43bf2f9700 1 -- 172.21.15.46:0/3529896424 wait complete. 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.203+0000 7f43bf2f9700 1 Processor -- start 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.203+0000 7f43bf2f9700 1 -- start start 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 0x7f43b81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43b8159950 0x7f43b8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80c7d70 con 0x7f43b8069c70 2023-10-07T09:00:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80b5f70 con 0x7f43b80af320 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80b6250 con 0x7f43b8159950 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60944/0 (socket says 172.21.15.46:60944) 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 -- 172.21.15.46:0/511066088 learned_addr learned my addr 172.21.15.46:0/511066088 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 -- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43b8159950 msgr2=0x7f43b8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43b8159950 0x7f43b8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 -- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 msgr2=0x7f43b81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bc894700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 0x7f43b81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 0x7f43b81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 -- 172.21.15.46:0/511066088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009a20 con 0x7f43b8069c70 2023-10-07T09:00:41.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bc894700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 0x7f43b81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bd095700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f43a8013000 tx=0x7f43a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8027470 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a80275f0 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80c7a00 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80279b0 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.204+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b80b5480 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.205+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80c7840 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.206+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f43a8024070 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.206+0000 7f43b57fa700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 0x7f43a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.206+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43a8087070 con 0x7f43b8069c70 2023-10-07T09:00:41.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.206+0000 7f43bc894700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 0x7f43a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.207+0000 7f43bc894700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 0x7f43a4069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f43b81602d0 tx=0x7f43ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.211+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a80542f0 con 0x7f43b8069c70 2023-10-07T09:00:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.482+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f43b80718b0 con 0x7f43b8069c70 2023-10-07T09:00:41.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.485+0000 7f43b57fa700 1 -- 172.21.15.46:0/511066088 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f43a8057910 con 0x7f43b8069c70 2023-10-07T09:00:41.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 msgr2=0x7f43a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 0x7f43a4069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f43b81602d0 tx=0x7f43ac009040 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 msgr2=0x7f43b814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f43a8013000 tx=0x7f43a8019000 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 shutdown_connections 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f43a4066fc0 0x7f43a4069470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43b8159950 0x7f43b8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43b8069c70 0x7f43b814d630 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 --2- 172.21.15.46:0/511066088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b80af320 0x7f43b81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.487+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 >> 172.21.15.46:0/511066088 conn(0x7f43b8068e00 msgr2=0x7f43b815e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.488+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 shutdown_connections 2023-10-07T09:00:41.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.488+0000 7f43bf2f9700 1 -- 172.21.15.46:0/511066088 wait complete. 2023-10-07T09:00:41.490 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:00:41.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:00:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.618+0000 7f8dd61b5700 1 Processor -- start 2023-10-07T09:00:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.618+0000 7f8dd61b5700 1 -- start start 2023-10-07T09:00:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dd61b5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dd0069d60 0x7f8dd00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dd61b5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd006bdb0 con 0x7f8dd00c81f0 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dd61b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00cb370 con 0x7f8dd00aca80 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dd61b5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd0159f60 con 0x7f8dd0069d60 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dceffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dd0069d60 0x7f8dd00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dcffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8dd00c81f0 0x7f8dd00cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54850/0 (socket says 172.21.15.46:54850) 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.619+0000 7f8dcffff700 1 -- 172.21.15.46:0/576767969 learned_addr learned my addr 172.21.15.46:0/576767969 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dceffd700 1 -- 172.21.15.46:0/576767969 >> v1:172.21.15.133:6789/0 conn(0x7f8dd00aca80 legacy=0x7f8dd006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dceffd700 1 -- 172.21.15.46:0/576767969 >> v1:172.21.15.46:6789/0 conn(0x7f8dd00c81f0 legacy=0x7f8dd00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dceffd700 1 -- 172.21.15.46:0/576767969 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd006b2b0 con 0x7f8dd0069d60 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dce7fc700 1 -- 172.21.15.46:0/576767969 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450074195 0 0) 0x7f8dd006bdb0 con 0x7f8dd00c81f0 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dceffd700 1 --2- 172.21.15.46:0/576767969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd0069d60 0x7f8dd00c7cb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40098e0 tx=0x7f8dc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1048d4fffa4927c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dce7fc700 1 -- 172.21.15.46:0/576767969 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4009e80 con 0x7f8dd0069d60 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dce7fc700 1 -- 172.21.15.46:0/576767969 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc400b820 con 0x7f8dd0069d60 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.620+0000 7f8dce7fc700 1 -- 172.21.15.46:0/576767969 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400bba0 con 0x7f8dd0069d60 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 -- 172.21.15.46:0/576767969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd0069d60 msgr2=0x7f8dd00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/576767969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd0069d60 0x7f8dd00c7cb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40098e0 tx=0x7f8dc40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 -- 172.21.15.46:0/576767969 shutdown_connections 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/576767969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd0069d60 0x7f8dd00c7cb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 -- 172.21.15.46:0/576767969 >> 172.21.15.46:0/576767969 conn(0x7f8dd00cd670 msgr2=0x7f8dd00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:41.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 -- 172.21.15.46:0/576767969 shutdown_connections 2023-10-07T09:00:41.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.621+0000 7f8dd61b5700 1 -- 172.21.15.46:0/576767969 wait complete. 2023-10-07T09:00:41.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.622+0000 7f8dd61b5700 1 Processor -- start 2023-10-07T09:00:41.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.622+0000 7f8dd61b5700 1 -- start start 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 0x7f8dd00af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dd00aca80 0x7f8dd016ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00b1630 con 0x7f8dd00c81f0 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd016d820 con 0x7f8dd00aca80 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd016db00 con 0x7f8dd0069d60 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60964/0 (socket says 172.21.15.46:60964) 2023-10-07T09:00:41.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 -- 172.21.15.46:0/1008341129 learned_addr learned my addr 172.21.15.46:0/1008341129 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dceffd700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dd00aca80 0x7f8dd016ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcf7fe700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 0x7f8dd00af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 -- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 msgr2=0x7f8dd00af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 0x7f8dd00af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 -- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dd00aca80 msgr2=0x7f8dd016ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dd00aca80 0x7f8dd016ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 -- 172.21.15.46:0/1008341129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4009420 con 0x7f8dd00c81f0 2023-10-07T09:00:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcf7fe700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 0x7f8dd00af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dcffff700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800ccc0 tx=0x7f8dc8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800a950 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800aab0 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00b1880 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800ae70 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.623+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd0157b30 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.624+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd004c3c0 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.625+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8dc8007300 con 0x7f8dd00c81f0 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.625+0000 7f8db77fe700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 0x7f8dbc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.625+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8dc8084930 con 0x7f8dd00c81f0 2023-10-07T09:00:41.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.625+0000 7f8dcf7fe700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 0x7f8dbc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:41.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.626+0000 7f8dcf7fe700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 0x7f8dbc069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0002930 tx=0x7f8dc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:41.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.629+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dc8051c30 con 0x7f8dd00c81f0 2023-10-07T09:00:41.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:00:41.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:00:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.869+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dd016dc40 con 0x7f8dd00c81f0 2023-10-07T09:00:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.869+0000 7f8db77fe700 1 -- 172.21.15.46:0/1008341129 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8dc8055250 con 0x7f8dd00c81f0 2023-10-07T09:00:41.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:00:41.871 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 msgr2=0x7f8dbc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 0x7f8dbc069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0002930 tx=0x7f8dc0009040 comp rx=0 tx=0).stop 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 msgr2=0x7f8dd01575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800ccc0 tx=0x7f8dc8001a80 comp rx=0 tx=0).stop 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 shutdown_connections 2023-10-07T09:00:41.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8dbc066fc0 0x7f8dbc069470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd00c81f0 0x7f8dd01575f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dd0069d60 0x7f8dd00af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 --2- 172.21.15.46:0/1008341129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dd00aca80 0x7f8dd016ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 >> 172.21.15.46:0/1008341129 conn(0x7f8dd00cd670 msgr2=0x7f8dd00c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.871+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 shutdown_connections 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:41.872+0000 7f8dd61b5700 1 -- 172.21.15.46:0/1008341129 wait complete. 2023-10-07T09:00:41.874 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 39 2023-10-07T09:00:42.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:00:31.406136+0000', 'modified': '2023-10-07T09:00:35.020440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5721}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5721': {'gid': 5721, 'name': 'b', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6836/635739532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 635739532}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 635739532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:00:42.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:00:42.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T09:00:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.412+0000 7f683e1a9700 1 Processor -- start 2023-10-07T09:00:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.412+0000 7f683e1a9700 1 -- start start 2023-10-07T09:00:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6838142ea0 0x7f68380b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68380ad870 0x7f683806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f68380b3b70 0x7f683806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68380b40f0 con 0x7f6838142ea0 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6838069640 con 0x7f68380b3b70 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683e1a9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6838069920 con 0x7f68380ad870 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6838142ea0 0x7f68380b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6838142ea0 0x7f68380b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60978/0 (socket says 172.21.15.46:60978) 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 -- 172.21.15.46:0/4072898497 learned_addr learned my addr 172.21.15.46:0/4072898497 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683c9a6700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68380ad870 0x7f683806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d9a8700 1 --2- 172.21.15.46:0/4072898497 >> v2:172.21.15.133:3300/0 conn(0x7f68380b3b70 0x7f683806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 -- 172.21.15.46:0/4072898497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68380ad870 msgr2=0x7f683806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68380ad870 0x7f683806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 -- 172.21.15.46:0/4072898497 >> v2:172.21.15.133:3300/0 conn(0x7f68380b3b70 msgr2=0x7f683806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 --2- 172.21.15.46:0/4072898497 >> v2:172.21.15.133:3300/0 conn(0x7f68380b3b70 0x7f683806bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.413+0000 7f683d1a7700 1 -- 172.21.15.46:0/4072898497 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838069c00 con 0x7f6838142ea0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683d1a7700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6838142ea0 0x7f68380b3630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f683806f360 tx=0x7f6828009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629733bd5f305901 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f6837fff700 1 -- 172.21.15.46:0/4072898497 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e070 con 0x7f6838142ea0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f6837fff700 1 -- 172.21.15.46:0/4072898497 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800ba50 con 0x7f6838142ea0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f6837fff700 1 -- 172.21.15.46:0/4072898497 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68280092e0 con 0x7f6838142ea0 2023-10-07T09:00:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 -- 172.21.15.46:0/4072898497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6838142ea0 msgr2=0x7f68380b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6838142ea0 0x7f68380b3630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f683806f360 tx=0x7f6828009840 comp rx=0 tx=0).stop 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 -- 172.21.15.46:0/4072898497 shutdown_connections 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 --2- 172.21.15.46:0/4072898497 >> v2:172.21.15.133:3300/0 conn(0x7f68380b3b70 0x7f683806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6838142ea0 0x7f68380b3630 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 --2- 172.21.15.46:0/4072898497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68380ad870 0x7f683806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 -- 172.21.15.46:0/4072898497 >> 172.21.15.46:0/4072898497 conn(0x7f68380ce430 msgr2=0x7f68380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 -- 172.21.15.46:0/4072898497 shutdown_connections 2023-10-07T09:00:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.414+0000 7f683e1a9700 1 -- 172.21.15.46:0/4072898497 wait complete. 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.415+0000 7f683e1a9700 1 Processor -- start 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.415+0000 7f683e1a9700 1 -- start start 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68380b3b70 0x7f68381590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6838142ea0 0x7f683806a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6838159610 con 0x7f683806a560 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683806a9d0 con 0x7f68380b3b70 2023-10-07T09:00:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683e1a9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68380c8d70 con 0x7f6838142ea0 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683d9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683d9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60986/0 (socket says 172.21.15.46:60986) 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.416+0000 7f683d9a8700 1 -- 172.21.15.46:0/3826156656 learned_addr learned my addr 172.21.15.46:0/3826156656 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d1a7700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68380b3b70 0x7f68381590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683c9a6700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6838142ea0 0x7f683806a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 -- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6838142ea0 msgr2=0x7f683806a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6838142ea0 0x7f683806a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 -- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68380b3b70 msgr2=0x7f68381590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68380b3b70 0x7f68381590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 -- 172.21.15.46:0/3826156656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009ae0 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683d9a8700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f683000d890 tx=0x7f6830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f68357fa700 1 -- 172.21.15.46:0/3826156656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300125f0 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f68357fa700 1 -- 172.21.15.46:0/3826156656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830012770 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683813d060 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f68357fa700 1 -- 172.21.15.46:0/3826156656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830012b30 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.417+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68380c8720 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.419+0000 7f68357fa700 1 -- 172.21.15.46:0/3826156656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f683001e460 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.419+0000 7f68357fa700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 0x7f6824069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.419+0000 7f68357fa700 1 -- 172.21.15.46:0/3826156656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6830084aa0 con 0x7f683806a560 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.419+0000 7f683d1a7700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 0x7f6824069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.420+0000 7f683d1a7700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 0x7f6824069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6828009880 tx=0x7f6828018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 Processor -- start 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 -- start start 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f757d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f96850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7ea2a70 con 0x5582e7f4bb80 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7ea0270 con 0x5582e7f495f0 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582e7e9c060 con 0x5582e7f96480 2023-10-07T09:00:42.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.421+0000 7f683d9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32768/0 (socket says 172.21.15.46:32768) 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 -- 172.21.15.46:0/157181520 learned_addr learned my addr 172.21.15.46:0/157181520 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683c9a6700 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f96850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d1a7700 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 -- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 msgr2=0x5582e7f757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 -- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 msgr2=0x5582e7f96850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f96850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 -- 172.21.15.46:0/157181520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e7d36270 con 0x5582e7f4bb80 2023-10-07T09:00:42.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f683d9a8700 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6830083010 tx=0x7f6830012fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38c0edf121b2ed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f681e7fc700 1 -- 172.21.15.46:0/157181520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300559e0 con 0x5582e7f4bb80 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f681e7fc700 1 -- 172.21.15.46:0/157181520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830058c30 con 0x5582e7f4bb80 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.422+0000 7f681e7fc700 1 -- 172.21.15.46:0/157181520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683005c980 con 0x5582e7f4bb80 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- 172.21.15.46:0/157181520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 msgr2=0x5582e7f4bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6830083010 tx=0x7f6830012fa0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- 172.21.15.46:0/157181520 shutdown_connections 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f4bff0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 --2- 172.21.15.46:0/157181520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f96850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- 172.21.15.46:0/157181520 >> 172.21.15.46:0/157181520 conn(0x5582e7f4d0c0 msgr2=0x5582e7f4d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- 172.21.15.46:0/157181520 shutdown_connections 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- 172.21.15.46:0/157181520 wait complete. 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.423+0000 7f6848703b80 1 -- start start 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 Processor -- start 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7e47890 con 0x5582e7f4bb80 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7e62ea0 con 0x5582e7f495f0 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582e7d1ee30 con 0x5582e7f96480 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f6848703b80 10 client.0 _ll_register_callbacks cb 0x5582e7f0f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:00:42.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.424+0000 7f683c9a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32776/0 (socket says 172.21.15.46:32776) 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 -- 172.21.15.46:0/659491665 learned_addr learned my addr 172.21.15.46:0/659491665 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 -- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 msgr2=0x5582e7f937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683d1a7700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f92350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 -- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 msgr2=0x5582e7f92350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f92350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 -- 172.21.15.46:0/659491665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68380c8720 con 0x5582e7f4bb80 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f683c9a6700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f682c013810 tx=0x7f682c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2873b7f6e8c87bc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c011780 con 0x5582e7f4bb80 2023-10-07T09:00:42.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f682c0118e0 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582e7f40cd0 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f682c011cb0 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f6848703b80 10 client.5883 fetch_fsmap learned FSMap version 39 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5582e7cd8fe0 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582e7f40cd0 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f682c01e460 con 0x5582e7f4bb80 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.425+0000 7f6848703b80 10 client.5883 fetch_fsmap finished waiting for FSMap version 39 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f6848703b80 10 client.5883 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f6848703b80 20 client.5883 populate_metadata read hostname 'smithi046' 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7f958e0 0x5582e7f95cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f6848703b80 4 client.5883 mds_command: new command op to 5721 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:00:42.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 --> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582e7f1daa0 con 0x5582e7f958e0 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f683d1a7700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7f958e0 0x5582e7f95cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f683d1a7700 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7f958e0 0x5582e7f95cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8644db838c3e13c8 server_cookie=4a70e65eca8645c5 in_seq=0 out_seq=0 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.426+0000 7f68177fe700 10 client.5883 ms_handle_connect on v2:172.21.15.133:6834/635739532 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f68177fe700 1 -- 172.21.15.46:0/659491665 <== mds.0 v2:172.21.15.133:6834/635739532 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5582e7f1daa0 con 0x5582e7f958e0 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f68177fe700 10 client.5883 handle_command_reply: tid=0 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 client.5883 shutdown 2023-10-07T09:00:42.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 msgr2=0x5582e7f932a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f682c013810 tx=0x7f682c008040 comp rx=0 tx=0).stop 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 shutdown_connections 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7f958e0 0x5582e7f95cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f495f0 0x5582e7f92350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f68177fe700 0 client.5883 ms_handle_reset on v2:172.21.15.133:6834/635739532 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 --2- 172.21.15.46:0/659491665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f4bb80 0x5582e7f932a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 >> 172.21.15.46:0/659491665 conn(0x5582e7f4d0c0 msgr2=0x5582e7f4ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 shutdown_connections 2023-10-07T09:00:42.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 1 -- 172.21.15.46:0/659491665 wait complete. 2023-10-07T09:00:42.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.427+0000 7f6848703b80 20 client.5883 trim_cache size 0 max 16384 2023-10-07T09:00:42.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.444+0000 7f6848703b80 1 Processor -- start 2023-10-07T09:00:42.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.444+0000 7f6848703b80 1 -- start start 2023-10-07T09:00:42.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f4bb80 0x5582e7f7a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f4df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7f4acc0 con 0x5582e7f495f0 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7f449e0 con 0x5582e7f4bb80 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582e7f4b5d0 con 0x5582e7f96480 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f683d1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f683d1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32788/0 (socket says 172.21.15.46:32788) 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f683d1a7700 1 -- 172.21.15.46:0/2991159748 learned_addr learned my addr 172.21.15.46:0/2991159748 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f683c9a6700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f4bb80 0x5582e7f7a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.445+0000 7f683d9a8700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f4df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 -- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 msgr2=0x5582e7f4df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f4df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 -- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f4bb80 msgr2=0x5582e7f7a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f4bb80 0x5582e7f7a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 -- 172.21.15.46:0/2991159748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e7e6a780 con 0x5582e7f495f0 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d9a8700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f4df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f683806f0d0 tx=0x7f6828016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4cb834ae71749d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f681effd700 1 -- 172.21.15.46:0/2991159748 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682802d040 con 0x5582e7f495f0 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f681effd700 1 -- 172.21.15.46:0/2991159748 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68280078b0 con 0x5582e7f495f0 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f681effd700 1 -- 172.21.15.46:0/2991159748 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828007c50 con 0x5582e7f495f0 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 -- 172.21.15.46:0/2991159748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 msgr2=0x5582e7f93940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f683806f0d0 tx=0x7f6828016000 comp rx=0 tx=0).stop 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 -- 172.21.15.46:0/2991159748 shutdown_connections 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f96480 0x5582e7f4df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7f93940 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 --2- 172.21.15.46:0/2991159748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f4bb80 0x5582e7f7a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 -- 172.21.15.46:0/2991159748 >> 172.21.15.46:0/2991159748 conn(0x5582e7f4d0c0 msgr2=0x5582e7fa4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 -- 172.21.15.46:0/2991159748 shutdown_connections 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.446+0000 7f6848703b80 1 -- 172.21.15.46:0/2991159748 wait complete. 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.447+0000 7f6848703b80 1 -- start start 2023-10-07T09:00:42.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.447+0000 7f6848703b80 1 Processor -- start 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f4bb80 0x5582e7fa40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f96480 0x5582e7f6ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7f75290 con 0x5582e7f495f0 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e7fb2400 con 0x5582e7f96480 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582e7fb43c0 con 0x5582e7f4bb80 2023-10-07T09:00:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f6848703b80 10 client.0 _ll_register_callbacks cb 0x5582e7f0f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32794/0 (socket says 172.21.15.46:32794) 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 -- 172.21.15.46:0/2318233976 learned_addr learned my addr 172.21.15.46:0/2318233976 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683c9a6700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f4bb80 0x5582e7fa40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d9a8700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f96480 0x5582e7f6ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 -- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f4bb80 msgr2=0x5582e7fa40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f4bb80 0x5582e7fa40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 -- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f96480 msgr2=0x5582e7f6ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f96480 0x5582e7f6ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.448+0000 7f683d1a7700 1 -- 172.21.15.46:0/2318233976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6838069c00 con 0x5582e7f495f0 2023-10-07T09:00:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f683d1a7700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f682800b890 tx=0x7f682802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ea1c5364551cd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682802d040 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6828007e00 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6830058c30 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6828026860 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 10 client.5889 fetch_fsmap learned FSMap version 39 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5582e7e51470 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830058c30 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f68280269c0 con 0x5582e7f495f0 2023-10-07T09:00:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 10 client.5889 fetch_fsmap finished waiting for FSMap version 39 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 10 client.5889 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 20 client.5889 populate_metadata read hostname 'smithi046' 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7ff79e0 0x5582e7f6f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 4 client.5889 mds_command: new command op to 5721 tid=0[{"prefix": "status"}] 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 --> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582e7e3ee00 con 0x5582e7ff79e0 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.449+0000 7f683c9a6700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7ff79e0 0x5582e7f6f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f68177fe700 10 client.5889 ms_handle_connect on v2:172.21.15.133:6834/635739532 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f683c9a6700 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7ff79e0 0x5582e7f6f460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c2401344f2e759 server_cookie=4bb71c82168617d7 in_seq=0 out_seq=0 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f68177fe700 1 -- 172.21.15.46:0/2318233976 <== mds.0 v2:172.21.15.133:6834/635739532 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5582e7e3ee00 con 0x5582e7ff79e0 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f68177fe700 10 client.5889 handle_command_reply: tid=0 2023-10-07T09:00:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 client.5889 shutdown 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 msgr2=0x5582e7fb1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f682800b890 tx=0x7f682802a000 comp rx=0 tx=0).stop 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 shutdown_connections 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582e7f96480 0x5582e7f6ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5582e7f495f0 0x5582e7fb1910 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:6834/635739532,v1:172.21.15.133:6836/635739532] conn(0x5582e7ff79e0 0x5582e7f6f460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 --2- 172.21.15.46:0/2318233976 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582e7f4bb80 0x5582e7fa40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f68177fe700 0 client.5889 ms_handle_reset on v2:172.21.15.133:6834/635739532 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 >> 172.21.15.46:0/2318233976 conn(0x5582e7f4d0c0 msgr2=0x5582e7f4df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 shutdown_connections 2023-10-07T09:00:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 1 -- 172.21.15.46:0/2318233976 wait complete. 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.450+0000 7f6848703b80 20 client.5889 trim_cache size 0 max 16384 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5721, 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:00:42.460 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 10.44102949, 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 39, 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 64, 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 64, 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 15.507599093 2023-10-07T09:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 msgr2=0x7f6824069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 0x7f6824069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6828009880 tx=0x7f6828018000 comp rx=0 tx=0).stop 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 msgr2=0x7f68380aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f683000d890 tx=0x7f6830008040 comp rx=0 tx=0).stop 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 shutdown_connections 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6824066fc0 0x7f6824069470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f683806a560 0x7f68380aeec0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68380b3b70 0x7f68381590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 --2- 172.21.15.46:0/3826156656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6838142ea0 0x7f683806a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 >> 172.21.15.46:0/3826156656 conn(0x7f68380ce430 msgr2=0x7f68380cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 shutdown_connections 2023-10-07T09:00:42.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.451+0000 7f683e1a9700 1 -- 172.21.15.46:0/3826156656 wait complete. 2023-10-07T09:00:42.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:00:42.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.582+0000 7f1c2ab06700 1 Processor -- start 2023-10-07T09:00:42.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.582+0000 7f1c2ab06700 1 -- start start 2023-10-07T09:00:42.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2ab06700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c2415d230 0x7f1c2415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2ab06700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240b2980 con 0x7f1c24159420 2023-10-07T09:00:42.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2ab06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2415db70 con 0x7f1c241597f0 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2ab06700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240b11d0 con 0x7f1c2415d230 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c29b04700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c24159420 0x7f1c240b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54858/0 (socket says 172.21.15.46:54858) 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c29b04700 1 -- 172.21.15.46:0/2978396787 learned_addr learned my addr 172.21.15.46:0/2978396787 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2a305700 1 --2- 172.21.15.46:0/2978396787 >> v2:172.21.15.46:3300/0 conn(0x7f1c2415d230 0x7f1c2415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c28b02700 1 -- 172.21.15.46:0/2978396787 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734147236 0 0) 0x7f1c240b2980 con 0x7f1c24159420 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c28b02700 1 -- 172.21.15.46:0/2978396787 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c003570 con 0x7f1c24159420 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2a305700 1 -- 172.21.15.46:0/2978396787 >> v1:172.21.15.133:6789/0 conn(0x7f1c241597f0 legacy=0x7f1c240b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2a305700 1 -- 172.21.15.46:0/2978396787 >> v1:172.21.15.46:6789/0 conn(0x7f1c24159420 legacy=0x7f1c240b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.583+0000 7f1c2a305700 1 -- 172.21.15.46:0/2978396787 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240b14b0 con 0x7f1c2415d230 2023-10-07T09:00:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2a305700 1 --2- 172.21.15.46:0/2978396787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c2415d230 0x7f1c2415d630 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0098e0 tx=0x7f1c1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3dca8b26845db6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c28b02700 1 -- 172.21.15.46:0/2978396787 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00b640 con 0x7f1c2415d230 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c28b02700 1 -- 172.21.15.46:0/2978396787 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00b7a0 con 0x7f1c2415d230 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c28b02700 1 -- 172.21.15.46:0/2978396787 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00bb20 con 0x7f1c2415d230 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2978396787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c2415d230 msgr2=0x7f1c2415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2978396787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c2415d230 0x7f1c2415d630 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0098e0 tx=0x7f1c1c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2978396787 shutdown_connections 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2978396787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c2415d230 0x7f1c2415d630 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2978396787 >> 172.21.15.46:0/2978396787 conn(0x7f1c240d0660 msgr2=0x7f1c240d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2978396787 shutdown_connections 2023-10-07T09:00:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.584+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2978396787 wait complete. 2023-10-07T09:00:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.585+0000 7f1c2ab06700 1 Processor -- start 2023-10-07T09:00:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.585+0000 7f1c2ab06700 1 -- start start 2023-10-07T09:00:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c24159420 0x7f1c240c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 0x7f1c2416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b4bb0 con 0x7f1c241597f0 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b4e90 con 0x7f1c24159420 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2ab06700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b5170 con 0x7f1c2415d230 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c29303700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c29303700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32808/0 (socket says 172.21.15.46:32808) 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c29303700 1 -- 172.21.15.46:0/2812631339 learned_addr learned my addr 172.21.15.46:0/2812631339 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c29b04700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c24159420 0x7f1c240c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.586+0000 7f1c2a305700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 0x7f1c2416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 -- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 msgr2=0x7f1c2416a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 0x7f1c2416a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 -- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c24159420 msgr2=0x7f1c240c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c24159420 0x7f1c240c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 -- 172.21.15.46:0/2812631339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009420 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c2a305700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 0x7f1c2416a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c29303700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c590 tx=0x7f1c18007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18011590 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18011710 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18011ad0 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240b5450 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.587+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240b4810 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.588+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2404c3c0 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.588+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1c1801b3b0 con 0x7f1c241597f0 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.589+0000 7f1c21ffb700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 0x7f1c10069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.589+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c18083a80 con 0x7f1c241597f0 2023-10-07T09:00:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.589+0000 7f1c29b04700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 0x7f1c10069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.590+0000 7f1c29b04700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 0x7f1c10069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c14005c50 tx=0x7f1c14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.593+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c18050d00 con 0x7f1c241597f0 2023-10-07T09:00:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.831+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c240b1790 con 0x7f1c241597f0 2023-10-07T09:00:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.832+0000 7f1c21ffb700 1 -- 172.21.15.46:0/2812631339 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c18017070 con 0x7f1c241597f0 2023-10-07T09:00:42.833 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 msgr2=0x7f1c10069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 0x7f1c10069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c14005c50 tx=0x7f1c14009040 comp rx=0 tx=0).stop 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 msgr2=0x7f1c24169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c590 tx=0x7f1c18007f10 comp rx=0 tx=0).stop 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 shutdown_connections 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c10066fc0 0x7f1c10069470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2415d230 0x7f1c2416a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c24159420 0x7f1c240c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 --2- 172.21.15.46:0/2812631339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c241597f0 0x7f1c24169db0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:42.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 >> 172.21.15.46:0/2812631339 conn(0x7f1c240d0660 msgr2=0x7f1c240d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:42.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 shutdown_connections 2023-10-07T09:00:42.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:42.834+0000 7f1c2ab06700 1 -- 172.21.15.46:0/2812631339 wait complete. 2023-10-07T09:00:42.846 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:00:42.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:00:42.847 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:42.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:42.847 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:00:42.863 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:42.864 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:00:42.865 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:00:42.866 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:42.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:42.866 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:00:42.927 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:00:42.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:42.929 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:00:42.985 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:00:42.985 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:00:42.985 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:00:42.985 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:00:42.985 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:00:42.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:00:42.986 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:00:43.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.088 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:00:43.103 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:00:43.103 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:00:43.103 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:43.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:00:43.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:43.169 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:43.224 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:00:43.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:43.225 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:43.279 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:00:43.279 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:00:43.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:43.361 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:43.361 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:43.380 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:43.402 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:43.403 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:43.403 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:43.403 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:00:43.403 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:00:43.403 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:00:43.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:00:43.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:00:43.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:00:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.629+0000 7f19ca1b6700 1 Processor -- start 2023-10-07T09:00:43.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.629+0000 7f19ca1b6700 1 -- start start 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.629+0000 7f19ca1b6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19c4159890 0x7f19c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19ca1b6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c415a160 con 0x7f19c4159c60 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19ca1b6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40d13a0 con 0x7f19c4069560 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19ca1b6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c415e140 con 0x7f19c4159890 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19c4159890 0x7f19c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c2ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f19c4159c60 0x7f19c415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54860/0 (socket says 172.21.15.46:54860) 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19c4159890 0x7f19c415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32820/0 (socket says 172.21.15.46:32820) 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c2ffd700 1 -- 172.21.15.46:0/2781615125 learned_addr learned my addr 172.21.15.46:0/2781615125 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 -- 172.21.15.46:0/2781615125 >> v1:172.21.15.133:6789/0 conn(0x7f19c4069560 legacy=0x7f19c40ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 -- 172.21.15.46:0/2781615125 >> v1:172.21.15.46:6789/0 conn(0x7f19c4159c60 legacy=0x7f19c415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 -- 172.21.15.46:0/2781615125 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c415a3d0 con 0x7f19c4159890 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c27fc700 1 -- 172.21.15.46:0/2781615125 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375000133 0 0) 0x7f19c415a160 con 0x7f19c4159c60 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c37fe700 1 --2- 172.21.15.46:0/2781615125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159890 0x7f19c415abd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009e60 tx=0x7f19b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7633ee763e0b533f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c27fc700 1 -- 172.21.15.46:0/2781615125 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400e070 con 0x7f19c4159890 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c27fc700 1 -- 172.21.15.46:0/2781615125 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400bbf0 con 0x7f19c4159890 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.630+0000 7f19c27fc700 1 -- 172.21.15.46:0/2781615125 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4012430 con 0x7f19c4159890 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 -- 172.21.15.46:0/2781615125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159890 msgr2=0x7f19c415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/2781615125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159890 0x7f19c415abd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009e60 tx=0x7f19b4009780 comp rx=0 tx=0).stop 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 -- 172.21.15.46:0/2781615125 shutdown_connections 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/2781615125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159890 0x7f19c415abd0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 -- 172.21.15.46:0/2781615125 >> 172.21.15.46:0/2781615125 conn(0x7f19c4068e20 msgr2=0x7f19c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 -- 172.21.15.46:0/2781615125 shutdown_connections 2023-10-07T09:00:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.631+0000 7f19ca1b6700 1 -- 172.21.15.46:0/2781615125 wait complete. 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.632+0000 7f19ca1b6700 1 Processor -- start 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.632+0000 7f19ca1b6700 1 -- start start 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19c4069560 0x7f19c414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19c4159890 0x7f19c415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40b4850 con 0x7f19c4159c60 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40b4ac0 con 0x7f19c4069560 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19ca1b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40b4da0 con 0x7f19c4159890 2023-10-07T09:00:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32832/0 (socket says 172.21.15.46:32832) 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 -- 172.21.15.46:0/460787065 learned_addr learned my addr 172.21.15.46:0/460787065 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c2ffd700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19c4159890 0x7f19c415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c37fe700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19c4069560 0x7f19c414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 -- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19c4159890 msgr2=0x7f19c415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19c4159890 0x7f19c415d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 -- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19c4069560 msgr2=0x7f19c414d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19c4069560 0x7f19c414d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.633+0000 7f19c3fff700 1 -- 172.21.15.46:0/460787065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009a20 con 0x7f19c4159c60 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19c3fff700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00b4e0 tx=0x7f19bc006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00f5e0 con 0x7f19c4159c60 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00f740 con 0x7f19c4159c60 2023-10-07T09:00:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c40b5080 con 0x7f19c4159c60 2023-10-07T09:00:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00fb00 con 0x7f19c4159c60 2023-10-07T09:00:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.634+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c414d930 con 0x7f19c4159c60 2023-10-07T09:00:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.635+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c40b55a0 con 0x7f19c4159c60 2023-10-07T09:00:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.635+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f19bc01a400 con 0x7f19c4159c60 2023-10-07T09:00:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.636+0000 7f19ab7fe700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 0x7f19b0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.636+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19bc0840c0 con 0x7f19c4159c60 2023-10-07T09:00:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.636+0000 7f19c37fe700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 0x7f19b0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.636+0000 7f19c37fe700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 0x7f19b0069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f19b40099f0 tx=0x7f19b4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.640+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c40b55a0 con 0x7f19c4159c60 2023-10-07T09:00:43.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.881+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19c40b55a0 con 0x7f19c4159c60 2023-10-07T09:00:43.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.882+0000 7f19ab7fe700 1 -- 172.21.15.46:0/460787065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19c40b55a0 con 0x7f19c4159c60 2023-10-07T09:00:43.883 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 msgr2=0x7f19b0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 0x7f19b0069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f19b40099f0 tx=0x7f19b4018000 comp rx=0 tx=0).stop 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 msgr2=0x7f19c40ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00b4e0 tx=0x7f19bc006f90 comp rx=0 tx=0).stop 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 shutdown_connections 2023-10-07T09:00:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f19b0066fc0 0x7f19b0069470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19c4159c60 0x7f19c40ce0d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19c4069560 0x7f19c414d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 --2- 172.21.15.46:0/460787065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19c4159890 0x7f19c415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 >> 172.21.15.46:0/460787065 conn(0x7f19c4068e20 msgr2=0x7f19c40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 shutdown_connections 2023-10-07T09:00:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:43.884+0000 7f19ca1b6700 1 -- 172.21.15.46:0/460787065 wait complete. 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:00:43.897 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:43.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.898 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:00:43.918 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:00:43.918 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:00:43.918 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:00:43.918 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:00:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42362sec preferred_lft 42362sec 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.920 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:00:43.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.922 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:00:43.985 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:00:43.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:43.987 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:00:44.046 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:00:44.047 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:00:44.047 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:00:44.047 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:00:44.047 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:00:44.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:00:44.048 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:00:44.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:44.153 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:00:44.168 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:00:44.168 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:00:44.168 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:44.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:44.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:00:44.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:44.234 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:44.289 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:00:44.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:00:44.290 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:44.345 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:00:44.345 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:00:44.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:44.425 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:44.425 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:44.445 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:44.466 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:00:44.467 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:00:44.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:00:44.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:00:44.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:00:44.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:00:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.665+0000 7f0871b15700 1 Processor -- start 2023-10-07T09:00:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 -- start start 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f086c159ec0 0x7f086c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 0x7f086c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0b5b00 con 0x7f086c0cce40 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0b5850 con 0x7f086c159ec0 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.666+0000 7f0871b15700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0b5da0 con 0x7f086c0b53d0 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 0x7f086c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f086c159ec0 0x7f086c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f086c0cce40 0x7f086c0cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:41246/0 (socket says 172.21.15.46:41246) 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086bfff700 1 -- 172.21.15.46:0/1685023641 learned_addr learned my addr 172.21.15.46:0/1685023641 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 -- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 msgr2=0x7f086c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 0x7f086c0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 -- 172.21.15.46:0/1685023641 >> v1:172.21.15.133:6789/0 conn(0x7f086c0cce40 legacy=0x7f086c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 -- 172.21.15.46:0/1685023641 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0b6080 con 0x7f086c159ec0 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086a7fc700 1 -- 172.21.15.46:0/1685023641 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563653767 0 0) 0x7f086c0b5b00 con 0x7f086c0cce40 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086affd700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 0x7f086c0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086b7fe700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c159ec0 0x7f086c0b4e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f085c0098d0 tx=0x7f085c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5a9a81034309da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086a7fc700 1 -- 172.21.15.46:0/1685023641 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c005c10 con 0x7f086c159ec0 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086a7fc700 1 -- 172.21.15.46:0/1685023641 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c005d70 con 0x7f086c159ec0 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.667+0000 7f086a7fc700 1 -- 172.21.15.46:0/1685023641 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c006280 con 0x7f086c159ec0 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 -- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c159ec0 msgr2=0x7f086c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c159ec0 0x7f086c0b4e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f085c0098d0 tx=0x7f085c009120 comp rx=0 tx=0).stop 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 -- 172.21.15.46:0/1685023641 shutdown_connections 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c159ec0 0x7f086c0b4e90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 --2- 172.21.15.46:0/1685023641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0b53d0 0x7f086c0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 -- 172.21.15.46:0/1685023641 >> 172.21.15.46:0/1685023641 conn(0x7f086c0999f0 msgr2=0x7f086c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 -- 172.21.15.46:0/1685023641 shutdown_connections 2023-10-07T09:00:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.668+0000 7f0871b15700 1 -- 172.21.15.46:0/1685023641 wait complete. 2023-10-07T09:00:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.669+0000 7f0871b15700 1 Processor -- start 2023-10-07T09:00:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.669+0000 7f0871b15700 1 -- start start 2023-10-07T09:00:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c0b53d0 0x7f086c09a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0cce40 0x7f086c09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c068da0 con 0x7f086c159ec0 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c06b1a0 con 0x7f086c0b53d0 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f0871b15700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c068ff0 con 0x7f086c0cce40 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32844/0 (socket says 172.21.15.46:32844) 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086bfff700 1 -- 172.21.15.46:0/1353818947 learned_addr learned my addr 172.21.15.46:0/1353818947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086b7fe700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c0b53d0 0x7f086c09a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086affd700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0cce40 0x7f086c09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.670+0000 7f086bfff700 1 -- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0cce40 msgr2=0x7f086c09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f086bfff700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0cce40 0x7f086c09ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f086bfff700 1 -- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c0b53d0 msgr2=0x7f086c09a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f086bfff700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c0b53d0 0x7f086c09a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f086bfff700 1 -- 172.21.15.46:0/1353818947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009420 con 0x7f086c159ec0 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f086bfff700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f086400cc90 tx=0x7f0864001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400a8b0 con 0x7f086c159ec0 2023-10-07T09:00:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400aa10 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c0093c0 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400add0 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.671+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0695b0 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.672+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c063c90 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.672+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0864007300 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.673+0000 7f08537fe700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 0x7f08580694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.673+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08640848c0 con 0x7f086c159ec0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.673+0000 7f086b7fe700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 0x7f08580694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.673+0000 7f086b7fe700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 0x7f08580694a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f086c16cd70 tx=0x7f085c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:44.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.677+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0864051ac0 con 0x7f086c159ec0 2023-10-07T09:00:44.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:44.915+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f086c0718b0 con 0x7f086c159ec0 2023-10-07T09:00:45.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.883+0000 7f08537fe700 1 -- 172.21.15.46:0/1353818947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 136+0+0 (secure 0 0 0) 0x7f08640550e0 con 0x7f086c159ec0 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 msgr2=0x7f08580694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 0x7f08580694a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f086c16cd70 tx=0x7f085c016000 comp rx=0 tx=0).stop 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 msgr2=0x7f086c156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f086400cc90 tx=0x7f0864001a80 comp rx=0 tx=0).stop 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 shutdown_connections 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0858066ff0 0x7f08580694a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f086c159ec0 0x7f086c156b00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:45.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f086c0b53d0 0x7f086c09a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:45.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 --2- 172.21.15.46:0/1353818947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f086c0cce40 0x7f086c09ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:45.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 >> 172.21.15.46:0/1353818947 conn(0x7f086c0999f0 msgr2=0x7f086c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:45.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 shutdown_connections 2023-10-07T09:00:45.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:45.886+0000 7f0871b15700 1 -- 172.21.15.46:0/1353818947 wait complete. 2023-10-07T09:00:45.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:00:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.028+0000 7f1c2025f700 1 Processor -- start 2023-10-07T09:00:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.028+0000 7f1c2025f700 1 -- start start 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c2025f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c18159c60 0x7f1c1815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c2025f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 0x7f1c18069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c2025f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1815a160 con 0x7f1c18159890 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c2025f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1815df50 con 0x7f1c18159c60 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c2025f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180d13a0 con 0x7f1c1815db10 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c18159c60 0x7f1c1815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c18159c60 0x7f1c1815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32858/0 (socket says 172.21.15.46:32858) 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1dffb700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c18159890 0x7f1c1815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54868/0 (socket says 172.21.15.46:54868) 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 -- 172.21.15.46:0/3167066338 learned_addr learned my addr 172.21.15.46:0/3167066338 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1e7fc700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 0x7f1c18069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 -- 172.21.15.46:0/3167066338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 msgr2=0x7f1c18069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 0x7f1c18069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 -- 172.21.15.46:0/3167066338 >> v1:172.21.15.46:6789/0 conn(0x7f1c18159890 legacy=0x7f1c1815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 -- 172.21.15.46:0/3167066338 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1815e140 con 0x7f1c18159c60 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1e7fc700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 0x7f1c18069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1cff9700 1 -- 172.21.15.46:0/3167066338 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908898081 0 0) 0x7f1c1815a160 con 0x7f1c18159890 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1d7fa700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c18159c60 0x7f1c1815d5d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0099b0 tx=0x7f1c0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489269336629146d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1cff9700 1 -- 172.21.15.46:0/3167066338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00b860 con 0x7f1c18159c60 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1cff9700 1 -- 172.21.15.46:0/3167066338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00b9c0 con 0x7f1c18159c60 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.029+0000 7f1c1cff9700 1 -- 172.21.15.46:0/3167066338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00bd60 con 0x7f1c18159c60 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 -- 172.21.15.46:0/3167066338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c18159c60 msgr2=0x7f1c1815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c18159c60 0x7f1c1815d5d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0099b0 tx=0x7f1c0c009250 comp rx=0 tx=0).stop 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 -- 172.21.15.46:0/3167066338 shutdown_connections 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c1815db10 0x7f1c18069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 --2- 172.21.15.46:0/3167066338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c18159c60 0x7f1c1815d5d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 -- 172.21.15.46:0/3167066338 >> 172.21.15.46:0/3167066338 conn(0x7f1c18068e20 msgr2=0x7f1c180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 -- 172.21.15.46:0/3167066338 shutdown_connections 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.030+0000 7f1c2025f700 1 -- 172.21.15.46:0/3167066338 wait complete. 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.031+0000 7f1c2025f700 1 Processor -- start 2023-10-07T09:00:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.031+0000 7f1c2025f700 1 -- start start 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c18159890 0x7f1c180b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c18159c60 0x7f1c180cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180b36c0 con 0x7f1c1815db10 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180b39a0 con 0x7f1c18159890 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c2025f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180b0ff0 con 0x7f1c18159c60 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32864/0 (socket says 172.21.15.46:32864) 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 -- 172.21.15.46:0/962709952 learned_addr learned my addr 172.21.15.46:0/962709952 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1dffb700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c18159890 0x7f1c180b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1d7fa700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c18159c60 0x7f1c180cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 -- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c18159c60 msgr2=0x7f1c180cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c18159c60 0x7f1c180cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 -- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c18159890 msgr2=0x7f1c180b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c18159890 0x7f1c180b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.032+0000 7f1c1e7fc700 1 -- 172.21.15.46:0/962709952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0094f0 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c1e7fc700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c850 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011600 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100117c0 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180b12d0 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011b80 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.033+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180cfad0 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.034+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1804c3c0 con 0x7f1c1815db10 2023-10-07T09:00:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.034+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1c10018350 con 0x7f1c1815db10 2023-10-07T09:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.035+0000 7f1c15ffb700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 0x7f1c04069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.035+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c100845b0 con 0x7f1c1815db10 2023-10-07T09:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.035+0000 7f1c1dffb700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 0x7f1c04069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.035+0000 7f1c1dffb700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 0x7f1c04069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c08001560 tx=0x7f1c08005d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.039+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c10051720 con 0x7f1c1815db10 2023-10-07T09:00:46.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.260+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c1806a5b0 con 0x7f1c04066fc0 2023-10-07T09:00:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.262+0000 7f1c15ffb700 1 -- 172.21.15.46:0/962709952 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1c1806a5b0 con 0x7f1c04066fc0 2023-10-07T09:00:46.262 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:00:46.263 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:00:46.263 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:00:46.263 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:00:46.263 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 msgr2=0x7f1c04069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 0x7f1c04069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c08001560 tx=0x7f1c08005d10 comp rx=0 tx=0).stop 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 msgr2=0x7f1c180cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c850 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 shutdown_connections 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c04066fc0 0x7f1c04069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c1815db10 0x7f1c180cd100 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c18159890 0x7f1c180b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 --2- 172.21.15.46:0/962709952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c18159c60 0x7f1c180cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 >> 172.21.15.46:0/962709952 conn(0x7f1c18068e20 msgr2=0x7f1c18155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 shutdown_connections 2023-10-07T09:00:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.264+0000 7f1c2025f700 1 -- 172.21.15.46:0/962709952 wait complete. 2023-10-07T09:00:46.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:00:46.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.398+0000 7fcb34c80700 1 Processor -- start 2023-10-07T09:00:46.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.398+0000 7fcb34c80700 1 -- start start 2023-10-07T09:00:46.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb34c80700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb34c80700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb34c80700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3015a160 con 0x7fcb30159c60 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb34c80700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb30069f20 con 0x7fcb30069560 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb34c80700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300d13a0 con 0x7fcb30159890 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb2e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb2ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb2dd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb30159c60 0x7fcb3015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:41256/0 (socket says 172.21.15.46:41256) 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb2e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:51924/0 (socket says 172.21.15.46:51924) 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.399+0000 7fcb2ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39526/0 (socket says 172.21.15.46:39526) 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2dd9b700 1 -- 172.21.15.46:0/1343608519 learned_addr learned my addr 172.21.15.46:0/1343608519 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:46.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2d59a700 1 -- 172.21.15.46:0/1343608519 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105240686 0 0) 0x7fcb3015a160 con 0x7fcb30159c60 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2d59a700 1 -- 172.21.15.46:0/1343608519 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb1c003570 con 0x7fcb30159c60 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2e59c700 1 -- 172.21.15.46:0/1343608519 >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 msgr2=0x7fcb300699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2e59c700 1 --2- 172.21.15.46:0/1343608519 >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2e59c700 1 -- 172.21.15.46:0/1343608519 >> v1:172.21.15.133:6789/0 conn(0x7fcb30159c60 legacy=0x7fcb3015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2e59c700 1 -- 172.21.15.46:0/1343608519 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3015e140 con 0x7fcb30159890 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2ed9d700 1 --2- 172.21.15.46:0/1343608519 >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2e59c700 1 --2- 172.21.15.46:0/1343608519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb280098e0 tx=0x7fcb280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a627c9ec63e2226 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2d59a700 1 -- 172.21.15.46:0/1343608519 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28011630 con 0x7fcb30159890 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2d59a700 1 -- 172.21.15.46:0/1343608519 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb28011790 con 0x7fcb30159890 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.400+0000 7fcb2d59a700 1 -- 172.21.15.46:0/1343608519 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28011b30 con 0x7fcb30159890 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 -- 172.21.15.46:0/1343608519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 msgr2=0x7fcb3015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 --2- 172.21.15.46:0/1343608519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb280098e0 tx=0x7fcb280091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 -- 172.21.15.46:0/1343608519 shutdown_connections 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 --2- 172.21.15.46:0/1343608519 >> v2:172.21.15.133:3300/0 conn(0x7fcb30069560 0x7fcb300699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 --2- 172.21.15.46:0/1343608519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 -- 172.21.15.46:0/1343608519 >> 172.21.15.46:0/1343608519 conn(0x7fcb30068e20 msgr2=0x7fcb300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 -- 172.21.15.46:0/1343608519 shutdown_connections 2023-10-07T09:00:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.401+0000 7fcb34c80700 1 -- 172.21.15.46:0/1343608519 wait complete. 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.402+0000 7fcb34c80700 1 Processor -- start 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.402+0000 7fcb34c80700 1 -- start start 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb30169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159c60 0x7fcb3016a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30157f30 con 0x7fcb30069560 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300c80d0 con 0x7fcb30159c60 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb34c80700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300c83b0 con 0x7fcb30159890 2023-10-07T09:00:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32868/0 (socket says 172.21.15.46:32868) 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 -- 172.21.15.46:0/2463982156 learned_addr learned my addr 172.21.15.46:0/2463982156 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2ed9d700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159c60 0x7fcb3016a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2dd9b700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb30169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 -- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 msgr2=0x7fcb30169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb30169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 -- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159c60 msgr2=0x7fcb3016a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159c60 0x7fcb3016a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 -- 172.21.15.46:0/2463982156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009a20 con 0x7fcb30069560 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.403+0000 7fcb2e59c700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb30070e20 tx=0x7fcb28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28011b10 con 0x7fcb30069560 2023-10-07T09:00:46.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb280253f0 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb280257b0 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28009420 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb300c8970 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.404+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3004c3c0 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.405+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fcb28025ba0 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.405+0000 7fcb267fc700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 0x7fcb10069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.405+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb28085dd0 con 0x7fcb30069560 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.405+0000 7fcb2dd9b700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 0x7fcb10069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.406+0000 7fcb2dd9b700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 0x7fcb10069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb300c9240 tx=0x7fcb18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.410+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb28053010 con 0x7fcb30069560 2023-10-07T09:00:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.602+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcb300cf000 con 0x7fcb30069560 2023-10-07T09:00:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.602+0000 7fcb267fc700 1 -- 172.21.15.46:0/2463982156 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb28056630 con 0x7fcb30069560 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.604+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 msgr2=0x7fcb10069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.604+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 0x7fcb10069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb300c9240 tx=0x7fcb18009040 comp rx=0 tx=0).stop 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.604+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 msgr2=0x7fcb300c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.604+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb30070e20 tx=0x7fcb28017000 comp rx=0 tx=0).stop 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 shutdown_connections 2023-10-07T09:00:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10066fc0 0x7fcb10069470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159c60 0x7fcb3016a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30069560 0x7fcb300c78a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 --2- 172.21.15.46:0/2463982156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159890 0x7fcb30169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 >> 172.21.15.46:0/2463982156 conn(0x7fcb30068e20 msgr2=0x7fcb301588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 shutdown_connections 2023-10-07T09:00:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.605+0000 7fcb34c80700 1 -- 172.21.15.46:0/2463982156 wait complete. 2023-10-07T09:00:46.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000516704 --mode=777 2023-10-07T09:00:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.739+0000 7f5f027bc700 1 Processor -- start 2023-10-07T09:00:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 -- start start 2023-10-07T09:00:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5efc0b03c0 0x7f5efc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5efc0b0790 0x7f5efc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0cfa00 con 0x7f5efc1591e0 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0cb580 con 0x7f5efc0b0790 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.740+0000 7f5f027bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0b2de0 con 0x7f5efc0b03c0 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5efc0b0790 0x7f5efc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5efc0b0790 0x7f5efc0b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32870/0 (socket says 172.21.15.46:32870) 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 -- 172.21.15.46:0/705127703 learned_addr learned my addr 172.21.15.46:0/705127703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f017ba700 1 --2- 172.21.15.46:0/705127703 >> v2:172.21.15.133:3300/0 conn(0x7f5efc0b03c0 0x7f5efc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 -- 172.21.15.46:0/705127703 >> v2:172.21.15.133:3300/0 conn(0x7f5efc0b03c0 msgr2=0x7f5efc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 --2- 172.21.15.46:0/705127703 >> v2:172.21.15.133:3300/0 conn(0x7f5efc0b03c0 0x7f5efc0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 -- 172.21.15.46:0/705127703 >> v1:172.21.15.133:6789/0 conn(0x7f5efc1591e0 legacy=0x7f5efc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 -- 172.21.15.46:0/705127703 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc0cf160 con 0x7f5efc0b0790 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5f00fb9700 1 --2- 172.21.15.46:0/705127703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc0b0790 0x7f5efc0b28a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00099b0 tx=0x7f5ef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8ff26ecaabf492 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5efbfff700 1 -- 172.21.15.46:0/705127703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0009ea0 con 0x7f5efc0b0790 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5efbfff700 1 -- 172.21.15.46:0/705127703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000b820 con 0x7f5efc0b0790 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.741+0000 7f5efbfff700 1 -- 172.21.15.46:0/705127703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000bbe0 con 0x7f5efc0b0790 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 -- 172.21.15.46:0/705127703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc0b0790 msgr2=0x7f5efc0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 --2- 172.21.15.46:0/705127703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc0b0790 0x7f5efc0b28a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00099b0 tx=0x7f5ef0009250 comp rx=0 tx=0).stop 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 -- 172.21.15.46:0/705127703 shutdown_connections 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 --2- 172.21.15.46:0/705127703 >> v2:172.21.15.133:3300/0 conn(0x7f5efc0b03c0 0x7f5efc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 --2- 172.21.15.46:0/705127703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc0b0790 0x7f5efc0b28a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 -- 172.21.15.46:0/705127703 >> 172.21.15.46:0/705127703 conn(0x7f5efc063230 msgr2=0x7f5efc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 -- 172.21.15.46:0/705127703 shutdown_connections 2023-10-07T09:00:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.742+0000 7f5f027bc700 1 -- 172.21.15.46:0/705127703 wait complete. 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.743+0000 7f5f027bc700 1 Processor -- start 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.743+0000 7f5f027bc700 1 -- start start 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc0b03c0 0x7f5efc16a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc0b0790 0x7f5efc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc15b970 con 0x7f5efc1591e0 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc158060 con 0x7f5efc0b0790 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f027bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc16aa70 con 0x7f5efc0b03c0 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32884/0 (socket says 172.21.15.46:32884) 2023-10-07T09:00:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 -- 172.21.15.46:0/3621220844 learned_addr learned my addr 172.21.15.46:0/3621220844 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f00fb9700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc0b0790 0x7f5efc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f017ba700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc0b03c0 0x7f5efc16a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 -- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc0b03c0 msgr2=0x7f5efc16a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc0b03c0 0x7f5efc16a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 -- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc0b0790 msgr2=0x7f5efc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc0b0790 0x7f5efc0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.744+0000 7f5f01fbb700 1 -- 172.21.15.46:0/3621220844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00094f0 con 0x7f5efc1591e0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5f01fbb700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c840 tx=0x7f5eec001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec012630 con 0x7f5efc1591e0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0127b0 con 0x7f5efc1591e0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc15a3c0 con 0x7f5efc1591e0 2023-10-07T09:00:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec012b70 con 0x7f5efc1591e0 2023-10-07T09:00:46.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.745+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc15aa00 con 0x7f5efc1591e0 2023-10-07T09:00:46.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.746+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc15bae0 con 0x7f5efc1591e0 2023-10-07T09:00:46.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.746+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5eec01a3a0 con 0x7f5efc1591e0 2023-10-07T09:00:46.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.746+0000 7f5ef97fa700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 0x7f5ee8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.747+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5eec084690 con 0x7f5efc1591e0 2023-10-07T09:00:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.747+0000 7f5f017ba700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 0x7f5ee8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.747+0000 7f5f017ba700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 0x7f5ee8069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0b4850 tx=0x7f5ef40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.751+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5efc15bae0 con 0x7f5efc1591e0 2023-10-07T09:00:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:46.975+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000516704", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f5efc15bae0 con 0x7f5ee8066fc0 2023-10-07T09:00:46.978 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.977+0000 7f470fd46700 -1 client.5338 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-07T09:00:16.020044+0000 mtime=2023-10-07T09:00:16.020044+0000 ctime=2023-10-07T09:00:16.026201+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000710308"] has_dir_layout 0x564a4a6a2000) 2023-10-07T09:00:46.982 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.981+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:46.982 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.981+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:46.982 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.981+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:46.983 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.981+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:46.983 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:00:46.981+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:00:47.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.013+0000 7f5ef97fa700 1 -- 172.21.15.46:0/3621220844 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5efc15bae0 con 0x7f5ee8066fc0 2023-10-07T09:00:47.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.015+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 msgr2=0x7f5ee8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.015+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 0x7f5ee8069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0b4850 tx=0x7f5ef40091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.015+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 msgr2=0x7f5efc0d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.015+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c840 tx=0x7f5eec001670 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 shutdown_connections 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5ee8066fc0 0x7f5ee8069470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5efc1591e0 0x7f5efc0d0520 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc0b03c0 0x7f5efc16a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 --2- 172.21.15.46:0/3621220844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc0b0790 0x7f5efc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 >> 172.21.15.46:0/3621220844 conn(0x7f5efc063230 msgr2=0x7f5efc068d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 shutdown_connections 2023-10-07T09:00:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.016+0000 7f5f027bc700 1 -- 172.21.15.46:0/3621220844 wait complete. 2023-10-07T09:00:47.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000516704 2023-10-07T09:00:47.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.150+0000 7f74abcf6700 1 Processor -- start 2023-10-07T09:00:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.150+0000 7f74abcf6700 1 -- start start 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74abcf6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159890 0x7f74a415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74abcf6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74a4069560 0x7f74a40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74abcf6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a415a160 con 0x7f74a4159c60 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74abcf6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a4069f20 con 0x7f74a4069560 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74abcf6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40d13a0 con 0x7f74a4159890 2023-10-07T09:00:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74a4069560 0x7f74a40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a9291700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74a4159c60 0x7f74a415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54870/0 (socket says 172.21.15.46:54870) 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a9291700 1 -- 172.21.15.46:0/2707112344 learned_addr learned my addr 172.21.15.46:0/2707112344 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a9a92700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159890 0x7f74a415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 -- 172.21.15.46:0/2707112344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159890 msgr2=0x7f74a415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159890 0x7f74a415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 -- 172.21.15.46:0/2707112344 >> v1:172.21.15.46:6789/0 conn(0x7f74a4159c60 legacy=0x7f74a415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a8a90700 1 -- 172.21.15.46:0/2707112344 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913065039 0 0) 0x7f74a415a160 con 0x7f74a4159c60 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 -- 172.21.15.46:0/2707112344 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415e140 con 0x7f74a4069560 2023-10-07T09:00:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74aa293700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4069560 0x7f74a40699e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f749c0098e0 tx=0x7f749c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f00bae0b5d83e07 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a8a90700 1 -- 172.21.15.46:0/2707112344 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c009e80 con 0x7f74a4069560 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a8a90700 1 -- 172.21.15.46:0/2707112344 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00b860 con 0x7f74a4069560 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.151+0000 7f74a8a90700 1 -- 172.21.15.46:0/2707112344 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00bbe0 con 0x7f74a4069560 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 -- 172.21.15.46:0/2707112344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4069560 msgr2=0x7f74a40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4069560 0x7f74a40699e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f749c0098e0 tx=0x7f749c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 -- 172.21.15.46:0/2707112344 shutdown_connections 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4069560 0x7f74a40699e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 --2- 172.21.15.46:0/2707112344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159890 0x7f74a415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 -- 172.21.15.46:0/2707112344 >> 172.21.15.46:0/2707112344 conn(0x7f74a4068e20 msgr2=0x7f74a40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 -- 172.21.15.46:0/2707112344 shutdown_connections 2023-10-07T09:00:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.152+0000 7f74abcf6700 1 -- 172.21.15.46:0/2707112344 wait complete. 2023-10-07T09:00:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.153+0000 7f74abcf6700 1 Processor -- start 2023-10-07T09:00:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.153+0000 7f74abcf6700 1 -- start start 2023-10-07T09:00:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a4069560 0x7f74a4142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159c60 0x7f74a415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415c940 con 0x7f74a4159890 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415cf00 con 0x7f74a4069560 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74abcf6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4154900 con 0x7f74a4159c60 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32896/0 (socket says 172.21.15.46:32896) 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 -- 172.21.15.46:0/1801755446 learned_addr learned my addr 172.21.15.46:0/1801755446 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9a92700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a4069560 0x7f74a4142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74aa293700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159c60 0x7f74a415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 -- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159c60 msgr2=0x7f74a415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159c60 0x7f74a415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 -- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a4069560 msgr2=0x7f74a4142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a4069560 0x7f74a4142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.154+0000 7f74a9291700 1 -- 172.21.15.46:0/1801755446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c009420 con 0x7f74a4159890 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74a9291700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f749800c840 tx=0x7f7498007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498005c00 con 0x7f74a4159890 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498005d60 con 0x7f74a4159890 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a415c090 con 0x7f74a4159890 2023-10-07T09:00:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498007300 con 0x7f74a4159890 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.155+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a415cb90 con 0x7f74a4159890 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.156+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a404c3c0 con 0x7f74a4159890 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.156+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f749801b3b0 con 0x7f74a4159890 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.157+0000 7f74a1ffb700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 0x7f7490069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.157+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7498083a10 con 0x7f74a4159890 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.157+0000 7f74a9a92700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 0x7f7490069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.157+0000 7f74a9a92700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 0x7f7490069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7494009fd0 tx=0x7f7494009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:00:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.161+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7498050c90 con 0x7f74a4159890 2023-10-07T09:00:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.386+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000516704", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a406a5b0 con 0x7f7490066fc0 2023-10-07T09:00:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.392+0000 7f74a1ffb700 1 -- 172.21.15.46:0/1801755446 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f74a406a5b0 con 0x7f7490066fc0 2023-10-07T09:00:47.393 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 msgr2=0x7f7490069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 0x7f7490069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7494009fd0 tx=0x7f7494009880 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 msgr2=0x7f74a40c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f749800c840 tx=0x7f7498007db0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 shutdown_connections 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7490066fc0 0x7f7490069470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74a4159c60 0x7f74a415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a4069560 0x7f74a4142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 --2- 172.21.15.46:0/1801755446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74a4159890 0x7f74a40c78a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:00:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 >> 172.21.15.46:0/1801755446 conn(0x7f74a4068e20 msgr2=0x7f74a40c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:00:47.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 shutdown_connections 2023-10-07T09:00:47.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:00:47.394+0000 7f74abcf6700 1 -- 172.21.15.46:0/1801755446 wait complete. 2023-10-07T09:00:47.407 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000516704 with 3000 files each 0.1MB size under directory volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772 2023-10-07T09:00:47.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.407 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4581e-05 s, 0.0 kB/s 2023-10-07T09:00:47.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0728e-05 s, 0.0 kB/s 2023-10-07T09:00:47.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3811e-05 s, 0.0 kB/s 2023-10-07T09:00:47.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8465e-05 s, 0.0 kB/s 2023-10-07T09:00:47.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.657 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7329e-05 s, 0.0 kB/s 2023-10-07T09:00:47.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.712 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2481e-05 s, 0.0 kB/s 2023-10-07T09:00:47.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.769 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.473e-05 s, 0.0 kB/s 2023-10-07T09:00:47.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.769 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6669e-05 s, 0.0 kB/s 2023-10-07T09:00:47.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.880 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8816e-05 s, 0.0 kB/s 2023-10-07T09:00:47.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.881 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.938 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3657e-05 s, 0.0 kB/s 2023-10-07T09:00:47.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:47.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:47.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:47.994 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0299e-05 s, 0.0 kB/s 2023-10-07T09:00:47.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:47.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.050 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1506e-05 s, 0.0 kB/s 2023-10-07T09:00:48.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-07T09:00:48.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.162 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.163 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9149e-05 s, 0.0 kB/s 2023-10-07T09:00:48.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.218 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7256e-05 s, 0.0 kB/s 2023-10-07T09:00:48.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.275 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3572e-05 s, 0.0 kB/s 2023-10-07T09:00:48.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.276 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1275e-05 s, 0.0 kB/s 2023-10-07T09:00:48.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.388 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.388 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.6539e-05 s, 0.0 kB/s 2023-10-07T09:00:48.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.388 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2819e-05 s, 0.0 kB/s 2023-10-07T09:00:48.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.444 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.499 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.500 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.500 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6255e-05 s, 0.0 kB/s 2023-10-07T09:00:48.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.500 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4279e-05 s, 0.0 kB/s 2023-10-07T09:00:48.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.556 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.612 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1758e-05 s, 0.0 kB/s 2023-10-07T09:00:48.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3402e-05 s, 0.0 kB/s 2023-10-07T09:00:48.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.669 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.723 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.724 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9226e-05 s, 0.0 kB/s 2023-10-07T09:00:48.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-07T09:00:48.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000114345 s, 0.0 kB/s 2023-10-07T09:00:48.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.009e-05 s, 0.0 kB/s 2023-10-07T09:00:48.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.898 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:48.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:48.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:48.954 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.871e-05 s, 0.0 kB/s 2023-10-07T09:00:48.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:48.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.010 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.571e-05 s, 0.0 kB/s 2023-10-07T09:00:49.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0859e-05 s, 0.0 kB/s 2023-10-07T09:00:49.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.124 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9982e-05 s, 0.0 kB/s 2023-10-07T09:00:49.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2731e-05 s, 0.0 kB/s 2023-10-07T09:00:49.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.236 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.502e-05 s, 0.0 kB/s 2023-10-07T09:00:49.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.237 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.294 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7849e-05 s, 0.0 kB/s 2023-10-07T09:00:49.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1386e-05 s, 0.0 kB/s 2023-10-07T09:00:49.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.352 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4666e-05 s, 0.0 kB/s 2023-10-07T09:00:49.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5543e-05 s, 0.0 kB/s 2023-10-07T09:00:49.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.520 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.520 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.521 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1207e-05 s, 0.0 kB/s 2023-10-07T09:00:49.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7436e-05 s, 0.0 kB/s 2023-10-07T09:00:49.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.577 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.632 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.632 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.632 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3352e-05 s, 0.0 kB/s 2023-10-07T09:00:49.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.633 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.689 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.689 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.689 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5753e-05 s, 0.0 kB/s 2023-10-07T09:00:49.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.689 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.745 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.746 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.746 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2601e-05 s, 0.0 kB/s 2023-10-07T09:00:49.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.746 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.801 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-07T09:00:49.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.802 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2581e-05 s, 0.0 kB/s 2023-10-07T09:00:49.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.858 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.915 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4263e-05 s, 0.0 kB/s 2023-10-07T09:00:49.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5875e-05 s, 0.0 kB/s 2023-10-07T09:00:49.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:49.972 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.027 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6692e-05 s, 0.0 kB/s 2023-10-07T09:00:50.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.316e-05 s, 0.0 kB/s 2023-10-07T09:00:50.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.085 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1779e-05 s, 0.0 kB/s 2023-10-07T09:00:50.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.197 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.197 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4184e-05 s, 0.0 kB/s 2023-10-07T09:00:50.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3722e-05 s, 0.0 kB/s 2023-10-07T09:00:50.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4178e-05 s, 0.0 kB/s 2023-10-07T09:00:50.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.309 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.364 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.364 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.364 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0818e-05 s, 0.0 kB/s 2023-10-07T09:00:50.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.1666e-05 s, 0.0 kB/s 2023-10-07T09:00:50.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.421 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5379e-05 s, 0.0 kB/s 2023-10-07T09:00:50.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.477 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.532 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.532 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.533 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1522e-05 s, 0.0 kB/s 2023-10-07T09:00:50.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.588 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4866e-05 s, 0.0 kB/s 2023-10-07T09:00:50.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.589 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.644 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4642e-05 s, 0.0 kB/s 2023-10-07T09:00:50.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.645 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.700 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1301e-05 s, 0.0 kB/s 2023-10-07T09:00:50.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.791e-05 s, 0.0 kB/s 2023-10-07T09:00:50.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.757 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3693e-05 s, 0.0 kB/s 2023-10-07T09:00:50.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.813 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3384e-05 s, 0.0 kB/s 2023-10-07T09:00:50.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.94e-05 s, 0.0 kB/s 2023-10-07T09:00:50.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1499e-05 s, 0.0 kB/s 2023-10-07T09:00:50.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:50.982 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.3933e-05 s, 0.0 kB/s 2023-10-07T09:00:51.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.038 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1828e-05 s, 0.0 kB/s 2023-10-07T09:00:51.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4366e-05 s, 0.0 kB/s 2023-10-07T09:00:51.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3982e-05 s, 0.0 kB/s 2023-10-07T09:00:51.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5396e-05 s, 0.0 kB/s 2023-10-07T09:00:51.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.317 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5449e-05 s, 0.0 kB/s 2023-10-07T09:00:51.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-07T09:00:51.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.275e-05 s, 0.0 kB/s 2023-10-07T09:00:51.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.430 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-07T09:00:51.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-07T09:00:51.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1739e-05 s, 0.0 kB/s 2023-10-07T09:00:51.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4926e-05 s, 0.0 kB/s 2023-10-07T09:00:51.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1652e-05 s, 0.0 kB/s 2023-10-07T09:00:51.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1467e-05 s, 0.0 kB/s 2023-10-07T09:00:51.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2986e-05 s, 0.0 kB/s 2023-10-07T09:00:51.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.878 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.878 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.878 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6122e-05 s, 0.0 kB/s 2023-10-07T09:00:51.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1294e-05 s, 0.0 kB/s 2023-10-07T09:00:51.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.937 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:51.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:51.993 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9869e-05 s, 0.0 kB/s 2023-10-07T09:00:51.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:51.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0388e-05 s, 0.0 kB/s 2023-10-07T09:00:52.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.104 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.104 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.104 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9365e-05 s, 0.0 kB/s 2023-10-07T09:00:52.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0948e-05 s, 0.0 kB/s 2023-10-07T09:00:52.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.162 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.217 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000127306 s, 0.0 kB/s 2023-10-07T09:00:52.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1509e-05 s, 0.0 kB/s 2023-10-07T09:00:52.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.275 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.330 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.330 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.330 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.424e-05 s, 0.0 kB/s 2023-10-07T09:00:52.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.331 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8775e-05 s, 0.0 kB/s 2023-10-07T09:00:52.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6126e-05 s, 0.0 kB/s 2023-10-07T09:00:52.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.443 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4573e-05 s, 0.0 kB/s 2023-10-07T09:00:52.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.499 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.554 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.554 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.554 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6609e-05 s, 0.0 kB/s 2023-10-07T09:00:52.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.612 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6834e-05 s, 0.0 kB/s 2023-10-07T09:00:52.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.669 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-07T09:00:52.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.669 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-07T09:00:52.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6455e-05 s, 0.0 kB/s 2023-10-07T09:00:52.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3022e-05 s, 0.0 kB/s 2023-10-07T09:00:52.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.893 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1926e-05 s, 0.0 kB/s 2023-10-07T09:00:52.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:52.949 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:52.949 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:52.950 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.5433e-05 s, 0.0 kB/s 2023-10-07T09:00:52.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:52.950 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.005 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.005 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.005 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0112e-05 s, 0.0 kB/s 2023-10-07T09:00:53.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.006 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0096e-05 s, 0.0 kB/s 2023-10-07T09:00:53.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.063 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.118 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.118 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.118 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9944e-05 s, 0.0 kB/s 2023-10-07T09:00:53.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.175 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.175 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2022e-05 s, 0.0 kB/s 2023-10-07T09:00:53.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.175 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.230 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.230 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.231 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1656e-05 s, 0.0 kB/s 2023-10-07T09:00:53.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.231 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.197e-05 s, 0.0 kB/s 2023-10-07T09:00:53.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.287 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2222e-05 s, 0.0 kB/s 2023-10-07T09:00:53.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.343 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.399 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1522e-05 s, 0.0 kB/s 2023-10-07T09:00:53.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.454 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7886e-05 s, 0.0 kB/s 2023-10-07T09:00:53.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.455 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4049e-05 s, 0.0 kB/s 2023-10-07T09:00:53.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1906e-05 s, 0.0 kB/s 2023-10-07T09:00:53.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6605e-05 s, 0.0 kB/s 2023-10-07T09:00:53.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.626 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.351e-05 s, 0.0 kB/s 2023-10-07T09:00:53.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.738 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4464e-05 s, 0.0 kB/s 2023-10-07T09:00:53.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2779e-05 s, 0.0 kB/s 2023-10-07T09:00:53.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.850 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3641e-05 s, 0.0 kB/s 2023-10-07T09:00:53.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1281e-05 s, 0.0 kB/s 2023-10-07T09:00:53.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:53.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:53.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:53.963 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2461e-05 s, 0.0 kB/s 2023-10-07T09:00:53.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:53.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4839e-05 s, 0.0 kB/s 2023-10-07T09:00:54.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.077 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4432e-05 s, 0.0 kB/s 2023-10-07T09:00:54.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4352e-05 s, 0.0 kB/s 2023-10-07T09:00:54.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1957e-05 s, 0.0 kB/s 2023-10-07T09:00:54.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.245 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5599e-05 s, 0.0 kB/s 2023-10-07T09:00:54.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.245 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7976e-05 s, 0.0 kB/s 2023-10-07T09:00:54.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-07T09:00:54.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.358 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2925e-05 s, 0.0 kB/s 2023-10-07T09:00:54.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2733e-05 s, 0.0 kB/s 2023-10-07T09:00:54.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.528 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1748e-05 s, 0.0 kB/s 2023-10-07T09:00:54.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1881e-05 s, 0.0 kB/s 2023-10-07T09:00:54.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.587 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.642 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3604e-05 s, 0.0 kB/s 2023-10-07T09:00:54.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.642 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.698 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2796e-05 s, 0.0 kB/s 2023-10-07T09:00:54.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6899e-05 s, 0.0 kB/s 2023-10-07T09:00:54.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.811 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6285e-05 s, 0.0 kB/s 2023-10-07T09:00:54.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5715e-05 s, 0.0 kB/s 2023-10-07T09:00:54.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.923 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7193e-05 s, 0.0 kB/s 2023-10-07T09:00:54.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:54.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:54.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:54.980 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.614e-05 s, 0.0 kB/s 2023-10-07T09:00:54.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:54.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.036 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-07T09:00:55.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2778e-05 s, 0.0 kB/s 2023-10-07T09:00:55.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.148 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3943e-05 s, 0.0 kB/s 2023-10-07T09:00:55.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8963e-05 s, 0.0 kB/s 2023-10-07T09:00:55.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3153e-05 s, 0.0 kB/s 2023-10-07T09:00:55.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2327e-05 s, 0.0 kB/s 2023-10-07T09:00:55.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.697e-05 s, 0.0 kB/s 2023-10-07T09:00:55.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-07T09:00:55.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.430 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.486 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5749e-05 s, 0.0 kB/s 2023-10-07T09:00:55.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1636e-05 s, 0.0 kB/s 2023-10-07T09:00:55.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.543 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000109095 s, 0.0 kB/s 2023-10-07T09:00:55.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4186e-05 s, 0.0 kB/s 2023-10-07T09:00:55.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.656 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6863e-05 s, 0.0 kB/s 2023-10-07T09:00:55.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2056e-05 s, 0.0 kB/s 2023-10-07T09:00:55.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.769 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000117592 s, 0.0 kB/s 2023-10-07T09:00:55.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0898e-05 s, 0.0 kB/s 2023-10-07T09:00:55.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.881 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6599e-05 s, 0.0 kB/s 2023-10-07T09:00:55.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:55.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:55.994 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:55.994 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4426e-05 s, 0.0 kB/s 2023-10-07T09:00:55.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:55.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2618e-05 s, 0.0 kB/s 2023-10-07T09:00:56.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.106 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0222e-05 s, 0.0 kB/s 2023-10-07T09:00:56.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.162 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.163 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-07T09:00:56.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6486e-05 s, 0.0 kB/s 2023-10-07T09:00:56.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.278 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-07T09:00:56.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.334 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3115e-05 s, 0.0 kB/s 2023-10-07T09:00:56.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3995e-05 s, 0.0 kB/s 2023-10-07T09:00:56.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1922e-05 s, 0.0 kB/s 2023-10-07T09:00:56.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.503 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1904e-05 s, 0.0 kB/s 2023-10-07T09:00:56.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.559 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-07T09:00:56.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.615 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6676e-05 s, 0.0 kB/s 2023-10-07T09:00:56.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.615 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-07T09:00:56.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0297e-05 s, 0.0 kB/s 2023-10-07T09:00:56.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.727 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.782 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1195e-05 s, 0.0 kB/s 2023-10-07T09:00:56.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.783 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.839 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1309e-05 s, 0.0 kB/s 2023-10-07T09:00:56.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.839 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5503e-05 s, 0.0 kB/s 2023-10-07T09:00:56.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.896 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:56.953 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:56.953 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:56.953 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.143e-05 s, 0.0 kB/s 2023-10-07T09:00:56.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:56.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.010 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4153e-05 s, 0.0 kB/s 2023-10-07T09:00:57.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-07T09:00:57.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.123 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1835e-05 s, 0.0 kB/s 2023-10-07T09:00:57.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.180 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1946e-05 s, 0.0 kB/s 2023-10-07T09:00:57.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.238 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.238 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.238 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2903e-05 s, 0.0 kB/s 2023-10-07T09:00:57.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.239 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.295 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.295 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.295 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9387e-05 s, 0.0 kB/s 2023-10-07T09:00:57.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.295 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.352 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.352 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1232e-05 s, 0.0 kB/s 2023-10-07T09:00:57.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.352 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.408 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.408 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.408 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8566e-05 s, 0.0 kB/s 2023-10-07T09:00:57.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.464 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.465 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.465 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.137e-05 s, 0.0 kB/s 2023-10-07T09:00:57.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.521 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9296e-05 s, 0.0 kB/s 2023-10-07T09:00:57.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.578 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-07T09:00:57.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.578 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2771e-05 s, 0.0 kB/s 2023-10-07T09:00:57.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.635 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.691 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0093e-05 s, 0.0 kB/s 2023-10-07T09:00:57.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.747 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.748 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4102e-05 s, 0.0 kB/s 2023-10-07T09:00:57.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2218e-05 s, 0.0 kB/s 2023-10-07T09:00:57.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.861 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.861 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.861 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2792e-05 s, 0.0 kB/s 2023-10-07T09:00:57.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.861 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.917 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.917 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.917 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5289e-05 s, 0.0 kB/s 2023-10-07T09:00:57.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.917 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5053e-05 s, 0.0 kB/s 2023-10-07T09:00:57.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:57.973 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106236 s, 0.0 kB/s 2023-10-07T09:00:58.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.087 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1423e-05 s, 0.0 kB/s 2023-10-07T09:00:58.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.087 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.145 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.145 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.145 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2248e-05 s, 0.0 kB/s 2023-10-07T09:00:58.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.145 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1529e-05 s, 0.0 kB/s 2023-10-07T09:00:58.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.259 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1584e-05 s, 0.0 kB/s 2023-10-07T09:00:58.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-07T09:00:58.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.372 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.372 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.373 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.573e-05 s, 0.0 kB/s 2023-10-07T09:00:58.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2656e-05 s, 0.0 kB/s 2023-10-07T09:00:58.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.486 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0562e-05 s, 0.0 kB/s 2023-10-07T09:00:58.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3216e-05 s, 0.0 kB/s 2023-10-07T09:00:58.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.543 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-07T09:00:58.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0643e-05 s, 0.0 kB/s 2023-10-07T09:00:58.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.656 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.818e-05 s, 0.0 kB/s 2023-10-07T09:00:58.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4589e-05 s, 0.0 kB/s 2023-10-07T09:00:58.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9712e-05 s, 0.0 kB/s 2023-10-07T09:00:58.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.882 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1294e-05 s, 0.0 kB/s 2023-10-07T09:00:58.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.939 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9173e-05 s, 0.0 kB/s 2023-10-07T09:00:58.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3832e-05 s, 0.0 kB/s 2023-10-07T09:00:58.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:58.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1091e-05 s, 0.0 kB/s 2023-10-07T09:00:59.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.110 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6152e-05 s, 0.0 kB/s 2023-10-07T09:00:59.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.111 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.3913e-05 s, 0.0 kB/s 2023-10-07T09:00:59.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2846e-05 s, 0.0 kB/s 2023-10-07T09:00:59.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.225 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.346e-05 s, 0.0 kB/s 2023-10-07T09:00:59.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.282 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.339 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8572e-05 s, 0.0 kB/s 2023-10-07T09:00:59.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.396 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1067e-05 s, 0.0 kB/s 2023-10-07T09:00:59.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.396 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2327e-05 s, 0.0 kB/s 2023-10-07T09:00:59.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.508 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2463e-05 s, 0.0 kB/s 2023-10-07T09:00:59.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3699e-05 s, 0.0 kB/s 2023-10-07T09:00:59.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3107e-05 s, 0.0 kB/s 2023-10-07T09:00:59.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.678 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3708e-05 s, 0.0 kB/s 2023-10-07T09:00:59.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4108e-05 s, 0.0 kB/s 2023-10-07T09:00:59.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5842e-05 s, 0.0 kB/s 2023-10-07T09:00:59.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.793 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.025e-05 s, 0.0 kB/s 2023-10-07T09:00:59.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.849 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.8809e-05 s, 0.0 kB/s 2023-10-07T09:00:59.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:00:59.961 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:00:59.961 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:00:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4786e-05 s, 0.0 kB/s 2023-10-07T09:00:59.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:00:59.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.018 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9447e-05 s, 0.0 kB/s 2023-10-07T09:01:00.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.018 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5061e-05 s, 0.0 kB/s 2023-10-07T09:01:00.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.075 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.132 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0096e-05 s, 0.0 kB/s 2023-10-07T09:01:00.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.189 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2306e-05 s, 0.0 kB/s 2023-10-07T09:01:00.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3691e-05 s, 0.0 kB/s 2023-10-07T09:01:00.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.245 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8759e-05 s, 0.0 kB/s 2023-10-07T09:01:00.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4467e-05 s, 0.0 kB/s 2023-10-07T09:01:00.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7526e-05 s, 0.0 kB/s 2023-10-07T09:01:00.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9669e-05 s, 0.0 kB/s 2023-10-07T09:01:00.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.095e-05 s, 0.0 kB/s 2023-10-07T09:01:00.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1273e-05 s, 0.0 kB/s 2023-10-07T09:01:00.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2222e-05 s, 0.0 kB/s 2023-10-07T09:01:00.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.695 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8249e-05 s, 0.0 kB/s 2023-10-07T09:01:00.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0893e-05 s, 0.0 kB/s 2023-10-07T09:01:00.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.058e-05 s, 0.0 kB/s 2023-10-07T09:01:00.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.864 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4889e-05 s, 0.0 kB/s 2023-10-07T09:01:00.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.864 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.478e-05 s, 0.0 kB/s 2023-10-07T09:01:00.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.920 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:00.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:00.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:00.976 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2106e-05 s, 0.0 kB/s 2023-10-07T09:01:00.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:00.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.033 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4929e-05 s, 0.0 kB/s 2023-10-07T09:01:01.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3561e-05 s, 0.0 kB/s 2023-10-07T09:01:01.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.090 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.147 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-07T09:01:01.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.202 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1724e-05 s, 0.0 kB/s 2023-10-07T09:01:01.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.258 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.7573e-05 s, 0.0 kB/s 2023-10-07T09:01:01.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.314 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2073e-05 s, 0.0 kB/s 2023-10-07T09:01:01.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.314 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.369 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4806e-05 s, 0.0 kB/s 2023-10-07T09:01:01.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.370 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.426 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-07T09:01:01.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.427 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.483 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.483 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.483 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.298e-05 s, 0.0 kB/s 2023-10-07T09:01:01.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.7055e-05 s, 0.0 kB/s 2023-10-07T09:01:01.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.157e-05 s, 0.0 kB/s 2023-10-07T09:01:01.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.597 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.106e-05 s, 0.0 kB/s 2023-10-07T09:01:01.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.652 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8376e-05 s, 0.0 kB/s 2023-10-07T09:01:01.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.708 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000107395 s, 0.0 kB/s 2023-10-07T09:01:01.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7262e-05 s, 0.0 kB/s 2023-10-07T09:01:01.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.822 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.879 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000118822 s, 0.0 kB/s 2023-10-07T09:01:01.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0698e-05 s, 0.0 kB/s 2023-10-07T09:01:01.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.937 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8932e-05 s, 0.0 kB/s 2023-10-07T09:01:01.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:01.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.051 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-07T09:01:02.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.2296e-05 s, 0.0 kB/s 2023-10-07T09:01:02.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.108 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-07T09:01:02.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.223 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2211e-05 s, 0.0 kB/s 2023-10-07T09:01:02.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.223 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1002e-05 s, 0.0 kB/s 2023-10-07T09:01:02.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0756e-05 s, 0.0 kB/s 2023-10-07T09:01:02.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6365e-05 s, 0.0 kB/s 2023-10-07T09:01:02.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.393 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8877e-05 s, 0.0 kB/s 2023-10-07T09:01:02.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.449 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.505 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9477e-05 s, 0.0 kB/s 2023-10-07T09:01:02.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.349e-05 s, 0.0 kB/s 2023-10-07T09:01:02.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.618 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.238e-05 s, 0.0 kB/s 2023-10-07T09:01:02.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3818e-05 s, 0.0 kB/s 2023-10-07T09:01:02.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.674 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3839e-05 s, 0.0 kB/s 2023-10-07T09:01:02.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3065e-05 s, 0.0 kB/s 2023-10-07T09:01:02.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.789 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4566e-05 s, 0.0 kB/s 2023-10-07T09:01:02.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9713e-05 s, 0.0 kB/s 2023-10-07T09:01:02.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:02.956 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3891e-05 s, 0.0 kB/s 2023-10-07T09:01:02.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:02.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.013 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0761e-05 s, 0.0 kB/s 2023-10-07T09:01:03.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.013 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1589e-05 s, 0.0 kB/s 2023-10-07T09:01:03.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2396e-05 s, 0.0 kB/s 2023-10-07T09:01:03.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.506e-05 s, 0.0 kB/s 2023-10-07T09:01:03.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-07T09:01:03.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.238 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.294 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000107656 s, 0.0 kB/s 2023-10-07T09:01:03.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.351 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5139e-05 s, 0.0 kB/s 2023-10-07T09:01:03.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.351 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.408 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.408 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.408 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1662e-05 s, 0.0 kB/s 2023-10-07T09:01:03.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1134e-05 s, 0.0 kB/s 2023-10-07T09:01:03.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.464 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.519 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.519 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.520 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1223e-05 s, 0.0 kB/s 2023-10-07T09:01:03.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.520 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6395e-05 s, 0.0 kB/s 2023-10-07T09:01:03.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.576 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.298e-05 s, 0.0 kB/s 2023-10-07T09:01:03.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.633 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-07T09:01:03.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.689 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1925e-05 s, 0.0 kB/s 2023-10-07T09:01:03.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.505e-05 s, 0.0 kB/s 2023-10-07T09:01:03.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9906e-05 s, 0.0 kB/s 2023-10-07T09:01:03.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.858 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.913 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.913 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.913 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9334e-05 s, 0.0 kB/s 2023-10-07T09:01:03.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:03.970 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:03.970 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:03.970 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6907e-05 s, 0.0 kB/s 2023-10-07T09:01:03.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:03.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.027 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1356e-05 s, 0.0 kB/s 2023-10-07T09:01:04.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.028 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.084 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.1671e-05 s, 0.0 kB/s 2023-10-07T09:01:04.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1439e-05 s, 0.0 kB/s 2023-10-07T09:01:04.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.196 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2826e-05 s, 0.0 kB/s 2023-10-07T09:01:04.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8621e-05 s, 0.0 kB/s 2023-10-07T09:01:04.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.308 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-07T09:01:04.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.308 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9472e-05 s, 0.0 kB/s 2023-10-07T09:01:04.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1615e-05 s, 0.0 kB/s 2023-10-07T09:01:04.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.420 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.475 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0193e-05 s, 0.0 kB/s 2023-10-07T09:01:04.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.476 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-07T09:01:04.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000117466 s, 0.0 kB/s 2023-10-07T09:01:04.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.589 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.644 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1403e-05 s, 0.0 kB/s 2023-10-07T09:01:04.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.645 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.701 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.1519e-05 s, 0.0 kB/s 2023-10-07T09:01:04.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.757 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4325e-05 s, 0.0 kB/s 2023-10-07T09:01:04.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.814 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.316e-05 s, 0.0 kB/s 2023-10-07T09:01:04.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.870 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3643e-05 s, 0.0 kB/s 2023-10-07T09:01:04.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.870 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.926 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.926 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.926 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9957e-05 s, 0.0 kB/s 2023-10-07T09:01:04.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.927 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8786e-05 s, 0.0 kB/s 2023-10-07T09:01:04.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:04.983 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1146e-05 s, 0.0 kB/s 2023-10-07T09:01:05.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-07T09:01:05.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.399e-05 s, 0.0 kB/s 2023-10-07T09:01:05.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.207 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.208 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9279e-05 s, 0.0 kB/s 2023-10-07T09:01:05.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.266 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.18e-05 s, 0.0 kB/s 2023-10-07T09:01:05.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5381e-05 s, 0.0 kB/s 2023-10-07T09:01:05.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.322 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6326e-05 s, 0.0 kB/s 2023-10-07T09:01:05.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0675e-05 s, 0.0 kB/s 2023-10-07T09:01:05.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.437 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1394e-05 s, 0.0 kB/s 2023-10-07T09:01:05.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.546 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.26e-05 s, 0.0 kB/s 2023-10-07T09:01:05.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3521e-05 s, 0.0 kB/s 2023-10-07T09:01:05.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5063e-05 s, 0.0 kB/s 2023-10-07T09:01:05.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5619e-05 s, 0.0 kB/s 2023-10-07T09:01:05.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1374e-05 s, 0.0 kB/s 2023-10-07T09:01:05.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.828 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-07T09:01:05.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.885 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2909e-05 s, 0.0 kB/s 2023-10-07T09:01:05.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.7488e-05 s, 0.0 kB/s 2023-10-07T09:01:05.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:05.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1353e-05 s, 0.0 kB/s 2023-10-07T09:01:06.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.001 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2581e-05 s, 0.0 kB/s 2023-10-07T09:01:06.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1373e-05 s, 0.0 kB/s 2023-10-07T09:01:06.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2152e-05 s, 0.0 kB/s 2023-10-07T09:01:06.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.227 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.269e-05 s, 0.0 kB/s 2023-10-07T09:01:06.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.286 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0739e-05 s, 0.0 kB/s 2023-10-07T09:01:06.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.287 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3788e-05 s, 0.0 kB/s 2023-10-07T09:01:06.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.343 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.399 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3885e-05 s, 0.0 kB/s 2023-10-07T09:01:06.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6929e-05 s, 0.0 kB/s 2023-10-07T09:01:06.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.455 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3666e-05 s, 0.0 kB/s 2023-10-07T09:01:06.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2051e-05 s, 0.0 kB/s 2023-10-07T09:01:06.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.625 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4358e-05 s, 0.0 kB/s 2023-10-07T09:01:06.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.681 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7883e-05 s, 0.0 kB/s 2023-10-07T09:01:06.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.681 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.737 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2819e-05 s, 0.0 kB/s 2023-10-07T09:01:06.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.793 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3343e-05 s, 0.0 kB/s 2023-10-07T09:01:06.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.793 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4832e-05 s, 0.0 kB/s 2023-10-07T09:01:06.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.849 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5209e-05 s, 0.0 kB/s 2023-10-07T09:01:06.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.905 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:06.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:06.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:06.963 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0193e-05 s, 0.0 kB/s 2023-10-07T09:01:06.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:06.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8016e-05 s, 0.0 kB/s 2023-10-07T09:01:07.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.175e-05 s, 0.0 kB/s 2023-10-07T09:01:07.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.076 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.131 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0186e-05 s, 0.0 kB/s 2023-10-07T09:01:07.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8076e-05 s, 0.0 kB/s 2023-10-07T09:01:07.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2597e-05 s, 0.0 kB/s 2023-10-07T09:01:07.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.246 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1967e-05 s, 0.0 kB/s 2023-10-07T09:01:07.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.56e-05 s, 0.0 kB/s 2023-10-07T09:01:07.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.358 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8614e-05 s, 0.0 kB/s 2023-10-07T09:01:07.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3246e-05 s, 0.0 kB/s 2023-10-07T09:01:07.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5562e-05 s, 0.0 kB/s 2023-10-07T09:01:07.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7736e-05 s, 0.0 kB/s 2023-10-07T09:01:07.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6823e-05 s, 0.0 kB/s 2023-10-07T09:01:07.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3012e-05 s, 0.0 kB/s 2023-10-07T09:01:07.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.754 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2392e-05 s, 0.0 kB/s 2023-10-07T09:01:07.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.810 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1545e-05 s, 0.0 kB/s 2023-10-07T09:01:07.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9839e-05 s, 0.0 kB/s 2023-10-07T09:01:07.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9029e-05 s, 0.0 kB/s 2023-10-07T09:01:07.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1416e-05 s, 0.0 kB/s 2023-10-07T09:01:07.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:07.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1633e-05 s, 0.0 kB/s 2023-10-07T09:01:08.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.038 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.547e-05 s, 0.0 kB/s 2023-10-07T09:01:08.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5399e-05 s, 0.0 kB/s 2023-10-07T09:01:08.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1743e-05 s, 0.0 kB/s 2023-10-07T09:01:08.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.208 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.264 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6032e-05 s, 0.0 kB/s 2023-10-07T09:01:08.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9966e-05 s, 0.0 kB/s 2023-10-07T09:01:08.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.321 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-07T09:01:08.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4072e-05 s, 0.0 kB/s 2023-10-07T09:01:08.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.433 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.489 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6596e-05 s, 0.0 kB/s 2023-10-07T09:01:08.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.601 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1068e-05 s, 0.0 kB/s 2023-10-07T09:01:08.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8706e-05 s, 0.0 kB/s 2023-10-07T09:01:08.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.617 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0528e-05 s, 0.0 kB/s 2023-10-07T09:01:08.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.674 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-07T09:01:08.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.413e-05 s, 0.0 kB/s 2023-10-07T09:01:08.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4745e-05 s, 0.0 kB/s 2023-10-07T09:01:08.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.842 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1752e-05 s, 0.0 kB/s 2023-10-07T09:01:08.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.898 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.7765e-05 s, 0.0 kB/s 2023-10-07T09:01:08.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:08.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.012 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.012 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1415e-05 s, 0.0 kB/s 2023-10-07T09:01:09.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.013 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3352e-05 s, 0.0 kB/s 2023-10-07T09:01:09.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4181e-05 s, 0.0 kB/s 2023-10-07T09:01:09.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.397 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2847e-05 s, 0.0 kB/s 2023-10-07T09:01:09.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.470 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5084e-05 s, 0.0 kB/s 2023-10-07T09:01:09.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0192e-05 s, 0.0 kB/s 2023-10-07T09:01:09.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.584 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2302e-05 s, 0.0 kB/s 2023-10-07T09:01:09.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3862e-05 s, 0.0 kB/s 2023-10-07T09:01:09.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5332e-05 s, 0.0 kB/s 2023-10-07T09:01:09.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7409e-05 s, 0.0 kB/s 2023-10-07T09:01:09.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2166e-05 s, 0.0 kB/s 2023-10-07T09:01:09.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2096e-05 s, 0.0 kB/s 2023-10-07T09:01:09.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.921 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1935e-05 s, 0.0 kB/s 2023-10-07T09:01:09.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.921 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:09.978 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:09.978 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:09.978 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5151e-05 s, 0.0 kB/s 2023-10-07T09:01:09.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:09.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.034 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3886e-05 s, 0.0 kB/s 2023-10-07T09:01:10.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.035 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4493e-05 s, 0.0 kB/s 2023-10-07T09:01:10.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-07T09:01:10.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1509e-05 s, 0.0 kB/s 2023-10-07T09:01:10.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4358e-05 s, 0.0 kB/s 2023-10-07T09:01:10.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.315 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.315 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.315 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1317e-05 s, 0.0 kB/s 2023-10-07T09:01:10.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.316 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.371 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101766 s, 0.0 kB/s 2023-10-07T09:01:10.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.429 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2497e-05 s, 0.0 kB/s 2023-10-07T09:01:10.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5165e-05 s, 0.0 kB/s 2023-10-07T09:01:10.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2809e-05 s, 0.0 kB/s 2023-10-07T09:01:10.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.541 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0002e-05 s, 0.0 kB/s 2023-10-07T09:01:10.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.597 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.653 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2323e-05 s, 0.0 kB/s 2023-10-07T09:01:10.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.385e-05 s, 0.0 kB/s 2023-10-07T09:01:10.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.709 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.766 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3304e-05 s, 0.0 kB/s 2023-10-07T09:01:10.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.766 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.822 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.822 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6127e-05 s, 0.0 kB/s 2023-10-07T09:01:10.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.822 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.878 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.878 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.878 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7476e-05 s, 0.0 kB/s 2023-10-07T09:01:10.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.878 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.933 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.934 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.3013e-05 s, 0.0 kB/s 2023-10-07T09:01:10.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.934 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.788e-05 s, 0.0 kB/s 2023-10-07T09:01:10.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:10.990 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.755e-05 s, 0.0 kB/s 2023-10-07T09:01:11.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.104 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-07T09:01:11.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.104 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.160 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2333e-05 s, 0.0 kB/s 2023-10-07T09:01:11.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.216 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1151e-05 s, 0.0 kB/s 2023-10-07T09:01:11.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.272 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5679e-05 s, 0.0 kB/s 2023-10-07T09:01:11.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.329 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3422e-05 s, 0.0 kB/s 2023-10-07T09:01:11.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.330 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.385 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.386 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.386 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1356e-05 s, 0.0 kB/s 2023-10-07T09:01:11.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.442 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0139e-05 s, 0.0 kB/s 2023-10-07T09:01:11.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.497 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5059e-05 s, 0.0 kB/s 2023-10-07T09:01:11.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.498 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4147e-05 s, 0.0 kB/s 2023-10-07T09:01:11.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5136e-05 s, 0.0 kB/s 2023-10-07T09:01:11.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.610 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.667 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.667 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.667 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6379e-05 s, 0.0 kB/s 2023-10-07T09:01:11.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.668 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:01:11.723 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.723 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.724 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-07T09:01:11.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:01:11.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.732e-05 s, 0.0 kB/s 2023-10-07T09:01:11.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1099e-05 s, 0.0 kB/s 2023-10-07T09:01:11.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.1309e-05 s, 0.0 kB/s 2023-10-07T09:01:11.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:11.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:11.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:11.950 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4814e-05 s, 0.0 kB/s 2023-10-07T09:01:11.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:11.950 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3472e-05 s, 0.0 kB/s 2023-10-07T09:01:12.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.006 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4263e-05 s, 0.0 kB/s 2023-10-07T09:01:12.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.119 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.746e-05 s, 0.0 kB/s 2023-10-07T09:01:12.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.119 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.176 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9667e-05 s, 0.0 kB/s 2023-10-07T09:01:12.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0047e-05 s, 0.0 kB/s 2023-10-07T09:01:12.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.289 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5397e-05 s, 0.0 kB/s 2023-10-07T09:01:12.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.289 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0243e-05 s, 0.0 kB/s 2023-10-07T09:01:12.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.400 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3527e-05 s, 0.0 kB/s 2023-10-07T09:01:12.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.457 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1199e-05 s, 0.0 kB/s 2023-10-07T09:01:12.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1406e-05 s, 0.0 kB/s 2023-10-07T09:01:12.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5226e-05 s, 0.0 kB/s 2023-10-07T09:01:12.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3832e-05 s, 0.0 kB/s 2023-10-07T09:01:12.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.681 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8289e-05 s, 0.0 kB/s 2023-10-07T09:01:12.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.682 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0323e-05 s, 0.0 kB/s 2023-10-07T09:01:12.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0396e-05 s, 0.0 kB/s 2023-10-07T09:01:12.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.849 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3775e-05 s, 0.0 kB/s 2023-10-07T09:01:12.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.906 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1781e-05 s, 0.0 kB/s 2023-10-07T09:01:12.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:12.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:12.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:12.962 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8395e-05 s, 0.0 kB/s 2023-10-07T09:01:12.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:12.962 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.018 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.393e-05 s, 0.0 kB/s 2023-10-07T09:01:13.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.074 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.158e-05 s, 0.0 kB/s 2023-10-07T09:01:13.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.075 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7196e-05 s, 0.0 kB/s 2023-10-07T09:01:13.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.187 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0378e-05 s, 0.0 kB/s 2023-10-07T09:01:13.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.766e-05 s, 0.0 kB/s 2023-10-07T09:01:13.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2377e-05 s, 0.0 kB/s 2023-10-07T09:01:13.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.356 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106479 s, 0.0 kB/s 2023-10-07T09:01:13.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000118509 s, 0.0 kB/s 2023-10-07T09:01:13.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1207e-05 s, 0.0 kB/s 2023-10-07T09:01:13.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.526 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-07T09:01:13.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.974e-05 s, 0.0 kB/s 2023-10-07T09:01:13.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1802e-05 s, 0.0 kB/s 2023-10-07T09:01:13.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1427e-05 s, 0.0 kB/s 2023-10-07T09:01:13.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.695 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2367e-05 s, 0.0 kB/s 2023-10-07T09:01:13.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.807 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5767e-05 s, 0.0 kB/s 2023-10-07T09:01:13.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.862 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3198e-05 s, 0.0 kB/s 2023-10-07T09:01:13.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1163e-05 s, 0.0 kB/s 2023-10-07T09:01:13.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:13.974 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:13.974 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:13.975 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0969e-05 s, 0.0 kB/s 2023-10-07T09:01:13.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:13.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4165e-05 s, 0.0 kB/s 2023-10-07T09:01:14.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2669e-05 s, 0.0 kB/s 2023-10-07T09:01:14.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3863e-05 s, 0.0 kB/s 2023-10-07T09:01:14.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3052e-05 s, 0.0 kB/s 2023-10-07T09:01:14.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1598e-05 s, 0.0 kB/s 2023-10-07T09:01:14.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4963e-05 s, 0.0 kB/s 2023-10-07T09:01:14.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.315 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.371 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9521e-05 s, 0.0 kB/s 2023-10-07T09:01:14.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9306e-05 s, 0.0 kB/s 2023-10-07T09:01:14.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.428 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3383e-05 s, 0.0 kB/s 2023-10-07T09:01:14.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.124e-05 s, 0.0 kB/s 2023-10-07T09:01:14.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.597 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3242e-05 s, 0.0 kB/s 2023-10-07T09:01:14.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1626e-05 s, 0.0 kB/s 2023-10-07T09:01:14.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.655 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.710 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8753e-05 s, 0.0 kB/s 2023-10-07T09:01:14.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.767 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3159e-05 s, 0.0 kB/s 2023-10-07T09:01:14.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1258e-05 s, 0.0 kB/s 2023-10-07T09:01:14.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8816e-05 s, 0.0 kB/s 2023-10-07T09:01:14.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.935 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2557e-05 s, 0.0 kB/s 2023-10-07T09:01:14.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.935 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1542e-05 s, 0.0 kB/s 2023-10-07T09:01:14.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:14.992 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1211e-05 s, 0.0 kB/s 2023-10-07T09:01:15.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000110125 s, 0.0 kB/s 2023-10-07T09:01:15.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.104 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.159 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.159 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.159 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1231e-05 s, 0.0 kB/s 2023-10-07T09:01:15.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.159 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.215 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.215 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.215 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3272e-05 s, 0.0 kB/s 2023-10-07T09:01:15.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-07T09:01:15.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.272 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.181e-05 s, 0.0 kB/s 2023-10-07T09:01:15.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9224e-05 s, 0.0 kB/s 2023-10-07T09:01:15.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.632e-05 s, 0.0 kB/s 2023-10-07T09:01:15.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.441 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0679e-05 s, 0.0 kB/s 2023-10-07T09:01:15.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.553 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9209e-05 s, 0.0 kB/s 2023-10-07T09:01:15.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4101e-05 s, 0.0 kB/s 2023-10-07T09:01:15.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3631e-05 s, 0.0 kB/s 2023-10-07T09:01:15.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.091e-05 s, 0.0 kB/s 2023-10-07T09:01:15.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1732e-05 s, 0.0 kB/s 2023-10-07T09:01:15.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.833 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.833 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.833 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-07T09:01:15.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.834 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.889 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.890 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-07T09:01:15.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.890 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:15.946 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:15.946 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:15.946 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2565e-05 s, 0.0 kB/s 2023-10-07T09:01:15.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:15.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5983e-05 s, 0.0 kB/s 2023-10-07T09:01:16.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.003 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1747e-05 s, 0.0 kB/s 2023-10-07T09:01:16.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3194e-05 s, 0.0 kB/s 2023-10-07T09:01:16.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0647e-05 s, 0.0 kB/s 2023-10-07T09:01:16.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.173 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0239e-05 s, 0.0 kB/s 2023-10-07T09:01:16.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.229 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.284 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2703e-05 s, 0.0 kB/s 2023-10-07T09:01:16.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.340 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.340 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.340 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1479e-05 s, 0.0 kB/s 2023-10-07T09:01:16.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3174e-05 s, 0.0 kB/s 2023-10-07T09:01:16.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.454 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3225e-05 s, 0.0 kB/s 2023-10-07T09:01:16.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6079e-05 s, 0.0 kB/s 2023-10-07T09:01:16.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.511 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.287e-05 s, 0.0 kB/s 2023-10-07T09:01:16.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.623 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3079e-05 s, 0.0 kB/s 2023-10-07T09:01:16.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.623 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.679 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3024e-05 s, 0.0 kB/s 2023-10-07T09:01:16.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.679 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.9663e-05 s, 0.0 kB/s 2023-10-07T09:01:16.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.790 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.791 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.791 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2041e-05 s, 0.0 kB/s 2023-10-07T09:01:16.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.791 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.847 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3701e-05 s, 0.0 kB/s 2023-10-07T09:01:16.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.905 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6829e-05 s, 0.0 kB/s 2023-10-07T09:01:16.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.642e-05 s, 0.0 kB/s 2023-10-07T09:01:16.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:16.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3925e-05 s, 0.0 kB/s 2023-10-07T09:01:17.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.077 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2672e-05 s, 0.0 kB/s 2023-10-07T09:01:17.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2908e-05 s, 0.0 kB/s 2023-10-07T09:01:17.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3939e-05 s, 0.0 kB/s 2023-10-07T09:01:17.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.247 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.247 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.247 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1591e-05 s, 0.0 kB/s 2023-10-07T09:01:17.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.305 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5836e-05 s, 0.0 kB/s 2023-10-07T09:01:17.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.362 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.865e-05 s, 0.0 kB/s 2023-10-07T09:01:17.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.362 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1202e-05 s, 0.0 kB/s 2023-10-07T09:01:17.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.475 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3436e-05 s, 0.0 kB/s 2023-10-07T09:01:17.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.531 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101196 s, 0.0 kB/s 2023-10-07T09:01:17.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.531 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3189e-05 s, 0.0 kB/s 2023-10-07T09:01:17.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.587 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.643 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4079e-05 s, 0.0 kB/s 2023-10-07T09:01:17.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.643 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.699 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5716e-05 s, 0.0 kB/s 2023-10-07T09:01:17.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4416e-05 s, 0.0 kB/s 2023-10-07T09:01:17.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.756 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-07T09:01:17.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1654e-05 s, 0.0 kB/s 2023-10-07T09:01:17.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8139e-05 s, 0.0 kB/s 2023-10-07T09:01:17.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:17.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:17.982 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:17.982 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4883e-05 s, 0.0 kB/s 2023-10-07T09:01:17.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:17.982 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.038 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1211e-05 s, 0.0 kB/s 2023-10-07T09:01:18.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3341e-05 s, 0.0 kB/s 2023-10-07T09:01:18.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0508e-05 s, 0.0 kB/s 2023-10-07T09:01:18.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.151 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.445e-05 s, 0.0 kB/s 2023-10-07T09:01:18.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.266 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1764e-05 s, 0.0 kB/s 2023-10-07T09:01:18.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4532e-05 s, 0.0 kB/s 2023-10-07T09:01:18.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.379 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-07T09:01:18.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2414e-05 s, 0.0 kB/s 2023-10-07T09:01:18.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.492 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.492 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.492 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1556e-05 s, 0.0 kB/s 2023-10-07T09:01:18.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.493 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0799e-05 s, 0.0 kB/s 2023-10-07T09:01:18.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.550 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9469e-05 s, 0.0 kB/s 2023-10-07T09:01:18.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.606 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.663 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5047e-05 s, 0.0 kB/s 2023-10-07T09:01:18.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.663 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.720 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6831e-05 s, 0.0 kB/s 2023-10-07T09:01:18.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0598e-05 s, 0.0 kB/s 2023-10-07T09:01:18.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9728e-05 s, 0.0 kB/s 2023-10-07T09:01:18.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.889 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.889 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.889 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3617e-05 s, 0.0 kB/s 2023-10-07T09:01:18.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.889 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:18.945 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2535e-05 s, 0.0 kB/s 2023-10-07T09:01:18.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:18.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1793e-05 s, 0.0 kB/s 2023-10-07T09:01:19.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.002 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.059 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-07T09:01:19.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1223e-05 s, 0.0 kB/s 2023-10-07T09:01:19.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.172 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1842e-05 s, 0.0 kB/s 2023-10-07T09:01:19.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.172 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3367e-05 s, 0.0 kB/s 2023-10-07T09:01:19.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1216e-05 s, 0.0 kB/s 2023-10-07T09:01:19.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.284 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-07T09:01:19.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.397 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0775e-05 s, 0.0 kB/s 2023-10-07T09:01:19.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.453 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3599e-05 s, 0.0 kB/s 2023-10-07T09:01:19.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.510 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1073e-05 s, 0.0 kB/s 2023-10-07T09:01:19.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.511 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3249e-05 s, 0.0 kB/s 2023-10-07T09:01:19.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-07T09:01:19.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4675e-05 s, 0.0 kB/s 2023-10-07T09:01:19.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7569e-05 s, 0.0 kB/s 2023-10-07T09:01:19.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.736 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.2914e-05 s, 0.0 kB/s 2023-10-07T09:01:19.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.848 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.849 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1501e-05 s, 0.0 kB/s 2023-10-07T09:01:19.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.849 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7066e-05 s, 0.0 kB/s 2023-10-07T09:01:19.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.905 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:19.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:19.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:19.962 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-07T09:01:19.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:19.962 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.019 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1025e-05 s, 0.0 kB/s 2023-10-07T09:01:20.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2274e-05 s, 0.0 kB/s 2023-10-07T09:01:20.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2177e-05 s, 0.0 kB/s 2023-10-07T09:01:20.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1593e-05 s, 0.0 kB/s 2023-10-07T09:01:20.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4946e-05 s, 0.0 kB/s 2023-10-07T09:01:20.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8919e-05 s, 0.0 kB/s 2023-10-07T09:01:20.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2261e-05 s, 0.0 kB/s 2023-10-07T09:01:20.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2108e-05 s, 0.0 kB/s 2023-10-07T09:01:20.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.417 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7408e-05 s, 0.0 kB/s 2023-10-07T09:01:20.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.531 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000120489 s, 0.0 kB/s 2023-10-07T09:01:20.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.532 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-07T09:01:20.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.589 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.646 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0882e-05 s, 0.0 kB/s 2023-10-07T09:01:20.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4382e-05 s, 0.0 kB/s 2023-10-07T09:01:20.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.703 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.759 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1684e-05 s, 0.0 kB/s 2023-10-07T09:01:20.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.816 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.816 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.816 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0457e-05 s, 0.0 kB/s 2023-10-07T09:01:20.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.817 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.873 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1936e-05 s, 0.0 kB/s 2023-10-07T09:01:20.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.874 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1659e-05 s, 0.0 kB/s 2023-10-07T09:01:20.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:20.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:20.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:20.987 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3926e-05 s, 0.0 kB/s 2023-10-07T09:01:20.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:20.988 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5051e-05 s, 0.0 kB/s 2023-10-07T09:01:21.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0715e-05 s, 0.0 kB/s 2023-10-07T09:01:21.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.101 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9553e-05 s, 0.0 kB/s 2023-10-07T09:01:21.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.157 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.035e-05 s, 0.0 kB/s 2023-10-07T09:01:21.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.213 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1555e-05 s, 0.0 kB/s 2023-10-07T09:01:21.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.270 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000103036 s, 0.0 kB/s 2023-10-07T09:01:21.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1201e-05 s, 0.0 kB/s 2023-10-07T09:01:21.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.382 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.439 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9306e-05 s, 0.0 kB/s 2023-10-07T09:01:21.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.439 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.497 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5703e-05 s, 0.0 kB/s 2023-10-07T09:01:21.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.553 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1296e-05 s, 0.0 kB/s 2023-10-07T09:01:21.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9359e-05 s, 0.0 kB/s 2023-10-07T09:01:21.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-07T09:01:21.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2826e-05 s, 0.0 kB/s 2023-10-07T09:01:21.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1054e-05 s, 0.0 kB/s 2023-10-07T09:01:21.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.834 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9776e-05 s, 0.0 kB/s 2023-10-07T09:01:21.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.834 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.891 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.891 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3032e-05 s, 0.0 kB/s 2023-10-07T09:01:21.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4598e-05 s, 0.0 kB/s 2023-10-07T09:01:21.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:21.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2514e-05 s, 0.0 kB/s 2023-10-07T09:01:22.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.005 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1535e-05 s, 0.0 kB/s 2023-10-07T09:01:22.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.061 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.118 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.118 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5104e-05 s, 0.0 kB/s 2023-10-07T09:01:22.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.174 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2729e-05 s, 0.0 kB/s 2023-10-07T09:01:22.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.174 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.231 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.231 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.231 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3975e-05 s, 0.0 kB/s 2023-10-07T09:01:22.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.231 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100236 s, 0.0 kB/s 2023-10-07T09:01:22.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.287 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.343 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.343 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3613e-05 s, 0.0 kB/s 2023-10-07T09:01:22.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.344 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.400 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7567e-05 s, 0.0 kB/s 2023-10-07T09:01:22.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-07T09:01:22.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.515 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.515 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.515 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3409e-05 s, 0.0 kB/s 2023-10-07T09:01:22.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.515 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.572 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.572 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.572 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4393e-05 s, 0.0 kB/s 2023-10-07T09:01:22.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.573 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.629 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1248e-05 s, 0.0 kB/s 2023-10-07T09:01:22.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.629 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.686 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6618e-05 s, 0.0 kB/s 2023-10-07T09:01:22.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.743 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.743 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.744 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5602e-05 s, 0.0 kB/s 2023-10-07T09:01:22.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.744 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.800 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0608e-05 s, 0.0 kB/s 2023-10-07T09:01:22.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.800 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1196e-05 s, 0.0 kB/s 2023-10-07T09:01:22.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.858 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.915 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5631e-05 s, 0.0 kB/s 2023-10-07T09:01:22.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4331e-05 s, 0.0 kB/s 2023-10-07T09:01:22.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:22.973 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.029 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3448e-05 s, 0.0 kB/s 2023-10-07T09:01:23.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.085 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.085 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.086 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2084e-05 s, 0.0 kB/s 2023-10-07T09:01:23.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.086 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1636e-05 s, 0.0 kB/s 2023-10-07T09:01:23.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.142 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.199 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.199 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.199 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-07T09:01:23.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.200 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7273e-05 s, 0.0 kB/s 2023-10-07T09:01:23.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0374e-05 s, 0.0 kB/s 2023-10-07T09:01:23.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.313 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7361e-05 s, 0.0 kB/s 2023-10-07T09:01:23.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.369 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3563e-05 s, 0.0 kB/s 2023-10-07T09:01:23.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.426 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.483 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.483 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.483 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8166e-05 s, 0.0 kB/s 2023-10-07T09:01:23.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1974e-05 s, 0.0 kB/s 2023-10-07T09:01:23.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.596 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2309e-05 s, 0.0 kB/s 2023-10-07T09:01:23.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.596 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4722e-05 s, 0.0 kB/s 2023-10-07T09:01:23.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3573e-05 s, 0.0 kB/s 2023-10-07T09:01:23.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1157e-05 s, 0.0 kB/s 2023-10-07T09:01:23.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.672e-05 s, 0.0 kB/s 2023-10-07T09:01:23.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.824 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.880 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3398e-05 s, 0.0 kB/s 2023-10-07T09:01:23.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.936 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.18e-05 s, 0.0 kB/s 2023-10-07T09:01:23.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.937 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4077e-05 s, 0.0 kB/s 2023-10-07T09:01:23.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:23.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.049 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.244e-05 s, 0.0 kB/s 2023-10-07T09:01:24.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.8437e-05 s, 0.0 kB/s 2023-10-07T09:01:24.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.163 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-07T09:01:24.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.164 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.220 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.220 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.220 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0728e-05 s, 0.0 kB/s 2023-10-07T09:01:24.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.221 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.276 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.277 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0246e-05 s, 0.0 kB/s 2023-10-07T09:01:24.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.277 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.332 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.332 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.333 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-07T09:01:24.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.333 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1019e-05 s, 0.0 kB/s 2023-10-07T09:01:24.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.445 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-07T09:01:24.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.446 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.502 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.502 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.502 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.198e-05 s, 0.0 kB/s 2023-10-07T09:01:24.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-07T09:01:24.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.616 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2569e-05 s, 0.0 kB/s 2023-10-07T09:01:24.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.616 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104177 s, 0.0 kB/s 2023-10-07T09:01:24.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.672 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.728 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.728 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.728 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4122e-05 s, 0.0 kB/s 2023-10-07T09:01:24.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.729 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4218e-05 s, 0.0 kB/s 2023-10-07T09:01:24.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2101e-05 s, 0.0 kB/s 2023-10-07T09:01:24.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.842 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.898 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.612e-05 s, 0.0 kB/s 2023-10-07T09:01:24.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.899 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1362e-05 s, 0.0 kB/s 2023-10-07T09:01:24.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:24.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.013 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0866e-05 s, 0.0 kB/s 2023-10-07T09:01:25.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.071 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000102175 s, 0.0 kB/s 2023-10-07T09:01:25.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4752e-05 s, 0.0 kB/s 2023-10-07T09:01:25.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0379e-05 s, 0.0 kB/s 2023-10-07T09:01:25.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.185 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6286e-05 s, 0.0 kB/s 2023-10-07T09:01:25.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.243 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3678e-05 s, 0.0 kB/s 2023-10-07T09:01:25.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-07T09:01:25.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1834e-05 s, 0.0 kB/s 2023-10-07T09:01:25.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3164e-05 s, 0.0 kB/s 2023-10-07T09:01:25.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.525 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0718e-05 s, 0.0 kB/s 2023-10-07T09:01:25.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2069e-05 s, 0.0 kB/s 2023-10-07T09:01:25.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.638 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2858e-05 s, 0.0 kB/s 2023-10-07T09:01:25.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1866e-05 s, 0.0 kB/s 2023-10-07T09:01:25.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1995e-05 s, 0.0 kB/s 2023-10-07T09:01:25.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5157e-05 s, 0.0 kB/s 2023-10-07T09:01:25.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5549e-05 s, 0.0 kB/s 2023-10-07T09:01:25.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9756e-05 s, 0.0 kB/s 2023-10-07T09:01:25.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.923 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:25.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:25.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:25.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0469e-05 s, 0.0 kB/s 2023-10-07T09:01:25.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:25.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1816e-05 s, 0.0 kB/s 2023-10-07T09:01:26.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.095 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0419e-05 s, 0.0 kB/s 2023-10-07T09:01:26.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104199 s, 0.0 kB/s 2023-10-07T09:01:26.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.207 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.207 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.208 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3299e-05 s, 0.0 kB/s 2023-10-07T09:01:26.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.208 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.264 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4064e-05 s, 0.0 kB/s 2023-10-07T09:01:26.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.264 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.319 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.319 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.319 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2262e-05 s, 0.0 kB/s 2023-10-07T09:01:26.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.320 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.375 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.375 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.375 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1489e-05 s, 0.0 kB/s 2023-10-07T09:01:26.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.0489e-05 s, 0.0 kB/s 2023-10-07T09:01:26.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.432 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8389e-05 s, 0.0 kB/s 2023-10-07T09:01:26.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0681e-05 s, 0.0 kB/s 2023-10-07T09:01:26.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0338e-05 s, 0.0 kB/s 2023-10-07T09:01:26.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3582e-05 s, 0.0 kB/s 2023-10-07T09:01:26.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.658 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9905e-05 s, 0.0 kB/s 2023-10-07T09:01:26.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2137e-05 s, 0.0 kB/s 2023-10-07T09:01:26.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2793e-05 s, 0.0 kB/s 2023-10-07T09:01:26.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3516e-05 s, 0.0 kB/s 2023-10-07T09:01:26.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7161e-05 s, 0.0 kB/s 2023-10-07T09:01:26.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3489e-05 s, 0.0 kB/s 2023-10-07T09:01:26.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:26.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.052 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2714e-05 s, 0.0 kB/s 2023-10-07T09:01:27.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.108 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-07T09:01:27.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.108 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.164 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.164 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.681e-05 s, 0.0 kB/s 2023-10-07T09:01:27.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.164 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.219 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9706e-05 s, 0.0 kB/s 2023-10-07T09:01:27.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.278 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6326e-05 s, 0.0 kB/s 2023-10-07T09:01:27.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9829e-05 s, 0.0 kB/s 2023-10-07T09:01:27.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.389 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-07T09:01:27.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.445 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5592e-05 s, 0.0 kB/s 2023-10-07T09:01:27.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.446 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.503 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1293e-05 s, 0.0 kB/s 2023-10-07T09:01:27.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.559 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3937e-05 s, 0.0 kB/s 2023-10-07T09:01:27.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.559 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1159e-05 s, 0.0 kB/s 2023-10-07T09:01:27.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.615 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3544e-05 s, 0.0 kB/s 2023-10-07T09:01:27.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.672 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104405 s, 0.0 kB/s 2023-10-07T09:01:27.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.786 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5356e-05 s, 0.0 kB/s 2023-10-07T09:01:27.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.787 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.843 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.843 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.843 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000112279 s, 0.0 kB/s 2023-10-07T09:01:27.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9516e-05 s, 0.0 kB/s 2023-10-07T09:01:27.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:27.956 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:27.956 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:27.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.404e-05 s, 0.0 kB/s 2023-10-07T09:01:27.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:27.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.012 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.013 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5365e-05 s, 0.0 kB/s 2023-10-07T09:01:28.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.013 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7359e-05 s, 0.0 kB/s 2023-10-07T09:01:28.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.224e-05 s, 0.0 kB/s 2023-10-07T09:01:28.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.126 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.181 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.181 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.181 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-07T09:01:28.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.182 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.238 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.238 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.238 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3073e-05 s, 0.0 kB/s 2023-10-07T09:01:28.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.238 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.383 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-07T09:01:28.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.932e-05 s, 0.0 kB/s 2023-10-07T09:01:28.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6779e-05 s, 0.0 kB/s 2023-10-07T09:01:28.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6343e-05 s, 0.0 kB/s 2023-10-07T09:01:28.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.570 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.570 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3001e-05 s, 0.0 kB/s 2023-10-07T09:01:28.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5506e-05 s, 0.0 kB/s 2023-10-07T09:01:28.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5672e-05 s, 0.0 kB/s 2023-10-07T09:01:28.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.738 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1953e-05 s, 0.0 kB/s 2023-10-07T09:01:28.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.740 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0615e-05 s, 0.0 kB/s 2023-10-07T09:01:28.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1943e-05 s, 0.0 kB/s 2023-10-07T09:01:28.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.854 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.910 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.910 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-07T09:01:28.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:28.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:28.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:28.966 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2713e-05 s, 0.0 kB/s 2023-10-07T09:01:28.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:28.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.022 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.022 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.022 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0546e-05 s, 0.0 kB/s 2023-10-07T09:01:29.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.022 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1747e-05 s, 0.0 kB/s 2023-10-07T09:01:29.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1829e-05 s, 0.0 kB/s 2023-10-07T09:01:29.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.189 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104933 s, 0.0 kB/s 2023-10-07T09:01:29.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2672e-05 s, 0.0 kB/s 2023-10-07T09:01:29.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.303 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2563e-05 s, 0.0 kB/s 2023-10-07T09:01:29.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.303 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2384e-05 s, 0.0 kB/s 2023-10-07T09:01:29.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3539e-05 s, 0.0 kB/s 2023-10-07T09:01:29.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3363e-05 s, 0.0 kB/s 2023-10-07T09:01:29.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.212e-05 s, 0.0 kB/s 2023-10-07T09:01:29.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0186e-05 s, 0.0 kB/s 2023-10-07T09:01:29.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5103e-05 s, 0.0 kB/s 2023-10-07T09:01:29.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.696 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4976e-05 s, 0.0 kB/s 2023-10-07T09:01:29.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3352e-05 s, 0.0 kB/s 2023-10-07T09:01:29.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6436e-05 s, 0.0 kB/s 2023-10-07T09:01:29.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0436e-05 s, 0.0 kB/s 2023-10-07T09:01:29.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6286e-05 s, 0.0 kB/s 2023-10-07T09:01:29.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.923 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:29.978 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:29.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:29.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-07T09:01:29.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:29.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7515e-05 s, 0.0 kB/s 2023-10-07T09:01:30.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.035 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-07T09:01:30.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7919e-05 s, 0.0 kB/s 2023-10-07T09:01:30.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1831e-05 s, 0.0 kB/s 2023-10-07T09:01:30.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.261 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-07T09:01:30.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0035e-05 s, 0.0 kB/s 2023-10-07T09:01:30.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3101e-05 s, 0.0 kB/s 2023-10-07T09:01:30.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4003e-05 s, 0.0 kB/s 2023-10-07T09:01:30.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.430 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.294e-05 s, 0.0 kB/s 2023-10-07T09:01:30.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.542 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.0815e-05 s, 0.0 kB/s 2023-10-07T09:01:30.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4883e-05 s, 0.0 kB/s 2023-10-07T09:01:30.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.654 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0482e-05 s, 0.0 kB/s 2023-10-07T09:01:30.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.655 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8645e-05 s, 0.0 kB/s 2023-10-07T09:01:30.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.766 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.766 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1128e-05 s, 0.0 kB/s 2023-10-07T09:01:30.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.543e-05 s, 0.0 kB/s 2023-10-07T09:01:30.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4519e-05 s, 0.0 kB/s 2023-10-07T09:01:30.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.935 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4087e-05 s, 0.0 kB/s 2023-10-07T09:01:30.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:30.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2708e-05 s, 0.0 kB/s 2023-10-07T09:01:30.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:30.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.755e-05 s, 0.0 kB/s 2023-10-07T09:01:31.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.049 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1558e-05 s, 0.0 kB/s 2023-10-07T09:01:31.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.161 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6734e-05 s, 0.0 kB/s 2023-10-07T09:01:31.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.162 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.217 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1524e-05 s, 0.0 kB/s 2023-10-07T09:01:31.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.218 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.274 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.274 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.274 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2058e-05 s, 0.0 kB/s 2023-10-07T09:01:31.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.275 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.330 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7252e-05 s, 0.0 kB/s 2023-10-07T09:01:31.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3186e-05 s, 0.0 kB/s 2023-10-07T09:01:31.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.388 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.443 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.444 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.444 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104602 s, 0.0 kB/s 2023-10-07T09:01:31.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.444 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2623e-05 s, 0.0 kB/s 2023-10-07T09:01:31.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.500 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1459e-05 s, 0.0 kB/s 2023-10-07T09:01:31.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.557 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3677e-05 s, 0.0 kB/s 2023-10-07T09:01:31.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9823e-05 s, 0.0 kB/s 2023-10-07T09:01:31.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.669 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1484e-05 s, 0.0 kB/s 2023-10-07T09:01:31.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.726 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.121e-05 s, 0.0 kB/s 2023-10-07T09:01:31.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2217e-05 s, 0.0 kB/s 2023-10-07T09:01:31.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.839 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5276e-05 s, 0.0 kB/s 2023-10-07T09:01:31.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0199e-05 s, 0.0 kB/s 2023-10-07T09:01:31.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:31.952 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.008 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.008 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.008 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-07T09:01:32.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.009 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.064 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1122e-05 s, 0.0 kB/s 2023-10-07T09:01:32.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.065 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4578e-05 s, 0.0 kB/s 2023-10-07T09:01:32.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4626e-05 s, 0.0 kB/s 2023-10-07T09:01:32.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1722e-05 s, 0.0 kB/s 2023-10-07T09:01:32.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.289 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0245e-05 s, 0.0 kB/s 2023-10-07T09:01:32.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.290 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-07T09:01:32.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.346 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.402 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0999e-05 s, 0.0 kB/s 2023-10-07T09:01:32.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.403 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7222e-05 s, 0.0 kB/s 2023-10-07T09:01:32.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.515 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.516 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.516 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6016e-05 s, 0.0 kB/s 2023-10-07T09:01:32.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.516 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.571 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.571 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.571 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7279e-05 s, 0.0 kB/s 2023-10-07T09:01:32.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.572 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1613e-05 s, 0.0 kB/s 2023-10-07T09:01:32.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.628 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.684 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4052e-05 s, 0.0 kB/s 2023-10-07T09:01:32.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-07T09:01:32.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2308e-05 s, 0.0 kB/s 2023-10-07T09:01:32.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.853 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.853 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1733e-05 s, 0.0 kB/s 2023-10-07T09:01:32.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.908 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.261e-05 s, 0.0 kB/s 2023-10-07T09:01:32.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:32.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:32.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:32.964 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.5166e-05 s, 0.0 kB/s 2023-10-07T09:01:32.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:32.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.021 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.354e-05 s, 0.0 kB/s 2023-10-07T09:01:33.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3057e-05 s, 0.0 kB/s 2023-10-07T09:01:33.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9203e-05 s, 0.0 kB/s 2023-10-07T09:01:33.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3997e-05 s, 0.0 kB/s 2023-10-07T09:01:33.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1788e-05 s, 0.0 kB/s 2023-10-07T09:01:33.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1329e-05 s, 0.0 kB/s 2023-10-07T09:01:33.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.303 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.358 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5559e-05 s, 0.0 kB/s 2023-10-07T09:01:33.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9815e-05 s, 0.0 kB/s 2023-10-07T09:01:33.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.416 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0829e-05 s, 0.0 kB/s 2023-10-07T09:01:33.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6883e-05 s, 0.0 kB/s 2023-10-07T09:01:33.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.586 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0793e-05 s, 0.0 kB/s 2023-10-07T09:01:33.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.586 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.640 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.641 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.7696e-05 s, 0.0 kB/s 2023-10-07T09:01:33.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.642 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.700 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6346e-05 s, 0.0 kB/s 2023-10-07T09:01:33.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6778e-05 s, 0.0 kB/s 2023-10-07T09:01:33.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.757 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2142e-05 s, 0.0 kB/s 2023-10-07T09:01:33.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.373e-05 s, 0.0 kB/s 2023-10-07T09:01:33.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.870 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.925 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6769e-05 s, 0.0 kB/s 2023-10-07T09:01:33.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-07T09:01:33.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:33.983 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6035e-05 s, 0.0 kB/s 2023-10-07T09:01:34.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.095 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1774e-05 s, 0.0 kB/s 2023-10-07T09:01:34.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.152 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.152 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.152 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-07T09:01:34.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0856e-05 s, 0.0 kB/s 2023-10-07T09:01:34.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8366e-05 s, 0.0 kB/s 2023-10-07T09:01:34.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.178e-05 s, 0.0 kB/s 2023-10-07T09:01:34.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.322 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.379 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5997e-05 s, 0.0 kB/s 2023-10-07T09:01:34.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6349e-05 s, 0.0 kB/s 2023-10-07T09:01:34.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.435 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5749e-05 s, 0.0 kB/s 2023-10-07T09:01:34.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7422e-05 s, 0.0 kB/s 2023-10-07T09:01:34.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9579e-05 s, 0.0 kB/s 2023-10-07T09:01:34.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.661 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.661 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.661 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9982e-05 s, 0.0 kB/s 2023-10-07T09:01:34.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.661 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2409e-05 s, 0.0 kB/s 2023-10-07T09:01:34.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.719 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1768e-05 s, 0.0 kB/s 2023-10-07T09:01:34.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.775 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.832 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000114875 s, 0.0 kB/s 2023-10-07T09:01:34.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0248e-05 s, 0.0 kB/s 2023-10-07T09:01:34.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.448e-05 s, 0.0 kB/s 2023-10-07T09:01:34.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:34.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.001 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.001 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.001 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4876e-05 s, 0.0 kB/s 2023-10-07T09:01:35.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.001 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4335e-05 s, 0.0 kB/s 2023-10-07T09:01:35.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.058 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.115 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2483e-05 s, 0.0 kB/s 2023-10-07T09:01:35.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.171 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1547e-05 s, 0.0 kB/s 2023-10-07T09:01:35.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1683e-05 s, 0.0 kB/s 2023-10-07T09:01:35.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9276e-05 s, 0.0 kB/s 2023-10-07T09:01:35.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.284 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.339 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1612e-05 s, 0.0 kB/s 2023-10-07T09:01:35.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.396 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1169e-05 s, 0.0 kB/s 2023-10-07T09:01:35.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.396 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.452 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0303e-05 s, 0.0 kB/s 2023-10-07T09:01:35.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2236e-05 s, 0.0 kB/s 2023-10-07T09:01:35.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.566 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.566 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000133568 s, 0.0 kB/s 2023-10-07T09:01:35.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.622 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.439e-05 s, 0.0 kB/s 2023-10-07T09:01:35.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.623 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0765e-05 s, 0.0 kB/s 2023-10-07T09:01:35.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.679 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1884e-05 s, 0.0 kB/s 2023-10-07T09:01:35.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.791 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.791 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1339e-05 s, 0.0 kB/s 2023-10-07T09:01:35.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5289e-05 s, 0.0 kB/s 2023-10-07T09:01:35.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3124e-05 s, 0.0 kB/s 2023-10-07T09:01:35.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.904 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3492e-05 s, 0.0 kB/s 2023-10-07T09:01:35.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:35.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.017 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5498e-05 s, 0.0 kB/s 2023-10-07T09:01:36.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.018 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.073 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5363e-05 s, 0.0 kB/s 2023-10-07T09:01:36.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.073 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000123399 s, 0.0 kB/s 2023-10-07T09:01:36.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.130 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.186 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2322e-05 s, 0.0 kB/s 2023-10-07T09:01:36.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.244 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5886e-05 s, 0.0 kB/s 2023-10-07T09:01:36.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.300 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0573e-05 s, 0.0 kB/s 2023-10-07T09:01:36.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.355 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.355 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.355 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3318e-05 s, 0.0 kB/s 2023-10-07T09:01:36.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.356 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.412 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6083e-05 s, 0.0 kB/s 2023-10-07T09:01:36.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.469 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.3961e-05 s, 0.0 kB/s 2023-10-07T09:01:36.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.526 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.971e-05 s, 0.0 kB/s 2023-10-07T09:01:36.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9986e-05 s, 0.0 kB/s 2023-10-07T09:01:36.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4859e-05 s, 0.0 kB/s 2023-10-07T09:01:36.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.695 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1937e-05 s, 0.0 kB/s 2023-10-07T09:01:36.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5106e-05 s, 0.0 kB/s 2023-10-07T09:01:36.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0296e-05 s, 0.0 kB/s 2023-10-07T09:01:36.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.866 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9062e-05 s, 0.0 kB/s 2023-10-07T09:01:36.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9909e-05 s, 0.0 kB/s 2023-10-07T09:01:36.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.923 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1478e-05 s, 0.0 kB/s 2023-10-07T09:01:36.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:36.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0166e-05 s, 0.0 kB/s 2023-10-07T09:01:37.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.055 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6107e-05 s, 0.0 kB/s 2023-10-07T09:01:37.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6091e-05 s, 0.0 kB/s 2023-10-07T09:01:37.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9007e-05 s, 0.0 kB/s 2023-10-07T09:01:37.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1212e-05 s, 0.0 kB/s 2023-10-07T09:01:37.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5667e-05 s, 0.0 kB/s 2023-10-07T09:01:37.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1654e-05 s, 0.0 kB/s 2023-10-07T09:01:37.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.429 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8121e-05 s, 0.0 kB/s 2023-10-07T09:01:37.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.486 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1792e-05 s, 0.0 kB/s 2023-10-07T09:01:37.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0712e-05 s, 0.0 kB/s 2023-10-07T09:01:37.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7216e-05 s, 0.0 kB/s 2023-10-07T09:01:37.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.654 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.535e-05 s, 0.0 kB/s 2023-10-07T09:01:37.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.709 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.710 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2445e-05 s, 0.0 kB/s 2023-10-07T09:01:37.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.767 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3606e-05 s, 0.0 kB/s 2023-10-07T09:01:37.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.823 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.823 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-07T09:01:37.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.824 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3836e-05 s, 0.0 kB/s 2023-10-07T09:01:37.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4192e-05 s, 0.0 kB/s 2023-10-07T09:01:37.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:37.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1427e-05 s, 0.0 kB/s 2023-10-07T09:01:37.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:37.992 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9873e-05 s, 0.0 kB/s 2023-10-07T09:01:38.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9439e-05 s, 0.0 kB/s 2023-10-07T09:01:38.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2482e-05 s, 0.0 kB/s 2023-10-07T09:01:38.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5756e-05 s, 0.0 kB/s 2023-10-07T09:01:38.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.273 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.273 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0809e-05 s, 0.0 kB/s 2023-10-07T09:01:38.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.328 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.328 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.328 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0935e-05 s, 0.0 kB/s 2023-10-07T09:01:38.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.329 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9646e-05 s, 0.0 kB/s 2023-10-07T09:01:38.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.385 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.441 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.7885e-05 s, 0.0 kB/s 2023-10-07T09:01:38.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5063e-05 s, 0.0 kB/s 2023-10-07T09:01:38.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.498 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.553 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.03e-05 s, 0.0 kB/s 2023-10-07T09:01:38.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4152e-05 s, 0.0 kB/s 2023-10-07T09:01:38.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.610 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.666 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.666 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.666 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.911e-05 s, 0.0 kB/s 2023-10-07T09:01:38.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.666 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.5527e-05 s, 0.0 kB/s 2023-10-07T09:01:38.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.722 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3444e-05 s, 0.0 kB/s 2023-10-07T09:01:38.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.296e-05 s, 0.0 kB/s 2023-10-07T09:01:38.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.834 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.889 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.890 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0569e-05 s, 0.0 kB/s 2023-10-07T09:01:38.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:38.945 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:38.945 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:38.946 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1233e-05 s, 0.0 kB/s 2023-10-07T09:01:38.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:38.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.003 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1492e-05 s, 0.0 kB/s 2023-10-07T09:01:39.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.060 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3022e-05 s, 0.0 kB/s 2023-10-07T09:01:39.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.116 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.116 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.117 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0618e-05 s, 0.0 kB/s 2023-10-07T09:01:39.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.117 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1166e-05 s, 0.0 kB/s 2023-10-07T09:01:39.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.173 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.229 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.229 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.230 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5409e-05 s, 0.0 kB/s 2023-10-07T09:01:39.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.230 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3836e-05 s, 0.0 kB/s 2023-10-07T09:01:39.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-07T09:01:39.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.343 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.399 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6516e-05 s, 0.0 kB/s 2023-10-07T09:01:39.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4872e-05 s, 0.0 kB/s 2023-10-07T09:01:39.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.455 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-07T09:01:39.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9606e-05 s, 0.0 kB/s 2023-10-07T09:01:39.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5796e-05 s, 0.0 kB/s 2023-10-07T09:01:39.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3253e-05 s, 0.0 kB/s 2023-10-07T09:01:39.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9306e-05 s, 0.0 kB/s 2023-10-07T09:01:39.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.797 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.797 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.797 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6075e-05 s, 0.0 kB/s 2023-10-07T09:01:39.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.798 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.854 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.854 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.854 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2439e-05 s, 0.0 kB/s 2023-10-07T09:01:39.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.854 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.911 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4832e-05 s, 0.0 kB/s 2023-10-07T09:01:39.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4425e-05 s, 0.0 kB/s 2023-10-07T09:01:39.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:39.967 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.023 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.485e-05 s, 0.0 kB/s 2023-10-07T09:01:40.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.024 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.080 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5856e-05 s, 0.0 kB/s 2023-10-07T09:01:40.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.080 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.136 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5563e-05 s, 0.0 kB/s 2023-10-07T09:01:40.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3972e-05 s, 0.0 kB/s 2023-10-07T09:01:40.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.193 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.248 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5086e-05 s, 0.0 kB/s 2023-10-07T09:01:40.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.249 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-07T09:01:40.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.361 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2404e-05 s, 0.0 kB/s 2023-10-07T09:01:40.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.362 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.418 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4187e-05 s, 0.0 kB/s 2023-10-07T09:01:40.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.473 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.474 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3724e-05 s, 0.0 kB/s 2023-10-07T09:01:40.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0619e-05 s, 0.0 kB/s 2023-10-07T09:01:40.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.531 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.587 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5032e-05 s, 0.0 kB/s 2023-10-07T09:01:40.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.587 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.643 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.643 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.643 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5789e-05 s, 0.0 kB/s 2023-10-07T09:01:40.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.644 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.699 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.700 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.735e-05 s, 0.0 kB/s 2023-10-07T09:01:40.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1876e-05 s, 0.0 kB/s 2023-10-07T09:01:40.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.756 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101303 s, 0.0 kB/s 2023-10-07T09:01:40.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.813 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2308e-05 s, 0.0 kB/s 2023-10-07T09:01:40.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3153e-05 s, 0.0 kB/s 2023-10-07T09:01:40.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4403e-05 s, 0.0 kB/s 2023-10-07T09:01:40.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:40.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5972e-05 s, 0.0 kB/s 2023-10-07T09:01:41.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1246e-05 s, 0.0 kB/s 2023-10-07T09:01:41.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6401e-05 s, 0.0 kB/s 2023-10-07T09:01:41.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1886e-05 s, 0.0 kB/s 2023-10-07T09:01:41.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3466e-05 s, 0.0 kB/s 2023-10-07T09:01:41.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.263 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.3368e-05 s, 0.0 kB/s 2023-10-07T09:01:41.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8731e-05 s, 0.0 kB/s 2023-10-07T09:01:41.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.7812e-05 s, 0.0 kB/s 2023-10-07T09:01:41.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9309e-05 s, 0.0 kB/s 2023-10-07T09:01:41.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6223e-05 s, 0.0 kB/s 2023-10-07T09:01:41.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.543 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0859e-05 s, 0.0 kB/s 2023-10-07T09:01:41.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0932e-05 s, 0.0 kB/s 2023-10-07T09:01:41.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1535e-05 s, 0.0 kB/s 2023-10-07T09:01:41.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4336e-05 s, 0.0 kB/s 2023-10-07T09:01:41.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.769 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:01:41.811 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:01:41.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-07T09:01:41.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.883 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5922e-05 s, 0.0 kB/s 2023-10-07T09:01:41.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4458e-05 s, 0.0 kB/s 2023-10-07T09:01:41.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.941 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:41.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:41.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:41.997 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5461e-05 s, 0.0 kB/s 2023-10-07T09:01:41.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:41.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5303e-05 s, 0.0 kB/s 2023-10-07T09:01:42.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3455e-05 s, 0.0 kB/s 2023-10-07T09:01:42.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4305e-05 s, 0.0 kB/s 2023-10-07T09:01:42.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.222 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6523e-05 s, 0.0 kB/s 2023-10-07T09:01:42.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.7751e-05 s, 0.0 kB/s 2023-10-07T09:01:42.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.336 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3575e-05 s, 0.0 kB/s 2023-10-07T09:01:42.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1372e-05 s, 0.0 kB/s 2023-10-07T09:01:42.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.449 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1761e-05 s, 0.0 kB/s 2023-10-07T09:01:42.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.506 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.197e-05 s, 0.0 kB/s 2023-10-07T09:01:42.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.561 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1218e-05 s, 0.0 kB/s 2023-10-07T09:01:42.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.618 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.618 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.618 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1955e-05 s, 0.0 kB/s 2023-10-07T09:01:42.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0146e-05 s, 0.0 kB/s 2023-10-07T09:01:42.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2325e-05 s, 0.0 kB/s 2023-10-07T09:01:42.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.787 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9605e-05 s, 0.0 kB/s 2023-10-07T09:01:42.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0742e-05 s, 0.0 kB/s 2023-10-07T09:01:42.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9004e-05 s, 0.0 kB/s 2023-10-07T09:01:42.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:42.958 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.964e-05 s, 0.0 kB/s 2023-10-07T09:01:42.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:42.958 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.014 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3353e-05 s, 0.0 kB/s 2023-10-07T09:01:43.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2454e-05 s, 0.0 kB/s 2023-10-07T09:01:43.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9904e-05 s, 0.0 kB/s 2023-10-07T09:01:43.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.185 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.185 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.185 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2749e-05 s, 0.0 kB/s 2023-10-07T09:01:43.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.186 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8923e-05 s, 0.0 kB/s 2023-10-07T09:01:43.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.298 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0394e-05 s, 0.0 kB/s 2023-10-07T09:01:43.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.353 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2739e-05 s, 0.0 kB/s 2023-10-07T09:01:43.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.457e-05 s, 0.0 kB/s 2023-10-07T09:01:43.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.466 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3681e-05 s, 0.0 kB/s 2023-10-07T09:01:43.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1079e-05 s, 0.0 kB/s 2023-10-07T09:01:43.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.523 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.579 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5179e-05 s, 0.0 kB/s 2023-10-07T09:01:43.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-07T09:01:43.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.635 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.692 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.692 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8436e-05 s, 0.0 kB/s 2023-10-07T09:01:43.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.693 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.257e-05 s, 0.0 kB/s 2023-10-07T09:01:43.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.804 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.804 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8279e-05 s, 0.0 kB/s 2023-10-07T09:01:43.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2291e-05 s, 0.0 kB/s 2023-10-07T09:01:43.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.862 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0056e-05 s, 0.0 kB/s 2023-10-07T09:01:43.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:43.975 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:43.975 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:43.975 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-07T09:01:43.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:43.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0408e-05 s, 0.0 kB/s 2023-10-07T09:01:44.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.033 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4086e-05 s, 0.0 kB/s 2023-10-07T09:01:44.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3546e-05 s, 0.0 kB/s 2023-10-07T09:01:44.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.203 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.203 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1181e-05 s, 0.0 kB/s 2023-10-07T09:01:44.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.259 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000102133 s, 0.0 kB/s 2023-10-07T09:01:44.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.315 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3223e-05 s, 0.0 kB/s 2023-10-07T09:01:44.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.315 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.370 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3402e-05 s, 0.0 kB/s 2023-10-07T09:01:44.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.371 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3323e-05 s, 0.0 kB/s 2023-10-07T09:01:44.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.427 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.482 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6959e-05 s, 0.0 kB/s 2023-10-07T09:01:44.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.539 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.539 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.539 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6319e-05 s, 0.0 kB/s 2023-10-07T09:01:44.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.595 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.595 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.596 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1784e-05 s, 0.0 kB/s 2023-10-07T09:01:44.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.596 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.652 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5035e-05 s, 0.0 kB/s 2023-10-07T09:01:44.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.652 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3734e-05 s, 0.0 kB/s 2023-10-07T09:01:44.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.709 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.764 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.292e-05 s, 0.0 kB/s 2023-10-07T09:01:44.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2589e-05 s, 0.0 kB/s 2023-10-07T09:01:44.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.877 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.877 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.877 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1832e-05 s, 0.0 kB/s 2023-10-07T09:01:44.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.878 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.934 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.495e-05 s, 0.0 kB/s 2023-10-07T09:01:44.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.935 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:44.990 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:44.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:44.991 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6466e-05 s, 0.0 kB/s 2023-10-07T09:01:44.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:44.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9777e-05 s, 0.0 kB/s 2023-10-07T09:01:45.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1634e-05 s, 0.0 kB/s 2023-10-07T09:01:45.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.104 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8392e-05 s, 0.0 kB/s 2023-10-07T09:01:45.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-07T09:01:45.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.349e-05 s, 0.0 kB/s 2023-10-07T09:01:45.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.272 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.328 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.328 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9948e-05 s, 0.0 kB/s 2023-10-07T09:01:45.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9757e-05 s, 0.0 kB/s 2023-10-07T09:01:45.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.441 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3099e-05 s, 0.0 kB/s 2023-10-07T09:01:45.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.441 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.143e-05 s, 0.0 kB/s 2023-10-07T09:01:45.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.498 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.554 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5056e-05 s, 0.0 kB/s 2023-10-07T09:01:45.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.610 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.610 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1458e-05 s, 0.0 kB/s 2023-10-07T09:01:45.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.610 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.665 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6423e-05 s, 0.0 kB/s 2023-10-07T09:01:45.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.666 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.337e-05 s, 0.0 kB/s 2023-10-07T09:01:45.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0645e-05 s, 0.0 kB/s 2023-10-07T09:01:45.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.835 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.835 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.835 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3495e-05 s, 0.0 kB/s 2023-10-07T09:01:45.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.835 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2381e-05 s, 0.0 kB/s 2023-10-07T09:01:45.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4455e-05 s, 0.0 kB/s 2023-10-07T09:01:45.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:45.948 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5017e-05 s, 0.0 kB/s 2023-10-07T09:01:46.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.059 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.059 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.059 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3361e-05 s, 0.0 kB/s 2023-10-07T09:01:46.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.115 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3912e-05 s, 0.0 kB/s 2023-10-07T09:01:46.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1926e-05 s, 0.0 kB/s 2023-10-07T09:01:46.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.173 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.229 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9493e-05 s, 0.0 kB/s 2023-10-07T09:01:46.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.229 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6499e-05 s, 0.0 kB/s 2023-10-07T09:01:46.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.342 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.992e-05 s, 0.0 kB/s 2023-10-07T09:01:46.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.342 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.398 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.278e-05 s, 0.0 kB/s 2023-10-07T09:01:46.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1948e-05 s, 0.0 kB/s 2023-10-07T09:01:46.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.511 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.511 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9766e-05 s, 0.0 kB/s 2023-10-07T09:01:46.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000114606 s, 0.0 kB/s 2023-10-07T09:01:46.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.568 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.624 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7313e-05 s, 0.0 kB/s 2023-10-07T09:01:46.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-07T09:01:46.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.681 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3411e-05 s, 0.0 kB/s 2023-10-07T09:01:46.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.793 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9385e-05 s, 0.0 kB/s 2023-10-07T09:01:46.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.851 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1584e-05 s, 0.0 kB/s 2023-10-07T09:01:46.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.907 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.907 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.907 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7472e-05 s, 0.0 kB/s 2023-10-07T09:01:46.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.908 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:46.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:46.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:46.964 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3683e-05 s, 0.0 kB/s 2023-10-07T09:01:46.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:46.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.076e-05 s, 0.0 kB/s 2023-10-07T09:01:47.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.078 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6089e-05 s, 0.0 kB/s 2023-10-07T09:01:47.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.135 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5661e-05 s, 0.0 kB/s 2023-10-07T09:01:47.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.135 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.190 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5292e-05 s, 0.0 kB/s 2023-10-07T09:01:47.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1797e-05 s, 0.0 kB/s 2023-10-07T09:01:47.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.303 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.304 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.304 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7873e-05 s, 0.0 kB/s 2023-10-07T09:01:47.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.304 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.359 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2583e-05 s, 0.0 kB/s 2023-10-07T09:01:47.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.360 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.416 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.416 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3325e-05 s, 0.0 kB/s 2023-10-07T09:01:47.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.416 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.092e-05 s, 0.0 kB/s 2023-10-07T09:01:47.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-07T09:01:47.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.529 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1882e-05 s, 0.0 kB/s 2023-10-07T09:01:47.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.641 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1338e-05 s, 0.0 kB/s 2023-10-07T09:01:47.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.697 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3611e-05 s, 0.0 kB/s 2023-10-07T09:01:47.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.752 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9276e-05 s, 0.0 kB/s 2023-10-07T09:01:47.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2931e-05 s, 0.0 kB/s 2023-10-07T09:01:47.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1013e-05 s, 0.0 kB/s 2023-10-07T09:01:47.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4618e-05 s, 0.0 kB/s 2023-10-07T09:01:47.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:47.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:47.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:47.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9455e-05 s, 0.0 kB/s 2023-10-07T09:01:47.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:47.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.035 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.035 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.035 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4091e-05 s, 0.0 kB/s 2023-10-07T09:01:48.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3612e-05 s, 0.0 kB/s 2023-10-07T09:01:48.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.092 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.148 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8012e-05 s, 0.0 kB/s 2023-10-07T09:01:48.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4023e-05 s, 0.0 kB/s 2023-10-07T09:01:48.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3383e-05 s, 0.0 kB/s 2023-10-07T09:01:48.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1536e-05 s, 0.0 kB/s 2023-10-07T09:01:48.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-07T09:01:48.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.430 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7309e-05 s, 0.0 kB/s 2023-10-07T09:01:48.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.488 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1787e-05 s, 0.0 kB/s 2023-10-07T09:01:48.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2226e-05 s, 0.0 kB/s 2023-10-07T09:01:48.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.603 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7578e-05 s, 0.0 kB/s 2023-10-07T09:01:48.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9046e-05 s, 0.0 kB/s 2023-10-07T09:01:48.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1132e-05 s, 0.0 kB/s 2023-10-07T09:01:48.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.772 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.312e-05 s, 0.0 kB/s 2023-10-07T09:01:48.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.827 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.391e-05 s, 0.0 kB/s 2023-10-07T09:01:48.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.884 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8458e-05 s, 0.0 kB/s 2023-10-07T09:01:48.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.940 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3653e-05 s, 0.0 kB/s 2023-10-07T09:01:48.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:48.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:48.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:48.997 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2618e-05 s, 0.0 kB/s 2023-10-07T09:01:48.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:48.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1237e-05 s, 0.0 kB/s 2023-10-07T09:01:49.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3329e-05 s, 0.0 kB/s 2023-10-07T09:01:49.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5944e-05 s, 0.0 kB/s 2023-10-07T09:01:49.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.222 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2516e-05 s, 0.0 kB/s 2023-10-07T09:01:49.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2082e-05 s, 0.0 kB/s 2023-10-07T09:01:49.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.334 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.847e-05 s, 0.0 kB/s 2023-10-07T09:01:49.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.391 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0767e-05 s, 0.0 kB/s 2023-10-07T09:01:49.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3839e-05 s, 0.0 kB/s 2023-10-07T09:01:49.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.503 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2679e-05 s, 0.0 kB/s 2023-10-07T09:01:49.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.504 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.560 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1453e-05 s, 0.0 kB/s 2023-10-07T09:01:49.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.616 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9232e-05 s, 0.0 kB/s 2023-10-07T09:01:49.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.617 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.673 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000103543 s, 0.0 kB/s 2023-10-07T09:01:49.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4259e-05 s, 0.0 kB/s 2023-10-07T09:01:49.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.731 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5639e-05 s, 0.0 kB/s 2023-10-07T09:01:49.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5787e-05 s, 0.0 kB/s 2023-10-07T09:01:49.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0312e-05 s, 0.0 kB/s 2023-10-07T09:01:49.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:49.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2849e-05 s, 0.0 kB/s 2023-10-07T09:01:49.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:49.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.016 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.016 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5581e-05 s, 0.0 kB/s 2023-10-07T09:01:50.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-07T09:01:50.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.129 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1678e-05 s, 0.0 kB/s 2023-10-07T09:01:50.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1828e-05 s, 0.0 kB/s 2023-10-07T09:01:50.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.186 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6511e-05 s, 0.0 kB/s 2023-10-07T09:01:50.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4873e-05 s, 0.0 kB/s 2023-10-07T09:01:50.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.355 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.356 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-07T09:01:50.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.356 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.412 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3429e-05 s, 0.0 kB/s 2023-10-07T09:01:50.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2055e-05 s, 0.0 kB/s 2023-10-07T09:01:50.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.525 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3554e-05 s, 0.0 kB/s 2023-10-07T09:01:50.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.346e-05 s, 0.0 kB/s 2023-10-07T09:01:50.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2523e-05 s, 0.0 kB/s 2023-10-07T09:01:50.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4026e-05 s, 0.0 kB/s 2023-10-07T09:01:50.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4178e-05 s, 0.0 kB/s 2023-10-07T09:01:50.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1872e-05 s, 0.0 kB/s 2023-10-07T09:01:50.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4104e-05 s, 0.0 kB/s 2023-10-07T09:01:50.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3429e-05 s, 0.0 kB/s 2023-10-07T09:01:50.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:50.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1553e-05 s, 0.0 kB/s 2023-10-07T09:01:50.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:50.982 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-07T09:01:51.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1509e-05 s, 0.0 kB/s 2023-10-07T09:01:51.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2543e-05 s, 0.0 kB/s 2023-10-07T09:01:51.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.365e-05 s, 0.0 kB/s 2023-10-07T09:01:51.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.208 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.2387e-05 s, 0.0 kB/s 2023-10-07T09:01:51.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.354e-05 s, 0.0 kB/s 2023-10-07T09:01:51.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.322 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9552e-05 s, 0.0 kB/s 2023-10-07T09:01:51.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-07T09:01:51.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.435 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9266e-05 s, 0.0 kB/s 2023-10-07T09:01:51.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8716e-05 s, 0.0 kB/s 2023-10-07T09:01:51.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0231e-05 s, 0.0 kB/s 2023-10-07T09:01:51.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1001e-05 s, 0.0 kB/s 2023-10-07T09:01:51.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.714 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.715 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0683e-05 s, 0.0 kB/s 2023-10-07T09:01:51.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.715 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2399e-05 s, 0.0 kB/s 2023-10-07T09:01:51.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2401e-05 s, 0.0 kB/s 2023-10-07T09:01:51.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1359e-05 s, 0.0 kB/s 2023-10-07T09:01:51.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3856e-05 s, 0.0 kB/s 2023-10-07T09:01:51.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.939 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4314e-05 s, 0.0 kB/s 2023-10-07T09:01:51.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:51.995 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3802e-05 s, 0.0 kB/s 2023-10-07T09:01:52.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4165e-05 s, 0.0 kB/s 2023-10-07T09:01:52.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2463e-05 s, 0.0 kB/s 2023-10-07T09:01:52.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3104e-05 s, 0.0 kB/s 2023-10-07T09:01:52.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.223 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0179e-05 s, 0.0 kB/s 2023-10-07T09:01:52.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6623e-05 s, 0.0 kB/s 2023-10-07T09:01:52.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.392 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.392 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9837e-05 s, 0.0 kB/s 2023-10-07T09:01:52.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.447 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.448 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-07T09:01:52.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.448 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-07T09:01:52.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.504 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1422e-05 s, 0.0 kB/s 2023-10-07T09:01:52.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.561 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7349e-05 s, 0.0 kB/s 2023-10-07T09:01:52.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.617 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2633e-05 s, 0.0 kB/s 2023-10-07T09:01:52.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-07T09:01:52.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.729 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.784 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.784 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.784 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2475e-05 s, 0.0 kB/s 2023-10-07T09:01:52.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1356e-05 s, 0.0 kB/s 2023-10-07T09:01:52.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.842 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.898 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-07T09:01:52.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.898 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:52.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:52.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:52.954 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4384e-05 s, 0.0 kB/s 2023-10-07T09:01:52.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:52.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.011 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5286e-05 s, 0.0 kB/s 2023-10-07T09:01:53.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.066 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.066 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.529e-05 s, 0.0 kB/s 2023-10-07T09:01:53.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.123 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.124 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.124 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5779e-05 s, 0.0 kB/s 2023-10-07T09:01:53.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.181 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0732e-05 s, 0.0 kB/s 2023-10-07T09:01:53.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.235 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.235 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2493e-05 s, 0.0 kB/s 2023-10-07T09:01:53.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.236 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5106e-05 s, 0.0 kB/s 2023-10-07T09:01:53.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4653e-05 s, 0.0 kB/s 2023-10-07T09:01:53.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.348 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6802e-05 s, 0.0 kB/s 2023-10-07T09:01:53.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.405 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3054e-05 s, 0.0 kB/s 2023-10-07T09:01:53.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.943e-05 s, 0.0 kB/s 2023-10-07T09:01:53.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.517 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0993e-05 s, 0.0 kB/s 2023-10-07T09:01:53.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.573 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3242e-05 s, 0.0 kB/s 2023-10-07T09:01:53.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.685 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.686 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8276e-05 s, 0.0 kB/s 2023-10-07T09:01:53.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.741 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.741 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.742 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1326e-05 s, 0.0 kB/s 2023-10-07T09:01:53.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.743 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6022e-05 s, 0.0 kB/s 2023-10-07T09:01:53.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.799 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.854 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.855 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.855 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3559e-05 s, 0.0 kB/s 2023-10-07T09:01:53.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9939e-05 s, 0.0 kB/s 2023-10-07T09:01:53.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:53.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:53.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:53.968 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1962e-05 s, 0.0 kB/s 2023-10-07T09:01:53.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:53.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2916e-05 s, 0.0 kB/s 2023-10-07T09:01:54.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3192e-05 s, 0.0 kB/s 2023-10-07T09:01:54.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.081 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.138 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.138 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.138 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.48e-05 s, 0.0 kB/s 2023-10-07T09:01:54.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100024 s, 0.0 kB/s 2023-10-07T09:01:54.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.194 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1025e-05 s, 0.0 kB/s 2023-10-07T09:01:54.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2877e-05 s, 0.0 kB/s 2023-10-07T09:01:54.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1296e-05 s, 0.0 kB/s 2023-10-07T09:01:54.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1333e-05 s, 0.0 kB/s 2023-10-07T09:01:54.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2293e-05 s, 0.0 kB/s 2023-10-07T09:01:54.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.476 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.531 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000137751 s, 0.0 kB/s 2023-10-07T09:01:54.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6422e-05 s, 0.0 kB/s 2023-10-07T09:01:54.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.590 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1663e-05 s, 0.0 kB/s 2023-10-07T09:01:54.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3573e-05 s, 0.0 kB/s 2023-10-07T09:01:54.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.758 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9623e-05 s, 0.0 kB/s 2023-10-07T09:01:54.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2263e-05 s, 0.0 kB/s 2023-10-07T09:01:54.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.816 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-07T09:01:54.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.928 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000102824 s, 0.0 kB/s 2023-10-07T09:01:54.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:54.985 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2709e-05 s, 0.0 kB/s 2023-10-07T09:01:54.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:54.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0616e-05 s, 0.0 kB/s 2023-10-07T09:01:55.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.042 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.098 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1321e-05 s, 0.0 kB/s 2023-10-07T09:01:55.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2422e-05 s, 0.0 kB/s 2023-10-07T09:01:55.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4461e-05 s, 0.0 kB/s 2023-10-07T09:01:55.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1709e-05 s, 0.0 kB/s 2023-10-07T09:01:55.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.323 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3666e-05 s, 0.0 kB/s 2023-10-07T09:01:55.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5609e-05 s, 0.0 kB/s 2023-10-07T09:01:55.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2296e-05 s, 0.0 kB/s 2023-10-07T09:01:55.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.492 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.492 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4018e-05 s, 0.0 kB/s 2023-10-07T09:01:55.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.492 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7043e-05 s, 0.0 kB/s 2023-10-07T09:01:55.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0782e-05 s, 0.0 kB/s 2023-10-07T09:01:55.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.659 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4056e-05 s, 0.0 kB/s 2023-10-07T09:01:55.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.660 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.715 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1502e-05 s, 0.0 kB/s 2023-10-07T09:01:55.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2223e-05 s, 0.0 kB/s 2023-10-07T09:01:55.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.828 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2168e-05 s, 0.0 kB/s 2023-10-07T09:01:55.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.885 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1973e-05 s, 0.0 kB/s 2023-10-07T09:01:55.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.887 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-07T09:01:55.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:55.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:55.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:55.999 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2819e-05 s, 0.0 kB/s 2023-10-07T09:01:55.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:55.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.055 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7656e-05 s, 0.0 kB/s 2023-10-07T09:01:56.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.055 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5363e-05 s, 0.0 kB/s 2023-10-07T09:01:56.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1849e-05 s, 0.0 kB/s 2023-10-07T09:01:56.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.225 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.225 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.225 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.322e-05 s, 0.0 kB/s 2023-10-07T09:01:56.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.226 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.281 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.281 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.281 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.572e-05 s, 0.0 kB/s 2023-10-07T09:01:56.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.283 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.339 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2112e-05 s, 0.0 kB/s 2023-10-07T09:01:56.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.395 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.396 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4205e-05 s, 0.0 kB/s 2023-10-07T09:01:56.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.396 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3464e-05 s, 0.0 kB/s 2023-10-07T09:01:56.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.508 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.508 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.508 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2581e-05 s, 0.0 kB/s 2023-10-07T09:01:56.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.566 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.566 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2382e-05 s, 0.0 kB/s 2023-10-07T09:01:56.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.622 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4166e-05 s, 0.0 kB/s 2023-10-07T09:01:56.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.677 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.678 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1799e-05 s, 0.0 kB/s 2023-10-07T09:01:56.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-07T09:01:56.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.734 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.789 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.789 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.790 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0626e-05 s, 0.0 kB/s 2023-10-07T09:01:56.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4352e-05 s, 0.0 kB/s 2023-10-07T09:01:56.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.846 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.901 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7629e-05 s, 0.0 kB/s 2023-10-07T09:01:56.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:56.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:56.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:56.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3883e-05 s, 0.0 kB/s 2023-10-07T09:01:56.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:56.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5135e-05 s, 0.0 kB/s 2023-10-07T09:01:57.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.017 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.073 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7476e-05 s, 0.0 kB/s 2023-10-07T09:01:57.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.074 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1753e-05 s, 0.0 kB/s 2023-10-07T09:01:57.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5956e-05 s, 0.0 kB/s 2023-10-07T09:01:57.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.246 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3343e-05 s, 0.0 kB/s 2023-10-07T09:01:57.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.302 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1838e-05 s, 0.0 kB/s 2023-10-07T09:01:57.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.303 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.359 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2623e-05 s, 0.0 kB/s 2023-10-07T09:01:57.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.00010158 s, 0.0 kB/s 2023-10-07T09:01:57.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000112252 s, 0.0 kB/s 2023-10-07T09:01:57.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4562e-05 s, 0.0 kB/s 2023-10-07T09:01:57.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2246e-05 s, 0.0 kB/s 2023-10-07T09:01:57.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6248e-05 s, 0.0 kB/s 2023-10-07T09:01:57.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.696 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0796e-05 s, 0.0 kB/s 2023-10-07T09:01:57.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-07T09:01:57.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4049e-05 s, 0.0 kB/s 2023-10-07T09:01:57.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0652e-05 s, 0.0 kB/s 2023-10-07T09:01:57.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1528e-05 s, 0.0 kB/s 2023-10-07T09:01:57.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.921 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.081e-05 s, 0.0 kB/s 2023-10-07T09:01:57.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:57.978 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1114e-05 s, 0.0 kB/s 2023-10-07T09:01:58.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.092 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2153e-05 s, 0.0 kB/s 2023-10-07T09:01:58.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.148 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1996e-05 s, 0.0 kB/s 2023-10-07T09:01:58.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-07T09:01:58.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8796e-05 s, 0.0 kB/s 2023-10-07T09:01:58.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1088e-05 s, 0.0 kB/s 2023-10-07T09:01:58.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-07T09:01:58.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2666e-05 s, 0.0 kB/s 2023-10-07T09:01:58.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6547e-05 s, 0.0 kB/s 2023-10-07T09:01:58.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4008e-05 s, 0.0 kB/s 2023-10-07T09:01:58.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4198e-05 s, 0.0 kB/s 2023-10-07T09:01:58.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6219e-05 s, 0.0 kB/s 2023-10-07T09:01:58.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.656 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.711 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.711 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.711 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0669e-05 s, 0.0 kB/s 2023-10-07T09:01:58.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.767 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7484e-05 s, 0.0 kB/s 2023-10-07T09:01:58.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.768 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7725e-05 s, 0.0 kB/s 2023-10-07T09:01:58.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.881 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.236e-05 s, 0.0 kB/s 2023-10-07T09:01:58.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.937 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.337e-05 s, 0.0 kB/s 2023-10-07T09:01:58.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5362e-05 s, 0.0 kB/s 2023-10-07T09:01:58.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:58.995 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.051 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.2439e-05 s, 0.0 kB/s 2023-10-07T09:01:59.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1927e-05 s, 0.0 kB/s 2023-10-07T09:01:59.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.109 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.343e-05 s, 0.0 kB/s 2023-10-07T09:01:59.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.222 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8105e-05 s, 0.0 kB/s 2023-10-07T09:01:59.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1358e-05 s, 0.0 kB/s 2023-10-07T09:01:59.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.334 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0412e-05 s, 0.0 kB/s 2023-10-07T09:01:59.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1956e-05 s, 0.0 kB/s 2023-10-07T09:01:59.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.1364e-05 s, 0.0 kB/s 2023-10-07T09:01:59.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.503 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5788e-05 s, 0.0 kB/s 2023-10-07T09:01:59.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3589e-05 s, 0.0 kB/s 2023-10-07T09:01:59.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9112e-05 s, 0.0 kB/s 2023-10-07T09:01:59.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.616 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6085e-05 s, 0.0 kB/s 2023-10-07T09:01:59.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.730 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2244e-05 s, 0.0 kB/s 2023-10-07T09:01:59.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.785 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6082e-05 s, 0.0 kB/s 2023-10-07T09:01:59.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8245e-05 s, 0.0 kB/s 2023-10-07T09:01:59.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5018e-05 s, 0.0 kB/s 2023-10-07T09:01:59.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:01:59.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:01:59.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:01:59.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6086e-05 s, 0.0 kB/s 2023-10-07T09:01:59.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:01:59.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.013 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1989e-05 s, 0.0 kB/s 2023-10-07T09:02:00.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.070 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.7215e-05 s, 0.0 kB/s 2023-10-07T09:02:00.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.070 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1665e-05 s, 0.0 kB/s 2023-10-07T09:02:00.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1632e-05 s, 0.0 kB/s 2023-10-07T09:02:00.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.184 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.2314e-05 s, 0.0 kB/s 2023-10-07T09:02:00.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-07T09:02:00.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.296 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.248e-05 s, 0.0 kB/s 2023-10-07T09:02:00.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.352 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.239e-05 s, 0.0 kB/s 2023-10-07T09:02:00.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-07T09:02:00.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.521 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5392e-05 s, 0.0 kB/s 2023-10-07T09:02:00.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.523 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.579 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-07T09:02:00.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0406e-05 s, 0.0 kB/s 2023-10-07T09:02:00.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.635 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.514e-05 s, 0.0 kB/s 2023-10-07T09:02:00.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0786e-05 s, 0.0 kB/s 2023-10-07T09:02:00.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.804 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3925e-05 s, 0.0 kB/s 2023-10-07T09:02:00.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.859 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.859 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0003e-05 s, 0.0 kB/s 2023-10-07T09:02:00.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.860 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.915 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2505e-05 s, 0.0 kB/s 2023-10-07T09:02:00.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:00.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:00.972 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:00.972 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3959e-05 s, 0.0 kB/s 2023-10-07T09:02:00.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:00.972 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.028 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.028 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5986e-05 s, 0.0 kB/s 2023-10-07T09:02:01.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.028 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.132 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.474e-05 s, 0.0 kB/s 2023-10-07T09:02:01.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8859e-05 s, 0.0 kB/s 2023-10-07T09:02:01.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.204 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.7214e-05 s, 0.0 kB/s 2023-10-07T09:02:01.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6976e-05 s, 0.0 kB/s 2023-10-07T09:02:01.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.263 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.4402e-05 s, 0.0 kB/s 2023-10-07T09:02:01.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.376 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9062e-05 s, 0.0 kB/s 2023-10-07T09:02:01.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.376 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9742e-05 s, 0.0 kB/s 2023-10-07T09:02:01.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.2893e-05 s, 0.0 kB/s 2023-10-07T09:02:01.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2073e-05 s, 0.0 kB/s 2023-10-07T09:02:01.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.601 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4616e-05 s, 0.0 kB/s 2023-10-07T09:02:01.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.189e-05 s, 0.0 kB/s 2023-10-07T09:02:01.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.658 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3295e-05 s, 0.0 kB/s 2023-10-07T09:02:01.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4426e-05 s, 0.0 kB/s 2023-10-07T09:02:01.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4573e-05 s, 0.0 kB/s 2023-10-07T09:02:01.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3426e-05 s, 0.0 kB/s 2023-10-07T09:02:01.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.247e-05 s, 0.0 kB/s 2023-10-07T09:02:01.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3527e-05 s, 0.0 kB/s 2023-10-07T09:02:01.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:01.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9729e-05 s, 0.0 kB/s 2023-10-07T09:02:02.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2078e-05 s, 0.0 kB/s 2023-10-07T09:02:02.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.167 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.167 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.167 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2007e-05 s, 0.0 kB/s 2023-10-07T09:02:02.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.223 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7362e-05 s, 0.0 kB/s 2023-10-07T09:02:02.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.223 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.280 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-07T09:02:02.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0043e-05 s, 0.0 kB/s 2023-10-07T09:02:02.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5513e-05 s, 0.0 kB/s 2023-10-07T09:02:02.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1421e-05 s, 0.0 kB/s 2023-10-07T09:02:02.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.506 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4387e-05 s, 0.0 kB/s 2023-10-07T09:02:02.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4719e-05 s, 0.0 kB/s 2023-10-07T09:02:02.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.311e-05 s, 0.0 kB/s 2023-10-07T09:02:02.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.620 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3724e-05 s, 0.0 kB/s 2023-10-07T09:02:02.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1795e-05 s, 0.0 kB/s 2023-10-07T09:02:02.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.00010313 s, 0.0 kB/s 2023-10-07T09:02:02.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3792e-05 s, 0.0 kB/s 2023-10-07T09:02:02.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1389e-05 s, 0.0 kB/s 2023-10-07T09:02:02.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.903 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:02.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:02.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:02.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7106e-05 s, 0.0 kB/s 2023-10-07T09:02:02.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:02.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9988e-05 s, 0.0 kB/s 2023-10-07T09:02:03.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.417e-05 s, 0.0 kB/s 2023-10-07T09:02:03.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3753e-05 s, 0.0 kB/s 2023-10-07T09:02:03.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3975e-05 s, 0.0 kB/s 2023-10-07T09:02:03.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.184 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5776e-05 s, 0.0 kB/s 2023-10-07T09:02:03.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.241 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0262e-05 s, 0.0 kB/s 2023-10-07T09:02:03.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.353 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1949e-05 s, 0.0 kB/s 2023-10-07T09:02:03.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6801e-05 s, 0.0 kB/s 2023-10-07T09:02:03.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.466 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.392e-05 s, 0.0 kB/s 2023-10-07T09:02:03.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.522 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.523 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.523 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3929e-05 s, 0.0 kB/s 2023-10-07T09:02:03.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.523 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.578 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.579 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1073e-05 s, 0.0 kB/s 2023-10-07T09:02:03.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7662e-05 s, 0.0 kB/s 2023-10-07T09:02:03.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.635 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.691 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.692 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.692 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1533e-05 s, 0.0 kB/s 2023-10-07T09:02:03.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9409e-05 s, 0.0 kB/s 2023-10-07T09:02:03.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1679e-05 s, 0.0 kB/s 2023-10-07T09:02:03.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.348e-05 s, 0.0 kB/s 2023-10-07T09:02:03.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.860 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.917 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.917 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.918 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3022e-05 s, 0.0 kB/s 2023-10-07T09:02:03.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.918 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:03.973 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:03.974 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:03.974 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6146e-05 s, 0.0 kB/s 2023-10-07T09:02:03.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:03.974 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8739e-05 s, 0.0 kB/s 2023-10-07T09:02:04.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7503e-05 s, 0.0 kB/s 2023-10-07T09:02:04.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1515e-05 s, 0.0 kB/s 2023-10-07T09:02:04.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.144 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.200 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.200 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.201 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5196e-05 s, 0.0 kB/s 2023-10-07T09:02:04.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.257 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.257 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1171e-05 s, 0.0 kB/s 2023-10-07T09:02:04.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.257 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.312 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.312 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6566e-05 s, 0.0 kB/s 2023-10-07T09:02:04.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.313 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9594e-05 s, 0.0 kB/s 2023-10-07T09:02:04.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.369 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6334e-05 s, 0.0 kB/s 2023-10-07T09:02:04.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.426 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.482 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.482 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-07T09:02:04.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.482 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.537 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.537 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.537 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4556e-05 s, 0.0 kB/s 2023-10-07T09:02:04.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0825e-05 s, 0.0 kB/s 2023-10-07T09:02:04.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0415e-05 s, 0.0 kB/s 2023-10-07T09:02:04.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.652 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1664e-05 s, 0.0 kB/s 2023-10-07T09:02:04.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.708 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.763 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.764 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0359e-05 s, 0.0 kB/s 2023-10-07T09:02:04.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.820 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7549e-05 s, 0.0 kB/s 2023-10-07T09:02:04.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.820 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7066e-05 s, 0.0 kB/s 2023-10-07T09:02:04.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.934 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1772e-05 s, 0.0 kB/s 2023-10-07T09:02:04.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.935 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:04.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:04.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:04.991 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9214e-05 s, 0.0 kB/s 2023-10-07T09:02:04.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:04.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000105093 s, 0.0 kB/s 2023-10-07T09:02:05.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.667e-05 s, 0.0 kB/s 2023-10-07T09:02:05.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-07T09:02:05.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.218 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4751e-05 s, 0.0 kB/s 2023-10-07T09:02:05.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.275 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.275 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3857e-05 s, 0.0 kB/s 2023-10-07T09:02:05.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.275 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.332 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5496e-05 s, 0.0 kB/s 2023-10-07T09:02:05.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1417e-05 s, 0.0 kB/s 2023-10-07T09:02:05.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1944e-05 s, 0.0 kB/s 2023-10-07T09:02:05.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.504 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.504 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.504 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1571e-05 s, 0.0 kB/s 2023-10-07T09:02:05.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.504 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.561 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-07T09:02:05.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.561 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2119e-05 s, 0.0 kB/s 2023-10-07T09:02:05.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.617 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.672 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9396e-05 s, 0.0 kB/s 2023-10-07T09:02:05.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.729 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3573e-05 s, 0.0 kB/s 2023-10-07T09:02:05.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.786 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6748e-05 s, 0.0 kB/s 2023-10-07T09:02:05.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3851e-05 s, 0.0 kB/s 2023-10-07T09:02:05.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.843 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0464e-05 s, 0.0 kB/s 2023-10-07T09:02:05.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.899 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:05.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:05.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:05.955 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-07T09:02:05.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:05.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.012 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.012 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1678e-05 s, 0.0 kB/s 2023-10-07T09:02:06.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.012 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1419e-05 s, 0.0 kB/s 2023-10-07T09:02:06.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3303e-05 s, 0.0 kB/s 2023-10-07T09:02:06.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0629e-05 s, 0.0 kB/s 2023-10-07T09:02:06.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9946e-05 s, 0.0 kB/s 2023-10-07T09:02:06.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.238 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.293 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9432e-05 s, 0.0 kB/s 2023-10-07T09:02:06.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.350 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.350 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7423e-05 s, 0.0 kB/s 2023-10-07T09:02:06.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.350 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.406 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.406 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3042e-05 s, 0.0 kB/s 2023-10-07T09:02:06.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.406 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-07T09:02:06.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3687e-05 s, 0.0 kB/s 2023-10-07T09:02:06.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.518 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.574 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1582e-05 s, 0.0 kB/s 2023-10-07T09:02:06.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.574 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8093e-05 s, 0.0 kB/s 2023-10-07T09:02:06.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2646e-05 s, 0.0 kB/s 2023-10-07T09:02:06.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.107e-05 s, 0.0 kB/s 2023-10-07T09:02:06.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.816 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.816 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.816 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104816 s, 0.0 kB/s 2023-10-07T09:02:06.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.816 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.872 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1102e-05 s, 0.0 kB/s 2023-10-07T09:02:06.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.116e-05 s, 0.0 kB/s 2023-10-07T09:02:06.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.573e-05 s, 0.0 kB/s 2023-10-07T09:02:06.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:06.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0541e-05 s, 0.0 kB/s 2023-10-07T09:02:07.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.098 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4342e-05 s, 0.0 kB/s 2023-10-07T09:02:07.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.097e-05 s, 0.0 kB/s 2023-10-07T09:02:07.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2799e-05 s, 0.0 kB/s 2023-10-07T09:02:07.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.255e-05 s, 0.0 kB/s 2023-10-07T09:02:07.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.267 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.0322e-05 s, 0.0 kB/s 2023-10-07T09:02:07.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.324 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1724e-05 s, 0.0 kB/s 2023-10-07T09:02:07.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-07T09:02:07.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1589e-05 s, 0.0 kB/s 2023-10-07T09:02:07.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.492 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.231e-05 s, 0.0 kB/s 2023-10-07T09:02:07.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0797e-05 s, 0.0 kB/s 2023-10-07T09:02:07.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.660 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1119e-05 s, 0.0 kB/s 2023-10-07T09:02:07.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.660 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3563e-05 s, 0.0 kB/s 2023-10-07T09:02:07.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5005e-05 s, 0.0 kB/s 2023-10-07T09:02:07.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.835 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.835 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2746e-05 s, 0.0 kB/s 2023-10-07T09:02:07.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.836 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.893 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2773e-05 s, 0.0 kB/s 2023-10-07T09:02:07.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.893 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:07.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:07.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:07.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5892e-05 s, 0.0 kB/s 2023-10-07T09:02:07.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:07.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4455e-05 s, 0.0 kB/s 2023-10-07T09:02:08.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.008 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0387e-05 s, 0.0 kB/s 2023-10-07T09:02:08.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.065 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.121 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0405e-05 s, 0.0 kB/s 2023-10-07T09:02:08.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0102e-05 s, 0.0 kB/s 2023-10-07T09:02:08.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1133e-05 s, 0.0 kB/s 2023-10-07T09:02:08.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.4239e-05 s, 0.0 kB/s 2023-10-07T09:02:08.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.289 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3288e-05 s, 0.0 kB/s 2023-10-07T09:02:08.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5444e-05 s, 0.0 kB/s 2023-10-07T09:02:08.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8679e-05 s, 0.0 kB/s 2023-10-07T09:02:08.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-07T09:02:08.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5703e-05 s, 0.0 kB/s 2023-10-07T09:02:08.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.695e-05 s, 0.0 kB/s 2023-10-07T09:02:08.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7775e-05 s, 0.0 kB/s 2023-10-07T09:02:08.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1428e-05 s, 0.0 kB/s 2023-10-07T09:02:08.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.1415e-05 s, 0.0 kB/s 2023-10-07T09:02:08.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.851 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0901e-05 s, 0.0 kB/s 2023-10-07T09:02:08.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3424e-05 s, 0.0 kB/s 2023-10-07T09:02:08.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9816e-05 s, 0.0 kB/s 2023-10-07T09:02:08.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:08.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.020 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-07T09:02:09.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.427e-05 s, 0.0 kB/s 2023-10-07T09:02:09.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.076 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6349e-05 s, 0.0 kB/s 2023-10-07T09:02:09.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.188 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7899e-05 s, 0.0 kB/s 2023-10-07T09:02:09.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.246 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1012e-05 s, 0.0 kB/s 2023-10-07T09:02:09.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.246 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.302 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-07T09:02:09.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.359 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2722e-05 s, 0.0 kB/s 2023-10-07T09:02:09.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-07T09:02:09.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4039e-05 s, 0.0 kB/s 2023-10-07T09:02:09.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.528 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0099e-05 s, 0.0 kB/s 2023-10-07T09:02:09.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.585 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.241e-05 s, 0.0 kB/s 2023-10-07T09:02:09.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2599e-05 s, 0.0 kB/s 2023-10-07T09:02:09.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.643 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-07T09:02:09.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.699 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.754 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2576e-05 s, 0.0 kB/s 2023-10-07T09:02:09.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.755 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2307e-05 s, 0.0 kB/s 2023-10-07T09:02:09.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2642e-05 s, 0.0 kB/s 2023-10-07T09:02:09.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2561e-05 s, 0.0 kB/s 2023-10-07T09:02:09.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:09.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:09.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1884e-05 s, 0.0 kB/s 2023-10-07T09:02:09.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:09.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.403e-05 s, 0.0 kB/s 2023-10-07T09:02:10.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2779e-05 s, 0.0 kB/s 2023-10-07T09:02:10.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.150 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.150 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4947e-05 s, 0.0 kB/s 2023-10-07T09:02:10.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4622e-05 s, 0.0 kB/s 2023-10-07T09:02:10.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5447e-05 s, 0.0 kB/s 2023-10-07T09:02:10.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.3843e-05 s, 0.0 kB/s 2023-10-07T09:02:10.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.375 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.375 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4456e-05 s, 0.0 kB/s 2023-10-07T09:02:10.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0822e-05 s, 0.0 kB/s 2023-10-07T09:02:10.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8862e-05 s, 0.0 kB/s 2023-10-07T09:02:10.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.542 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3966e-05 s, 0.0 kB/s 2023-10-07T09:02:10.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.543 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8179e-05 s, 0.0 kB/s 2023-10-07T09:02:10.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.599 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6886e-05 s, 0.0 kB/s 2023-10-07T09:02:10.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.656 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.712 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3063e-05 s, 0.0 kB/s 2023-10-07T09:02:10.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.712 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.768 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.768 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8396e-05 s, 0.0 kB/s 2023-10-07T09:02:10.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.768 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3523e-05 s, 0.0 kB/s 2023-10-07T09:02:10.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1586e-05 s, 0.0 kB/s 2023-10-07T09:02:10.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.881 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2262e-05 s, 0.0 kB/s 2023-10-07T09:02:10.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:10.994 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:10.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:10.995 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4133e-05 s, 0.0 kB/s 2023-10-07T09:02:10.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:10.995 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3636e-05 s, 0.0 kB/s 2023-10-07T09:02:11.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5293e-05 s, 0.0 kB/s 2023-10-07T09:02:11.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.109 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.164 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.165 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1657e-05 s, 0.0 kB/s 2023-10-07T09:02:11.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.165 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1981e-05 s, 0.0 kB/s 2023-10-07T09:02:11.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.221 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6011e-05 s, 0.0 kB/s 2023-10-07T09:02:11.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.277 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1015e-05 s, 0.0 kB/s 2023-10-07T09:02:11.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.333 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1076e-05 s, 0.0 kB/s 2023-10-07T09:02:11.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.444 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3224e-05 s, 0.0 kB/s 2023-10-07T09:02:11.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.445 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.501 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.501 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.501 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.921e-05 s, 0.0 kB/s 2023-10-07T09:02:11.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.501 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.3166e-05 s, 0.0 kB/s 2023-10-07T09:02:11.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.613 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.613 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.613 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0096e-05 s, 0.0 kB/s 2023-10-07T09:02:11.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.614 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.671 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-07T09:02:11.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.727 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4639e-05 s, 0.0 kB/s 2023-10-07T09:02:11.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.727 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.782 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1681e-05 s, 0.0 kB/s 2023-10-07T09:02:11.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.783 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.881 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.3012e-05 s, 0.0 kB/s 2023-10-07T09:02:11.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.898 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3749e-05 s, 0.0 kB/s 2023-10-07T09:02:11.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.899 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:11.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:02:11.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:02:11.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:11.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:11.955 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1119e-05 s, 0.0 kB/s 2023-10-07T09:02:11.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:11.956 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.204e-05 s, 0.0 kB/s 2023-10-07T09:02:12.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-07T09:02:12.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1168e-05 s, 0.0 kB/s 2023-10-07T09:02:12.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.164 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.219 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2299e-05 s, 0.0 kB/s 2023-10-07T09:02:12.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.220 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2496e-05 s, 0.0 kB/s 2023-10-07T09:02:12.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.277 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1383e-05 s, 0.0 kB/s 2023-10-07T09:02:12.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.390 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6613e-05 s, 0.0 kB/s 2023-10-07T09:02:12.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.013e-05 s, 0.0 kB/s 2023-10-07T09:02:12.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1878e-05 s, 0.0 kB/s 2023-10-07T09:02:12.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.504 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.560 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.560 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2966e-05 s, 0.0 kB/s 2023-10-07T09:02:12.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7026e-05 s, 0.0 kB/s 2023-10-07T09:02:12.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.617 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3455e-05 s, 0.0 kB/s 2023-10-07T09:02:12.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.672 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3178e-05 s, 0.0 kB/s 2023-10-07T09:02:12.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.728 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.783 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.783 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.783 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4726e-05 s, 0.0 kB/s 2023-10-07T09:02:12.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.784 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.840 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.176e-05 s, 0.0 kB/s 2023-10-07T09:02:12.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.841 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.896 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9276e-05 s, 0.0 kB/s 2023-10-07T09:02:12.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.896 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:12.953 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:12.953 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:12.953 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.7857e-05 s, 0.0 kB/s 2023-10-07T09:02:12.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:12.953 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1738e-05 s, 0.0 kB/s 2023-10-07T09:02:13.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.010 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0199e-05 s, 0.0 kB/s 2023-10-07T09:02:13.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.066 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1928e-05 s, 0.0 kB/s 2023-10-07T09:02:13.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.178 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.179 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-07T09:02:13.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.179 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.235 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5939e-05 s, 0.0 kB/s 2023-10-07T09:02:13.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.235 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8179e-05 s, 0.0 kB/s 2023-10-07T09:02:13.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.347 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2424e-05 s, 0.0 kB/s 2023-10-07T09:02:13.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.404 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5896e-05 s, 0.0 kB/s 2023-10-07T09:02:13.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.404 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104682 s, 0.0 kB/s 2023-10-07T09:02:13.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.460 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3916e-05 s, 0.0 kB/s 2023-10-07T09:02:13.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.517 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.574 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.574 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.574 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1599e-05 s, 0.0 kB/s 2023-10-07T09:02:13.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.574 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.630 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.631 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.631 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0139e-05 s, 0.0 kB/s 2023-10-07T09:02:13.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.631 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.687 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.687 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.687 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106393 s, 0.0 kB/s 2023-10-07T09:02:13.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.687 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9981e-05 s, 0.0 kB/s 2023-10-07T09:02:13.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.746 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0365e-05 s, 0.0 kB/s 2023-10-07T09:02:13.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0654e-05 s, 0.0 kB/s 2023-10-07T09:02:13.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.859 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7421e-05 s, 0.0 kB/s 2023-10-07T09:02:13.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:13.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:13.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:13.972 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3283e-05 s, 0.0 kB/s 2023-10-07T09:02:13.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:13.972 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.027 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8218e-05 s, 0.0 kB/s 2023-10-07T09:02:14.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.028 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3326e-05 s, 0.0 kB/s 2023-10-07T09:02:14.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.224e-05 s, 0.0 kB/s 2023-10-07T09:02:14.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.197 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.197 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1546e-05 s, 0.0 kB/s 2023-10-07T09:02:14.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6702e-05 s, 0.0 kB/s 2023-10-07T09:02:14.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1288e-05 s, 0.0 kB/s 2023-10-07T09:02:14.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.308 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.365 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.365 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.365 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3704e-05 s, 0.0 kB/s 2023-10-07T09:02:14.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2284e-05 s, 0.0 kB/s 2023-10-07T09:02:14.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.479 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.479 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.479 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4483e-05 s, 0.0 kB/s 2023-10-07T09:02:14.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.479 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.536 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.536 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.536 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.2333e-05 s, 0.0 kB/s 2023-10-07T09:02:14.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6838e-05 s, 0.0 kB/s 2023-10-07T09:02:14.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.592 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.648 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.648 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.648 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-07T09:02:14.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.648 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.703 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.703 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.704 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2518e-05 s, 0.0 kB/s 2023-10-07T09:02:14.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5622e-05 s, 0.0 kB/s 2023-10-07T09:02:14.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.816 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1302e-05 s, 0.0 kB/s 2023-10-07T09:02:14.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.817 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.873 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1318e-05 s, 0.0 kB/s 2023-10-07T09:02:14.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.930 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5237e-05 s, 0.0 kB/s 2023-10-07T09:02:14.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3114e-05 s, 0.0 kB/s 2023-10-07T09:02:14.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:14.987 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.043 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1233e-05 s, 0.0 kB/s 2023-10-07T09:02:15.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6942e-05 s, 0.0 kB/s 2023-10-07T09:02:15.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.158 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.159 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.159 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-07T09:02:15.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.159 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.214 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.215 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.215 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1749e-05 s, 0.0 kB/s 2023-10-07T09:02:15.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9046e-05 s, 0.0 kB/s 2023-10-07T09:02:15.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.271 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3973e-05 s, 0.0 kB/s 2023-10-07T09:02:15.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1585e-05 s, 0.0 kB/s 2023-10-07T09:02:15.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.385 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3235e-05 s, 0.0 kB/s 2023-10-07T09:02:15.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.441 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.497 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7289e-05 s, 0.0 kB/s 2023-10-07T09:02:15.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.552 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9626e-05 s, 0.0 kB/s 2023-10-07T09:02:15.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.609 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3431e-05 s, 0.0 kB/s 2023-10-07T09:02:15.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.665 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2206e-05 s, 0.0 kB/s 2023-10-07T09:02:15.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8286e-05 s, 0.0 kB/s 2023-10-07T09:02:15.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1856e-05 s, 0.0 kB/s 2023-10-07T09:02:15.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.832 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.832 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0536e-05 s, 0.0 kB/s 2023-10-07T09:02:15.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.890 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4982e-05 s, 0.0 kB/s 2023-10-07T09:02:15.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.890 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:15.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:15.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:15.947 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0647e-05 s, 0.0 kB/s 2023-10-07T09:02:15.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:15.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.174e-05 s, 0.0 kB/s 2023-10-07T09:02:16.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5489e-05 s, 0.0 kB/s 2023-10-07T09:02:16.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.061 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.455e-05 s, 0.0 kB/s 2023-10-07T09:02:16.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.117 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4949e-05 s, 0.0 kB/s 2023-10-07T09:02:16.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.174 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3174e-05 s, 0.0 kB/s 2023-10-07T09:02:16.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.231 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.286 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9215e-05 s, 0.0 kB/s 2023-10-07T09:02:16.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.343 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0351e-05 s, 0.0 kB/s 2023-10-07T09:02:16.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.344 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.400 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2326e-05 s, 0.0 kB/s 2023-10-07T09:02:16.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.457 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8177e-05 s, 0.0 kB/s 2023-10-07T09:02:16.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1896e-05 s, 0.0 kB/s 2023-10-07T09:02:16.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1229e-05 s, 0.0 kB/s 2023-10-07T09:02:16.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4317e-05 s, 0.0 kB/s 2023-10-07T09:02:16.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.683 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.683 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1321e-05 s, 0.0 kB/s 2023-10-07T09:02:16.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.739 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2856e-05 s, 0.0 kB/s 2023-10-07T09:02:16.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.795 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2316e-05 s, 0.0 kB/s 2023-10-07T09:02:16.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.851 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.851 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.851 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8123e-05 s, 0.0 kB/s 2023-10-07T09:02:16.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:16.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:16.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:16.906 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0676e-05 s, 0.0 kB/s 2023-10-07T09:02:16.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:16.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.027 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5303e-05 s, 0.0 kB/s 2023-10-07T09:02:17.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.044 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4826e-05 s, 0.0 kB/s 2023-10-07T09:02:17.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.101 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4689e-05 s, 0.0 kB/s 2023-10-07T09:02:17.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.157 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2112e-05 s, 0.0 kB/s 2023-10-07T09:02:17.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.158 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.214 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4306e-05 s, 0.0 kB/s 2023-10-07T09:02:17.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5179e-05 s, 0.0 kB/s 2023-10-07T09:02:17.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.270 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.325 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5293e-05 s, 0.0 kB/s 2023-10-07T09:02:17.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.381 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.382 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5574e-05 s, 0.0 kB/s 2023-10-07T09:02:17.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.382 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.438 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.438 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.438 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4199e-05 s, 0.0 kB/s 2023-10-07T09:02:17.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.495 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.192e-05 s, 0.0 kB/s 2023-10-07T09:02:17.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.551 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.552 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4483e-05 s, 0.0 kB/s 2023-10-07T09:02:17.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1911e-05 s, 0.0 kB/s 2023-10-07T09:02:17.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.665 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6396e-05 s, 0.0 kB/s 2023-10-07T09:02:17.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.4426e-05 s, 0.0 kB/s 2023-10-07T09:02:17.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.722 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.777 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2068e-05 s, 0.0 kB/s 2023-10-07T09:02:17.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.835 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.835 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8283e-05 s, 0.0 kB/s 2023-10-07T09:02:17.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.835 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2158e-05 s, 0.0 kB/s 2023-10-07T09:02:17.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:17.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:17.947 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:17.947 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-07T09:02:17.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:17.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4514e-05 s, 0.0 kB/s 2023-10-07T09:02:18.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.060 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.060 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7926e-05 s, 0.0 kB/s 2023-10-07T09:02:18.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.287e-05 s, 0.0 kB/s 2023-10-07T09:02:18.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.173 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6006e-05 s, 0.0 kB/s 2023-10-07T09:02:18.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.175 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2112e-05 s, 0.0 kB/s 2023-10-07T09:02:18.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.232 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-07T09:02:18.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2642e-05 s, 0.0 kB/s 2023-10-07T09:02:18.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2069e-05 s, 0.0 kB/s 2023-10-07T09:02:18.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-07T09:02:18.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.459 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.514 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.515 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.515 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3607e-05 s, 0.0 kB/s 2023-10-07T09:02:18.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.515 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.570 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1641e-05 s, 0.0 kB/s 2023-10-07T09:02:18.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.627 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1943e-05 s, 0.0 kB/s 2023-10-07T09:02:18.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-07T09:02:18.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.740 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6916e-05 s, 0.0 kB/s 2023-10-07T09:02:18.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.740 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1596e-05 s, 0.0 kB/s 2023-10-07T09:02:18.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0882e-05 s, 0.0 kB/s 2023-10-07T09:02:18.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.910 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.910 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.910 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3305e-05 s, 0.0 kB/s 2023-10-07T09:02:18.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:18.967 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:18.967 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:18.968 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4466e-05 s, 0.0 kB/s 2023-10-07T09:02:18.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:18.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.024 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1847e-05 s, 0.0 kB/s 2023-10-07T09:02:19.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.024 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.285e-05 s, 0.0 kB/s 2023-10-07T09:02:19.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.081 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.137 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.137 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2269e-05 s, 0.0 kB/s 2023-10-07T09:02:19.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.137 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3622e-05 s, 0.0 kB/s 2023-10-07T09:02:19.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.193 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.249 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0786e-05 s, 0.0 kB/s 2023-10-07T09:02:19.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.249 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2363e-05 s, 0.0 kB/s 2023-10-07T09:02:19.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5735e-05 s, 0.0 kB/s 2023-10-07T09:02:19.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.417 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.417 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.417 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2654e-05 s, 0.0 kB/s 2023-10-07T09:02:19.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.418 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.474 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-07T09:02:19.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.529 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3585e-05 s, 0.0 kB/s 2023-10-07T09:02:19.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.530 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2242e-05 s, 0.0 kB/s 2023-10-07T09:02:19.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.586 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4788e-05 s, 0.0 kB/s 2023-10-07T09:02:19.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.642 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.092e-05 s, 0.0 kB/s 2023-10-07T09:02:19.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4166e-05 s, 0.0 kB/s 2023-10-07T09:02:19.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-07T09:02:19.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4283e-05 s, 0.0 kB/s 2023-10-07T09:02:19.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3488e-05 s, 0.0 kB/s 2023-10-07T09:02:19.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-07T09:02:19.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:19.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9126e-05 s, 0.0 kB/s 2023-10-07T09:02:20.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2836e-05 s, 0.0 kB/s 2023-10-07T09:02:20.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2314e-05 s, 0.0 kB/s 2023-10-07T09:02:20.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3992e-05 s, 0.0 kB/s 2023-10-07T09:02:20.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8772e-05 s, 0.0 kB/s 2023-10-07T09:02:20.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.37e-05 s, 0.0 kB/s 2023-10-07T09:02:20.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9042e-05 s, 0.0 kB/s 2023-10-07T09:02:20.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1724e-05 s, 0.0 kB/s 2023-10-07T09:02:20.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.430 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4097e-05 s, 0.0 kB/s 2023-10-07T09:02:20.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9326e-05 s, 0.0 kB/s 2023-10-07T09:02:20.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.599 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.366e-05 s, 0.0 kB/s 2023-10-07T09:02:20.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1945e-05 s, 0.0 kB/s 2023-10-07T09:02:20.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.6958e-05 s, 0.0 kB/s 2023-10-07T09:02:20.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-07T09:02:20.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.826 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1437e-05 s, 0.0 kB/s 2023-10-07T09:02:20.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.883 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7952e-05 s, 0.0 kB/s 2023-10-07T09:02:20.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3128e-05 s, 0.0 kB/s 2023-10-07T09:02:20.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:20.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:20.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:20.996 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.315e-05 s, 0.0 kB/s 2023-10-07T09:02:20.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:20.997 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8789e-05 s, 0.0 kB/s 2023-10-07T09:02:21.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1432e-05 s, 0.0 kB/s 2023-10-07T09:02:21.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3572e-05 s, 0.0 kB/s 2023-10-07T09:02:21.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.377e-05 s, 0.0 kB/s 2023-10-07T09:02:21.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.224 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2123e-05 s, 0.0 kB/s 2023-10-07T09:02:21.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1507e-05 s, 0.0 kB/s 2023-10-07T09:02:21.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3073e-05 s, 0.0 kB/s 2023-10-07T09:02:21.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3148e-05 s, 0.0 kB/s 2023-10-07T09:02:21.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.451 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.507 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.507 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.508 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5139e-05 s, 0.0 kB/s 2023-10-07T09:02:21.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.508 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2275e-05 s, 0.0 kB/s 2023-10-07T09:02:21.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9333e-05 s, 0.0 kB/s 2023-10-07T09:02:21.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.678 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9599e-05 s, 0.0 kB/s 2023-10-07T09:02:21.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.679 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2798e-05 s, 0.0 kB/s 2023-10-07T09:02:21.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-07T09:02:21.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.848 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.849 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.849 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2745e-05 s, 0.0 kB/s 2023-10-07T09:02:21.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.849 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.905 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2265e-05 s, 0.0 kB/s 2023-10-07T09:02:21.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.905 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:21.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:21.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:21.963 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2871e-05 s, 0.0 kB/s 2023-10-07T09:02:21.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:21.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.019 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4e-05 s, 0.0 kB/s 2023-10-07T09:02:22.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2447e-05 s, 0.0 kB/s 2023-10-07T09:02:22.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.076 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.132 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.132 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1113e-05 s, 0.0 kB/s 2023-10-07T09:02:22.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.188 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2206e-05 s, 0.0 kB/s 2023-10-07T09:02:22.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.244 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-07T09:02:22.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.300 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8708e-05 s, 0.0 kB/s 2023-10-07T09:02:22.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4936e-05 s, 0.0 kB/s 2023-10-07T09:02:22.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-07T09:02:22.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.469 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.469 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4949e-05 s, 0.0 kB/s 2023-10-07T09:02:22.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.525 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0241e-05 s, 0.0 kB/s 2023-10-07T09:02:22.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4256e-05 s, 0.0 kB/s 2023-10-07T09:02:22.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3436e-05 s, 0.0 kB/s 2023-10-07T09:02:22.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.695 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3591e-05 s, 0.0 kB/s 2023-10-07T09:02:22.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.695 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9042e-05 s, 0.0 kB/s 2023-10-07T09:02:22.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0687e-05 s, 0.0 kB/s 2023-10-07T09:02:22.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.861 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.862 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1063e-05 s, 0.0 kB/s 2023-10-07T09:02:22.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.919 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.920 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.920 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4249e-05 s, 0.0 kB/s 2023-10-07T09:02:22.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.920 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:22.975 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:22.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:22.976 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-07T09:02:22.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:22.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.031 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.031 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.032 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2661e-05 s, 0.0 kB/s 2023-10-07T09:02:23.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.087 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.087 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.087 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5989e-05 s, 0.0 kB/s 2023-10-07T09:02:23.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3648e-05 s, 0.0 kB/s 2023-10-07T09:02:23.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.148 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.238e-05 s, 0.0 kB/s 2023-10-07T09:02:23.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0662e-05 s, 0.0 kB/s 2023-10-07T09:02:23.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4375e-05 s, 0.0 kB/s 2023-10-07T09:02:23.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.320 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101104 s, 0.0 kB/s 2023-10-07T09:02:23.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3594e-05 s, 0.0 kB/s 2023-10-07T09:02:23.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.489 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.489 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2736e-05 s, 0.0 kB/s 2023-10-07T09:02:23.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5189e-05 s, 0.0 kB/s 2023-10-07T09:02:23.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6043e-05 s, 0.0 kB/s 2023-10-07T09:02:23.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3283e-05 s, 0.0 kB/s 2023-10-07T09:02:23.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8779e-05 s, 0.0 kB/s 2023-10-07T09:02:23.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1302e-05 s, 0.0 kB/s 2023-10-07T09:02:23.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.829 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-07T09:02:23.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.830 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.886 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.886 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.886 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2307e-05 s, 0.0 kB/s 2023-10-07T09:02:23.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5953e-05 s, 0.0 kB/s 2023-10-07T09:02:23.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:23.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2295e-05 s, 0.0 kB/s 2023-10-07T09:02:23.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.000 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2252e-05 s, 0.0 kB/s 2023-10-07T09:02:24.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4039e-05 s, 0.0 kB/s 2023-10-07T09:02:24.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.170 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9302e-05 s, 0.0 kB/s 2023-10-07T09:02:24.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.229 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2546e-05 s, 0.0 kB/s 2023-10-07T09:02:24.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.230 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9636e-05 s, 0.0 kB/s 2023-10-07T09:02:24.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.284 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4653e-05 s, 0.0 kB/s 2023-10-07T09:02:24.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.378e-05 s, 0.0 kB/s 2023-10-07T09:02:24.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1969e-05 s, 0.0 kB/s 2023-10-07T09:02:24.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.455 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.510 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.510 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.111e-05 s, 0.0 kB/s 2023-10-07T09:02:24.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0986e-05 s, 0.0 kB/s 2023-10-07T09:02:24.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7973e-05 s, 0.0 kB/s 2023-10-07T09:02:24.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.624 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.679 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.679 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.679 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6954e-05 s, 0.0 kB/s 2023-10-07T09:02:24.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.680 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.735 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2044e-05 s, 0.0 kB/s 2023-10-07T09:02:24.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.736 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.2693e-05 s, 0.0 kB/s 2023-10-07T09:02:24.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2339e-05 s, 0.0 kB/s 2023-10-07T09:02:24.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.904 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.904 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.904 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7676e-05 s, 0.0 kB/s 2023-10-07T09:02:24.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.904 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3429e-05 s, 0.0 kB/s 2023-10-07T09:02:24.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:24.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3393e-05 s, 0.0 kB/s 2023-10-07T09:02:25.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.213e-05 s, 0.0 kB/s 2023-10-07T09:02:25.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-07T09:02:25.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.186 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000105532 s, 0.0 kB/s 2023-10-07T09:02:25.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4001e-05 s, 0.0 kB/s 2023-10-07T09:02:25.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.243 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3629e-05 s, 0.0 kB/s 2023-10-07T09:02:25.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.299 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3807e-05 s, 0.0 kB/s 2023-10-07T09:02:25.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.411 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6313e-05 s, 0.0 kB/s 2023-10-07T09:02:25.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-07T09:02:25.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.468 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-07T09:02:25.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.580 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0029e-05 s, 0.0 kB/s 2023-10-07T09:02:25.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.255e-05 s, 0.0 kB/s 2023-10-07T09:02:25.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3396e-05 s, 0.0 kB/s 2023-10-07T09:02:25.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8363e-05 s, 0.0 kB/s 2023-10-07T09:02:25.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1999e-05 s, 0.0 kB/s 2023-10-07T09:02:25.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4599e-05 s, 0.0 kB/s 2023-10-07T09:02:25.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100256 s, 0.0 kB/s 2023-10-07T09:02:25.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:25.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:25.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:25.980 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8089e-05 s, 0.0 kB/s 2023-10-07T09:02:25.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:25.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.036 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3729e-05 s, 0.0 kB/s 2023-10-07T09:02:26.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.092 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1439e-05 s, 0.0 kB/s 2023-10-07T09:02:26.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3111e-05 s, 0.0 kB/s 2023-10-07T09:02:26.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1209e-05 s, 0.0 kB/s 2023-10-07T09:02:26.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0419e-05 s, 0.0 kB/s 2023-10-07T09:02:26.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.318 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1642e-05 s, 0.0 kB/s 2023-10-07T09:02:26.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.375 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.375 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3935e-05 s, 0.0 kB/s 2023-10-07T09:02:26.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1849e-05 s, 0.0 kB/s 2023-10-07T09:02:26.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4021e-05 s, 0.0 kB/s 2023-10-07T09:02:26.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.545 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.352e-05 s, 0.0 kB/s 2023-10-07T09:02:26.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2974e-05 s, 0.0 kB/s 2023-10-07T09:02:26.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5605e-05 s, 0.0 kB/s 2023-10-07T09:02:26.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.714 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.715 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5559e-05 s, 0.0 kB/s 2023-10-07T09:02:26.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2888e-05 s, 0.0 kB/s 2023-10-07T09:02:26.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.828 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2754e-05 s, 0.0 kB/s 2023-10-07T09:02:26.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.883 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.884 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.884 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2543e-05 s, 0.0 kB/s 2023-10-07T09:02:26.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.939 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6309e-05 s, 0.0 kB/s 2023-10-07T09:02:26.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6226e-05 s, 0.0 kB/s 2023-10-07T09:02:26.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:26.997 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.052 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000115832 s, 0.0 kB/s 2023-10-07T09:02:27.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4436e-05 s, 0.0 kB/s 2023-10-07T09:02:27.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0883e-05 s, 0.0 kB/s 2023-10-07T09:02:27.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.167 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4227e-05 s, 0.0 kB/s 2023-10-07T09:02:27.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.224 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.280 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2643e-05 s, 0.0 kB/s 2023-10-07T09:02:27.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6295e-05 s, 0.0 kB/s 2023-10-07T09:02:27.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.394 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2243e-05 s, 0.0 kB/s 2023-10-07T09:02:27.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.450 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.450 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.237e-05 s, 0.0 kB/s 2023-10-07T09:02:27.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3008e-05 s, 0.0 kB/s 2023-10-07T09:02:27.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.562 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-07T09:02:27.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.618 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.618 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.618 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4621e-05 s, 0.0 kB/s 2023-10-07T09:02:27.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106024 s, 0.0 kB/s 2023-10-07T09:02:27.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4055e-05 s, 0.0 kB/s 2023-10-07T09:02:27.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.787 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6566e-05 s, 0.0 kB/s 2023-10-07T09:02:27.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1219e-05 s, 0.0 kB/s 2023-10-07T09:02:27.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1133e-05 s, 0.0 kB/s 2023-10-07T09:02:27.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:27.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:27.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8538e-05 s, 0.0 kB/s 2023-10-07T09:02:27.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:27.958 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.014 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2432e-05 s, 0.0 kB/s 2023-10-07T09:02:28.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2913e-05 s, 0.0 kB/s 2023-10-07T09:02:28.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9528e-05 s, 0.0 kB/s 2023-10-07T09:02:28.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.127 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.183 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1035e-05 s, 0.0 kB/s 2023-10-07T09:02:28.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.184 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.240 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.240 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.240 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6993e-05 s, 0.0 kB/s 2023-10-07T09:02:28.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.297 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7643e-05 s, 0.0 kB/s 2023-10-07T09:02:28.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.297 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1897e-05 s, 0.0 kB/s 2023-10-07T09:02:28.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.355e-05 s, 0.0 kB/s 2023-10-07T09:02:28.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.411 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6099e-05 s, 0.0 kB/s 2023-10-07T09:02:28.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5434e-05 s, 0.0 kB/s 2023-10-07T09:02:28.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.581 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2148e-05 s, 0.0 kB/s 2023-10-07T09:02:28.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.581 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1559e-05 s, 0.0 kB/s 2023-10-07T09:02:28.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2212e-05 s, 0.0 kB/s 2023-10-07T09:02:28.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.695 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5003e-05 s, 0.0 kB/s 2023-10-07T09:02:28.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2432e-05 s, 0.0 kB/s 2023-10-07T09:02:28.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3443e-05 s, 0.0 kB/s 2023-10-07T09:02:28.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5809e-05 s, 0.0 kB/s 2023-10-07T09:02:28.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:28.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:28.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:28.966 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-07T09:02:28.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:28.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.022 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3697e-05 s, 0.0 kB/s 2023-10-07T09:02:29.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.022 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-07T09:02:29.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.135 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5682e-05 s, 0.0 kB/s 2023-10-07T09:02:29.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.191 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.948e-05 s, 0.0 kB/s 2023-10-07T09:02:29.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.192 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3923e-05 s, 0.0 kB/s 2023-10-07T09:02:29.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1544e-05 s, 0.0 kB/s 2023-10-07T09:02:29.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.362 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0926e-05 s, 0.0 kB/s 2023-10-07T09:02:29.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.362 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.419 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3191e-05 s, 0.0 kB/s 2023-10-07T09:02:29.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3652e-05 s, 0.0 kB/s 2023-10-07T09:02:29.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.532 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0442e-05 s, 0.0 kB/s 2023-10-07T09:02:29.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2053e-05 s, 0.0 kB/s 2023-10-07T09:02:29.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.590 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.646 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.646 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.646 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9726e-05 s, 0.0 kB/s 2023-10-07T09:02:29.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.647 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.704 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1347e-05 s, 0.0 kB/s 2023-10-07T09:02:29.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.763 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.763 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.764 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0183e-05 s, 0.0 kB/s 2023-10-07T09:02:29.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.819 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.819 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.819 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6932e-05 s, 0.0 kB/s 2023-10-07T09:02:29.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.820 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.876 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2514e-05 s, 0.0 kB/s 2023-10-07T09:02:29.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.876 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.933 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.933 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.933 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.987e-05 s, 0.0 kB/s 2023-10-07T09:02:29.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.933 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:29.990 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:29.990 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:29.990 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1583e-05 s, 0.0 kB/s 2023-10-07T09:02:29.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:29.990 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1035e-05 s, 0.0 kB/s 2023-10-07T09:02:30.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100812 s, 0.0 kB/s 2023-10-07T09:02:30.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.103 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.159 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.160 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5015e-05 s, 0.0 kB/s 2023-10-07T09:02:30.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8426e-05 s, 0.0 kB/s 2023-10-07T09:02:30.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.272 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.272 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-07T09:02:30.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.329 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3918e-05 s, 0.0 kB/s 2023-10-07T09:02:30.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.329 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.385 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.385 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.386 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7186e-05 s, 0.0 kB/s 2023-10-07T09:02:30.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5672e-05 s, 0.0 kB/s 2023-10-07T09:02:30.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1487e-05 s, 0.0 kB/s 2023-10-07T09:02:30.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.498 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.556 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6792e-05 s, 0.0 kB/s 2023-10-07T09:02:30.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.556 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1766e-05 s, 0.0 kB/s 2023-10-07T09:02:30.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.612 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5266e-05 s, 0.0 kB/s 2023-10-07T09:02:30.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.668 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.724 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2286e-05 s, 0.0 kB/s 2023-10-07T09:02:30.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.782 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2614e-05 s, 0.0 kB/s 2023-10-07T09:02:30.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.837 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-07T09:02:30.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.893 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2037e-05 s, 0.0 kB/s 2023-10-07T09:02:30.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:30.949 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:30.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:30.950 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5689e-05 s, 0.0 kB/s 2023-10-07T09:02:30.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:30.950 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.005 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6658e-05 s, 0.0 kB/s 2023-10-07T09:02:31.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.006 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.062 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.062 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1012e-05 s, 0.0 kB/s 2023-10-07T09:02:31.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2764e-05 s, 0.0 kB/s 2023-10-07T09:02:31.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.119 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.6067e-05 s, 0.0 kB/s 2023-10-07T09:02:31.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.233 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1627e-05 s, 0.0 kB/s 2023-10-07T09:02:31.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9719e-05 s, 0.0 kB/s 2023-10-07T09:02:31.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.289 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4861e-05 s, 0.0 kB/s 2023-10-07T09:02:31.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1854e-05 s, 0.0 kB/s 2023-10-07T09:02:31.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.458 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5963e-05 s, 0.0 kB/s 2023-10-07T09:02:31.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.458 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.514 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.514 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.514 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9859e-05 s, 0.0 kB/s 2023-10-07T09:02:31.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.515 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1246e-05 s, 0.0 kB/s 2023-10-07T09:02:31.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.627 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0546e-05 s, 0.0 kB/s 2023-10-07T09:02:31.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.345e-05 s, 0.0 kB/s 2023-10-07T09:02:31.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.684 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4153e-05 s, 0.0 kB/s 2023-10-07T09:02:31.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.740 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3742e-05 s, 0.0 kB/s 2023-10-07T09:02:31.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.3284e-05 s, 0.0 kB/s 2023-10-07T09:02:31.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.909 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.909 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2484e-05 s, 0.0 kB/s 2023-10-07T09:02:31.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:31.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:31.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:31.965 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6231e-05 s, 0.0 kB/s 2023-10-07T09:02:31.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:31.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.023 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2533e-05 s, 0.0 kB/s 2023-10-07T09:02:32.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9006e-05 s, 0.0 kB/s 2023-10-07T09:02:32.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.080 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4841e-05 s, 0.0 kB/s 2023-10-07T09:02:32.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1871e-05 s, 0.0 kB/s 2023-10-07T09:02:32.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.194 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5883e-05 s, 0.0 kB/s 2023-10-07T09:02:32.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.251 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.995e-05 s, 0.0 kB/s 2023-10-07T09:02:32.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0665e-05 s, 0.0 kB/s 2023-10-07T09:02:32.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0185e-05 s, 0.0 kB/s 2023-10-07T09:02:32.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2102e-05 s, 0.0 kB/s 2023-10-07T09:02:32.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.476 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3967e-05 s, 0.0 kB/s 2023-10-07T09:02:32.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.532 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.588 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.588 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8382e-05 s, 0.0 kB/s 2023-10-07T09:02:32.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.589 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1004e-05 s, 0.0 kB/s 2023-10-07T09:02:32.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.645 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8485e-05 s, 0.0 kB/s 2023-10-07T09:02:32.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.703 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0819e-05 s, 0.0 kB/s 2023-10-07T09:02:32.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2672e-05 s, 0.0 kB/s 2023-10-07T09:02:32.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.816 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.872 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.241e-05 s, 0.0 kB/s 2023-10-07T09:02:32.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3753e-05 s, 0.0 kB/s 2023-10-07T09:02:32.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:32.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:32.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:32.986 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6102e-05 s, 0.0 kB/s 2023-10-07T09:02:32.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:32.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2196e-05 s, 0.0 kB/s 2023-10-07T09:02:33.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.046 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3779e-05 s, 0.0 kB/s 2023-10-07T09:02:33.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.155 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.155 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.155 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4762e-05 s, 0.0 kB/s 2023-10-07T09:02:33.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2515e-05 s, 0.0 kB/s 2023-10-07T09:02:33.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.213 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.270 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0973e-05 s, 0.0 kB/s 2023-10-07T09:02:33.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.270 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.325 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.325 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.401e-05 s, 0.0 kB/s 2023-10-07T09:02:33.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.383 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3636e-05 s, 0.0 kB/s 2023-10-07T09:02:33.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.440 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3095e-05 s, 0.0 kB/s 2023-10-07T09:02:33.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1919e-05 s, 0.0 kB/s 2023-10-07T09:02:33.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3083e-05 s, 0.0 kB/s 2023-10-07T09:02:33.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3484e-05 s, 0.0 kB/s 2023-10-07T09:02:33.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.665 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.665 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3338e-05 s, 0.0 kB/s 2023-10-07T09:02:33.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1911e-05 s, 0.0 kB/s 2023-10-07T09:02:33.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7769e-05 s, 0.0 kB/s 2023-10-07T09:02:33.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.834 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0182e-05 s, 0.0 kB/s 2023-10-07T09:02:33.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.836 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.892 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.892 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.892 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8355e-05 s, 0.0 kB/s 2023-10-07T09:02:33.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.892 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:33.948 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:33.948 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:33.948 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2236e-05 s, 0.0 kB/s 2023-10-07T09:02:33.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:33.948 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.004 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.004 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5906e-05 s, 0.0 kB/s 2023-10-07T09:02:34.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.005 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.061 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.062 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1019e-05 s, 0.0 kB/s 2023-10-07T09:02:34.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3314e-05 s, 0.0 kB/s 2023-10-07T09:02:34.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.175 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0322e-05 s, 0.0 kB/s 2023-10-07T09:02:34.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.175 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.231 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.232 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.804e-05 s, 0.0 kB/s 2023-10-07T09:02:34.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.232 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.287 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.288 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4876e-05 s, 0.0 kB/s 2023-10-07T09:02:34.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.344 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7543e-05 s, 0.0 kB/s 2023-10-07T09:02:34.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.344 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.400 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-07T09:02:34.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5236e-05 s, 0.0 kB/s 2023-10-07T09:02:34.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0063e-05 s, 0.0 kB/s 2023-10-07T09:02:34.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3986e-05 s, 0.0 kB/s 2023-10-07T09:02:34.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.625 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6676e-05 s, 0.0 kB/s 2023-10-07T09:02:34.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.626 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3041e-05 s, 0.0 kB/s 2023-10-07T09:02:34.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.682 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.738 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.738 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6082e-05 s, 0.0 kB/s 2023-10-07T09:02:34.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.794 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.408e-05 s, 0.0 kB/s 2023-10-07T09:02:34.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2927e-05 s, 0.0 kB/s 2023-10-07T09:02:34.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.907 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.907 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.907 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.289e-05 s, 0.0 kB/s 2023-10-07T09:02:34.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:34.963 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:34.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:34.964 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5573e-05 s, 0.0 kB/s 2023-10-07T09:02:34.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:34.964 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.020 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.020 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.020 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.2755e-05 s, 0.0 kB/s 2023-10-07T09:02:35.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.076 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.077 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4028e-05 s, 0.0 kB/s 2023-10-07T09:02:35.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2116e-05 s, 0.0 kB/s 2023-10-07T09:02:35.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.189 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.190 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4482e-05 s, 0.0 kB/s 2023-10-07T09:02:35.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5589e-05 s, 0.0 kB/s 2023-10-07T09:02:35.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.246 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4889e-05 s, 0.0 kB/s 2023-10-07T09:02:35.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.304 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9366e-05 s, 0.0 kB/s 2023-10-07T09:02:35.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.362 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9307e-05 s, 0.0 kB/s 2023-10-07T09:02:35.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.417 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.3154e-05 s, 0.0 kB/s 2023-10-07T09:02:35.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.530 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.530 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3e-05 s, 0.0 kB/s 2023-10-07T09:02:35.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.531 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9361e-05 s, 0.0 kB/s 2023-10-07T09:02:35.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.587 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.644 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.644 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.644 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3599e-05 s, 0.0 kB/s 2023-10-07T09:02:35.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.645 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8495e-05 s, 0.0 kB/s 2023-10-07T09:02:35.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.201e-05 s, 0.0 kB/s 2023-10-07T09:02:35.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1451e-05 s, 0.0 kB/s 2023-10-07T09:02:35.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.815 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2134e-05 s, 0.0 kB/s 2023-10-07T09:02:35.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0888e-05 s, 0.0 kB/s 2023-10-07T09:02:35.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:35.986 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:35.986 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:35.986 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0743e-05 s, 0.0 kB/s 2023-10-07T09:02:35.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:35.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4876e-05 s, 0.0 kB/s 2023-10-07T09:02:36.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.012e-05 s, 0.0 kB/s 2023-10-07T09:02:36.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.156 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0493e-05 s, 0.0 kB/s 2023-10-07T09:02:36.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.213 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-07T09:02:36.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.213 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.268 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.269 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5774e-05 s, 0.0 kB/s 2023-10-07T09:02:36.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.269 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.325 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.325 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.325 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-07T09:02:36.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.382 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.175e-05 s, 0.0 kB/s 2023-10-07T09:02:36.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.382 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.0085e-05 s, 0.0 kB/s 2023-10-07T09:02:36.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.439 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.495 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101226 s, 0.0 kB/s 2023-10-07T09:02:36.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.495 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.552 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5786e-05 s, 0.0 kB/s 2023-10-07T09:02:36.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104868 s, 0.0 kB/s 2023-10-07T09:02:36.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.608 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5495e-05 s, 0.0 kB/s 2023-10-07T09:02:36.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.664 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.720 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5805e-05 s, 0.0 kB/s 2023-10-07T09:02:36.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.778 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.778 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-07T09:02:36.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.834 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.834 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9283e-05 s, 0.0 kB/s 2023-10-07T09:02:36.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.834 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.076e-05 s, 0.0 kB/s 2023-10-07T09:02:36.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:36.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:36.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:36.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.6358e-05 s, 0.0 kB/s 2023-10-07T09:02:36.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:36.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.006 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.006 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.006 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-07T09:02:37.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.007 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5122e-05 s, 0.0 kB/s 2023-10-07T09:02:37.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.063 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.119 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1819e-05 s, 0.0 kB/s 2023-10-07T09:02:37.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.119 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.175 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.175 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.175 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1327e-05 s, 0.0 kB/s 2023-10-07T09:02:37.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.232 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.232 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1551e-05 s, 0.0 kB/s 2023-10-07T09:02:37.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.232 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.288 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.288 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4068e-05 s, 0.0 kB/s 2023-10-07T09:02:37.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5646e-05 s, 0.0 kB/s 2023-10-07T09:02:37.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.400 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.401 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.401 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4365e-05 s, 0.0 kB/s 2023-10-07T09:02:37.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4396e-05 s, 0.0 kB/s 2023-10-07T09:02:37.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0636e-05 s, 0.0 kB/s 2023-10-07T09:02:37.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1287e-05 s, 0.0 kB/s 2023-10-07T09:02:37.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.013e-05 s, 0.0 kB/s 2023-10-07T09:02:37.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-07T09:02:37.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.681 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0118e-05 s, 0.0 kB/s 2023-10-07T09:02:37.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.793 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1722e-05 s, 0.0 kB/s 2023-10-07T09:02:37.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.324e-05 s, 0.0 kB/s 2023-10-07T09:02:37.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0888e-05 s, 0.0 kB/s 2023-10-07T09:02:37.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:37.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:37.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:37.962 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-07T09:02:37.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:37.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0026e-05 s, 0.0 kB/s 2023-10-07T09:02:38.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.075 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.075 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-07T09:02:38.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.075 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2896e-05 s, 0.0 kB/s 2023-10-07T09:02:38.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.187 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-07T09:02:38.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.244 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6969e-05 s, 0.0 kB/s 2023-10-07T09:02:38.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1286e-05 s, 0.0 kB/s 2023-10-07T09:02:38.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.356 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4281e-05 s, 0.0 kB/s 2023-10-07T09:02:38.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3714e-05 s, 0.0 kB/s 2023-10-07T09:02:38.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.488 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2297e-05 s, 0.0 kB/s 2023-10-07T09:02:38.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2376e-05 s, 0.0 kB/s 2023-10-07T09:02:38.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.581 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5106e-05 s, 0.0 kB/s 2023-10-07T09:02:38.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.071e-05 s, 0.0 kB/s 2023-10-07T09:02:38.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8141e-05 s, 0.0 kB/s 2023-10-07T09:02:38.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3356e-05 s, 0.0 kB/s 2023-10-07T09:02:38.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.807 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.807 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-07T09:02:38.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3489e-05 s, 0.0 kB/s 2023-10-07T09:02:38.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:38.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:38.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:38.921 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3806e-05 s, 0.0 kB/s 2023-10-07T09:02:38.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:38.921 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100249 s, 0.0 kB/s 2023-10-07T09:02:39.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.030 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.941e-05 s, 0.0 kB/s 2023-10-07T09:02:39.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.085 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.085 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.086 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8722e-05 s, 0.0 kB/s 2023-10-07T09:02:39.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.086 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7941e-05 s, 0.0 kB/s 2023-10-07T09:02:39.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.143 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.198 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3137e-05 s, 0.0 kB/s 2023-10-07T09:02:39.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.199 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.255 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.255 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.255 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7666e-05 s, 0.0 kB/s 2023-10-07T09:02:39.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.255 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.311 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.311 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7876e-05 s, 0.0 kB/s 2023-10-07T09:02:39.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.312 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.367 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.367 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.367 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.788e-05 s, 0.0 kB/s 2023-10-07T09:02:39.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.368 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.424 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.424 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.425 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2187e-05 s, 0.0 kB/s 2023-10-07T09:02:39.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.425 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3612e-05 s, 0.0 kB/s 2023-10-07T09:02:39.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.481 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3535e-05 s, 0.0 kB/s 2023-10-07T09:02:39.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.537 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.592 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.593 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.593 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7742e-05 s, 0.0 kB/s 2023-10-07T09:02:39.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.593 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.649 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.649 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.649 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3883e-05 s, 0.0 kB/s 2023-10-07T09:02:39.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1884e-05 s, 0.0 kB/s 2023-10-07T09:02:39.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.762 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.762 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.762 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000127906 s, 0.0 kB/s 2023-10-07T09:02:39.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.762 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.817 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.818 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.818 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.076e-05 s, 0.0 kB/s 2023-10-07T09:02:39.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.819 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-07T09:02:39.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.875 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-07T09:02:39.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:39.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:39.988 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:39.988 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-07T09:02:39.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:39.988 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.045 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.045 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.045 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3425e-05 s, 0.0 kB/s 2023-10-07T09:02:40.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.045 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.102 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.102 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.776e-05 s, 0.0 kB/s 2023-10-07T09:02:40.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3146e-05 s, 0.0 kB/s 2023-10-07T09:02:40.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.158 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8844e-05 s, 0.0 kB/s 2023-10-07T09:02:40.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.271 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.271 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1398e-05 s, 0.0 kB/s 2023-10-07T09:02:40.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.271 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1204e-05 s, 0.0 kB/s 2023-10-07T09:02:40.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-07T09:02:40.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.440 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5475e-05 s, 0.0 kB/s 2023-10-07T09:02:40.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6319e-05 s, 0.0 kB/s 2023-10-07T09:02:40.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.550 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.315e-05 s, 0.0 kB/s 2023-10-07T09:02:40.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.551 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-07T09:02:40.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.608 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4049e-05 s, 0.0 kB/s 2023-10-07T09:02:40.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.663 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.718 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.719 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2e-05 s, 0 B/s 2023-10-07T09:02:40.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.719 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.774 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.774 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.775 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-07T09:02:40.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.775 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.832 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-07T09:02:40.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.886 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8448e-05 s, 0.0 kB/s 2023-10-07T09:02:40.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3389e-05 s, 0.0 kB/s 2023-10-07T09:02:40.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:40.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000111922 s, 0.0 kB/s 2023-10-07T09:02:41.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.000 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-07T09:02:41.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.056 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0579e-05 s, 0.0 kB/s 2023-10-07T09:02:41.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.169 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5676e-05 s, 0.0 kB/s 2023-10-07T09:02:41.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.224 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.0933e-05 s, 0.0 kB/s 2023-10-07T09:02:41.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.225 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7948e-05 s, 0.0 kB/s 2023-10-07T09:02:41.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.337 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.337 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.337 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6382e-05 s, 0.0 kB/s 2023-10-07T09:02:41.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.394 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1599e-05 s, 0.0 kB/s 2023-10-07T09:02:41.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.450 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.450 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.450 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5552e-05 s, 0.0 kB/s 2023-10-07T09:02:41.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.507 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2887e-05 s, 0.0 kB/s 2023-10-07T09:02:41.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.507 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3455e-05 s, 0.0 kB/s 2023-10-07T09:02:41.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-07T09:02:41.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.620 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3345e-05 s, 0.0 kB/s 2023-10-07T09:02:41.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.677 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.733 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3259e-05 s, 0.0 kB/s 2023-10-07T09:02:41.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.733 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.789 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.4513e-05 s, 0.0 kB/s 2023-10-07T09:02:41.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.789 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0764e-05 s, 0.0 kB/s 2023-10-07T09:02:41.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0596e-05 s, 0.0 kB/s 2023-10-07T09:02:41.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8283e-05 s, 0.0 kB/s 2023-10-07T09:02:41.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:41.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:41.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:02:42.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:02:42.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6382e-05 s, 0.0 kB/s 2023-10-07T09:02:42.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5222e-05 s, 0.0 kB/s 2023-10-07T09:02:42.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.129 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3889e-05 s, 0.0 kB/s 2023-10-07T09:02:42.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.186 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3148e-05 s, 0.0 kB/s 2023-10-07T09:02:42.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.186 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.242 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.5629e-05 s, 0.0 kB/s 2023-10-07T09:02:42.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.299 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3098e-05 s, 0.0 kB/s 2023-10-07T09:02:42.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4477e-05 s, 0.0 kB/s 2023-10-07T09:02:42.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.227e-05 s, 0.0 kB/s 2023-10-07T09:02:42.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.470 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0973e-05 s, 0.0 kB/s 2023-10-07T09:02:42.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5132e-05 s, 0.0 kB/s 2023-10-07T09:02:42.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.584 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5639e-05 s, 0.0 kB/s 2023-10-07T09:02:42.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.641 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.641 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-07T09:02:42.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.698 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0752e-05 s, 0.0 kB/s 2023-10-07T09:02:42.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4003e-05 s, 0.0 kB/s 2023-10-07T09:02:42.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1769e-05 s, 0.0 kB/s 2023-10-07T09:02:42.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.868 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.868 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7382e-05 s, 0.0 kB/s 2023-10-07T09:02:42.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7419e-05 s, 0.0 kB/s 2023-10-07T09:02:42.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:42.982 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:42.982 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:42.982 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3542e-05 s, 0.0 kB/s 2023-10-07T09:02:42.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:42.983 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7349e-05 s, 0.0 kB/s 2023-10-07T09:02:43.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2813e-05 s, 0.0 kB/s 2023-10-07T09:02:43.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.152 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.152 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.152 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0636e-05 s, 0.0 kB/s 2023-10-07T09:02:43.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.209 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-07T09:02:43.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-07T09:02:43.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2313e-05 s, 0.0 kB/s 2023-10-07T09:02:43.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.321 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.377 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.377 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.377 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000172568 s, 0.0 kB/s 2023-10-07T09:02:43.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9824e-05 s, 0.0 kB/s 2023-10-07T09:02:43.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.435 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7753e-05 s, 0.0 kB/s 2023-10-07T09:02:43.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2786e-05 s, 0.0 kB/s 2023-10-07T09:02:43.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1959e-05 s, 0.0 kB/s 2023-10-07T09:02:43.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.660 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3861e-05 s, 0.0 kB/s 2023-10-07T09:02:43.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.660 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5899e-05 s, 0.0 kB/s 2023-10-07T09:02:43.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.773 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6426e-05 s, 0.0 kB/s 2023-10-07T09:02:43.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.774 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1171e-05 s, 0.0 kB/s 2023-10-07T09:02:43.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-07T09:02:43.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5145e-05 s, 0.0 kB/s 2023-10-07T09:02:43.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.352e-05 s, 0.0 kB/s 2023-10-07T09:02:43.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:43.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2739e-05 s, 0.0 kB/s 2023-10-07T09:02:44.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2855e-05 s, 0.0 kB/s 2023-10-07T09:02:44.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-07T09:02:44.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.222 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2556e-05 s, 0.0 kB/s 2023-10-07T09:02:44.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0234e-05 s, 0.0 kB/s 2023-10-07T09:02:44.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-07T09:02:44.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.391 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2273e-05 s, 0.0 kB/s 2023-10-07T09:02:44.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.097e-05 s, 0.0 kB/s 2023-10-07T09:02:44.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.503 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-07T09:02:44.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.505 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.559 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.560 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7416e-05 s, 0.0 kB/s 2023-10-07T09:02:44.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.615 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0469e-05 s, 0.0 kB/s 2023-10-07T09:02:44.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.616 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2613e-05 s, 0.0 kB/s 2023-10-07T09:02:44.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.729 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.729 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.339e-05 s, 0.0 kB/s 2023-10-07T09:02:44.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0132e-05 s, 0.0 kB/s 2023-10-07T09:02:44.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.841 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.842 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.842 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2696e-05 s, 0.0 kB/s 2023-10-07T09:02:44.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.842 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.898 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.898 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9095e-05 s, 0.0 kB/s 2023-10-07T09:02:44.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.898 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:44.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2548e-05 s, 0.0 kB/s 2023-10-07T09:02:44.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:44.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.011 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000119929 s, 0.0 kB/s 2023-10-07T09:02:45.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5173e-05 s, 0.0 kB/s 2023-10-07T09:02:45.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.169 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.170 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6029e-05 s, 0.0 kB/s 2023-10-07T09:02:45.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4199e-05 s, 0.0 kB/s 2023-10-07T09:02:45.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.244 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5814e-05 s, 0.0 kB/s 2023-10-07T09:02:45.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.245 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.301 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.301 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.789e-05 s, 0.0 kB/s 2023-10-07T09:02:45.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.356 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5806e-05 s, 0.0 kB/s 2023-10-07T09:02:45.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.358 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.413 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0669e-05 s, 0.0 kB/s 2023-10-07T09:02:45.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7309e-05 s, 0.0 kB/s 2023-10-07T09:02:45.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1561e-05 s, 0.0 kB/s 2023-10-07T09:02:45.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.582 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3273e-05 s, 0.0 kB/s 2023-10-07T09:02:45.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.638 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1101e-05 s, 0.0 kB/s 2023-10-07T09:02:45.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.694 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.695 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1937e-05 s, 0.0 kB/s 2023-10-07T09:02:45.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.695 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9117e-05 s, 0.0 kB/s 2023-10-07T09:02:45.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.807 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.807 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.808 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1772e-05 s, 0.0 kB/s 2023-10-07T09:02:45.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.57e-05 s, 0.0 kB/s 2023-10-07T09:02:45.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.923 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.923 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.923 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-07T09:02:45.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4473e-05 s, 0.0 kB/s 2023-10-07T09:02:45.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:45.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3417e-05 s, 0.0 kB/s 2023-10-07T09:02:46.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.9337e-05 s, 0.0 kB/s 2023-10-07T09:02:46.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3829e-05 s, 0.0 kB/s 2023-10-07T09:02:46.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2506e-05 s, 0.0 kB/s 2023-10-07T09:02:46.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3868e-05 s, 0.0 kB/s 2023-10-07T09:02:46.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.317 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.317 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0627e-05 s, 0.0 kB/s 2023-10-07T09:02:46.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.742e-05 s, 0.0 kB/s 2023-10-07T09:02:46.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.430 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.430 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000109839 s, 0.0 kB/s 2023-10-07T09:02:46.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.488 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7349e-05 s, 0.0 kB/s 2023-10-07T09:02:46.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.545 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2237e-05 s, 0.0 kB/s 2023-10-07T09:02:46.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9562e-05 s, 0.0 kB/s 2023-10-07T09:02:46.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3356e-05 s, 0.0 kB/s 2023-10-07T09:02:46.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.658 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.714 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-07T09:02:46.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2971e-05 s, 0.0 kB/s 2023-10-07T09:02:46.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1509e-05 s, 0.0 kB/s 2023-10-07T09:02:46.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1252e-05 s, 0.0 kB/s 2023-10-07T09:02:46.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.938 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.938 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-07T09:02:46.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.939 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:46.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:46.995 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:46.995 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2635e-05 s, 0.0 kB/s 2023-10-07T09:02:46.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:46.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2643e-05 s, 0.0 kB/s 2023-10-07T09:02:47.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.107 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.107 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1739e-05 s, 0.0 kB/s 2023-10-07T09:02:47.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.108 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.166 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.166 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7395e-05 s, 0.0 kB/s 2023-10-07T09:02:47.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1738e-05 s, 0.0 kB/s 2023-10-07T09:02:47.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.277 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.278 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5171e-05 s, 0.0 kB/s 2023-10-07T09:02:47.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104371 s, 0.0 kB/s 2023-10-07T09:02:47.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4343e-05 s, 0.0 kB/s 2023-10-07T09:02:47.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.445 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1022e-05 s, 0.0 kB/s 2023-10-07T09:02:47.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.446 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.502 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0652e-05 s, 0.0 kB/s 2023-10-07T09:02:47.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.502 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0804e-05 s, 0.0 kB/s 2023-10-07T09:02:47.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.614 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.614 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.614 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2539e-05 s, 0.0 kB/s 2023-10-07T09:02:47.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.614 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1946e-05 s, 0.0 kB/s 2023-10-07T09:02:47.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.725 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.725 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.725 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5192e-05 s, 0.0 kB/s 2023-10-07T09:02:47.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.726 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1274e-05 s, 0.0 kB/s 2023-10-07T09:02:47.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4188e-05 s, 0.0 kB/s 2023-10-07T09:02:47.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4256e-05 s, 0.0 kB/s 2023-10-07T09:02:47.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000109252 s, 0.0 kB/s 2023-10-07T09:02:47.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:47.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.008 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.008 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.959e-05 s, 0.0 kB/s 2023-10-07T09:02:48.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.008 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2899e-05 s, 0.0 kB/s 2023-10-07T09:02:48.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.065 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.0018e-05 s, 0.0 kB/s 2023-10-07T09:02:48.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-07T09:02:48.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2385e-05 s, 0.0 kB/s 2023-10-07T09:02:48.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.234 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.286e-05 s, 0.0 kB/s 2023-10-07T09:02:48.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.290 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7456e-05 s, 0.0 kB/s 2023-10-07T09:02:48.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.346 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-07T09:02:48.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.405 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9649e-05 s, 0.0 kB/s 2023-10-07T09:02:48.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.518 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.519 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.519 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1666e-05 s, 0.0 kB/s 2023-10-07T09:02:48.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.519 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.575 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.575 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.575 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3786e-05 s, 0.0 kB/s 2023-10-07T09:02:48.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.576 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-07T09:02:48.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.632 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.687 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4251e-05 s, 0.0 kB/s 2023-10-07T09:02:48.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.688 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.744 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.744 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.744 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6582e-05 s, 0.0 kB/s 2023-10-07T09:02:48.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.744 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4528e-05 s, 0.0 kB/s 2023-10-07T09:02:48.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.856 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.857 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.857 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5492e-05 s, 0.0 kB/s 2023-10-07T09:02:48.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.857 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0562e-05 s, 0.0 kB/s 2023-10-07T09:02:48.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.913 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2299e-05 s, 0.0 kB/s 2023-10-07T09:02:48.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:48.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.027 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.027 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.0173e-05 s, 0.0 kB/s 2023-10-07T09:02:49.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.084 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9659e-05 s, 0.0 kB/s 2023-10-07T09:02:49.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3982e-05 s, 0.0 kB/s 2023-10-07T09:02:49.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1433e-05 s, 0.0 kB/s 2023-10-07T09:02:49.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.253 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.253 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.253 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1095e-05 s, 0.0 kB/s 2023-10-07T09:02:49.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1178e-05 s, 0.0 kB/s 2023-10-07T09:02:49.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.309 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.364 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.365 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.365 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7458e-05 s, 0.0 kB/s 2023-10-07T09:02:49.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.421 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.421 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.421 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5303e-05 s, 0.0 kB/s 2023-10-07T09:02:49.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.421 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.478 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2953e-05 s, 0.0 kB/s 2023-10-07T09:02:49.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.533 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-07T09:02:49.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.534 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.590 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5912e-05 s, 0.0 kB/s 2023-10-07T09:02:49.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.590 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-07T09:02:49.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.702 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.702 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8734e-05 s, 0.0 kB/s 2023-10-07T09:02:49.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.758 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0489e-05 s, 0.0 kB/s 2023-10-07T09:02:49.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6602e-05 s, 0.0 kB/s 2023-10-07T09:02:49.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2607e-05 s, 0.0 kB/s 2023-10-07T09:02:49.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.927 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3722e-05 s, 0.0 kB/s 2023-10-07T09:02:49.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.927 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3435e-05 s, 0.0 kB/s 2023-10-07T09:02:49.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:49.984 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.040 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.040 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.040 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0385e-05 s, 0.0 kB/s 2023-10-07T09:02:50.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.097 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.342e-05 s, 0.0 kB/s 2023-10-07T09:02:50.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1668e-05 s, 0.0 kB/s 2023-10-07T09:02:50.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0269e-05 s, 0.0 kB/s 2023-10-07T09:02:50.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.268 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.268 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.268 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9875e-05 s, 0.0 kB/s 2023-10-07T09:02:50.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1696e-05 s, 0.0 kB/s 2023-10-07T09:02:50.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.380 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.380 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.380 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1232e-05 s, 0.0 kB/s 2023-10-07T09:02:50.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.381 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1477e-05 s, 0.0 kB/s 2023-10-07T09:02:50.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.184e-05 s, 0.0 kB/s 2023-10-07T09:02:50.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.494 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6779e-05 s, 0.0 kB/s 2023-10-07T09:02:50.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.551 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5549e-05 s, 0.0 kB/s 2023-10-07T09:02:50.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.607 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6639e-05 s, 0.0 kB/s 2023-10-07T09:02:50.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3423e-05 s, 0.0 kB/s 2023-10-07T09:02:50.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.799 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.828e-05 s, 0.0 kB/s 2023-10-07T09:02:50.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.799 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2362e-05 s, 0.0 kB/s 2023-10-07T09:02:50.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.856 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.912 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.912 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.912 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4922e-05 s, 0.0 kB/s 2023-10-07T09:02:50.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.912 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:50.969 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:50.969 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:50.969 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0911e-05 s, 0.0 kB/s 2023-10-07T09:02:50.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:50.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8245e-05 s, 0.0 kB/s 2023-10-07T09:02:51.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6459e-05 s, 0.0 kB/s 2023-10-07T09:02:51.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9895e-05 s, 0.0 kB/s 2023-10-07T09:02:51.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5701e-05 s, 0.0 kB/s 2023-10-07T09:02:51.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.253 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.253 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.253 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1726e-05 s, 0.0 kB/s 2023-10-07T09:02:51.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0133e-05 s, 0.0 kB/s 2023-10-07T09:02:51.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.310 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9561e-05 s, 0.0 kB/s 2023-10-07T09:02:51.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.366 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.9443e-05 s, 0.0 kB/s 2023-10-07T09:02:51.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.478 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.478 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.478 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-07T09:02:51.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.479 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4972e-05 s, 0.0 kB/s 2023-10-07T09:02:51.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1629e-05 s, 0.0 kB/s 2023-10-07T09:02:51.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.592 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1324e-05 s, 0.0 kB/s 2023-10-07T09:02:51.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.648 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.704 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1059e-05 s, 0.0 kB/s 2023-10-07T09:02:51.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1414e-05 s, 0.0 kB/s 2023-10-07T09:02:51.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4099e-05 s, 0.0 kB/s 2023-10-07T09:02:51.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.816 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.7559e-05 s, 0.0 kB/s 2023-10-07T09:02:51.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.928 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.149e-05 s, 0.0 kB/s 2023-10-07T09:02:51.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:51.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:51.984 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2592e-05 s, 0.0 kB/s 2023-10-07T09:02:51.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:51.984 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1572e-05 s, 0.0 kB/s 2023-10-07T09:02:52.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.096 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.096 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2811e-05 s, 0.0 kB/s 2023-10-07T09:02:52.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2492e-05 s, 0.0 kB/s 2023-10-07T09:02:52.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2191e-05 s, 0.0 kB/s 2023-10-07T09:02:52.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4884e-05 s, 0.0 kB/s 2023-10-07T09:02:52.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-07T09:02:52.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.322 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7333e-05 s, 0.0 kB/s 2023-10-07T09:02:52.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6459e-05 s, 0.0 kB/s 2023-10-07T09:02:52.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.435 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8437e-05 s, 0.0 kB/s 2023-10-07T09:02:52.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.548 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0616e-05 s, 0.0 kB/s 2023-10-07T09:02:52.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.549 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.605 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0525e-05 s, 0.0 kB/s 2023-10-07T09:02:52.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.605 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0176e-05 s, 0.0 kB/s 2023-10-07T09:02:52.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.661 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.408e-05 s, 0.0 kB/s 2023-10-07T09:02:52.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7152e-05 s, 0.0 kB/s 2023-10-07T09:02:52.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.829 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7539e-05 s, 0.0 kB/s 2023-10-07T09:02:52.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.887 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-07T09:02:52.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1725e-05 s, 0.0 kB/s 2023-10-07T09:02:52.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:52.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:52.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:52.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:52.999 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0096e-05 s, 0.0 kB/s 2023-10-07T09:02:53.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.000 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8929e-05 s, 0.0 kB/s 2023-10-07T09:02:53.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.056 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.112 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.092e-05 s, 0.0 kB/s 2023-10-07T09:02:53.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.170 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2308e-05 s, 0.0 kB/s 2023-10-07T09:02:53.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.227 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000115389 s, 0.0 kB/s 2023-10-07T09:02:53.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.227 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.284 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.284 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1832e-05 s, 0.0 kB/s 2023-10-07T09:02:53.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.284 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.138e-05 s, 0.0 kB/s 2023-10-07T09:02:53.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0981e-05 s, 0.0 kB/s 2023-10-07T09:02:53.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.397 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.452 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9364e-05 s, 0.0 kB/s 2023-10-07T09:02:53.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.453 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.509 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104653 s, 0.0 kB/s 2023-10-07T09:02:53.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3698e-05 s, 0.0 kB/s 2023-10-07T09:02:53.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.621 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2324e-05 s, 0.0 kB/s 2023-10-07T09:02:53.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.677 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.678 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.678 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0472e-05 s, 0.0 kB/s 2023-10-07T09:02:53.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2036e-05 s, 0.0 kB/s 2023-10-07T09:02:53.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.734 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.789 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.789 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.789 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-07T09:02:53.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.846 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.846 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-07T09:02:53.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.846 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3969e-05 s, 0.0 kB/s 2023-10-07T09:02:53.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:53.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:53.959 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:53.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4404e-05 s, 0.0 kB/s 2023-10-07T09:02:53.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:53.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6148e-05 s, 0.0 kB/s 2023-10-07T09:02:54.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5819e-05 s, 0.0 kB/s 2023-10-07T09:02:54.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4376e-05 s, 0.0 kB/s 2023-10-07T09:02:54.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.185 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2148e-05 s, 0.0 kB/s 2023-10-07T09:02:54.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.186 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.241 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7792e-05 s, 0.0 kB/s 2023-10-07T09:02:54.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1886e-05 s, 0.0 kB/s 2023-10-07T09:02:54.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.068e-05 s, 0.0 kB/s 2023-10-07T09:02:54.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9669e-05 s, 0.0 kB/s 2023-10-07T09:02:54.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.467 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1734e-05 s, 0.0 kB/s 2023-10-07T09:02:54.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.468 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.524 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.524 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.36e-05 s, 0.0 kB/s 2023-10-07T09:02:54.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.524 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.580 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.216e-05 s, 0.0 kB/s 2023-10-07T09:02:54.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.580 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.636 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.636 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.636 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3359e-05 s, 0.0 kB/s 2023-10-07T09:02:54.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.636 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.693 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.693 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.693 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-07T09:02:54.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.693 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.47e-05 s, 0.0 kB/s 2023-10-07T09:02:54.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.806 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.806 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1859e-05 s, 0.0 kB/s 2023-10-07T09:02:54.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.806 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.862 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-07T09:02:54.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.920 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3812e-05 s, 0.0 kB/s 2023-10-07T09:02:54.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.920 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:54.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:54.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:54.976 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2348e-05 s, 0.0 kB/s 2023-10-07T09:02:54.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:54.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2634e-05 s, 0.0 kB/s 2023-10-07T09:02:55.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5559e-05 s, 0.0 kB/s 2023-10-07T09:02:55.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.145 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.145 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.145 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5536e-05 s, 0.0 kB/s 2023-10-07T09:02:55.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.145 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6812e-05 s, 0.0 kB/s 2023-10-07T09:02:55.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.202 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.258 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.258 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.6587e-05 s, 0.0 kB/s 2023-10-07T09:02:55.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.258 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.314 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.314 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1492e-05 s, 0.0 kB/s 2023-10-07T09:02:55.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.315 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1304e-05 s, 0.0 kB/s 2023-10-07T09:02:55.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.428 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.428 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.428 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6459e-05 s, 0.0 kB/s 2023-10-07T09:02:55.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.485 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3623e-05 s, 0.0 kB/s 2023-10-07T09:02:55.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6282e-05 s, 0.0 kB/s 2023-10-07T09:02:55.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9773e-05 s, 0.0 kB/s 2023-10-07T09:02:55.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.655 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-07T09:02:55.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.655 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.712 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.712 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3822e-05 s, 0.0 kB/s 2023-10-07T09:02:55.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4233e-05 s, 0.0 kB/s 2023-10-07T09:02:55.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.827 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5799e-05 s, 0.0 kB/s 2023-10-07T09:02:55.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.911 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-07T09:02:55.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.912 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0553e-05 s, 0.0 kB/s 2023-10-07T09:02:55.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4058e-05 s, 0.0 kB/s 2023-10-07T09:02:55.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:55.984 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.040 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.040 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.040 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1469e-05 s, 0.0 kB/s 2023-10-07T09:02:56.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.097 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1927e-05 s, 0.0 kB/s 2023-10-07T09:02:56.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5727e-05 s, 0.0 kB/s 2023-10-07T09:02:56.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104835 s, 0.0 kB/s 2023-10-07T09:02:56.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.267 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4253e-05 s, 0.0 kB/s 2023-10-07T09:02:56.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.323 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9776e-05 s, 0.0 kB/s 2023-10-07T09:02:56.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.378 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1757e-05 s, 0.0 kB/s 2023-10-07T09:02:56.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.436 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5039e-05 s, 0.0 kB/s 2023-10-07T09:02:56.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3017e-05 s, 0.0 kB/s 2023-10-07T09:02:56.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.492 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.341e-05 s, 0.0 kB/s 2023-10-07T09:02:56.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.549 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.604 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3296e-05 s, 0.0 kB/s 2023-10-07T09:02:56.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.605 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3676e-05 s, 0.0 kB/s 2023-10-07T09:02:56.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.662 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.717 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.718 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.718 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6105e-05 s, 0.0 kB/s 2023-10-07T09:02:56.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.718 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.773 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4039e-05 s, 0.0 kB/s 2023-10-07T09:02:56.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.774 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3413e-05 s, 0.0 kB/s 2023-10-07T09:02:56.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.831 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0526e-05 s, 0.0 kB/s 2023-10-07T09:02:56.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.887 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:56.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:56.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:56.943 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3153e-05 s, 0.0 kB/s 2023-10-07T09:02:56.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:56.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.000 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5963e-05 s, 0.0 kB/s 2023-10-07T09:02:57.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.000 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2359e-05 s, 0.0 kB/s 2023-10-07T09:02:57.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.058 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6659e-05 s, 0.0 kB/s 2023-10-07T09:02:57.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.069e-05 s, 0.0 kB/s 2023-10-07T09:02:57.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2783e-05 s, 0.0 kB/s 2023-10-07T09:02:57.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.227 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.283 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0095e-05 s, 0.0 kB/s 2023-10-07T09:02:57.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.283 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1071e-05 s, 0.0 kB/s 2023-10-07T09:02:57.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.339 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.394 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.395 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.395 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5452e-05 s, 0.0 kB/s 2023-10-07T09:02:57.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.395 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.451 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.451 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.451 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-07T09:02:57.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.451 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.507 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.508 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0952e-05 s, 0.0 kB/s 2023-10-07T09:02:57.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.508 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.269e-05 s, 0.0 kB/s 2023-10-07T09:02:57.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.564 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2301e-05 s, 0.0 kB/s 2023-10-07T09:02:57.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.620 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.405e-05 s, 0.0 kB/s 2023-10-07T09:02:57.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.731 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.731 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.731 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5196e-05 s, 0.0 kB/s 2023-10-07T09:02:57.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0174e-05 s, 0.0 kB/s 2023-10-07T09:02:57.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.789 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.7227e-05 s, 0.0 kB/s 2023-10-07T09:02:57.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.899 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1373e-05 s, 0.0 kB/s 2023-10-07T09:02:57.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3674e-05 s, 0.0 kB/s 2023-10-07T09:02:57.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:57.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9263e-05 s, 0.0 kB/s 2023-10-07T09:02:58.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.070 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2177e-05 s, 0.0 kB/s 2023-10-07T09:02:58.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5518e-05 s, 0.0 kB/s 2023-10-07T09:02:58.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.183 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.183 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2443e-05 s, 0.0 kB/s 2023-10-07T09:02:58.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.184 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.239 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.239 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.240 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5269e-05 s, 0.0 kB/s 2023-10-07T09:02:58.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.241 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4766e-05 s, 0.0 kB/s 2023-10-07T09:02:58.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.297 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.352 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.352 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.352 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-07T09:02:58.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.353 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.409 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7142e-05 s, 0.0 kB/s 2023-10-07T09:02:58.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.409 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-07T09:02:58.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.520 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.520 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.521 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4539e-05 s, 0.0 kB/s 2023-10-07T09:02:58.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.576 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.577 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.577 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.345e-05 s, 0.0 kB/s 2023-10-07T09:02:58.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.577 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104372 s, 0.0 kB/s 2023-10-07T09:02:58.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.633 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.688 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.688 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.688 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3718e-05 s, 0.0 kB/s 2023-10-07T09:02:58.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.689 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.744 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.118e-05 s, 0.0 kB/s 2023-10-07T09:02:58.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.800 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.801 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1056e-05 s, 0.0 kB/s 2023-10-07T09:02:58.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.856 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.856 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.857 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.196e-05 s, 0.0 kB/s 2023-10-07T09:02:58.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.857 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2131e-05 s, 0.0 kB/s 2023-10-07T09:02:58.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.913 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:58.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:58.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:58.968 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-07T09:02:58.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:58.969 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.024 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.405e-05 s, 0.0 kB/s 2023-10-07T09:02:59.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5353e-05 s, 0.0 kB/s 2023-10-07T09:02:59.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.083 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2393e-05 s, 0.0 kB/s 2023-10-07T09:02:59.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.139 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.194 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.194 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.195 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0639e-05 s, 0.0 kB/s 2023-10-07T09:02:59.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.195 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.250 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.251 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.251 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3623e-05 s, 0.0 kB/s 2023-10-07T09:02:59.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.251 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5309e-05 s, 0.0 kB/s 2023-10-07T09:02:59.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.362 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3473e-05 s, 0.0 kB/s 2023-10-07T09:02:59.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3123e-05 s, 0.0 kB/s 2023-10-07T09:02:59.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.422 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.478 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.009e-05 s, 0.0 kB/s 2023-10-07T09:02:59.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.533 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2636e-05 s, 0.0 kB/s 2023-10-07T09:02:59.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.534 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.9396e-05 s, 0.0 kB/s 2023-10-07T09:02:59.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3465e-05 s, 0.0 kB/s 2023-10-07T09:02:59.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.701 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1652e-05 s, 0.0 kB/s 2023-10-07T09:02:59.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.757 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.757 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1533e-05 s, 0.0 kB/s 2023-10-07T09:02:59.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5139e-05 s, 0.0 kB/s 2023-10-07T09:02:59.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4886e-05 s, 0.0 kB/s 2023-10-07T09:02:59.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2836e-05 s, 0.0 kB/s 2023-10-07T09:02:59.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:02:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:02:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:02:59.985 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.169e-05 s, 0.0 kB/s 2023-10-07T09:02:59.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:02:59.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8069e-05 s, 0.0 kB/s 2023-10-07T09:03:00.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.042 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2183e-05 s, 0.0 kB/s 2023-10-07T09:03:00.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.155 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.156 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3104e-05 s, 0.0 kB/s 2023-10-07T09:03:00.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000105069 s, 0.0 kB/s 2023-10-07T09:03:00.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.212 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8058e-05 s, 0.0 kB/s 2023-10-07T09:03:00.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.269 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.324 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.324 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-07T09:03:00.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.380 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7522e-05 s, 0.0 kB/s 2023-10-07T09:03:00.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.381 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.437 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9022e-05 s, 0.0 kB/s 2023-10-07T09:03:00.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.493 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.494 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.494 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-07T09:03:00.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.494 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3196e-05 s, 0.0 kB/s 2023-10-07T09:03:00.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.550 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.605 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.605 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.605 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0594e-05 s, 0.0 kB/s 2023-10-07T09:03:00.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.606 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.661 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.661 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.662 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2411e-05 s, 0.0 kB/s 2023-10-07T09:03:00.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.662 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.717 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.717 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.718 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0889e-05 s, 0.0 kB/s 2023-10-07T09:03:00.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.718 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5912e-05 s, 0.0 kB/s 2023-10-07T09:03:00.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.774 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1635e-05 s, 0.0 kB/s 2023-10-07T09:03:00.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.830 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000116477 s, 0.0 kB/s 2023-10-07T09:03:00.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.887 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2061e-05 s, 0.0 kB/s 2023-10-07T09:03:00.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:00.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3489e-05 s, 0.0 kB/s 2023-10-07T09:03:01.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.055 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3367e-05 s, 0.0 kB/s 2023-10-07T09:03:01.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.056 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.111 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.111 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3067e-05 s, 0.0 kB/s 2023-10-07T09:03:01.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3194e-05 s, 0.0 kB/s 2023-10-07T09:03:01.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.224 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.225 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.182e-05 s, 0.0 kB/s 2023-10-07T09:03:01.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.225 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.280 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.280 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1024e-05 s, 0.0 kB/s 2023-10-07T09:03:01.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.336 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.336 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3574e-05 s, 0.0 kB/s 2023-10-07T09:03:01.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.393 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.393 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-07T09:03:01.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.449 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1706e-05 s, 0.0 kB/s 2023-10-07T09:03:01.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1559e-05 s, 0.0 kB/s 2023-10-07T09:03:01.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3162e-05 s, 0.0 kB/s 2023-10-07T09:03:01.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.618 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.619 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.5548e-05 s, 0.0 kB/s 2023-10-07T09:03:01.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6962e-05 s, 0.0 kB/s 2023-10-07T09:03:01.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.675 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5272e-05 s, 0.0 kB/s 2023-10-07T09:03:01.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.731 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.254e-05 s, 0.0 kB/s 2023-10-07T09:03:01.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7825e-05 s, 0.0 kB/s 2023-10-07T09:03:01.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3948e-05 s, 0.0 kB/s 2023-10-07T09:03:01.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3831e-05 s, 0.0 kB/s 2023-10-07T09:03:01.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:01.958 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5579e-05 s, 0.0 kB/s 2023-10-07T09:03:02.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1061e-05 s, 0.0 kB/s 2023-10-07T09:03:02.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8711e-05 s, 0.0 kB/s 2023-10-07T09:03:02.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6936e-05 s, 0.0 kB/s 2023-10-07T09:03:02.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.185 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.241 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4525e-05 s, 0.0 kB/s 2023-10-07T09:03:02.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.298 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2174e-05 s, 0.0 kB/s 2023-10-07T09:03:02.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2695e-05 s, 0.0 kB/s 2023-10-07T09:03:02.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.409 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.395e-05 s, 0.0 kB/s 2023-10-07T09:03:02.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1889e-05 s, 0.0 kB/s 2023-10-07T09:03:02.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.522 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.522 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.522 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5332e-05 s, 0.0 kB/s 2023-10-07T09:03:02.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.522 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.577 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.577 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.578 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-07T09:03:02.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.578 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.633 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.633 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1634e-05 s, 0.0 kB/s 2023-10-07T09:03:02.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.634 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-07T09:03:02.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.690 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.181e-05 s, 0.0 kB/s 2023-10-07T09:03:02.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.747 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2304e-05 s, 0.0 kB/s 2023-10-07T09:03:02.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3754e-05 s, 0.0 kB/s 2023-10-07T09:03:02.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.859 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.914 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.914 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.914 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9299e-05 s, 0.0 kB/s 2023-10-07T09:03:02.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:02.970 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:02.971 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:02.971 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2297e-05 s, 0.0 kB/s 2023-10-07T09:03:02.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:02.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.2238e-05 s, 0.0 kB/s 2023-10-07T09:03:03.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.083 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.084 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.084 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2017e-05 s, 0.0 kB/s 2023-10-07T09:03:03.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.139 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.139 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-07T09:03:03.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1762e-05 s, 0.0 kB/s 2023-10-07T09:03:03.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.196 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3382e-05 s, 0.0 kB/s 2023-10-07T09:03:03.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0554e-05 s, 0.0 kB/s 2023-10-07T09:03:03.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7192e-05 s, 0.0 kB/s 2023-10-07T09:03:03.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9796e-05 s, 0.0 kB/s 2023-10-07T09:03:03.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.420 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.476 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.476 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.476 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7481e-05 s, 0.0 kB/s 2023-10-07T09:03:03.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.477 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000119539 s, 0.0 kB/s 2023-10-07T09:03:03.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.589 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.589 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2947e-05 s, 0.0 kB/s 2023-10-07T09:03:03.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.589 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.645 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.645 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5272e-05 s, 0.0 kB/s 2023-10-07T09:03:03.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.701 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.701 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3026e-05 s, 0.0 kB/s 2023-10-07T09:03:03.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2235e-05 s, 0.0 kB/s 2023-10-07T09:03:03.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.393e-05 s, 0.0 kB/s 2023-10-07T09:03:03.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.815 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.871 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.871 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3606e-05 s, 0.0 kB/s 2023-10-07T09:03:03.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.929 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.929 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-07T09:03:03.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:03.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:03.985 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:03.985 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2122e-05 s, 0.0 kB/s 2023-10-07T09:03:03.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:03.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.042 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.26e-05 s, 0.0 kB/s 2023-10-07T09:03:04.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.042 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.098 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.098 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6046e-05 s, 0.0 kB/s 2023-10-07T09:03:04.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1289e-05 s, 0.0 kB/s 2023-10-07T09:03:04.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.212 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.212 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.212 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.224e-05 s, 0.0 kB/s 2023-10-07T09:03:04.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.212 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.268 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000103889 s, 0.0 kB/s 2023-10-07T09:03:04.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.270 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-07T09:03:04.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.383 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0892e-05 s, 0.0 kB/s 2023-10-07T09:03:04.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.440 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2564e-05 s, 0.0 kB/s 2023-10-07T09:03:04.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.495 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.406e-05 s, 0.0 kB/s 2023-10-07T09:03:04.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-07T09:03:04.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2421e-05 s, 0.0 kB/s 2023-10-07T09:03:04.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0733e-05 s, 0.0 kB/s 2023-10-07T09:03:04.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3145e-05 s, 0.0 kB/s 2023-10-07T09:03:04.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1442e-05 s, 0.0 kB/s 2023-10-07T09:03:04.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.9755e-05 s, 0.0 kB/s 2023-10-07T09:03:04.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4976e-05 s, 0.0 kB/s 2023-10-07T09:03:04.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.889 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4293e-05 s, 0.0 kB/s 2023-10-07T09:03:04.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:04.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.002 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.002 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.002 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4993e-05 s, 0.0 kB/s 2023-10-07T09:03:05.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.002 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8236e-05 s, 0.0 kB/s 2023-10-07T09:03:05.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.059 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.114 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.115 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3412e-05 s, 0.0 kB/s 2023-10-07T09:03:05.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0035e-05 s, 0.0 kB/s 2023-10-07T09:03:05.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.228 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4499e-05 s, 0.0 kB/s 2023-10-07T09:03:05.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.285 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6793e-05 s, 0.0 kB/s 2023-10-07T09:03:05.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.340 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7159e-05 s, 0.0 kB/s 2023-10-07T09:03:05.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6549e-05 s, 0.0 kB/s 2023-10-07T09:03:05.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.397 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.452 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.453 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.453 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3796e-05 s, 0.0 kB/s 2023-10-07T09:03:05.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.508 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.509 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.509 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3068e-05 s, 0.0 kB/s 2023-10-07T09:03:05.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.8455e-05 s, 0.0 kB/s 2023-10-07T09:03:05.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.565 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4769e-05 s, 0.0 kB/s 2023-10-07T09:03:05.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.621 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.676 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.677 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.677 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100752 s, 0.0 kB/s 2023-10-07T09:03:05.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.677 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.732 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106059 s, 0.0 kB/s 2023-10-07T09:03:05.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.733 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.789 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.790 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.790 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1175e-05 s, 0.0 kB/s 2023-10-07T09:03:05.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0559e-05 s, 0.0 kB/s 2023-10-07T09:03:05.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.846 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.903 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.903 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4276e-05 s, 0.0 kB/s 2023-10-07T09:03:05.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.903 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:05.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:05.958 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3389e-05 s, 0.0 kB/s 2023-10-07T09:03:05.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:05.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3138e-05 s, 0.0 kB/s 2023-10-07T09:03:06.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1453e-05 s, 0.0 kB/s 2023-10-07T09:03:06.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1761e-05 s, 0.0 kB/s 2023-10-07T09:03:06.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.128 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4358e-05 s, 0.0 kB/s 2023-10-07T09:03:06.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.185 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.241 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2032e-05 s, 0.0 kB/s 2023-10-07T09:03:06.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-07T09:03:06.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.354 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.354 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2633e-05 s, 0.0 kB/s 2023-10-07T09:03:06.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.958e-05 s, 0.0 kB/s 2023-10-07T09:03:06.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101986 s, 0.0 kB/s 2023-10-07T09:03:06.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3672e-05 s, 0.0 kB/s 2023-10-07T09:03:06.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.522 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4909e-05 s, 0.0 kB/s 2023-10-07T09:03:06.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.578 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.634 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1419e-05 s, 0.0 kB/s 2023-10-07T09:03:06.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.635 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.690 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.690 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.691 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1227e-05 s, 0.0 kB/s 2023-10-07T09:03:06.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.691 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.066e-05 s, 0.0 kB/s 2023-10-07T09:03:06.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.747 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.803 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.803 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5733e-05 s, 0.0 kB/s 2023-10-07T09:03:06.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.858 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.859 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1244e-05 s, 0.0 kB/s 2023-10-07T09:03:06.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.859 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.915 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.915 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0716e-05 s, 0.0 kB/s 2023-10-07T09:03:06.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5546e-05 s, 0.0 kB/s 2023-10-07T09:03:06.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:06.973 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.029 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4856e-05 s, 0.0 kB/s 2023-10-07T09:03:07.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.086 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.086 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.086 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0991e-05 s, 0.0 kB/s 2023-10-07T09:03:07.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.086 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3169e-05 s, 0.0 kB/s 2023-10-07T09:03:07.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.192 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.208 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9149e-05 s, 0.0 kB/s 2023-10-07T09:03:07.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0555e-05 s, 0.0 kB/s 2023-10-07T09:03:07.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7583e-05 s, 0.0 kB/s 2023-10-07T09:03:07.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5013e-05 s, 0.0 kB/s 2023-10-07T09:03:07.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-07T09:03:07.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.437 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1763e-05 s, 0.0 kB/s 2023-10-07T09:03:07.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.494 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0749e-05 s, 0.0 kB/s 2023-10-07T09:03:07.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.551 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0989e-05 s, 0.0 kB/s 2023-10-07T09:03:07.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.607 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1865e-05 s, 0.0 kB/s 2023-10-07T09:03:07.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.664 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3709e-05 s, 0.0 kB/s 2023-10-07T09:03:07.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.720 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2916e-05 s, 0.0 kB/s 2023-10-07T09:03:07.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.776 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5649e-05 s, 0.0 kB/s 2023-10-07T09:03:07.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.888 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3847e-05 s, 0.0 kB/s 2023-10-07T09:03:07.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:07.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:07.943 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.2867e-05 s, 0.0 kB/s 2023-10-07T09:03:07.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:07.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-07T09:03:08.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.000 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4062e-05 s, 0.0 kB/s 2023-10-07T09:03:08.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3703e-05 s, 0.0 kB/s 2023-10-07T09:03:08.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.170 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.170 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1537e-05 s, 0.0 kB/s 2023-10-07T09:03:08.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.227 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.227 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5802e-05 s, 0.0 kB/s 2023-10-07T09:03:08.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.227 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6372e-05 s, 0.0 kB/s 2023-10-07T09:03:08.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-07T09:03:08.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.343 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6799e-05 s, 0.0 kB/s 2023-10-07T09:03:08.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.400 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5984e-05 s, 0.0 kB/s 2023-10-07T09:03:08.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6463e-05 s, 0.0 kB/s 2023-10-07T09:03:08.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1571e-05 s, 0.0 kB/s 2023-10-07T09:03:08.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1404e-05 s, 0.0 kB/s 2023-10-07T09:03:08.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0889e-05 s, 0.0 kB/s 2023-10-07T09:03:08.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8673e-05 s, 0.0 kB/s 2023-10-07T09:03:08.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.483e-05 s, 0.0 kB/s 2023-10-07T09:03:08.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.852 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2883e-05 s, 0.0 kB/s 2023-10-07T09:03:08.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.852 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0395e-05 s, 0.0 kB/s 2023-10-07T09:03:08.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1147e-05 s, 0.0 kB/s 2023-10-07T09:03:08.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:08.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.244e-05 s, 0.0 kB/s 2023-10-07T09:03:09.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.078 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3693e-05 s, 0.0 kB/s 2023-10-07T09:03:09.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9223e-05 s, 0.0 kB/s 2023-10-07T09:03:09.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.213 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1623e-05 s, 0.0 kB/s 2023-10-07T09:03:09.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.248 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.249 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.079e-05 s, 0.0 kB/s 2023-10-07T09:03:09.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.249 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.305 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0056e-05 s, 0.0 kB/s 2023-10-07T09:03:09.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0973e-05 s, 0.0 kB/s 2023-10-07T09:03:09.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2598e-05 s, 0.0 kB/s 2023-10-07T09:03:09.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.421 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.477 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.477 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2183e-05 s, 0.0 kB/s 2023-10-07T09:03:09.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.534 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.534 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.534 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000107395 s, 0.0 kB/s 2023-10-07T09:03:09.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.590 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6376e-05 s, 0.0 kB/s 2023-10-07T09:03:09.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.592 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-07T09:03:09.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.648 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.705 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.705 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.705 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0936e-05 s, 0.0 kB/s 2023-10-07T09:03:09.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.706 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.762 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.762 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.762 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2306e-05 s, 0.0 kB/s 2023-10-07T09:03:09.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.762 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4055e-05 s, 0.0 kB/s 2023-10-07T09:03:09.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.819 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.876 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1879e-05 s, 0.0 kB/s 2023-10-07T09:03:09.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.934 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.934 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104642 s, 0.0 kB/s 2023-10-07T09:03:09.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.935 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3446e-05 s, 0.0 kB/s 2023-10-07T09:03:09.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:09.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.9901e-05 s, 0.0 kB/s 2023-10-07T09:03:10.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1864e-05 s, 0.0 kB/s 2023-10-07T09:03:10.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.162 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.163 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.163 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3946e-05 s, 0.0 kB/s 2023-10-07T09:03:10.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.219 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.219 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1319e-05 s, 0.0 kB/s 2023-10-07T09:03:10.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.7003e-05 s, 0.0 kB/s 2023-10-07T09:03:10.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.276 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.334 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3772e-05 s, 0.0 kB/s 2023-10-07T09:03:10.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.334 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.391 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-07T09:03:10.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1093e-05 s, 0.0 kB/s 2023-10-07T09:03:10.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.449 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4793e-05 s, 0.0 kB/s 2023-10-07T09:03:10.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-07T09:03:10.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.619 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3131e-05 s, 0.0 kB/s 2023-10-07T09:03:10.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2209e-05 s, 0.0 kB/s 2023-10-07T09:03:10.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.677 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1772e-05 s, 0.0 kB/s 2023-10-07T09:03:10.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.734 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.790 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.790 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.790 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.3837e-05 s, 0.0 kB/s 2023-10-07T09:03:10.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8259e-05 s, 0.0 kB/s 2023-10-07T09:03:10.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.847 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1319e-05 s, 0.0 kB/s 2023-10-07T09:03:10.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.903 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:10.960 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:10.960 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:10.960 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3765e-05 s, 0.0 kB/s 2023-10-07T09:03:10.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:10.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3128e-05 s, 0.0 kB/s 2023-10-07T09:03:11.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.073 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3094e-05 s, 0.0 kB/s 2023-10-07T09:03:11.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.074 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.130 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.130 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2391e-05 s, 0.0 kB/s 2023-10-07T09:03:11.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.188 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.188 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2333e-05 s, 0.0 kB/s 2023-10-07T09:03:11.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.244 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1129e-05 s, 0.0 kB/s 2023-10-07T09:03:11.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.245 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-07T09:03:11.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.357 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.357 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2202e-05 s, 0.0 kB/s 2023-10-07T09:03:11.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.358 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3302e-05 s, 0.0 kB/s 2023-10-07T09:03:11.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.470 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-07T09:03:11.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3395e-05 s, 0.0 kB/s 2023-10-07T09:03:11.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.584 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4737e-05 s, 0.0 kB/s 2023-10-07T09:03:11.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7906e-05 s, 0.0 kB/s 2023-10-07T09:03:11.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.698 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.698 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.7588e-05 s, 0.0 kB/s 2023-10-07T09:03:11.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.754 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4456e-05 s, 0.0 kB/s 2023-10-07T09:03:11.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.810 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5659e-05 s, 0.0 kB/s 2023-10-07T09:03:11.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9666e-05 s, 0.0 kB/s 2023-10-07T09:03:11.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0689e-05 s, 0.0 kB/s 2023-10-07T09:03:11.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.888e-05 s, 0.0 kB/s 2023-10-07T09:03:11.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:11.982 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2753e-05 s, 0.0 kB/s 2023-10-07T09:03:12.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:03:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101462 s, 0.0 kB/s 2023-10-07T09:03:12.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:03:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5761e-05 s, 0.0 kB/s 2023-10-07T09:03:12.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2691e-05 s, 0.0 kB/s 2023-10-07T09:03:12.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.267 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.267 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.1636e-05 s, 0.0 kB/s 2023-10-07T09:03:12.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0736e-05 s, 0.0 kB/s 2023-10-07T09:03:12.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.324 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.380 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.381 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.381 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9423e-05 s, 0.0 kB/s 2023-10-07T09:03:12.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.381 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.437 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.437 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.437 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-07T09:03:12.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.437 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0699e-05 s, 0.0 kB/s 2023-10-07T09:03:12.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.495 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.550 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4916e-05 s, 0.0 kB/s 2023-10-07T09:03:12.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.551 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3621e-05 s, 0.0 kB/s 2023-10-07T09:03:12.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.607 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.663 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3291e-05 s, 0.0 kB/s 2023-10-07T09:03:12.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.663 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9959e-05 s, 0.0 kB/s 2023-10-07T09:03:12.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.720 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.815 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.815 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0049e-05 s, 0.0 kB/s 2023-10-07T09:03:12.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.815 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4259e-05 s, 0.0 kB/s 2023-10-07T09:03:12.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.888 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-07T09:03:12.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:12.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:12.944 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:12.944 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3579e-05 s, 0.0 kB/s 2023-10-07T09:03:12.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:12.945 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.385e-05 s, 0.0 kB/s 2023-10-07T09:03:13.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.002 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.057 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.057 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.057 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3106e-05 s, 0.0 kB/s 2023-10-07T09:03:13.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.058 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.115 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.115 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4399e-05 s, 0.0 kB/s 2023-10-07T09:03:13.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.171 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.171 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.171 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4308e-05 s, 0.0 kB/s 2023-10-07T09:03:13.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.172 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.228 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.228 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000108136 s, 0.0 kB/s 2023-10-07T09:03:13.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.229 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3613e-05 s, 0.0 kB/s 2023-10-07T09:03:13.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.342 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.342 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-07T09:03:13.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.342 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.397 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.398 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.398 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1529e-05 s, 0.0 kB/s 2023-10-07T09:03:13.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.64e-05 s, 0.0 kB/s 2023-10-07T09:03:13.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.511 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7772e-05 s, 0.0 kB/s 2023-10-07T09:03:13.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1673e-05 s, 0.0 kB/s 2023-10-07T09:03:13.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.568 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-07T09:03:13.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.624 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7573e-05 s, 0.0 kB/s 2023-10-07T09:03:13.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.680 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.737 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.737 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6089e-05 s, 0.0 kB/s 2023-10-07T09:03:13.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.793 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2143e-05 s, 0.0 kB/s 2023-10-07T09:03:13.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-07T09:03:13.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.905 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.906 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.906 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0397e-05 s, 0.0 kB/s 2023-10-07T09:03:13.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4905e-05 s, 0.0 kB/s 2023-10-07T09:03:13.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:13.962 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.017 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.018 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.018 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8107e-05 s, 0.0 kB/s 2023-10-07T09:03:14.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.018 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-07T09:03:14.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.074 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.129 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.129 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2354e-05 s, 0.0 kB/s 2023-10-07T09:03:14.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.130 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.186 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.187 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.187 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5268e-05 s, 0.0 kB/s 2023-10-07T09:03:14.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.243 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.243 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4875e-05 s, 0.0 kB/s 2023-10-07T09:03:14.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1093e-05 s, 0.0 kB/s 2023-10-07T09:03:14.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3598e-05 s, 0.0 kB/s 2023-10-07T09:03:14.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.415 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.416 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3333e-05 s, 0.0 kB/s 2023-10-07T09:03:14.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.416 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.472 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.472 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1802e-05 s, 0.0 kB/s 2023-10-07T09:03:14.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.529 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1814e-05 s, 0.0 kB/s 2023-10-07T09:03:14.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.529 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.396e-05 s, 0.0 kB/s 2023-10-07T09:03:14.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3566e-05 s, 0.0 kB/s 2023-10-07T09:03:14.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3027e-05 s, 0.0 kB/s 2023-10-07T09:03:14.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3065e-05 s, 0.0 kB/s 2023-10-07T09:03:14.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5674e-05 s, 0.0 kB/s 2023-10-07T09:03:14.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.864 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2399e-05 s, 0.0 kB/s 2023-10-07T09:03:14.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.865 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.147e-05 s, 0.0 kB/s 2023-10-07T09:03:14.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.923 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:14.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:14.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:14.980 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2471e-05 s, 0.0 kB/s 2023-10-07T09:03:14.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:14.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5716e-05 s, 0.0 kB/s 2023-10-07T09:03:15.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6812e-05 s, 0.0 kB/s 2023-10-07T09:03:15.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.092 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.147 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.148 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5215e-05 s, 0.0 kB/s 2023-10-07T09:03:15.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.148 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.204 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.204 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.204 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8606e-05 s, 0.0 kB/s 2023-10-07T09:03:15.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2194e-05 s, 0.0 kB/s 2023-10-07T09:03:15.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.261 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.317 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9596e-05 s, 0.0 kB/s 2023-10-07T09:03:15.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.372 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.373 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.373 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3516e-05 s, 0.0 kB/s 2023-10-07T09:03:15.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-07T09:03:15.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1928e-05 s, 0.0 kB/s 2023-10-07T09:03:15.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.540 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.085e-05 s, 0.0 kB/s 2023-10-07T09:03:15.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.541 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.596 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0889e-05 s, 0.0 kB/s 2023-10-07T09:03:15.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.597 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1876e-05 s, 0.0 kB/s 2023-10-07T09:03:15.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1449e-05 s, 0.0 kB/s 2023-10-07T09:03:15.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.709 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.764 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.765 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.765 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2012e-05 s, 0.0 kB/s 2023-10-07T09:03:15.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.820 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.821 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3352e-05 s, 0.0 kB/s 2023-10-07T09:03:15.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.876 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.876 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3488e-05 s, 0.0 kB/s 2023-10-07T09:03:15.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.932 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.932 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.932 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9758e-05 s, 0.0 kB/s 2023-10-07T09:03:15.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.933 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:15.988 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:15.988 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:15.988 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4369e-05 s, 0.0 kB/s 2023-10-07T09:03:15.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:15.989 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.589e-05 s, 0.0 kB/s 2023-10-07T09:03:16.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.045 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.102 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.102 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.3856e-05 s, 0.0 kB/s 2023-10-07T09:03:16.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.292e-05 s, 0.0 kB/s 2023-10-07T09:03:16.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.159 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.214 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.214 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.215 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3457e-05 s, 0.0 kB/s 2023-10-07T09:03:16.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.270 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.271 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.251e-05 s, 0.0 kB/s 2023-10-07T09:03:16.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.271 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0064e-05 s, 0.0 kB/s 2023-10-07T09:03:16.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.383 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.6401e-05 s, 0.0 kB/s 2023-10-07T09:03:16.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.439 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.439 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1614e-05 s, 0.0 kB/s 2023-10-07T09:03:16.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.439 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.495 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.495 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3796e-05 s, 0.0 kB/s 2023-10-07T09:03:16.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2022e-05 s, 0.0 kB/s 2023-10-07T09:03:16.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.608 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.608 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-07T09:03:16.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.608 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.663 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.664 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.664 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0546e-05 s, 0.0 kB/s 2023-10-07T09:03:16.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100856 s, 0.0 kB/s 2023-10-07T09:03:16.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.720 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3124e-05 s, 0.0 kB/s 2023-10-07T09:03:16.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.776 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7029e-05 s, 0.0 kB/s 2023-10-07T09:03:16.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.887 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.888 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1858e-05 s, 0.0 kB/s 2023-10-07T09:03:16.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:16.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:16.943 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:16.943 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3479e-05 s, 0.0 kB/s 2023-10-07T09:03:16.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:16.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.000 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.001 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2107e-05 s, 0.0 kB/s 2023-10-07T09:03:17.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.001 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.057 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-07T09:03:17.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2495e-05 s, 0.0 kB/s 2023-10-07T09:03:17.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5775e-05 s, 0.0 kB/s 2023-10-07T09:03:17.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.222 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.223 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.223 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3249e-05 s, 0.0 kB/s 2023-10-07T09:03:17.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.224 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0403e-05 s, 0.0 kB/s 2023-10-07T09:03:17.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100122 s, 0.0 kB/s 2023-10-07T09:03:17.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6073e-05 s, 0.0 kB/s 2023-10-07T09:03:17.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5912e-05 s, 0.0 kB/s 2023-10-07T09:03:17.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.505 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9666e-05 s, 0.0 kB/s 2023-10-07T09:03:17.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.562 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6423e-05 s, 0.0 kB/s 2023-10-07T09:03:17.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.0153e-05 s, 0.0 kB/s 2023-10-07T09:03:17.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5866e-05 s, 0.0 kB/s 2023-10-07T09:03:17.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1139e-05 s, 0.0 kB/s 2023-10-07T09:03:17.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1665e-05 s, 0.0 kB/s 2023-10-07T09:03:17.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.789 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.845 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.845 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000100399 s, 0.0 kB/s 2023-10-07T09:03:17.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2173e-05 s, 0.0 kB/s 2023-10-07T09:03:17.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-07T09:03:17.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:17.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4337e-05 s, 0.0 kB/s 2023-10-07T09:03:18.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.184e-05 s, 0.0 kB/s 2023-10-07T09:03:18.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.154 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4632e-05 s, 0.0 kB/s 2023-10-07T09:03:18.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.092e-05 s, 0.0 kB/s 2023-10-07T09:03:18.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.265 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.266 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-07T09:03:18.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.321 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.321 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1816e-05 s, 0.0 kB/s 2023-10-07T09:03:18.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.322 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.376 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.8883e-05 s, 0.0 kB/s 2023-10-07T09:03:18.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.433 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.433 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3848e-05 s, 0.0 kB/s 2023-10-07T09:03:18.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.490 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.490 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-07T09:03:18.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.546 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1612e-05 s, 0.0 kB/s 2023-10-07T09:03:18.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-07T09:03:18.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.658 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.658 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-07T09:03:18.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5252e-05 s, 0.0 kB/s 2023-10-07T09:03:18.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1755e-05 s, 0.0 kB/s 2023-10-07T09:03:18.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5849e-05 s, 0.0 kB/s 2023-10-07T09:03:18.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0604e-05 s, 0.0 kB/s 2023-10-07T09:03:18.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-07T09:03:18.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.941 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2681e-05 s, 0.0 kB/s 2023-10-07T09:03:18.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:18.997 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.052 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.2765e-05 s, 0.0 kB/s 2023-10-07T09:03:19.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1323e-05 s, 0.0 kB/s 2023-10-07T09:03:19.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.109 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.164 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.164 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.164 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6649e-05 s, 0.0 kB/s 2023-10-07T09:03:19.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.165 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3306e-05 s, 0.0 kB/s 2023-10-07T09:03:19.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.278 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3085e-05 s, 0.0 kB/s 2023-10-07T09:03:19.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2189e-05 s, 0.0 kB/s 2023-10-07T09:03:19.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.390 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.390 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000110899 s, 0.0 kB/s 2023-10-07T09:03:19.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-07T09:03:19.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.448 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1902e-05 s, 0.0 kB/s 2023-10-07T09:03:19.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1237e-05 s, 0.0 kB/s 2023-10-07T09:03:19.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6536e-05 s, 0.0 kB/s 2023-10-07T09:03:19.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.674 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-07T09:03:19.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.675 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.730 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.733 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.733 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3738e-05 s, 0.0 kB/s 2023-10-07T09:03:19.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.733 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2899e-05 s, 0.0 kB/s 2023-10-07T09:03:19.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.788 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0338e-05 s, 0.0 kB/s 2023-10-07T09:03:19.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.900 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.900 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3129e-05 s, 0.0 kB/s 2023-10-07T09:03:19.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:19.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:19.957 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:19.957 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4936e-05 s, 0.0 kB/s 2023-10-07T09:03:19.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:19.958 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2523e-05 s, 0.0 kB/s 2023-10-07T09:03:20.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.072 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.072 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2977e-05 s, 0.0 kB/s 2023-10-07T09:03:20.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3413e-05 s, 0.0 kB/s 2023-10-07T09:03:20.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.185 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.185 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.185 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1149e-05 s, 0.0 kB/s 2023-10-07T09:03:20.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.185 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.241 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.242 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.242 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9006e-05 s, 0.0 kB/s 2023-10-07T09:03:20.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.297 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.297 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2786e-05 s, 0.0 kB/s 2023-10-07T09:03:20.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9077e-05 s, 0.0 kB/s 2023-10-07T09:03:20.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2503e-05 s, 0.0 kB/s 2023-10-07T09:03:20.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1946e-05 s, 0.0 kB/s 2023-10-07T09:03:20.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.467 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9693e-05 s, 0.0 kB/s 2023-10-07T09:03:20.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.581 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.582 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5413e-05 s, 0.0 kB/s 2023-10-07T09:03:20.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.637 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.638 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.638 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3294e-05 s, 0.0 kB/s 2023-10-07T09:03:20.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.694 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0439e-05 s, 0.0 kB/s 2023-10-07T09:03:20.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.695 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.750 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.751 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.751 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1547e-05 s, 0.0 kB/s 2023-10-07T09:03:20.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.807 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.807 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.807 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1524e-05 s, 0.0 kB/s 2023-10-07T09:03:20.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0485e-05 s, 0.0 kB/s 2023-10-07T09:03:20.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3608e-05 s, 0.0 kB/s 2023-10-07T09:03:20.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:20.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:20.976 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:20.976 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-07T09:03:20.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:20.977 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6066e-05 s, 0.0 kB/s 2023-10-07T09:03:21.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.00010013 s, 0.0 kB/s 2023-10-07T09:03:21.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0886e-05 s, 0.0 kB/s 2023-10-07T09:03:21.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3013e-05 s, 0.0 kB/s 2023-10-07T09:03:21.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.204 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4084e-05 s, 0.0 kB/s 2023-10-07T09:03:21.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.316 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.316 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0246e-05 s, 0.0 kB/s 2023-10-07T09:03:21.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.316 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.371 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.371 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-07T09:03:21.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5673e-05 s, 0.0 kB/s 2023-10-07T09:03:21.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.428 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.483 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.484 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.484 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3619e-05 s, 0.0 kB/s 2023-10-07T09:03:21.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.484 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.540 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.540 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.8212e-05 s, 0.0 kB/s 2023-10-07T09:03:21.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1756e-05 s, 0.0 kB/s 2023-10-07T09:03:21.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.597 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6643e-05 s, 0.0 kB/s 2023-10-07T09:03:21.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.710 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.710 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000103962 s, 0.0 kB/s 2023-10-07T09:03:21.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4252e-05 s, 0.0 kB/s 2023-10-07T09:03:21.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.824 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.824 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.824 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-07T09:03:21.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.824 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.879 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.879 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1883e-05 s, 0.0 kB/s 2023-10-07T09:03:21.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.115e-05 s, 0.0 kB/s 2023-10-07T09:03:21.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0772e-05 s, 0.0 kB/s 2023-10-07T09:03:21.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:21.992 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0707e-05 s, 0.0 kB/s 2023-10-07T09:03:22.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.049 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1375e-05 s, 0.0 kB/s 2023-10-07T09:03:22.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.160 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.161 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0681e-05 s, 0.0 kB/s 2023-10-07T09:03:22.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6769e-05 s, 0.0 kB/s 2023-10-07T09:03:22.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.273 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.273 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.273 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.4734e-05 s, 0.0 kB/s 2023-10-07T09:03:22.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.328 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.329 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.095e-05 s, 0.0 kB/s 2023-10-07T09:03:22.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.329 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.383 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3339e-05 s, 0.0 kB/s 2023-10-07T09:03:22.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.385 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2499e-05 s, 0.0 kB/s 2023-10-07T09:03:22.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.441 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7319e-05 s, 0.0 kB/s 2023-10-07T09:03:22.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.499 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2683e-05 s, 0.0 kB/s 2023-10-07T09:03:22.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-07T09:03:22.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.612 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.4676e-05 s, 0.0 kB/s 2023-10-07T09:03:22.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.668 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.725 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3342e-05 s, 0.0 kB/s 2023-10-07T09:03:22.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.780 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.780 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0819e-05 s, 0.0 kB/s 2023-10-07T09:03:22.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-07T09:03:22.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3116e-05 s, 0.0 kB/s 2023-10-07T09:03:22.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:22.950 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:22.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:22.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2519e-05 s, 0.0 kB/s 2023-10-07T09:03:22.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:22.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.050 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.050 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1136e-05 s, 0.0 kB/s 2023-10-07T09:03:23.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.066 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.9732e-05 s, 0.0 kB/s 2023-10-07T09:03:23.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.067 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3873e-05 s, 0.0 kB/s 2023-10-07T09:03:23.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2927e-05 s, 0.0 kB/s 2023-10-07T09:03:23.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.179 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2032e-05 s, 0.0 kB/s 2023-10-07T09:03:23.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.236 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.292 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.292 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.292 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0791e-05 s, 0.0 kB/s 2023-10-07T09:03:23.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0408e-05 s, 0.0 kB/s 2023-10-07T09:03:23.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.349 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.265e-05 s, 0.0 kB/s 2023-10-07T09:03:23.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.405 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.461 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5283e-05 s, 0.0 kB/s 2023-10-07T09:03:23.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.461 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.516 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.517 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1751e-05 s, 0.0 kB/s 2023-10-07T09:03:23.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.517 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.573 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.573 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.573 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2091e-05 s, 0.0 kB/s 2023-10-07T09:03:23.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.573 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.629 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.630 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4273e-05 s, 0.0 kB/s 2023-10-07T09:03:23.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.6692e-05 s, 0.0 kB/s 2023-10-07T09:03:23.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.687 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5622e-05 s, 0.0 kB/s 2023-10-07T09:03:23.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.743 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.799 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.035e-05 s, 0.0 kB/s 2023-10-07T09:03:23.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.800 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2184e-05 s, 0.0 kB/s 2023-10-07T09:03:23.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.856 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.911 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4159e-05 s, 0.0 kB/s 2023-10-07T09:03:23.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.912 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:23.969 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:23.969 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:23.969 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3683e-05 s, 0.0 kB/s 2023-10-07T09:03:23.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:23.969 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.025 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.025 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.025 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2828e-05 s, 0.0 kB/s 2023-10-07T09:03:24.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.081 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.081 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.082 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.322e-05 s, 0.0 kB/s 2023-10-07T09:03:24.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.082 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8884e-05 s, 0.0 kB/s 2023-10-07T09:03:24.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.195 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.195 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.195 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0988e-05 s, 0.0 kB/s 2023-10-07T09:03:24.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.196 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101646 s, 0.0 kB/s 2023-10-07T09:03:24.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.308 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.308 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9353e-05 s, 0.0 kB/s 2023-10-07T09:03:24.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.309 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.365 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.366 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.366 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0897e-05 s, 0.0 kB/s 2023-10-07T09:03:24.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.366 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.421 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.422 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.422 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4639e-05 s, 0.0 kB/s 2023-10-07T09:03:24.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7703e-05 s, 0.0 kB/s 2023-10-07T09:03:24.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.479 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.534 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.535 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.535 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4996e-05 s, 0.0 kB/s 2023-10-07T09:03:24.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.591 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.591 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.591 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-07T09:03:24.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.592 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.647 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.647 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.647 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.7555e-05 s, 0.0 kB/s 2023-10-07T09:03:24.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.647 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.003e-05 s, 0.0 kB/s 2023-10-07T09:03:24.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.761 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.761 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.761 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000106763 s, 0.0 kB/s 2023-10-07T09:03:24.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.761 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.817 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.818 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.818 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3623e-05 s, 0.0 kB/s 2023-10-07T09:03:24.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.818 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000104495 s, 0.0 kB/s 2023-10-07T09:03:24.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.874 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.930 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.930 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.2239e-05 s, 0.0 kB/s 2023-10-07T09:03:24.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.59e-05 s, 0.0 kB/s 2023-10-07T09:03:24.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:24.987 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-07T09:03:25.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.099 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.100 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.100 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.9423e-05 s, 0.0 kB/s 2023-10-07T09:03:25.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.100 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.156 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.156 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5571e-05 s, 0.0 kB/s 2023-10-07T09:03:25.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.157 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.213 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.213 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0993e-05 s, 0.0 kB/s 2023-10-07T09:03:25.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6086e-05 s, 0.0 kB/s 2023-10-07T09:03:25.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.270 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0659e-05 s, 0.0 kB/s 2023-10-07T09:03:25.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.384 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.384 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3499e-05 s, 0.0 kB/s 2023-10-07T09:03:25.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.472e-05 s, 0.0 kB/s 2023-10-07T09:03:25.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.497 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.8874e-05 s, 0.0 kB/s 2023-10-07T09:03:25.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.498 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3812e-05 s, 0.0 kB/s 2023-10-07T09:03:25.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4301e-05 s, 0.0 kB/s 2023-10-07T09:03:25.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.611 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0883e-05 s, 0.0 kB/s 2023-10-07T09:03:25.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.667 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-07T09:03:25.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.781 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.781 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4356e-05 s, 0.0 kB/s 2023-10-07T09:03:25.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.837 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.838 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.838 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2438e-05 s, 0.0 kB/s 2023-10-07T09:03:25.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.894 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.894 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.414e-05 s, 0.0 kB/s 2023-10-07T09:03:25.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2821e-05 s, 0.0 kB/s 2023-10-07T09:03:25.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:25.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.007 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.3151e-05 s, 0.0 kB/s 2023-10-07T09:03:26.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.007 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.063 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.063 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.063 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2523e-05 s, 0.0 kB/s 2023-10-07T09:03:26.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.063 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1732e-05 s, 0.0 kB/s 2023-10-07T09:03:26.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.119 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.176 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0135e-05 s, 0.0 kB/s 2023-10-07T09:03:26.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2333e-05 s, 0.0 kB/s 2023-10-07T09:03:26.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.234 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.290 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-07T09:03:26.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.347 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.347 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1713e-05 s, 0.0 kB/s 2023-10-07T09:03:26.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.348 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.5514e-05 s, 0.0 kB/s 2023-10-07T09:03:26.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.404 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5986e-05 s, 0.0 kB/s 2023-10-07T09:03:26.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.517 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.518 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.518 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2548e-05 s, 0.0 kB/s 2023-10-07T09:03:26.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.518 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.574 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.574 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.574 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.8384e-05 s, 0.0 kB/s 2023-10-07T09:03:26.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.574 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.630 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.630 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.630 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8931e-05 s, 0.0 kB/s 2023-10-07T09:03:26.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.687 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.687 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.687 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3252e-05 s, 0.0 kB/s 2023-10-07T09:03:26.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.687 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.742 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.743 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.743 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5225e-05 s, 0.0 kB/s 2023-10-07T09:03:26.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.743 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.798 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1817e-05 s, 0.0 kB/s 2023-10-07T09:03:26.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.799 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.855 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.855 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.855 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000118186 s, 0.0 kB/s 2023-10-07T09:03:26.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.911 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.911 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1633e-05 s, 0.0 kB/s 2023-10-07T09:03:26.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.912 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-07T09:03:26.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:26.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.024 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.024 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2246e-05 s, 0.0 kB/s 2023-10-07T09:03:27.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.080 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.080 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5162e-05 s, 0.0 kB/s 2023-10-07T09:03:27.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.081 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-07T09:03:27.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.137 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.193 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.193 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7523e-05 s, 0.0 kB/s 2023-10-07T09:03:27.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.194 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.250 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.250 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7052e-05 s, 0.0 kB/s 2023-10-07T09:03:27.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1352e-05 s, 0.0 kB/s 2023-10-07T09:03:27.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1558e-05 s, 0.0 kB/s 2023-10-07T09:03:27.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.362 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.418 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3106e-05 s, 0.0 kB/s 2023-10-07T09:03:27.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.418 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.572e-05 s, 0.0 kB/s 2023-10-07T09:03:27.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5693e-05 s, 0.0 kB/s 2023-10-07T09:03:27.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.530 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.586 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.587 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.587 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1715e-05 s, 0.0 kB/s 2023-10-07T09:03:27.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.587 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.642 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.643 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.643 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0946e-05 s, 0.0 kB/s 2023-10-07T09:03:27.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.644 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.0178e-05 s, 0.0 kB/s 2023-10-07T09:03:27.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.754 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.755 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.755 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.8927e-05 s, 0.0 kB/s 2023-10-07T09:03:27.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.756 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.811 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.811 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5259e-05 s, 0.0 kB/s 2023-10-07T09:03:27.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0787e-05 s, 0.0 kB/s 2023-10-07T09:03:27.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.924 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.924 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-07T09:03:27.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.924 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:27.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:27.980 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:27.980 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-07T09:03:27.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:27.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.037 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.8136e-05 s, 0.0 kB/s 2023-10-07T09:03:28.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.093 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-07T09:03:28.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.148 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000111882 s, 0.0 kB/s 2023-10-07T09:03:28.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9182e-05 s, 0.0 kB/s 2023-10-07T09:03:28.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.4816e-05 s, 0.0 kB/s 2023-10-07T09:03:28.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.319 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 6.4962e-05 s, 0.0 kB/s 2023-10-07T09:03:28.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1549e-05 s, 0.0 kB/s 2023-10-07T09:03:28.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.432 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.432 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.432 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4065e-05 s, 0.0 kB/s 2023-10-07T09:03:28.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.433 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.489 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4314e-05 s, 0.0 kB/s 2023-10-07T09:03:28.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1719e-05 s, 0.0 kB/s 2023-10-07T09:03:28.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.602 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.602 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5133e-05 s, 0.0 kB/s 2023-10-07T09:03:28.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.659 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.659 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0529e-05 s, 0.0 kB/s 2023-10-07T09:03:28.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.716 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3696e-05 s, 0.0 kB/s 2023-10-07T09:03:28.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2514e-05 s, 0.0 kB/s 2023-10-07T09:03:28.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0203e-05 s, 0.0 kB/s 2023-10-07T09:03:28.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.178e-05 s, 0.0 kB/s 2023-10-07T09:03:28.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2972e-05 s, 0.0 kB/s 2023-10-07T09:03:28.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:28.997 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:28.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:28.998 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3592e-05 s, 0.0 kB/s 2023-10-07T09:03:28.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:28.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.054 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.054 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.054 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.487e-05 s, 0.0 kB/s 2023-10-07T09:03:29.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0708e-05 s, 0.0 kB/s 2023-10-07T09:03:29.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3492e-05 s, 0.0 kB/s 2023-10-07T09:03:29.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.217 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.218 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2144e-05 s, 0.0 kB/s 2023-10-07T09:03:29.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.218 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.273 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.274 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.274 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-07T09:03:29.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.329 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.329 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3818e-05 s, 0.0 kB/s 2023-10-07T09:03:29.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.330 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.385 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.386 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.386 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.7373e-05 s, 0.0 kB/s 2023-10-07T09:03:29.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1342e-05 s, 0.0 kB/s 2023-10-07T09:03:29.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.498 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.498 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1669e-05 s, 0.0 kB/s 2023-10-07T09:03:29.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.499 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.555 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.555 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7086e-05 s, 0.0 kB/s 2023-10-07T09:03:29.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.611 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.611 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.611 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-07T09:03:29.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.611 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5646e-05 s, 0.0 kB/s 2023-10-07T09:03:29.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.902e-05 s, 0.0 kB/s 2023-10-07T09:03:29.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.727 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.783 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.783 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.783 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5295e-05 s, 0.0 kB/s 2023-10-07T09:03:29.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.784 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6132e-05 s, 0.0 kB/s 2023-10-07T09:03:29.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.841 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6282e-05 s, 0.0 kB/s 2023-10-07T09:03:29.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.897 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:29.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:29.954 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:29.954 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-07T09:03:29.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:29.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6352e-05 s, 0.0 kB/s 2023-10-07T09:03:30.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1404e-05 s, 0.0 kB/s 2023-10-07T09:03:30.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.067 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.122 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.122 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3308e-05 s, 0.0 kB/s 2023-10-07T09:03:30.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.178 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.179 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.179 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4779e-05 s, 0.0 kB/s 2023-10-07T09:03:30.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.179 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1882e-05 s, 0.0 kB/s 2023-10-07T09:03:30.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.235 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.290 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.291 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.6125e-05 s, 0.0 kB/s 2023-10-07T09:03:30.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.346 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.346 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.347 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5476e-05 s, 0.0 kB/s 2023-10-07T09:03:30.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.402 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0509e-05 s, 0.0 kB/s 2023-10-07T09:03:30.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.403 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3755e-05 s, 0.0 kB/s 2023-10-07T09:03:30.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.460 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.516 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.516 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.516 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-07T09:03:30.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.516 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.571 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.572 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.572 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.386e-05 s, 0.0 kB/s 2023-10-07T09:03:30.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.572 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.628 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.628 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.5603e-05 s, 0.0 kB/s 2023-10-07T09:03:30.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.628 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9198e-05 s, 0.0 kB/s 2023-10-07T09:03:30.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.684 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.740 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.741 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.741 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2161e-05 s, 0.0 kB/s 2023-10-07T09:03:30.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.796 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.796 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4271e-05 s, 0.0 kB/s 2023-10-07T09:03:30.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.796 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.852 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.852 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1618e-05 s, 0.0 kB/s 2023-10-07T09:03:30.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.909 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.909 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-07T09:03:30.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:30.965 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:30.965 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3143e-05 s, 0.0 kB/s 2023-10-07T09:03:30.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:30.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3713e-05 s, 0.0 kB/s 2023-10-07T09:03:31.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.077 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.078 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.078 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.648e-05 s, 0.0 kB/s 2023-10-07T09:03:31.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1466e-05 s, 0.0 kB/s 2023-10-07T09:03:31.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.190 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.190 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5756e-05 s, 0.0 kB/s 2023-10-07T09:03:31.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.246 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.247 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6096e-05 s, 0.0 kB/s 2023-10-07T09:03:31.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1081e-05 s, 0.0 kB/s 2023-10-07T09:03:31.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.303 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.358 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.359 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.359 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.072e-05 s, 0.0 kB/s 2023-10-07T09:03:31.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.414 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.415 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.06e-05 s, 0.0 kB/s 2023-10-07T09:03:31.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1809e-05 s, 0.0 kB/s 2023-10-07T09:03:31.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.526 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.527 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1775e-05 s, 0.0 kB/s 2023-10-07T09:03:31.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.527 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-07T09:03:31.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-07T09:03:31.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2707e-05 s, 0.0 kB/s 2023-10-07T09:03:31.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.752 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-07T09:03:31.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.808 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2908e-05 s, 0.0 kB/s 2023-10-07T09:03:31.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.865 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.865 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0688e-05 s, 0.0 kB/s 2023-10-07T09:03:31.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9839e-05 s, 0.0 kB/s 2023-10-07T09:03:31.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-07T09:03:31.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:31.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.036 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.036 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-07T09:03:32.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.1139e-05 s, 0.0 kB/s 2023-10-07T09:03:32.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1268e-05 s, 0.0 kB/s 2023-10-07T09:03:32.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6129e-05 s, 0.0 kB/s 2023-10-07T09:03:32.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.262 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.262 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1325e-05 s, 0.0 kB/s 2023-10-07T09:03:32.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.318 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1811e-05 s, 0.0 kB/s 2023-10-07T09:03:32.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.374 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.375 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.375 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4972e-05 s, 0.0 kB/s 2023-10-07T09:03:32.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2885e-05 s, 0.0 kB/s 2023-10-07T09:03:32.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.432 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.488 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.488 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4292e-05 s, 0.0 kB/s 2023-10-07T09:03:32.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.545 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.545 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6483e-05 s, 0.0 kB/s 2023-10-07T09:03:32.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1061e-05 s, 0.0 kB/s 2023-10-07T09:03:32.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3439e-05 s, 0.0 kB/s 2023-10-07T09:03:32.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.713 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.713 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6843e-05 s, 0.0 kB/s 2023-10-07T09:03:32.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.769 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3489e-05 s, 0.0 kB/s 2023-10-07T09:03:32.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2934e-05 s, 0.0 kB/s 2023-10-07T09:03:32.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.881 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 2.9439e-05 s, 0.0 kB/s 2023-10-07T09:03:32.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.936 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.937 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.937 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6056e-05 s, 0.0 kB/s 2023-10-07T09:03:32.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:32.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:32.993 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:32.994 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3876e-05 s, 0.0 kB/s 2023-10-07T09:03:32.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:32.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-07T09:03:33.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3717e-05 s, 0.0 kB/s 2023-10-07T09:03:33.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2204e-05 s, 0.0 kB/s 2023-10-07T09:03:33.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0475e-05 s, 0.0 kB/s 2023-10-07T09:03:33.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.274 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.274 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.274 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0253e-05 s, 0.0 kB/s 2023-10-07T09:03:33.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.275 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.331 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.332 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.332 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.231e-05 s, 0.0 kB/s 2023-10-07T09:03:33.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.387 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.387 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4806e-05 s, 0.0 kB/s 2023-10-07T09:03:33.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.388 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.443 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9453e-05 s, 0.0 kB/s 2023-10-07T09:03:33.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.445 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.500 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.500 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.500 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5242e-05 s, 0.0 kB/s 2023-10-07T09:03:33.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.501 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.557 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.557 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.557 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000105845 s, 0.0 kB/s 2023-10-07T09:03:33.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3711e-05 s, 0.0 kB/s 2023-10-07T09:03:33.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.615 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.670 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.671 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.671 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1556e-05 s, 0.0 kB/s 2023-10-07T09:03:33.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.727 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.727 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.062e-05 s, 0.0 kB/s 2023-10-07T09:03:33.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.727 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.782 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.782 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.1645e-05 s, 0.0 kB/s 2023-10-07T09:03:33.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.783 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.839 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.839 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.840 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6909e-05 s, 0.0 kB/s 2023-10-07T09:03:33.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.840 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-07T09:03:33.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.896 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:33.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:33.951 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:33.951 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-07T09:03:33.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:33.952 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.007 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.008 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.008 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5277e-05 s, 0.0 kB/s 2023-10-07T09:03:34.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.008 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.063 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.063 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.063 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.4519e-05 s, 0.0 kB/s 2023-10-07T09:03:34.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.064 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.312e-05 s, 0.0 kB/s 2023-10-07T09:03:34.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1736e-05 s, 0.0 kB/s 2023-10-07T09:03:34.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-07T09:03:34.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.289 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.289 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2477e-05 s, 0.0 kB/s 2023-10-07T09:03:34.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.290 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.345 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.345 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.5436e-05 s, 0.0 kB/s 2023-10-07T09:03:34.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.346 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.401 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.402 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.402 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2025e-05 s, 0.0 kB/s 2023-10-07T09:03:34.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2717e-05 s, 0.0 kB/s 2023-10-07T09:03:34.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.458 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.513 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1623e-05 s, 0.0 kB/s 2023-10-07T09:03:34.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0553e-05 s, 0.0 kB/s 2023-10-07T09:03:34.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.626 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.627 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.627 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2435e-05 s, 0.0 kB/s 2023-10-07T09:03:34.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.683 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.683 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.683 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-07T09:03:34.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.739 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.739 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3894e-05 s, 0.0 kB/s 2023-10-07T09:03:34.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.836 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.836 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.836 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2568e-05 s, 0.0 kB/s 2023-10-07T09:03:34.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000101153 s, 0.0 kB/s 2023-10-07T09:03:34.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.6291e-05 s, 0.0 kB/s 2023-10-07T09:03:34.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:34.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:34.966 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2619e-05 s, 0.0 kB/s 2023-10-07T09:03:34.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:34.967 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.022 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.023 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.023 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 4.1983e-05 s, 0.0 kB/s 2023-10-07T09:03:35.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.079 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.079 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.079 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 0.000116366 s, 0.0 kB/s 2023-10-07T09:03:35.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.135 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.3864e-05 s, 0.0 kB/s 2023-10-07T09:03:35.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.192 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3331e-05 s, 0.0 kB/s 2023-10-07T09:03:35.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.193 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0183e-05 s, 0.0 kB/s 2023-10-07T09:03:35.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6249e-05 s, 0.0 kB/s 2023-10-07T09:03:35.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.361 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.361 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6492e-05 s, 0.0 kB/s 2023-10-07T09:03:35.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.418 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.418 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.9389e-05 s, 0.0 kB/s 2023-10-07T09:03:35.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.418 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.474 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.475 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.475 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-07T09:03:35.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.531 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.531 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2749e-05 s, 0.0 kB/s 2023-10-07T09:03:35.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.531 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.588 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.5428e-05 s, 0.0 kB/s 2023-10-07T09:03:35.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.588 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.643 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.643 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.643 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-07T09:03:35.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.644 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.7526e-05 s, 0.0 kB/s 2023-10-07T09:03:35.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.758 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.758 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3562e-05 s, 0.0 kB/s 2023-10-07T09:03:35.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-07T09:03:35.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.815 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2786e-05 s, 0.0 kB/s 2023-10-07T09:03:35.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.928 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.928 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3892e-05 s, 0.0 kB/s 2023-10-07T09:03:35.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-07T09:03:35.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:35.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.040 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2567e-05 s, 0.0 kB/s 2023-10-07T09:03:36.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.0575e-05 s, 0.0 kB/s 2023-10-07T09:03:36.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.097 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0733e-05 s, 0.0 kB/s 2023-10-07T09:03:36.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.210 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.210 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4459e-05 s, 0.0 kB/s 2023-10-07T09:03:36.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.266 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.267 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0868e-05 s, 0.0 kB/s 2023-10-07T09:03:36.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.267 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.322 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.323 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.323 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.9422e-05 s, 0.0 kB/s 2023-10-07T09:03:36.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.1516e-05 s, 0.0 kB/s 2023-10-07T09:03:36.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1322e-05 s, 0.0 kB/s 2023-10-07T09:03:36.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-07T09:03:36.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.492 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.548 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.548 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3484e-05 s, 0.0 kB/s 2023-10-07T09:03:36.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.549 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.2469e-05 s, 0.0 kB/s 2023-10-07T09:03:36.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.605 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 9.0193e-05 s, 0.0 kB/s 2023-10-07T09:03:36.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.661 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.716 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.717 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.717 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 7.7369e-05 s, 0.0 kB/s 2023-10-07T09:03:36.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 5.4336e-05 s, 0.0 kB/s 2023-10-07T09:03:36.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.829 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.830 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.1241e-05 s, 0.0 kB/s 2023-10-07T09:03:36.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.830 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3609e-05 s, 0.0 kB/s 2023-10-07T09:03:36.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2818e-05 s, 0.0 kB/s 2023-10-07T09:03:36.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.2206e-05 s, 0.0 kB/s 2023-10-07T09:03:36.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:36.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:37.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:37.056 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:37.056 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.3632e-05 s, 0.0 kB/s 2023-10-07T09:03:37.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:37.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:37.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:37.112 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:37.113 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.7682e-05 s, 0.0 kB/s 2023-10-07T09:03:37.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:37.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:37.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:37.168 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:37.168 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-07T09:03:37.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:37.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000516704/2dbf0db9-9c8b-488d-a96f-7eba7f3a9772/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T09:03:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records in 2023-10-07T09:03:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:0+0 records out 2023-10-07T09:03:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:0 bytes copied, 8.6726e-05 s, 0.0 kB/s 2023-10-07T09:03:37.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000516704 2023-10-07T09:03:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.385+0000 7f47bf46c700 1 Processor -- start 2023-10-07T09:03:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.385+0000 7f47bf46c700 1 -- start start 2023-10-07T09:03:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bf46c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bf46c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bf46c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80c7a70 con 0x7f47b80ccee0 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bf46c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b815a450 con 0x7f47b8156490 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bf46c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b815a730 con 0x7f47b80c88b0 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bd208700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bca07700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f47b80ccee0 0x7f47b80c81a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:53862/0 (socket says 172.21.15.46:53862) 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bd208700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:53302/0 (socket says 172.21.15.46:53302) 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:48356/0 (socket says 172.21.15.46:48356) 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bca07700 1 -- 172.21.15.46:0/3236335212 learned_addr learned my addr 172.21.15.46:0/3236335212 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 -- 172.21.15.46:0/3236335212 >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 msgr2=0x7f47b80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 --2- 172.21.15.46:0/3236335212 >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 -- 172.21.15.46:0/3236335212 >> v1:172.21.15.133:6789/0 conn(0x7f47b80ccee0 legacy=0x7f47b80c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47b7fff700 1 -- 172.21.15.46:0/3236335212 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785714783 0 0) 0x7f47b80c7a70 con 0x7f47b80ccee0 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bda09700 1 -- 172.21.15.46:0/3236335212 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b815aa10 con 0x7f47b80c88b0 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.386+0000 7f47bd208700 1 --2- 172.21.15.46:0/3236335212 >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bda09700 1 --2- 172.21.15.46:0/3236335212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47b00098e0 tx=0x7f47b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51787f96365c829 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47b7fff700 1 -- 172.21.15.46:0/3236335212 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000b640 con 0x7f47b80c88b0 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47b7fff700 1 -- 172.21.15.46:0/3236335212 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000b7a0 con 0x7f47b80c88b0 2023-10-07T09:03:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47b7fff700 1 -- 172.21.15.46:0/3236335212 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000bb40 con 0x7f47b80c88b0 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 -- 172.21.15.46:0/3236335212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 msgr2=0x7f47b80ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 --2- 172.21.15.46:0/3236335212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47b00098e0 tx=0x7f47b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 -- 172.21.15.46:0/3236335212 shutdown_connections 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 --2- 172.21.15.46:0/3236335212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80c88b0 0x7f47b80ca170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 --2- 172.21.15.46:0/3236335212 >> v2:172.21.15.133:3300/0 conn(0x7f47b8156490 0x7f47b80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 -- 172.21.15.46:0/3236335212 >> 172.21.15.46:0/3236335212 conn(0x7f47b8068e10 msgr2=0x7f47b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 -- 172.21.15.46:0/3236335212 shutdown_connections 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.387+0000 7f47bf46c700 1 -- 172.21.15.46:0/3236335212 wait complete. 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.388+0000 7f47bf46c700 1 Processor -- start 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 -- start start 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80ccee0 0x7f47b8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b8156490 0x7f47b8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5c40 con 0x7f47b80c88b0 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5030 con 0x7f47b8156490 2023-10-07T09:03:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.389+0000 7f47bf46c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5310 con 0x7f47b80ccee0 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40818/0 (socket says 172.21.15.46:40818) 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 -- 172.21.15.46:0/2181664411 learned_addr learned my addr 172.21.15.46:0/2181664411 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bda09700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b8156490 0x7f47b8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bca07700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80ccee0 0x7f47b8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 -- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80ccee0 msgr2=0x7f47b8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80ccee0 0x7f47b8150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 -- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b8156490 msgr2=0x7f47b8154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b8156490 0x7f47b8154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 -- 172.21.15.46:0/2181664411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009a20 con 0x7f47b80c88b0 2023-10-07T09:03:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bd208700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f47a800e600 tx=0x7f47a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8012590 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b0009420 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012930 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.390+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b80c58d0 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.391+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b804c3c0 con 0x7f47b80c88b0 2023-10-07T09:03:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.392+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f47a8003020 con 0x7f47b80c88b0 2023-10-07T09:03:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.392+0000 7f47b57fa700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 0x7f47a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.392+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f47a8016070 con 0x7f47b80c88b0 2023-10-07T09:03:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.392+0000 7f47bca07700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 0x7f47a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.393+0000 7f47bca07700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 0x7f47a4069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c1760 tx=0x7f47ac007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.396+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47a8058220 con 0x7f47b80c88b0 2023-10-07T09:03:37.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.622+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000516704", "target": ["mon-mgr", ""]}) v1 -- 0x7f47b80c5d80 con 0x7f47a4066fc0 2023-10-07T09:03:37.627 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.626+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.627 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.626+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.628 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.626+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.628 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.626+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.628 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.626+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.650+0000 7f47b57fa700 1 -- 172.21.15.46:0/2181664411 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f47ac001420 con 0x7f47a4066fc0 2023-10-07T09:03:37.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 msgr2=0x7f47a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 0x7f47a4069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c1760 tx=0x7f47ac007d30 comp rx=0 tx=0).stop 2023-10-07T09:03:37.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 msgr2=0x7f47b80c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f47a800e600 tx=0x7f47a800b040 comp rx=0 tx=0).stop 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 shutdown_connections 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f47a4066fc0 0x7f47a4069470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b8156490 0x7f47b8154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47b80c88b0 0x7f47b80c60d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 --2- 172.21.15.46:0/2181664411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b80ccee0 0x7f47b8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 >> 172.21.15.46:0/2181664411 conn(0x7f47b8068e10 msgr2=0x7f47b80c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 shutdown_connections 2023-10-07T09:03:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.652+0000 7f47bf46c700 1 -- 172.21.15.46:0/2181664411 wait complete. 2023-10-07T09:03:37.656 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.653+0000 7f471254b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.656 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.653+0000 7f471254b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.656 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.653+0000 7f471254b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.656 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.653+0000 7f471254b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.656 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.653+0000 7f471254b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-07T09:03:37.667 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.666+0000 7f4712d4c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.667 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.666+0000 7f4712d4c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.667 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.666+0000 7f4712d4c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.667 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.666+0000 7f4712d4c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.668 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:03:37.666+0000 7f4712d4c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:03:37.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 Processor -- start 2023-10-07T09:03:37.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 -- start start 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 0x7f4e4c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 0x7f4e4c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c15d7e0 con 0x7f4e4c06c0a0 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c15dac0 con 0x7f4e4c15df50 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.785+0000 7f4e51cdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c15aa30 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e4c06c0a0 0x7f4e4c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47468/0 (socket says 172.21.15.46:47468) 2023-10-07T09:03:37.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4affd700 1 -- 172.21.15.46:0/1231828675 learned_addr learned my addr 172.21.15.46:0/1231828675 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/1231828675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 0x7f4e4c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4bfff700 1 --2- 172.21.15.46:0/1231828675 >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 0x7f4e4c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4a7fc700 1 -- 172.21.15.46:0/1231828675 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074353312 0 0) 0x7f4e4c15d7e0 con 0x7f4e4c06c0a0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4a7fc700 1 -- 172.21.15.46:0/1231828675 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e34003570 con 0x7f4e4c06c0a0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1231828675 >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 msgr2=0x7f4e4c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/1231828675 >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 0x7f4e4c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1231828675 >> v1:172.21.15.46:6789/0 conn(0x7f4e4c06c0a0 legacy=0x7f4e4c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/1231828675 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c15ad10 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4bfff700 1 --2- 172.21.15.46:0/1231828675 >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 0x7f4e4c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/1231828675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 0x7f4e4c0caa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0098e0 tx=0x7f4e3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5113be408da519 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4a7fc700 1 -- 172.21.15.46:0/1231828675 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c011630 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4a7fc700 1 -- 172.21.15.46:0/1231828675 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c011790 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.786+0000 7f4e4a7fc700 1 -- 172.21.15.46:0/1231828675 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c011b10 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 -- 172.21.15.46:0/1231828675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 msgr2=0x7f4e4c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/1231828675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 0x7f4e4c0caa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0098e0 tx=0x7f4e3c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 -- 172.21.15.46:0/1231828675 shutdown_connections 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/1231828675 >> v2:172.21.15.133:3300/0 conn(0x7f4e4c15df50 0x7f4e4c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/1231828675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06bcd0 0x7f4e4c0caa90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 -- 172.21.15.46:0/1231828675 >> 172.21.15.46:0/1231828675 conn(0x7f4e4c0ce600 msgr2=0x7f4e4c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 -- 172.21.15.46:0/1231828675 shutdown_connections 2023-10-07T09:03:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.787+0000 7f4e51cdf700 1 -- 172.21.15.46:0/1231828675 wait complete. 2023-10-07T09:03:37.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.788+0000 7f4e51cdf700 1 Processor -- start 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.788+0000 7f4e51cdf700 1 -- start start 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 0x7f4e4c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06c0a0 0x7f4e4c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 0x7f4e4c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c158150 con 0x7f4e4c15df50 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c14f910 con 0x7f4e4c06bcd0 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e51cdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1552f0 con 0x7f4e4c06c0a0 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e4bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 0x7f4e4c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e4b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 0x7f4e4c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e4affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06c0a0 0x7f4e4c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e4b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 0x7f4e4c0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:53344/0 (socket says 172.21.15.46:53344) 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.789+0000 7f4e4b7fe700 1 -- 172.21.15.46:0/170313418 learned_addr learned my addr 172.21.15.46:0/170313418 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 -- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06c0a0 msgr2=0x7f4e4c14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06c0a0 0x7f4e4c14f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 -- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 msgr2=0x7f4e4c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 0x7f4e4c0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 -- 172.21.15.46:0/170313418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009a20 con 0x7f4e4c15df50 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e4bfff700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 0x7f4e4c159e30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009f40 tx=0x7f4e4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400cb70 con 0x7f4e4c15df50 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400f040 con 0x7f4e4c15df50 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c009420 con 0x7f4e4c15df50 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44014480 con 0x7f4e4c15df50 2023-10-07T09:03:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.790+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0c81e0 con 0x7f4e4c15df50 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.791+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c158300 con 0x7f4e4c15df50 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.791+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4e44003020 con 0x7f4e4c15df50 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.792+0000 7f4e337fe700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 0x7f4e38069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.792+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f4e44085060 con 0x7f4e4c15df50 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.792+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 0x7f4e38069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:37.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.792+0000 7f4e4b7fe700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 0x7f4e38069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0093a0 tx=0x7f4e3c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:37.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:37.796+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e4c158300 con 0x7f4e4c15df50 2023-10-07T09:03:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.025+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e4c04c3c0 con 0x7f4e38066fc0 2023-10-07T09:03:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.033+0000 7f4e337fe700 1 -- 172.21.15.46:0/170313418 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+538 (secure 0 0 0) 0x7f4e4c04c3c0 con 0x7f4e38066fc0 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_addrs": [ 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.46:6789", 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6789", 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6790" 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "pending_subvolume_deletions": 1, 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": { 2023-10-07T09:03:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: "data": [ 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365957939200, 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_data", 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 8192 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": [ 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365957939200, 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_metadata", 2023-10-07T09:03:38.036 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 20455424 2023-10-07T09:03:38.037 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:38.037 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:03:38.037 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:38.037 INFO:teuthology.orchestra.run.smithi046.stdout: "used_size": 145 2023-10-07T09:03:38.037 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 msgr2=0x7f4e38069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 0x7f4e38069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0093a0 tx=0x7f4e3c017000 comp rx=0 tx=0).stop 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 msgr2=0x7f4e4c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 0x7f4e4c159e30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009f40 tx=0x7f4e4400b040 comp rx=0 tx=0).stop 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 shutdown_connections 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e38066fc0 0x7f4e38069470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e4c15df50 0x7f4e4c159e30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e4c06bcd0 0x7f4e4c0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 --2- 172.21.15.46:0/170313418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e4c06c0a0 0x7f4e4c14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 >> 172.21.15.46:0/170313418 conn(0x7f4e4c0ce600 msgr2=0x7f4e4c157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 shutdown_connections 2023-10-07T09:03:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:38.035+0000 7f4e51cdf700 1 -- 172.21.15.46:0/170313418 wait complete. 2023-10-07T09:03:38.048 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:03:38.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:03:38.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:03:38.126 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:03:38.127 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:03:38.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:38.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:03:38.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:03:38.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:03:38.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:03:38.689 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:03:38.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:03:38.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:03:39.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:03:39.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:03:39.304 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:03:39.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:39.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.451+0000 7f6beeae9700 1 Processor -- start 2023-10-07T09:03:39.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.451+0000 7f6beeae9700 1 -- start start 2023-10-07T09:03:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6beeae9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6beeae9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80ad930 con 0x7f6be8155c10 2023-10-07T09:03:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6beeae9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80acd20 con 0x7f6be81578b0 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6beeae9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80ad000 con 0x7f6be80b0a10 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bec885700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6be8155c10 0x7f6be80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47482/0 (socket says 172.21.15.46:47482) 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bec885700 1 -- 172.21.15.46:0/3274524896 learned_addr learned my addr 172.21.15.46:0/3274524896 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bed086700 1 --2- 172.21.15.46:0/3274524896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708009249 0 0) 0x7f6be80ad930 con 0x7f6be8155c10 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd0003570 con 0x7f6be8155c10 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750714962 0 0) 0x7f6be80acd20 con 0x7f6be81578b0 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be80ad930 con 0x7f6be81578b0 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bed086700 1 -- 172.21.15.46:0/3274524896 >> v1:172.21.15.133:6789/0 conn(0x7f6be81578b0 legacy=0x7f6be80af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bed086700 1 -- 172.21.15.46:0/3274524896 >> v1:172.21.15.46:6789/0 conn(0x7f6be8155c10 legacy=0x7f6be80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.452+0000 7f6bed086700 1 -- 172.21.15.46:0/3274524896 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80ad2e0 con 0x7f6be80b0a10 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6bed086700 1 --2- 172.21.15.46:0/3274524896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be8155fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e90 tx=0x7f6be0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2206fdbf6c7d95 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000e070 con 0x7f6be80b0a10 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000bb80 con 0x7f6be80b0a10 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6be77fe700 1 -- 172.21.15.46:0/3274524896 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0012430 con 0x7f6be80b0a10 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 -- 172.21.15.46:0/3274524896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 msgr2=0x7f6be8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 --2- 172.21.15.46:0/3274524896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be8155fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e90 tx=0x7f6be0009780 comp rx=0 tx=0).stop 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 -- 172.21.15.46:0/3274524896 shutdown_connections 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 --2- 172.21.15.46:0/3274524896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be8155fe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 -- 172.21.15.46:0/3274524896 >> 172.21.15.46:0/3274524896 conn(0x7f6be806a320 msgr2=0x7f6be80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 -- 172.21.15.46:0/3274524896 shutdown_connections 2023-10-07T09:03:39.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.453+0000 7f6beeae9700 1 -- 172.21.15.46:0/3274524896 wait complete. 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 Processor -- start 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 -- start start 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6be81578b0 0x7f6be8149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be814e960 con 0x7f6be8155c10 2023-10-07T09:03:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be8166940 con 0x7f6be81578b0 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.455+0000 7f6beeae9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81513c0 con 0x7f6be80b0a10 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6bec885700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40830/0 (socket says 172.21.15.46:40830) 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 -- 172.21.15.46:0/2121826624 learned_addr learned my addr 172.21.15.46:0/2121826624 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6bed086700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6be81578b0 0x7f6be8149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 -- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 msgr2=0x7f6be814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 -- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6be81578b0 msgr2=0x7f6be8149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6be81578b0 0x7f6be8149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 -- 172.21.15.46:0/2121826624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009a20 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6bec885700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be7fff700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c5b0 tx=0x7f6bdc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc010510 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc010670 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc010a30 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be814b240 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.456+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be814b800 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.457+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be814eb10 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.458+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6bdc01b400 con 0x7f6be8155c10 2023-10-07T09:03:39.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.458+0000 7f6be4ff9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 0x7f6bd4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.458+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6bdc0841e0 con 0x7f6be8155c10 2023-10-07T09:03:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.458+0000 7f6bec885700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 0x7f6bd4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.459+0000 7f6bec885700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 0x7f6bd4069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.463+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6be814eb10 con 0x7f6be8155c10 2023-10-07T09:03:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.697+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be814eb10 con 0x7f6be8155c10 2023-10-07T09:03:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.698+0000 7f6be4ff9700 1 -- 172.21.15.46:0/2121826624 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f6be814eb10 con 0x7f6be8155c10 2023-10-07T09:03:39.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:39.700 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 msgr2=0x7f6bd4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 0x7f6bd4069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 msgr2=0x7f6be8166400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c5b0 tx=0x7f6bdc007e10 comp rx=0 tx=0).stop 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 shutdown_connections 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bd4066fc0 0x7f6bd4069470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6be81578b0 0x7f6be8149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6be80b0a10 0x7f6be814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 --2- 172.21.15.46:0/2121826624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8155c10 0x7f6be8166400 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 >> 172.21.15.46:0/2121826624 conn(0x7f6be806a320 msgr2=0x7f6be8153370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 shutdown_connections 2023-10-07T09:03:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.700+0000 7f6beeae9700 1 -- 172.21.15.46:0/2121826624 wait complete. 2023-10-07T09:03:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 40 2023-10-07T09:03:39.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:39.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 Processor -- start 2023-10-07T09:03:39.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 -- start start 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98fc15c910 0x7f98fc15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc15d2b0 con 0x7f98fc0b5ea0 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0b2a40 con 0x7f98fc15c910 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.831+0000 7f9902a65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc15c480 con 0x7f98fc159c10 2023-10-07T09:03:39.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fbfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f98fc0b5ea0 0x7f98fc068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53724/0 (socket says 172.21.15.46:53724) 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fbfff700 1 -- 172.21.15.46:0/3424608473 learned_addr learned my addr 172.21.15.46:0/3424608473 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9900801700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 --2- 172.21.15.46:0/3424608473 >> v2:172.21.15.46:3300/0 conn(0x7f98fc15c910 0x7f98fc15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fb7fe700 1 -- 172.21.15.46:0/3424608473 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999525794 0 0) 0x7f98ec001110 con 0x7f98fc0b5ea0 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fb7fe700 1 -- 172.21.15.46:0/3424608473 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e8003570 con 0x7f98fc0b5ea0 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 -- 172.21.15.46:0/3424608473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 msgr2=0x7f98fc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 -- 172.21.15.46:0/3424608473 >> v1:172.21.15.46:6789/0 conn(0x7f98fc0b5ea0 legacy=0x7f98fc068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 -- 172.21.15.46:0/3424608473 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc15b5d0 con 0x7f98fc15c910 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f9901002700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc15cd70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98e40098e0 tx=0x7f98e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe980a7be5545321 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fb7fe700 1 -- 172.21.15.46:0/3424608473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011630 con 0x7f98fc15c910 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fb7fe700 1 -- 172.21.15.46:0/3424608473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e4011790 con 0x7f98fc15c910 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.832+0000 7f98fb7fe700 1 -- 172.21.15.46:0/3424608473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011b30 con 0x7f98fc15c910 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 -- 172.21.15.46:0/3424608473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 msgr2=0x7f98fc15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc15cd70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98e40098e0 tx=0x7f98e40091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 -- 172.21.15.46:0/3424608473 shutdown_connections 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc15cd70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 --2- 172.21.15.46:0/3424608473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 -- 172.21.15.46:0/3424608473 >> 172.21.15.46:0/3424608473 conn(0x7f98fc099a20 msgr2=0x7f98fc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 -- 172.21.15.46:0/3424608473 shutdown_connections 2023-10-07T09:03:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.833+0000 7f9902a65700 1 -- 172.21.15.46:0/3424608473 wait complete. 2023-10-07T09:03:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.834+0000 7f9902a65700 1 Processor -- start 2023-10-07T09:03:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.834+0000 7f9902a65700 1 -- start start 2023-10-07T09:03:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0b5ea0 0x7f98fc16c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc16c8f0 con 0x7f98fc15c910 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b1150 con 0x7f98fc0b5ea0 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9902a65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc16d8e0 con 0x7f98fc159c10 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9901002700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9901002700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43420/0 (socket says 172.21.15.46:43420) 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9901002700 1 -- 172.21.15.46:0/2933870218 learned_addr learned my addr 172.21.15.46:0/2933870218 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9900801700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0b5ea0 0x7f98fc16c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f98fbfff700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.835+0000 7f9901002700 1 -- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 msgr2=0x7f98fc0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9901002700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9901002700 1 -- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0b5ea0 msgr2=0x7f98fc16c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9901002700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0b5ea0 0x7f98fc16c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9901002700 1 -- 172.21.15.46:0/2933870218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4009420 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9901002700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f98fc063db0 tx=0x7f98e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011b10 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e40253f0 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc15f860 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4025790 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.836+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc15fe20 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.837+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc04c3c0 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.838+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f98e4025b80 con 0x7f98fc15c910 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.838+0000 7f98f8ff9700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 0x7f98dc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.838+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f98e4085e20 con 0x7f98fc15c910 2023-10-07T09:03:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.838+0000 7f9900801700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 0x7f98dc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.839+0000 7f9900801700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 0x7f98dc069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98f400f570 tx=0x7f98f400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:39.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:39.842+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98e4053060 con 0x7f98fc15c910 2023-10-07T09:03:40.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.034+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98fc15b900 con 0x7f98fc15c910 2023-10-07T09:03:40.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.035+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2933870218 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7f98e4056680 con 0x7f98fc15c910 2023-10-07T09:03:40.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:40.037 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:01:26.948373+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:40.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 msgr2=0x7f98dc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 0x7f98dc069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98f400f570 tx=0x7f98f400b040 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 msgr2=0x7f98fc16cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f98fc063db0 tx=0x7f98e4017000 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 shutdown_connections 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f98dc066fc0 0x7f98dc069470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc15c910 0x7f98fc16cad0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0b5ea0 0x7f98fc16c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 --2- 172.21.15.46:0/2933870218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98fc159c10 0x7f98fc0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 >> 172.21.15.46:0/2933870218 conn(0x7f98fc099a20 msgr2=0x7f98fc09a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 shutdown_connections 2023-10-07T09:03:40.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.038+0000 7f9902a65700 1 -- 172.21.15.46:0/2933870218 wait complete. 2023-10-07T09:03:40.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:00:29.803034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:00:30.366275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:03:40.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:03:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.172+0000 7fe5d6674700 1 Processor -- start 2023-10-07T09:03:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.172+0000 7fe5d6674700 1 -- start start 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5d6674700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0164690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5d6674700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d006bdb0 con 0x7fe5d0069d60 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5d6674700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d00cb370 con 0x7fe5d00aca80 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5d6674700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0159f60 con 0x7fe5d00c83c0 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5cf7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe5d0069d60 0x7fe5d00c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53726/0 (socket says 172.21.15.46:53726) 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.173+0000 7fe5cf7fe700 1 -- 172.21.15.46:0/4079901409 learned_addr learned my addr 172.21.15.46:0/4079901409 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/4079901409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5d4c11700 1 -- 172.21.15.46:0/4079901409 >> v1:172.21.15.133:6789/0 conn(0x7fe5d00aca80 legacy=0x7fe5d006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5d4c11700 1 -- 172.21.15.46:0/4079901409 >> v1:172.21.15.46:6789/0 conn(0x7fe5d0069d60 legacy=0x7fe5d00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5d4c11700 1 -- 172.21.15.46:0/4079901409 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d006b2b0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/4079901409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0164690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009e90 tx=0x7fe5c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6538ee1d6487013 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5ceffd700 1 -- 172.21.15.46:0/4079901409 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800e070 con 0x7fe5d00c83c0 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.174+0000 7fe5ceffd700 1 -- 172.21.15.46:0/4079901409 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800bc30 con 0x7fe5d00c83c0 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5ceffd700 1 -- 172.21.15.46:0/4079901409 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8012430 con 0x7fe5d00c83c0 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 -- 172.21.15.46:0/4079901409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 msgr2=0x7fe5d0164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 --2- 172.21.15.46:0/4079901409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0164690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009e90 tx=0x7fe5c8009780 comp rx=0 tx=0).stop 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 -- 172.21.15.46:0/4079901409 shutdown_connections 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 --2- 172.21.15.46:0/4079901409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0164690 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 -- 172.21.15.46:0/4079901409 >> 172.21.15.46:0/4079901409 conn(0x7fe5d00cd670 msgr2=0x7fe5d00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 -- 172.21.15.46:0/4079901409 shutdown_connections 2023-10-07T09:03:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.175+0000 7fe5d6674700 1 -- 172.21.15.46:0/4079901409 wait complete. 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.176+0000 7fe5d6674700 1 Processor -- start 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 -- start start 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 0x7fe5d00ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 0x7fe5d01574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d015d5e0 con 0x7fe5d0069d60 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d015d8c0 con 0x7fe5d00aca80 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d6674700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0157a30 con 0x7fe5d00c83c0 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 0x7fe5d00ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 0x7fe5d00ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43424/0 (socket says 172.21.15.46:43424) 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5cffff700 1 -- 172.21.15.46:0/3016353544 learned_addr learned my addr 172.21.15.46:0/3016353544 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.177+0000 7fe5cf7fe700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 0x7fe5d01574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 -- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 msgr2=0x7fe5d01574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 0x7fe5d01574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 -- 172.21.15.46:0/3016353544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 msgr2=0x7fe5d00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 0x7fe5d00ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 -- 172.21.15.46:0/3016353544 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009a20 con 0x7fe5d00c83c0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5cf7fe700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 0x7fe5d01574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.178+0000 7fe5d4c11700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0150680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8016000 tx=0x7fe5c8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.183+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c801e630 con 0x7fe5d00c83c0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.184+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0157d00 con 0x7fe5d00c83c0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.184+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c801e7d0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.184+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c801eb90 con 0x7fe5d00c83c0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.184+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d01582c0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.185+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d015da50 con 0x7fe5d00c83c0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.185+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fe5c8024070 con 0x7fe5d00c83c0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.185+0000 7fe5b7fff700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 0x7fe5bc069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.186+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe5c8087120 con 0x7fe5d00c83c0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.186+0000 7fe5cffff700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 0x7fe5bc069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.186+0000 7fe5cffff700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 0x7fe5bc069650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0003950 tx=0x7fe5c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.191+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5c80540c0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.381+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5d004c3c0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.382+0000 7fe5b7fff700 1 -- 172.21.15.46:0/3016353544 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5c80576e0 con 0x7fe5d00c83c0 2023-10-07T09:03:40.384 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:03:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 msgr2=0x7fe5bc069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 0x7fe5bc069650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0003950 tx=0x7fe5c0009040 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 msgr2=0x7fe5d0150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0150680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8016000 tx=0x7fe5c8019000 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 shutdown_connections 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe5bc0671a0 0x7fe5bc069650 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5d00c83c0 0x7fe5d0150680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d0069d60 0x7fe5d00ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 --2- 172.21.15.46:0/3016353544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5d00aca80 0x7fe5d01574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 >> 172.21.15.46:0/3016353544 conn(0x7fe5d00cd670 msgr2=0x7fe5d01525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 shutdown_connections 2023-10-07T09:03:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.385+0000 7fe5d6674700 1 -- 172.21.15.46:0/3016353544 wait complete. 2023-10-07T09:03:40.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:03:40.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.518+0000 7f1f9d23f700 1 Processor -- start 2023-10-07T09:03:40.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.518+0000 7f1f9d23f700 1 -- start start 2023-10-07T09:03:40.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9d23f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9d23f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9d23f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9815a160 con 0x7f1f9815db10 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9d23f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980d13a0 con 0x7f1f98159890 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9d23f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9815e140 con 0x7f1f98159c60 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f96d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f96d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43428/0 (socket says 172.21.15.46:43428) 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f96d9d700 1 -- 172.21.15.46:0/331714992 learned_addr learned my addr 172.21.15.46:0/331714992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f9659c700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f96d9d700 1 -- 172.21.15.46:0/331714992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159c60 msgr2=0x7f1f9815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f96d9d700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f96d9d700 1 -- 172.21.15.46:0/331714992 >> v1:172.21.15.133:6789/0 conn(0x7f1f9815db10 legacy=0x7f1f98069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f96d9d700 1 -- 172.21.15.46:0/331714992 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9815a3d0 con 0x7f1f98159890 2023-10-07T09:03:40.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.519+0000 7f1f95d9b700 1 -- 172.21.15.46:0/331714992 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610277734 0 0) 0x7f1f9815a160 con 0x7f1f9815db10 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f96d9d700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f98159890 0x7f1f9815abd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9154d62e6c5d940 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f95d9b700 1 -- 172.21.15.46:0/331714992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88009ea0 con 0x7f1f98159890 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f95d9b700 1 -- 172.21.15.46:0/331714992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800b860 con 0x7f1f98159890 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f95d9b700 1 -- 172.21.15.46:0/331714992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bc00 con 0x7f1f98159890 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 -- 172.21.15.46:0/331714992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f98159890 msgr2=0x7f1f9815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f98159890 0x7f1f9815abd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88009250 comp rx=0 tx=0).stop 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 -- 172.21.15.46:0/331714992 shutdown_connections 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f98159890 0x7f1f9815abd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/331714992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159c60 0x7f1f9815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 -- 172.21.15.46:0/331714992 >> 172.21.15.46:0/331714992 conn(0x7f1f98068e20 msgr2=0x7f1f980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 -- 172.21.15.46:0/331714992 shutdown_connections 2023-10-07T09:03:40.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.520+0000 7f1f9d23f700 1 -- 172.21.15.46:0/331714992 wait complete. 2023-10-07T09:03:40.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 Processor -- start 2023-10-07T09:03:40.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 -- start start 2023-10-07T09:03:40.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f98159c60 0x7f1f980c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c6bf0 con 0x7f1f9815db10 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c5fe0 con 0x7f1f98159c60 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.522+0000 7f1f9d23f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c62c0 con 0x7f1f98159890 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43438/0 (socket says 172.21.15.46:43438) 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 -- 172.21.15.46:0/1254589339 learned_addr learned my addr 172.21.15.46:0/1254589339 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9659c700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f98159c60 0x7f1f980c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f96d9d700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 -- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 msgr2=0x7f1f9814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9814b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 -- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f98159c60 msgr2=0x7f1f980c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f98159c60 0x7f1f980c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 -- 172.21.15.46:0/1254589339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f880094f0 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9759e700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c890 tx=0x7f1f90001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012630 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90012790 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980c65a0 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012b50 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.523+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9815c740 con 0x7f1f9815db10 2023-10-07T09:03:40.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.524+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804c3c0 con 0x7f1f9815db10 2023-10-07T09:03:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.525+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f1f9001a3a0 con 0x7f1f9815db10 2023-10-07T09:03:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.525+0000 7f1f8effd700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 0x7f1f78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.525+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1f90084a80 con 0x7f1f9815db10 2023-10-07T09:03:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.525+0000 7f1f96d9d700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 0x7f1f78069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.526+0000 7f1f96d9d700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 0x7f1f78069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.530+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f90051a20 con 0x7f1f9815db10 2023-10-07T09:03:40.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.722+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f980c6d30 con 0x7f1f9815db10 2023-10-07T09:03:40.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.723+0000 7f1f8effd700 1 -- 172.21.15.46:0/1254589339 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f90055040 con 0x7f1f9815db10 2023-10-07T09:03:40.725 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:03:40.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 msgr2=0x7f1f78069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 0x7f1f78069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88017000 comp rx=0 tx=0).stop 2023-10-07T09:03:40.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 msgr2=0x7f1f980ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c890 tx=0x7f1f90001670 comp rx=0 tx=0).stop 2023-10-07T09:03:40.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 shutdown_connections 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f78067170 0x7f1f78069620 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f9815db10 0x7f1f980ce410 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f98159890 0x7f1f9814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 --2- 172.21.15.46:0/1254589339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f98159c60 0x7f1f980c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 >> 172.21.15.46:0/1254589339 conn(0x7f1f98068e20 msgr2=0x7f1f9814d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 shutdown_connections 2023-10-07T09:03:40.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.725+0000 7f1f9d23f700 1 -- 172.21.15.46:0/1254589339 wait complete. 2023-10-07T09:03:40.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:03:40.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.858+0000 7f8c8ca4b700 1 Processor -- start 2023-10-07T09:03:40.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.858+0000 7f8c8ca4b700 1 -- start start 2023-10-07T09:03:40.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c8ca4b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c880ccc00 0x7f8c88069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c8ca4b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c8806a020 0x7f8c880cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c8ca4b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c880c9f30 con 0x7f8c88159a60 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c8ca4b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8806dfc0 con 0x7f8c8806a020 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c8ca4b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880ca470 con 0x7f8c880ccc00 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c8806a020 0x7f8c880cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c86ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c880ccc00 0x7f8c88069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c8806a020 0x7f8c880cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43450/0 (socket says 172.21.15.46:43450) 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 -- 172.21.15.46:0/3966694798 learned_addr learned my addr 172.21.15.46:0/3966694798 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 -- 172.21.15.46:0/3966694798 >> v2:172.21.15.133:3300/0 conn(0x7f8c880ccc00 msgr2=0x7f8c88069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 --2- 172.21.15.46:0/3966694798 >> v2:172.21.15.133:3300/0 conn(0x7f8c880ccc00 0x7f8c88069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 -- 172.21.15.46:0/3966694798 >> v1:172.21.15.133:6789/0 conn(0x7f8c88159a60 legacy=0x7f8c880c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.859+0000 7f8c87fff700 1 -- 172.21.15.46:0/3966694798 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880ca750 con 0x7f8c8806a020 2023-10-07T09:03:40.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c87fff700 1 --2- 172.21.15.46:0/3966694798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c8806a020 0x7f8c880cb230 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8c880cf6a0 tx=0x7f8c80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c1482e3fd20f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c867fc700 1 -- 172.21.15.46:0/3966694798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000e070 con 0x7f8c8806a020 2023-10-07T09:03:40.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c867fc700 1 -- 172.21.15.46:0/3966694798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000bab0 con 0x7f8c8806a020 2023-10-07T09:03:40.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c867fc700 1 -- 172.21.15.46:0/3966694798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800092e0 con 0x7f8c8806a020 2023-10-07T09:03:40.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3966694798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c8806a020 msgr2=0x7f8c880cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3966694798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c8806a020 0x7f8c880cb230 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8c880cf6a0 tx=0x7f8c80009840 comp rx=0 tx=0).stop 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3966694798 shutdown_connections 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3966694798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c8806a020 0x7f8c880cb230 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3966694798 >> v2:172.21.15.133:3300/0 conn(0x7f8c880ccc00 0x7f8c88069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3966694798 >> 172.21.15.46:0/3966694798 conn(0x7f8c8806baa0 msgr2=0x7f8c8806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3966694798 shutdown_connections 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.860+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3966694798 wait complete. 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 Processor -- start 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 -- start start 2023-10-07T09:03:40.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8806a020 0x7f8c88153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8c88159a60 0x7f8c88156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880b4190 con 0x7f8c880ccc00 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880b3580 con 0x7f8c8806a020 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.862+0000 7f8c8ca4b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880b3860 con 0x7f8c88159a60 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43454/0 (socket says 172.21.15.46:43454) 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 -- 172.21.15.46:0/3870768605 learned_addr learned my addr 172.21.15.46:0/3870768605 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c877fe700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8806a020 0x7f8c88153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c87fff700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8c88159a60 0x7f8c88156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 -- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8c88159a60 msgr2=0x7f8c88156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8c88159a60 0x7f8c88156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 -- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8806a020 msgr2=0x7f8c88153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8806a020 0x7f8c88153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 -- 172.21.15.46:0/3870768605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80009ae0 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c86ffd700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00ec80 tx=0x7f8c7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00c850 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00c9b0 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c880b3b40 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00cd50 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.863+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c880c8570 con 0x7f8c880ccc00 2023-10-07T09:03:40.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.864+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8806eba0 con 0x7f8c880ccc00 2023-10-07T09:03:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.865+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8c7c013680 con 0x7f8c880ccc00 2023-10-07T09:03:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.865+0000 7f8c6f7fe700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 0x7f8c74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.865+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8c7c084a80 con 0x7f8c880ccc00 2023-10-07T09:03:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.865+0000 7f8c877fe700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 0x7f8c74069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:40.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.866+0000 7f8c877fe700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 0x7f8c74069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:40.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:40.869+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c7c051a20 con 0x7f8c880ccc00 2023-10-07T09:03:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.061+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c880caa30 con 0x7f8c880ccc00 2023-10-07T09:03:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.061+0000 7f8c6f7fe700 1 -- 172.21.15.46:0/3870768605 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c7c055040 con 0x7f8c880ccc00 2023-10-07T09:03:41.063 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:03:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 msgr2=0x7f8c74069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 0x7f8c74069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78007ea0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 msgr2=0x7f8c880b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00ec80 tx=0x7f8c7c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 shutdown_connections 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8c74067170 0x7f8c74069620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8c88159a60 0x7f8c88156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8806a020 0x7f8c88153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 --2- 172.21.15.46:0/3870768605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c880ccc00 0x7f8c880b2ba0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 >> 172.21.15.46:0/3870768605 conn(0x7f8c8806baa0 msgr2=0x7f8c880cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 shutdown_connections 2023-10-07T09:03:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.064+0000 7f8c8ca4b700 1 -- 172.21.15.46:0/3870768605 wait complete. 2023-10-07T09:03:41.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:41.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.194+0000 7fa58a43c700 1 Processor -- start 2023-10-07T09:03:41.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.194+0000 7fa58a43c700 1 -- start start 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58a43c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa584159420 0x7fa5840b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58a43c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5841597f0 0x7fa5840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58a43c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840b11d0 con 0x7fa58415d230 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58a43c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840b14b0 con 0x7fa584159420 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58a43c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840b1790 con 0x7fa5841597f0 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58943a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa584159420 0x7fa5840b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa589c3b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa58415d230 0x7fa58415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53734/0 (socket says 172.21.15.46:53734) 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa589c3b700 1 -- 172.21.15.46:0/2133246697 learned_addr learned my addr 172.21.15.46:0/2133246697 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa588c39700 1 --2- 172.21.15.46:0/2133246697 >> v2:172.21.15.133:3300/0 conn(0x7fa5841597f0 0x7fa5840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58943a700 1 -- 172.21.15.46:0/2133246697 >> v2:172.21.15.133:3300/0 conn(0x7fa5841597f0 msgr2=0x7fa5840b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa58943a700 1 --2- 172.21.15.46:0/2133246697 >> v2:172.21.15.133:3300/0 conn(0x7fa5841597f0 0x7fa5840b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58943a700 1 -- 172.21.15.46:0/2133246697 >> v1:172.21.15.46:6789/0 conn(0x7fa58415d230 legacy=0x7fa58415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.195+0000 7fa583fff700 1 -- 172.21.15.46:0/2133246697 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247536948 0 0) 0x7fa5840b11d0 con 0x7fa58415d230 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58943a700 1 -- 172.21.15.46:0/2133246697 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840b1a70 con 0x7fa584159420 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58943a700 1 --2- 172.21.15.46:0/2133246697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa584159420 0x7fa5840b5f40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa584089750 tx=0x7fa57c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fc56f993738731 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa583fff700 1 -- 172.21.15.46:0/2133246697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00e070 con 0x7fa584159420 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa583fff700 1 -- 172.21.15.46:0/2133246697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00bb60 con 0x7fa584159420 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa583fff700 1 -- 172.21.15.46:0/2133246697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c012430 con 0x7fa584159420 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 -- 172.21.15.46:0/2133246697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa584159420 msgr2=0x7fa5840b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 --2- 172.21.15.46:0/2133246697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa584159420 0x7fa5840b5f40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa584089750 tx=0x7fa57c009780 comp rx=0 tx=0).stop 2023-10-07T09:03:41.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 -- 172.21.15.46:0/2133246697 shutdown_connections 2023-10-07T09:03:41.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 --2- 172.21.15.46:0/2133246697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa584159420 0x7fa5840b5f40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 --2- 172.21.15.46:0/2133246697 >> v2:172.21.15.133:3300/0 conn(0x7fa5841597f0 0x7fa5840b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 -- 172.21.15.46:0/2133246697 >> 172.21.15.46:0/2133246697 conn(0x7fa5840d0660 msgr2=0x7fa5840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 -- 172.21.15.46:0/2133246697 shutdown_connections 2023-10-07T09:03:41.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.196+0000 7fa58a43c700 1 -- 172.21.15.46:0/2133246697 wait complete. 2023-10-07T09:03:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 Processor -- start 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 -- start start 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 0x7fa5840c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 0x7fa584156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.198+0000 7fa58a43c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584169bc0 con 0x7fa58415d230 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58a43c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840c5c30 con 0x7fa584159420 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58a43c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840c5f10 con 0x7fa5841597f0 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58943a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 0x7fa5840c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa588c39700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 0x7fa584156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43468/0 (socket says 172.21.15.46:43468) 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58943a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 0x7fa5840c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:36194/0 (socket says 172.21.15.46:36194) 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 -- 172.21.15.46:0/589577661 learned_addr learned my addr 172.21.15.46:0/589577661 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 -- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 msgr2=0x7fa584156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 0x7fa584156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 -- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 msgr2=0x7fa5840c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 0x7fa5840c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 -- 172.21.15.46:0/589577661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c009a20 con 0x7fa58415d230 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa588c39700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 0x7fa584156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa589c3b700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c500 tx=0x7fa574007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574005b30 con 0x7fa58415d230 2023-10-07T09:03:41.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574005c90 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5840c61f0 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574007320 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.199+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa584169820 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.200+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584169d70 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.201+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa57401b3b0 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.201+0000 7fa5817fa700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 0x7fa570069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.201+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa574083c20 con 0x7fa58415d230 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.201+0000 7fa58943a700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 0x7fa570069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.202+0000 7fa58943a700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 0x7fa570069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0099f0 tx=0x7fa57c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.206+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa574050bc0 con 0x7fa58415d230 2023-10-07T09:03:41.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.442+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa58404c3c0 con 0x7fa58415d230 2023-10-07T09:03:41.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.443+0000 7fa5817fa700 1 -- 172.21.15.46:0/589577661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa574017020 con 0x7fa58415d230 2023-10-07T09:03:41.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:41.445 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:03:41.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 msgr2=0x7fa570069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 0x7fa570069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0099f0 tx=0x7fa57c019000 comp rx=0 tx=0).stop 2023-10-07T09:03:41.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 msgr2=0x7fa5840b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c500 tx=0x7fa574007f60 comp rx=0 tx=0).stop 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 shutdown_connections 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa570067170 0x7fa570069620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa58415d230 0x7fa5840b5900 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584159420 0x7fa5840c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 --2- 172.21.15.46:0/589577661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5841597f0 0x7fa584156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 >> 172.21.15.46:0/589577661 conn(0x7fa5840d0660 msgr2=0x7fa5840cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 shutdown_connections 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.445+0000 7fa58a43c700 1 -- 172.21.15.46:0/589577661 wait complete. 2023-10-07T09:03:41.448 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 40 2023-10-07T09:03:41.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:41.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 Processor -- start 2023-10-07T09:03:41.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 -- start start 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdef406bcd0 0x7fdef40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdef406c0a0 0x7fdef415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef415d7e0 con 0x7fdef415df50 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef415dac0 con 0x7fdef406c0a0 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef943d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef415aa30 con 0x7fdef406bcd0 2023-10-07T09:03:41.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdef406c0a0 0x7fdef415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdef415df50 0x7fdef40c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53738/0 (socket says 172.21.15.46:53738) 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdef406c0a0 0x7fdef415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43482/0 (socket says 172.21.15.46:43482) 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef37fe700 1 -- 172.21.15.46:0/1893667958 learned_addr learned my addr 172.21.15.46:0/1893667958 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef2ffd700 1 --2- 172.21.15.46:0/1893667958 >> v2:172.21.15.133:3300/0 conn(0x7fdef406bcd0 0x7fdef40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 -- 172.21.15.46:0/1893667958 >> v2:172.21.15.133:3300/0 conn(0x7fdef406bcd0 msgr2=0x7fdef40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 --2- 172.21.15.46:0/1893667958 >> v2:172.21.15.133:3300/0 conn(0x7fdef406bcd0 0x7fdef40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 -- 172.21.15.46:0/1893667958 >> v1:172.21.15.46:6789/0 conn(0x7fdef415df50 legacy=0x7fdef40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 -- 172.21.15.46:0/1893667958 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef415ad10 con 0x7fdef406c0a0 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef27fc700 1 --2- 172.21.15.46:0/1893667958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef406c0a0 0x7fdef415a1e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdef40691a0 tx=0x7fdee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc433e1b543ad4c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef1ffb700 1 -- 172.21.15.46:0/1893667958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4011630 con 0x7fdef406c0a0 2023-10-07T09:03:41.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef1ffb700 1 -- 172.21.15.46:0/1893667958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4011790 con 0x7fdef406c0a0 2023-10-07T09:03:41.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.578+0000 7fdef1ffb700 1 -- 172.21.15.46:0/1893667958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4011b30 con 0x7fdef406c0a0 2023-10-07T09:03:41.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 -- 172.21.15.46:0/1893667958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef406c0a0 msgr2=0x7fdef415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 --2- 172.21.15.46:0/1893667958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef406c0a0 0x7fdef415a1e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdef40691a0 tx=0x7fdee40091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 -- 172.21.15.46:0/1893667958 shutdown_connections 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 --2- 172.21.15.46:0/1893667958 >> v2:172.21.15.133:3300/0 conn(0x7fdef406bcd0 0x7fdef40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 --2- 172.21.15.46:0/1893667958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef406c0a0 0x7fdef415a1e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 -- 172.21.15.46:0/1893667958 >> 172.21.15.46:0/1893667958 conn(0x7fdef40ce600 msgr2=0x7fdef40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 -- 172.21.15.46:0/1893667958 shutdown_connections 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.579+0000 7fdef943d700 1 -- 172.21.15.46:0/1893667958 wait complete. 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.580+0000 7fdef943d700 1 Processor -- start 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.580+0000 7fdef943d700 1 -- start start 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef406bcd0 0x7fdef40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef406c0a0 0x7fdef40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40c7250 con 0x7fdef415df50 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40b2a40 con 0x7fdef406bcd0 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef943d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40c6700 con 0x7fdef406c0a0 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43490/0 (socket says 172.21.15.46:43490) 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 -- 172.21.15.46:0/2578957820 learned_addr learned my addr 172.21.15.46:0/2578957820 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef2ffd700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef406bcd0 0x7fdef40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef27fc700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef406c0a0 0x7fdef40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 -- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef406c0a0 msgr2=0x7fdef40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef406c0a0 0x7fdef40c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 -- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef406bcd0 msgr2=0x7fdef40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef406bcd0 0x7fdef40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.581+0000 7fdef37fe700 1 -- 172.21.15.46:0/2578957820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4009420 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdef37fe700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00cc70 tx=0x7fdeec001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00a850 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec00a9b0 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef40c69b0 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00ad70 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.582+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef40c6f70 con 0x7fdef415df50 2023-10-07T09:03:41.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.583+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef404c3c0 con 0x7fdef415df50 2023-10-07T09:03:41.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.583+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdeec007300 con 0x7fdef415df50 2023-10-07T09:03:41.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.584+0000 7fdeeaffd700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 0x7fded4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.584+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdeec084b30 con 0x7fdef415df50 2023-10-07T09:03:41.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.584+0000 7fdef2ffd700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 0x7fded4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.584+0000 7fdef2ffd700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 0x7fded4069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009d10 tx=0x7fdedc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.588+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdeec051b50 con 0x7fdef415df50 2023-10-07T09:03:41.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.782+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdef415a500 con 0x7fdef415df50 2023-10-07T09:03:41.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.782+0000 7fdeeaffd700 1 -- 172.21.15.46:0/2578957820 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7fdeec055170 con 0x7fdef415df50 2023-10-07T09:03:41.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:41.783 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:01:26.948373+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 msgr2=0x7fded4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 0x7fded4069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009d10 tx=0x7fdedc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 msgr2=0x7fdef4169e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00cc70 tx=0x7fdeec001a50 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 shutdown_connections 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fded4067170 0x7fded4069620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef415df50 0x7fdef4169e60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef406bcd0 0x7fdef40c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 --2- 172.21.15.46:0/2578957820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef406c0a0 0x7fdef40c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 >> 172.21.15.46:0/2578957820 conn(0x7fdef40ce600 msgr2=0x7fdef406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 shutdown_connections 2023-10-07T09:03:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.785+0000 7fdef943d700 1 -- 172.21.15.46:0/2578957820 wait complete. 2023-10-07T09:03:41.797 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:03:41.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:41.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.916+0000 7f0c7f0a3700 1 Processor -- start 2023-10-07T09:03:41.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.916+0000 7f0c7f0a3700 1 -- start start 2023-10-07T09:03:41.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7f0a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 0x7f0c7815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7f0a3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 0x7f0c7815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7f0a3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7815a160 con 0x7f0c7815db10 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7f0a3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780d13a0 con 0x7f0c78159c60 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7f0a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815e140 con 0x7f0c78159890 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7d640700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0c7815db10 0x7f0c78069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53752/0 (socket says 172.21.15.46:53752) 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7d640700 1 -- 172.21.15.46:0/2786011874 learned_addr learned my addr 172.21.15.46:0/2786011874 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c77fff700 1 --2- 172.21.15.46:0/2786011874 >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 0x7f0c7815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.917+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2786011874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 0x7f0c7815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c777fe700 1 -- 172.21.15.46:0/2786011874 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380127133 0 0) 0x7f0c7815a160 con 0x7f0c7815db10 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c777fe700 1 -- 172.21.15.46:0/2786011874 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c60003570 con 0x7f0c7815db10 2023-10-07T09:03:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c7ce3f700 1 -- 172.21.15.46:0/2786011874 >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 msgr2=0x7f0c7815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2786011874 >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 0x7f0c7815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c7ce3f700 1 -- 172.21.15.46:0/2786011874 >> v1:172.21.15.46:6789/0 conn(0x7f0c7815db10 legacy=0x7f0c78069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c7ce3f700 1 -- 172.21.15.46:0/2786011874 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7815a3d0 con 0x7f0c78159890 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c77fff700 1 --2- 172.21.15.46:0/2786011874 >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 0x7f0c7815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2786011874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 0x7f0c7815abd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c680098e0 tx=0x7f0c680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb34c09bfbd3447e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c777fe700 1 -- 172.21.15.46:0/2786011874 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68011630 con 0x7f0c78159890 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c777fe700 1 -- 172.21.15.46:0/2786011874 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68011790 con 0x7f0c78159890 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.918+0000 7f0c777fe700 1 -- 172.21.15.46:0/2786011874 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68011b10 con 0x7f0c78159890 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2786011874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 msgr2=0x7f0c7815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2786011874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 0x7f0c7815abd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c680098e0 tx=0x7f0c680091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2786011874 shutdown_connections 2023-10-07T09:03:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2786011874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c78159890 0x7f0c7815abd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2786011874 >> v2:172.21.15.133:3300/0 conn(0x7f0c78159c60 0x7f0c7815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2786011874 >> 172.21.15.46:0/2786011874 conn(0x7f0c78068e20 msgr2=0x7f0c780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2786011874 shutdown_connections 2023-10-07T09:03:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.919+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2786011874 wait complete. 2023-10-07T09:03:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.920+0000 7f0c7f0a3700 1 Processor -- start 2023-10-07T09:03:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.920+0000 7f0c7f0a3700 1 -- start start 2023-10-07T09:03:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c78159890 0x7f0c7814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c7815db10 0x7f0c78151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c8550 con 0x7f0c78159c60 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c7940 con 0x7f0c78159890 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c7c20 con 0x7f0c7815db10 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43504/0 (socket says 172.21.15.46:43504) 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 -- 172.21.15.46:0/2489634460 learned_addr learned my addr 172.21.15.46:0/2489634460 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c78159890 0x7f0c7814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7d640700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c7815db10 0x7f0c78151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 -- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c7815db10 msgr2=0x7f0c78151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c7815db10 0x7f0c78151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 -- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c78159890 msgr2=0x7f0c7814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:41.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c78159890 0x7f0c7814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 -- 172.21.15.46:0/2489634460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009420 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c77fff700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00ec80 tx=0x7f0c6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00c850 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00c9b0 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68009420 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.921+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00cd50 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.922+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c780c81e0 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.922+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7804c3c0 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.923+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0c6c013680 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.923+0000 7f0c74ff9700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 0x7f0c64069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.923+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0c6c0848c0 con 0x7f0c78159c60 2023-10-07T09:03:41.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.923+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 0x7f0c64069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.924+0000 7f0c7ce3f700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 0x7f0c64069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c680091e0 tx=0x7f0c68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:41.928+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c6c051860 con 0x7f0c78159c60 2023-10-07T09:03:42.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.164+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c780c8690 con 0x7f0c78159c60 2023-10-07T09:03:42.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.164+0000 7f0c74ff9700 1 -- 172.21.15.46:0/2489634460 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0c6c017090 con 0x7f0c78159c60 2023-10-07T09:03:42.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:42.165 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:03:42.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 msgr2=0x7f0c64069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 0x7f0c64069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c680091e0 tx=0x7f0c68017000 comp rx=0 tx=0).stop 2023-10-07T09:03:42.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 msgr2=0x7f0c780c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00ec80 tx=0x7f0c6c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 shutdown_connections 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c64067170 0x7f0c64069620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c7815db10 0x7f0c78151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c78159890 0x7f0c7814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 --2- 172.21.15.46:0/2489634460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c78159c60 0x7f0c780c91f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 >> 172.21.15.46:0/2489634460 conn(0x7f0c78068e20 msgr2=0x7f0c780c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 shutdown_connections 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.167+0000 7f0c7f0a3700 1 -- 172.21.15.46:0/2489634460 wait complete. 2023-10-07T09:03:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 40 2023-10-07T09:03:42.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:42.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:03:42.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:03:42.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.299+0000 7ff415025700 1 Processor -- start 2023-10-07T09:03:42.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.299+0000 7ff415025700 1 -- start start 2023-10-07T09:03:42.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff415025700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff41015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff415025700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff410069560 0x7ff4100699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff415025700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41015a160 con 0x7ff410159c60 2023-10-07T09:03:42.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff415025700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff410069f20 con 0x7ff410069560 2023-10-07T09:03:42.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff415025700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100d13a0 con 0x7ff410159890 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff410069560 0x7ff4100699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff410069560 0x7ff4100699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43518/0 (socket says 172.21.15.46:43518) 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 -- 172.21.15.46:0/770943128 learned_addr learned my addr 172.21.15.46:0/770943128 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40ed9d700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff41015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 -- 172.21.15.46:0/770943128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 msgr2=0x7ff41015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff41015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 -- 172.21.15.46:0/770943128 >> v1:172.21.15.133:6789/0 conn(0x7ff410159c60 legacy=0x7ff41015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40dd9b700 1 -- 172.21.15.46:0/770943128 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277082122 0 0) 0x7ff41015a160 con 0x7ff410159c60 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 -- 172.21.15.46:0/770943128 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41015e140 con 0x7ff410069560 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.300+0000 7ff40f59e700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff4100699e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff4080099b0 tx=0x7ff408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c30d202e1acd84 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff40dd9b700 1 -- 172.21.15.46:0/770943128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408009ea0 con 0x7ff410069560 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff40dd9b700 1 -- 172.21.15.46:0/770943128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40800b860 con 0x7ff410069560 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff40dd9b700 1 -- 172.21.15.46:0/770943128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800bc00 con 0x7ff410069560 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 -- 172.21.15.46:0/770943128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 msgr2=0x7ff4100699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff4100699e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff4080099b0 tx=0x7ff408009250 comp rx=0 tx=0).stop 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 -- 172.21.15.46:0/770943128 shutdown_connections 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff4100699e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 --2- 172.21.15.46:0/770943128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff41015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 -- 172.21.15.46:0/770943128 >> 172.21.15.46:0/770943128 conn(0x7ff410068e20 msgr2=0x7ff4100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 -- 172.21.15.46:0/770943128 shutdown_connections 2023-10-07T09:03:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.301+0000 7ff415025700 1 -- 172.21.15.46:0/770943128 wait complete. 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.302+0000 7ff415025700 1 Processor -- start 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.302+0000 7ff415025700 1 -- start start 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff410153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410159c60 0x7ff41016a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b3590 con 0x7ff410069560 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b3870 con 0x7ff410159c60 2023-10-07T09:03:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff415025700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41016a040 con 0x7ff410159890 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff40ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff40ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43526/0 (socket says 172.21.15.46:43526) 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff40ed9d700 1 -- 172.21.15.46:0/2346887845 learned_addr learned my addr 172.21.15.46:0/2346887845 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff40f59e700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410159c60 0x7ff41016a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.303+0000 7ff40e59c700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff410153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 -- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 msgr2=0x7ff410153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff410153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 -- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410159c60 msgr2=0x7ff41016a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410159c60 0x7ff41016a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 -- 172.21.15.46:0/2346887845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080094f0 con 0x7ff410069560 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff40ed9d700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff40000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000cb70 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000f040 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41016a320 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400014480 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.304+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4101697f0 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.305+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4100b3b50 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.305+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff4000147f0 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.306+0000 7ff406ffd700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 0x7ff3f0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.306+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff4000852e0 con 0x7ff410069560 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.306+0000 7ff40e59c700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 0x7ff3f0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.306+0000 7ff40e59c700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 0x7ff3f0069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff410155000 tx=0x7ff3f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.310+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4000520d0 con 0x7ff410069560 2023-10-07T09:03:42.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.547+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff41004c3c0 con 0x7ff410069560 2023-10-07T09:03:42.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.547+0000 7ff406ffd700 1 -- 172.21.15.46:0/2346887845 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff4000556f0 con 0x7ff410069560 2023-10-07T09:03:42.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:42.548 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:00:31.406136+0000","modified":"2023-10-07T09:00:35.020440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/635739532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":635739532},{"type":"v1","addr":"172.21.15.133:6836","nonce":635739532}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T09:03:42.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 msgr2=0x7ff3f0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 0x7ff3f0069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff410155000 tx=0x7ff3f8009040 comp rx=0 tx=0).stop 2023-10-07T09:03:42.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 msgr2=0x7ff41015c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff40000b040 comp rx=0 tx=0).stop 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 shutdown_connections 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3f0067170 0x7ff3f0069620 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410159c60 0x7ff41016a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff410069560 0x7ff41015c790 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 --2- 172.21.15.46:0/2346887845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff410159890 0x7ff410153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 >> 172.21.15.46:0/2346887845 conn(0x7ff410068e20 msgr2=0x7ff410155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 shutdown_connections 2023-10-07T09:03:42.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.549+0000 7ff415025700 1 -- 172.21.15.46:0/2346887845 wait complete. 2023-10-07T09:03:42.552 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 40 2023-10-07T09:03:42.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:42.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.720+0000 7f18bb59e700 1 Processor -- start 2023-10-07T09:03:42.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.720+0000 7f18bb59e700 1 -- start start 2023-10-07T09:03:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18bc159420 0x7f18bc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bb59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f18bc15d230 0x7f18bc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bb59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0b2980 con 0x7f18bc1597f0 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bb59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc15db70 con 0x7f18bc15d230 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0b11d0 con 0x7f18bc159420 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18bad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f18bc15d230 0x7f18bc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18b9d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f18bc1597f0 0x7f18bc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53764/0 (socket says 172.21.15.46:53764) 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18b9d9b700 1 -- 172.21.15.46:0/2458413525 learned_addr learned my addr 172.21.15.46:0/2458413525 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.721+0000 7f18ba59c700 1 --2- 172.21.15.46:0/2458413525 >> v2:172.21.15.133:3300/0 conn(0x7f18bc159420 0x7f18bc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bad9d700 1 -- 172.21.15.46:0/2458413525 >> v2:172.21.15.133:3300/0 conn(0x7f18bc159420 msgr2=0x7f18bc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bad9d700 1 --2- 172.21.15.46:0/2458413525 >> v2:172.21.15.133:3300/0 conn(0x7f18bc159420 0x7f18bc0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bad9d700 1 -- 172.21.15.46:0/2458413525 >> v1:172.21.15.46:6789/0 conn(0x7f18bc1597f0 legacy=0x7f18bc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18b959a700 1 -- 172.21.15.46:0/2458413525 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171364081 0 0) 0x7f18bc0b2980 con 0x7f18bc1597f0 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bad9d700 1 -- 172.21.15.46:0/2458413525 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0b14b0 con 0x7f18bc15d230 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bad9d700 1 --2- 172.21.15.46:0/2458413525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc15d230 0x7f18bc15d630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0b2f20 tx=0x7f18b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cd332c1a82a175 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18b959a700 1 -- 172.21.15.46:0/2458413525 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011630 con 0x7f18bc15d230 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18b959a700 1 -- 172.21.15.46:0/2458413525 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4011790 con 0x7f18bc15d230 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18b959a700 1 -- 172.21.15.46:0/2458413525 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011b30 con 0x7f18bc15d230 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bb59e700 1 -- 172.21.15.46:0/2458413525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc15d230 msgr2=0x7f18bc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2458413525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc15d230 0x7f18bc15d630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0b2f20 tx=0x7f18b40091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.722+0000 7f18bb59e700 1 -- 172.21.15.46:0/2458413525 shutdown_connections 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.723+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2458413525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc15d230 0x7f18bc15d630 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.723+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2458413525 >> v2:172.21.15.133:3300/0 conn(0x7f18bc159420 0x7f18bc0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.723+0000 7f18bb59e700 1 -- 172.21.15.46:0/2458413525 >> 172.21.15.46:0/2458413525 conn(0x7f18bc0d0660 msgr2=0x7f18bc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.723+0000 7f18bb59e700 1 -- 172.21.15.46:0/2458413525 shutdown_connections 2023-10-07T09:03:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.723+0000 7f18bb59e700 1 -- 172.21.15.46:0/2458413525 wait complete. 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 Processor -- start 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 -- start start 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18bc1597f0 0x7f18bc143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18bc15d230 0x7f18bc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc15c6b0 con 0x7f18bc159420 2023-10-07T09:03:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc15ce60 con 0x7f18bc1597f0 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18bb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0c5940 con 0x7f18bc15d230 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18ba59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18ba59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43542/0 (socket says 172.21.15.46:43542) 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.724+0000 7f18ba59c700 1 -- 172.21.15.46:0/2389334204 learned_addr learned my addr 172.21.15.46:0/2389334204 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18b9d9b700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18bc1597f0 0x7f18bc143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18bad9d700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18bc15d230 0x7f18bc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 -- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18bc15d230 msgr2=0x7f18bc0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18bc15d230 0x7f18bc0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 -- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18bc1597f0 msgr2=0x7f18bc143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18bc1597f0 0x7f18bc143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 -- 172.21.15.46:0/2389334204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009420 con 0x7f18bc159420 2023-10-07T09:03:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18ba59c700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009f10 tx=0x7f18ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00cb70 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00f040 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc15baa0 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac014480 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.725+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc15c060 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.726+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc04c3c0 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.726+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f18ac014830 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.727+0000 7f18b27fc700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 0x7f189c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.727+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f18ac085390 con 0x7f18bc159420 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.727+0000 7f18b9d9b700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 0x7f189c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.727+0000 7f18b9d9b700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 0x7f189c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18bc158e10 tx=0x7f18a4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.731+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18ac052220 con 0x7f18bc159420 2023-10-07T09:03:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.924+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18bc0b1790 con 0x7f18bc159420 2023-10-07T09:03:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.925+0000 7f18b27fc700 1 -- 172.21.15.46:0/2389334204 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7f18ac055840 con 0x7f18bc159420 2023-10-07T09:03:42.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:42.926 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:01:26.948373+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:00:29.803034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T09:00:30.366275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 msgr2=0x7f189c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 0x7f189c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18bc158e10 tx=0x7f18a4007d30 comp rx=0 tx=0).stop 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 msgr2=0x7f18bc0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009f10 tx=0x7f18ac00b040 comp rx=0 tx=0).stop 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 shutdown_connections 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f189c067170 0x7f189c069620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18bc15d230 0x7f18bc0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc159420 0x7f18bc0c5400 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 --2- 172.21.15.46:0/2389334204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18bc1597f0 0x7f18bc143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 >> 172.21.15.46:0/2389334204 conn(0x7f18bc0d0660 msgr2=0x7f18bc0af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 shutdown_connections 2023-10-07T09:03:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:42.927+0000 7f18bb59e700 1 -- 172.21.15.46:0/2389334204 wait complete. 2023-10-07T09:03:42.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:03:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.059+0000 7f63f2c44700 1 Processor -- start 2023-10-07T09:03:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 -- start start 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec15c480 con 0x7f63ec068bb0 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0b2a40 con 0x7f63ec159c10 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.060+0000 7f63f2c44700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15b5d0 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63f09e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63f11e1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f63ec068bb0 0x7f63ec15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:44792/0 (socket says 172.21.15.46:44792) 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63f11e1700 1 -- 172.21.15.46:0/2695894351 learned_addr learned my addr 172.21.15.46:0/2695894351 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49170/0 (socket says 172.21.15.46:49170) 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63f09e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:36260/0 (socket says 172.21.15.46:36260) 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 -- 172.21.15.46:0/2695894351 >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 msgr2=0x7f63ec15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 --2- 172.21.15.46:0/2695894351 >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 -- 172.21.15.46:0/2695894351 >> v1:172.21.15.133:6789/0 conn(0x7f63ec068bb0 legacy=0x7f63ec15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 -- 172.21.15.46:0/2695894351 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec15b870 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63eb7fe700 1 -- 172.21.15.46:0/2695894351 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974101749 0 0) 0x7f63ec15c480 con 0x7f63ec068bb0 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63f09e0700 1 --2- 172.21.15.46:0/2695894351 >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63ebfff700 1 --2- 172.21.15.46:0/2695894351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098e0 tx=0x7f63e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d862c3e516e7e28 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63eb7fe700 1 -- 172.21.15.46:0/2695894351 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000b640 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63eb7fe700 1 -- 172.21.15.46:0/2695894351 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000b7a0 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.061+0000 7f63eb7fe700 1 -- 172.21.15.46:0/2695894351 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000bb40 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 -- 172.21.15.46:0/2695894351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 msgr2=0x7f63ec068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 --2- 172.21.15.46:0/2695894351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098e0 tx=0x7f63e00091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 -- 172.21.15.46:0/2695894351 shutdown_connections 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 --2- 172.21.15.46:0/2695894351 >> v2:172.21.15.133:3300/0 conn(0x7f63ec159c10 0x7f63ec15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 --2- 172.21.15.46:0/2695894351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b5ea0 0x7f63ec068670 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 -- 172.21.15.46:0/2695894351 >> 172.21.15.46:0/2695894351 conn(0x7f63ec099a20 msgr2=0x7f63ec0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 -- 172.21.15.46:0/2695894351 shutdown_connections 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.062+0000 7f63f2c44700 1 -- 172.21.15.46:0/2695894351 wait complete. 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.063+0000 7f63f2c44700 1 Processor -- start 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.063+0000 7f63f2c44700 1 -- start start 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b5ea0 0x7f63ec0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 0x7f63ec0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0b03b0 con 0x7f63ec159c10 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0b0690 con 0x7f63ec0b5ea0 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f2c44700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0b0970 con 0x7f63ec068bb0 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f09e0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f11e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 0x7f63ec0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b5ea0 0x7f63ec0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f09e0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49180/0 (socket says 172.21.15.46:49180) 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f09e0700 1 -- 172.21.15.46:0/298588594 learned_addr learned my addr 172.21.15.46:0/298588594 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f11e1700 1 -- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 msgr2=0x7f63ec0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f11e1700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f11e1700 1 -- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b5ea0 msgr2=0x7f63ec0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.064+0000 7f63f11e1700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b5ea0 0x7f63ec0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63f11e1700 1 -- 172.21.15.46:0/298588594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc009420 con 0x7f63ec159c10 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63f09e0700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63f11e1700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 0x7f63ec0c84d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cbe0 tx=0x7f63e40019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400a8b0 con 0x7f63ec159c10 2023-10-07T09:03:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400aa30 con 0x7f63ec159c10 2023-10-07T09:03:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e0009420 con 0x7f63ec159c10 2023-10-07T09:03:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400adf0 con 0x7f63ec159c10 2023-10-07T09:03:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.065+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec16a960 con 0x7f63ec159c10 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.066+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0b4410 con 0x7f63ec159c10 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.066+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f63e4007300 con 0x7f63ec159c10 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.067+0000 7f63e8ff9700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 0x7f63d8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.067+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f63e4084b50 con 0x7f63ec159c10 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.067+0000 7f63f09e0700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 0x7f63d8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.067+0000 7f63f09e0700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 0x7f63d8069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63dc011640 tx=0x7f63dc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.071+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e4051c20 con 0x7f63ec159c10 2023-10-07T09:03:43.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.308+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f63ec16ab50 con 0x7f63ec159c10 2023-10-07T09:03:43.309 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:03:43.309+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:03:43.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.312+0000 7f63e8ff9700 1 -- 172.21.15.46:0/298588594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f63e4055240 con 0x7f63ec159c10 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 msgr2=0x7f63d8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 0x7f63d8069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63dc011640 tx=0x7f63dc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 msgr2=0x7f63ec0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 0x7f63ec0c84d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cbe0 tx=0x7f63e40019a0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 shutdown_connections 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63d8067170 0x7f63d8069620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159c10 0x7f63ec0c84d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec068bb0 0x7f63ec0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 --2- 172.21.15.46:0/298588594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b5ea0 0x7f63ec0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 >> 172.21.15.46:0/298588594 conn(0x7f63ec099a20 msgr2=0x7f63ec0690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 shutdown_connections 2023-10-07T09:03:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.315+0000 7f63f2c44700 1 -- 172.21.15.46:0/298588594 wait complete. 2023-10-07T09:03:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:03:43.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:03:43.347 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:03:43.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.447+0000 7efc9bfc6700 1 Processor -- start 2023-10-07T09:03:43.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.447+0000 7efc9bfc6700 1 -- start start 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9bfc6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 0x7efc9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9bfc6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc94069560 0x7efc940699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9bfc6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc94069ee0 con 0x7efc94159c60 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9bfc6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9415a160 con 0x7efc94069560 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9bfc6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940d13a0 con 0x7efc94159890 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9a563700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc94069560 0x7efc940699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9a563700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc94069560 0x7efc940699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43562/0 (socket says 172.21.15.46:43562) 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc99d62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 0x7efc9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.448+0000 7efc9a563700 1 -- 172.21.15.46:0/1717234628 learned_addr learned my addr 172.21.15.46:0/1717234628 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:43.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9a563700 1 -- 172.21.15.46:0/1717234628 >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 msgr2=0x7efc9415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9a563700 1 --2- 172.21.15.46:0/1717234628 >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 0x7efc9415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9a563700 1 -- 172.21.15.46:0/1717234628 >> v1:172.21.15.133:6789/0 conn(0x7efc94159c60 legacy=0x7efc9415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9a563700 1 -- 172.21.15.46:0/1717234628 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9415e140 con 0x7efc94069560 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc98d60700 1 -- 172.21.15.46:0/1717234628 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231028319 0 0) 0x7efc94069ee0 con 0x7efc94159c60 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc99d62700 1 --2- 172.21.15.46:0/1717234628 >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 0x7efc9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9a563700 1 --2- 172.21.15.46:0/1717234628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94069560 0x7efc940699a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efc940d1090 tx=0x7efc8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29400872b0d5b635 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc98d60700 1 -- 172.21.15.46:0/1717234628 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00e070 con 0x7efc94069560 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc98d60700 1 -- 172.21.15.46:0/1717234628 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00ba20 con 0x7efc94069560 2023-10-07T09:03:43.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc98d60700 1 -- 172.21.15.46:0/1717234628 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0092e0 con 0x7efc94069560 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1717234628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94069560 msgr2=0x7efc940699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.449+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1717234628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94069560 0x7efc940699a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efc940d1090 tx=0x7efc8c009840 comp rx=0 tx=0).stop 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1717234628 shutdown_connections 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1717234628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94069560 0x7efc940699a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1717234628 >> v2:172.21.15.133:3300/0 conn(0x7efc94159890 0x7efc9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1717234628 >> 172.21.15.46:0/1717234628 conn(0x7efc94068e20 msgr2=0x7efc940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1717234628 shutdown_connections 2023-10-07T09:03:43.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.450+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1717234628 wait complete. 2023-10-07T09:03:43.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.451+0000 7efc9bfc6700 1 Processor -- start 2023-10-07T09:03:43.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.451+0000 7efc9bfc6700 1 -- start start 2023-10-07T09:03:43.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.451+0000 7efc9bfc6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 0x7efc941492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 0x7efc940b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c8e20 con 0x7efc94159c60 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c92a0 con 0x7efc94069560 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940cd1f0 con 0x7efc94159890 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43566/0 (socket says 172.21.15.46:43566) 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 -- 172.21.15.46:0/1805552915 learned_addr learned my addr 172.21.15.46:0/1805552915 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc99561700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 0x7efc940b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc99d62700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 0x7efc941492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 -- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 msgr2=0x7efc940b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 0x7efc940b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 -- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 msgr2=0x7efc941492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 0x7efc941492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 -- 172.21.15.46:0/1805552915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009420 con 0x7efc94159c60 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc99561700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 0x7efc940b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc99d62700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 0x7efc941492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9a563700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009880 tx=0x7efc8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c008c20 con 0x7efc94159c60 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c008d80 con 0x7efc94159c60 2023-10-07T09:03:43.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c009ae0 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.452+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0266b0 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.453+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940cd580 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.453+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9404c3c0 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.454+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7efc8c003040 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.454+0000 7efc89ffb700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 0x7efc78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.454+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7efc8c086aa0 con 0x7efc94159c60 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.454+0000 7efc99d62700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 0x7efc78069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:43.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.455+0000 7efc99d62700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 0x7efc78069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc900093f0 tx=0x7efc90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:43.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.459+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc8c053990 con 0x7efc94159c60 2023-10-07T09:03:43.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:43.695+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc9406a5b0 con 0x7efc94159c60 2023-10-07T09:03:44.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.314+0000 7efc89ffb700 1 -- 172.21.15.46:0/1805552915 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc8c0210a0 con 0x7efc94159c60 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 msgr2=0x7efc78069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 0x7efc78069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc900093f0 tx=0x7efc90008040 comp rx=0 tx=0).stop 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 msgr2=0x7efc940c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009880 tx=0x7efc8c018000 comp rx=0 tx=0).stop 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 shutdown_connections 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067170 0x7efc78069620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc94159c60 0x7efc940c8280 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc94069560 0x7efc941492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 --2- 172.21.15.46:0/1805552915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc94159890 0x7efc940b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 >> 172.21.15.46:0/1805552915 conn(0x7efc94068e20 msgr2=0x7efc941578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 shutdown_connections 2023-10-07T09:03:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.317+0000 7efc9bfc6700 1 -- 172.21.15.46:0/1805552915 wait complete. 2023-10-07T09:03:44.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:03:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.459+0000 7f27d7f7f700 1 Processor -- start 2023-10-07T09:03:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.459+0000 7f27d7f7f700 1 -- start start 2023-10-07T09:03:44.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 0x7f27d00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27d00b53d0 0x7f27d00cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00b5b00 con 0x7f27d00b53d0 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00b5850 con 0x7f27d0159ec0 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d7f7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00b5da0 con 0x7f27d00cce40 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d551a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27d00b53d0 0x7f27d00cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d551a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27d00b53d0 0x7f27d00cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43568/0 (socket says 172.21.15.46:43568) 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.460+0000 7f27d551a700 1 -- 172.21.15.46:0/2315318114 learned_addr learned my addr 172.21.15.46:0/2315318114 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d651c700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d5d1b700 1 --2- 172.21.15.46:0/2315318114 >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 0x7f27d00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 -- 172.21.15.46:0/2315318114 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 msgr2=0x7f27d00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d00cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 -- 172.21.15.46:0/2315318114 >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 msgr2=0x7f27d00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 --2- 172.21.15.46:0/2315318114 >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 0x7f27d00b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 -- 172.21.15.46:0/2315318114 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00b6080 con 0x7f27d00b53d0 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d5d1b700 1 --2- 172.21.15.46:0/2315318114 >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 0x7f27d00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d551a700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d00b53d0 0x7f27d00cc900 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f27d0089120 tx=0x7f27c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51314c8f326ea837 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d4d19700 1 -- 172.21.15.46:0/2315318114 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400b860 con 0x7f27d00b53d0 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d4d19700 1 -- 172.21.15.46:0/2315318114 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c400b9c0 con 0x7f27d00b53d0 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.461+0000 7f27d4d19700 1 -- 172.21.15.46:0/2315318114 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400bd60 con 0x7f27d00b53d0 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 -- 172.21.15.46:0/2315318114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d00b53d0 msgr2=0x7f27d00cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d00b53d0 0x7f27d00cc900 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f27d0089120 tx=0x7f27c4009250 comp rx=0 tx=0).stop 2023-10-07T09:03:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 -- 172.21.15.46:0/2315318114 shutdown_connections 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/2315318114 >> v2:172.21.15.133:3300/0 conn(0x7f27d0159ec0 0x7f27d00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/2315318114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d00b53d0 0x7f27d00cc900 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 -- 172.21.15.46:0/2315318114 >> 172.21.15.46:0/2315318114 conn(0x7f27d00999f0 msgr2=0x7f27d00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 -- 172.21.15.46:0/2315318114 shutdown_connections 2023-10-07T09:03:44.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.462+0000 7f27d7f7f700 1 -- 172.21.15.46:0/2315318114 wait complete. 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.463+0000 7f27d7f7f700 1 Processor -- start 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.463+0000 7f27d7f7f700 1 -- start start 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00b53d0 0x7f27d0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d006b200 con 0x7f27d0159ec0 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0069c50 con 0x7f27d00b53d0 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0069040 con 0x7f27d00cce40 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43580/0 (socket says 172.21.15.46:43580) 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 -- 172.21.15.46:0/3147554484 learned_addr learned my addr 172.21.15.46:0/3147554484 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d5d1b700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00b53d0 0x7f27d0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d551a700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 -- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 msgr2=0x7f27d0154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d0154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 -- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00b53d0 msgr2=0x7f27d0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00b53d0 0x7f27d0158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 -- 172.21.15.46:0/3147554484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40094f0 con 0x7f27d0159ec0 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d651c700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009fa0 tx=0x7f27c0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000ed20 con 0x7f27d0159ec0 2023-10-07T09:03:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000ee80 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d0069320 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0014670 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.464+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d00698e0 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.465+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d00718b0 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.466+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f27c00149e0 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.466+0000 7f27cdffb700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 0x7f27bc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.466+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f27c00850e0 con 0x7f27d0159ec0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.466+0000 7f27d5d1b700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 0x7f27bc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.467+0000 7f27d5d1b700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 0x7f27bc069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f27d00ced20 tx=0x7f27c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.470+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27c0052030 con 0x7f27d0159ec0 2023-10-07T09:03:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:44.663+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27d0069d90 con 0x7f27d0159ec0 2023-10-07T09:03:45.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.316+0000 7f27cdffb700 1 -- 172.21.15.46:0/3147554484 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27d0069d90 con 0x7f27d0159ec0 2023-10-07T09:03:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 msgr2=0x7f27bc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 0x7f27bc069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f27d00ced20 tx=0x7f27c8008040 comp rx=0 tx=0).stop 2023-10-07T09:03:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 msgr2=0x7f27d01552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009fa0 tx=0x7f27c0009900 comp rx=0 tx=0).stop 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 shutdown_connections 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27bc067170 0x7f27bc069620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d0159ec0 0x7f27d01552f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00b53d0 0x7f27d0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 --2- 172.21.15.46:0/3147554484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27d00cce40 0x7f27d0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.319+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 >> 172.21.15.46:0/3147554484 conn(0x7f27d00999f0 msgr2=0x7f27d0152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.320+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 shutdown_connections 2023-10-07T09:03:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.320+0000 7f27d7f7f700 1 -- 172.21.15.46:0/3147554484 wait complete. 2023-10-07T09:03:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:03:45.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:03:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.458+0000 7fd893eb3700 1 Processor -- start 2023-10-07T09:03:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.458+0000 7fd893eb3700 1 -- start start 2023-10-07T09:03:45.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd893eb3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd88c159ec0 0x7fd88c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd893eb3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd88c0b53d0 0x7fd88c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd893eb3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c0b5b00 con 0x7fd88c0cce40 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd893eb3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0b5850 con 0x7fd88c0b53d0 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd893eb3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0b5da0 con 0x7fd88c159ec0 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd89144e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd88c0b53d0 0x7fd88c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd89144e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd88c0b53d0 0x7fd88c0cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43596/0 (socket says 172.21.15.46:43596) 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.459+0000 7fd89144e700 1 -- 172.21.15.46:0/351960234 learned_addr learned my addr 172.21.15.46:0/351960234 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd891c4f700 1 --2- 172.21.15.46:0/351960234 >> v2:172.21.15.133:3300/0 conn(0x7fd88c159ec0 0x7fd88c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd89144e700 1 -- 172.21.15.46:0/351960234 >> v2:172.21.15.133:3300/0 conn(0x7fd88c159ec0 msgr2=0x7fd88c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd89144e700 1 --2- 172.21.15.46:0/351960234 >> v2:172.21.15.133:3300/0 conn(0x7fd88c159ec0 0x7fd88c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd89144e700 1 -- 172.21.15.46:0/351960234 >> v1:172.21.15.133:6789/0 conn(0x7fd88c0cce40 legacy=0x7fd88c0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd89144e700 1 -- 172.21.15.46:0/351960234 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c0b6080 con 0x7fd88c0b53d0 2023-10-07T09:03:45.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd89144e700 1 --2- 172.21.15.46:0/351960234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c0cc900 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd88c089120 tx=0x7fd880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ef5ff0ff4b5e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd890c4d700 1 -- 172.21.15.46:0/351960234 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000b860 con 0x7fd88c0b53d0 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd890c4d700 1 -- 172.21.15.46:0/351960234 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000b9c0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd890c4d700 1 -- 172.21.15.46:0/351960234 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000bd60 con 0x7fd88c0b53d0 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd893eb3700 1 -- 172.21.15.46:0/351960234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 msgr2=0x7fd88c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.460+0000 7fd893eb3700 1 --2- 172.21.15.46:0/351960234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c0cc900 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd88c089120 tx=0x7fd880009250 comp rx=0 tx=0).stop 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 -- 172.21.15.46:0/351960234 shutdown_connections 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 --2- 172.21.15.46:0/351960234 >> v2:172.21.15.133:3300/0 conn(0x7fd88c159ec0 0x7fd88c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 --2- 172.21.15.46:0/351960234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c0cc900 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 -- 172.21.15.46:0/351960234 >> 172.21.15.46:0/351960234 conn(0x7fd88c0999f0 msgr2=0x7fd88c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 -- 172.21.15.46:0/351960234 shutdown_connections 2023-10-07T09:03:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.461+0000 7fd893eb3700 1 -- 172.21.15.46:0/351960234 wait complete. 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 Processor -- start 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 -- start start 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 0x7fd88c09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 0x7fd88c09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c144d60 con 0x7fd88c0b53d0 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c16afc0 con 0x7fd88c0cce40 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd893eb3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c16b210 con 0x7fd88c159ec0 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd891c4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.462+0000 7fd891c4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43608/0 (socket says 172.21.15.46:43608) 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 -- 172.21.15.46:0/3077204016 learned_addr learned my addr 172.21.15.46:0/3077204016 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd892450700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 0x7fd88c09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd89144e700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 0x7fd88c09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 -- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 msgr2=0x7fd88c09d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 0x7fd88c09d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 -- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 msgr2=0x7fd88c09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 0x7fd88c09d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 -- 172.21.15.46:0/3077204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800094f0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd89144e700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 0x7fd88c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd892450700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 0x7fd88c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd891c4f700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd884009fd0 tx=0x7fd884009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400edd0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884014420 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c16b4f0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8840147e0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.463+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c16bab0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.464+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd884014b90 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.464+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c063c90 con 0x7fd88c0b53d0 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.465+0000 7fd889ffb700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 0x7fd878069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.465+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fd884084fe0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.465+0000 7fd89144e700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 0x7fd878069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.466+0000 7fd89144e700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 0x7fd878069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd88c089120 tx=0x7fd880017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.469+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8840520e0 con 0x7fd88c0b53d0 2023-10-07T09:03:45.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:45.664+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd88c16c100 con 0x7fd88c0b53d0 2023-10-07T09:03:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.320+0000 7fd889ffb700 1 -- 172.21.15.46:0/3077204016 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd884055700 con 0x7fd88c0b53d0 2023-10-07T09:03:46.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.325+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 msgr2=0x7fd878069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.325+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 0x7fd878069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd88c089120 tx=0x7fd880017000 comp rx=0 tx=0).stop 2023-10-07T09:03:46.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.325+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 msgr2=0x7fd88c144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.325+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd884009fd0 tx=0x7fd884009970 comp rx=0 tx=0).stop 2023-10-07T09:03:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 shutdown_connections 2023-10-07T09:03:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd878067170 0x7fd878069620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd88c159ec0 0x7fd88c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88c0b53d0 0x7fd88c144820 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 --2- 172.21.15.46:0/3077204016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd88c0cce40 0x7fd88c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 >> 172.21.15.46:0/3077204016 conn(0x7fd88c0999f0 msgr2=0x7fd88c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 shutdown_connections 2023-10-07T09:03:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.326+0000 7fd893eb3700 1 -- 172.21.15.46:0/3077204016 wait complete. 2023-10-07T09:03:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:03:46.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:03:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.467+0000 7f00ff2cc700 1 Processor -- start 2023-10-07T09:03:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.467+0000 7f00ff2cc700 1 -- start start 2023-10-07T09:03:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00ff2cc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00f80b4e70 0x7f00f80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00ff2cc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80cfb00 con 0x7f00f80b16d0 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00ff2cc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f815e060 con 0x7f00f80b1b40 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00ff2cc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80b5c40 con 0x7f00f80b4e70 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00fe2ca700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00f80b4e70 0x7f00f80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00fdac9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f00f80b16d0 0x7f00f815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53768/0 (socket says 172.21.15.46:53768) 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00fe2ca700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00f80b4e70 0x7f00f80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43610/0 (socket says 172.21.15.46:43610) 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.468+0000 7f00fdac9700 1 -- 172.21.15.46:0/531262649 learned_addr learned my addr 172.21.15.46:0/531262649 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fe2ca700 1 -- 172.21.15.46:0/531262649 >> v1:172.21.15.133:6789/0 conn(0x7f00f80b1b40 legacy=0x7f00f815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fe2ca700 1 -- 172.21.15.46:0/531262649 >> v1:172.21.15.46:6789/0 conn(0x7f00f80b16d0 legacy=0x7f00f815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fd2c8700 1 -- 172.21.15.46:0/531262649 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036889280 0 0) 0x7f00f80cfb00 con 0x7f00f80b16d0 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fe2ca700 1 -- 172.21.15.46:0/531262649 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80b5f20 con 0x7f00f80b4e70 2023-10-07T09:03:46.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fe2ca700 1 --2- 172.21.15.46:0/531262649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b4e70 0x7f00f80ccff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f00f00098e0 tx=0x7f00f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cb40e2e2f751dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fd2c8700 1 -- 172.21.15.46:0/531262649 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0009e80 con 0x7f00f80b4e70 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fd2c8700 1 -- 172.21.15.46:0/531262649 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000b860 con 0x7f00f80b4e70 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00fd2c8700 1 -- 172.21.15.46:0/531262649 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000bbe0 con 0x7f00f80b4e70 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 -- 172.21.15.46:0/531262649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b4e70 msgr2=0x7f00f80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/531262649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b4e70 0x7f00f80ccff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f00f00098e0 tx=0x7f00f00091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 -- 172.21.15.46:0/531262649 shutdown_connections 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/531262649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b4e70 0x7f00f80ccff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 -- 172.21.15.46:0/531262649 >> 172.21.15.46:0/531262649 conn(0x7f00f80d10c0 msgr2=0x7f00f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.469+0000 7f00ff2cc700 1 -- 172.21.15.46:0/531262649 shutdown_connections 2023-10-07T09:03:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.470+0000 7f00ff2cc700 1 -- 172.21.15.46:0/531262649 wait complete. 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 Processor -- start 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 -- start start 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 0x7f00f80c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 0x7f00f816a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f816ad70 con 0x7f00f80b1b40 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80ca440 con 0x7f00f80b16d0 2023-10-07T09:03:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00ff2cc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80c9830 con 0x7f00f80b4e70 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00fdac9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00fdac9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43618/0 (socket says 172.21.15.46:43618) 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.471+0000 7f00fdac9700 1 -- 172.21.15.46:0/3264880704 learned_addr learned my addr 172.21.15.46:0/3264880704 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fe2ca700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 0x7f00f80c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00feacb700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 0x7f00f816a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 -- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 msgr2=0x7f00f816a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 0x7f00f816a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 -- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 msgr2=0x7f00f80c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 0x7f00f80c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 -- 172.21.15.46:0/3264880704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0009420 con 0x7f00f80b1b40 2023-10-07T09:03:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00feacb700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 0x7f00f816a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fe2ca700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 0x7f00f80c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00fdac9700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c810 tx=0x7f00ec007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec005c00 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec005d60 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80c9b10 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec007340 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.472+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80ca0d0 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.473+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f80ca5f0 con 0x7f00f80b1b40 2023-10-07T09:03:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.474+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f00ec01b400 con 0x7f00f80b1b40 2023-10-07T09:03:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.474+0000 7f00f67fc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 0x7f00e4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.474+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f00ec084040 con 0x7f00f80b1b40 2023-10-07T09:03:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.474+0000 7f00fe2ca700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 0x7f00e4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.475+0000 7f00fe2ca700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 0x7f00e4069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f00f00093f0 tx=0x7f00f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.478+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00f80ca5f0 con 0x7f00f80b1b40 2023-10-07T09:03:46.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.673+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f00f80ca5b0 con 0x7f00f80b1b40 2023-10-07T09:03:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.676+0000 7f00f67fc700 1 -- 172.21.15.46:0/3264880704 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00ec0513a0 con 0x7f00f80b1b40 2023-10-07T09:03:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 msgr2=0x7f00e4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 0x7f00e4069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f00f00093f0 tx=0x7f00f0017000 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 msgr2=0x7f00f8157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c810 tx=0x7f00ec007d90 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 shutdown_connections 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f00e4067170 0x7f00e4069620 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00f80b4e70 0x7f00f816a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00f80b16d0 0x7f00f80c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 --2- 172.21.15.46:0/3264880704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80b1b40 0x7f00f8157d30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 >> 172.21.15.46:0/3264880704 conn(0x7f00f80d10c0 msgr2=0x7f00f8158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 shutdown_connections 2023-10-07T09:03:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.678+0000 7f00ff2cc700 1 -- 172.21.15.46:0/3264880704 wait complete. 2023-10-07T09:03:46.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-07T09:03:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.808+0000 7fdabb729700 1 Processor -- start 2023-10-07T09:03:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 -- start start 2023-10-07T09:03:46.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdab415db10 0x7fdab4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab415a160 con 0x7fdab4159890 2023-10-07T09:03:46.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40d13a0 con 0x7fdab415db10 2023-10-07T09:03:46.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.809+0000 7fdabb729700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab415e140 con 0x7fdab4159c60 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab9cc6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdab415db10 0x7fdab4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49220/0 (socket says 172.21.15.46:49220) 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 -- 172.21.15.46:0/2644311771 learned_addr learned my addr 172.21.15.46:0/2644311771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 -- 172.21.15.46:0/2644311771 >> v2:172.21.15.133:3300/0 conn(0x7fdab415db10 msgr2=0x7fdab4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 --2- 172.21.15.46:0/2644311771 >> v2:172.21.15.133:3300/0 conn(0x7fdab415db10 0x7fdab4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 -- 172.21.15.46:0/2644311771 >> v1:172.21.15.133:6789/0 conn(0x7fdab4159890 legacy=0x7fdab415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 -- 172.21.15.46:0/2644311771 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab415a3d0 con 0x7fdab4159c60 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.810+0000 7fdab8cc4700 1 --2- 172.21.15.46:0/2644311771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099b0 tx=0x7fdaa8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721bd9a13c6c4a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdab3fff700 1 -- 172.21.15.46:0/2644311771 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009ea0 con 0x7fdab4159c60 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdab3fff700 1 -- 172.21.15.46:0/2644311771 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800b860 con 0x7fdab4159c60 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdab3fff700 1 -- 172.21.15.46:0/2644311771 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800bc00 con 0x7fdab4159c60 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 -- 172.21.15.46:0/2644311771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 msgr2=0x7fdab415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 --2- 172.21.15.46:0/2644311771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099b0 tx=0x7fdaa8009250 comp rx=0 tx=0).stop 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 -- 172.21.15.46:0/2644311771 shutdown_connections 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 --2- 172.21.15.46:0/2644311771 >> v2:172.21.15.133:3300/0 conn(0x7fdab415db10 0x7fdab4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 --2- 172.21.15.46:0/2644311771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159c60 0x7fdab415d5d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 -- 172.21.15.46:0/2644311771 >> 172.21.15.46:0/2644311771 conn(0x7fdab4068e20 msgr2=0x7fdab40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:46.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 -- 172.21.15.46:0/2644311771 shutdown_connections 2023-10-07T09:03:46.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.811+0000 7fdabb729700 1 -- 172.21.15.46:0/2644311771 wait complete. 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.812+0000 7fdabb729700 1 Processor -- start 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.812+0000 7fdabb729700 1 -- start start 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159890 0x7fdab4138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab415db10 0x7fdab415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab414f1a0 con 0x7fdab4159c60 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab416dec0 con 0x7fdab415db10 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdabb729700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab416e1a0 con 0x7fdab4159890 2023-10-07T09:03:46.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdab8cc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdab8cc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43624/0 (socket says 172.21.15.46:43624) 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdab8cc4700 1 -- 172.21.15.46:0/952962963 learned_addr learned my addr 172.21.15.46:0/952962963 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdab9cc6700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab415db10 0x7fdab415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.813+0000 7fdab94c5700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159890 0x7fdab4138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 -- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159890 msgr2=0x7fdab4138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159890 0x7fdab4138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 -- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab415db10 msgr2=0x7fdab415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab415db10 0x7fdab415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 -- 172.21.15.46:0/952962963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80094f0 con 0x7fdab4159c60 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab8cc4700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdab4070e20 tx=0x7fdaa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8000d10 con 0x7fdab4159c60 2023-10-07T09:03:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800bbe0 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab414ee30 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8011650 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.814+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab414ea70 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.815+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab414f310 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.815+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdaa8011a80 con 0x7fdab4159c60 2023-10-07T09:03:46.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.816+0000 7fdab17fa700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 0x7fdaa0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:46.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.816+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdaa8085dd0 con 0x7fdab4159c60 2023-10-07T09:03:46.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.816+0000 7fdab94c5700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 0x7fdaa0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:46.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.816+0000 7fdab94c5700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 0x7fdaa0069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4007fd0 tx=0x7fdaa40016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:46.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:46.820+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaa80530b0 con 0x7fdab4159c60 2023-10-07T09:03:47.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.096+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7fdab404c3c0 con 0x7fdab4159c60 2023-10-07T09:03:47.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.322+0000 7fdab17fa700 1 -- 172.21.15.46:0/952962963 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v240) v1 ==== 158+0+0 (secure 0 0 0) 0x7fdaa80566d0 con 0x7fdab4159c60 2023-10-07T09:03:47.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 msgr2=0x7fdaa0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 0x7fdaa0069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4007fd0 tx=0x7fdaa40016f0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 msgr2=0x7fdab416d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdab4070e20 tx=0x7fdaa8017000 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 shutdown_connections 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaa0067170 0x7fdaa0069620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab415db10 0x7fdab415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdab4159890 0x7fdab4138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 --2- 172.21.15.46:0/952962963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdab4159c60 0x7fdab416d440 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 >> 172.21.15.46:0/952962963 conn(0x7fdab4068e20 msgr2=0x7fdab415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 shutdown_connections 2023-10-07T09:03:47.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.324+0000 7fdabb729700 1 -- 172.21.15.46:0/952962963 wait complete. 2023-10-07T09:03:47.337 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-07T09:03:47.337 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-07T09:03:47.338 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:03:47.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-07T09:03:47.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.457+0000 7f4740e1a700 1 Processor -- start 2023-10-07T09:03:47.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.457+0000 7f4740e1a700 1 -- start start 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4740e1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 0x7f473c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4740e1a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f473c069560 0x7f473c0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4740e1a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c15a160 con 0x7f473c159c60 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4740e1a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c069f20 con 0x7f473c069560 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4740e1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0d13a0 con 0x7f473c159890 2023-10-07T09:03:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4739d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f473c159c60 0x7f473c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53770/0 (socket says 172.21.15.46:53770) 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f4739d9b700 1 -- 172.21.15.46:0/4069203785 learned_addr learned my addr 172.21.15.46:0/4069203785 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f473c069560 0x7f473c0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473a59c700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 0x7f473c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473959a700 1 -- 172.21.15.46:0/4069203785 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564285982 0 0) 0x7f473c15a160 con 0x7f473c159c60 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473959a700 1 -- 172.21.15.46:0/4069203785 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4728003570 con 0x7f473c159c60 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473ad9d700 1 -- 172.21.15.46:0/4069203785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 msgr2=0x7f473c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473ad9d700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 0x7f473c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473ad9d700 1 -- 172.21.15.46:0/4069203785 >> v1:172.21.15.46:6789/0 conn(0x7f473c159c60 legacy=0x7f473c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473ad9d700 1 -- 172.21.15.46:0/4069203785 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c15e140 con 0x7f473c069560 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.458+0000 7f473a59c700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 0x7f473c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f473ad9d700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c069560 0x7f473c0699e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f47340098e0 tx=0x7f47340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4045e6afd941c5c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:47.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f473959a700 1 -- 172.21.15.46:0/4069203785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400b640 con 0x7f473c069560 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f473959a700 1 -- 172.21.15.46:0/4069203785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400b7a0 con 0x7f473c069560 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f473959a700 1 -- 172.21.15.46:0/4069203785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400bb40 con 0x7f473c069560 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 -- 172.21.15.46:0/4069203785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c069560 msgr2=0x7f473c0699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c069560 0x7f473c0699e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f47340098e0 tx=0x7f47340091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 -- 172.21.15.46:0/4069203785 shutdown_connections 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c069560 0x7f473c0699e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 --2- 172.21.15.46:0/4069203785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c159890 0x7f473c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 -- 172.21.15.46:0/4069203785 >> 172.21.15.46:0/4069203785 conn(0x7f473c068e20 msgr2=0x7f473c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 -- 172.21.15.46:0/4069203785 shutdown_connections 2023-10-07T09:03:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.459+0000 7f4740e1a700 1 -- 172.21.15.46:0/4069203785 wait complete. 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 Processor -- start 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 -- start start 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c069560 0x7f473c15d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 0x7f473c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0c9150 con 0x7f473c159890 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0cd640 con 0x7f473c159c60 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4740e1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c15dbf0 con 0x7f473c069560 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.461+0000 7f4739d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43640/0 (socket says 172.21.15.46:43640) 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 -- 172.21.15.46:0/2732075818 learned_addr learned my addr 172.21.15.46:0/2732075818 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f473a59c700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c069560 0x7f473c15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f473ad9d700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 0x7f473c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 -- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c069560 msgr2=0x7f473c15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c069560 0x7f473c15d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 -- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 msgr2=0x7f473c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 0x7f473c0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 -- 172.21.15.46:0/2732075818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009420 con 0x7f473c159890 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f473ad9d700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 0x7f473c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4739d9b700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f472400c7c0 tx=0x7f4724007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724005c00 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724005d60 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c0c8b00 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724007300 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.462+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c0b44d0 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.463+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0c92c0 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.464+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f472401b3b0 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.464+0000 7f47327fc700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 0x7f471c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.464+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4724083a70 con 0x7f473c159890 2023-10-07T09:03:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.464+0000 7f473a59c700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 0x7f471c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:47.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.465+0000 7f473a59c700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 0x7f471c069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f472c00d6e0 tx=0x7f472c007850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.468+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4724050d50 con 0x7f473c159890 2023-10-07T09:03:47.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:47.741+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f473c04c3c0 con 0x7f473c159890 2023-10-07T09:03:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.326+0000 7f47327fc700 1 -- 172.21.15.46:0/2732075818 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v241) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4724017020 con 0x7f473c159890 2023-10-07T09:03:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 msgr2=0x7f471c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 0x7f471c069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f472c00d6e0 tx=0x7f472c007850 comp rx=0 tx=0).stop 2023-10-07T09:03:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 msgr2=0x7f473c0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f472400c7c0 tx=0x7f4724007dd0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 shutdown_connections 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f471c067170 0x7f471c069620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473c159c60 0x7f473c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473c069560 0x7f473c15d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 --2- 172.21.15.46:0/2732075818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f473c159890 0x7f473c0cd100 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 >> 172.21.15.46:0/2732075818 conn(0x7f473c068e20 msgr2=0x7f473c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 shutdown_connections 2023-10-07T09:03:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.328+0000 7f4740e1a700 1 -- 172.21.15.46:0/2732075818 wait complete. 2023-10-07T09:03:48.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:03:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.466+0000 7fb56c9aa700 1 Processor -- start 2023-10-07T09:03:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.466+0000 7fb56c9aa700 1 -- start start 2023-10-07T09:03:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.467+0000 7fb56c9aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb56815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.467+0000 7fb56c9aa700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56815a160 con 0x7fb568159c60 2023-10-07T09:03:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.467+0000 7fb56c9aa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680d13a0 con 0x7fb568069560 2023-10-07T09:03:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.467+0000 7fb56c9aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56815e140 con 0x7fb568159890 2023-10-07T09:03:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb565d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb568159c60 0x7fb56815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53772/0 (socket says 172.21.15.46:53772) 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb565d9b700 1 -- 172.21.15.46:0/341551531 learned_addr learned my addr 172.21.15.46:0/341551531 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56659c700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb56815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477003242 0 0) 0x7fb56815a160 con 0x7fb568159c60 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb554003570 con 0x7fb568159c60 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485224296 0 0) 0x7fb554003570 con 0x7fb568159c60 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 msgr2=0x7fb56815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb56815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 >> v1:172.21.15.133:6789/0 conn(0x7fb568069560 legacy=0x7fb5680ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56815a3d0 con 0x7fb568159c60 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb550001470 con 0x7fb568159c60 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 >> v1:172.21.15.46:6789/0 conn(0x7fb568159c60 legacy=0x7fb56815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb554003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb554003fd0 0x7fb554004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb5540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56815e140 con 0x7fb554004d50 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55400bb40 con 0x7fb554003fd0 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55400bd00 con 0x7fb568159890 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb566d9d700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb5540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb56659c700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb554003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.468+0000 7fb565d9b700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb554003fd0 0x7fb554004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 -- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 msgr2=0x7fb554003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb568159890 0x7fb554003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 -- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb554003fd0 msgr2=0x7fb554004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb554003fd0 0x7fb554004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 -- 172.21.15.46:0/341551531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554003570 con 0x7fb554004d50 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb566d9d700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb5540051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb5600019a0 tx=0x7fb560007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe609948f677d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000c5d0 con 0x7fb554004d50 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000c750 con 0x7fb554004d50 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb56559a700 1 -- 172.21.15.46:0/341551531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000cb10 con 0x7fb554004d50 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb56c9aa700 1 -- 172.21.15.46:0/341551531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 msgr2=0x7fb5540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.469+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/341551531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb5540051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb5600019a0 tx=0x7fb560007d10 comp rx=0 tx=0).stop 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.470+0000 7fb566d9d700 1 -- 172.21.15.46:0/341551531 reap_dead start 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.470+0000 7fb56c9aa700 1 -- 172.21.15.46:0/341551531 shutdown_connections 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.470+0000 7fb56c9aa700 1 -- 172.21.15.46:0/341551531 >> 172.21.15.46:0/341551531 conn(0x7fb568068e20 msgr2=0x7fb5680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.470+0000 7fb56c9aa700 1 -- 172.21.15.46:0/341551531 shutdown_connections 2023-10-07T09:03:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.470+0000 7fb56c9aa700 1 -- 172.21.15.46:0/341551531 wait complete. 2023-10-07T09:03:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 Processor -- start 2023-10-07T09:03:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 -- start start 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 0x7fb5680b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 0x7fb5680cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680ce450 con 0x7fb554004d50 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56814fcf0 con 0x7fb5680cda90 2023-10-07T09:03:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.471+0000 7fb56c9aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5681502b0 con 0x7fb5680cfb90 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43658/0 (socket says 172.21.15.46:43658) 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 -- 172.21.15.46:0/3875333309 learned_addr learned my addr 172.21.15.46:0/3875333309 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb565d9b700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 0x7fb5680b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb566d9d700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 0x7fb5680cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 -- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 msgr2=0x7fb5680b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 0x7fb5680b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 -- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 msgr2=0x7fb5680cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 0x7fb5680cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 -- 172.21.15.46:0/3875333309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680b27a0 con 0x7fb554004d50 2023-10-07T09:03:48.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb565d9b700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 0x7fb5680b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb566d9d700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 0x7fb5680cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56659c700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb558011f30 tx=0x7fb55800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800e040 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800f040 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5680b2a80 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558015430 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.472+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56814f970 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.473+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56804c3c0 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.474+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb558015820 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.474+0000 7fb55e7fc700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 0x7fb548069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.474+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb5580852c0 con 0x7fb554004d50 2023-10-07T09:03:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.474+0000 7fb565d9b700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 0x7fb548069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.475+0000 7fb565d9b700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 0x7fb548069650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb550001d00 tx=0x7fb550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.478+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb558052490 con 0x7fb554004d50 2023-10-07T09:03:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.670+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb5680b0120 con 0x7fb554004d50 2023-10-07T09:03:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.674+0000 7fb55e7fc700 1 -- 172.21.15.46:0/3875333309 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb558055ab0 con 0x7fb554004d50 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 msgr2=0x7fb548069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 0x7fb548069650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb550001d00 tx=0x7fb550009040 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 msgr2=0x7fb56814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb558011f30 tx=0x7fb55800b040 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 shutdown_connections 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5480671a0 0x7fb548069650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5680cda90 0x7fb5680cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554004d50 0x7fb56814f430 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 --2- 172.21.15.46:0/3875333309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5680cfb90 0x7fb5680b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 >> 172.21.15.46:0/3875333309 conn(0x7fb568068e20 msgr2=0x7fb56815d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 shutdown_connections 2023-10-07T09:03:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.676+0000 7fb56c9aa700 1 -- 172.21.15.46:0/3875333309 wait complete. 2023-10-07T09:03:48.689 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:03:48.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:03:48.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:03:48.776 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:03:48.776 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:03:48.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.894+0000 7f7d629b2700 1 Processor -- start 2023-10-07T09:03:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.894+0000 7f7d629b2700 1 -- start start 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d629b2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d5c159c60 0x7f7d5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d629b2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d5c15db10 0x7f7d5c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d629b2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c15a160 con 0x7f7d5c159890 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d629b2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c15df50 con 0x7f7d5c15db10 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d629b2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0d13a0 con 0x7f7d5c159c60 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7d5c159890 0x7f7d5c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53786/0 (socket says 172.21.15.46:53786) 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5bfff700 1 -- 172.21.15.46:0/287503859 learned_addr learned my addr 172.21.15.46:0/287503859 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 --2- 172.21.15.46:0/287503859 >> v2:172.21.15.46:3300/0 conn(0x7f7d5c15db10 0x7f7d5c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5b7fe700 1 --2- 172.21.15.46:0/287503859 >> v2:172.21.15.133:3300/0 conn(0x7f7d5c159c60 0x7f7d5c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5affd700 1 -- 172.21.15.46:0/287503859 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008326700 0 0) 0x7f7d5c15a160 con 0x7f7d5c159890 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5affd700 1 -- 172.21.15.46:0/287503859 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d48003570 con 0x7f7d5c159890 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 -- 172.21.15.46:0/287503859 >> v2:172.21.15.133:3300/0 conn(0x7f7d5c159c60 msgr2=0x7f7d5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 --2- 172.21.15.46:0/287503859 >> v2:172.21.15.133:3300/0 conn(0x7f7d5c159c60 0x7f7d5c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 -- 172.21.15.46:0/287503859 >> v1:172.21.15.46:6789/0 conn(0x7f7d5c159890 legacy=0x7f7d5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 -- 172.21.15.46:0/287503859 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c15e140 con 0x7f7d5c15db10 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d60f4f700 1 --2- 172.21.15.46:0/287503859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c15db10 0x7f7d5c069560 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b67f0 tx=0x7f7d54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d949d292961b4538 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5affd700 1 -- 172.21.15.46:0/287503859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400e070 con 0x7f7d5c15db10 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5affd700 1 -- 172.21.15.46:0/287503859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5400bb60 con 0x7f7d5c15db10 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.895+0000 7f7d5affd700 1 -- 172.21.15.46:0/287503859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54012430 con 0x7f7d5c15db10 2023-10-07T09:03:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 -- 172.21.15.46:0/287503859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c15db10 msgr2=0x7f7d5c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 --2- 172.21.15.46:0/287503859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c15db10 0x7f7d5c069560 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b67f0 tx=0x7f7d54009780 comp rx=0 tx=0).stop 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 -- 172.21.15.46:0/287503859 shutdown_connections 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 --2- 172.21.15.46:0/287503859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c15db10 0x7f7d5c069560 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 --2- 172.21.15.46:0/287503859 >> v2:172.21.15.133:3300/0 conn(0x7f7d5c159c60 0x7f7d5c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 -- 172.21.15.46:0/287503859 >> 172.21.15.46:0/287503859 conn(0x7f7d5c068e20 msgr2=0x7f7d5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 -- 172.21.15.46:0/287503859 shutdown_connections 2023-10-07T09:03:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.896+0000 7f7d629b2700 1 -- 172.21.15.46:0/287503859 wait complete. 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.897+0000 7f7d629b2700 1 Processor -- start 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.897+0000 7f7d629b2700 1 -- start start 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d5c159c60 0x7f7d5c0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 0x7f7d5c16ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c16dbf0 con 0x7f7d5c159890 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0b3ad0 con 0x7f7d5c15db10 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d629b2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c15beb0 con 0x7f7d5c159c60 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43680/0 (socket says 172.21.15.46:43680) 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 -- 172.21.15.46:0/1672446831 learned_addr learned my addr 172.21.15.46:0/1672446831 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d60f4f700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 0x7f7d5c16ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5b7fe700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d5c159c60 0x7f7d5c0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 -- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d5c159c60 msgr2=0x7f7d5c0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d5c159c60 0x7f7d5c0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 -- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 msgr2=0x7f7d5c16ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 0x7f7d5c16ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d5bfff700 1 -- 172.21.15.46:0/1672446831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54009a20 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.898+0000 7f7d60f4f700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 0x7f7d5c16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d5bfff700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c7c0 tx=0x7f7d4c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c005b30 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c005c90 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c15c190 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c007340 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.899+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c15c750 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.900+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c04c3c0 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.900+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7d4c01b400 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.900+0000 7f7d53fff700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 0x7f7d3c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.901+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7d4c084130 con 0x7f7d5c159890 2023-10-07T09:03:48.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.901+0000 7f7d5b7fe700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 0x7f7d3c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:48.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.901+0000 7f7d5b7fe700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 0x7f7d3c069620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c16cc20 tx=0x7f7d44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:48.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:48.905+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d4c0513c0 con 0x7f7d5c159890 2023-10-07T09:03:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.141+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d5c06a5b0 con 0x7f7d5c159890 2023-10-07T09:03:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.141+0000 7f7d53fff700 1 -- 172.21.15.46:0/1672446831 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7d4c0549e0 con 0x7f7d5c159890 2023-10-07T09:03:49.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3722485535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3722485535},{"type":"v1","addr":"172.21.15.46:6835","nonce":3722485535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3059850392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3059850392},{"type":"v1","addr":"172.21.15.133:6836","nonce":3059850392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3677343440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3677343440},{"type":"v1","addr":"172.21.15.133:6837","nonce":3677343440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3393116891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3393116891},{"type":"v1","addr":"172.21.15.46:6834","nonce":3393116891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-10-07T09:03:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 msgr2=0x7f7d3c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 0x7f7d3c069620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c16cc20 tx=0x7f7d44008040 comp rx=0 tx=0).stop 2023-10-07T09:03:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 msgr2=0x7f7d5c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c7c0 tx=0x7f7d4c007e00 comp rx=0 tx=0).stop 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 shutdown_connections 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d3c067170 0x7f7d3c069620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d5c15db10 0x7f7d5c16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d5c159890 0x7f7d5c0b3590 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 --2- 172.21.15.46:0/1672446831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d5c159c60 0x7f7d5c0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 >> 172.21.15.46:0/1672446831 conn(0x7f7d5c068e20 msgr2=0x7f7d5c0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 shutdown_connections 2023-10-07T09:03:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.143+0000 7f7d629b2700 1 -- 172.21.15.46:0/1672446831 wait complete. 2023-10-07T09:03:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 42 2023-10-07T09:03:49.156 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:03:49.157 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:03:49.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:03:49.157 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:03:49.157 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:03:49.157 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:03:49.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:03:49.157 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:03:49.158 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:03:49.158 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:03:49.158 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:03:49.158 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:03:49.158 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:03:49.159 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:03:49.159 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:03:49.159 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:03:49.165 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:03:49.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:03:49.166 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:03:49.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:03:49.169 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:03:49.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:03:49.170 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:03:49.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:03:49.208 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:03:49.208 DEBUG:teuthology.parallel:result is None 2023-10-07T09:03:49.209 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:03:49.209 DEBUG:teuthology.parallel:result is None 2023-10-07T09:03:49.212 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:03:49.213 DEBUG:teuthology.parallel:result is None 2023-10-07T09:03:49.213 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:03:49.213 DEBUG:teuthology.parallel:result is None 2023-10-07T09:03:49.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:03:49.284 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:03:49.284 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:03:49.295 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:03:49.296 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:03:49.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.339+0000 7f2342653700 1 Processor -- start 2023-10-07T09:03:49.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 -- start start 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c159420 0x7f233c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c15d230 0x7f233c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0b2980 con 0x7f233c1597f0 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c15dbb0 con 0x7f233c159420 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2342653700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0b11d0 con 0x7f233c15d230 2023-10-07T09:03:49.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.340+0000 7f2341651700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c159420 0x7f233c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c159420 0x7f233c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43704/0 (socket says 172.21.15.46:43704) 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 -- 172.21.15.46:0/3575842000 learned_addr learned my addr 172.21.15.46:0/3575842000 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341e52700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c15d230 0x7f233c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 -- 172.21.15.46:0/3575842000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c15d230 msgr2=0x7f233c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c15d230 0x7f233c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 -- 172.21.15.46:0/3575842000 >> v1:172.21.15.133:6789/0 conn(0x7f233c1597f0 legacy=0x7f233c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 -- 172.21.15.46:0/3575842000 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0b14b0 con 0x7f233c159420 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2341651700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c0b5f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23380099b0 tx=0x7f2338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5e1f3bc9342bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2333fff700 1 -- 172.21.15.46:0/3575842000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338009ea0 con 0x7f233c159420 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2333fff700 1 -- 172.21.15.46:0/3575842000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800b860 con 0x7f233c159420 2023-10-07T09:03:49.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.341+0000 7f2333fff700 1 -- 172.21.15.46:0/3575842000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800bc00 con 0x7f233c159420 2023-10-07T09:03:49.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 -- 172.21.15.46:0/3575842000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 msgr2=0x7f233c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c0b5f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23380099b0 tx=0x7f2338009250 comp rx=0 tx=0).stop 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 -- 172.21.15.46:0/3575842000 shutdown_connections 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c15d230 0x7f233c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 --2- 172.21.15.46:0/3575842000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c0b5f40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 -- 172.21.15.46:0/3575842000 >> 172.21.15.46:0/3575842000 conn(0x7f233c0d0660 msgr2=0x7f233c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 -- 172.21.15.46:0/3575842000 shutdown_connections 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.342+0000 7f2342653700 1 -- 172.21.15.46:0/3575842000 wait complete. 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.344+0000 7f2342653700 1 Processor -- start 2023-10-07T09:03:49.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.344+0000 7f2342653700 1 -- start start 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.344+0000 7f2342653700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.344+0000 7f2342653700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c1597f0 0x7f233c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.344+0000 7f2342653700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 0x7f233c0cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2342653700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c6ba0 con 0x7f233c159420 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2342653700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c9ba0 con 0x7f233c15d230 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2342653700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c9870 con 0x7f233c1597f0 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43708/0 (socket says 172.21.15.46:43708) 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 -- 172.21.15.46:0/2940332811 learned_addr learned my addr 172.21.15.46:0/2940332811 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2340e50700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c1597f0 0x7f233c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341e52700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 0x7f233c0cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 -- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c1597f0 msgr2=0x7f233c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c1597f0 0x7f233c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 -- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 msgr2=0x7f233c0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 0x7f233c0cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 -- 172.21.15.46:0/2940332811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380094f0 con 0x7f233c159420 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341e52700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 0x7f233c0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2341651700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800bbe0 con 0x7f233c159420 2023-10-07T09:03:49.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338011420 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380117c0 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0c6300 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.345+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0c68c0 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.346+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c04c3c0 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.347+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2338011bf0 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.347+0000 7f23317fa700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 0x7f2320069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.347+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2338085eb0 con 0x7f233c159420 2023-10-07T09:03:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.347+0000 7f2340e50700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 0x7f2320069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.348+0000 7f2340e50700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 0x7f2320069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f233c1586f0 tx=0x7f232c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.353+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2338053190 con 0x7f233c159420 2023-10-07T09:03:49.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:49.561+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f233c0b1790 con 0x7f233c159420 2023-10-07T09:03:50.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.350+0000 7f23317fa700 1 -- 172.21.15.46:0/2940332811 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23380567b0 con 0x7f233c159420 2023-10-07T09:03:50.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 msgr2=0x7f2320069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 0x7f2320069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f233c1586f0 tx=0x7f232c009040 comp rx=0 tx=0).stop 2023-10-07T09:03:50.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 msgr2=0x7f233c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338017000 comp rx=0 tx=0).stop 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 shutdown_connections 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2320067170 0x7f2320069620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f233c15d230 0x7f233c0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c159420 0x7f233c1551e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 --2- 172.21.15.46:0/2940332811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f233c1597f0 0x7f233c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 >> 172.21.15.46:0/2940332811 conn(0x7f233c0d0660 msgr2=0x7f233c156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 shutdown_connections 2023-10-07T09:03:50.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.352+0000 7f2342653700 1 -- 172.21.15.46:0/2940332811 wait complete. 2023-10-07T09:03:50.355 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:03:50.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:03:50.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.488+0000 7f617184f700 1 Processor -- start 2023-10-07T09:03:50.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.488+0000 7f617184f700 1 -- start start 2023-10-07T09:03:50.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f616c1598c0 0x7f616c06b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 0x7f616c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c159c90 0x7f616c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c06a6a0 con 0x7f616c1598c0 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0ca490 con 0x7f616c0cc260 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f617184f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0cca40 con 0x7f616c159c90 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f616c1598c0 0x7f616c06b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f616c1598c0 0x7f616c06b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36008/0 (socket says 172.21.15.46:36008) 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 -- 172.21.15.46:0/1816799491 learned_addr learned my addr 172.21.15.46:0/1816799491 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616b7fe700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c159c90 0x7f616c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616a7fc700 1 --2- 172.21.15.46:0/1816799491 >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 0x7f616c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 -- 172.21.15.46:0/1816799491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c159c90 msgr2=0x7f616c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c159c90 0x7f616c06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 -- 172.21.15.46:0/1816799491 >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 msgr2=0x7f616c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 --2- 172.21.15.46:0/1816799491 >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 0x7f616c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616affd700 1 -- 172.21.15.46:0/1816799491 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0cc760 con 0x7f616c1598c0 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.489+0000 7f616a7fc700 1 --2- 172.21.15.46:0/1816799491 >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 0x7f616c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f616affd700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c1598c0 0x7f616c06b070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f616c06c880 tx=0x7f615c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3033af8661c3451f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f6169ffb700 1 -- 172.21.15.46:0/1816799491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c005c10 con 0x7f616c1598c0 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f6169ffb700 1 -- 172.21.15.46:0/1816799491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c005d70 con 0x7f616c1598c0 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f6169ffb700 1 -- 172.21.15.46:0/1816799491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00b880 con 0x7f616c1598c0 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 -- 172.21.15.46:0/1816799491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c1598c0 msgr2=0x7f616c06b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c1598c0 0x7f616c06b070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f616c06c880 tx=0x7f615c009220 comp rx=0 tx=0).stop 2023-10-07T09:03:50.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 -- 172.21.15.46:0/1816799491 shutdown_connections 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c159c90 0x7f616c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 --2- 172.21.15.46:0/1816799491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c1598c0 0x7f616c06b070 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 --2- 172.21.15.46:0/1816799491 >> v2:172.21.15.133:3300/0 conn(0x7f616c0cc260 0x7f616c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 -- 172.21.15.46:0/1816799491 >> 172.21.15.46:0/1816799491 conn(0x7f616c06baa0 msgr2=0x7f616c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 -- 172.21.15.46:0/1816799491 shutdown_connections 2023-10-07T09:03:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.490+0000 7f617184f700 1 -- 172.21.15.46:0/1816799491 wait complete. 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 Processor -- start 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 -- start start 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c0cc260 0x7f616c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c1598c0 0x7f616c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15a460 con 0x7f616c159c90 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0c68c0 con 0x7f616c0cc260 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.492+0000 7f617184f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0c6ba0 con 0x7f616c1598c0 2023-10-07T09:03:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36020/0 (socket says 172.21.15.46:36020) 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 -- 172.21.15.46:0/2683531486 learned_addr learned my addr 172.21.15.46:0/2683531486 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616a7fc700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c1598c0 0x7f616c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616affd700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c0cc260 0x7f616c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 -- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c1598c0 msgr2=0x7f616c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c1598c0 0x7f616c0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 -- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c0cc260 msgr2=0x7f616c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c0cc260 0x7f616c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 -- 172.21.15.46:0/2683531486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009480 con 0x7f616c159c90 2023-10-07T09:03:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f616b7fe700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6164007ef0 tx=0x7f6164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400eb30 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616400ec90 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c0c6e80 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164014670 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.493+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c0c65d0 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.494+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c0cbe80 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.495+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6164014a60 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.495+0000 7f6162ffd700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 0x7f614c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.495+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6164084a90 con 0x7f616c159c90 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.495+0000 7f616affd700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 0x7f614c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.496+0000 7f616affd700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 0x7f614c069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f615c007fd0 tx=0x7f615c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.500+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6164051dc0 con 0x7f616c159c90 2023-10-07T09:03:50.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.773+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f616c04c3c0 con 0x7f616c159c90 2023-10-07T09:03:50.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.773+0000 7f6162ffd700 1 -- 172.21.15.46:0/2683531486 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f61640553e0 con 0x7f616c159c90 2023-10-07T09:03:50.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:50.774 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:03:50.774 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:03:50.775 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:03:50.776 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:03:50.778 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.779 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.781 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.783 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.784 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:03:50.785 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:03:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:03:50.788 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:03:50.789 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.790 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:50.790 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:03:50.790 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:03:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 msgr2=0x7f614c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 0x7f614c069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f615c007fd0 tx=0x7f615c016000 comp rx=0 tx=0).stop 2023-10-07T09:03:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 msgr2=0x7f616c0c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6164007ef0 tx=0x7f6164009840 comp rx=0 tx=0).stop 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 shutdown_connections 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f614c067170 0x7f614c069620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f616c159c90 0x7f616c0c80c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c0cc260 0x7f616c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 --2- 172.21.15.46:0/2683531486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c1598c0 0x7f616c0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 >> 172.21.15.46:0/2683531486 conn(0x7f616c06baa0 msgr2=0x7f616c0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 shutdown_connections 2023-10-07T09:03:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.775+0000 7f617184f700 1 -- 172.21.15.46:0/2683531486 wait complete. 2023-10-07T09:03:50.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.910+0000 7fbb3e8c6700 1 Processor -- start 2023-10-07T09:03:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.910+0000 7fbb3e8c6700 1 -- start start 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3e8c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb38159c60 0x7fbb3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3e8c6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3815a160 con 0x7fbb3815db10 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3e8c6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb380d13a0 con 0x7fbb38159890 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3e8c6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3815df50 con 0x7fbb38159c60 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3ce63700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbb3815db10 0x7fbb38069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41562/0 (socket says 172.21.15.46:41562) 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb3ce63700 1 -- 172.21.15.46:0/3260681633 learned_addr learned my addr 172.21.15.46:0/3260681633 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.911+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3260681633 >> v2:172.21.15.133:3300/0 conn(0x7fbb38159c60 0x7fbb3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250795121 0 0) 0x7fbb3815a160 con 0x7fbb3815db10 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb20003570 con 0x7fbb3815db10 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025609308 0 0) 0x7fbb380d13a0 con 0x7fbb38159890 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3815a160 con 0x7fbb38159890 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444114615 0 0) 0x7fbb20003570 con 0x7fbb3815db10 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 >> v2:172.21.15.133:3300/0 conn(0x7fbb38159c60 msgr2=0x7fbb3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 --2- 172.21.15.46:0/3260681633 >> v2:172.21.15.133:3300/0 conn(0x7fbb38159c60 0x7fbb3815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 >> v1:172.21.15.133:6789/0 conn(0x7fbb38159890 legacy=0x7fbb3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3815e140 con 0x7fbb3815db10 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fbb300017f0 con 0x7fbb3815db10 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 >> v1:172.21.15.46:6789/0 conn(0x7fbb3815db10 legacy=0x7fbb38069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb20003bf0 0x7fbb20003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 0x7fbb20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200051c0 0x7fbb2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2000c080 con 0x7fbb20004810 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2000c1f0 con 0x7fbb200051c0 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2000c3b0 con 0x7fbb20003bf0 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 0x7fbb20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb37fff700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb20003bf0 0x7fbb20003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb3ce63700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200051c0 0x7fbb2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 -- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb20003bf0 msgr2=0x7fbb20003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb20003bf0 0x7fbb20003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 -- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200051c0 msgr2=0x7fbb2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200051c0 0x7fbb2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb3ce63700 1 -- 172.21.15.46:0/3260681633 reap_dead start 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 -- 172.21.15.46:0/3260681633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20003570 con 0x7fbb20004810 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.912+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 0x7fbb20004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009c00 tx=0x7fbb2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb4438988ac9d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00e710 con 0x7fbb20004810 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00e870 con 0x7fbb20004810 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb36ffd700 1 -- 172.21.15.46:0/3260681633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00ec30 con 0x7fbb20004810 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 msgr2=0x7fbb20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 0x7fbb20004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009c00 tx=0x7fbb2c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3260681633 shutdown_connections 2023-10-07T09:03:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3260681633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb20004810 0x7fbb20004c80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3260681633 >> 172.21.15.46:0/3260681633 conn(0x7fbb38068e20 msgr2=0x7fbb380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3260681633 shutdown_connections 2023-10-07T09:03:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.913+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3260681633 wait complete. 2023-10-07T09:03:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.914+0000 7fbb3e8c6700 1 Processor -- start 2023-10-07T09:03:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.914+0000 7fbb3e8c6700 1 -- start start 2023-10-07T09:03:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb20004810 0x7fbb38149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb380b49b0 0x7fbb380b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b2810 con 0x7fbb380b1e60 2023-10-07T09:03:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b4290 con 0x7fbb20004810 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3e8c6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b36c0 con 0x7fbb380b49b0 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36046/0 (socket says 172.21.15.46:36046) 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 -- 172.21.15.46:0/3316385325 learned_addr learned my addr 172.21.15.46:0/3316385325 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb3ce63700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb380b49b0 0x7fbb380b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb37fff700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb20004810 0x7fbb38149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 -- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb380b49b0 msgr2=0x7fbb380b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb380b49b0 0x7fbb380b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 -- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb20004810 msgr2=0x7fbb38149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.915+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb20004810 0x7fbb38149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb377fe700 1 -- 172.21.15.46:0/3316385325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380b3960 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb377fe700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c1c0 tx=0x7fbb2c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c022070 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00e9e0 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c01c450 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380b3c40 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.916+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3814a160 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.917+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb380b2810 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.917+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fbb2c01c840 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.917+0000 7fbb1ffff700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 0x7fbb24069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.918+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbb2c085d00 con 0x7fbb380b1e60 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.918+0000 7fbb37fff700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 0x7fbb24069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:50.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.918+0000 7fbb37fff700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 0x7fbb24069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb28000f60 tx=0x7fbb28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:50.922+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb2c052f70 con 0x7fbb380b1e60 2023-10-07T09:03:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.114+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb380b4400 con 0x7fbb380b1e60 2023-10-07T09:03:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.115+0000 7fbb1ffff700 1 -- 172.21.15.46:0/3316385325 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12135 (secure 0 0 0) 0x7fbb2c017090 con 0x7fbb380b1e60 2023-10-07T09:03:51.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:51.116 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":74,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:50.347983+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:51.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 msgr2=0x7fbb24069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 0x7fbb24069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb28000f60 tx=0x7fbb28009040 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 msgr2=0x7fbb380b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c1c0 tx=0x7fbb2c01a000 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 shutdown_connections 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb24067170 0x7fbb24069620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb380b49b0 0x7fbb380b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb20004810 0x7fbb38149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 --2- 172.21.15.46:0/3316385325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb380b1e60 0x7fbb380b22d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.117+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 >> 172.21.15.46:0/3316385325 conn(0x7fbb38068e20 msgr2=0x7fbb3815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.118+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 shutdown_connections 2023-10-07T09:03:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.118+0000 7fbb3e8c6700 1 -- 172.21.15.46:0/3316385325 wait complete. 2023-10-07T09:03:51.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:03:51.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:03:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.251+0000 7f774765e700 1 Processor -- start 2023-10-07T09:03:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.252+0000 7f774765e700 1 -- start start 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.252+0000 7f774765e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f774006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.252+0000 7f774765e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774006bdb0 con 0x7f7740069d60 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.252+0000 7f774765e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400cb370 con 0x7f77400c83c0 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.252+0000 7f774765e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7740159f60 con 0x7f77400aca80 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f7744bf9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7740069d60 0x7f77400c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41578/0 (socket says 172.21.15.46:41578) 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f7744bf9700 1 -- 172.21.15.46:0/598536068 learned_addr learned my addr 172.21.15.46:0/598536068 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f77453fa700 1 --2- 172.21.15.46:0/598536068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f774006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797626826 0 0) 0x7f774006bdb0 con 0x7f7740069d60 2023-10-07T09:03:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7728003570 con 0x7f7740069d60 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224813080 0 0) 0x7f77400cb370 con 0x7f77400c83c0 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f774006bdb0 con 0x7f77400c83c0 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f77453fa700 1 -- 172.21.15.46:0/598536068 >> v1:172.21.15.133:6789/0 conn(0x7f77400c83c0 legacy=0x7f77400cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f77453fa700 1 -- 172.21.15.46:0/598536068 >> v1:172.21.15.46:6789/0 conn(0x7f7740069d60 legacy=0x7f77400c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342054358 0 0) 0x7f7728003570 con 0x7f7740069d60 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f77453fa700 1 -- 172.21.15.46:0/598536068 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774006b510 con 0x7f77400aca80 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f77453fa700 1 --2- 172.21.15.46:0/598536068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f774006aba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ee0 tx=0x7f7730009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68cdb87f10e20575 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.253+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000e070 con 0x7f77400aca80 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000b870 con 0x7f77400aca80 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f773ffff700 1 -- 172.21.15.46:0/598536068 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734001470 con 0x7f77400aca80 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 -- 172.21.15.46:0/598536068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 msgr2=0x7f774006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 --2- 172.21.15.46:0/598536068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f774006aba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ee0 tx=0x7f7730009780 comp rx=0 tx=0).stop 2023-10-07T09:03:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 -- 172.21.15.46:0/598536068 shutdown_connections 2023-10-07T09:03:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 --2- 172.21.15.46:0/598536068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f774006aba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 -- 172.21.15.46:0/598536068 >> 172.21.15.46:0/598536068 conn(0x7f77400cd670 msgr2=0x7f77400cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 -- 172.21.15.46:0/598536068 shutdown_connections 2023-10-07T09:03:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.254+0000 7f774765e700 1 -- 172.21.15.46:0/598536068 wait complete. 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.255+0000 7f774765e700 1 Processor -- start 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.255+0000 7f774765e700 1 -- start start 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7740069d60 0x7f77400cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f77400ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400b25e0 con 0x7f77400c83c0 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400b3440 con 0x7f7740069d60 2023-10-07T09:03:51.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f774765e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7740158db0 con 0x7f77400aca80 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f7745bfb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f7745bfb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36060/0 (socket says 172.21.15.46:36060) 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f7745bfb700 1 -- 172.21.15.46:0/3711843255 learned_addr learned my addr 172.21.15.46:0/3711843255 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f7744bf9700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f77400ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.256+0000 7f77453fa700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7740069d60 0x7f77400cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 -- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 msgr2=0x7f77400ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f77400ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 -- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7740069d60 msgr2=0x7f77400cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7740069d60 0x7f77400cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 -- 172.21.15.46:0/3711843255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009a20 con 0x7f77400c83c0 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f7745bfb700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f773800c4d0 tx=0x7f7738007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738011590 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738011710 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77400b2830 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738011ad0 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.257+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77400b2df0 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.258+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774004c3c0 con 0x7f77400c83c0 2023-10-07T09:03:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.258+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7738012420 con 0x7f77400c83c0 2023-10-07T09:03:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.259+0000 7f773d7fa700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 0x7f772c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.259+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7738002030 con 0x7f77400c83c0 2023-10-07T09:03:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.259+0000 7f77453fa700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 0x7f772c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.259+0000 7f77453fa700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 0x7f772c069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f7730017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.263+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7738051330 con 0x7f77400c83c0 2023-10-07T09:03:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.453+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f774006b7f0 con 0x7f77400c83c0 2023-10-07T09:03:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.454+0000 7f773d7fa700 1 -- 172.21.15.46:0/3711843255 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7738054950 con 0x7f77400c83c0 2023-10-07T09:03:51.455 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:03:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.455+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 msgr2=0x7f772c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.455+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 0x7f772c069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f7730017000 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.455+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 msgr2=0x7f77400adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.455+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f773800c4d0 tx=0x7f7738007cf0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 shutdown_connections 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f772c067170 0x7f772c069620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77400c83c0 0x7f77400adee0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7740069d60 0x7f77400cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 --2- 172.21.15.46:0/3711843255 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77400aca80 0x7f77400ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 >> 172.21.15.46:0/3711843255 conn(0x7f77400cd670 msgr2=0x7f77400aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 shutdown_connections 2023-10-07T09:03:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.456+0000 7f774765e700 1 -- 172.21.15.46:0/3711843255 wait complete. 2023-10-07T09:03:51.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:03:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.586+0000 7fcebde96700 1 Processor -- start 2023-10-07T09:03:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.586+0000 7fcebde96700 1 -- start start 2023-10-07T09:03:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fcebde96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fcebde96700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fceb806a410 0x7fceb806a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fcebde96700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80c74b0 con 0x7fceb8159b10 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fcebde96700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb80c8700 con 0x7fceb806a410 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fcebde96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c9070 con 0x7fceb815d730 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fceb7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fceb806a410 0x7fceb806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fceb77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fceb8159b10 0x7fceb80cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41590/0 (socket says 172.21.15.46:41590) 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.587+0000 7fceb77fe700 1 -- 172.21.15.46:0/544418071 learned_addr learned my addr 172.21.15.46:0/544418071 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb6ffd700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb7fff700 1 -- 172.21.15.46:0/544418071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 msgr2=0x7fceb815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb7fff700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb7fff700 1 -- 172.21.15.46:0/544418071 >> v1:172.21.15.46:6789/0 conn(0x7fceb8159b10 legacy=0x7fceb80cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb7fff700 1 -- 172.21.15.46:0/544418071 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb815e0e0 con 0x7fceb806a410 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb67fc700 1 -- 172.21.15.46:0/544418071 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917653464 0 0) 0x7fceb80c74b0 con 0x7fceb8159b10 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb6ffd700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb7fff700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb806a410 0x7fceb806a890 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc503e477f136585 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb67fc700 1 -- 172.21.15.46:0/544418071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000e070 con 0x7fceb806a410 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb67fc700 1 -- 172.21.15.46:0/544418071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000bcc0 con 0x7fceb806a410 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.588+0000 7fceb67fc700 1 -- 172.21.15.46:0/544418071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0012680 con 0x7fceb806a410 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 -- 172.21.15.46:0/544418071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb806a410 msgr2=0x7fceb806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb806a410 0x7fceb806a890 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0009780 comp rx=0 tx=0).stop 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 -- 172.21.15.46:0/544418071 shutdown_connections 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb806a410 0x7fceb806a890 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 --2- 172.21.15.46:0/544418071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 -- 172.21.15.46:0/544418071 >> 172.21.15.46:0/544418071 conn(0x7fceb80c9870 msgr2=0x7fceb80c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 -- 172.21.15.46:0/544418071 shutdown_connections 2023-10-07T09:03:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.589+0000 7fcebde96700 1 -- 172.21.15.46:0/544418071 wait complete. 2023-10-07T09:03:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.590+0000 7fcebde96700 1 Processor -- start 2023-10-07T09:03:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.590+0000 7fcebde96700 1 -- start start 2023-10-07T09:03:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 0x7fceb814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb816dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb816ec50 con 0x7fceb8159b10 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb816ac30 con 0x7fceb806a410 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb814e110 con 0x7fceb815d730 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36082/0 (socket says 172.21.15.46:36082) 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 -- 172.21.15.46:0/887171763 learned_addr learned my addr 172.21.15.46:0/887171763 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb77fe700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 0x7fceb814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb7fff700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb816dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 -- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 msgr2=0x7fceb816dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb816dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 -- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 msgr2=0x7fceb814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 0x7fceb814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 -- 172.21.15.46:0/887171763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009a20 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb77fe700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 0x7fceb814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb7fff700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb816dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fceb6ffd700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c880 tx=0x7fceac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011600 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011760 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb816e690 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.591+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011b00 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.592+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb816a8c0 con 0x7fceb8159b10 2023-10-07T09:03:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.592+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb816a720 con 0x7fceb8159b10 2023-10-07T09:03:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.593+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fceac018350 con 0x7fceb8159b10 2023-10-07T09:03:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.593+0000 7fce9f7fe700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 0x7fcea4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.593+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fceac084590 con 0x7fceb8159b10 2023-10-07T09:03:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.594+0000 7fceb77fe700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 0x7fcea4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.594+0000 7fceb77fe700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 0x7fcea4069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcea80018d0 tx=0x7fcea8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.598+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fceb816a720 con 0x7fceb8159b10 2023-10-07T09:03:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.794+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fceb816a720 con 0x7fceb8159b10 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.794+0000 7fce9f7fe700 1 -- 172.21.15.46:0/887171763 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+65 (secure 0 0 0) 0x7fceb816a720 con 0x7fceb8159b10 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:03:51.795 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:03:51.796 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:03:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 msgr2=0x7fcea4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 0x7fcea4069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcea80018d0 tx=0x7fcea8009040 comp rx=0 tx=0).stop 2023-10-07T09:03:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 msgr2=0x7fceb816b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c880 tx=0x7fceac008040 comp rx=0 tx=0).stop 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 shutdown_connections 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcea4067170 0x7fcea4069620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fceb815d730 0x7fceb816dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb806a410 0x7fceb814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 --2- 172.21.15.46:0/887171763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fceb8159b10 0x7fceb816b0c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 >> 172.21.15.46:0/887171763 conn(0x7fceb80c9870 msgr2=0x7fceb814ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 shutdown_connections 2023-10-07T09:03:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.796+0000 7fcebde96700 1 -- 172.21.15.46:0/887171763 wait complete. 2023-10-07T09:03:51.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:03:51.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:03:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.930+0000 7fc6372fd700 1 Processor -- start 2023-10-07T09:03:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 -- start start 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 0x7fc6300b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6300b40f0 0x7fc6300ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 0x7fc63006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300b4560 con 0x7fc6300b40f0 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63015c320 con 0x7fc6300ceb60 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc6372fd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300cef90 con 0x7fc630155360 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.931+0000 7fc634898700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6300b40f0 0x7fc6300ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6300b40f0 0x7fc6300ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36092/0 (socket says 172.21.15.46:36092) 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 -- 172.21.15.46:0/2785817302 learned_addr learned my addr 172.21.15.46:0/2785817302 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc635099700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 0x7fc6300b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc63589a700 1 --2- 172.21.15.46:0/2785817302 >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 0x7fc63006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 -- 172.21.15.46:0/2785817302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 msgr2=0x7fc6300b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 0x7fc6300b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 -- 172.21.15.46:0/2785817302 >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 msgr2=0x7fc63006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 --2- 172.21.15.46:0/2785817302 >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 0x7fc63006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 -- 172.21.15.46:0/2785817302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63015b710 con 0x7fc6300b40f0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc635099700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 0x7fc6300b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc63589a700 1 --2- 172.21.15.46:0/2785817302 >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 0x7fc63006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc634898700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6300b40f0 0x7fc6300ce620 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc630070f60 tx=0x7fc624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae4242784751457 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc62ffff700 1 -- 172.21.15.46:0/2785817302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400b860 con 0x7fc6300b40f0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc62ffff700 1 -- 172.21.15.46:0/2785817302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62400b9c0 con 0x7fc6300b40f0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.932+0000 7fc62ffff700 1 -- 172.21.15.46:0/2785817302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400bd60 con 0x7fc6300b40f0 2023-10-07T09:03:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 -- 172.21.15.46:0/2785817302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6300b40f0 msgr2=0x7fc6300ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6300b40f0 0x7fc6300ce620 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc630070f60 tx=0x7fc624009250 comp rx=0 tx=0).stop 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 -- 172.21.15.46:0/2785817302 shutdown_connections 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 --2- 172.21.15.46:0/2785817302 >> v2:172.21.15.133:3300/0 conn(0x7fc6300ceb60 0x7fc63006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc630155360 0x7fc6300b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 --2- 172.21.15.46:0/2785817302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6300b40f0 0x7fc6300ce620 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 -- 172.21.15.46:0/2785817302 >> 172.21.15.46:0/2785817302 conn(0x7fc63006baf0 msgr2=0x7fc63006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 -- 172.21.15.46:0/2785817302 shutdown_connections 2023-10-07T09:03:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.933+0000 7fc6372fd700 1 -- 172.21.15.46:0/2785817302 wait complete. 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.934+0000 7fc6372fd700 1 Processor -- start 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.934+0000 7fc6372fd700 1 -- start start 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6300b40f0 0x7fc630141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6300ceb60 0x7fc6300c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c5af0 con 0x7fc630155360 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630153c20 con 0x7fc6300b40f0 2023-10-07T09:03:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc6372fd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c4ee0 con 0x7fc6300ceb60 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36106/0 (socket says 172.21.15.46:36106) 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 -- 172.21.15.46:0/4266930435 learned_addr learned my addr 172.21.15.46:0/4266930435 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc634898700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6300ceb60 0x7fc6300c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc635099700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6300b40f0 0x7fc630141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 -- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6300ceb60 msgr2=0x7fc6300c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6300ceb60 0x7fc6300c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 -- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6300b40f0 msgr2=0x7fc630141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6300b40f0 0x7fc630141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 -- 172.21.15.46:0/4266930435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240094f0 con 0x7fc630155360 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.935+0000 7fc63589a700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e870 tx=0x7fc628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800c430 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800c590 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300c51c0 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800c910 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300c5780 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.936+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6300718b0 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.937+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc62800cd40 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.937+0000 7fc62d7fa700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 0x7fc61c069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.937+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6280843d0 con 0x7fc630155360 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.938+0000 7fc635099700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 0x7fc61c069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.938+0000 7fc635099700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 0x7fc61c069650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc620007580 tx=0x7fc6200097d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:51.942+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6280515f0 con 0x7fc630155360 2023-10-07T09:03:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.132+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc63015b9f0 con 0x7fc630155360 2023-10-07T09:03:52.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.358+0000 7fc62d7fa700 1 -- 172.21.15.46:0/4266930435 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc628054c10 con 0x7fc630155360 2023-10-07T09:03:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 msgr2=0x7fc61c069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 0x7fc61c069650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc620007580 tx=0x7fc6200097d0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 msgr2=0x7fc6300c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e870 tx=0x7fc628008040 comp rx=0 tx=0).stop 2023-10-07T09:03:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 shutdown_connections 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc61c0671a0 0x7fc61c069650 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc620007580 tx=0x7fc6200097d0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc630155360 0x7fc6300c48d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6300b40f0 0x7fc630141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 --2- 172.21.15.46:0/4266930435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6300ceb60 0x7fc6300c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.361+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 >> 172.21.15.46:0/4266930435 conn(0x7fc63006baf0 msgr2=0x7fc6300b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.362+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 shutdown_connections 2023-10-07T09:03:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.362+0000 7fc6372fd700 1 -- 172.21.15.46:0/4266930435 wait complete. 2023-10-07T09:03:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:03:52.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:03:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.501+0000 7f643c7b9700 1 Processor -- start 2023-10-07T09:03:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.501+0000 7f643c7b9700 1 -- start start 2023-10-07T09:03:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f643c7b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f643406bcd0 0x7f64340c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f643c7b9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643415b790 con 0x7f6434158d40 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f643c7b9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643415ba70 con 0x7f64341414c0 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f643c7b9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643415bd50 con 0x7f643406bcd0 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f6439d54700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6434158d40 0x7f6434140db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41598/0 (socket says 172.21.15.46:41598) 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.502+0000 7f6439d54700 1 -- 172.21.15.46:0/1822458775 learned_addr learned my addr 172.21.15.46:0/1822458775 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643a555700 1 --2- 172.21.15.46:0/1822458775 >> v2:172.21.15.133:3300/0 conn(0x7f643406bcd0 0x7f64340c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898116149 0 0) 0x7f643415b790 con 0x7f6434158d40 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6420003570 con 0x7f6434158d40 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394828779 0 0) 0x7f6420003570 con 0x7f6434158d40 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 >> v2:172.21.15.133:3300/0 conn(0x7f643406bcd0 msgr2=0x7f64340c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 --2- 172.21.15.46:0/1822458775 >> v2:172.21.15.133:3300/0 conn(0x7f643406bcd0 0x7f64340c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 >> v1:172.21.15.133:6789/0 conn(0x7f64341414c0 legacy=0x7f64340cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643415c030 con 0x7f6434158d40 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f6424001470 con 0x7f6434158d40 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 >> v1:172.21.15.46:6789/0 conn(0x7f6434158d40 legacy=0x7f6434140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6420003a60 0x7f6420003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6420004810 0x7f6420004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 0x7f642000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643415bd50 con 0x7f64200051c0 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642000c0d0 con 0x7f6420003a60 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642000c290 con 0x7f6420004810 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 0x7f642000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643a555700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6420003a60 0x7f6420003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f6439d54700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6420004810 0x7f6420004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 -- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6420004810 msgr2=0x7f6420004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6420004810 0x7f6420004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 -- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6420003a60 msgr2=0x7f6420003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6420003a60 0x7f6420003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643ad56700 1 -- 172.21.15.46:0/1822458775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420003570 con 0x7f64200051c0 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.503+0000 7f643a555700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6420003a60 0x7f6420003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643ad56700 1 -- 172.21.15.46:0/1822458775 reap_dead start 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643ad56700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 0x7f642000ba60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f642c001f90 tx=0x7f642c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f7c3ef3ae4f579 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c001950 con 0x7f64200051c0 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00c8b0 con 0x7f64200051c0 2023-10-07T09:03:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f6439553700 1 -- 172.21.15.46:0/1822458775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00cc50 con 0x7f64200051c0 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 -- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 msgr2=0x7f642000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 0x7f642000ba60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f642c001f90 tx=0x7f642c001640 comp rx=0 tx=0).stop 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 -- 172.21.15.46:0/1822458775 shutdown_connections 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 --2- 172.21.15.46:0/1822458775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64200051c0 0x7f642000ba60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 -- 172.21.15.46:0/1822458775 >> 172.21.15.46:0/1822458775 conn(0x7f64340ce5c0 msgr2=0x7f64340ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 -- 172.21.15.46:0/1822458775 shutdown_connections 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.504+0000 7f643c7b9700 1 -- 172.21.15.46:0/1822458775 wait complete. 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.505+0000 7f643c7b9700 1 Processor -- start 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 -- start start 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64200051c0 0x7f643413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643406a770 0x7f64340b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b4080 con 0x7f64340b3be0 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6434169ed0 con 0x7f64200051c0 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643c7b9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643416a0e0 con 0x7f643406a770 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643ad56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643ad56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36132/0 (socket says 172.21.15.46:36132) 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643ad56700 1 -- 172.21.15.46:0/151596598 learned_addr learned my addr 172.21.15.46:0/151596598 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.506+0000 7f643a555700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64200051c0 0x7f643413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f6439d54700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643406a770 0x7f64340b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 -- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643406a770 msgr2=0x7f64340b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643406a770 0x7f64340b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 -- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64200051c0 msgr2=0x7f643413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64200051c0 0x7f643413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 -- 172.21.15.46:0/151596598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643416a3c0 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643ad56700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f642c000f80 tx=0x7f642c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c001950 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00c6d0 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643416a6a0 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c01e890 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.507+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643416ac60 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.508+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643416ae50 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.509+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f642c01ec80 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.509+0000 7f642a7fc700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 0x7f6418069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.509+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f642c085da0 con 0x7f64340b3be0 2023-10-07T09:03:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.509+0000 7f643a555700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 0x7f6418069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.510+0000 7f643a555700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 0x7f6418069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f64340c47b0 tx=0x7f64300091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.514+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f642c052f60 con 0x7f64340b3be0 2023-10-07T09:03:52.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:52.707+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f64340718b0 con 0x7f64340b3be0 2023-10-07T09:03:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.362+0000 7f642a7fc700 1 -- 172.21.15.46:0/151596598 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) v1 ==== 170+0+0 (secure 0 0 0) 0x7f642c017020 con 0x7f64340b3be0 2023-10-07T09:03:53.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.373+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 msgr2=0x7f6418069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.373+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 0x7f6418069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f64340c47b0 tx=0x7f64300091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.373+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 msgr2=0x7f64340694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.373+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f642c000f80 tx=0x7f642c015000 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 shutdown_connections 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6418067170 0x7f6418069620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64340b3be0 0x7f64340694a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64200051c0 0x7f643413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 --2- 172.21.15.46:0/151596598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643406a770 0x7f64340b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.374+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 >> 172.21.15.46:0/151596598 conn(0x7f64340ce5c0 msgr2=0x7f6434157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:53.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.380+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 shutdown_connections 2023-10-07T09:03:53.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.380+0000 7f643c7b9700 1 -- 172.21.15.46:0/151596598 wait complete. 2023-10-07T09:03:53.382 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:03:53.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:03:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.518+0000 7f6fe4018700 1 Processor -- start 2023-10-07T09:03:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.518+0000 7f6fe4018700 1 -- start start 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe4018700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6fdc159890 0x7f6fdc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe4018700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 0x7f6fdc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe4018700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc15a160 con 0x7f6fdc15db10 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe4018700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc15df50 con 0x7f6fdc159890 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe4018700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0d13a0 con 0x7f6fdc159c60 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6fdc159890 0x7f6fdc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6fdc159890 0x7f6fdc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36138/0 (socket says 172.21.15.46:36138) 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 -- 172.21.15.46:0/2750190944 learned_addr learned my addr 172.21.15.46:0/2750190944 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe15b3700 1 --2- 172.21.15.46:0/2750190944 >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 0x7f6fdc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 -- 172.21.15.46:0/2750190944 >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 msgr2=0x7f6fdc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 --2- 172.21.15.46:0/2750190944 >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 0x7f6fdc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 -- 172.21.15.46:0/2750190944 >> v1:172.21.15.133:6789/0 conn(0x7f6fdc15db10 legacy=0x7f6fdc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 -- 172.21.15.46:0/2750190944 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc15e140 con 0x7f6fdc159890 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe15b3700 1 --2- 172.21.15.46:0/2750190944 >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 0x7f6fdc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.519+0000 7f6fe1db4700 1 --2- 172.21.15.46:0/2750190944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159890 0x7f6fdc15abd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b67f0 tx=0x7f6fd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c36c7ba700aec79 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe0db2700 1 -- 172.21.15.46:0/2750190944 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800b820 con 0x7f6fdc159890 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe0db2700 1 -- 172.21.15.46:0/2750190944 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd800b980 con 0x7f6fdc159890 2023-10-07T09:03:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe0db2700 1 -- 172.21.15.46:0/2750190944 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800bd20 con 0x7f6fdc159890 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 -- 172.21.15.46:0/2750190944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159890 msgr2=0x7f6fdc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 --2- 172.21.15.46:0/2750190944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159890 0x7f6fdc15abd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b67f0 tx=0x7f6fd8009250 comp rx=0 tx=0).stop 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 -- 172.21.15.46:0/2750190944 shutdown_connections 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 --2- 172.21.15.46:0/2750190944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159890 0x7f6fdc15abd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 --2- 172.21.15.46:0/2750190944 >> v2:172.21.15.133:3300/0 conn(0x7f6fdc159c60 0x7f6fdc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 -- 172.21.15.46:0/2750190944 >> 172.21.15.46:0/2750190944 conn(0x7f6fdc068e20 msgr2=0x7f6fdc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 -- 172.21.15.46:0/2750190944 shutdown_connections 2023-10-07T09:03:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.520+0000 7f6fe4018700 1 -- 172.21.15.46:0/2750190944 wait complete. 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.521+0000 7f6fe4018700 1 Processor -- start 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.521+0000 7f6fe4018700 1 -- start start 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc159890 0x7f6fdc0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 0x7f6fdc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1584d0 con 0x7f6fdc159c60 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc16d650 con 0x7f6fdc159890 2023-10-07T09:03:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe4018700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc16d930 con 0x7f6fdc15db10 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36152/0 (socket says 172.21.15.46:36152) 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 -- 172.21.15.46:0/106827291 learned_addr learned my addr 172.21.15.46:0/106827291 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe1db4700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc159890 0x7f6fdc0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe25b5700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 0x7f6fdc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 -- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 msgr2=0x7f6fdc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 0x7f6fdc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 -- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc159890 msgr2=0x7f6fdc0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc159890 0x7f6fdc0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe15b3700 1 -- 172.21.15.46:0/106827291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80094f0 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.522+0000 7f6fe25b5700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 0x7f6fdc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fe15b3700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c830 tx=0x7f6fcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011600 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc011760 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc158700 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011b20 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.523+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0c8d50 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.524+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc16dae0 con 0x7f6fdc159c60 2023-10-07T09:03:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.524+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6fcc0193b0 con 0x7f6fdc159c60 2023-10-07T09:03:53.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.525+0000 7f6fd1ffb700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 0x7f6fc0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:53.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.525+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6fcc0848d0 con 0x7f6fdc159c60 2023-10-07T09:03:53.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.525+0000 7f6fe1db4700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 0x7f6fc0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:53.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.526+0000 7f6fe1db4700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 0x7f6fc0069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b67f0 tx=0x7f6fd8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:53.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.529+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fdc16dae0 con 0x7f6fdc159c60 2023-10-07T09:03:53.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:53.772+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6fdc16daa0 con 0x7f6fdc159c60 2023-10-07T09:03:54.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.378+0000 7f6fd1ffb700 1 -- 172.21.15.46:0/106827291 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6fcc0150c0 con 0x7f6fdc159c60 2023-10-07T09:03:54.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.393+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 msgr2=0x7f6fc0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.393+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 0x7f6fc0069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b67f0 tx=0x7f6fd8016000 comp rx=0 tx=0).stop 2023-10-07T09:03:54.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.393+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 msgr2=0x7f6fdc0ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.393+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c830 tx=0x7f6fcc008040 comp rx=0 tx=0).stop 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 shutdown_connections 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6fc0067170 0x7f6fc0069620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6fdc15db10 0x7f6fdc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc159890 0x7f6fdc0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 --2- 172.21.15.46:0/106827291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fdc159c60 0x7f6fdc0ca4c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 >> 172.21.15.46:0/106827291 conn(0x7f6fdc068e20 msgr2=0x7f6fdc153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.394+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 shutdown_connections 2023-10-07T09:03:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.395+0000 7f6fe4018700 1 -- 172.21.15.46:0/106827291 wait complete. 2023-10-07T09:03:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 12 and data pool 13 2023-10-07T09:03:54.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:54.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.528+0000 7f7830343700 1 Processor -- start 2023-10-07T09:03:54.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.528+0000 7f7830343700 1 -- start start 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7828159890 0x7f782815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7828159c60 0x7f782815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f782815db10 0x7f7828069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782815df50 con 0x7f7828159890 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782815a160 con 0x7f7828159c60 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f7830343700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78280d13a0 con 0x7f782815db10 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.529+0000 7f782e0df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7828159890 0x7f782815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7828159890 0x7f782815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36162/0 (socket says 172.21.15.46:36162) 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 -- 172.21.15.46:0/2111282842 learned_addr learned my addr 172.21.15.46:0/2111282842 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782d8de700 1 --2- 172.21.15.46:0/2111282842 >> v2:172.21.15.133:3300/0 conn(0x7f7828159c60 0x7f782815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e8e0700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f782815db10 0x7f7828069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 -- 172.21.15.46:0/2111282842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f782815db10 msgr2=0x7f7828069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f782815db10 0x7f7828069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 -- 172.21.15.46:0/2111282842 >> v2:172.21.15.133:3300/0 conn(0x7f7828159c60 msgr2=0x7f782815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 --2- 172.21.15.46:0/2111282842 >> v2:172.21.15.133:3300/0 conn(0x7f7828159c60 0x7f782815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 -- 172.21.15.46:0/2111282842 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782815e140 con 0x7f7828159890 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782e0df700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7828159890 0x7f782815abd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f78280b67f0 tx=0x7f7820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baac78d3b7b235f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782d0dd700 1 -- 172.21.15.46:0/2111282842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000b860 con 0x7f7828159890 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782d0dd700 1 -- 172.21.15.46:0/2111282842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782000b9c0 con 0x7f7828159890 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.530+0000 7f782d0dd700 1 -- 172.21.15.46:0/2111282842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000bd60 con 0x7f7828159890 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 -- 172.21.15.46:0/2111282842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7828159890 msgr2=0x7f782815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7828159890 0x7f782815abd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f78280b67f0 tx=0x7f7820009250 comp rx=0 tx=0).stop 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 -- 172.21.15.46:0/2111282842 shutdown_connections 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f782815db10 0x7f7828069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 --2- 172.21.15.46:0/2111282842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7828159890 0x7f782815abd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 --2- 172.21.15.46:0/2111282842 >> v2:172.21.15.133:3300/0 conn(0x7f7828159c60 0x7f782815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 -- 172.21.15.46:0/2111282842 >> 172.21.15.46:0/2111282842 conn(0x7f7828068e20 msgr2=0x7f78280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 -- 172.21.15.46:0/2111282842 shutdown_connections 2023-10-07T09:03:54.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.531+0000 7f7830343700 1 -- 172.21.15.46:0/2111282842 wait complete. 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.532+0000 7f7830343700 1 Processor -- start 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.532+0000 7f7830343700 1 -- start start 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7828159890 0x7f78280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 0x7f78280c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828153650 con 0x7f782815db10 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280c9dd0 con 0x7f7828159c60 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78280b3630 con 0x7f7828159890 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e0df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7828159890 0x7f78280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36164/0 (socket says 172.21.15.46:36164) 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 -- 172.21.15.46:0/4147757162 learned_addr learned my addr 172.21.15.46:0/4147757162 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782d8de700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 0x7f78280c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 -- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7828159890 msgr2=0x7f78280b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7828159890 0x7f78280b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 -- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 msgr2=0x7f78280c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 0x7f78280c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 -- 172.21.15.46:0/4147757162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200094f0 con 0x7f782815db10 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782d8de700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 0x7f78280c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f782e8e0700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7818009fa0 tx=0x7f7818009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ec70 con 0x7f782815db10 2023-10-07T09:03:54.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800edd0 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818014670 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78280b3910 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.533+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78280b3ed0 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.534+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782804c3c0 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.535+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f78180149e0 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.535+0000 7f78267fc700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 0x7f7814069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.535+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7818084f70 con 0x7f782815db10 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.536+0000 7f782e0df700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 0x7f7814069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.536+0000 7f782e0df700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 0x7f7814069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f78280b67f0 tx=0x7f7820017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.540+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7818051f50 con 0x7f782815db10 2023-10-07T09:03:54.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.733+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f782806a5b0 con 0x7f782815db10 2023-10-07T09:03:54.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.734+0000 7f78267fc700 1 -- 172.21.15.46:0/4147757162 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f7818055570 con 0x7f782815db10 2023-10-07T09:03:54.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:54.735 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:53.773385+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 msgr2=0x7f7814069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 0x7f7814069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f78280b67f0 tx=0x7f7820017000 comp rx=0 tx=0).stop 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 msgr2=0x7f78280c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7818009fa0 tx=0x7f7818009900 comp rx=0 tx=0).stop 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 shutdown_connections 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7814067170 0x7f7814069620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f782815db10 0x7f78280c9750 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7828159890 0x7f78280b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 --2- 172.21.15.46:0/4147757162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828159c60 0x7f78280c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 >> 172.21.15.46:0/4147757162 conn(0x7f7828068e20 msgr2=0x7f78280c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:54.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 shutdown_connections 2023-10-07T09:03:54.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.736+0000 7f7830343700 1 -- 172.21.15.46:0/4147757162 wait complete. 2023-10-07T09:03:54.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 Processor -- start 2023-10-07T09:03:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 -- start start 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44e8159890 0x7f44e815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44e8159c60 0x7f44e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e815df50 con 0x7f44e8159c60 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e815a160 con 0x7f44e8159890 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.867+0000 7f44ed236700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80d13a0 con 0x7f44e815db10 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44e8159c60 0x7f44e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44e8159c60 0x7f44e815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36178/0 (socket says 172.21.15.46:36178) 2023-10-07T09:03:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 -- 172.21.15.46:0/1156579009 learned_addr learned my addr 172.21.15.46:0/1156579009 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e759e700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e6d9d700 1 --2- 172.21.15.46:0/1156579009 >> v2:172.21.15.133:3300/0 conn(0x7f44e8159890 0x7f44e815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 -- 172.21.15.46:0/1156579009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 msgr2=0x7f44e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 -- 172.21.15.46:0/1156579009 >> v2:172.21.15.133:3300/0 conn(0x7f44e8159890 msgr2=0x7f44e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 --2- 172.21.15.46:0/1156579009 >> v2:172.21.15.133:3300/0 conn(0x7f44e8159890 0x7f44e815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 -- 172.21.15.46:0/1156579009 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e815e140 con 0x7f44e8159c60 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e659c700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159c60 0x7f44e815d5d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f44e80d1090 tx=0x7f44d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa095cebf1445bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e5d9b700 1 -- 172.21.15.46:0/1156579009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000b860 con 0x7f44e8159c60 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e5d9b700 1 -- 172.21.15.46:0/1156579009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000b9c0 con 0x7f44e8159c60 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.868+0000 7f44e5d9b700 1 -- 172.21.15.46:0/1156579009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000bd60 con 0x7f44e8159c60 2023-10-07T09:03:54.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 -- 172.21.15.46:0/1156579009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159c60 msgr2=0x7f44e815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159c60 0x7f44e815d5d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f44e80d1090 tx=0x7f44d0009250 comp rx=0 tx=0).stop 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 -- 172.21.15.46:0/1156579009 shutdown_connections 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 --2- 172.21.15.46:0/1156579009 >> v2:172.21.15.133:3300/0 conn(0x7f44e8159890 0x7f44e815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 --2- 172.21.15.46:0/1156579009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159c60 0x7f44e815d5d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 -- 172.21.15.46:0/1156579009 >> 172.21.15.46:0/1156579009 conn(0x7f44e8068e20 msgr2=0x7f44e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 -- 172.21.15.46:0/1156579009 shutdown_connections 2023-10-07T09:03:54.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.869+0000 7f44ed236700 1 -- 172.21.15.46:0/1156579009 wait complete. 2023-10-07T09:03:54.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.870+0000 7f44ed236700 1 Processor -- start 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.870+0000 7f44ed236700 1 -- start start 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8159c60 0x7f44e80b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b5b50 con 0x7f44e8159890 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b3590 con 0x7f44e8159c60 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b5150 con 0x7f44e815db10 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36188/0 (socket says 172.21.15.46:36188) 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 -- 172.21.15.46:0/3185338231 learned_addr learned my addr 172.21.15.46:0/3185338231 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:54.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e659c700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8159c60 0x7f44e80b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e759e700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 -- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 msgr2=0x7f44e80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 -- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8159c60 msgr2=0x7f44e80b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8159c60 0x7f44e80b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 -- 172.21.15.46:0/3185338231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00094f0 con 0x7f44e8159890 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44e6d9d700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009fa0 tx=0x7f44d8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800ebc0 con 0x7f44e8159890 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800ed20 con 0x7f44e8159890 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.871+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e816a0c0 con 0x7f44e8159890 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.872+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8014670 con 0x7f44e8159890 2023-10-07T09:03:54.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.872+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e816a680 con 0x7f44e8159890 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.872+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e80b3870 con 0x7f44e8159890 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.873+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f44d80149e0 con 0x7f44e8159890 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.873+0000 7f44deffd700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 0x7f44c8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.873+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44d8084f30 con 0x7f44e8159890 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.874+0000 7f44e659c700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 0x7f44c8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:54.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.874+0000 7f44e659c700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 0x7f44c8069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44e80d1090 tx=0x7f44d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:54.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:54.878+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44d8051e70 con 0x7f44e8159890 2023-10-07T09:03:55.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.073+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e804c3c0 con 0x7f44e8159890 2023-10-07T09:03:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.074+0000 7f44deffd700 1 -- 172.21.15.46:0/3185338231 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f44d8055490 con 0x7f44e8159890 2023-10-07T09:03:55.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:55.076 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:53.773385+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 msgr2=0x7f44c8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 0x7f44c8069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44e80d1090 tx=0x7f44d0017000 comp rx=0 tx=0).stop 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 msgr2=0x7f44e816acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009fa0 tx=0x7f44d8009880 comp rx=0 tx=0).stop 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 shutdown_connections 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f44c8067170 0x7f44c8069620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44e815db10 0x7f44e80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44e8159890 0x7f44e816acf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 --2- 172.21.15.46:0/3185338231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8159c60 0x7f44e80b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 >> 172.21.15.46:0/3185338231 conn(0x7f44e8068e20 msgr2=0x7f44e815cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:55.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 shutdown_connections 2023-10-07T09:03:55.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.076+0000 7f44ed236700 1 -- 172.21.15.46:0/3185338231 wait complete. 2023-10-07T09:03:55.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:03:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.210+0000 7f064753e700 1 Processor -- start 2023-10-07T09:03:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 -- start start 2023-10-07T09:03:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 0x7f064015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0640069560 0x7f06400699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064015a160 con 0x7f0640159c60 2023-10-07T09:03:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0640069f20 con 0x7f0640069560 2023-10-07T09:03:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.211+0000 7f064753e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400d13a0 con 0x7f0640159890 2023-10-07T09:03:55.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f06452da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 0x7f064015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0640069560 0x7f06400699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0640069560 0x7f06400699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:34322/0 (socket says 172.21.15.46:34322) 2023-10-07T09:03:55.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 -- 172.21.15.46:0/2491361198 learned_addr learned my addr 172.21.15.46:0/2491361198 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 -- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 msgr2=0x7f064015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 0x7f064015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 -- 172.21.15.46:0/2491361198 >> v1:172.21.15.133:6789/0 conn(0x7f0640159c60 legacy=0x7f064015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f063ffff700 1 -- 172.21.15.46:0/2491361198 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910464072 0 0) 0x7f064015a160 con 0x7f0640159c60 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f0645adb700 1 -- 172.21.15.46:0/2491361198 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064015e140 con 0x7f0640069560 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.212+0000 7f06452da700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 0x7f064015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f0645adb700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640069560 0x7f06400699e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06300099b0 tx=0x7f0630009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcdd4f5bd7a83e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f063ffff700 1 -- 172.21.15.46:0/2491361198 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630009ea0 con 0x7f0640069560 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f063ffff700 1 -- 172.21.15.46:0/2491361198 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000b860 con 0x7f0640069560 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f063ffff700 1 -- 172.21.15.46:0/2491361198 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000bc00 con 0x7f0640069560 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 -- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640069560 msgr2=0x7f06400699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640069560 0x7f06400699e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06300099b0 tx=0x7f0630009250 comp rx=0 tx=0).stop 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 -- 172.21.15.46:0/2491361198 shutdown_connections 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640069560 0x7f06400699e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 --2- 172.21.15.46:0/2491361198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640159890 0x7f064015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 -- 172.21.15.46:0/2491361198 >> 172.21.15.46:0/2491361198 conn(0x7f0640068e20 msgr2=0x7f06400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 -- 172.21.15.46:0/2491361198 shutdown_connections 2023-10-07T09:03:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.213+0000 7f064753e700 1 -- 172.21.15.46:0/2491361198 wait complete. 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.214+0000 7f064753e700 1 Processor -- start 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.214+0000 7f064753e700 1 -- start start 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640069560 0x7f06400c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640159c60 0x7f06400b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400ce440 con 0x7f0640159890 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400b3c90 con 0x7f0640159c60 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f064753e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400b3f70 con 0x7f0640069560 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f0644ad9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f0644ad9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36202/0 (socket says 172.21.15.46:36202) 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.215+0000 7f0644ad9700 1 -- 172.21.15.46:0/826596825 learned_addr learned my addr 172.21.15.46:0/826596825 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f06452da700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640069560 0x7f06400c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0645adb700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640159c60 0x7f06400b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 -- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640069560 msgr2=0x7f06400c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640069560 0x7f06400c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 -- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640159c60 msgr2=0x7f06400b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640159c60 0x7f06400b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 -- 172.21.15.46:0/826596825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638009a20 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f0644ad9700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f063400c7e0 tx=0x7f0634007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011590 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06340116f0 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011ab0 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300094f0 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.216+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064014c710 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.217+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400b4410 con 0x7f0640159890 2023-10-07T09:03:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.218+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f063401b3b0 con 0x7f0640159890 2023-10-07T09:03:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.218+0000 7f063d7fa700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 0x7f062c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.218+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0634083ed0 con 0x7f0640159890 2023-10-07T09:03:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.218+0000 7f06452da700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 0x7f062c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.219+0000 7f06452da700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 0x7f062c069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06380099f0 tx=0x7f063800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.222+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0634050eb0 con 0x7f0640159890 2023-10-07T09:03:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:55.461+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f064004c3c0 con 0x7f0640159890 2023-10-07T09:03:56.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.385+0000 7f063d7fa700 1 -- 172.21.15.46:0/826596825 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0634017070 con 0x7f0640159890 2023-10-07T09:03:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 msgr2=0x7f062c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 0x7f062c069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06380099f0 tx=0x7f063800b040 comp rx=0 tx=0).stop 2023-10-07T09:03:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 msgr2=0x7f064015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f063400c7e0 tx=0x7f0634007dc0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 shutdown_connections 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f062c067170 0x7f062c069620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0640159c60 0x7f06400b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0640069560 0x7f06400c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 --2- 172.21.15.46:0/826596825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0640159890 0x7f064015d480 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 >> 172.21.15.46:0/826596825 conn(0x7f0640068e20 msgr2=0x7f06400b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 shutdown_connections 2023-10-07T09:03:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.388+0000 7f064753e700 1 -- 172.21.15.46:0/826596825 wait complete. 2023-10-07T09:03:56.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:03:56.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.535+0000 7ff411399700 1 Processor -- start 2023-10-07T09:03:56.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.535+0000 7ff411399700 1 -- start start 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff411399700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff40c0ccee0 0x7ff40c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff411399700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff40c0c87c0 0x7ff40c156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff411399700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c15b0d0 con 0x7ff40c0c83f0 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff411399700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c156c50 con 0x7ff40c0c87c0 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff411399700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c15a4c0 con 0x7ff40c0ccee0 2023-10-07T09:03:56.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff40c0c87c0 0x7ff40c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff40c0c87c0 0x7ff40c156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36204/0 (socket says 172.21.15.46:36204) 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 -- 172.21.15.46:0/712169392 learned_addr learned my addr 172.21.15.46:0/712169392 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40a7fc700 1 --2- 172.21.15.46:0/712169392 >> v2:172.21.15.133:3300/0 conn(0x7ff40c0ccee0 0x7ff40c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 -- 172.21.15.46:0/712169392 >> v2:172.21.15.133:3300/0 conn(0x7ff40c0ccee0 msgr2=0x7ff40c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 --2- 172.21.15.46:0/712169392 >> v2:172.21.15.133:3300/0 conn(0x7ff40c0ccee0 0x7ff40c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 -- 172.21.15.46:0/712169392 >> v1:172.21.15.133:6789/0 conn(0x7ff40c0c83f0 legacy=0x7ff40c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:56.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 -- 172.21.15.46:0/712169392 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c15a7a0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff40b7fe700 1 --2- 172.21.15.46:0/712169392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c156710 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0c7eb0 tx=0x7ff404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15f5f2593447478 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff409ffb700 1 -- 172.21.15.46:0/712169392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400b820 con 0x7ff40c0c87c0 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff409ffb700 1 -- 172.21.15.46:0/712169392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40400b980 con 0x7ff40c0c87c0 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.536+0000 7ff409ffb700 1 -- 172.21.15.46:0/712169392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400bd20 con 0x7ff40c0c87c0 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 -- 172.21.15.46:0/712169392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 msgr2=0x7ff40c156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 --2- 172.21.15.46:0/712169392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c156710 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0c7eb0 tx=0x7ff404009250 comp rx=0 tx=0).stop 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 -- 172.21.15.46:0/712169392 shutdown_connections 2023-10-07T09:03:56.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 --2- 172.21.15.46:0/712169392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c156710 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 --2- 172.21.15.46:0/712169392 >> v2:172.21.15.133:3300/0 conn(0x7ff40c0ccee0 0x7ff40c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 -- 172.21.15.46:0/712169392 >> 172.21.15.46:0/712169392 conn(0x7ff40c068e10 msgr2=0x7ff40c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:56.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 -- 172.21.15.46:0/712169392 shutdown_connections 2023-10-07T09:03:56.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.537+0000 7ff411399700 1 -- 172.21.15.46:0/712169392 wait complete. 2023-10-07T09:03:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.538+0000 7ff411399700 1 Processor -- start 2023-10-07T09:03:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.538+0000 7ff411399700 1 -- start start 2023-10-07T09:03:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40c0c83f0 0x7ff40c160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 0x7ff40c0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c150990 con 0x7ff40c0c87c0 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c3e30 con 0x7ff40c0c83f0 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff411399700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c40d0 con 0x7ff40c0ccee0 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36216/0 (socket says 172.21.15.46:36216) 2023-10-07T09:03:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 -- 172.21.15.46:0/2885246724 learned_addr learned my addr 172.21.15.46:0/2885246724 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40affd700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40c0c83f0 0x7ff40c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40b7fe700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 0x7ff40c0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 -- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 msgr2=0x7ff40c0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 0x7ff40c0c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 -- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40c0c83f0 msgr2=0x7ff40c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40c0c83f0 0x7ff40c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:56.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40a7fc700 1 -- 172.21.15.46:0/2885246724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4040094f0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.539+0000 7ff40b7fe700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 0x7ff40c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff40a7fc700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400d890 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40125f0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4012750 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0b03d0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4012ad0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.540+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c0b0990 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.541+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c04c3c0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.541+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff3f401e460 con 0x7ff40c0c87c0 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.542+0000 7ff402ffd700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 0x7ff3ec069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:56.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.542+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3f4084ee0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.542+0000 7ff40affd700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 0x7ff3ec069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:56.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.542+0000 7ff40affd700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 0x7ff3ec069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007560 tx=0x7ff3fc009760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:56.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.546+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3f40558b0 con 0x7ff40c0c87c0 2023-10-07T09:03:56.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:56.785+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff40c0cbd90 con 0x7ff40c0c87c0 2023-10-07T09:03:57.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.388+0000 7ff402ffd700 1 -- 172.21.15.46:0/2885246724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3f4055440 con 0x7ff40c0c87c0 2023-10-07T09:03:57.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.390+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 msgr2=0x7ff3ec069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 0x7ff3ec069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007560 tx=0x7ff3fc009760 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 msgr2=0x7ff40c150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400d890 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 shutdown_connections 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3ec067170 0x7ff3ec069620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff40c0ccee0 0x7ff40c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40c0c83f0 0x7ff40c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 --2- 172.21.15.46:0/2885246724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff40c0c87c0 0x7ff40c150450 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 >> 172.21.15.46:0/2885246724 conn(0x7ff40c068e10 msgr2=0x7ff40c0c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 shutdown_connections 2023-10-07T09:03:57.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.391+0000 7ff411399700 1 -- 172.21.15.46:0/2885246724 wait complete. 2023-10-07T09:03:57.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:57.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.532+0000 7f3da582a700 1 Processor -- start 2023-10-07T09:03:57.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.532+0000 7f3da582a700 1 -- start start 2023-10-07T09:03:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da582a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3da0159420 0x7f3da00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da582a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3da01597f0 0x7f3da00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da582a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da00b11d0 con 0x7f3da015d230 2023-10-07T09:03:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da582a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00b14b0 con 0x7f3da01597f0 2023-10-07T09:03:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da582a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00b1790 con 0x7f3da0159420 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3da01597f0 0x7f3da00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da5029700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3da015d230 0x7f3da015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41614/0 (socket says 172.21.15.46:41614) 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da5029700 1 -- 172.21.15.46:0/2309901677 learned_addr learned my addr 172.21.15.46:0/2309901677 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3da4828700 1 --2- 172.21.15.46:0/2309901677 >> v2:172.21.15.133:3300/0 conn(0x7f3da0159420 0x7f3da00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9ffff700 1 -- 172.21.15.46:0/2309901677 >> v2:172.21.15.133:3300/0 conn(0x7f3da0159420 msgr2=0x7f3da00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9ffff700 1 --2- 172.21.15.46:0/2309901677 >> v2:172.21.15.133:3300/0 conn(0x7f3da0159420 0x7f3da00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9ffff700 1 -- 172.21.15.46:0/2309901677 >> v1:172.21.15.46:6789/0 conn(0x7f3da015d230 legacy=0x7f3da015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9ffff700 1 -- 172.21.15.46:0/2309901677 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00b1a70 con 0x7f3da01597f0 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.533+0000 7f3d9f7fe700 1 -- 172.21.15.46:0/2309901677 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106417700 0 0) 0x7f3da00b11d0 con 0x7f3da015d230 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3d9ffff700 1 --2- 172.21.15.46:0/2309901677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da01597f0 0x7f3da00b2270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3da00b2f20 tx=0x7f3d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b835523288a31d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3d9f7fe700 1 -- 172.21.15.46:0/2309901677 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c011630 con 0x7f3da01597f0 2023-10-07T09:03:57.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3d9f7fe700 1 -- 172.21.15.46:0/2309901677 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c011790 con 0x7f3da01597f0 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3d9f7fe700 1 -- 172.21.15.46:0/2309901677 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c011b30 con 0x7f3da01597f0 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 -- 172.21.15.46:0/2309901677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da01597f0 msgr2=0x7f3da00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 --2- 172.21.15.46:0/2309901677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da01597f0 0x7f3da00b2270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3da00b2f20 tx=0x7f3d8c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 -- 172.21.15.46:0/2309901677 shutdown_connections 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 --2- 172.21.15.46:0/2309901677 >> v2:172.21.15.133:3300/0 conn(0x7f3da0159420 0x7f3da00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 --2- 172.21.15.46:0/2309901677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da01597f0 0x7f3da00b2270 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 -- 172.21.15.46:0/2309901677 >> 172.21.15.46:0/2309901677 conn(0x7f3da00d0660 msgr2=0x7f3da00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 -- 172.21.15.46:0/2309901677 shutdown_connections 2023-10-07T09:03:57.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.534+0000 7f3da582a700 1 -- 172.21.15.46:0/2309901677 wait complete. 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.535+0000 7f3da582a700 1 Processor -- start 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 -- start start 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da0159420 0x7f3da015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 0x7f3da014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da014e280 con 0x7f3da015d230 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da015a220 con 0x7f3da0159420 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da582a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00b5130 con 0x7f3da01597f0 2023-10-07T09:03:57.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.536+0000 7f3da5029700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36238/0 (socket says 172.21.15.46:36238) 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 -- 172.21.15.46:0/3330156822 learned_addr learned my addr 172.21.15.46:0/3330156822 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3d9ffff700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 0x7f3da014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da4828700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da0159420 0x7f3da015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 -- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 msgr2=0x7f3da014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 0x7f3da014dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 -- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da0159420 msgr2=0x7f3da015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da0159420 0x7f3da015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 -- 172.21.15.46:0/3330156822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c009420 con 0x7f3da015d230 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3d9ffff700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 0x7f3da014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da5029700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800cbc0 tx=0x7f3d98001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800a830 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800a990 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da00b5410 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800ad50 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.537+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00b59d0 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.538+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00b5d10 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.539+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3d98007300 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.539+0000 7f3d9cff9700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 0x7f3d84069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.539+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d98084b20 con 0x7f3da015d230 2023-10-07T09:03:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.539+0000 7f3da4828700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 0x7f3d84069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.540+0000 7f3da4828700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 0x7f3d84069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009db0 tx=0x7f3d940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.543+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d98051b80 con 0x7f3da015d230 2023-10-07T09:03:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.783+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3da004c3c0 con 0x7f3da015d230 2023-10-07T09:03:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.783+0000 7f3d9cff9700 1 -- 172.21.15.46:0/3330156822 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3d980551a0 con 0x7f3da015d230 2023-10-07T09:03:57.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:57.785 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 msgr2=0x7f3d84069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 0x7f3d84069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009db0 tx=0x7f3d940091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 msgr2=0x7f3da0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800cbc0 tx=0x7f3d98001980 comp rx=0 tx=0).stop 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 shutdown_connections 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d84067170 0x7f3d84069620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da015d230 0x7f3da0159ce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da0159420 0x7f3da015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 --2- 172.21.15.46:0/3330156822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da01597f0 0x7f3da014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 >> 172.21.15.46:0/3330156822 conn(0x7f3da00d0660 msgr2=0x7f3da0156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 shutdown_connections 2023-10-07T09:03:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.786+0000 7f3da582a700 1 -- 172.21.15.46:0/3330156822 wait complete. 2023-10-07T09:03:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 47 2023-10-07T09:03:57.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:03:57.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.916+0000 7fb3640f4700 1 Processor -- start 2023-10-07T09:03:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 -- start start 2023-10-07T09:03:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb35c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb35c06c0a0 0x7fb35c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c15d7e0 con 0x7fb35c15df50 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c15dac0 con 0x7fb35c06c0a0 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.917+0000 7fb3640f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15aa30 con 0x7fb35c06bcd0 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb362691700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb35c15df50 0x7fb35c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41628/0 (socket says 172.21.15.46:41628) 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb362691700 1 -- 172.21.15.46:0/2006692081 learned_addr learned my addr 172.21.15.46:0/2006692081 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb36168f700 1 --2- 172.21.15.46:0/2006692081 >> v2:172.21.15.133:3300/0 conn(0x7fb35c06c0a0 0x7fb35c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb361e90700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb35c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169482536 0 0) 0x7fb35c15d7e0 con 0x7fb35c15df50 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb344003570 con 0x7fb35c15df50 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490898183 0 0) 0x7fb344003570 con 0x7fb35c15df50 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 msgr2=0x7fb35c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb35c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 >> v2:172.21.15.133:3300/0 conn(0x7fb35c06c0a0 msgr2=0x7fb35c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 --2- 172.21.15.46:0/2006692081 >> v2:172.21.15.133:3300/0 conn(0x7fb35c06c0a0 0x7fb35c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c15ad10 con 0x7fb35c15df50 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb34c0017f0 con 0x7fb35c15df50 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb36168f700 1 --2- 172.21.15.46:0/2006692081 >> v2:172.21.15.133:3300/0 conn(0x7fb35c06c0a0 0x7fb35c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:03:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 >> v1:172.21.15.46:6789/0 conn(0x7fb35c15df50 legacy=0x7fb35c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb344003a60 0x7fb344003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb344004810 0x7fb344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb3440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15dac0 con 0x7fb344003a60 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15aa30 con 0x7fb344004810 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34400bae0 con 0x7fb35c06bcd0 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb361e90700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb344003a60 0x7fb344003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb36168f700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb344004810 0x7fb344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.918+0000 7fb362691700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb3440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 -- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 msgr2=0x7fb3440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:57.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb35c06bcd0 0x7fb3440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 -- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb344004810 msgr2=0x7fb344004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb344004810 0x7fb344004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 -- 172.21.15.46:0/2006692081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344003570 con 0x7fb344003a60 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb361e90700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb344003a60 0x7fb344003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb354009c00 tx=0x7fb3540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ff9f9c329456c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400e710 con 0x7fb344003a60 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35400e870 con 0x7fb344003a60 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb360e8e700 1 -- 172.21.15.46:0/2006692081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400ec30 con 0x7fb344003a60 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb3640f4700 1 -- 172.21.15.46:0/2006692081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb344003a60 msgr2=0x7fb344003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb3640f4700 1 --2- 172.21.15.46:0/2006692081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb344003a60 0x7fb344003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb354009c00 tx=0x7fb3540091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.919+0000 7fb362691700 1 -- 172.21.15.46:0/2006692081 reap_dead start 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.920+0000 7fb3640f4700 1 -- 172.21.15.46:0/2006692081 shutdown_connections 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.920+0000 7fb3640f4700 1 -- 172.21.15.46:0/2006692081 >> 172.21.15.46:0/2006692081 conn(0x7fb35c0ce600 msgr2=0x7fb35c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.920+0000 7fb3640f4700 1 -- 172.21.15.46:0/2006692081 shutdown_connections 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.920+0000 7fb3640f4700 1 -- 172.21.15.46:0/2006692081 wait complete. 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 Processor -- start 2023-10-07T09:03:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 -- start start 2023-10-07T09:03:57.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb344003a60 0x7fb35c16d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 0x7fb35c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c16e100 con 0x7fb35c0c8430 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c16db40 con 0x7fb35c158000 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.921+0000 7fb3640f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c16de20 con 0x7fb344003a60 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36258/0 (socket says 172.21.15.46:36258) 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 -- 172.21.15.46:0/1834323610 learned_addr learned my addr 172.21.15.46:0/1834323610 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 -- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb344003a60 msgr2=0x7fb35c16d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb344003a60 0x7fb35c16d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 -- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 msgr2=0x7fb35c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb36168f700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 0x7fb35c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 0x7fb35c0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:57.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 -- 172.21.15.46:0/1834323610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c158700 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb36168f700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 0x7fb35c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb362691700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb34c000f80 tx=0x7fb34c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00ad80 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0133f0 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c1589e0 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0137b0 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.922+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c153540 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.923+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c158560 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.924+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb34c013b60 con 0x7fb35c0c8430 2023-10-07T09:03:57.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.924+0000 7fb359ffb700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 0x7fb348069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:57.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.924+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb34c085220 con 0x7fb35c0c8430 2023-10-07T09:03:57.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.924+0000 7fb361e90700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 0x7fb348069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:57.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.925+0000 7fb361e90700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 0x7fb348069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3540091e0 tx=0x7fb35401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:57.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:57.928+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb35c158560 con 0x7fb35c0c8430 2023-10-07T09:03:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.122+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35c158560 con 0x7fb35c0c8430 2023-10-07T09:03:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.123+0000 7fb359ffb700 1 -- 172.21.15.46:0/1834323610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fb35c158560 con 0x7fb35c0c8430 2023-10-07T09:03:58.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:58.124 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":78,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:55.374764+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:03:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 msgr2=0x7fb348069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 0x7fb348069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3540091e0 tx=0x7fb35401a000 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 msgr2=0x7fb35c14ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb34c000f80 tx=0x7fb34c002210 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 shutdown_connections 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb348067170 0x7fb348069620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c0c8430 0x7fb35c14ef50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb344003a60 0x7fb35c16d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 --2- 172.21.15.46:0/1834323610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35c158000 0x7fb35c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 >> 172.21.15.46:0/1834323610 conn(0x7fb35c0ce600 msgr2=0x7fb35c157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 shutdown_connections 2023-10-07T09:03:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.125+0000 7fb3640f4700 1 -- 172.21.15.46:0/1834323610 wait complete. 2023-10-07T09:03:58.138 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:03:58.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:03:58.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.257+0000 7fa3abf0a700 1 Processor -- start 2023-10-07T09:03:58.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.257+0000 7fa3abf0a700 1 -- start start 2023-10-07T09:03:58.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3abf0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 0x7fa3a415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3abf0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3a415c910 0x7fa3a415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3abf0a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a415d2b0 con 0x7fa3a40b5ea0 2023-10-07T09:03:58.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3abf0a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40b2a40 con 0x7fa3a415c910 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3abf0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415c480 con 0x7fa3a4159c10 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a94a5700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa3a40b5ea0 0x7fa3a4068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41630/0 (socket says 172.21.15.46:41630) 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a94a5700 1 -- 172.21.15.46:0/1280766017 learned_addr learned my addr 172.21.15.46:0/1280766017 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/1280766017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 0x7fa3a415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3aa4a7700 1 --2- 172.21.15.46:0/1280766017 >> v2:172.21.15.133:3300/0 conn(0x7fa3a415c910 0x7fa3a415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a8ca4700 1 -- 172.21.15.46:0/1280766017 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532873034 0 0) 0x7fa398001110 con 0x7fa3a40b5ea0 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a8ca4700 1 -- 172.21.15.46:0/1280766017 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38c003570 con 0x7fa3a40b5ea0 2023-10-07T09:03:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a9ca6700 1 -- 172.21.15.46:0/1280766017 >> v2:172.21.15.133:3300/0 conn(0x7fa3a415c910 msgr2=0x7fa3a415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/1280766017 >> v2:172.21.15.133:3300/0 conn(0x7fa3a415c910 0x7fa3a415cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a9ca6700 1 -- 172.21.15.46:0/1280766017 >> v1:172.21.15.46:6789/0 conn(0x7fa3a40b5ea0 legacy=0x7fa3a4068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.258+0000 7fa3a9ca6700 1 -- 172.21.15.46:0/1280766017 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a415b5d0 con 0x7fa3a4159c10 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/1280766017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 0x7fa3a415b090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e60 tx=0x7fa394009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9626dc994a20b66f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3a8ca4700 1 -- 172.21.15.46:0/1280766017 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400e070 con 0x7fa3a4159c10 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3a8ca4700 1 -- 172.21.15.46:0/1280766017 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400bab0 con 0x7fa3a4159c10 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3a8ca4700 1 -- 172.21.15.46:0/1280766017 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400be70 con 0x7fa3a4159c10 2023-10-07T09:03:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 -- 172.21.15.46:0/1280766017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 msgr2=0x7fa3a415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/1280766017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 0x7fa3a415b090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e60 tx=0x7fa394009780 comp rx=0 tx=0).stop 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 -- 172.21.15.46:0/1280766017 shutdown_connections 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/1280766017 >> v2:172.21.15.133:3300/0 conn(0x7fa3a415c910 0x7fa3a415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/1280766017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a4159c10 0x7fa3a415b090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 -- 172.21.15.46:0/1280766017 >> 172.21.15.46:0/1280766017 conn(0x7fa3a4099a20 msgr2=0x7fa3a40af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 -- 172.21.15.46:0/1280766017 shutdown_connections 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.259+0000 7fa3abf0a700 1 -- 172.21.15.46:0/1280766017 wait complete. 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.260+0000 7fa3abf0a700 1 Processor -- start 2023-10-07T09:03:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 -- start start 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a40b5ea0 0x7fa3a40adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 0x7fa3a41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4155af0 con 0x7fa3a415c910 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415ed40 con 0x7fa3a4159c10 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3abf0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415ea10 con 0x7fa3a40b5ea0 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3aa4a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3aa4a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36260/0 (socket says 172.21.15.46:36260) 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3aa4a7700 1 -- 172.21.15.46:0/758619849 learned_addr learned my addr 172.21.15.46:0/758619849 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a40b5ea0 0x7fa3a40adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.261+0000 7fa3a94a5700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 0x7fa3a41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 -- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a40b5ea0 msgr2=0x7fa3a40adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a40b5ea0 0x7fa3a40adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 -- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 msgr2=0x7fa3a41555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 0x7fa3a41555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 -- 172.21.15.46:0/758619849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009a20 con 0x7fa3a415c910 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3a94a5700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 0x7fa3a41555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3aa4a7700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e8d0 tx=0x7fa39c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c013680 con 0x7fa3a415c910 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0137e0 con 0x7fa3a415c910 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a40ae0e0 con 0x7fa3a415c910 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c013ba0 con 0x7fa3a415c910 2023-10-07T09:03:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.262+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40b1210 con 0x7fa3a415c910 2023-10-07T09:03:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.263+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a415eed0 con 0x7fa3a415c910 2023-10-07T09:03:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.264+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa39c0123d0 con 0x7fa3a415c910 2023-10-07T09:03:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.264+0000 7fa3a1ffb700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 0x7fa390069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.264+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa39c084990 con 0x7fa3a415c910 2023-10-07T09:03:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.264+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 0x7fa390069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.265+0000 7fa3a9ca6700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 0x7fa390069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa394019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.268+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa39c051970 con 0x7fa3a415c910 2023-10-07T09:03:58.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.459+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3a415b870 con 0x7fa390067170 2023-10-07T09:03:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.468+0000 7fa3a1ffb700 1 -- 172.21.15.46:0/758619849 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289311 (secure 0 0 0) 0x7fa3a415b870 con 0x7fa390067170 2023-10-07T09:03:58.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 msgr2=0x7fa390069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 0x7fa390069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa394019000 comp rx=0 tx=0).stop 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 msgr2=0x7fa3a40b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e8d0 tx=0x7fa39c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 shutdown_connections 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa390067170 0x7fa390069620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3a415c910 0x7fa3a40b0cd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3a40b5ea0 0x7fa3a40adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 --2- 172.21.15.46:0/758619849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3a4159c10 0x7fa3a41555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 >> 172.21.15.46:0/758619849 conn(0x7fa3a4099a20 msgr2=0x7fa3a409a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 shutdown_connections 2023-10-07T09:03:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.471+0000 7fa3abf0a700 1 -- 172.21.15.46:0/758619849 wait complete. 2023-10-07T09:03:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:03:58.484 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2023-10-07T09:03:57.841171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403328,"kb_used_data":8640,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571392,"statfs":{"total":773094113280,"available":770633105408,"internally_reserved":0,"allocated":8847360,"data_stored":4434588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.483149"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397224+0000","last_change":"2023-10-07T09:03:54.397224+0000","last_active":"2023-10-07T09:03:54.397224+0000","last_peered":"2023-10-07T09:03:54.397224+0000","last_clean":"2023-10-07T09:03:54.397224+0000","last_became_active":"2023-10-07T09:03:54.396784+0000","last_became_peered":"2023-10-07T09:03:54.396784+0000","last_unstale":"2023-10-07T09:03:54.397224+0000","last_undegraded":"2023-10-07T09:03:54.397224+0000","last_fullsized":"2023-10-07T09:03:54.397224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:31.927565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394463+0000","last_change":"2023-10-07T09:03:54.393894+0000","last_active":"2023-10-07T09:03:54.394463+0000","last_peered":"2023-10-07T09:03:54.394463+0000","last_clean":"2023-10-07T09:03:54.394463+0000","last_became_active":"2023-10-07T09:03:54.393634+0000","last_became_peered":"2023-10-07T09:03:54.393634+0000","last_unstale":"2023-10-07T09:03:54.394463+0000","last_undegraded":"2023-10-07T09:03:54.394463+0000","last_fullsized":"2023-10-07T09:03:54.394463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:16.512068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401760+0000","last_change":"2023-10-07T09:03:54.397244+0000","last_active":"2023-10-07T09:03:54.401760+0000","last_peered":"2023-10-07T09:03:54.401760+0000","last_clean":"2023-10-07T09:03:54.401760+0000","last_became_active":"2023-10-07T09:03:54.396709+0000","last_became_peered":"2023-10-07T09:03:54.396709+0000","last_unstale":"2023-10-07T09:03:54.401760+0000","last_undegraded":"2023-10-07T09:03:54.401760+0000","last_fullsized":"2023-10-07T09:03:54.401760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:44.641777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.384498+0000","last_change":"2023-10-07T09:03:54.384498+0000","last_active":"2023-10-07T09:03:54.384498+0000","last_peered":"2023-10-07T09:03:54.384498+0000","last_clean":"2023-10-07T09:03:54.384498+0000","last_became_active":"2023-10-07T09:03:54.384138+0000","last_became_peered":"2023-10-07T09:03:54.384138+0000","last_unstale":"2023-10-07T09:03:54.384498+0000","last_undegraded":"2023-10-07T09:03:54.384498+0000","last_fullsized":"2023-10-07T09:03:54.384498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:02.875058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397323+0000","last_change":"2023-10-07T09:03:54.393691+0000","last_active":"2023-10-07T09:03:54.397323+0000","last_peered":"2023-10-07T09:03:54.397323+0000","last_clean":"2023-10-07T09:03:54.397323+0000","last_became_active":"2023-10-07T09:03:54.392863+0000","last_became_peered":"2023-10-07T09:03:54.392863+0000","last_unstale":"2023-10-07T09:03:54.397323+0000","last_undegraded":"2023-10-07T09:03:54.397323+0000","last_fullsized":"2023-10-07T09:03:54.397323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381666+0000","last_change":"2023-10-07T09:03:54.377321+0000","last_active":"2023-10-07T09:03:54.381666+0000","last_peered":"2023-10-07T09:03:54.381666+0000","last_clean":"2023-10-07T09:03:54.381666+0000","last_became_active":"2023-10-07T09:03:54.377071+0000","last_became_peered":"2023-10-07T09:03:54.377071+0000","last_unstale":"2023-10-07T09:03:54.381666+0000","last_undegraded":"2023-10-07T09:03:54.381666+0000","last_fullsized":"2023-10-07T09:03:54.381666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:43.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392318+0000","last_change":"2023-10-07T09:03:54.392318+0000","last_active":"2023-10-07T09:03:54.392318+0000","last_peered":"2023-10-07T09:03:54.392318+0000","last_clean":"2023-10-07T09:03:54.392318+0000","last_became_active":"2023-10-07T09:03:54.392060+0000","last_became_peered":"2023-10-07T09:03:54.392060+0000","last_unstale":"2023-10-07T09:03:54.392318+0000","last_undegraded":"2023-10-07T09:03:54.392318+0000","last_fullsized":"2023-10-07T09:03:54.392318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:32.624061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386596+0000","last_change":"2023-10-07T09:03:54.379801+0000","last_active":"2023-10-07T09:03:54.386596+0000","last_peered":"2023-10-07T09:03:54.386596+0000","last_clean":"2023-10-07T09:03:54.386596+0000","last_became_active":"2023-10-07T09:03:54.379532+0000","last_became_peered":"2023-10-07T09:03:54.379532+0000","last_unstale":"2023-10-07T09:03:54.386596+0000","last_undegraded":"2023-10-07T09:03:54.386596+0000","last_fullsized":"2023-10-07T09:03:54.386596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:47.103088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.390447+0000","last_change":"2023-10-07T09:03:54.387457+0000","last_active":"2023-10-07T09:03:54.390447+0000","last_peered":"2023-10-07T09:03:54.390447+0000","last_clean":"2023-10-07T09:03:54.390447+0000","last_became_active":"2023-10-07T09:03:54.387233+0000","last_became_peered":"2023-10-07T09:03:54.387233+0000","last_unstale":"2023-10-07T09:03:54.390447+0000","last_undegraded":"2023-10-07T09:03:54.390447+0000","last_fullsized":"2023-10-07T09:03:54.390447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.390959+0000","last_change":"2023-10-07T09:03:54.390959+0000","last_active":"2023-10-07T09:03:54.390959+0000","last_peered":"2023-10-07T09:03:54.390959+0000","last_clean":"2023-10-07T09:03:54.390959+0000","last_became_active":"2023-10-07T09:03:54.390643+0000","last_became_peered":"2023-10-07T09:03:54.390643+0000","last_unstale":"2023-10-07T09:03:54.390959+0000","last_undegraded":"2023-10-07T09:03:54.390959+0000","last_fullsized":"2023-10-07T09:03:54.390959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:13.082179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394621+0000","last_change":"2023-10-07T09:03:54.393796+0000","last_active":"2023-10-07T09:03:54.394621+0000","last_peered":"2023-10-07T09:03:54.394621+0000","last_clean":"2023-10-07T09:03:54.394621+0000","last_became_active":"2023-10-07T09:03:54.390426+0000","last_became_peered":"2023-10-07T09:03:54.390426+0000","last_unstale":"2023-10-07T09:03:54.394621+0000","last_undegraded":"2023-10-07T09:03:54.394621+0000","last_fullsized":"2023-10-07T09:03:54.394621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:31.364730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381853+0000","last_change":"2023-10-07T09:03:54.381853+0000","last_active":"2023-10-07T09:03:54.381853+0000","last_peered":"2023-10-07T09:03:54.381853+0000","last_clean":"2023-10-07T09:03:54.381853+0000","last_became_active":"2023-10-07T09:03:54.381621+0000","last_became_peered":"2023-10-07T09:03:54.381621+0000","last_unstale":"2023-10-07T09:03:54.381853+0000","last_undegraded":"2023-10-07T09:03:54.381853+0000","last_fullsized":"2023-10-07T09:03:54.381853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:43.717297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391629+0000","last_change":"2023-10-07T09:03:54.389160+0000","last_active":"2023-10-07T09:03:54.391629+0000","last_peered":"2023-10-07T09:03:54.391629+0000","last_clean":"2023-10-07T09:03:54.391629+0000","last_became_active":"2023-10-07T09:03:54.388114+0000","last_became_peered":"2023-10-07T09:03:54.388114+0000","last_unstale":"2023-10-07T09:03:54.391629+0000","last_undegraded":"2023-10-07T09:03:54.391629+0000","last_fullsized":"2023-10-07T09:03:54.391629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.453648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385439+0000","last_change":"2023-10-07T09:03:54.385439+0000","last_active":"2023-10-07T09:03:54.385439+0000","last_peered":"2023-10-07T09:03:54.385439+0000","last_clean":"2023-10-07T09:03:54.385439+0000","last_became_active":"2023-10-07T09:03:54.384976+0000","last_became_peered":"2023-10-07T09:03:54.384976+0000","last_unstale":"2023-10-07T09:03:54.385439+0000","last_undegraded":"2023-10-07T09:03:54.385439+0000","last_fullsized":"2023-10-07T09:03:54.385439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:36.165191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.387995+0000","last_change":"2023-10-07T09:03:54.387995+0000","last_active":"2023-10-07T09:03:54.387995+0000","last_peered":"2023-10-07T09:03:54.387995+0000","last_clean":"2023-10-07T09:03:54.387995+0000","last_became_active":"2023-10-07T09:03:54.387706+0000","last_became_peered":"2023-10-07T09:03:54.387706+0000","last_unstale":"2023-10-07T09:03:54.387995+0000","last_undegraded":"2023-10-07T09:03:54.387995+0000","last_fullsized":"2023-10-07T09:03:54.387995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:02.750799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401530+0000","last_change":"2023-10-07T09:03:54.398619+0000","last_active":"2023-10-07T09:03:54.401530+0000","last_peered":"2023-10-07T09:03:54.401530+0000","last_clean":"2023-10-07T09:03:54.401530+0000","last_became_active":"2023-10-07T09:03:54.398296+0000","last_became_peered":"2023-10-07T09:03:54.398296+0000","last_unstale":"2023-10-07T09:03:54.401530+0000","last_undegraded":"2023-10-07T09:03:54.401530+0000","last_fullsized":"2023-10-07T09:03:54.401530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:47.926672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397727+0000","last_change":"2023-10-07T09:03:54.393677+0000","last_active":"2023-10-07T09:03:54.397727+0000","last_peered":"2023-10-07T09:03:54.397727+0000","last_clean":"2023-10-07T09:03:54.397727+0000","last_became_active":"2023-10-07T09:03:54.393348+0000","last_became_peered":"2023-10-07T09:03:54.393348+0000","last_unstale":"2023-10-07T09:03:54.397727+0000","last_undegraded":"2023-10-07T09:03:54.397727+0000","last_fullsized":"2023-10-07T09:03:54.397727+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:02:09.396102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395052+0000","last_change":"2023-10-07T09:03:54.395052+0000","last_active":"2023-10-07T09:03:54.395052+0000","last_peered":"2023-10-07T09:03:54.395052+0000","last_clean":"2023-10-07T09:03:54.395052+0000","last_became_active":"2023-10-07T09:03:54.394784+0000","last_became_peered":"2023-10-07T09:03:54.394784+0000","last_unstale":"2023-10-07T09:03:54.395052+0000","last_undegraded":"2023-10-07T09:03:54.395052+0000","last_fullsized":"2023-10-07T09:03:54.395052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:12.096874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385418+0000","last_change":"2023-10-07T09:03:54.385418+0000","last_active":"2023-10-07T09:03:54.385418+0000","last_peered":"2023-10-07T09:03:54.385418+0000","last_clean":"2023-10-07T09:03:54.385418+0000","last_became_active":"2023-10-07T09:03:54.385144+0000","last_became_peered":"2023-10-07T09:03:54.385144+0000","last_unstale":"2023-10-07T09:03:54.385418+0000","last_undegraded":"2023-10-07T09:03:54.385418+0000","last_fullsized":"2023-10-07T09:03:54.385418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.453648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.382450+0000","last_change":"2023-10-07T09:03:54.382450+0000","last_active":"2023-10-07T09:03:54.382450+0000","last_peered":"2023-10-07T09:03:54.382450+0000","last_clean":"2023-10-07T09:03:54.382450+0000","last_became_active":"2023-10-07T09:03:54.382208+0000","last_became_peered":"2023-10-07T09:03:54.382208+0000","last_unstale":"2023-10-07T09:03:54.382450+0000","last_undegraded":"2023-10-07T09:03:54.382450+0000","last_fullsized":"2023-10-07T09:03:54.382450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:47.807857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386979+0000","last_change":"2023-10-07T09:03:54.386979+0000","last_active":"2023-10-07T09:03:54.386979+0000","last_peered":"2023-10-07T09:03:54.386979+0000","last_clean":"2023-10-07T09:03:54.386979+0000","last_became_active":"2023-10-07T09:03:54.385113+0000","last_became_peered":"2023-10-07T09:03:54.385113+0000","last_unstale":"2023-10-07T09:03:54.386979+0000","last_undegraded":"2023-10-07T09:03:54.386979+0000","last_fullsized":"2023-10-07T09:03:54.386979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:15.253851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383911+0000","last_change":"2023-10-07T09:03:54.382792+0000","last_active":"2023-10-07T09:03:54.383911+0000","last_peered":"2023-10-07T09:03:54.383911+0000","last_clean":"2023-10-07T09:03:54.383911+0000","last_became_active":"2023-10-07T09:03:54.382500+0000","last_became_peered":"2023-10-07T09:03:54.382500+0000","last_unstale":"2023-10-07T09:03:54.383911+0000","last_undegraded":"2023-10-07T09:03:54.383911+0000","last_fullsized":"2023-10-07T09:03:54.383911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:27:36.101865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394948+0000","last_change":"2023-10-07T09:03:54.394948+0000","last_active":"2023-10-07T09:03:54.394948+0000","last_peered":"2023-10-07T09:03:54.394948+0000","last_clean":"2023-10-07T09:03:54.394948+0000","last_became_active":"2023-10-07T09:03:54.394537+0000","last_became_peered":"2023-10-07T09:03:54.394537+0000","last_unstale":"2023-10-07T09:03:54.394948+0000","last_undegraded":"2023-10-07T09:03:54.394948+0000","last_fullsized":"2023-10-07T09:03:54.394948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:57.924366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385296+0000","last_change":"2023-10-07T09:03:54.385296+0000","last_active":"2023-10-07T09:03:54.385296+0000","last_peered":"2023-10-07T09:03:54.385296+0000","last_clean":"2023-10-07T09:03:54.385296+0000","last_became_active":"2023-10-07T09:03:54.385027+0000","last_became_peered":"2023-10-07T09:03:54.385027+0000","last_unstale":"2023-10-07T09:03:54.385296+0000","last_undegraded":"2023-10-07T09:03:54.385296+0000","last_fullsized":"2023-10-07T09:03:54.385296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:23:27.254962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.399188+0000","last_change":"2023-10-07T09:03:54.398484+0000","last_active":"2023-10-07T09:03:54.399188+0000","last_peered":"2023-10-07T09:03:54.399188+0000","last_clean":"2023-10-07T09:03:54.399188+0000","last_became_active":"2023-10-07T09:03:54.398197+0000","last_became_peered":"2023-10-07T09:03:54.398197+0000","last_unstale":"2023-10-07T09:03:54.399188+0000","last_undegraded":"2023-10-07T09:03:54.399188+0000","last_fullsized":"2023-10-07T09:03:54.399188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:02:09.396102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391185+0000","last_change":"2023-10-07T09:03:54.387034+0000","last_active":"2023-10-07T09:03:54.391185+0000","last_peered":"2023-10-07T09:03:54.391185+0000","last_clean":"2023-10-07T09:03:54.391185+0000","last_became_active":"2023-10-07T09:03:54.386756+0000","last_became_peered":"2023-10-07T09:03:54.386756+0000","last_unstale":"2023-10-07T09:03:54.391185+0000","last_undegraded":"2023-10-07T09:03:54.391185+0000","last_fullsized":"2023-10-07T09:03:54.391185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:29:33.394523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392164+0000","last_change":"2023-10-07T09:03:54.385590+0000","last_active":"2023-10-07T09:03:54.392164+0000","last_peered":"2023-10-07T09:03:54.392164+0000","last_clean":"2023-10-07T09:03:54.392164+0000","last_became_active":"2023-10-07T09:03:54.385276+0000","last_became_peered":"2023-10-07T09:03:54.385276+0000","last_unstale":"2023-10-07T09:03:54.392164+0000","last_undegraded":"2023-10-07T09:03:54.392164+0000","last_fullsized":"2023-10-07T09:03:54.392164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:15.368783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396210+0000","last_change":"2023-10-07T09:03:54.396210+0000","last_active":"2023-10-07T09:03:54.396210+0000","last_peered":"2023-10-07T09:03:54.396210+0000","last_clean":"2023-10-07T09:03:54.396210+0000","last_became_active":"2023-10-07T09:03:54.395519+0000","last_became_peered":"2023-10-07T09:03:54.395519+0000","last_unstale":"2023-10-07T09:03:54.396210+0000","last_undegraded":"2023-10-07T09:03:54.396210+0000","last_fullsized":"2023-10-07T09:03:54.396210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:47.103088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.384451+0000","last_change":"2023-10-07T09:03:54.376684+0000","last_active":"2023-10-07T09:03:54.384451+0000","last_peered":"2023-10-07T09:03:54.384451+0000","last_clean":"2023-10-07T09:03:54.384451+0000","last_became_active":"2023-10-07T09:03:54.376416+0000","last_became_peered":"2023-10-07T09:03:54.376416+0000","last_unstale":"2023-10-07T09:03:54.384451+0000","last_undegraded":"2023-10-07T09:03:54.384451+0000","last_fullsized":"2023-10-07T09:03:54.384451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:40.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383582+0000","last_change":"2023-10-07T09:03:54.377522+0000","last_active":"2023-10-07T09:03:54.383582+0000","last_peered":"2023-10-07T09:03:54.383582+0000","last_clean":"2023-10-07T09:03:54.383582+0000","last_became_active":"2023-10-07T09:03:54.377069+0000","last_became_peered":"2023-10-07T09:03:54.377069+0000","last_unstale":"2023-10-07T09:03:54.383582+0000","last_undegraded":"2023-10-07T09:03:54.383582+0000","last_fullsized":"2023-10-07T09:03:54.383582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:56.769076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386999+0000","last_change":"2023-10-07T09:03:54.382562+0000","last_active":"2023-10-07T09:03:54.386999+0000","last_peered":"2023-10-07T09:03:54.386999+0000","last_clean":"2023-10-07T09:03:54.386999+0000","last_became_active":"2023-10-07T09:03:54.382296+0000","last_became_peered":"2023-10-07T09:03:54.382296+0000","last_unstale":"2023-10-07T09:03:54.386999+0000","last_undegraded":"2023-10-07T09:03:54.386999+0000","last_fullsized":"2023-10-07T09:03:54.386999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:26.029964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386204+0000","last_change":"2023-10-07T09:03:54.386204+0000","last_active":"2023-10-07T09:03:54.386204+0000","last_peered":"2023-10-07T09:03:54.386204+0000","last_clean":"2023-10-07T09:03:54.386204+0000","last_became_active":"2023-10-07T09:03:54.385706+0000","last_became_peered":"2023-10-07T09:03:54.385706+0000","last_unstale":"2023-10-07T09:03:54.386204+0000","last_undegraded":"2023-10-07T09:03:54.386204+0000","last_fullsized":"2023-10-07T09:03:54.386204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:43.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401501+0000","last_change":"2023-10-07T09:03:54.398621+0000","last_active":"2023-10-07T09:03:54.401501+0000","last_peered":"2023-10-07T09:03:54.401501+0000","last_clean":"2023-10-07T09:03:54.401501+0000","last_became_active":"2023-10-07T09:03:54.398399+0000","last_became_peered":"2023-10-07T09:03:54.398399+0000","last_unstale":"2023-10-07T09:03:54.401501+0000","last_undegraded":"2023-10-07T09:03:54.401501+0000","last_fullsized":"2023-10-07T09:03:54.401501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:49.266603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396997+0000","last_change":"2023-10-07T09:03:53.372360+0000","last_active":"2023-10-07T09:03:54.396997+0000","last_peered":"2023-10-07T09:03:54.396997+0000","last_clean":"2023-10-07T09:03:54.396997+0000","last_became_active":"2023-10-07T09:03:53.372100+0000","last_became_peered":"2023-10-07T09:03:53.372100+0000","last_unstale":"2023-10-07T09:03:54.396997+0000","last_undegraded":"2023-10-07T09:03:54.396997+0000","last_fullsized":"2023-10-07T09:03:54.396997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:19.632738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391492+0000","last_change":"2023-10-07T09:03:54.391492+0000","last_active":"2023-10-07T09:03:54.391492+0000","last_peered":"2023-10-07T09:03:54.391492+0000","last_clean":"2023-10-07T09:03:54.391492+0000","last_became_active":"2023-10-07T09:03:54.391028+0000","last_became_peered":"2023-10-07T09:03:54.391028+0000","last_unstale":"2023-10-07T09:03:54.391492+0000","last_undegraded":"2023-10-07T09:03:54.391492+0000","last_fullsized":"2023-10-07T09:03:54.391492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:56.302361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395622+0000","last_change":"2023-10-07T09:03:53.371129+0000","last_active":"2023-10-07T09:03:54.395622+0000","last_peered":"2023-10-07T09:03:54.395622+0000","last_clean":"2023-10-07T09:03:54.395622+0000","last_became_active":"2023-10-07T09:03:53.370865+0000","last_became_peered":"2023-10-07T09:03:53.370865+0000","last_unstale":"2023-10-07T09:03:54.395622+0000","last_undegraded":"2023-10-07T09:03:54.395622+0000","last_fullsized":"2023-10-07T09:03:54.395622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:51:53.543686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385968+0000","last_change":"2023-10-07T09:03:54.385968+0000","last_active":"2023-10-07T09:03:54.385968+0000","last_peered":"2023-10-07T09:03:54.385968+0000","last_clean":"2023-10-07T09:03:54.385968+0000","last_became_active":"2023-10-07T09:03:54.385729+0000","last_became_peered":"2023-10-07T09:03:54.385729+0000","last_unstale":"2023-10-07T09:03:54.385968+0000","last_undegraded":"2023-10-07T09:03:54.385968+0000","last_fullsized":"2023-10-07T09:03:54.385968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:06.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394595+0000","last_change":"2023-10-07T09:03:53.374108+0000","last_active":"2023-10-07T09:03:54.394595+0000","last_peered":"2023-10-07T09:03:54.394595+0000","last_clean":"2023-10-07T09:03:54.394595+0000","last_became_active":"2023-10-07T09:03:53.373835+0000","last_became_peered":"2023-10-07T09:03:53.373835+0000","last_unstale":"2023-10-07T09:03:54.394595+0000","last_undegraded":"2023-10-07T09:03:54.394595+0000","last_fullsized":"2023-10-07T09:03:54.394595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:56.918044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391681+0000","last_change":"2023-10-07T09:03:54.387426+0000","last_active":"2023-10-07T09:03:54.391681+0000","last_peered":"2023-10-07T09:03:54.391681+0000","last_clean":"2023-10-07T09:03:54.391681+0000","last_became_active":"2023-10-07T09:03:54.387117+0000","last_became_peered":"2023-10-07T09:03:54.387117+0000","last_unstale":"2023-10-07T09:03:54.391681+0000","last_undegraded":"2023-10-07T09:03:54.391681+0000","last_fullsized":"2023-10-07T09:03:54.391681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:02.700693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396080+0000","last_change":"2023-10-07T09:03:53.379260+0000","last_active":"2023-10-07T09:03:54.396080+0000","last_peered":"2023-10-07T09:03:54.396080+0000","last_clean":"2023-10-07T09:03:54.396080+0000","last_became_active":"2023-10-07T09:03:53.378579+0000","last_became_peered":"2023-10-07T09:03:53.378579+0000","last_unstale":"2023-10-07T09:03:54.396080+0000","last_undegraded":"2023-10-07T09:03:54.396080+0000","last_fullsized":"2023-10-07T09:03:54.396080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:55.296040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383555+0000","last_change":"2023-10-07T09:03:54.377349+0000","last_active":"2023-10-07T09:03:54.383555+0000","last_peered":"2023-10-07T09:03:54.383555+0000","last_clean":"2023-10-07T09:03:54.383555+0000","last_became_active":"2023-10-07T09:03:54.376794+0000","last_became_peered":"2023-10-07T09:03:54.376794+0000","last_unstale":"2023-10-07T09:03:54.383555+0000","last_undegraded":"2023-10-07T09:03:54.383555+0000","last_fullsized":"2023-10-07T09:03:54.383555+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:53.505111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394609+0000","last_change":"2023-10-07T09:03:53.375068+0000","last_active":"2023-10-07T09:03:54.394609+0000","last_peered":"2023-10-07T09:03:54.394609+0000","last_clean":"2023-10-07T09:03:54.394609+0000","last_became_active":"2023-10-07T09:03:53.374777+0000","last_became_peered":"2023-10-07T09:03:53.374777+0000","last_unstale":"2023-10-07T09:03:54.394609+0000","last_undegraded":"2023-10-07T09:03:54.394609+0000","last_fullsized":"2023-10-07T09:03:54.394609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:06.557890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396423+0000","last_change":"2023-10-07T09:03:54.393528+0000","last_active":"2023-10-07T09:03:54.396423+0000","last_peered":"2023-10-07T09:03:54.396423+0000","last_clean":"2023-10-07T09:03:54.396423+0000","last_became_active":"2023-10-07T09:03:54.393251+0000","last_became_peered":"2023-10-07T09:03:54.393251+0000","last_unstale":"2023-10-07T09:03:54.396423+0000","last_undegraded":"2023-10-07T09:03:54.396423+0000","last_fullsized":"2023-10-07T09:03:54.396423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:40.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394047+0000","last_change":"2023-10-07T09:03:53.371166+0000","last_active":"2023-10-07T09:03:54.394047+0000","last_peered":"2023-10-07T09:03:54.394047+0000","last_clean":"2023-10-07T09:03:54.394047+0000","last_became_active":"2023-10-07T09:03:53.370857+0000","last_became_peered":"2023-10-07T09:03:53.370857+0000","last_unstale":"2023-10-07T09:03:54.394047+0000","last_undegraded":"2023-10-07T09:03:54.394047+0000","last_fullsized":"2023-10-07T09:03:54.394047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:04.254900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401846+0000","last_change":"2023-10-07T09:03:54.397547+0000","last_active":"2023-10-07T09:03:54.401846+0000","last_peered":"2023-10-07T09:03:54.401846+0000","last_clean":"2023-10-07T09:03:54.401846+0000","last_became_active":"2023-10-07T09:03:54.397286+0000","last_became_peered":"2023-10-07T09:03:54.397286+0000","last_unstale":"2023-10-07T09:03:54.401846+0000","last_undegraded":"2023-10-07T09:03:54.401846+0000","last_fullsized":"2023-10-07T09:03:54.401846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:33:44.789725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.381410+0000","last_change":"2023-10-07T09:03:53.379547+0000","last_active":"2023-10-07T09:03:53.381410+0000","last_peered":"2023-10-07T09:03:53.381410+0000","last_clean":"2023-10-07T09:03:53.381410+0000","last_became_active":"2023-10-07T09:03:53.378656+0000","last_became_peered":"2023-10-07T09:03:53.378656+0000","last_unstale":"2023-10-07T09:03:53.381410+0000","last_undegraded":"2023-10-07T09:03:53.381410+0000","last_fullsized":"2023-10-07T09:03:53.381410+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:46.920351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.387817+0000","last_change":"2023-10-07T09:03:54.387817+0000","last_active":"2023-10-07T09:03:54.387817+0000","last_peered":"2023-10-07T09:03:54.387817+0000","last_clean":"2023-10-07T09:03:54.387817+0000","last_became_active":"2023-10-07T09:03:54.387565+0000","last_became_peered":"2023-10-07T09:03:54.387565+0000","last_unstale":"2023-10-07T09:03:54.387817+0000","last_undegraded":"2023-10-07T09:03:54.387817+0000","last_fullsized":"2023-10-07T09:03:54.387817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:03:56.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374657+0000","last_change":"2023-10-07T09:03:53.377432+0000","last_active":"2023-10-07T09:03:54.374657+0000","last_peered":"2023-10-07T09:03:54.374657+0000","last_clean":"2023-10-07T09:03:54.374657+0000","last_became_active":"2023-10-07T09:03:53.377129+0000","last_became_peered":"2023-10-07T09:03:53.377129+0000","last_unstale":"2023-10-07T09:03:54.374657+0000","last_undegraded":"2023-10-07T09:03:54.374657+0000","last_fullsized":"2023-10-07T09:03:54.374657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:35.571003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.377233+0000","last_change":"2023-10-07T09:03:54.377233+0000","last_active":"2023-10-07T09:03:54.377233+0000","last_peered":"2023-10-07T09:03:54.377233+0000","last_clean":"2023-10-07T09:03:54.377233+0000","last_became_active":"2023-10-07T09:03:54.376980+0000","last_became_peered":"2023-10-07T09:03:54.376980+0000","last_unstale":"2023-10-07T09:03:54.377233+0000","last_undegraded":"2023-10-07T09:03:54.377233+0000","last_fullsized":"2023-10-07T09:03:54.377233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:24:45.952218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379605+0000","last_change":"2023-10-07T09:03:53.377256+0000","last_active":"2023-10-07T09:03:53.379605+0000","last_peered":"2023-10-07T09:03:53.379605+0000","last_clean":"2023-10-07T09:03:53.379605+0000","last_became_active":"2023-10-07T09:03:53.376984+0000","last_became_peered":"2023-10-07T09:03:53.376984+0000","last_unstale":"2023-10-07T09:03:53.379605+0000","last_undegraded":"2023-10-07T09:03:53.379605+0000","last_fullsized":"2023-10-07T09:03:53.379605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:49:41.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381580+0000","last_change":"2023-10-07T09:03:54.376808+0000","last_active":"2023-10-07T09:03:54.381580+0000","last_peered":"2023-10-07T09:03:54.381580+0000","last_clean":"2023-10-07T09:03:54.381580+0000","last_became_active":"2023-10-07T09:03:54.376529+0000","last_became_peered":"2023-10-07T09:03:54.376529+0000","last_unstale":"2023-10-07T09:03:54.381580+0000","last_undegraded":"2023-10-07T09:03:54.381580+0000","last_fullsized":"2023-10-07T09:03:54.381580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:06.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379731+0000","last_change":"2023-10-07T09:03:53.378243+0000","last_active":"2023-10-07T09:03:53.379731+0000","last_peered":"2023-10-07T09:03:53.379731+0000","last_clean":"2023-10-07T09:03:53.379731+0000","last_became_active":"2023-10-07T09:03:53.377949+0000","last_became_peered":"2023-10-07T09:03:53.377949+0000","last_unstale":"2023-10-07T09:03:53.379731+0000","last_undegraded":"2023-10-07T09:03:53.379731+0000","last_fullsized":"2023-10-07T09:03:53.379731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:01.241179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396318+0000","last_change":"2023-10-07T09:03:54.396318+0000","last_active":"2023-10-07T09:03:54.396318+0000","last_peered":"2023-10-07T09:03:54.396318+0000","last_clean":"2023-10-07T09:03:54.396318+0000","last_became_active":"2023-10-07T09:03:54.396072+0000","last_became_peered":"2023-10-07T09:03:54.396072+0000","last_unstale":"2023-10-07T09:03:54.396318+0000","last_undegraded":"2023-10-07T09:03:54.396318+0000","last_fullsized":"2023-10-07T09:03:54.396318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:55.969183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395538+0000","last_change":"2023-10-07T09:03:53.379189+0000","last_active":"2023-10-07T09:03:54.395538+0000","last_peered":"2023-10-07T09:03:54.395538+0000","last_clean":"2023-10-07T09:03:54.395538+0000","last_became_active":"2023-10-07T09:03:53.378962+0000","last_became_peered":"2023-10-07T09:03:53.378962+0000","last_unstale":"2023-10-07T09:03:54.395538+0000","last_undegraded":"2023-10-07T09:03:54.395538+0000","last_fullsized":"2023-10-07T09:03:54.395538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:50:32.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392183+0000","last_change":"2023-10-07T09:03:54.385605+0000","last_active":"2023-10-07T09:03:54.392183+0000","last_peered":"2023-10-07T09:03:54.392183+0000","last_clean":"2023-10-07T09:03:54.392183+0000","last_became_active":"2023-10-07T09:03:54.385239+0000","last_became_peered":"2023-10-07T09:03:54.385239+0000","last_unstale":"2023-10-07T09:03:54.392183+0000","last_undegraded":"2023-10-07T09:03:54.392183+0000","last_fullsized":"2023-10-07T09:03:54.392183+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:59.405752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.403089+0000","last_change":"2023-10-07T09:03:53.377500+0000","last_active":"2023-10-07T09:03:54.403089+0000","last_peered":"2023-10-07T09:03:54.403089+0000","last_clean":"2023-10-07T09:03:54.403089+0000","last_became_active":"2023-10-07T09:03:53.377112+0000","last_became_peered":"2023-10-07T09:03:53.377112+0000","last_unstale":"2023-10-07T09:03:54.403089+0000","last_undegraded":"2023-10-07T09:03:54.403089+0000","last_fullsized":"2023-10-07T09:03:54.403089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:27:35.095544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.393796+0000","last_change":"2023-10-07T09:03:54.393796+0000","last_active":"2023-10-07T09:03:54.393796+0000","last_peered":"2023-10-07T09:03:54.393796+0000","last_clean":"2023-10-07T09:03:54.393796+0000","last_became_active":"2023-10-07T09:03:54.393497+0000","last_became_peered":"2023-10-07T09:03:54.393497+0000","last_unstale":"2023-10-07T09:03:54.393796+0000","last_undegraded":"2023-10-07T09:03:54.393796+0000","last_fullsized":"2023-10-07T09:03:54.393796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:02.700693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397277+0000","last_change":"2023-10-07T09:03:53.377373+0000","last_active":"2023-10-07T09:03:54.397277+0000","last_peered":"2023-10-07T09:03:54.397277+0000","last_clean":"2023-10-07T09:03:54.397277+0000","last_became_active":"2023-10-07T09:03:53.376891+0000","last_became_peered":"2023-10-07T09:03:53.376891+0000","last_unstale":"2023-10-07T09:03:54.397277+0000","last_undegraded":"2023-10-07T09:03:54.397277+0000","last_fullsized":"2023-10-07T09:03:54.397277+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:06.557890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401507+0000","last_change":"2023-10-07T09:03:54.394829+0000","last_active":"2023-10-07T09:03:54.401507+0000","last_peered":"2023-10-07T09:03:54.401507+0000","last_clean":"2023-10-07T09:03:54.401507+0000","last_became_active":"2023-10-07T09:03:54.394513+0000","last_became_peered":"2023-10-07T09:03:54.394513+0000","last_unstale":"2023-10-07T09:03:54.401507+0000","last_undegraded":"2023-10-07T09:03:54.401507+0000","last_fullsized":"2023-10-07T09:03:54.401507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:41.955476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.381357+0000","last_change":"2023-10-07T09:03:53.375883+0000","last_active":"2023-10-07T09:03:53.381357+0000","last_peered":"2023-10-07T09:03:53.381357+0000","last_clean":"2023-10-07T09:03:53.381357+0000","last_became_active":"2023-10-07T09:03:53.375189+0000","last_became_peered":"2023-10-07T09:03:53.375189+0000","last_unstale":"2023-10-07T09:03:53.381357+0000","last_undegraded":"2023-10-07T09:03:53.381357+0000","last_fullsized":"2023-10-07T09:03:53.381357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:33:43.783404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383803+0000","last_change":"2023-10-07T09:03:54.379982+0000","last_active":"2023-10-07T09:03:54.383803+0000","last_peered":"2023-10-07T09:03:54.383803+0000","last_clean":"2023-10-07T09:03:54.383803+0000","last_became_active":"2023-10-07T09:03:54.379586+0000","last_became_peered":"2023-10-07T09:03:54.379586+0000","last_unstale":"2023-10-07T09:03:54.383803+0000","last_undegraded":"2023-10-07T09:03:54.383803+0000","last_fullsized":"2023-10-07T09:03:54.383803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:53.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.372736+0000","last_change":"2023-10-07T09:03:53.380308+0000","last_active":"2023-10-07T09:03:54.372736+0000","last_peered":"2023-10-07T09:03:54.372736+0000","last_clean":"2023-10-07T09:03:54.372736+0000","last_became_active":"2023-10-07T09:03:53.379992+0000","last_became_peered":"2023-10-07T09:03:53.379992+0000","last_unstale":"2023-10-07T09:03:54.372736+0000","last_undegraded":"2023-10-07T09:03:54.372736+0000","last_fullsized":"2023-10-07T09:03:54.372736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:27.717502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.393062+0000","last_change":"2023-10-07T09:03:54.388731+0000","last_active":"2023-10-07T09:03:54.393062+0000","last_peered":"2023-10-07T09:03:54.393062+0000","last_clean":"2023-10-07T09:03:54.393062+0000","last_became_active":"2023-10-07T09:03:54.388461+0000","last_became_peered":"2023-10-07T09:03:54.388461+0000","last_unstale":"2023-10-07T09:03:54.393062+0000","last_undegraded":"2023-10-07T09:03:54.393062+0000","last_fullsized":"2023-10-07T09:03:54.393062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:28.723823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401718+0000","last_change":"2023-10-07T09:03:53.377542+0000","last_active":"2023-10-07T09:03:54.401718+0000","last_peered":"2023-10-07T09:03:54.401718+0000","last_clean":"2023-10-07T09:03:54.401718+0000","last_became_active":"2023-10-07T09:03:53.377270+0000","last_became_peered":"2023-10-07T09:03:53.377270+0000","last_unstale":"2023-10-07T09:03:54.401718+0000","last_undegraded":"2023-10-07T09:03:54.401718+0000","last_fullsized":"2023-10-07T09:03:54.401718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:29.728400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391304+0000","last_change":"2023-10-07T09:03:54.389692+0000","last_active":"2023-10-07T09:03:54.391304+0000","last_peered":"2023-10-07T09:03:54.391304+0000","last_clean":"2023-10-07T09:03:54.391304+0000","last_became_active":"2023-10-07T09:03:54.389421+0000","last_became_peered":"2023-10-07T09:03:54.389421+0000","last_unstale":"2023-10-07T09:03:54.391304+0000","last_undegraded":"2023-10-07T09:03:54.391304+0000","last_fullsized":"2023-10-07T09:03:54.391304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:29.982610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381726+0000","last_change":"2023-10-07T09:03:53.378650+0000","last_active":"2023-10-07T09:03:54.381726+0000","last_peered":"2023-10-07T09:03:54.381726+0000","last_clean":"2023-10-07T09:03:54.381726+0000","last_became_active":"2023-10-07T09:03:53.377819+0000","last_became_peered":"2023-10-07T09:03:53.377819+0000","last_unstale":"2023-10-07T09:03:54.381726+0000","last_undegraded":"2023-10-07T09:03:54.381726+0000","last_fullsized":"2023-10-07T09:03:54.381726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:53:48.716351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397451+0000","last_change":"2023-10-07T09:03:54.397451+0000","last_active":"2023-10-07T09:03:54.397451+0000","last_peered":"2023-10-07T09:03:54.397451+0000","last_clean":"2023-10-07T09:03:54.397451+0000","last_became_active":"2023-10-07T09:03:54.397163+0000","last_became_peered":"2023-10-07T09:03:54.397163+0000","last_unstale":"2023-10-07T09:03:54.397451+0000","last_undegraded":"2023-10-07T09:03:54.397451+0000","last_fullsized":"2023-10-07T09:03:54.397451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:49.266603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395763+0000","last_change":"2023-10-07T09:03:53.376923+0000","last_active":"2023-10-07T09:03:54.395763+0000","last_peered":"2023-10-07T09:03:54.395763+0000","last_clean":"2023-10-07T09:03:54.395763+0000","last_became_active":"2023-10-07T09:03:53.376629+0000","last_became_peered":"2023-10-07T09:03:53.376629+0000","last_unstale":"2023-10-07T09:03:54.395763+0000","last_undegraded":"2023-10-07T09:03:54.395763+0000","last_fullsized":"2023-10-07T09:03:54.395763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:12.075858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396355+0000","last_change":"2023-10-07T09:03:54.391750+0000","last_active":"2023-10-07T09:03:54.396355+0000","last_peered":"2023-10-07T09:03:54.396355+0000","last_clean":"2023-10-07T09:03:54.396355+0000","last_became_active":"2023-10-07T09:03:54.391451+0000","last_became_peered":"2023-10-07T09:03:54.391451+0000","last_unstale":"2023-10-07T09:03:54.396355+0000","last_undegraded":"2023-10-07T09:03:54.396355+0000","last_fullsized":"2023-10-07T09:03:54.396355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:16.512068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380987+0000","last_change":"2023-10-07T09:03:53.379341+0000","last_active":"2023-10-07T09:03:53.380987+0000","last_peered":"2023-10-07T09:03:53.380987+0000","last_clean":"2023-10-07T09:03:53.380987+0000","last_became_active":"2023-10-07T09:03:53.378973+0000","last_became_peered":"2023-10-07T09:03:53.378973+0000","last_unstale":"2023-10-07T09:03:53.380987+0000","last_undegraded":"2023-10-07T09:03:53.380987+0000","last_fullsized":"2023-10-07T09:03:53.380987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:48.260281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385240+0000","last_change":"2023-10-07T09:03:54.385240+0000","last_active":"2023-10-07T09:03:54.385240+0000","last_peered":"2023-10-07T09:03:54.385240+0000","last_clean":"2023-10-07T09:03:54.385240+0000","last_became_active":"2023-10-07T09:03:54.384595+0000","last_became_peered":"2023-10-07T09:03:54.384595+0000","last_unstale":"2023-10-07T09:03:54.385240+0000","last_undegraded":"2023-10-07T09:03:54.385240+0000","last_fullsized":"2023-10-07T09:03:54.385240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:41:07.033570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392643+0000","last_change":"2023-10-07T09:03:53.374654+0000","last_active":"2023-10-07T09:03:54.392643+0000","last_peered":"2023-10-07T09:03:54.392643+0000","last_clean":"2023-10-07T09:03:54.392643+0000","last_became_active":"2023-10-07T09:03:53.374366+0000","last_became_peered":"2023-10-07T09:03:53.374366+0000","last_unstale":"2023-10-07T09:03:54.392643+0000","last_undegraded":"2023-10-07T09:03:54.392643+0000","last_fullsized":"2023-10-07T09:03:54.392643+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:28.976289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386306+0000","last_change":"2023-10-07T09:03:54.379346+0000","last_active":"2023-10-07T09:03:54.386306+0000","last_peered":"2023-10-07T09:03:54.386306+0000","last_clean":"2023-10-07T09:03:54.386306+0000","last_became_active":"2023-10-07T09:03:54.379022+0000","last_became_peered":"2023-10-07T09:03:54.379022+0000","last_unstale":"2023-10-07T09:03:54.386306+0000","last_undegraded":"2023-10-07T09:03:54.386306+0000","last_fullsized":"2023-10-07T09:03:54.386306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:57.924366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.378204+0000","last_change":"2023-10-07T09:03:53.374580+0000","last_active":"2023-10-07T09:03:53.378204+0000","last_peered":"2023-10-07T09:03:53.378204+0000","last_clean":"2023-10-07T09:03:53.378204+0000","last_became_active":"2023-10-07T09:03:53.374295+0000","last_became_peered":"2023-10-07T09:03:53.374295+0000","last_unstale":"2023-10-07T09:03:53.378204+0000","last_undegraded":"2023-10-07T09:03:53.378204+0000","last_fullsized":"2023-10-07T09:03:53.378204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:47.094307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374776+0000","last_change":"2023-10-07T09:03:54.374776+0000","last_active":"2023-10-07T09:03:54.374776+0000","last_peered":"2023-10-07T09:03:54.374776+0000","last_clean":"2023-10-07T09:03:54.374776+0000","last_became_active":"2023-10-07T09:03:54.374494+0000","last_became_peered":"2023-10-07T09:03:54.374494+0000","last_unstale":"2023-10-07T09:03:54.374776+0000","last_undegraded":"2023-10-07T09:03:54.374776+0000","last_fullsized":"2023-10-07T09:03:54.374776+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:36.577324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379545+0000","last_change":"2023-10-07T09:03:53.376382+0000","last_active":"2023-10-07T09:03:53.379545+0000","last_peered":"2023-10-07T09:03:53.379545+0000","last_clean":"2023-10-07T09:03:53.379545+0000","last_became_active":"2023-10-07T09:03:53.376176+0000","last_became_peered":"2023-10-07T09:03:53.376176+0000","last_unstale":"2023-10-07T09:03:53.379545+0000","last_undegraded":"2023-10-07T09:03:53.379545+0000","last_fullsized":"2023-10-07T09:03:53.379545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:03:00.875723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.388209+0000","last_change":"2023-10-07T09:03:54.384179+0000","last_active":"2023-10-07T09:03:54.388209+0000","last_peered":"2023-10-07T09:03:54.388209+0000","last_clean":"2023-10-07T09:03:54.388209+0000","last_became_active":"2023-10-07T09:03:54.383908+0000","last_became_peered":"2023-10-07T09:03:54.383908+0000","last_unstale":"2023-10-07T09:03:54.388209+0000","last_undegraded":"2023-10-07T09:03:54.388209+0000","last_fullsized":"2023-10-07T09:03:54.388209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:31.927565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.378649+0000","last_change":"2023-10-07T09:03:53.374166+0000","last_active":"2023-10-07T09:03:53.378649+0000","last_peered":"2023-10-07T09:03:53.378649+0000","last_clean":"2023-10-07T09:03:53.378649+0000","last_became_active":"2023-10-07T09:03:53.373894+0000","last_became_peered":"2023-10-07T09:03:53.373894+0000","last_unstale":"2023-10-07T09:03:53.378649+0000","last_undegraded":"2023-10-07T09:03:53.378649+0000","last_fullsized":"2023-10-07T09:03:53.378649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:40.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397004+0000","last_change":"2023-10-07T09:03:54.395260+0000","last_active":"2023-10-07T09:03:54.397004+0000","last_peered":"2023-10-07T09:03:54.397004+0000","last_clean":"2023-10-07T09:03:54.397004+0000","last_became_active":"2023-10-07T09:03:54.392887+0000","last_became_peered":"2023-10-07T09:03:54.392887+0000","last_unstale":"2023-10-07T09:03:54.397004+0000","last_undegraded":"2023-10-07T09:03:54.397004+0000","last_fullsized":"2023-10-07T09:03:54.397004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:13.082179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401810+0000","last_change":"2023-10-07T09:03:53.378791+0000","last_active":"2023-10-07T09:03:54.401810+0000","last_peered":"2023-10-07T09:03:54.401810+0000","last_clean":"2023-10-07T09:03:54.401810+0000","last_became_active":"2023-10-07T09:03:53.377449+0000","last_became_peered":"2023-10-07T09:03:53.377449+0000","last_unstale":"2023-10-07T09:03:54.401810+0000","last_undegraded":"2023-10-07T09:03:54.401810+0000","last_fullsized":"2023-10-07T09:03:54.401810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:46.801535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401868+0000","last_change":"2023-10-07T09:03:54.397522+0000","last_active":"2023-10-07T09:03:54.401868+0000","last_peered":"2023-10-07T09:03:54.401868+0000","last_clean":"2023-10-07T09:03:54.401868+0000","last_became_active":"2023-10-07T09:03:54.397318+0000","last_became_peered":"2023-10-07T09:03:54.397318+0000","last_unstale":"2023-10-07T09:03:54.401868+0000","last_undegraded":"2023-10-07T09:03:54.401868+0000","last_fullsized":"2023-10-07T09:03:54.401868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:41.819178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374679+0000","last_change":"2023-10-07T09:03:53.375406+0000","last_active":"2023-10-07T09:03:54.374679+0000","last_peered":"2023-10-07T09:03:54.374679+0000","last_clean":"2023-10-07T09:03:54.374679+0000","last_became_active":"2023-10-07T09:03:53.375138+0000","last_became_peered":"2023-10-07T09:03:53.375138+0000","last_unstale":"2023-10-07T09:03:54.374679+0000","last_undegraded":"2023-10-07T09:03:54.374679+0000","last_fullsized":"2023-10-07T09:03:54.374679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:35.158870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.388728+0000","last_change":"2023-10-07T09:03:54.388728+0000","last_active":"2023-10-07T09:03:54.388728+0000","last_peered":"2023-10-07T09:03:54.388728+0000","last_clean":"2023-10-07T09:03:54.388728+0000","last_became_active":"2023-10-07T09:03:54.388208+0000","last_became_peered":"2023-10-07T09:03:54.388208+0000","last_unstale":"2023-10-07T09:03:54.388728+0000","last_undegraded":"2023-10-07T09:03:54.388728+0000","last_fullsized":"2023-10-07T09:03:54.388728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:47.926672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380728+0000","last_change":"2023-10-07T09:03:53.378418+0000","last_active":"2023-10-07T09:03:53.380728+0000","last_peered":"2023-10-07T09:03:53.380728+0000","last_clean":"2023-10-07T09:03:53.380728+0000","last_became_active":"2023-10-07T09:03:53.378135+0000","last_became_peered":"2023-10-07T09:03:53.378135+0000","last_unstale":"2023-10-07T09:03:53.380728+0000","last_undegraded":"2023-10-07T09:03:53.380728+0000","last_fullsized":"2023-10-07T09:03:53.380728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:54.322902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392132+0000","last_change":"2023-10-07T09:03:54.384923+0000","last_active":"2023-10-07T09:03:54.392132+0000","last_peered":"2023-10-07T09:03:54.392132+0000","last_clean":"2023-10-07T09:03:54.392132+0000","last_became_active":"2023-10-07T09:03:54.384568+0000","last_became_peered":"2023-10-07T09:03:54.384568+0000","last_unstale":"2023-10-07T09:03:54.392132+0000","last_undegraded":"2023-10-07T09:03:54.392132+0000","last_fullsized":"2023-10-07T09:03:54.392132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:43.717297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379234+0000","last_change":"2023-10-07T09:03:53.376580+0000","last_active":"2023-10-07T09:03:53.379234+0000","last_peered":"2023-10-07T09:03:53.379234+0000","last_clean":"2023-10-07T09:03:53.379234+0000","last_became_active":"2023-10-07T09:03:53.376340+0000","last_became_peered":"2023-10-07T09:03:53.376340+0000","last_unstale":"2023-10-07T09:03:53.379234+0000","last_undegraded":"2023-10-07T09:03:53.379234+0000","last_fullsized":"2023-10-07T09:03:53.379234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:04.254900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386169+0000","last_change":"2023-10-07T09:03:54.379002+0000","last_active":"2023-10-07T09:03:54.386169+0000","last_peered":"2023-10-07T09:03:54.386169+0000","last_clean":"2023-10-07T09:03:54.386169+0000","last_became_active":"2023-10-07T09:03:54.378739+0000","last_became_peered":"2023-10-07T09:03:54.378739+0000","last_unstale":"2023-10-07T09:03:54.386169+0000","last_undegraded":"2023-10-07T09:03:54.386169+0000","last_fullsized":"2023-10-07T09:03:54.386169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:56.302361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380647+0000","last_change":"2023-10-07T09:03:53.377537+0000","last_active":"2023-10-07T09:03:53.380647+0000","last_peered":"2023-10-07T09:03:53.380647+0000","last_clean":"2023-10-07T09:03:53.380647+0000","last_became_active":"2023-10-07T09:03:53.377242+0000","last_became_peered":"2023-10-07T09:03:53.377242+0000","last_unstale":"2023-10-07T09:03:53.380647+0000","last_undegraded":"2023-10-07T09:03:53.380647+0000","last_fullsized":"2023-10-07T09:03:53.380647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:42.710975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394399+0000","last_change":"2023-10-07T09:03:54.394399+0000","last_active":"2023-10-07T09:03:54.394399+0000","last_peered":"2023-10-07T09:03:54.394399+0000","last_clean":"2023-10-07T09:03:54.394399+0000","last_became_active":"2023-10-07T09:03:54.394088+0000","last_became_peered":"2023-10-07T09:03:54.394088+0000","last_unstale":"2023-10-07T09:03:54.394399+0000","last_undegraded":"2023-10-07T09:03:54.394399+0000","last_fullsized":"2023-10-07T09:03:54.394399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:08.786784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.375688+0000","last_change":"2023-10-07T09:03:53.371015+0000","last_active":"2023-10-07T09:03:54.375688+0000","last_peered":"2023-10-07T09:03:54.375688+0000","last_clean":"2023-10-07T09:03:54.375688+0000","last_became_active":"2023-10-07T09:03:53.370658+0000","last_became_peered":"2023-10-07T09:03:53.370658+0000","last_unstale":"2023-10-07T09:03:54.375688+0000","last_undegraded":"2023-10-07T09:03:54.375688+0000","last_fullsized":"2023-10-07T09:03:54.375688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:01.241179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392479+0000","last_change":"2023-10-07T09:03:54.387987+0000","last_active":"2023-10-07T09:03:54.392479+0000","last_peered":"2023-10-07T09:03:54.392479+0000","last_clean":"2023-10-07T09:03:54.392479+0000","last_became_active":"2023-10-07T09:03:54.387719+0000","last_became_peered":"2023-10-07T09:03:54.387719+0000","last_unstale":"2023-10-07T09:03:54.392479+0000","last_undegraded":"2023-10-07T09:03:54.392479+0000","last_fullsized":"2023-10-07T09:03:54.392479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:55.969183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379563+0000","last_change":"2023-10-07T09:03:53.376731+0000","last_active":"2023-10-07T09:03:53.379563+0000","last_peered":"2023-10-07T09:03:53.379563+0000","last_clean":"2023-10-07T09:03:53.379563+0000","last_became_active":"2023-10-07T09:03:53.376451+0000","last_became_peered":"2023-10-07T09:03:53.376451+0000","last_unstale":"2023-10-07T09:03:53.379563+0000","last_undegraded":"2023-10-07T09:03:53.379563+0000","last_fullsized":"2023-10-07T09:03:53.379563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:53.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386089+0000","last_change":"2023-10-07T09:03:54.386089+0000","last_active":"2023-10-07T09:03:54.386089+0000","last_peered":"2023-10-07T09:03:54.386089+0000","last_clean":"2023-10-07T09:03:54.386089+0000","last_became_active":"2023-10-07T09:03:54.384687+0000","last_became_peered":"2023-10-07T09:03:54.384687+0000","last_unstale":"2023-10-07T09:03:54.386089+0000","last_undegraded":"2023-10-07T09:03:54.386089+0000","last_fullsized":"2023-10-07T09:03:54.386089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.378809+0000","last_change":"2023-10-07T09:03:53.373943+0000","last_active":"2023-10-07T09:03:54.378809+0000","last_peered":"2023-10-07T09:03:54.378809+0000","last_clean":"2023-10-07T09:03:54.378809+0000","last_became_active":"2023-10-07T09:03:53.373685+0000","last_became_peered":"2023-10-07T09:03:53.373685+0000","last_unstale":"2023-10-07T09:03:54.378809+0000","last_undegraded":"2023-10-07T09:03:54.378809+0000","last_fullsized":"2023-10-07T09:03:54.378809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:21.069225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383877+0000","last_change":"2023-10-07T09:03:54.383039+0000","last_active":"2023-10-07T09:03:54.383877+0000","last_peered":"2023-10-07T09:03:54.383877+0000","last_clean":"2023-10-07T09:03:54.383877+0000","last_became_active":"2023-10-07T09:03:54.382786+0000","last_became_peered":"2023-10-07T09:03:54.382786+0000","last_unstale":"2023-10-07T09:03:54.383877+0000","last_undegraded":"2023-10-07T09:03:54.383877+0000","last_fullsized":"2023-10-07T09:03:54.383877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:20.639059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396757+0000","last_change":"2023-10-07T09:03:53.377118+0000","last_active":"2023-10-07T09:03:54.396757+0000","last_peered":"2023-10-07T09:03:54.396757+0000","last_clean":"2023-10-07T09:03:54.396757+0000","last_became_active":"2023-10-07T09:03:53.376810+0000","last_became_peered":"2023-10-07T09:03:53.376810+0000","last_unstale":"2023-10-07T09:03:54.396757+0000","last_undegraded":"2023-10-07T09:03:54.396757+0000","last_fullsized":"2023-10-07T09:03:54.396757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:46.920351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.382342+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:03:54.382342+0000","last_peered":"2023-10-07T09:03:54.382342+0000","last_clean":"2023-10-07T09:03:54.382342+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:03:54.382342+0000","last_undegraded":"2023-10-07T09:03:54.382342+0000","last_fullsized":"2023-10-07T09:03:54.382342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298796,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073044,"statfs":{"total":96636764160,"available":96330797056,"internally_reserved":0,"allocated":1544192,"data_stored":995021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.627}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":405249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.84899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":411065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47099999999999997,"5min":0.63,"15min":0.63},"last":0.437},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35199999999999998,"15min":0.41399999999999998},"min":{"1min":0.223,"5min":0.221,"15min":0.221},"max":{"1min":0.49299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.39700000000000002},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.496,"15min":0.82799999999999996},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":11.32,"15min":11.32},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.504,"15min":0.85499999999999998},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.82699999999999996},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90000000000000002,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.84699999999999998},"min":{"1min":0.504,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89500000000000002,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.48599999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64600000000000002,"15min":0.77700000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":994985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.191,"15min":0.191},"max":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.317}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36299999999999999,"15min":0.38800000000000001},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53400000000000003,"5min":0.625,"15min":0.625},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.22,"15min":0.22},"max":{"1min":0.48099999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.437}]},{"osd":4,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.625},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76600000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.754,"5min":1,"15min":1},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":1.006,"15min":1.006},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61599999999999999,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.748,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":405137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.41199999999999998,"15min":0.64900000000000002},"min":{"1min":0.23100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47999999999999998,"5min":10.214,"15min":10.214},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.53600000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.755,"15min":0.755},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.47699999999999998,"15min":0.70799999999999996},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":10.144,"15min":10.144},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.496,"15min":0.77100000000000002},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59199999999999997,"5min":10.071,"15min":10.071},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.51600000000000001,"15min":0.78500000000000003},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":10.183,"15min":10.183},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.76500000000000001,"15min":1.2450000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78800000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.498}]},{"osd":6,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.441},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.81499999999999995,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.745,"5min":1.125,"15min":1.125},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":406119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.371}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.25},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.39500000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.46000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":404583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59699999999999998,"15min":0.88300000000000001},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72299999999999998,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.60099999999999998,"15min":0.75700000000000001},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73199999999999998,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.64800000000000002,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.93899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.67500000000000004,"15min":0.97299999999999998},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":10.01,"15min":10.01},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58199999999999996,"15min":0.75},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":5.569,"15min":5.569},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65000000000000002,"15min":0.93799999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66700000000000004,"5min":10.131,"15min":10.131},"last":0.502}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48399999999999999,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64200000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":412429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.32000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.47999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.46800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":0.879},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.433}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.503},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.47599999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.626},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:03:58.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:03:58.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.643+0000 7fb831eb4700 1 Processor -- start 2023-10-07T09:03:58.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.643+0000 7fb831eb4700 1 -- start start 2023-10-07T09:03:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb831eb4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb82c159c60 0x7fb82c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb831eb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb82c15db10 0x7fb82c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb831eb4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c15a160 con 0x7fb82c159890 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb831eb4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c15df50 con 0x7fb82c159c60 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb831eb4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0d13a0 con 0x7fb82c15db10 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb82c159c60 0x7fb82c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb82c159c60 0x7fb82c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36270/0 (socket says 172.21.15.46:36270) 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 -- 172.21.15.46:0/1162468956 learned_addr learned my addr 172.21.15.46:0/1162468956 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82bfff700 1 --2- 172.21.15.46:0/1162468956 >> v2:172.21.15.133:3300/0 conn(0x7fb82c15db10 0x7fb82c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 -- 172.21.15.46:0/1162468956 >> v2:172.21.15.133:3300/0 conn(0x7fb82c15db10 msgr2=0x7fb82c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 --2- 172.21.15.46:0/1162468956 >> v2:172.21.15.133:3300/0 conn(0x7fb82c15db10 0x7fb82c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 -- 172.21.15.46:0/1162468956 >> v1:172.21.15.133:6789/0 conn(0x7fb82c159890 legacy=0x7fb82c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.644+0000 7fb82affd700 1 -- 172.21.15.46:0/1162468956 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c15e140 con 0x7fb82c159c60 2023-10-07T09:03:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb82affd700 1 --2- 172.21.15.46:0/1162468956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c15d5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06a890 tx=0x7fb820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7dd9334c8986a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb82a7fc700 1 -- 172.21.15.46:0/1162468956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820009e70 con 0x7fb82c159c60 2023-10-07T09:03:58.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb82a7fc700 1 -- 172.21.15.46:0/1162468956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82000b860 con 0x7fb82c159c60 2023-10-07T09:03:58.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb82a7fc700 1 -- 172.21.15.46:0/1162468956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82000bc00 con 0x7fb82c159c60 2023-10-07T09:03:58.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 -- 172.21.15.46:0/1162468956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 msgr2=0x7fb82c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1162468956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c15d5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06a890 tx=0x7fb820009250 comp rx=0 tx=0).stop 2023-10-07T09:03:58.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 -- 172.21.15.46:0/1162468956 shutdown_connections 2023-10-07T09:03:58.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1162468956 >> v2:172.21.15.133:3300/0 conn(0x7fb82c15db10 0x7fb82c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1162468956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c15d5d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 -- 172.21.15.46:0/1162468956 >> 172.21.15.46:0/1162468956 conn(0x7fb82c068e20 msgr2=0x7fb82c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 -- 172.21.15.46:0/1162468956 shutdown_connections 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.645+0000 7fb831eb4700 1 -- 172.21.15.46:0/1162468956 wait complete. 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 Processor -- start 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 -- start start 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb82c159890 0x7fb82c0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c15db10 0x7fb82c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0ca970 con 0x7fb82c159c60 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0c9df0 con 0x7fb82c15db10 2023-10-07T09:03:58.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb831eb4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0ca0d0 con 0x7fb82c159890 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb82affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb82affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36284/0 (socket says 172.21.15.46:36284) 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.647+0000 7fb82affd700 1 -- 172.21.15.46:0/1087640290 learned_addr learned my addr 172.21.15.46:0/1087640290 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82bfff700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c15db10 0x7fb82c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82b7fe700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb82c159890 0x7fb82c0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 -- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb82c159890 msgr2=0x7fb82c0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb82c159890 0x7fb82c0c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 -- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c15db10 msgr2=0x7fb82c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c15db10 0x7fb82c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 -- 172.21.15.46:0/1087640290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200094f0 con 0x7fb82c159c60 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb82affd700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb82c070e20 tx=0x7fb820017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011420 con 0x7fb82c159c60 2023-10-07T09:03:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8200115a0 con 0x7fb82c159c60 2023-10-07T09:03:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011960 con 0x7fb82c159c60 2023-10-07T09:03:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0ca3b0 con 0x7fb82c159c60 2023-10-07T09:03:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.648+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0c9a50 con 0x7fb82c159c60 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.649+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c04c3c0 con 0x7fb82c159c60 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.649+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb820011d10 con 0x7fb82c159c60 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.650+0000 7fb8137fe700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 0x7fb818069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.650+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb820085ea0 con 0x7fb82c159c60 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.650+0000 7fb82b7fe700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 0x7fb818069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.651+0000 7fb82b7fe700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 0x7fb818069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb81c003860 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.654+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb820052ec0 con 0x7fb82c159c60 2023-10-07T09:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.844+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb82c0b2c50 con 0x7fb818067170 2023-10-07T09:03:58.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.852+0000 7fb8137fe700 1 -- 172.21.15.46:0/1087640290 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289311 (secure 0 0 0) 0x7fb82c0b2c50 con 0x7fb818067170 2023-10-07T09:03:58.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 msgr2=0x7fb818069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 0x7fb818069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb81c003860 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 msgr2=0x7fb82c140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb82c070e20 tx=0x7fb820017000 comp rx=0 tx=0).stop 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 shutdown_connections 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb818067170 0x7fb818069620 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c15db10 0x7fb82c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb82c159890 0x7fb82c0c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 --2- 172.21.15.46:0/1087640290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb82c159c60 0x7fb82c140b90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 >> 172.21.15.46:0/1087640290 conn(0x7fb82c068e20 msgr2=0x7fb82c1530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 shutdown_connections 2023-10-07T09:03:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:58.855+0000 7fb831eb4700 1 -- 172.21.15.46:0/1087640290 wait complete. 2023-10-07T09:03:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:03:58.868 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2023-10-07T09:03:57.841171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403328,"kb_used_data":8640,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571392,"statfs":{"total":773094113280,"available":770633105408,"internally_reserved":0,"allocated":8847360,"data_stored":4434588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.483149"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397224+0000","last_change":"2023-10-07T09:03:54.397224+0000","last_active":"2023-10-07T09:03:54.397224+0000","last_peered":"2023-10-07T09:03:54.397224+0000","last_clean":"2023-10-07T09:03:54.397224+0000","last_became_active":"2023-10-07T09:03:54.396784+0000","last_became_peered":"2023-10-07T09:03:54.396784+0000","last_unstale":"2023-10-07T09:03:54.397224+0000","last_undegraded":"2023-10-07T09:03:54.397224+0000","last_fullsized":"2023-10-07T09:03:54.397224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:31.927565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394463+0000","last_change":"2023-10-07T09:03:54.393894+0000","last_active":"2023-10-07T09:03:54.394463+0000","last_peered":"2023-10-07T09:03:54.394463+0000","last_clean":"2023-10-07T09:03:54.394463+0000","last_became_active":"2023-10-07T09:03:54.393634+0000","last_became_peered":"2023-10-07T09:03:54.393634+0000","last_unstale":"2023-10-07T09:03:54.394463+0000","last_undegraded":"2023-10-07T09:03:54.394463+0000","last_fullsized":"2023-10-07T09:03:54.394463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:16.512068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401760+0000","last_change":"2023-10-07T09:03:54.397244+0000","last_active":"2023-10-07T09:03:54.401760+0000","last_peered":"2023-10-07T09:03:54.401760+0000","last_clean":"2023-10-07T09:03:54.401760+0000","last_became_active":"2023-10-07T09:03:54.396709+0000","last_became_peered":"2023-10-07T09:03:54.396709+0000","last_unstale":"2023-10-07T09:03:54.401760+0000","last_undegraded":"2023-10-07T09:03:54.401760+0000","last_fullsized":"2023-10-07T09:03:54.401760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:44.641777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.384498+0000","last_change":"2023-10-07T09:03:54.384498+0000","last_active":"2023-10-07T09:03:54.384498+0000","last_peered":"2023-10-07T09:03:54.384498+0000","last_clean":"2023-10-07T09:03:54.384498+0000","last_became_active":"2023-10-07T09:03:54.384138+0000","last_became_peered":"2023-10-07T09:03:54.384138+0000","last_unstale":"2023-10-07T09:03:54.384498+0000","last_undegraded":"2023-10-07T09:03:54.384498+0000","last_fullsized":"2023-10-07T09:03:54.384498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:47:02.875058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397323+0000","last_change":"2023-10-07T09:03:54.393691+0000","last_active":"2023-10-07T09:03:54.397323+0000","last_peered":"2023-10-07T09:03:54.397323+0000","last_clean":"2023-10-07T09:03:54.397323+0000","last_became_active":"2023-10-07T09:03:54.392863+0000","last_became_peered":"2023-10-07T09:03:54.392863+0000","last_unstale":"2023-10-07T09:03:54.397323+0000","last_undegraded":"2023-10-07T09:03:54.397323+0000","last_fullsized":"2023-10-07T09:03:54.397323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381666+0000","last_change":"2023-10-07T09:03:54.377321+0000","last_active":"2023-10-07T09:03:54.381666+0000","last_peered":"2023-10-07T09:03:54.381666+0000","last_clean":"2023-10-07T09:03:54.381666+0000","last_became_active":"2023-10-07T09:03:54.377071+0000","last_became_peered":"2023-10-07T09:03:54.377071+0000","last_unstale":"2023-10-07T09:03:54.381666+0000","last_undegraded":"2023-10-07T09:03:54.381666+0000","last_fullsized":"2023-10-07T09:03:54.381666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:43.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392318+0000","last_change":"2023-10-07T09:03:54.392318+0000","last_active":"2023-10-07T09:03:54.392318+0000","last_peered":"2023-10-07T09:03:54.392318+0000","last_clean":"2023-10-07T09:03:54.392318+0000","last_became_active":"2023-10-07T09:03:54.392060+0000","last_became_peered":"2023-10-07T09:03:54.392060+0000","last_unstale":"2023-10-07T09:03:54.392318+0000","last_undegraded":"2023-10-07T09:03:54.392318+0000","last_fullsized":"2023-10-07T09:03:54.392318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:32.624061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386596+0000","last_change":"2023-10-07T09:03:54.379801+0000","last_active":"2023-10-07T09:03:54.386596+0000","last_peered":"2023-10-07T09:03:54.386596+0000","last_clean":"2023-10-07T09:03:54.386596+0000","last_became_active":"2023-10-07T09:03:54.379532+0000","last_became_peered":"2023-10-07T09:03:54.379532+0000","last_unstale":"2023-10-07T09:03:54.386596+0000","last_undegraded":"2023-10-07T09:03:54.386596+0000","last_fullsized":"2023-10-07T09:03:54.386596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:47.103088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.390447+0000","last_change":"2023-10-07T09:03:54.387457+0000","last_active":"2023-10-07T09:03:54.390447+0000","last_peered":"2023-10-07T09:03:54.390447+0000","last_clean":"2023-10-07T09:03:54.390447+0000","last_became_active":"2023-10-07T09:03:54.387233+0000","last_became_peered":"2023-10-07T09:03:54.387233+0000","last_unstale":"2023-10-07T09:03:54.390447+0000","last_undegraded":"2023-10-07T09:03:54.390447+0000","last_fullsized":"2023-10-07T09:03:54.390447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.390959+0000","last_change":"2023-10-07T09:03:54.390959+0000","last_active":"2023-10-07T09:03:54.390959+0000","last_peered":"2023-10-07T09:03:54.390959+0000","last_clean":"2023-10-07T09:03:54.390959+0000","last_became_active":"2023-10-07T09:03:54.390643+0000","last_became_peered":"2023-10-07T09:03:54.390643+0000","last_unstale":"2023-10-07T09:03:54.390959+0000","last_undegraded":"2023-10-07T09:03:54.390959+0000","last_fullsized":"2023-10-07T09:03:54.390959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:13.082179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394621+0000","last_change":"2023-10-07T09:03:54.393796+0000","last_active":"2023-10-07T09:03:54.394621+0000","last_peered":"2023-10-07T09:03:54.394621+0000","last_clean":"2023-10-07T09:03:54.394621+0000","last_became_active":"2023-10-07T09:03:54.390426+0000","last_became_peered":"2023-10-07T09:03:54.390426+0000","last_unstale":"2023-10-07T09:03:54.394621+0000","last_undegraded":"2023-10-07T09:03:54.394621+0000","last_fullsized":"2023-10-07T09:03:54.394621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:31.364730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381853+0000","last_change":"2023-10-07T09:03:54.381853+0000","last_active":"2023-10-07T09:03:54.381853+0000","last_peered":"2023-10-07T09:03:54.381853+0000","last_clean":"2023-10-07T09:03:54.381853+0000","last_became_active":"2023-10-07T09:03:54.381621+0000","last_became_peered":"2023-10-07T09:03:54.381621+0000","last_unstale":"2023-10-07T09:03:54.381853+0000","last_undegraded":"2023-10-07T09:03:54.381853+0000","last_fullsized":"2023-10-07T09:03:54.381853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:43.717297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391629+0000","last_change":"2023-10-07T09:03:54.389160+0000","last_active":"2023-10-07T09:03:54.391629+0000","last_peered":"2023-10-07T09:03:54.391629+0000","last_clean":"2023-10-07T09:03:54.391629+0000","last_became_active":"2023-10-07T09:03:54.388114+0000","last_became_peered":"2023-10-07T09:03:54.388114+0000","last_unstale":"2023-10-07T09:03:54.391629+0000","last_undegraded":"2023-10-07T09:03:54.391629+0000","last_fullsized":"2023-10-07T09:03:54.391629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.453648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385439+0000","last_change":"2023-10-07T09:03:54.385439+0000","last_active":"2023-10-07T09:03:54.385439+0000","last_peered":"2023-10-07T09:03:54.385439+0000","last_clean":"2023-10-07T09:03:54.385439+0000","last_became_active":"2023-10-07T09:03:54.384976+0000","last_became_peered":"2023-10-07T09:03:54.384976+0000","last_unstale":"2023-10-07T09:03:54.385439+0000","last_undegraded":"2023-10-07T09:03:54.385439+0000","last_fullsized":"2023-10-07T09:03:54.385439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:36.165191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.387995+0000","last_change":"2023-10-07T09:03:54.387995+0000","last_active":"2023-10-07T09:03:54.387995+0000","last_peered":"2023-10-07T09:03:54.387995+0000","last_clean":"2023-10-07T09:03:54.387995+0000","last_became_active":"2023-10-07T09:03:54.387706+0000","last_became_peered":"2023-10-07T09:03:54.387706+0000","last_unstale":"2023-10-07T09:03:54.387995+0000","last_undegraded":"2023-10-07T09:03:54.387995+0000","last_fullsized":"2023-10-07T09:03:54.387995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:02.750799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401530+0000","last_change":"2023-10-07T09:03:54.398619+0000","last_active":"2023-10-07T09:03:54.401530+0000","last_peered":"2023-10-07T09:03:54.401530+0000","last_clean":"2023-10-07T09:03:54.401530+0000","last_became_active":"2023-10-07T09:03:54.398296+0000","last_became_peered":"2023-10-07T09:03:54.398296+0000","last_unstale":"2023-10-07T09:03:54.401530+0000","last_undegraded":"2023-10-07T09:03:54.401530+0000","last_fullsized":"2023-10-07T09:03:54.401530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:47.926672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397727+0000","last_change":"2023-10-07T09:03:54.393677+0000","last_active":"2023-10-07T09:03:54.397727+0000","last_peered":"2023-10-07T09:03:54.397727+0000","last_clean":"2023-10-07T09:03:54.397727+0000","last_became_active":"2023-10-07T09:03:54.393348+0000","last_became_peered":"2023-10-07T09:03:54.393348+0000","last_unstale":"2023-10-07T09:03:54.397727+0000","last_undegraded":"2023-10-07T09:03:54.397727+0000","last_fullsized":"2023-10-07T09:03:54.397727+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:02:09.396102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395052+0000","last_change":"2023-10-07T09:03:54.395052+0000","last_active":"2023-10-07T09:03:54.395052+0000","last_peered":"2023-10-07T09:03:54.395052+0000","last_clean":"2023-10-07T09:03:54.395052+0000","last_became_active":"2023-10-07T09:03:54.394784+0000","last_became_peered":"2023-10-07T09:03:54.394784+0000","last_unstale":"2023-10-07T09:03:54.395052+0000","last_undegraded":"2023-10-07T09:03:54.395052+0000","last_fullsized":"2023-10-07T09:03:54.395052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:12.096874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385418+0000","last_change":"2023-10-07T09:03:54.385418+0000","last_active":"2023-10-07T09:03:54.385418+0000","last_peered":"2023-10-07T09:03:54.385418+0000","last_clean":"2023-10-07T09:03:54.385418+0000","last_became_active":"2023-10-07T09:03:54.385144+0000","last_became_peered":"2023-10-07T09:03:54.385144+0000","last_unstale":"2023-10-07T09:03:54.385418+0000","last_undegraded":"2023-10-07T09:03:54.385418+0000","last_fullsized":"2023-10-07T09:03:54.385418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.453648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.382450+0000","last_change":"2023-10-07T09:03:54.382450+0000","last_active":"2023-10-07T09:03:54.382450+0000","last_peered":"2023-10-07T09:03:54.382450+0000","last_clean":"2023-10-07T09:03:54.382450+0000","last_became_active":"2023-10-07T09:03:54.382208+0000","last_became_peered":"2023-10-07T09:03:54.382208+0000","last_unstale":"2023-10-07T09:03:54.382450+0000","last_undegraded":"2023-10-07T09:03:54.382450+0000","last_fullsized":"2023-10-07T09:03:54.382450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:47.807857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386979+0000","last_change":"2023-10-07T09:03:54.386979+0000","last_active":"2023-10-07T09:03:54.386979+0000","last_peered":"2023-10-07T09:03:54.386979+0000","last_clean":"2023-10-07T09:03:54.386979+0000","last_became_active":"2023-10-07T09:03:54.385113+0000","last_became_peered":"2023-10-07T09:03:54.385113+0000","last_unstale":"2023-10-07T09:03:54.386979+0000","last_undegraded":"2023-10-07T09:03:54.386979+0000","last_fullsized":"2023-10-07T09:03:54.386979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:15.253851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383911+0000","last_change":"2023-10-07T09:03:54.382792+0000","last_active":"2023-10-07T09:03:54.383911+0000","last_peered":"2023-10-07T09:03:54.383911+0000","last_clean":"2023-10-07T09:03:54.383911+0000","last_became_active":"2023-10-07T09:03:54.382500+0000","last_became_peered":"2023-10-07T09:03:54.382500+0000","last_unstale":"2023-10-07T09:03:54.383911+0000","last_undegraded":"2023-10-07T09:03:54.383911+0000","last_fullsized":"2023-10-07T09:03:54.383911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:27:36.101865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394948+0000","last_change":"2023-10-07T09:03:54.394948+0000","last_active":"2023-10-07T09:03:54.394948+0000","last_peered":"2023-10-07T09:03:54.394948+0000","last_clean":"2023-10-07T09:03:54.394948+0000","last_became_active":"2023-10-07T09:03:54.394537+0000","last_became_peered":"2023-10-07T09:03:54.394537+0000","last_unstale":"2023-10-07T09:03:54.394948+0000","last_undegraded":"2023-10-07T09:03:54.394948+0000","last_fullsized":"2023-10-07T09:03:54.394948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:57.924366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385296+0000","last_change":"2023-10-07T09:03:54.385296+0000","last_active":"2023-10-07T09:03:54.385296+0000","last_peered":"2023-10-07T09:03:54.385296+0000","last_clean":"2023-10-07T09:03:54.385296+0000","last_became_active":"2023-10-07T09:03:54.385027+0000","last_became_peered":"2023-10-07T09:03:54.385027+0000","last_unstale":"2023-10-07T09:03:54.385296+0000","last_undegraded":"2023-10-07T09:03:54.385296+0000","last_fullsized":"2023-10-07T09:03:54.385296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:23:27.254962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.399188+0000","last_change":"2023-10-07T09:03:54.398484+0000","last_active":"2023-10-07T09:03:54.399188+0000","last_peered":"2023-10-07T09:03:54.399188+0000","last_clean":"2023-10-07T09:03:54.399188+0000","last_became_active":"2023-10-07T09:03:54.398197+0000","last_became_peered":"2023-10-07T09:03:54.398197+0000","last_unstale":"2023-10-07T09:03:54.399188+0000","last_undegraded":"2023-10-07T09:03:54.399188+0000","last_fullsized":"2023-10-07T09:03:54.399188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:02:09.396102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391185+0000","last_change":"2023-10-07T09:03:54.387034+0000","last_active":"2023-10-07T09:03:54.391185+0000","last_peered":"2023-10-07T09:03:54.391185+0000","last_clean":"2023-10-07T09:03:54.391185+0000","last_became_active":"2023-10-07T09:03:54.386756+0000","last_became_peered":"2023-10-07T09:03:54.386756+0000","last_unstale":"2023-10-07T09:03:54.391185+0000","last_undegraded":"2023-10-07T09:03:54.391185+0000","last_fullsized":"2023-10-07T09:03:54.391185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:29:33.394523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392164+0000","last_change":"2023-10-07T09:03:54.385590+0000","last_active":"2023-10-07T09:03:54.392164+0000","last_peered":"2023-10-07T09:03:54.392164+0000","last_clean":"2023-10-07T09:03:54.392164+0000","last_became_active":"2023-10-07T09:03:54.385276+0000","last_became_peered":"2023-10-07T09:03:54.385276+0000","last_unstale":"2023-10-07T09:03:54.392164+0000","last_undegraded":"2023-10-07T09:03:54.392164+0000","last_fullsized":"2023-10-07T09:03:54.392164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:15.368783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396210+0000","last_change":"2023-10-07T09:03:54.396210+0000","last_active":"2023-10-07T09:03:54.396210+0000","last_peered":"2023-10-07T09:03:54.396210+0000","last_clean":"2023-10-07T09:03:54.396210+0000","last_became_active":"2023-10-07T09:03:54.395519+0000","last_became_peered":"2023-10-07T09:03:54.395519+0000","last_unstale":"2023-10-07T09:03:54.396210+0000","last_undegraded":"2023-10-07T09:03:54.396210+0000","last_fullsized":"2023-10-07T09:03:54.396210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:47.103088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.384451+0000","last_change":"2023-10-07T09:03:54.376684+0000","last_active":"2023-10-07T09:03:54.384451+0000","last_peered":"2023-10-07T09:03:54.384451+0000","last_clean":"2023-10-07T09:03:54.384451+0000","last_became_active":"2023-10-07T09:03:54.376416+0000","last_became_peered":"2023-10-07T09:03:54.376416+0000","last_unstale":"2023-10-07T09:03:54.384451+0000","last_undegraded":"2023-10-07T09:03:54.384451+0000","last_fullsized":"2023-10-07T09:03:54.384451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:40.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383582+0000","last_change":"2023-10-07T09:03:54.377522+0000","last_active":"2023-10-07T09:03:54.383582+0000","last_peered":"2023-10-07T09:03:54.383582+0000","last_clean":"2023-10-07T09:03:54.383582+0000","last_became_active":"2023-10-07T09:03:54.377069+0000","last_became_peered":"2023-10-07T09:03:54.377069+0000","last_unstale":"2023-10-07T09:03:54.383582+0000","last_undegraded":"2023-10-07T09:03:54.383582+0000","last_fullsized":"2023-10-07T09:03:54.383582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:56.769076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386999+0000","last_change":"2023-10-07T09:03:54.382562+0000","last_active":"2023-10-07T09:03:54.386999+0000","last_peered":"2023-10-07T09:03:54.386999+0000","last_clean":"2023-10-07T09:03:54.386999+0000","last_became_active":"2023-10-07T09:03:54.382296+0000","last_became_peered":"2023-10-07T09:03:54.382296+0000","last_unstale":"2023-10-07T09:03:54.386999+0000","last_undegraded":"2023-10-07T09:03:54.386999+0000","last_fullsized":"2023-10-07T09:03:54.386999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:26.029964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386204+0000","last_change":"2023-10-07T09:03:54.386204+0000","last_active":"2023-10-07T09:03:54.386204+0000","last_peered":"2023-10-07T09:03:54.386204+0000","last_clean":"2023-10-07T09:03:54.386204+0000","last_became_active":"2023-10-07T09:03:54.385706+0000","last_became_peered":"2023-10-07T09:03:54.385706+0000","last_unstale":"2023-10-07T09:03:54.386204+0000","last_undegraded":"2023-10-07T09:03:54.386204+0000","last_fullsized":"2023-10-07T09:03:54.386204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:20:43.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401501+0000","last_change":"2023-10-07T09:03:54.398621+0000","last_active":"2023-10-07T09:03:54.401501+0000","last_peered":"2023-10-07T09:03:54.401501+0000","last_clean":"2023-10-07T09:03:54.401501+0000","last_became_active":"2023-10-07T09:03:54.398399+0000","last_became_peered":"2023-10-07T09:03:54.398399+0000","last_unstale":"2023-10-07T09:03:54.401501+0000","last_undegraded":"2023-10-07T09:03:54.401501+0000","last_fullsized":"2023-10-07T09:03:54.401501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:49.266603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396997+0000","last_change":"2023-10-07T09:03:53.372360+0000","last_active":"2023-10-07T09:03:54.396997+0000","last_peered":"2023-10-07T09:03:54.396997+0000","last_clean":"2023-10-07T09:03:54.396997+0000","last_became_active":"2023-10-07T09:03:53.372100+0000","last_became_peered":"2023-10-07T09:03:53.372100+0000","last_unstale":"2023-10-07T09:03:54.396997+0000","last_undegraded":"2023-10-07T09:03:54.396997+0000","last_fullsized":"2023-10-07T09:03:54.396997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:19.632738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391492+0000","last_change":"2023-10-07T09:03:54.391492+0000","last_active":"2023-10-07T09:03:54.391492+0000","last_peered":"2023-10-07T09:03:54.391492+0000","last_clean":"2023-10-07T09:03:54.391492+0000","last_became_active":"2023-10-07T09:03:54.391028+0000","last_became_peered":"2023-10-07T09:03:54.391028+0000","last_unstale":"2023-10-07T09:03:54.391492+0000","last_undegraded":"2023-10-07T09:03:54.391492+0000","last_fullsized":"2023-10-07T09:03:54.391492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:56.302361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395622+0000","last_change":"2023-10-07T09:03:53.371129+0000","last_active":"2023-10-07T09:03:54.395622+0000","last_peered":"2023-10-07T09:03:54.395622+0000","last_clean":"2023-10-07T09:03:54.395622+0000","last_became_active":"2023-10-07T09:03:53.370865+0000","last_became_peered":"2023-10-07T09:03:53.370865+0000","last_unstale":"2023-10-07T09:03:54.395622+0000","last_undegraded":"2023-10-07T09:03:54.395622+0000","last_fullsized":"2023-10-07T09:03:54.395622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:51:53.543686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385968+0000","last_change":"2023-10-07T09:03:54.385968+0000","last_active":"2023-10-07T09:03:54.385968+0000","last_peered":"2023-10-07T09:03:54.385968+0000","last_clean":"2023-10-07T09:03:54.385968+0000","last_became_active":"2023-10-07T09:03:54.385729+0000","last_became_peered":"2023-10-07T09:03:54.385729+0000","last_unstale":"2023-10-07T09:03:54.385968+0000","last_undegraded":"2023-10-07T09:03:54.385968+0000","last_fullsized":"2023-10-07T09:03:54.385968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:06.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394595+0000","last_change":"2023-10-07T09:03:53.374108+0000","last_active":"2023-10-07T09:03:54.394595+0000","last_peered":"2023-10-07T09:03:54.394595+0000","last_clean":"2023-10-07T09:03:54.394595+0000","last_became_active":"2023-10-07T09:03:53.373835+0000","last_became_peered":"2023-10-07T09:03:53.373835+0000","last_unstale":"2023-10-07T09:03:54.394595+0000","last_undegraded":"2023-10-07T09:03:54.394595+0000","last_fullsized":"2023-10-07T09:03:54.394595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:56.918044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391681+0000","last_change":"2023-10-07T09:03:54.387426+0000","last_active":"2023-10-07T09:03:54.391681+0000","last_peered":"2023-10-07T09:03:54.391681+0000","last_clean":"2023-10-07T09:03:54.391681+0000","last_became_active":"2023-10-07T09:03:54.387117+0000","last_became_peered":"2023-10-07T09:03:54.387117+0000","last_unstale":"2023-10-07T09:03:54.391681+0000","last_undegraded":"2023-10-07T09:03:54.391681+0000","last_fullsized":"2023-10-07T09:03:54.391681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:02.700693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396080+0000","last_change":"2023-10-07T09:03:53.379260+0000","last_active":"2023-10-07T09:03:54.396080+0000","last_peered":"2023-10-07T09:03:54.396080+0000","last_clean":"2023-10-07T09:03:54.396080+0000","last_became_active":"2023-10-07T09:03:53.378579+0000","last_became_peered":"2023-10-07T09:03:53.378579+0000","last_unstale":"2023-10-07T09:03:54.396080+0000","last_undegraded":"2023-10-07T09:03:54.396080+0000","last_fullsized":"2023-10-07T09:03:54.396080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:55.296040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383555+0000","last_change":"2023-10-07T09:03:54.377349+0000","last_active":"2023-10-07T09:03:54.383555+0000","last_peered":"2023-10-07T09:03:54.383555+0000","last_clean":"2023-10-07T09:03:54.383555+0000","last_became_active":"2023-10-07T09:03:54.376794+0000","last_became_peered":"2023-10-07T09:03:54.376794+0000","last_unstale":"2023-10-07T09:03:54.383555+0000","last_undegraded":"2023-10-07T09:03:54.383555+0000","last_fullsized":"2023-10-07T09:03:54.383555+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:53.505111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394609+0000","last_change":"2023-10-07T09:03:53.375068+0000","last_active":"2023-10-07T09:03:54.394609+0000","last_peered":"2023-10-07T09:03:54.394609+0000","last_clean":"2023-10-07T09:03:54.394609+0000","last_became_active":"2023-10-07T09:03:53.374777+0000","last_became_peered":"2023-10-07T09:03:53.374777+0000","last_unstale":"2023-10-07T09:03:54.394609+0000","last_undegraded":"2023-10-07T09:03:54.394609+0000","last_fullsized":"2023-10-07T09:03:54.394609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:06.557890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396423+0000","last_change":"2023-10-07T09:03:54.393528+0000","last_active":"2023-10-07T09:03:54.396423+0000","last_peered":"2023-10-07T09:03:54.396423+0000","last_clean":"2023-10-07T09:03:54.396423+0000","last_became_active":"2023-10-07T09:03:54.393251+0000","last_became_peered":"2023-10-07T09:03:54.393251+0000","last_unstale":"2023-10-07T09:03:54.396423+0000","last_undegraded":"2023-10-07T09:03:54.396423+0000","last_fullsized":"2023-10-07T09:03:54.396423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:40.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394047+0000","last_change":"2023-10-07T09:03:53.371166+0000","last_active":"2023-10-07T09:03:54.394047+0000","last_peered":"2023-10-07T09:03:54.394047+0000","last_clean":"2023-10-07T09:03:54.394047+0000","last_became_active":"2023-10-07T09:03:53.370857+0000","last_became_peered":"2023-10-07T09:03:53.370857+0000","last_unstale":"2023-10-07T09:03:54.394047+0000","last_undegraded":"2023-10-07T09:03:54.394047+0000","last_fullsized":"2023-10-07T09:03:54.394047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:04.254900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401846+0000","last_change":"2023-10-07T09:03:54.397547+0000","last_active":"2023-10-07T09:03:54.401846+0000","last_peered":"2023-10-07T09:03:54.401846+0000","last_clean":"2023-10-07T09:03:54.401846+0000","last_became_active":"2023-10-07T09:03:54.397286+0000","last_became_peered":"2023-10-07T09:03:54.397286+0000","last_unstale":"2023-10-07T09:03:54.401846+0000","last_undegraded":"2023-10-07T09:03:54.401846+0000","last_fullsized":"2023-10-07T09:03:54.401846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:33:44.789725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.381410+0000","last_change":"2023-10-07T09:03:53.379547+0000","last_active":"2023-10-07T09:03:53.381410+0000","last_peered":"2023-10-07T09:03:53.381410+0000","last_clean":"2023-10-07T09:03:53.381410+0000","last_became_active":"2023-10-07T09:03:53.378656+0000","last_became_peered":"2023-10-07T09:03:53.378656+0000","last_unstale":"2023-10-07T09:03:53.381410+0000","last_undegraded":"2023-10-07T09:03:53.381410+0000","last_fullsized":"2023-10-07T09:03:53.381410+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:46.920351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.387817+0000","last_change":"2023-10-07T09:03:54.387817+0000","last_active":"2023-10-07T09:03:54.387817+0000","last_peered":"2023-10-07T09:03:54.387817+0000","last_clean":"2023-10-07T09:03:54.387817+0000","last_became_active":"2023-10-07T09:03:54.387565+0000","last_became_peered":"2023-10-07T09:03:54.387565+0000","last_unstale":"2023-10-07T09:03:54.387817+0000","last_undegraded":"2023-10-07T09:03:54.387817+0000","last_fullsized":"2023-10-07T09:03:54.387817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:03:56.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374657+0000","last_change":"2023-10-07T09:03:53.377432+0000","last_active":"2023-10-07T09:03:54.374657+0000","last_peered":"2023-10-07T09:03:54.374657+0000","last_clean":"2023-10-07T09:03:54.374657+0000","last_became_active":"2023-10-07T09:03:53.377129+0000","last_became_peered":"2023-10-07T09:03:53.377129+0000","last_unstale":"2023-10-07T09:03:54.374657+0000","last_undegraded":"2023-10-07T09:03:54.374657+0000","last_fullsized":"2023-10-07T09:03:54.374657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:35.571003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.377233+0000","last_change":"2023-10-07T09:03:54.377233+0000","last_active":"2023-10-07T09:03:54.377233+0000","last_peered":"2023-10-07T09:03:54.377233+0000","last_clean":"2023-10-07T09:03:54.377233+0000","last_became_active":"2023-10-07T09:03:54.376980+0000","last_became_peered":"2023-10-07T09:03:54.376980+0000","last_unstale":"2023-10-07T09:03:54.377233+0000","last_undegraded":"2023-10-07T09:03:54.377233+0000","last_fullsized":"2023-10-07T09:03:54.377233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:24:45.952218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379605+0000","last_change":"2023-10-07T09:03:53.377256+0000","last_active":"2023-10-07T09:03:53.379605+0000","last_peered":"2023-10-07T09:03:53.379605+0000","last_clean":"2023-10-07T09:03:53.379605+0000","last_became_active":"2023-10-07T09:03:53.376984+0000","last_became_peered":"2023-10-07T09:03:53.376984+0000","last_unstale":"2023-10-07T09:03:53.379605+0000","last_undegraded":"2023-10-07T09:03:53.379605+0000","last_fullsized":"2023-10-07T09:03:53.379605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:49:41.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381580+0000","last_change":"2023-10-07T09:03:54.376808+0000","last_active":"2023-10-07T09:03:54.381580+0000","last_peered":"2023-10-07T09:03:54.381580+0000","last_clean":"2023-10-07T09:03:54.381580+0000","last_became_active":"2023-10-07T09:03:54.376529+0000","last_became_peered":"2023-10-07T09:03:54.376529+0000","last_unstale":"2023-10-07T09:03:54.381580+0000","last_undegraded":"2023-10-07T09:03:54.381580+0000","last_fullsized":"2023-10-07T09:03:54.381580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:06.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379731+0000","last_change":"2023-10-07T09:03:53.378243+0000","last_active":"2023-10-07T09:03:53.379731+0000","last_peered":"2023-10-07T09:03:53.379731+0000","last_clean":"2023-10-07T09:03:53.379731+0000","last_became_active":"2023-10-07T09:03:53.377949+0000","last_became_peered":"2023-10-07T09:03:53.377949+0000","last_unstale":"2023-10-07T09:03:53.379731+0000","last_undegraded":"2023-10-07T09:03:53.379731+0000","last_fullsized":"2023-10-07T09:03:53.379731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:01.241179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396318+0000","last_change":"2023-10-07T09:03:54.396318+0000","last_active":"2023-10-07T09:03:54.396318+0000","last_peered":"2023-10-07T09:03:54.396318+0000","last_clean":"2023-10-07T09:03:54.396318+0000","last_became_active":"2023-10-07T09:03:54.396072+0000","last_became_peered":"2023-10-07T09:03:54.396072+0000","last_unstale":"2023-10-07T09:03:54.396318+0000","last_undegraded":"2023-10-07T09:03:54.396318+0000","last_fullsized":"2023-10-07T09:03:54.396318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:55.969183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395538+0000","last_change":"2023-10-07T09:03:53.379189+0000","last_active":"2023-10-07T09:03:54.395538+0000","last_peered":"2023-10-07T09:03:54.395538+0000","last_clean":"2023-10-07T09:03:54.395538+0000","last_became_active":"2023-10-07T09:03:53.378962+0000","last_became_peered":"2023-10-07T09:03:53.378962+0000","last_unstale":"2023-10-07T09:03:54.395538+0000","last_undegraded":"2023-10-07T09:03:54.395538+0000","last_fullsized":"2023-10-07T09:03:54.395538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:50:32.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392183+0000","last_change":"2023-10-07T09:03:54.385605+0000","last_active":"2023-10-07T09:03:54.392183+0000","last_peered":"2023-10-07T09:03:54.392183+0000","last_clean":"2023-10-07T09:03:54.392183+0000","last_became_active":"2023-10-07T09:03:54.385239+0000","last_became_peered":"2023-10-07T09:03:54.385239+0000","last_unstale":"2023-10-07T09:03:54.392183+0000","last_undegraded":"2023-10-07T09:03:54.392183+0000","last_fullsized":"2023-10-07T09:03:54.392183+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:59.405752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.403089+0000","last_change":"2023-10-07T09:03:53.377500+0000","last_active":"2023-10-07T09:03:54.403089+0000","last_peered":"2023-10-07T09:03:54.403089+0000","last_clean":"2023-10-07T09:03:54.403089+0000","last_became_active":"2023-10-07T09:03:53.377112+0000","last_became_peered":"2023-10-07T09:03:53.377112+0000","last_unstale":"2023-10-07T09:03:54.403089+0000","last_undegraded":"2023-10-07T09:03:54.403089+0000","last_fullsized":"2023-10-07T09:03:54.403089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:27:35.095544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.393796+0000","last_change":"2023-10-07T09:03:54.393796+0000","last_active":"2023-10-07T09:03:54.393796+0000","last_peered":"2023-10-07T09:03:54.393796+0000","last_clean":"2023-10-07T09:03:54.393796+0000","last_became_active":"2023-10-07T09:03:54.393497+0000","last_became_peered":"2023-10-07T09:03:54.393497+0000","last_unstale":"2023-10-07T09:03:54.393796+0000","last_undegraded":"2023-10-07T09:03:54.393796+0000","last_fullsized":"2023-10-07T09:03:54.393796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:02.700693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397277+0000","last_change":"2023-10-07T09:03:53.377373+0000","last_active":"2023-10-07T09:03:54.397277+0000","last_peered":"2023-10-07T09:03:54.397277+0000","last_clean":"2023-10-07T09:03:54.397277+0000","last_became_active":"2023-10-07T09:03:53.376891+0000","last_became_peered":"2023-10-07T09:03:53.376891+0000","last_unstale":"2023-10-07T09:03:54.397277+0000","last_undegraded":"2023-10-07T09:03:54.397277+0000","last_fullsized":"2023-10-07T09:03:54.397277+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:41:06.557890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401507+0000","last_change":"2023-10-07T09:03:54.394829+0000","last_active":"2023-10-07T09:03:54.401507+0000","last_peered":"2023-10-07T09:03:54.401507+0000","last_clean":"2023-10-07T09:03:54.401507+0000","last_became_active":"2023-10-07T09:03:54.394513+0000","last_became_peered":"2023-10-07T09:03:54.394513+0000","last_unstale":"2023-10-07T09:03:54.401507+0000","last_undegraded":"2023-10-07T09:03:54.401507+0000","last_fullsized":"2023-10-07T09:03:54.401507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:41.955476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.381357+0000","last_change":"2023-10-07T09:03:53.375883+0000","last_active":"2023-10-07T09:03:53.381357+0000","last_peered":"2023-10-07T09:03:53.381357+0000","last_clean":"2023-10-07T09:03:53.381357+0000","last_became_active":"2023-10-07T09:03:53.375189+0000","last_became_peered":"2023-10-07T09:03:53.375189+0000","last_unstale":"2023-10-07T09:03:53.381357+0000","last_undegraded":"2023-10-07T09:03:53.381357+0000","last_fullsized":"2023-10-07T09:03:53.381357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:33:43.783404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383803+0000","last_change":"2023-10-07T09:03:54.379982+0000","last_active":"2023-10-07T09:03:54.383803+0000","last_peered":"2023-10-07T09:03:54.383803+0000","last_clean":"2023-10-07T09:03:54.383803+0000","last_became_active":"2023-10-07T09:03:54.379586+0000","last_became_peered":"2023-10-07T09:03:54.379586+0000","last_unstale":"2023-10-07T09:03:54.383803+0000","last_undegraded":"2023-10-07T09:03:54.383803+0000","last_fullsized":"2023-10-07T09:03:54.383803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:53.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.372736+0000","last_change":"2023-10-07T09:03:53.380308+0000","last_active":"2023-10-07T09:03:54.372736+0000","last_peered":"2023-10-07T09:03:54.372736+0000","last_clean":"2023-10-07T09:03:54.372736+0000","last_became_active":"2023-10-07T09:03:53.379992+0000","last_became_peered":"2023-10-07T09:03:53.379992+0000","last_unstale":"2023-10-07T09:03:54.372736+0000","last_undegraded":"2023-10-07T09:03:54.372736+0000","last_fullsized":"2023-10-07T09:03:54.372736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:27.717502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.393062+0000","last_change":"2023-10-07T09:03:54.388731+0000","last_active":"2023-10-07T09:03:54.393062+0000","last_peered":"2023-10-07T09:03:54.393062+0000","last_clean":"2023-10-07T09:03:54.393062+0000","last_became_active":"2023-10-07T09:03:54.388461+0000","last_became_peered":"2023-10-07T09:03:54.388461+0000","last_unstale":"2023-10-07T09:03:54.393062+0000","last_undegraded":"2023-10-07T09:03:54.393062+0000","last_fullsized":"2023-10-07T09:03:54.393062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:28.723823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401718+0000","last_change":"2023-10-07T09:03:53.377542+0000","last_active":"2023-10-07T09:03:54.401718+0000","last_peered":"2023-10-07T09:03:54.401718+0000","last_clean":"2023-10-07T09:03:54.401718+0000","last_became_active":"2023-10-07T09:03:53.377270+0000","last_became_peered":"2023-10-07T09:03:53.377270+0000","last_unstale":"2023-10-07T09:03:54.401718+0000","last_undegraded":"2023-10-07T09:03:54.401718+0000","last_fullsized":"2023-10-07T09:03:54.401718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:29.728400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.391304+0000","last_change":"2023-10-07T09:03:54.389692+0000","last_active":"2023-10-07T09:03:54.391304+0000","last_peered":"2023-10-07T09:03:54.391304+0000","last_clean":"2023-10-07T09:03:54.391304+0000","last_became_active":"2023-10-07T09:03:54.389421+0000","last_became_peered":"2023-10-07T09:03:54.389421+0000","last_unstale":"2023-10-07T09:03:54.391304+0000","last_undegraded":"2023-10-07T09:03:54.391304+0000","last_fullsized":"2023-10-07T09:03:54.391304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:29.982610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.381726+0000","last_change":"2023-10-07T09:03:53.378650+0000","last_active":"2023-10-07T09:03:54.381726+0000","last_peered":"2023-10-07T09:03:54.381726+0000","last_clean":"2023-10-07T09:03:54.381726+0000","last_became_active":"2023-10-07T09:03:53.377819+0000","last_became_peered":"2023-10-07T09:03:53.377819+0000","last_unstale":"2023-10-07T09:03:54.381726+0000","last_undegraded":"2023-10-07T09:03:54.381726+0000","last_fullsized":"2023-10-07T09:03:54.381726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:53:48.716351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397451+0000","last_change":"2023-10-07T09:03:54.397451+0000","last_active":"2023-10-07T09:03:54.397451+0000","last_peered":"2023-10-07T09:03:54.397451+0000","last_clean":"2023-10-07T09:03:54.397451+0000","last_became_active":"2023-10-07T09:03:54.397163+0000","last_became_peered":"2023-10-07T09:03:54.397163+0000","last_unstale":"2023-10-07T09:03:54.397451+0000","last_undegraded":"2023-10-07T09:03:54.397451+0000","last_fullsized":"2023-10-07T09:03:54.397451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:49.266603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.395763+0000","last_change":"2023-10-07T09:03:53.376923+0000","last_active":"2023-10-07T09:03:54.395763+0000","last_peered":"2023-10-07T09:03:54.395763+0000","last_clean":"2023-10-07T09:03:54.395763+0000","last_became_active":"2023-10-07T09:03:53.376629+0000","last_became_peered":"2023-10-07T09:03:53.376629+0000","last_unstale":"2023-10-07T09:03:54.395763+0000","last_undegraded":"2023-10-07T09:03:54.395763+0000","last_fullsized":"2023-10-07T09:03:54.395763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:12.075858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396355+0000","last_change":"2023-10-07T09:03:54.391750+0000","last_active":"2023-10-07T09:03:54.396355+0000","last_peered":"2023-10-07T09:03:54.396355+0000","last_clean":"2023-10-07T09:03:54.396355+0000","last_became_active":"2023-10-07T09:03:54.391451+0000","last_became_peered":"2023-10-07T09:03:54.391451+0000","last_unstale":"2023-10-07T09:03:54.396355+0000","last_undegraded":"2023-10-07T09:03:54.396355+0000","last_fullsized":"2023-10-07T09:03:54.396355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:16.512068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380987+0000","last_change":"2023-10-07T09:03:53.379341+0000","last_active":"2023-10-07T09:03:53.380987+0000","last_peered":"2023-10-07T09:03:53.380987+0000","last_clean":"2023-10-07T09:03:53.380987+0000","last_became_active":"2023-10-07T09:03:53.378973+0000","last_became_peered":"2023-10-07T09:03:53.378973+0000","last_unstale":"2023-10-07T09:03:53.380987+0000","last_undegraded":"2023-10-07T09:03:53.380987+0000","last_fullsized":"2023-10-07T09:03:53.380987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:48.260281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.385240+0000","last_change":"2023-10-07T09:03:54.385240+0000","last_active":"2023-10-07T09:03:54.385240+0000","last_peered":"2023-10-07T09:03:54.385240+0000","last_clean":"2023-10-07T09:03:54.385240+0000","last_became_active":"2023-10-07T09:03:54.384595+0000","last_became_peered":"2023-10-07T09:03:54.384595+0000","last_unstale":"2023-10-07T09:03:54.385240+0000","last_undegraded":"2023-10-07T09:03:54.385240+0000","last_fullsized":"2023-10-07T09:03:54.385240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:41:07.033570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392643+0000","last_change":"2023-10-07T09:03:53.374654+0000","last_active":"2023-10-07T09:03:54.392643+0000","last_peered":"2023-10-07T09:03:54.392643+0000","last_clean":"2023-10-07T09:03:54.392643+0000","last_became_active":"2023-10-07T09:03:53.374366+0000","last_became_peered":"2023-10-07T09:03:53.374366+0000","last_unstale":"2023-10-07T09:03:54.392643+0000","last_undegraded":"2023-10-07T09:03:54.392643+0000","last_fullsized":"2023-10-07T09:03:54.392643+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:28.976289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386306+0000","last_change":"2023-10-07T09:03:54.379346+0000","last_active":"2023-10-07T09:03:54.386306+0000","last_peered":"2023-10-07T09:03:54.386306+0000","last_clean":"2023-10-07T09:03:54.386306+0000","last_became_active":"2023-10-07T09:03:54.379022+0000","last_became_peered":"2023-10-07T09:03:54.379022+0000","last_unstale":"2023-10-07T09:03:54.386306+0000","last_undegraded":"2023-10-07T09:03:54.386306+0000","last_fullsized":"2023-10-07T09:03:54.386306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:57.924366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.378204+0000","last_change":"2023-10-07T09:03:53.374580+0000","last_active":"2023-10-07T09:03:53.378204+0000","last_peered":"2023-10-07T09:03:53.378204+0000","last_clean":"2023-10-07T09:03:53.378204+0000","last_became_active":"2023-10-07T09:03:53.374295+0000","last_became_peered":"2023-10-07T09:03:53.374295+0000","last_unstale":"2023-10-07T09:03:53.378204+0000","last_undegraded":"2023-10-07T09:03:53.378204+0000","last_fullsized":"2023-10-07T09:03:53.378204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:47.094307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374776+0000","last_change":"2023-10-07T09:03:54.374776+0000","last_active":"2023-10-07T09:03:54.374776+0000","last_peered":"2023-10-07T09:03:54.374776+0000","last_clean":"2023-10-07T09:03:54.374776+0000","last_became_active":"2023-10-07T09:03:54.374494+0000","last_became_peered":"2023-10-07T09:03:54.374494+0000","last_unstale":"2023-10-07T09:03:54.374776+0000","last_undegraded":"2023-10-07T09:03:54.374776+0000","last_fullsized":"2023-10-07T09:03:54.374776+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:36.577324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379545+0000","last_change":"2023-10-07T09:03:53.376382+0000","last_active":"2023-10-07T09:03:53.379545+0000","last_peered":"2023-10-07T09:03:53.379545+0000","last_clean":"2023-10-07T09:03:53.379545+0000","last_became_active":"2023-10-07T09:03:53.376176+0000","last_became_peered":"2023-10-07T09:03:53.376176+0000","last_unstale":"2023-10-07T09:03:53.379545+0000","last_undegraded":"2023-10-07T09:03:53.379545+0000","last_fullsized":"2023-10-07T09:03:53.379545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:03:00.875723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.388209+0000","last_change":"2023-10-07T09:03:54.384179+0000","last_active":"2023-10-07T09:03:54.388209+0000","last_peered":"2023-10-07T09:03:54.388209+0000","last_clean":"2023-10-07T09:03:54.388209+0000","last_became_active":"2023-10-07T09:03:54.383908+0000","last_became_peered":"2023-10-07T09:03:54.383908+0000","last_unstale":"2023-10-07T09:03:54.388209+0000","last_undegraded":"2023-10-07T09:03:54.388209+0000","last_fullsized":"2023-10-07T09:03:54.388209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:31.927565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.378649+0000","last_change":"2023-10-07T09:03:53.374166+0000","last_active":"2023-10-07T09:03:53.378649+0000","last_peered":"2023-10-07T09:03:53.378649+0000","last_clean":"2023-10-07T09:03:53.378649+0000","last_became_active":"2023-10-07T09:03:53.373894+0000","last_became_peered":"2023-10-07T09:03:53.373894+0000","last_unstale":"2023-10-07T09:03:53.378649+0000","last_undegraded":"2023-10-07T09:03:53.378649+0000","last_fullsized":"2023-10-07T09:03:53.378649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:40.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.397004+0000","last_change":"2023-10-07T09:03:54.395260+0000","last_active":"2023-10-07T09:03:54.397004+0000","last_peered":"2023-10-07T09:03:54.397004+0000","last_clean":"2023-10-07T09:03:54.397004+0000","last_became_active":"2023-10-07T09:03:54.392887+0000","last_became_peered":"2023-10-07T09:03:54.392887+0000","last_unstale":"2023-10-07T09:03:54.397004+0000","last_undegraded":"2023-10-07T09:03:54.397004+0000","last_fullsized":"2023-10-07T09:03:54.397004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:13.082179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401810+0000","last_change":"2023-10-07T09:03:53.378791+0000","last_active":"2023-10-07T09:03:54.401810+0000","last_peered":"2023-10-07T09:03:54.401810+0000","last_clean":"2023-10-07T09:03:54.401810+0000","last_became_active":"2023-10-07T09:03:53.377449+0000","last_became_peered":"2023-10-07T09:03:53.377449+0000","last_unstale":"2023-10-07T09:03:54.401810+0000","last_undegraded":"2023-10-07T09:03:54.401810+0000","last_fullsized":"2023-10-07T09:03:54.401810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:45:46.801535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.401868+0000","last_change":"2023-10-07T09:03:54.397522+0000","last_active":"2023-10-07T09:03:54.401868+0000","last_peered":"2023-10-07T09:03:54.401868+0000","last_clean":"2023-10-07T09:03:54.401868+0000","last_became_active":"2023-10-07T09:03:54.397318+0000","last_became_peered":"2023-10-07T09:03:54.397318+0000","last_unstale":"2023-10-07T09:03:54.401868+0000","last_undegraded":"2023-10-07T09:03:54.401868+0000","last_fullsized":"2023-10-07T09:03:54.401868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:41.819178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.374679+0000","last_change":"2023-10-07T09:03:53.375406+0000","last_active":"2023-10-07T09:03:54.374679+0000","last_peered":"2023-10-07T09:03:54.374679+0000","last_clean":"2023-10-07T09:03:54.374679+0000","last_became_active":"2023-10-07T09:03:53.375138+0000","last_became_peered":"2023-10-07T09:03:53.375138+0000","last_unstale":"2023-10-07T09:03:54.374679+0000","last_undegraded":"2023-10-07T09:03:54.374679+0000","last_fullsized":"2023-10-07T09:03:54.374679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:08:35.158870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.388728+0000","last_change":"2023-10-07T09:03:54.388728+0000","last_active":"2023-10-07T09:03:54.388728+0000","last_peered":"2023-10-07T09:03:54.388728+0000","last_clean":"2023-10-07T09:03:54.388728+0000","last_became_active":"2023-10-07T09:03:54.388208+0000","last_became_peered":"2023-10-07T09:03:54.388208+0000","last_unstale":"2023-10-07T09:03:54.388728+0000","last_undegraded":"2023-10-07T09:03:54.388728+0000","last_fullsized":"2023-10-07T09:03:54.388728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:47.926672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380728+0000","last_change":"2023-10-07T09:03:53.378418+0000","last_active":"2023-10-07T09:03:53.380728+0000","last_peered":"2023-10-07T09:03:53.380728+0000","last_clean":"2023-10-07T09:03:53.380728+0000","last_became_active":"2023-10-07T09:03:53.378135+0000","last_became_peered":"2023-10-07T09:03:53.378135+0000","last_unstale":"2023-10-07T09:03:53.380728+0000","last_undegraded":"2023-10-07T09:03:53.380728+0000","last_fullsized":"2023-10-07T09:03:53.380728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:54.322902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392132+0000","last_change":"2023-10-07T09:03:54.384923+0000","last_active":"2023-10-07T09:03:54.392132+0000","last_peered":"2023-10-07T09:03:54.392132+0000","last_clean":"2023-10-07T09:03:54.392132+0000","last_became_active":"2023-10-07T09:03:54.384568+0000","last_became_peered":"2023-10-07T09:03:54.384568+0000","last_unstale":"2023-10-07T09:03:54.392132+0000","last_undegraded":"2023-10-07T09:03:54.392132+0000","last_fullsized":"2023-10-07T09:03:54.392132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:43.717297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379234+0000","last_change":"2023-10-07T09:03:53.376580+0000","last_active":"2023-10-07T09:03:53.379234+0000","last_peered":"2023-10-07T09:03:53.379234+0000","last_clean":"2023-10-07T09:03:53.379234+0000","last_became_active":"2023-10-07T09:03:53.376340+0000","last_became_peered":"2023-10-07T09:03:53.376340+0000","last_unstale":"2023-10-07T09:03:53.379234+0000","last_undegraded":"2023-10-07T09:03:53.379234+0000","last_fullsized":"2023-10-07T09:03:53.379234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:04.254900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386169+0000","last_change":"2023-10-07T09:03:54.379002+0000","last_active":"2023-10-07T09:03:54.386169+0000","last_peered":"2023-10-07T09:03:54.386169+0000","last_clean":"2023-10-07T09:03:54.386169+0000","last_became_active":"2023-10-07T09:03:54.378739+0000","last_became_peered":"2023-10-07T09:03:54.378739+0000","last_unstale":"2023-10-07T09:03:54.386169+0000","last_undegraded":"2023-10-07T09:03:54.386169+0000","last_fullsized":"2023-10-07T09:03:54.386169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:52:56.302361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.380647+0000","last_change":"2023-10-07T09:03:53.377537+0000","last_active":"2023-10-07T09:03:53.380647+0000","last_peered":"2023-10-07T09:03:53.380647+0000","last_clean":"2023-10-07T09:03:53.380647+0000","last_became_active":"2023-10-07T09:03:53.377242+0000","last_became_peered":"2023-10-07T09:03:53.377242+0000","last_unstale":"2023-10-07T09:03:53.380647+0000","last_undegraded":"2023-10-07T09:03:53.380647+0000","last_fullsized":"2023-10-07T09:03:53.380647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:42.710975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.394399+0000","last_change":"2023-10-07T09:03:54.394399+0000","last_active":"2023-10-07T09:03:54.394399+0000","last_peered":"2023-10-07T09:03:54.394399+0000","last_clean":"2023-10-07T09:03:54.394399+0000","last_became_active":"2023-10-07T09:03:54.394088+0000","last_became_peered":"2023-10-07T09:03:54.394088+0000","last_unstale":"2023-10-07T09:03:54.394399+0000","last_undegraded":"2023-10-07T09:03:54.394399+0000","last_fullsized":"2023-10-07T09:03:54.394399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:08.786784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.375688+0000","last_change":"2023-10-07T09:03:53.371015+0000","last_active":"2023-10-07T09:03:54.375688+0000","last_peered":"2023-10-07T09:03:54.375688+0000","last_clean":"2023-10-07T09:03:54.375688+0000","last_became_active":"2023-10-07T09:03:53.370658+0000","last_became_peered":"2023-10-07T09:03:53.370658+0000","last_unstale":"2023-10-07T09:03:54.375688+0000","last_undegraded":"2023-10-07T09:03:54.375688+0000","last_fullsized":"2023-10-07T09:03:54.375688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:01.241179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.392479+0000","last_change":"2023-10-07T09:03:54.387987+0000","last_active":"2023-10-07T09:03:54.392479+0000","last_peered":"2023-10-07T09:03:54.392479+0000","last_clean":"2023-10-07T09:03:54.392479+0000","last_became_active":"2023-10-07T09:03:54.387719+0000","last_became_peered":"2023-10-07T09:03:54.387719+0000","last_unstale":"2023-10-07T09:03:54.392479+0000","last_undegraded":"2023-10-07T09:03:54.392479+0000","last_fullsized":"2023-10-07T09:03:54.392479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:55.969183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-07T09:03:53.379563+0000","last_change":"2023-10-07T09:03:53.376731+0000","last_active":"2023-10-07T09:03:53.379563+0000","last_peered":"2023-10-07T09:03:53.379563+0000","last_clean":"2023-10-07T09:03:53.379563+0000","last_became_active":"2023-10-07T09:03:53.376451+0000","last_became_peered":"2023-10-07T09:03:53.376451+0000","last_unstale":"2023-10-07T09:03:53.379563+0000","last_undegraded":"2023-10-07T09:03:53.379563+0000","last_fullsized":"2023-10-07T09:03:53.379563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:53.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.386089+0000","last_change":"2023-10-07T09:03:54.386089+0000","last_active":"2023-10-07T09:03:54.386089+0000","last_peered":"2023-10-07T09:03:54.386089+0000","last_clean":"2023-10-07T09:03:54.386089+0000","last_became_active":"2023-10-07T09:03:54.384687+0000","last_became_peered":"2023-10-07T09:03:54.384687+0000","last_unstale":"2023-10-07T09:03:54.386089+0000","last_undegraded":"2023-10-07T09:03:54.386089+0000","last_fullsized":"2023-10-07T09:03:54.386089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:21:30.734721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.378809+0000","last_change":"2023-10-07T09:03:53.373943+0000","last_active":"2023-10-07T09:03:54.378809+0000","last_peered":"2023-10-07T09:03:54.378809+0000","last_clean":"2023-10-07T09:03:54.378809+0000","last_became_active":"2023-10-07T09:03:53.373685+0000","last_became_peered":"2023-10-07T09:03:53.373685+0000","last_unstale":"2023-10-07T09:03:54.378809+0000","last_undegraded":"2023-10-07T09:03:54.378809+0000","last_fullsized":"2023-10-07T09:03:54.378809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:54:21.069225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.383877+0000","last_change":"2023-10-07T09:03:54.383039+0000","last_active":"2023-10-07T09:03:54.383877+0000","last_peered":"2023-10-07T09:03:54.383877+0000","last_clean":"2023-10-07T09:03:54.383877+0000","last_became_active":"2023-10-07T09:03:54.382786+0000","last_became_peered":"2023-10-07T09:03:54.382786+0000","last_unstale":"2023-10-07T09:03:54.383877+0000","last_undegraded":"2023-10-07T09:03:54.383877+0000","last_fullsized":"2023-10-07T09:03:54.383877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:53.357142+0000","last_clean_scrub_stamp":"2023-10-07T09:03:53.357142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:20.639059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.396757+0000","last_change":"2023-10-07T09:03:53.377118+0000","last_active":"2023-10-07T09:03:54.396757+0000","last_peered":"2023-10-07T09:03:54.396757+0000","last_clean":"2023-10-07T09:03:54.396757+0000","last_became_active":"2023-10-07T09:03:53.376810+0000","last_became_peered":"2023-10-07T09:03:53.376810+0000","last_unstale":"2023-10-07T09:03:54.396757+0000","last_undegraded":"2023-10-07T09:03:54.396757+0000","last_fullsized":"2023-10-07T09:03:54.396757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:03:52.350821+0000","last_clean_scrub_stamp":"2023-10-07T09:03:52.350821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:46.920351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-07T09:03:54.382342+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:03:54.382342+0000","last_peered":"2023-10-07T09:03:54.382342+0000","last_clean":"2023-10-07T09:03:54.382342+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:03:54.382342+0000","last_undegraded":"2023-10-07T09:03:54.382342+0000","last_fullsized":"2023-10-07T09:03:54.382342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298796,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073044,"statfs":{"total":96636764160,"available":96330797056,"internally_reserved":0,"allocated":1544192,"data_stored":995021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.627}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":405249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.84899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":411065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47099999999999997,"5min":0.63,"15min":0.63},"last":0.437},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35199999999999998,"15min":0.41399999999999998},"min":{"1min":0.223,"5min":0.221,"15min":0.221},"max":{"1min":0.49299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.39700000000000002},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.496,"15min":0.82799999999999996},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":11.32,"15min":11.32},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.504,"15min":0.85499999999999998},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.314},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.82699999999999996},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90000000000000002,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.84699999999999998},"min":{"1min":0.504,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89500000000000002,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.48599999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64600000000000002,"15min":0.77700000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":994985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.191,"15min":0.191},"max":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.317}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36299999999999999,"15min":0.38800000000000001},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53400000000000003,"5min":0.625,"15min":0.625},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.22,"15min":0.22},"max":{"1min":0.48099999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.437}]},{"osd":4,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.625},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76600000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.754,"5min":1,"15min":1},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":1.006,"15min":1.006},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61599999999999999,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.748,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":405137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.41199999999999998,"15min":0.64900000000000002},"min":{"1min":0.23100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47999999999999998,"5min":10.214,"15min":10.214},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.53600000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.755,"15min":0.755},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.47699999999999998,"15min":0.70799999999999996},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":10.144,"15min":10.144},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.496,"15min":0.77100000000000002},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59199999999999997,"5min":10.071,"15min":10.071},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.51600000000000001,"15min":0.78500000000000003},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":10.183,"15min":10.183},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.76500000000000001,"15min":1.2450000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78800000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.498}]},{"osd":6,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.441},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.81499999999999995,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.745,"5min":1.125,"15min":1.125},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":406119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.371}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.25},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.39500000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.46000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":404583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59699999999999998,"15min":0.88300000000000001},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72299999999999998,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.60099999999999998,"15min":0.75700000000000001},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73199999999999998,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.64800000000000002,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.93899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.67500000000000004,"15min":0.97299999999999998},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":10.01,"15min":10.01},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58199999999999996,"15min":0.75},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":5.569,"15min":5.569},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65000000000000002,"15min":0.93799999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66700000000000004,"5min":10.131,"15min":10.131},"last":0.502}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48399999999999999,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64200000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":412429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.32000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.47999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.46800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":0.879},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.433}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.503},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.47599999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.626},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:03:58.874 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:03:58.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:03:59.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.033+0000 7f5857916700 1 Processor -- start 2023-10-07T09:03:59.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 -- start start 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5850069c70 0x7f58500cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58500af320 0x7f58500cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500ce380 con 0x7f5850159950 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500cec20 con 0x7f58500af320 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.034+0000 7f5857916700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500afa90 con 0x7f5850069c70 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58500af320 0x7f58500cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f58556b2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5850159950 0x7f5850069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41642/0 (socket says 172.21.15.46:41642) 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f58556b2700 1 -- 172.21.15.46:0/3511723839 learned_addr learned my addr 172.21.15.46:0/3511723839 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5854eb1700 1 --2- 172.21.15.46:0/3511723839 >> v2:172.21.15.133:3300/0 conn(0x7f5850069c70 0x7f58500cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 -- 172.21.15.46:0/3511723839 >> v2:172.21.15.133:3300/0 conn(0x7f5850069c70 msgr2=0x7f58500cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 --2- 172.21.15.46:0/3511723839 >> v2:172.21.15.133:3300/0 conn(0x7f5850069c70 0x7f58500cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 -- 172.21.15.46:0/3511723839 >> v1:172.21.15.46:6789/0 conn(0x7f5850159950 legacy=0x7f5850069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f584ffff700 1 -- 172.21.15.46:0/3511723839 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223992839 0 0) 0x7f58500ce380 con 0x7f5850159950 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 -- 172.21.15.46:0/3511723839 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500ce5d0 con 0x7f58500af320 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f5855eb3700 1 --2- 172.21.15.46:0/3511723839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58500af320 0x7f58500cf0b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f585015d450 tx=0x7f5840009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb4f37504e703c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f584ffff700 1 -- 172.21.15.46:0/3511723839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584000e070 con 0x7f58500af320 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f584ffff700 1 -- 172.21.15.46:0/3511723839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584000bb60 con 0x7f58500af320 2023-10-07T09:03:59.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.035+0000 7f584ffff700 1 -- 172.21.15.46:0/3511723839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840012430 con 0x7f58500af320 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 -- 172.21.15.46:0/3511723839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58500af320 msgr2=0x7f58500cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 --2- 172.21.15.46:0/3511723839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58500af320 0x7f58500cf0b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f585015d450 tx=0x7f5840009780 comp rx=0 tx=0).stop 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 -- 172.21.15.46:0/3511723839 shutdown_connections 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 --2- 172.21.15.46:0/3511723839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58500af320 0x7f58500cf0b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 --2- 172.21.15.46:0/3511723839 >> v2:172.21.15.133:3300/0 conn(0x7f5850069c70 0x7f58500cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 -- 172.21.15.46:0/3511723839 >> 172.21.15.46:0/3511723839 conn(0x7f5850068e00 msgr2=0x7f58500d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 -- 172.21.15.46:0/3511723839 shutdown_connections 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.036+0000 7f5857916700 1 -- 172.21.15.46:0/3511723839 wait complete. 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.037+0000 7f5857916700 1 Processor -- start 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.037+0000 7f5857916700 1 -- start start 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850069c70 0x7f58500b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58500af320 0x7f58500c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b41c0 con 0x7f5850159950 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c8240 con 0x7f58500af320 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5857916700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c8520 con 0x7f5850069c70 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36300/0 (socket says 172.21.15.46:36300) 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 -- 172.21.15.46:0/2778719425 learned_addr learned my addr 172.21.15.46:0/2778719425 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5854eb1700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58500af320 0x7f58500c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f58556b2700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850069c70 0x7f58500b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 -- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850069c70 msgr2=0x7f58500b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850069c70 0x7f58500b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 -- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58500af320 msgr2=0x7f58500c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58500af320 0x7f58500c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.038+0000 7f5855eb3700 1 -- 172.21.15.46:0/2778719425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840009a20 con 0x7f5850159950 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f5855eb3700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5850070e20 tx=0x7f5840019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840027470 con 0x7f5850159950 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58400275d0 con 0x7f5850159950 2023-10-07T09:03:59.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840027990 con 0x7f5850159950 2023-10-07T09:03:59.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585015ad90 con 0x7f5850159950 2023-10-07T09:03:59.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.039+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58500c8800 con 0x7f5850159950 2023-10-07T09:03:59.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.040+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585015b2b0 con 0x7f5850159950 2023-10-07T09:03:59.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.040+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5840024070 con 0x7f5850159950 2023-10-07T09:03:59.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.040+0000 7f584d7fa700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 0x7f583c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.041+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58400871d0 con 0x7f5850159950 2023-10-07T09:03:59.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.041+0000 7f58556b2700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 0x7f583c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.041+0000 7f58556b2700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 0x7f583c069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f585016ce00 tx=0x7f5848007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.045+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f585015b2b0 con 0x7f5850159950 2023-10-07T09:03:59.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.319+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f585015b2b0 con 0x7f5850159950 2023-10-07T09:03:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.323+0000 7f584d7fa700 1 -- 172.21.15.46:0/2778719425 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f585015b2b0 con 0x7f5850159950 2023-10-07T09:03:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 msgr2=0x7f583c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 0x7f583c069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f585016ce00 tx=0x7f5848007f50 comp rx=0 tx=0).stop 2023-10-07T09:03:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 msgr2=0x7f58500d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5850070e20 tx=0x7f5840019000 comp rx=0 tx=0).stop 2023-10-07T09:03:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 shutdown_connections 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f583c067170 0x7f583c069620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5850159950 0x7f58500d0780 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850069c70 0x7f58500b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 --2- 172.21.15.46:0/2778719425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58500af320 0x7f58500c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 >> 172.21.15.46:0/2778719425 conn(0x7f5850068e00 msgr2=0x7f58500c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 shutdown_connections 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.325+0000 7f5857916700 1 -- 172.21.15.46:0/2778719425 wait complete. 2023-10-07T09:03:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:03:59.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:03:59.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.457+0000 7fb8699ad700 1 Processor -- start 2023-10-07T09:03:59.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.457+0000 7fb8699ad700 1 -- start start 2023-10-07T09:03:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8699ad700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8641597f0 0x7fb8640b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8699ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb86415d230 0x7fb86415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8699ad700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86415db70 con 0x7fb864159420 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8699ad700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640b11d0 con 0x7fb8641597f0 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8699ad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640b14b0 con 0x7fb86415d230 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb863fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8641597f0 0x7fb8640b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8689ab700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb864159420 0x7fb8640b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41650/0 (socket says 172.21.15.46:41650) 2023-10-07T09:03:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8689ab700 1 -- 172.21.15.46:0/1488750186 learned_addr learned my addr 172.21.15.46:0/1488750186 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb8691ac700 1 --2- 172.21.15.46:0/1488750186 >> v2:172.21.15.133:3300/0 conn(0x7fb86415d230 0x7fb86415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb863fff700 1 -- 172.21.15.46:0/1488750186 >> v2:172.21.15.133:3300/0 conn(0x7fb86415d230 msgr2=0x7fb86415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.458+0000 7fb863fff700 1 --2- 172.21.15.46:0/1488750186 >> v2:172.21.15.133:3300/0 conn(0x7fb86415d230 0x7fb86415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb863fff700 1 -- 172.21.15.46:0/1488750186 >> v1:172.21.15.46:6789/0 conn(0x7fb864159420 legacy=0x7fb8640b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb863fff700 1 -- 172.21.15.46:0/1488750186 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640b1790 con 0x7fb8641597f0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8637fe700 1 -- 172.21.15.46:0/1488750186 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830519484 0 0) 0x7fb86415db70 con 0x7fb864159420 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb863fff700 1 --2- 172.21.15.46:0/1488750186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb8640b2270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb86415d170 tx=0x7fb8580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce7569a9c32743c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8637fe700 1 -- 172.21.15.46:0/1488750186 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800b6b0 con 0x7fb8641597f0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8637fe700 1 -- 172.21.15.46:0/1488750186 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800b810 con 0x7fb8641597f0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8637fe700 1 -- 172.21.15.46:0/1488750186 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800bbb0 con 0x7fb8641597f0 2023-10-07T09:03:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8699ad700 1 -- 172.21.15.46:0/1488750186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 msgr2=0x7fb8640b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8699ad700 1 --2- 172.21.15.46:0/1488750186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb8640b2270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb86415d170 tx=0x7fb8580091a0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8699ad700 1 -- 172.21.15.46:0/1488750186 shutdown_connections 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8699ad700 1 --2- 172.21.15.46:0/1488750186 >> v2:172.21.15.133:3300/0 conn(0x7fb86415d230 0x7fb86415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.459+0000 7fb8699ad700 1 --2- 172.21.15.46:0/1488750186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb8640b2270 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.460+0000 7fb8699ad700 1 -- 172.21.15.46:0/1488750186 >> 172.21.15.46:0/1488750186 conn(0x7fb8640d0660 msgr2=0x7fb8640d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.460+0000 7fb8699ad700 1 -- 172.21.15.46:0/1488750186 shutdown_connections 2023-10-07T09:03:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.460+0000 7fb8699ad700 1 -- 172.21.15.46:0/1488750186 wait complete. 2023-10-07T09:03:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.461+0000 7fb8699ad700 1 Processor -- start 2023-10-07T09:03:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.461+0000 7fb8699ad700 1 -- start start 2023-10-07T09:03:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb864159420 0x7fb86415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 0x7fb864155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415ac10 con 0x7fb8641597f0 2023-10-07T09:03:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415cd80 con 0x7fb86415d230 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415c170 con 0x7fb864159420 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36314/0 (socket says 172.21.15.46:36314) 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 -- 172.21.15.46:0/3637042049 learned_addr learned my addr 172.21.15.46:0/3637042049 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8691ac700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 0x7fb864155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8689ab700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb864159420 0x7fb86415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 -- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb864159420 msgr2=0x7fb86415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb864159420 0x7fb86415bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 -- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 msgr2=0x7fb864155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 0x7fb864155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 -- 172.21.15.46:0/3637042049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009420 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8691ac700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 0x7fb864155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb863fff700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb858013000 tx=0x7fb858017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011420 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858011580 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86415c450 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.462+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011920 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.463+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86415ca10 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.463+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86415cf10 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.464+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb858011d10 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.464+0000 7fb860ff9700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 0x7fb850069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.464+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb858086360 con 0x7fb8641597f0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.464+0000 7fb8689ab700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 0x7fb850069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:03:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.465+0000 7fb8689ab700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 0x7fb850069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8540011e0 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:03:59.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.468+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8580533c0 con 0x7fb8641597f0 2023-10-07T09:03:59.680 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-10-07T09:03:59.680+0000 7f10c0282700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:03:59.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.705+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb86404c3c0 con 0x7fb8641597f0 2023-10-07T09:03:59.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.706+0000 7fb860ff9700 1 -- 172.21.15.46:0/3637042049 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fb8580569e0 con 0x7fb8641597f0 2023-10-07T09:03:59.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:03:59.707 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 msgr2=0x7fb850069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 0x7fb850069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8540011e0 tx=0x7fb854009040 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 msgr2=0x7fb86415a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb858013000 tx=0x7fb858017000 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 shutdown_connections 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb850067170 0x7fb850069620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb86415d230 0x7fb864155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb864159420 0x7fb86415bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 --2- 172.21.15.46:0/3637042049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8641597f0 0x7fb86415a6d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:03:59.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 >> 172.21.15.46:0/3637042049 conn(0x7fb8640d0660 msgr2=0x7fb864157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:03:59.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 shutdown_connections 2023-10-07T09:03:59.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:03:59.708+0000 7fb8699ad700 1 -- 172.21.15.46:0/3637042049 wait complete. 2023-10-07T09:03:59.710 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 47 2023-10-07T09:04:00.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:03:53.773708+0000', 'modified': '2023-10-07T09:03:57.384591+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6123}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6123': {'gid': 6123, 'name': 'b', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6836/2936476891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 2936476891}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 2936476891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:04:00.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:04:00.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T09:04:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.246+0000 7f1fe0a1a700 1 Processor -- start 2023-10-07T09:04:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.246+0000 7f1fe0a1a700 1 -- start start 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fe0a1a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1fdc159890 0x7f1fdc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fe0a1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 0x7f1fdc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fe0a1a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc15a160 con 0x7f1fdc15db10 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fe0a1a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0d13a0 con 0x7f1fdc159890 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fe0a1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc15e140 con 0x7f1fdc159c60 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fdad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1fdc15db10 0x7f1fdc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59418/0 (socket says 172.21.15.46:59418) 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fdad9d700 1 -- 172.21.15.46:0/1986368163 learned_addr learned my addr 172.21.15.46:0/1986368163 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.247+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1986368163 >> v2:172.21.15.133:3300/0 conn(0x7f1fdc159890 0x7f1fdc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 0x7f1fdc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd959a700 1 -- 172.21.15.46:0/1986368163 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198479729 0 0) 0x7f1fdc15a160 con 0x7f1fdc15db10 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd959a700 1 -- 172.21.15.46:0/1986368163 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc8003570 con 0x7f1fdc15db10 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fda59c700 1 -- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 msgr2=0x7f1fdc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 0x7f1fdc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fda59c700 1 -- 172.21.15.46:0/1986368163 >> v1:172.21.15.46:6789/0 conn(0x7f1fdc15db10 legacy=0x7f1fdc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fda59c700 1 -- 172.21.15.46:0/1986368163 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc15a3d0 con 0x7f1fdc159890 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 0x7f1fdc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc159890 0x7f1fdc15abd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0098e0 tx=0x7f1fcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4330b6cb5d1efd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd959a700 1 -- 172.21.15.46:0/1986368163 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc011630 con 0x7f1fdc159890 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd959a700 1 -- 172.21.15.46:0/1986368163 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc011790 con 0x7f1fdc159890 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.248+0000 7f1fd959a700 1 -- 172.21.15.46:0/1986368163 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc011b30 con 0x7f1fdc159890 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc159890 msgr2=0x7f1fdc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc159890 0x7f1fdc15abd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0098e0 tx=0x7f1fcc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1986368163 shutdown_connections 2023-10-07T09:04:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc159890 0x7f1fdc15abd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1986368163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159c60 0x7f1fdc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1986368163 >> 172.21.15.46:0/1986368163 conn(0x7f1fdc068e20 msgr2=0x7f1fdc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1986368163 shutdown_connections 2023-10-07T09:04:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.249+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1986368163 wait complete. 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.250+0000 7f1fe0a1a700 1 Processor -- start 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.250+0000 7f1fe0a1a700 1 -- start start 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 0x7f1fdc14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc15db10 0x7f1fdc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc14f650 con 0x7f1fdc159c60 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1501b0 con 0x7f1fdc15db10 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fe0a1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0b6450 con 0x7f1fdc159890 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36186/0 (socket says 172.21.15.46:36186) 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1100228948 learned_addr learned my addr 172.21.15.46:0/1100228948 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc15db10 0x7f1fdc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 0x7f1fdc14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 msgr2=0x7f1fdc14c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 0x7f1fdc14c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc15db10 msgr2=0x7f1fdc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc15db10 0x7f1fdc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1100228948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009420 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.251+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 0x7f1fdc14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ec80 tx=0x7f1fc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fd27fc700 1 -- 172.21.15.46:0/1100228948 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400c920 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fd27fc700 1 -- 172.21.15.46:0/1100228948 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400ca80 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc009420 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fd27fc700 1 -- 172.21.15.46:0/1100228948 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400ce20 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.252+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc14fb60 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.253+0000 7f1fd27fc700 1 -- 172.21.15.46:0/1100228948 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f1fc4013680 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.253+0000 7f1fd27fc700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 0x7f1fbc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.254+0000 7f1fd27fc700 1 -- 172.21.15.46:0/1100228948 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fc4084940 con 0x7f1fdc159c60 2023-10-07T09:04:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.254+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 0x7f1fbc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.254+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 0x7f1fbc069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0091e0 tx=0x7f1fcc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.255+0000 7f1fe9d12b80 1 Processor -- start 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 -- start start 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb87a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb5acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cab5a70 con 0x55ec4cb5ea50 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cab3270 con 0x55ec4cba8d00 2023-10-07T09:04:00.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec4caaf060 con 0x55ec4cb87f60 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fda59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fda59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36196/0 (socket says 172.21.15.46:36196) 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.256+0000 7f1fda59c700 1 -- 172.21.15.46:0/2819944437 learned_addr learned my addr 172.21.15.46:0/2819944437 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb5acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb87a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 -- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 msgr2=0x55ec4cb5acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb5acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 -- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 msgr2=0x55ec4cb87a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb87a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 -- 172.21.15.46:0/2819944437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec4c949270 con 0x55ec4cb5ea50 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fda59c700 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009ed0 tx=0x7f1fcc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f9a9de8a796a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fbb7fe700 1 -- 172.21.15.46:0/2819944437 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc020070 con 0x55ec4cb5ea50 2023-10-07T09:04:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fbb7fe700 1 -- 172.21.15.46:0/2819944437 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01aba0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.257+0000 7f1fbb7fe700 1 -- 172.21.15.46:0/2819944437 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc01ad50 con 0x55ec4cb5ea50 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/2819944437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 msgr2=0x55ec4cb5ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009ed0 tx=0x7f1fcc020000 comp rx=0 tx=0).stop 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/2819944437 shutdown_connections 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb5acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cb5ee20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/2819944437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb87a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/2819944437 >> 172.21.15.46:0/2819944437 conn(0x55ec4cb60370 msgr2=0x55ec4cb60740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/2819944437 shutdown_connections 2023-10-07T09:04:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.258+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/2819944437 wait complete. 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.259+0000 7f1fe9d12b80 1 -- start start 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.259+0000 7f1fe9d12b80 1 Processor -- start 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb9cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb5b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4ca5a890 con 0x55ec4cb5ea50 2023-10-07T09:04:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4ca75ea0 con 0x55ec4cba8d00 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec4c931e30 con 0x55ec4cb87f60 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 10 client.0 _ll_register_callbacks cb 0x55ec4cb22110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36200/0 (socket says 172.21.15.46:36200) 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 -- 172.21.15.46:0/1245149748 learned_addr learned my addr 172.21.15.46:0/1245149748 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb9cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb5b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 -- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 msgr2=0x55ec4cb9cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb9cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 -- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 msgr2=0x55ec4cb5b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb5b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 -- 172.21.15.46:0/1245149748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc15a3d0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb9cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0030c0 tx=0x7f1fcc02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7c383878ade91f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc020070 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fcc01b9d0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec4cb53b70 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.260+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fcc01bda0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 10 client.6255 fetch_fsmap learned FSMap version 47 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55ec4c8ebfe0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec4cb53b70 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1fcc03c440 con 0x55ec4cb5ea50 2023-10-07T09:04:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 10 client.6255 fetch_fsmap finished waiting for FSMap version 47 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 10 client.6255 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 20 client.6255 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cb9ebe0 0x55ec4cb9efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 4 client.6255 mds_command: new command op to 6123 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 --> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec4cb30aa0 con 0x55ec4cb9ebe0 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cb9ebe0 0x55ec4cb9efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fb8ff9700 10 client.6255 ms_handle_connect on v2:172.21.15.133:6834/2936476891 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.261+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cb9ebe0 0x55ec4cb9efb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2386d376432f29d9 server_cookie=bd9e19e6b6fa120 in_seq=0 out_seq=0 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1245149748 <== mds.0 v2:172.21.15.133:6834/2936476891 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ec4cb30aa0 con 0x55ec4cb9ebe0 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fb8ff9700 10 client.6255 handle_command_reply: tid=0 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 client.6255 shutdown 2023-10-07T09:04:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 msgr2=0x55ec4cba1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0030c0 tx=0x7f1fcc02b040 comp rx=0 tx=0).stop 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 shutdown_connections 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cb9ebe0 0x55ec4cb9efb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cb5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb5ea50 0x55ec4cba1200 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1245149748 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb87f60 0x55ec4cb9cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fb8ff9700 0 client.6255 ms_handle_reset on v2:172.21.15.133:6834/2936476891 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 >> 172.21.15.46:0/1245149748 conn(0x55ec4cb60370 msgr2=0x55ec4cba4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 shutdown_connections 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.262+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1245149748 wait complete. 2023-10-07T09:04:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.263+0000 7f1fe9d12b80 20 client.6255 trim_cache size 0 max 16384 2023-10-07T09:04:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.279+0000 7f1fe9d12b80 1 Processor -- start 2023-10-07T09:04:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.279+0000 7f1fe9d12b80 1 -- start start 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cba86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cb87f60 0x55ec4cb5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cba2d10 con 0x55ec4cba8d00 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cb60f10 con 0x55ec4cb87f60 2023-10-07T09:04:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cb9d490 con 0x55ec4cb5ea50 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36210/0 (socket says 172.21.15.46:36210) 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 -- 172.21.15.46:0/15878047 learned_addr learned my addr 172.21.15.46:0/15878047 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fda59c700 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cba86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cb87f60 0x55ec4cb5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 -- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 msgr2=0x55ec4cba86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cba86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 -- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cb87f60 msgr2=0x55ec4cb5f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cb87f60 0x55ec4cb5f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.280+0000 7f1fdad9d700 1 -- 172.21.15.46:0/15878047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec4ca7d780 con 0x55ec4cba8d00 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4007110 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73c5f775c8a7cc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fbbfff700 1 -- 172.21.15.46:0/15878047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4016420 con 0x55ec4cba8d00 2023-10-07T09:04:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fbbfff700 1 -- 172.21.15.46:0/15878047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4016580 con 0x55ec4cba8d00 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fbbfff700 1 -- 172.21.15.46:0/15878047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4016900 con 0x55ec4cba8d00 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/15878047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 msgr2=0x55ec4cba01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4007110 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/15878047 shutdown_connections 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cba8d00 0x55ec4cba01b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cba86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/15878047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cb87f60 0x55ec4cb5f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/15878047 >> 172.21.15.46:0/15878047 conn(0x55ec4cb60370 msgr2=0x55ec4cb574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/15878047 shutdown_connections 2023-10-07T09:04:00.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.281+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/15878047 wait complete. 2023-10-07T09:04:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.282+0000 7f1fe9d12b80 1 -- start start 2023-10-07T09:04:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.282+0000 7f1fe9d12b80 1 Processor -- start 2023-10-07T09:04:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cc0afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cba2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cb87ad0 con 0x55ec4cb87f60 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cb8b260 con 0x55ec4cba8d00 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec4cb877f0 con 0x55ec4cb5ea50 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fe9d12b80 10 client.0 _ll_register_callbacks cb 0x55ec4cb22110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36214/0 (socket says 172.21.15.46:36214) 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1668485831 learned_addr learned my addr 172.21.15.46:0/1668485831 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cc0afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cba2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 msgr2=0x55ec4cc0afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cc0afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 msgr2=0x55ec4cba2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cba2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 -- 172.21.15.46:0/1668485831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8003570 con 0x55ec4cb87f60 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fdad9d700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cba2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fd9d9b700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40552e0 tx=0x7f1fc4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c6271acf4df01f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.283+0000 7f1fb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4053a50 con 0x55ec4cb87f60 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fc4055a50 con 0x55ec4cb87f60 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fcc01aba0 con 0x55ec4cb87f60 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fc4054ce0 con 0x55ec4cb87f60 2023-10-07T09:04:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 10 client.6261 fetch_fsmap learned FSMap version 47 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55ec4ca64470 con 0x55ec4cb87f60 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01aba0 con 0x55ec4cb87f60 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1fc405c0f0 con 0x55ec4cb87f60 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 10 client.6261 fetch_fsmap finished waiting for FSMap version 47 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 10 client.6261 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 20 client.6261 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cbbab40 0x55ec4cbbaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 4 client.6261 mds_command: new command op to 6123 tid=0[{"prefix": "status"}] 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 --> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ec4ca51e00 con 0x55ec4cbbab40 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.284+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cbbab40 0x55ec4cbbaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fb8ff9700 10 client.6261 ms_handle_connect on v2:172.21.15.133:6834/2936476891 2023-10-07T09:04:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fda59c700 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cbbab40 0x55ec4cbbaf10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e11431fb656d9c90 server_cookie=60e47e7ceec7f11e in_seq=0 out_seq=0 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fb8ff9700 1 -- 172.21.15.46:0/1668485831 <== mds.0 v2:172.21.15.133:6834/2936476891 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55ec4ca51e00 con 0x55ec4cbbab40 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fb8ff9700 10 client.6261 handle_command_reply: tid=0 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 client.6261 shutdown 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 msgr2=0x55ec4cba1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40552e0 tx=0x7f1fc4015040 comp rx=0 tx=0).stop 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 shutdown_connections 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:6834/2936476891,v1:172.21.15.133:6836/2936476891] conn(0x55ec4cbbab40 0x55ec4cbbaf10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ec4cba8d00 0x55ec4cba2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ec4cb5ea50 0x55ec4cc0afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 --2- 172.21.15.46:0/1668485831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec4cb87f60 0x55ec4cba1c50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fb8ff9700 0 client.6261 ms_handle_reset on v2:172.21.15.133:6834/2936476891 2023-10-07T09:04:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 >> 172.21.15.46:0/1668485831 conn(0x55ec4cb60370 msgr2=0x55ec4cb5f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 shutdown_connections 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 1 -- 172.21.15.46:0/1668485831 wait complete. 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.285+0000 7f1fe9d12b80 20 client.6261 trim_cache size 0 max 16384 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 6123, 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:04:00.293 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.909122838, 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 47, 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 78, 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 78, 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.98847883 2023-10-07T09:04:00.294 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 msgr2=0x7f1fbc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 0x7f1fbc069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0091e0 tx=0x7f1fcc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 msgr2=0x7f1fdc0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ec80 tx=0x7f1fc40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 shutdown_connections 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1fbc067170 0x7f1fbc069620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc15db10 0x7f1fdc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fdc159890 0x7f1fdc14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 --2- 172.21.15.46:0/1100228948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fdc159c60 0x7f1fdc0b3590 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 >> 172.21.15.46:0/1100228948 conn(0x7f1fdc068e20 msgr2=0x7f1fdc0c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 shutdown_connections 2023-10-07T09:04:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.286+0000 7f1fe0a1a700 1 -- 172.21.15.46:0/1100228948 wait complete. 2023-10-07T09:04:00.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.417+0000 7fdfac5d1700 1 Processor -- start 2023-10-07T09:04:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.417+0000 7fdfac5d1700 1 -- start start 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfac5d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa415d730 0x7fdfa415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfac5d1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdfa406a410 0x7fdfa406a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfac5d1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa40c74b0 con 0x7fdfa4159b10 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfac5d1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40c8700 con 0x7fdfa406a410 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfac5d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40c9070 con 0x7fdfa415d730 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfaab6e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdfa406a410 0x7fdfa406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfaa36d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdfa4159b10 0x7fdfa40cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59422/0 (socket says 172.21.15.46:59422) 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.418+0000 7fdfaa36d700 1 -- 172.21.15.46:0/4031794436 learned_addr learned my addr 172.21.15.46:0/4031794436 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfa9b6c700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa415d730 0x7fdfa415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfaab6e700 1 -- 172.21.15.46:0/4031794436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa415d730 msgr2=0x7fdfa415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfaab6e700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa415d730 0x7fdfa415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfaab6e700 1 -- 172.21.15.46:0/4031794436 >> v1:172.21.15.46:6789/0 conn(0x7fdfa4159b10 legacy=0x7fdfa40cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfa936b700 1 -- 172.21.15.46:0/4031794436 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115107540 0 0) 0x7fdfa40c74b0 con 0x7fdfa4159b10 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfaab6e700 1 -- 172.21.15.46:0/4031794436 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa415e0e0 con 0x7fdfa406a410 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfaab6e700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa406a410 0x7fdfa406a890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009e60 tx=0x7fdf9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4aa225fe8d01b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfa936b700 1 -- 172.21.15.46:0/4031794436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00e070 con 0x7fdfa406a410 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfa936b700 1 -- 172.21.15.46:0/4031794436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00bcc0 con 0x7fdfa406a410 2023-10-07T09:04:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.419+0000 7fdfa936b700 1 -- 172.21.15.46:0/4031794436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c012680 con 0x7fdfa406a410 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 -- 172.21.15.46:0/4031794436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa406a410 msgr2=0x7fdfa406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa406a410 0x7fdfa406a890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009e60 tx=0x7fdf9c009780 comp rx=0 tx=0).stop 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 -- 172.21.15.46:0/4031794436 shutdown_connections 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa406a410 0x7fdfa406a890 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/4031794436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa415d730 0x7fdfa415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 -- 172.21.15.46:0/4031794436 >> 172.21.15.46:0/4031794436 conn(0x7fdfa40c9870 msgr2=0x7fdfa40c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 -- 172.21.15.46:0/4031794436 shutdown_connections 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.420+0000 7fdfac5d1700 1 -- 172.21.15.46:0/4031794436 wait complete. 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.421+0000 7fdfac5d1700 1 Processor -- start 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.421+0000 7fdfac5d1700 1 -- start start 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 0x7fdfa40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 0x7fdfa4152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40b0710 con 0x7fdfa415d730 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4152af0 con 0x7fdfa406a410 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4152dd0 con 0x7fdfa4159b10 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36232/0 (socket says 172.21.15.46:36232) 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 -- 172.21.15.46:0/2618506276 learned_addr learned my addr 172.21.15.46:0/2618506276 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 -- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 msgr2=0x7fdfa4152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfa9b6c700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 0x7fdfa4152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaa36d700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 0x7fdfa40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 0x7fdfa4152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 -- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 msgr2=0x7fdfa40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 0x7fdfa40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 -- 172.21.15.46:0/2618506276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c009a20 con 0x7fdfa415d730 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaa36d700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 0x7fdfa40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfa9b6c700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 0x7fdfa4152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfaab6e700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00b6c0 tx=0x7fdf9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c01d630 con 0x7fdfa415d730 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c01d7b0 con 0x7fdfa415d730 2023-10-07T09:04:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa41530b0 con 0x7fdfa415d730 2023-10-07T09:04:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c01db70 con 0x7fdfa415d730 2023-10-07T09:04:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.422+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40b28e0 con 0x7fdfa415d730 2023-10-07T09:04:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.423+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40b08c0 con 0x7fdfa415d730 2023-10-07T09:04:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.424+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdf9c024070 con 0x7fdfa415d730 2023-10-07T09:04:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.424+0000 7fdfa27fc700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 0x7fdf90069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.424+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf9c087290 con 0x7fdfa415d730 2023-10-07T09:04:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.424+0000 7fdfaa36d700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 0x7fdf90069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.425+0000 7fdfaa36d700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 0x7fdf90069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdf940018d0 tx=0x7fdf94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.429+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa40b08c0 con 0x7fdfa415d730 2023-10-07T09:04:00.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.664+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfa404c3c0 con 0x7fdfa415d730 2023-10-07T09:04:00.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.664+0000 7fdfa27fc700 1 -- 172.21.15.46:0/2618506276 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdf9c054320 con 0x7fdfa415d730 2023-10-07T09:04:00.665 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 msgr2=0x7fdf90069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 0x7fdf90069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdf940018d0 tx=0x7fdf94009040 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 msgr2=0x7fdfa414e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00b6c0 tx=0x7fdf9c019000 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 shutdown_connections 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdf90067170 0x7fdf90069620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfa415d730 0x7fdfa414e290 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa406a410 0x7fdfa40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 --2- 172.21.15.46:0/2618506276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfa4159b10 0x7fdfa4152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.666+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 >> 172.21.15.46:0/2618506276 conn(0x7fdfa40c9870 msgr2=0x7fdfa4154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:00.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.667+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 shutdown_connections 2023-10-07T09:04:00.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:00.667+0000 7fdfac5d1700 1 -- 172.21.15.46:0/2618506276 wait complete. 2023-10-07T09:04:00.679 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:00.679 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:00.679 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:04:00.679 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:04:00.680 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:00.680 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:00.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:00.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:00.680 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:00.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.680 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:04:00.696 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:00.696 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:00.696 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:00.697 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42173sec preferred_lft 42173sec 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:00.698 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:04:00.699 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:00.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.700 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:00.760 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:04:00.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.762 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:04:00.818 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:04:00.819 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:00.819 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:04:00.819 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:04:00.819 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:00.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.819 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:04:00.819 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:04:00.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:04:00.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:04:00.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:04:00.820 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:04:00.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.921 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:04:00.935 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:04:00.936 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:04:00.936 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:00.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:00.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:04:01.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:01.000 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:01.056 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:01.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:01.056 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:01.111 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:04:01.112 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:01.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:01.212 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:01.213 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:01.213 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:01.236 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:01.236 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:01.236 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:01.236 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:01.236 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:01.237 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:01.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:01.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.463+0000 7f8f6a4e2700 1 Processor -- start 2023-10-07T09:04:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 -- start start 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f64159b10 0x7f8f640cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6406b420 0x7f8f6415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640c74b0 con 0x7f8f6415d730 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640c8700 con 0x7f8f64159b10 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f6a4e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640c9070 con 0x7f8f6406b420 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.464+0000 7f8f63fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f64159b10 0x7f8f640cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f64159b10 0x7f8f640cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36234/0 (socket says 172.21.15.46:36234) 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 -- 172.21.15.46:0/2152468484 learned_addr learned my addr 172.21.15.46:0/2152468484 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f68a7f700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6406b420 0x7f8f6415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 -- 172.21.15.46:0/2152468484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6406b420 msgr2=0x7f8f6415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6406b420 0x7f8f6415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 -- 172.21.15.46:0/2152468484 >> v1:172.21.15.133:6789/0 conn(0x7f8f6415d730 legacy=0x7f8f64159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 -- 172.21.15.46:0/2152468484 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6415e0e0 con 0x7f8f64159b10 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f63fff700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f64159b10 0x7f8f640cb3e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f540099b0 tx=0x7f8f54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17a8848612bf63b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f62ffd700 1 -- 172.21.15.46:0/2152468484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400b8f0 con 0x7f8f64159b10 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f62ffd700 1 -- 172.21.15.46:0/2152468484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5400ba50 con 0x7f8f64159b10 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.465+0000 7f8f62ffd700 1 -- 172.21.15.46:0/2152468484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400bdf0 con 0x7f8f64159b10 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2152468484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f64159b10 msgr2=0x7f8f640cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f64159b10 0x7f8f640cb3e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f540099b0 tx=0x7f8f54009250 comp rx=0 tx=0).stop 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2152468484 shutdown_connections 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6406b420 0x7f8f6415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2152468484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f64159b10 0x7f8f640cb3e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2152468484 >> 172.21.15.46:0/2152468484 conn(0x7f8f640c9870 msgr2=0x7f8f640c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:01.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2152468484 shutdown_connections 2023-10-07T09:04:01.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.466+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2152468484 wait complete. 2023-10-07T09:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.467+0000 7f8f6a4e2700 1 Processor -- start 2023-10-07T09:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.467+0000 7f8f6a4e2700 1 -- start start 2023-10-07T09:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 0x7f8f640c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 0x7f8f6415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b0e30 con 0x7f8f6406b420 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b1940 con 0x7f8f64159b10 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f6a4e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b1010 con 0x7f8f6415d730 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36246/0 (socket says 172.21.15.46:36246) 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 -- 172.21.15.46:0/2267347992 learned_addr learned my addr 172.21.15.46:0/2267347992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f637fe700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 0x7f8f640c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f68a7f700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 0x7f8f6415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 -- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 msgr2=0x7f8f6415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 0x7f8f6415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 -- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 msgr2=0x7f8f640c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 0x7f8f640c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 -- 172.21.15.46:0/2267347992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540094f0 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f68a7f700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 0x7f8f6415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f637fe700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 0x7f8f640c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.468+0000 7f8f63fff700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f6406cc50 tx=0x7f8f54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.469+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54024440 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.469+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f540245c0 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.469+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640b12f0 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.469+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54024980 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.469+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64154e50 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.470+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6404c3c0 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.470+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8f5401a420 con 0x7f8f6406b420 2023-10-07T09:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.471+0000 7f8f4bfff700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 0x7f8f50069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.471+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f54086960 con 0x7f8f6406b420 2023-10-07T09:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.471+0000 7f8f637fe700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 0x7f8f50069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.471+0000 7f8f637fe700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 0x7f8f50069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8f640c4720 tx=0x7f8f58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.475+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f54053940 con 0x7f8f6406b420 2023-10-07T09:04:01.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.715+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f640c8e20 con 0x7f8f6406b420 2023-10-07T09:04:01.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.715+0000 7f8f4bfff700 1 -- 172.21.15.46:0/2267347992 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f54015070 con 0x7f8f6406b420 2023-10-07T09:04:01.716 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 msgr2=0x7f8f50069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 0x7f8f50069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8f640c4720 tx=0x7f8f58009040 comp rx=0 tx=0).stop 2023-10-07T09:04:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 msgr2=0x7f8f64154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f6406cc50 tx=0x7f8f54017000 comp rx=0 tx=0).stop 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 shutdown_connections 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f50067170 0x7f8f50069620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6415d730 0x7f8f6415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f6406b420 0x7f8f64154910 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 --2- 172.21.15.46:0/2267347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f64159b10 0x7f8f640c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 >> 172.21.15.46:0/2267347992 conn(0x7f8f640c9870 msgr2=0x7f8f64155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 shutdown_connections 2023-10-07T09:04:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:01.717+0000 7f8f6a4e2700 1 -- 172.21.15.46:0/2267347992 wait complete. 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:01.730 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:01.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:01.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.731 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:04:01.749 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42164sec preferred_lft 42164sec 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:01.751 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:04:01.752 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:01.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.753 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:01.818 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:04:01.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.820 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:04:01.879 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:04:01.879 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:01.879 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:04:01.879 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:04:01.879 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:01.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:04:01.880 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:04:01.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:01.987 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:04:02.003 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:04:02.003 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:04:02.003 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:02.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:02.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:04:02.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:02.070 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:02.125 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:02.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:02.126 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:02.181 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:04:02.181 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:02.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:02.262 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:02.262 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:02.281 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:02.281 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:02.281 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:02.281 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:02.281 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:02.282 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:02.282 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:02.282 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:02.303 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:02.303 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:02.303 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:02.303 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:02.303 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:02.305 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:02.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:02.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:02.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:04:02.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 Processor -- start 2023-10-07T09:04:02.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 -- start start 2023-10-07T09:04:02.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc4c0cf350 0x7fbc4c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c0b5b00 con 0x7fbc4c0b53d0 2023-10-07T09:04:02.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c0b5da0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.508+0000 7fbc5215d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c0b6080 con 0x7fbc4c159ec0 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc4c0cf350 0x7fbc4c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc4c0b53d0 0x7fbc4c0cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:53242/0 (socket says 172.21.15.46:53242) 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc4c0cf350 0x7fbc4c0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:54290/0 (socket says 172.21.15.46:54290) 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:50642/0 (socket says 172.21.15.46:50642) 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 -- 172.21.15.46:0/1416180200 learned_addr learned my addr 172.21.15.46:0/1416180200 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 -- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 msgr2=0x7fbc4c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 -- 172.21.15.46:0/1416180200 >> v1:172.21.15.133:6789/0 conn(0x7fbc4c0b53d0 legacy=0x7fbc4c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:02.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 -- 172.21.15.46:0/1416180200 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0cc100 con 0x7fbc4c0cf350 2023-10-07T09:04:02.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4b7fe700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:02.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.509+0000 7fbc4bfff700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009f20 tx=0x7fbc44009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5741495ea16bf0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:02.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc4a7fc700 1 -- 172.21.15.46:0/1416180200 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400e070 con 0x7fbc4c0cf350 2023-10-07T09:04:02.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc4a7fc700 1 -- 172.21.15.46:0/1416180200 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4400b9d0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc4a7fc700 1 -- 172.21.15.46:0/1416180200 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc440092e0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 -- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0cf350 msgr2=0x7fbc4c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:02.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009f20 tx=0x7fbc44009840 comp rx=0 tx=0).stop 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 -- 172.21.15.46:0/1416180200 shutdown_connections 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 --2- 172.21.15.46:0/1416180200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 -- 172.21.15.46:0/1416180200 >> 172.21.15.46:0/1416180200 conn(0x7fbc4c0999f0 msgr2=0x7fbc4c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 -- 172.21.15.46:0/1416180200 shutdown_connections 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.510+0000 7fbc5215d700 1 -- 172.21.15.46:0/1416180200 wait complete. 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.511+0000 7fbc5215d700 1 Processor -- start 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.511+0000 7fbc5215d700 1 -- start start 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0b53d0 0x7fbc4c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c069760 con 0x7fbc4c0cf350 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156180 con 0x7fbc4c0b53d0 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc5215d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156460 con 0x7fbc4c159ec0 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc4affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc4affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36262/0 (socket says 172.21.15.46:36262) 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc4affd700 1 -- 172.21.15.46:0/4285449762 learned_addr learned my addr 172.21.15.46:0/4285449762 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc4b7fe700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0b53d0 0x7fbc4c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.512+0000 7fbc4bfff700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 -- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 msgr2=0x7fbc4c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:02.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 -- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0b53d0 msgr2=0x7fbc4c068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0b53d0 0x7fbc4c068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 -- 172.21.15.46:0/4285449762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0093c0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc4affd700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7c0 tx=0x7fbc40007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40005a70 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40005bd0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400070d0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44009ae0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.513+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c156a20 con 0x7fbc4c0cf350 2023-10-07T09:04:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.514+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c156be0 con 0x7fbc4c0cf350 2023-10-07T09:04:02.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.514+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fbc40007480 con 0x7fbc4c0cf350 2023-10-07T09:04:02.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.515+0000 7fbc337fe700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 0x7fbc38069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:02.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.515+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc40083c70 con 0x7fbc4c0cf350 2023-10-07T09:04:02.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.515+0000 7fbc4b7fe700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 0x7fbc38069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:02.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.515+0000 7fbc4b7fe700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 0x7fbc38069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c155fa0 tx=0x7fbc3c009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:02.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.519+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc40050c50 con 0x7fbc4c0cf350 2023-10-07T09:04:02.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:02.758+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc4c063c90 con 0x7fbc4c0cf350 2023-10-07T09:04:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.416+0000 7fbc337fe700 1 -- 172.21.15.46:0/4285449762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 136+0+0 (secure 0 0 0) 0x7fbc400170c0 con 0x7fbc4c0cf350 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 msgr2=0x7fbc38069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 0x7fbc38069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c155fa0 tx=0x7fbc3c009120 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 msgr2=0x7fbc4c0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7c0 tx=0x7fbc40007f70 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 shutdown_connections 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc38067170 0x7fbc38069620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc4c159ec0 0x7fbc4c069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc4c0b53d0 0x7fbc4c068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 --2- 172.21.15.46:0/4285449762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc4c0cf350 0x7fbc4c0cd720 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 >> 172.21.15.46:0/4285449762 conn(0x7fbc4c0999f0 msgr2=0x7fbc4c155650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 shutdown_connections 2023-10-07T09:04:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.419+0000 7fbc5215d700 1 -- 172.21.15.46:0/4285449762 wait complete. 2023-10-07T09:04:03.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:04:03.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.560+0000 7f1816b83700 1 Processor -- start 2023-10-07T09:04:03.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.560+0000 7f1816b83700 1 -- start start 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f1816b83700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1810159890 0x7f181015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f1816b83700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181015a160 con 0x7f1810159c60 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f1816b83700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100d13a0 con 0x7f1810069560 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f1816b83700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181015e140 con 0x7f1810159890 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f181491f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1810159890 0x7f181015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f180ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1810159c60 0x7f181015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59428/0 (socket says 172.21.15.46:59428) 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.561+0000 7f180ffff700 1 -- 172.21.15.46:0/3308878904 learned_addr learned my addr 172.21.15.46:0/3308878904 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f181491f700 1 -- 172.21.15.46:0/3308878904 >> v1:172.21.15.133:6789/0 conn(0x7f1810069560 legacy=0x7f18100ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f181491f700 1 -- 172.21.15.46:0/3308878904 >> v1:172.21.15.46:6789/0 conn(0x7f1810159c60 legacy=0x7f181015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f181491f700 1 -- 172.21.15.46:0/3308878904 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181015a3d0 con 0x7f1810159890 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f180f7fe700 1 -- 172.21.15.46:0/3308878904 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104122716 0 0) 0x7f181015a160 con 0x7f1810159c60 2023-10-07T09:04:03.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f181491f700 1 --2- 172.21.15.46:0/3308878904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f181015abd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f17f80098e0 tx=0x7f17f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ace4d1df11ef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f180f7fe700 1 -- 172.21.15.46:0/3308878904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8009e80 con 0x7f1810159890 2023-10-07T09:04:03.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f180f7fe700 1 -- 172.21.15.46:0/3308878904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800b820 con 0x7f1810159890 2023-10-07T09:04:03.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.562+0000 7f180f7fe700 1 -- 172.21.15.46:0/3308878904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800bba0 con 0x7f1810159890 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 -- 172.21.15.46:0/3308878904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 msgr2=0x7f181015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 --2- 172.21.15.46:0/3308878904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f181015abd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f17f80098e0 tx=0x7f17f80091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 -- 172.21.15.46:0/3308878904 shutdown_connections 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 --2- 172.21.15.46:0/3308878904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f181015abd0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 -- 172.21.15.46:0/3308878904 >> 172.21.15.46:0/3308878904 conn(0x7f1810068e20 msgr2=0x7f18100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 -- 172.21.15.46:0/3308878904 shutdown_connections 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.563+0000 7f1816b83700 1 -- 172.21.15.46:0/3308878904 wait complete. 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.564+0000 7f1816b83700 1 Processor -- start 2023-10-07T09:04:03.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.564+0000 7f1816b83700 1 -- start start 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1810069560 0x7f1810140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1810159c60 0x7f1810156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1810152af0 con 0x7f1810159890 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100cede0 con 0x7f1810069560 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ce1d0 con 0x7f1810159c60 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36268/0 (socket says 172.21.15.46:36268) 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 -- 172.21.15.46:0/2254020044 learned_addr learned my addr 172.21.15.46:0/2254020044 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1815120700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1810159c60 0x7f1810156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f181491f700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1810069560 0x7f1810140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 -- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1810159c60 msgr2=0x7f1810156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1810159c60 0x7f1810156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 -- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1810069560 msgr2=0x7f1810140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1810069560 0x7f1810140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 -- 172.21.15.46:0/2254020044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009420 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180ffff700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f180000cd30 tx=0x7f1800001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180000ab70 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000acd0 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100ce4b0 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800007300 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.565+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18100cea70 con 0x7f1810159890 2023-10-07T09:04:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.566+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18100cef70 con 0x7f1810159890 2023-10-07T09:04:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.567+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f18000076f0 con 0x7f1810159890 2023-10-07T09:04:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.567+0000 7f180cff9700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 0x7f17f0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.567+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1800084e10 con 0x7f1810159890 2023-10-07T09:04:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.567+0000 7f181491f700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 0x7f17f0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.568+0000 7f181491f700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 0x7f17f0069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17f80030c0 tx=0x7f17f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.571+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1800051e70 con 0x7f1810159890 2023-10-07T09:04:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.791+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f181004c3c0 con 0x7f17f0067170 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.793+0000 7f180cff9700 1 -- 172.21.15.46:0/2254020044 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f181004c3c0 con 0x7f17f0067170 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:03.794 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:04:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 msgr2=0x7f17f0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 0x7f17f0069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17f80030c0 tx=0x7f17f8016000 comp rx=0 tx=0).stop 2023-10-07T09:04:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 msgr2=0x7f1810155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f180000cd30 tx=0x7f1800001af0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 shutdown_connections 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f17f0067170 0x7f17f0069620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1810159c60 0x7f1810156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1810069560 0x7f1810140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 --2- 172.21.15.46:0/2254020044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159890 0x7f1810155c10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.795+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 >> 172.21.15.46:0/2254020044 conn(0x7f1810068e20 msgr2=0x7f18100b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.796+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 shutdown_connections 2023-10-07T09:04:03.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.796+0000 7f1816b83700 1 -- 172.21.15.46:0/2254020044 wait complete. 2023-10-07T09:04:03.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:04:03.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.929+0000 7fedf45a2700 1 Processor -- start 2023-10-07T09:04:03.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.929+0000 7fedf45a2700 1 -- start start 2023-10-07T09:04:03.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf45a2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedec141500 0x7fedec0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf45a2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec15c2a0 con 0x7fedec06c0a0 2023-10-07T09:04:03.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf45a2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec15b690 con 0x7fedec06bcd0 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf45a2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec15b970 con 0x7fedec141500 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf1b3d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedec141500 0x7fedec0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf2b3f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fedec06c0a0 0x7fedec0c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59440/0 (socket says 172.21.15.46:59440) 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf1b3d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedec141500 0x7fedec0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36278/0 (socket says 172.21.15.46:36278) 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.930+0000 7fedf2b3f700 1 -- 172.21.15.46:0/1046114886 learned_addr learned my addr 172.21.15.46:0/1046114886 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf1b3d700 1 -- 172.21.15.46:0/1046114886 >> v1:172.21.15.133:6789/0 conn(0x7fedec06bcd0 legacy=0x7fedec140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf1b3d700 1 -- 172.21.15.46:0/1046114886 >> v1:172.21.15.46:6789/0 conn(0x7fedec06c0a0 legacy=0x7fedec0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf133c700 1 -- 172.21.15.46:0/1046114886 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604845555 0 0) 0x7fedec15c2a0 con 0x7fedec06c0a0 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf1b3d700 1 -- 172.21.15.46:0/1046114886 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec15bc50 con 0x7fedec141500 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf1b3d700 1 --2- 172.21.15.46:0/1046114886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec141500 0x7fedec0c8e00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fede00098e0 tx=0x7fede00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128673a7280c37ed server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf133c700 1 -- 172.21.15.46:0/1046114886 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0009e80 con 0x7fedec141500 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf133c700 1 -- 172.21.15.46:0/1046114886 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000b860 con 0x7fedec141500 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.931+0000 7fedf133c700 1 -- 172.21.15.46:0/1046114886 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000bbe0 con 0x7fedec141500 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 -- 172.21.15.46:0/1046114886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec141500 msgr2=0x7fedec0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1046114886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec141500 0x7fedec0c8e00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fede00098e0 tx=0x7fede00091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 -- 172.21.15.46:0/1046114886 shutdown_connections 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1046114886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec141500 0x7fedec0c8e00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 -- 172.21.15.46:0/1046114886 >> 172.21.15.46:0/1046114886 conn(0x7fedec0ce600 msgr2=0x7fedec0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 -- 172.21.15.46:0/1046114886 shutdown_connections 2023-10-07T09:04:03.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.932+0000 7fedf45a2700 1 -- 172.21.15.46:0/1046114886 wait complete. 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.933+0000 7fedf45a2700 1 Processor -- start 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.933+0000 7fedf45a2700 1 -- start start 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.933+0000 7fedf45a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.933+0000 7fedf45a2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 0x7fedec13c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.933+0000 7fedf45a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 0x7fedec0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf45a2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec16b790 con 0x7fedec06bcd0 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf45a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7860 con 0x7fedec141500 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf45a2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7b40 con 0x7fedec06c0a0 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36286/0 (socket says 172.21.15.46:36286) 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 -- 172.21.15.46:0/1575061441 learned_addr learned my addr 172.21.15.46:0/1575061441 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf2b3f700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 0x7fedec0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf1b3d700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 0x7fedec13c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 -- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 msgr2=0x7fedec13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 0x7fedec13c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 -- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 msgr2=0x7fedec0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 0x7fedec0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 -- 172.21.15.46:0/1575061441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009420 con 0x7fedec06bcd0 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf2b3f700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 0x7fedec0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf1b3d700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 0x7fedec13c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:03.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf233e700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fede400c590 tx=0x7fede400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4011590 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede40116f0 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0c7e20 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4011ab0 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.934+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec13c6c0 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.935+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0c8060 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.936+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fede401b3b0 con 0x7fedec06bcd0 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.936+0000 7fedea7fc700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 0x7fedd8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:03.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.936+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fede4083d70 con 0x7fedec06bcd0 2023-10-07T09:04:03.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.937+0000 7fedf1b3d700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 0x7fedd8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:03.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.937+0000 7fedf1b3d700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 0x7fedd8069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fedec0c3bd0 tx=0x7fede0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:03.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:03.941+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedec0c8060 con 0x7fedec06bcd0 2023-10-07T09:04:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.132+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fedec0b13a0 con 0x7fedec06bcd0 2023-10-07T09:04:04.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.132+0000 7fedea7fc700 1 -- 172.21.15.46:0/1575061441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fedec0b13a0 con 0x7fedec06bcd0 2023-10-07T09:04:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 msgr2=0x7fedd8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 0x7fedd8069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fedec0c3bd0 tx=0x7fede0017000 comp rx=0 tx=0).stop 2023-10-07T09:04:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 msgr2=0x7fedec0b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fede400c590 tx=0x7fede400c950 comp rx=0 tx=0).stop 2023-10-07T09:04:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 shutdown_connections 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067170 0x7fedd8069620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec141500 0x7fedec0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec06bcd0 0x7fedec0b2b50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 --2- 172.21.15.46:0/1575061441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec06c0a0 0x7fedec13c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 >> 172.21.15.46:0/1575061441 conn(0x7fedec0ce600 msgr2=0x7fedec13c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 shutdown_connections 2023-10-07T09:04:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.134+0000 7fedf45a2700 1 -- 172.21.15.46:0/1575061441 wait complete. 2023-10-07T09:04:04.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000543178 2023-10-07T09:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.269+0000 7f75a2b0c700 1 Processor -- start 2023-10-07T09:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.269+0000 7f75a2b0c700 1 -- start start 2023-10-07T09:04:04.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a2b0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f759c0b4e70 0x7f759c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a2b0c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0cfb00 con 0x7f759c0b1b40 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a2b0c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c15e060 con 0x7f759c0b16d0 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a2b0c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0b5c40 con 0x7f759c0b4e70 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a230b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f759c0b1b40 0x7f759c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59444/0 (socket says 172.21.15.46:59444) 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a230b700 1 -- 172.21.15.46:0/2073471129 learned_addr learned my addr 172.21.15.46:0/2073471129 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.270+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2073471129 >> v2:172.21.15.133:3300/0 conn(0x7f759c0b4e70 0x7f759c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95286254 0 0) 0x7f759c0cfb00 con 0x7f759c0b1b40 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7584003570 con 0x7f759c0b1b40 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821216439 0 0) 0x7f7584003570 con 0x7f759c0b1b40 2023-10-07T09:04:04.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 >> v2:172.21.15.133:3300/0 conn(0x7f759c0b4e70 msgr2=0x7f759c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 --2- 172.21.15.46:0/2073471129 >> v2:172.21.15.133:3300/0 conn(0x7f759c0b4e70 0x7f759c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 >> v1:172.21.15.133:6789/0 conn(0x7f759c0b16d0 legacy=0x7f759c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0b5f20 con 0x7f759c0b1b40 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f75940017f0 con 0x7f759c0b1b40 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 >> v1:172.21.15.46:6789/0 conn(0x7f759c0b1b40 legacy=0x7f759c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 0x7f7584003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584004810 0x7f7584004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7584005210 0x7f758400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0b5c40 con 0x7f7584003ab0 2023-10-07T09:04:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758400c1b0 con 0x7f7584005210 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758400c370 con 0x7f7584004810 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 0x7f7584003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1309700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584004810 0x7f7584004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a230b700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7584005210 0x7f758400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 -- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584004810 msgr2=0x7f7584004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584004810 0x7f7584004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 -- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7584005210 msgr2=0x7f758400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7584005210 0x7f758400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1b0a700 1 -- 172.21.15.46:0/2073471129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584003570 con 0x7f7584003ab0 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a1309700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584004810 0x7f7584004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a230b700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7584005210 0x7f758400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.271+0000 7f75a230b700 1 -- 172.21.15.46:0/2073471129 reap_dead start 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 0x7f7584003ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f758c009c00 tx=0x7f758c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42040938a5e3de25 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00e710 con 0x7f7584003ab0 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00e870 con 0x7f7584003ab0 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a0b08700 1 -- 172.21.15.46:0/2073471129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00ec30 con 0x7f7584003ab0 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 msgr2=0x7f7584003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 0x7f7584003ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f758c009c00 tx=0x7f758c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2073471129 shutdown_connections 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2073471129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7584003ab0 0x7f7584003ec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2073471129 >> 172.21.15.46:0/2073471129 conn(0x7f759c0d10c0 msgr2=0x7f759c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2073471129 shutdown_connections 2023-10-07T09:04:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.272+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2073471129 wait complete. 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.273+0000 7f75a2b0c700 1 Processor -- start 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.273+0000 7f75a2b0c700 1 -- start start 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 0x7f759c169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 0x7f759c1604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c161910 con 0x7f759c1568a0 2023-10-07T09:04:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c160d00 con 0x7f759c161da0 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a2b0c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c160fe0 con 0x7f7584003ab0 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36306/0 (socket says 172.21.15.46:36306) 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 -- 172.21.15.46:0/2482629561 learned_addr learned my addr 172.21.15.46:0/2482629561 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a1309700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 0x7f759c1604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 0x7f759c169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 -- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 msgr2=0x7f759c169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 0x7f759c169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 -- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 msgr2=0x7f759c1604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 0x7f759c1604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a230b700 1 -- 172.21.15.46:0/2482629561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c1612c0 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a1309700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 0x7f759c1604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.274+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 0x7f759c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f75a230b700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7594001350 tx=0x7f7594001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400e8a0 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400ea00 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c1615a0 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400edc0 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.275+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c156d20 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.276+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c156f70 con 0x7f759c1568a0 2023-10-07T09:04:04.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.276+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7594013630 con 0x7f759c1568a0 2023-10-07T09:04:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.277+0000 7f7599ffb700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 0x7f7588069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.277+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7594084ba0 con 0x7f759c1568a0 2023-10-07T09:04:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.277+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 0x7f7588069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.277+0000 7f75a1b0a700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 0x7f7588069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f758c0091e0 tx=0x7f758c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.281+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f759c156f70 con 0x7f759c1568a0 2023-10-07T09:04:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.506+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000543178", "target": ["mon-mgr", ""]}) v1 -- 0x7f759c156f70 con 0x7f7588067170 2023-10-07T09:04:04.513 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:04.513+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:04.513 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:04.513+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:04.513 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:04.513+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:04.513 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:04.513+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:04.513 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:04.513+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:04.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.527+0000 7f7599ffb700 1 -- 172.21.15.46:0/2482629561 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f759c156f70 con 0x7f7588067170 2023-10-07T09:04:04.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 msgr2=0x7f7588069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 0x7f7588069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f758c0091e0 tx=0x7f758c01a000 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 msgr2=0x7f759c0c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7594001350 tx=0x7f7594001e70 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 shutdown_connections 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7588067170 0x7f7588069620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c1568a0 0x7f759c0c5a00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584003ab0 0x7f759c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 --2- 172.21.15.46:0/2482629561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759c161da0 0x7f759c1604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.529+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 >> 172.21.15.46:0/2482629561 conn(0x7f759c0d10c0 msgr2=0x7f759c068420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.530+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 shutdown_connections 2023-10-07T09:04:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.530+0000 7f75a2b0c700 1 -- 172.21.15.46:0/2482629561 wait complete. 2023-10-07T09:04:04.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-07T09:04:04.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.663+0000 7fc55af50700 1 Processor -- start 2023-10-07T09:04:04.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.663+0000 7fc55af50700 1 -- start start 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.663+0000 7fc55af50700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5540aca80 0x7fc55406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.663+0000 7fc55af50700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5540c83c0 0x7fc5540cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.663+0000 7fc55af50700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55406bdb0 con 0x7fc554069d60 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc55af50700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540cb370 con 0x7fc5540aca80 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc55af50700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc554159f60 con 0x7fc5540c83c0 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5540aca80 0x7fc55406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc553fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc554069d60 0x7fc5540c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59448/0 (socket says 172.21.15.46:59448) 2023-10-07T09:04:04.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5540aca80 0x7fc55406aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36320/0 (socket says 172.21.15.46:36320) 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc553fff700 1 -- 172.21.15.46:0/2743959521 learned_addr learned my addr 172.21.15.46:0/2743959521 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc5594ed700 1 --2- 172.21.15.46:0/2743959521 >> v2:172.21.15.133:3300/0 conn(0x7fc5540c83c0 0x7fc5540cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 -- 172.21.15.46:0/2743959521 >> v2:172.21.15.133:3300/0 conn(0x7fc5540c83c0 msgr2=0x7fc5540cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 --2- 172.21.15.46:0/2743959521 >> v2:172.21.15.133:3300/0 conn(0x7fc5540c83c0 0x7fc5540cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 -- 172.21.15.46:0/2743959521 >> v1:172.21.15.46:6789/0 conn(0x7fc554069d60 legacy=0x7fc5540c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc5537fe700 1 -- 172.21.15.46:0/2743959521 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657880173 0 0) 0x7fc55406bdb0 con 0x7fc554069d60 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 -- 172.21.15.46:0/2743959521 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55406b510 con 0x7fc5540aca80 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc558cec700 1 --2- 172.21.15.46:0/2743959521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540aca80 0x7fc55406aba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b0190 tx=0x7fc54c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b720aab8a6d0cd83 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc5537fe700 1 -- 172.21.15.46:0/2743959521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00e070 con 0x7fc5540aca80 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc5537fe700 1 -- 172.21.15.46:0/2743959521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c00bb60 con 0x7fc5540aca80 2023-10-07T09:04:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.664+0000 7fc5537fe700 1 -- 172.21.15.46:0/2743959521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c012430 con 0x7fc5540aca80 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 -- 172.21.15.46:0/2743959521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540aca80 msgr2=0x7fc55406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 --2- 172.21.15.46:0/2743959521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540aca80 0x7fc55406aba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b0190 tx=0x7fc54c009780 comp rx=0 tx=0).stop 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 -- 172.21.15.46:0/2743959521 shutdown_connections 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 --2- 172.21.15.46:0/2743959521 >> v2:172.21.15.133:3300/0 conn(0x7fc5540c83c0 0x7fc5540cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 --2- 172.21.15.46:0/2743959521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540aca80 0x7fc55406aba0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 -- 172.21.15.46:0/2743959521 >> 172.21.15.46:0/2743959521 conn(0x7fc5540cd670 msgr2=0x7fc5540cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 -- 172.21.15.46:0/2743959521 shutdown_connections 2023-10-07T09:04:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.665+0000 7fc55af50700 1 -- 172.21.15.46:0/2743959521 wait complete. 2023-10-07T09:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.666+0000 7fc55af50700 1 Processor -- start 2023-10-07T09:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.666+0000 7fc55af50700 1 -- start start 2023-10-07T09:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc554069d60 0x7fc5540ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5540aca80 0x7fc55415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540b04a0 con 0x7fc5540c83c0 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55415c7d0 con 0x7fc5540aca80 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc55af50700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55415cab0 con 0x7fc554069d60 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36328/0 (socket says 172.21.15.46:36328) 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 -- 172.21.15.46:0/3053082039 learned_addr learned my addr 172.21.15.46:0/3053082039 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc553fff700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5540aca80 0x7fc55415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc558cec700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc554069d60 0x7fc5540ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 -- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc554069d60 msgr2=0x7fc5540ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc554069d60 0x7fc5540ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 -- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5540aca80 msgr2=0x7fc55415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5540aca80 0x7fc55415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.667+0000 7fc5594ed700 1 -- 172.21.15.46:0/3053082039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c009a20 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc5594ed700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e900 tx=0x7fc5440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013680 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440137e0 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55415cd90 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013ba0 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.668+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55415c4c0 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.669+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5540b0610 con 0x7fc5540c83c0 2023-10-07T09:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.670+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc54400c3e0 con 0x7fc5540c83c0 2023-10-07T09:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.670+0000 7fc550ff9700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 0x7fc540069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.670+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc544084f00 con 0x7fc5540c83c0 2023-10-07T09:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.670+0000 7fc558cec700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 0x7fc540069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.671+0000 7fc558cec700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 0x7fc540069650 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097c0 tx=0x7fc54c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.674+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc544051ee0 con 0x7fc5540c83c0 2023-10-07T09:04:04.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.897+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc5540b05e0 con 0x7fc5400671a0 2023-10-07T09:04:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.900+0000 7fc550ff9700 1 -- 172.21.15.46:0/3053082039 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+534 (secure 0 0 0) 0x7fc5540b05e0 con 0x7fc5400671a0 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_addrs": [ 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.46:6789", 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6789", 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6790" 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "pending_subvolume_deletions": 0, 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": { 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: "data": [ 2023-10-07T09:04:04.901 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": " 340G", 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_data", 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "used": " 0 " 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": [ 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": " 340G", 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_metadata", 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: "used": "64.0k" 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:04.902 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:04:04.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:04.903 INFO:teuthology.orchestra.run.smithi046.stdout: "used_size": " 0 " 2023-10-07T09:04:04.903 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 msgr2=0x7fc540069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 0x7fc540069650 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097c0 tx=0x7fc54c019000 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 msgr2=0x7fc5540ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e900 tx=0x7fc5440091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 shutdown_connections 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc5400671a0 0x7fc540069650 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5540c83c0 0x7fc5540ace90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc554069d60 0x7fc5540ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 --2- 172.21.15.46:0/3053082039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5540aca80 0x7fc55415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:04.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 >> 172.21.15.46:0/3053082039 conn(0x7fc5540cd670 msgr2=0x7fc5540c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:04.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 shutdown_connections 2023-10-07T09:04:04.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:04.902+0000 7fc55af50700 1 -- 172.21.15.46:0/3053082039 wait complete. 2023-10-07T09:04:04.915 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:04:04.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:04.957 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:05.003 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:04:05.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:04:05.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:05.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:05.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:04:05.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:05.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:04:05.096 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:04:05.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:05.097 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:05.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:04:05.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:05.141 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:04:05.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.316+0000 7f43ad50d700 1 Processor -- start 2023-10-07T09:04:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.316+0000 7f43ad50d700 1 -- start start 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 0x7f43a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 0x7f43a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43a815db10 0x7f43a8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a815a160 con 0x7f43a815db10 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80d13a0 con 0x7f43a8159890 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43ad50d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815e140 con 0x7f43a8159c60 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43a815db10 0x7f43a8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43a815db10 0x7f43a8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36334/0 (socket says 172.21.15.46:36334) 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 -- 172.21.15.46:0/2773068006 learned_addr learned my addr 172.21.15.46:0/2773068006 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 -- 172.21.15.46:0/2773068006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 msgr2=0x7f43a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a6ffd700 1 --2- 172.21.15.46:0/2773068006 >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 0x7f43a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a67fc700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 0x7f43a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 0x7f43a815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 -- 172.21.15.46:0/2773068006 >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 msgr2=0x7f43a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 --2- 172.21.15.46:0/2773068006 >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 0x7f43a815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 -- 172.21.15.46:0/2773068006 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a815a3d0 con 0x7f43a815db10 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a6ffd700 1 --2- 172.21.15.46:0/2773068006 >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 0x7f43a815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a67fc700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 0x7f43a815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a77fe700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a815db10 0x7f43a8069560 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f43a80d1090 tx=0x7f43a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ed97b71f5232bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a5ffb700 1 -- 172.21.15.46:0/2773068006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000e070 con 0x7f43a815db10 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a5ffb700 1 -- 172.21.15.46:0/2773068006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000ba50 con 0x7f43a815db10 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.317+0000 7f43a5ffb700 1 -- 172.21.15.46:0/2773068006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00092e0 con 0x7f43a815db10 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 -- 172.21.15.46:0/2773068006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a815db10 msgr2=0x7f43a8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a815db10 0x7f43a8069560 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f43a80d1090 tx=0x7f43a0009840 comp rx=0 tx=0).stop 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 -- 172.21.15.46:0/2773068006 shutdown_connections 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a815db10 0x7f43a8069560 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 --2- 172.21.15.46:0/2773068006 >> v2:172.21.15.133:3300/0 conn(0x7f43a8159890 0x7f43a815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 --2- 172.21.15.46:0/2773068006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159c60 0x7f43a815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 -- 172.21.15.46:0/2773068006 >> 172.21.15.46:0/2773068006 conn(0x7f43a8068e20 msgr2=0x7f43a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 -- 172.21.15.46:0/2773068006 shutdown_connections 2023-10-07T09:04:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.318+0000 7f43ad50d700 1 -- 172.21.15.46:0/2773068006 wait complete. 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.319+0000 7f43ad50d700 1 Processor -- start 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.319+0000 7f43ad50d700 1 -- start start 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159890 0x7f43a8169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a815db10 0x7f43a816d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8160420 con 0x7f43a8159c60 2023-10-07T09:04:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8169970 con 0x7f43a815db10 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43ad50d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8169390 con 0x7f43a8159890 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36348/0 (socket says 172.21.15.46:36348) 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 -- 172.21.15.46:0/1259102131 learned_addr learned my addr 172.21.15.46:0/1259102131 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a6ffd700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159890 0x7f43a8169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a77fe700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a815db10 0x7f43a816d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 -- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159890 msgr2=0x7f43a8169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159890 0x7f43a8169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 -- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a815db10 msgr2=0x7f43a816d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a815db10 0x7f43a816d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.320+0000 7f43a67fc700 1 -- 172.21.15.46:0/1259102131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0009ae0 con 0x7f43a8159c60 2023-10-07T09:04:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f43a67fc700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f439000c8b0 tx=0x7f4390008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390011600 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390011760 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a80c7a50 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390011b00 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.321+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a8160140 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.322+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a804c3c0 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.322+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f43900193b0 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.323+0000 7f439effd700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 0x7f4388069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.323+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43900848c0 con 0x7f43a8159c60 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.323+0000 7f43a6ffd700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 0x7f4388069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.323+0000 7f43a6ffd700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 0x7f4388069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f43a80cab90 tx=0x7f4398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.327+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4390051790 con 0x7f43a8159c60 2023-10-07T09:04:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.563+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43a806a5b0 con 0x7f43a8159c60 2023-10-07T09:04:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.563+0000 7f439effd700 1 -- 172.21.15.46:0/1259102131 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f4390015090 con 0x7f43a8159c60 2023-10-07T09:04:05.564 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:05.565 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 msgr2=0x7f4388069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 0x7f4388069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f43a80cab90 tx=0x7f4398008040 comp rx=0 tx=0).stop 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 msgr2=0x7f43a816cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f439000c8b0 tx=0x7f4390008040 comp rx=0 tx=0).stop 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 shutdown_connections 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4388067170 0x7f4388069620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a815db10 0x7f43a816d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43a8159890 0x7f43a8169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 --2- 172.21.15.46:0/1259102131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43a8159c60 0x7f43a816cfa0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 >> 172.21.15.46:0/1259102131 conn(0x7f43a8068e20 msgr2=0x7f43a815b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 shutdown_connections 2023-10-07T09:04:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.566+0000 7f43ad50d700 1 -- 172.21.15.46:0/1259102131 wait complete. 2023-10-07T09:04:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 48 2023-10-07T09:04:05.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.697+0000 7f347a704700 1 Processor -- start 2023-10-07T09:04:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.697+0000 7f347a704700 1 -- start start 2023-10-07T09:04:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f347a704700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3474159420 0x7f34740b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f347a704700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f347415d230 0x7f347415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f347a704700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740b2980 con 0x7f34741597f0 2023-10-07T09:04:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f347a704700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347415db70 con 0x7f347415d230 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f347a704700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34740b11d0 con 0x7f3474159420 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f347415d230 0x7f347415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f347415d230 0x7f347415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36362/0 (socket says 172.21.15.46:36362) 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 -- 172.21.15.46:0/3318030800 learned_addr learned my addr 172.21.15.46:0/3318030800 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479702700 1 --2- 172.21.15.46:0/3318030800 >> v2:172.21.15.133:3300/0 conn(0x7f3474159420 0x7f34740b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 -- 172.21.15.46:0/3318030800 >> v2:172.21.15.133:3300/0 conn(0x7f3474159420 msgr2=0x7f34740b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 --2- 172.21.15.46:0/3318030800 >> v2:172.21.15.133:3300/0 conn(0x7f3474159420 0x7f34740b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 -- 172.21.15.46:0/3318030800 >> v1:172.21.15.133:6789/0 conn(0x7f34741597f0 legacy=0x7f34740b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.698+0000 7f3479f03700 1 -- 172.21.15.46:0/3318030800 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740b14b0 con 0x7f347415d230 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f3479f03700 1 --2- 172.21.15.46:0/3318030800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347415d230 0x7f347415d630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f34740b2f20 tx=0x7f3464009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf56e7d0c7e423d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f3473fff700 1 -- 172.21.15.46:0/3318030800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400e070 con 0x7f347415d230 2023-10-07T09:04:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f3473fff700 1 -- 172.21.15.46:0/3318030800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346400ba10 con 0x7f347415d230 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f3473fff700 1 -- 172.21.15.46:0/3318030800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640092e0 con 0x7f347415d230 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 -- 172.21.15.46:0/3318030800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347415d230 msgr2=0x7f347415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 --2- 172.21.15.46:0/3318030800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347415d230 0x7f347415d630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f34740b2f20 tx=0x7f3464009840 comp rx=0 tx=0).stop 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 -- 172.21.15.46:0/3318030800 shutdown_connections 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 --2- 172.21.15.46:0/3318030800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f347415d230 0x7f347415d630 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 --2- 172.21.15.46:0/3318030800 >> v2:172.21.15.133:3300/0 conn(0x7f3474159420 0x7f34740b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 -- 172.21.15.46:0/3318030800 >> 172.21.15.46:0/3318030800 conn(0x7f34740d0660 msgr2=0x7f34740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 -- 172.21.15.46:0/3318030800 shutdown_connections 2023-10-07T09:04:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.699+0000 7f347a704700 1 -- 172.21.15.46:0/3318030800 wait complete. 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 Processor -- start 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 -- start start 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 0x7f34740c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f347415d230 0x7f34740b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347416b3b0 con 0x7f34741597f0 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c5f70 con 0x7f3474159420 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.701+0000 7f347a704700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347416a4c0 con 0x7f347415d230 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36378/0 (socket says 172.21.15.46:36378) 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 -- 172.21.15.46:0/2953617475 learned_addr learned my addr 172.21.15.46:0/2953617475 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3479f03700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f347415d230 0x7f34740b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3479702700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 0x7f34740c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 -- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f347415d230 msgr2=0x7f34740b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f347415d230 0x7f34740b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 -- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 msgr2=0x7f34740c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 0x7f34740c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 -- 172.21.15.46:0/2953617475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009ae0 con 0x7f34741597f0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3479702700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 0x7f34740c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f3478f01700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f346800c590 tx=0x7f3468007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011590 con 0x7f34741597f0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468011730 con 0x7f34741597f0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347416a7a0 con 0x7f34741597f0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011af0 con 0x7f34741597f0 2023-10-07T09:04:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.702+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347416ad60 con 0x7f34741597f0 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.703+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347416b560 con 0x7f34741597f0 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.704+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f346801c460 con 0x7f34741597f0 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.704+0000 7f34717fa700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 0x7f3460069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.704+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34680845c0 con 0x7f34741597f0 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.704+0000 7f3479702700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 0x7f3460069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.705+0000 7f3479702700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 0x7f3460069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f346c006fd0 tx=0x7f346c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.708+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f347416b560 con 0x7f34741597f0 2023-10-07T09:04:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.903+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f347404c3c0 con 0x7f34741597f0 2023-10-07T09:04:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.904+0000 7f34717fa700 1 -- 172.21.15.46:0/2953617475 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f34680515a0 con 0x7f34741597f0 2023-10-07T09:04:05.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:05.905 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":78,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:55.374764+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 msgr2=0x7f3460069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 0x7f3460069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f346c006fd0 tx=0x7f346c008040 comp rx=0 tx=0).stop 2023-10-07T09:04:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 msgr2=0x7f3474168b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f346800c590 tx=0x7f3468007f30 comp rx=0 tx=0).stop 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 shutdown_connections 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3460067170 0x7f3460069620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f347415d230 0x7f34740b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3474159420 0x7f34740c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 --2- 172.21.15.46:0/2953617475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34741597f0 0x7f3474168b00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 >> 172.21.15.46:0/2953617475 conn(0x7f34740d0660 msgr2=0x7f3474156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 shutdown_connections 2023-10-07T09:04:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:05.906+0000 7f347a704700 1 -- 172.21.15.46:0/2953617475 wait complete. 2023-10-07T09:04:05.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:03:52.162534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:03:52.738311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:04:05.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:04:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.041+0000 7ffa3907c700 1 Processor -- start 2023-10-07T09:04:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.041+0000 7ffa3907c700 1 -- start start 2023-10-07T09:04:06.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa34159890 0x7ffa3415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa34159c60 0x7ffa3415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa3415db10 0x7ffa34069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3415df50 con 0x7ffa34159890 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3415a160 con 0x7ffa34159c60 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa3907c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340d13a0 con 0x7ffa3415db10 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa32d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa34159890 0x7ffa3415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa32d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa34159890 0x7ffa3415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36394/0 (socket says 172.21.15.46:36394) 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.042+0000 7ffa32d9d700 1 -- 172.21.15.46:0/1932110218 learned_addr learned my addr 172.21.15.46:0/1932110218 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa3259c700 1 --2- 172.21.15.46:0/1932110218 >> v2:172.21.15.133:3300/0 conn(0x7ffa34159c60 0x7ffa3415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa3359e700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa3415db10 0x7ffa34069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 -- 172.21.15.46:0/1932110218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa3415db10 msgr2=0x7ffa34069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa3415db10 0x7ffa34069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 -- 172.21.15.46:0/1932110218 >> v2:172.21.15.133:3300/0 conn(0x7ffa34159c60 msgr2=0x7ffa3415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/1932110218 >> v2:172.21.15.133:3300/0 conn(0x7ffa34159c60 0x7ffa3415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 -- 172.21.15.46:0/1932110218 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3415e140 con 0x7ffa34159890 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159890 0x7ffa3415abd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ffa340b67f0 tx=0x7ffa24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4e03219029d980 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa31d9b700 1 -- 172.21.15.46:0/1932110218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400e070 con 0x7ffa34159890 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa31d9b700 1 -- 172.21.15.46:0/1932110218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400b970 con 0x7ffa34159890 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.043+0000 7ffa31d9b700 1 -- 172.21.15.46:0/1932110218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240092e0 con 0x7ffa34159890 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 -- 172.21.15.46:0/1932110218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159890 msgr2=0x7ffa3415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159890 0x7ffa3415abd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ffa340b67f0 tx=0x7ffa24009840 comp rx=0 tx=0).stop 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 -- 172.21.15.46:0/1932110218 shutdown_connections 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa3415db10 0x7ffa34069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 --2- 172.21.15.46:0/1932110218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159890 0x7ffa3415abd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 --2- 172.21.15.46:0/1932110218 >> v2:172.21.15.133:3300/0 conn(0x7ffa34159c60 0x7ffa3415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 -- 172.21.15.46:0/1932110218 >> 172.21.15.46:0/1932110218 conn(0x7ffa34068e20 msgr2=0x7ffa340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 -- 172.21.15.46:0/1932110218 shutdown_connections 2023-10-07T09:04:06.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.044+0000 7ffa3907c700 1 -- 172.21.15.46:0/1932110218 wait complete. 2023-10-07T09:04:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.045+0000 7ffa3907c700 1 Processor -- start 2023-10-07T09:04:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.045+0000 7ffa3907c700 1 -- start start 2023-10-07T09:04:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 0x7ffa34151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 0x7ffa340c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341524b0 con 0x7ffa34159c60 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34169c00 con 0x7ffa3415db10 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3416aad0 con 0x7ffa34159890 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36400/0 (socket says 172.21.15.46:36400) 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 -- 172.21.15.46:0/3122711938 learned_addr learned my addr 172.21.15.46:0/3122711938 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 0x7ffa34151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3359e700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 0x7ffa340c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 -- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 msgr2=0x7ffa34151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 0x7ffa34151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 -- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 msgr2=0x7ffa340c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 0x7ffa340c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 -- 172.21.15.46:0/3122711938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009ae0 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 0x7ffa34151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3359e700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 0x7ffa340c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3259c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00ec80 tx=0x7ffa1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00c9d0 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00cb30 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.046+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34169ec0 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.047+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c013470 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.047+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3416a480 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.048+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3404c3c0 con 0x7ffa34159c60 2023-10-07T09:04:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.048+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ffa1c013820 con 0x7ffa34159c60 2023-10-07T09:04:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.048+0000 7ffa2affd700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 0x7ffa140696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.049+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa1c084cf0 con 0x7ffa34159c60 2023-10-07T09:04:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.049+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 0x7ffa140696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.049+0000 7ffa32d9d700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 0x7ffa140696e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009ab0 tx=0x7ffa24018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.053+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa1c051c10 con 0x7ffa34159c60 2023-10-07T09:04:06.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.246+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa340c9270 con 0x7ffa34159c60 2023-10-07T09:04:06.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.247+0000 7ffa2affd700 1 -- 172.21.15.46:0/3122711938 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa1c055230 con 0x7ffa34159c60 2023-10-07T09:04:06.250 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 msgr2=0x7ffa140696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 0x7ffa140696e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009ab0 tx=0x7ffa24018000 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 msgr2=0x7ffa340b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00ec80 tx=0x7ffa1c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 shutdown_connections 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa14067230 0x7ffa140696e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa3415db10 0x7ffa340c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa34159890 0x7ffa34151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 --2- 172.21.15.46:0/3122711938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa34159c60 0x7ffa340b58b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 >> 172.21.15.46:0/3122711938 conn(0x7ffa34068e20 msgr2=0x7ffa34153420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 shutdown_connections 2023-10-07T09:04:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.249+0000 7ffa3907c700 1 -- 172.21.15.46:0/3122711938 wait complete. 2023-10-07T09:04:06.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:04:06.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.382+0000 7f38d5a6e700 1 Processor -- start 2023-10-07T09:04:06.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.382+0000 7f38d5a6e700 1 -- start start 2023-10-07T09:04:06.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38d5a6e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38d0159890 0x7f38d015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38d5a6e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f38d0069560 0x7f38d00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38d5a6e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d0069ee0 con 0x7f38d0159c60 2023-10-07T09:04:06.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38d5a6e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d015a160 con 0x7f38d0069560 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38d5a6e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d00d13a0 con 0x7f38d0159890 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38cffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f38d0069560 0x7f38d00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38cffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f38d0069560 0x7f38d00699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36416/0 (socket says 172.21.15.46:36416) 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38cffff700 1 -- 172.21.15.46:0/2222834945 learned_addr learned my addr 172.21.15.46:0/2222834945 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.383+0000 7f38cf7fe700 1 --2- 172.21.15.46:0/2222834945 >> v2:172.21.15.133:3300/0 conn(0x7f38d0159890 0x7f38d015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38cffff700 1 -- 172.21.15.46:0/2222834945 >> v2:172.21.15.133:3300/0 conn(0x7f38d0159890 msgr2=0x7f38d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38cffff700 1 --2- 172.21.15.46:0/2222834945 >> v2:172.21.15.133:3300/0 conn(0x7f38d0159890 0x7f38d015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38cffff700 1 -- 172.21.15.46:0/2222834945 >> v1:172.21.15.133:6789/0 conn(0x7f38d0159c60 legacy=0x7f38d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38cffff700 1 -- 172.21.15.46:0/2222834945 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d015e140 con 0x7f38d0069560 2023-10-07T09:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38cffff700 1 --2- 172.21.15.46:0/2222834945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d00699a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f38d00d1090 tx=0x7f38c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63509504f18e0eea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38ce7fc700 1 -- 172.21.15.46:0/2222834945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e070 con 0x7f38d0069560 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38ce7fc700 1 -- 172.21.15.46:0/2222834945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800ba20 con 0x7f38d0069560 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38ce7fc700 1 -- 172.21.15.46:0/2222834945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c80092e0 con 0x7f38d0069560 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.384+0000 7f38d5a6e700 1 -- 172.21.15.46:0/2222834945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 msgr2=0x7f38d00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/2222834945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d00699a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f38d00d1090 tx=0x7f38c8009840 comp rx=0 tx=0).stop 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 -- 172.21.15.46:0/2222834945 shutdown_connections 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/2222834945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d00699a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/2222834945 >> v2:172.21.15.133:3300/0 conn(0x7f38d0159890 0x7f38d015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 -- 172.21.15.46:0/2222834945 >> 172.21.15.46:0/2222834945 conn(0x7f38d0068e20 msgr2=0x7f38d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 -- 172.21.15.46:0/2222834945 shutdown_connections 2023-10-07T09:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.385+0000 7f38d5a6e700 1 -- 172.21.15.46:0/2222834945 wait complete. 2023-10-07T09:04:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.386+0000 7f38d5a6e700 1 Processor -- start 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.386+0000 7f38d5a6e700 1 -- start start 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38d0159890 0x7f38d00ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38d0159c60 0x7f38d00c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00ca9a0 con 0x7f38d0069560 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00ce880 con 0x7f38d0159c60 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00ca6c0 con 0x7f38d0159890 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36418/0 (socket says 172.21.15.46:36418) 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 -- 172.21.15.46:0/578686779 learned_addr learned my addr 172.21.15.46:0/578686779 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 -- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38d0159890 msgr2=0x7f38d00ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38d0159890 0x7f38d00ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 -- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38d0159c60 msgr2=0x7f38d00c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38d0159c60 0x7f38d00c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 -- 172.21.15.46:0/578686779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8009ae0 con 0x7f38d0069560 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38cf7fe700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f38c000ec80 tx=0x7f38c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000c9d0 con 0x7f38d0069560 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000cb30 con 0x7f38d0069560 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00ce230 con 0x7f38d0069560 2023-10-07T09:04:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0013470 con 0x7f38d0069560 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.387+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d00c8080 con 0x7f38d0069560 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.388+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00ce090 con 0x7f38d0069560 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.389+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f38c0013820 con 0x7f38d0069560 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.389+0000 7f38b77fe700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 0x7f38bc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.389+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38c0084d70 con 0x7f38d0069560 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.389+0000 7f38ceffd700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 0x7f38bc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.390+0000 7f38ceffd700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 0x7f38bc0696b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f38d0152510 tx=0x7f38c4007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.393+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38d00ce090 con 0x7f38d0069560 2023-10-07T09:04:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.584+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38d00ce090 con 0x7f38d0069560 2023-10-07T09:04:06.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.584+0000 7f38b77fe700 1 -- 172.21.15.46:0/578686779 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38d00ce090 con 0x7f38d0069560 2023-10-07T09:04:06.585 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:04:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 msgr2=0x7f38bc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 0x7f38bc0696b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f38d0152510 tx=0x7f38c4007b40 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 msgr2=0x7f38d0167bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f38c000ec80 tx=0x7f38c00091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 shutdown_connections 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f38bc067200 0x7f38bc0696b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38d0159c60 0x7f38d00c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38d0069560 0x7f38d0167bc0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 --2- 172.21.15.46:0/578686779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38d0159890 0x7f38d00ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 >> 172.21.15.46:0/578686779 conn(0x7f38d0068e20 msgr2=0x7f38d0152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 shutdown_connections 2023-10-07T09:04:06.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.586+0000 7f38d5a6e700 1 -- 172.21.15.46:0/578686779 wait complete. 2023-10-07T09:04:06.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:04:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.720+0000 7feea5d8c700 1 Processor -- start 2023-10-07T09:04:06.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.720+0000 7feea5d8c700 1 -- start start 2023-10-07T09:04:06.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7feea5d8c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feea0069560 0x7feea00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7feea5d8c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea0069ee0 con 0x7feea0159890 2023-10-07T09:04:06.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7feea5d8c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea015a160 con 0x7feea0159c60 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7feea5d8c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00d13a0 con 0x7feea0069560 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feea0159890 0x7feea015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59450/0 (socket says 172.21.15.46:59450) 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9f7fe700 1 -- 172.21.15.46:0/3928483725 learned_addr learned my addr 172.21.15.46:0/3928483725 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9ffff700 1 --2- 172.21.15.46:0/3928483725 >> v2:172.21.15.133:3300/0 conn(0x7feea0069560 0x7feea00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259295914 0 0) 0x7feea0069ee0 con 0x7feea0159890 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee88003570 con 0x7feea0159890 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9ffff700 1 -- 172.21.15.46:0/3928483725 >> v1:172.21.15.133:6789/0 conn(0x7feea0159c60 legacy=0x7feea015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154180357 0 0) 0x7fee88003570 con 0x7feea0159890 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9ffff700 1 -- 172.21.15.46:0/3928483725 >> v1:172.21.15.46:6789/0 conn(0x7feea0159890 legacy=0x7feea015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9ffff700 1 -- 172.21.15.46:0/3928483725 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea015e140 con 0x7feea0069560 2023-10-07T09:04:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.721+0000 7fee9ffff700 1 --2- 172.21.15.46:0/3928483725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0069560 0x7feea00699a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fee980098e0 tx=0x7fee980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fcdc2c4fc2684d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900017f0 con 0x7feea0069560 2023-10-07T09:04:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98011420 con 0x7feea0069560 2023-10-07T09:04:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7fee9e7fc700 1 -- 172.21.15.46:0/3928483725 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980117a0 con 0x7feea0069560 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 -- 172.21.15.46:0/3928483725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0069560 msgr2=0x7feea00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 --2- 172.21.15.46:0/3928483725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0069560 0x7feea00699a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fee980098e0 tx=0x7fee980091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 -- 172.21.15.46:0/3928483725 shutdown_connections 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 --2- 172.21.15.46:0/3928483725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0069560 0x7feea00699a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 -- 172.21.15.46:0/3928483725 >> 172.21.15.46:0/3928483725 conn(0x7feea0068e20 msgr2=0x7feea00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 -- 172.21.15.46:0/3928483725 shutdown_connections 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.722+0000 7feea5d8c700 1 -- 172.21.15.46:0/3928483725 wait complete. 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.723+0000 7feea5d8c700 1 Processor -- start 2023-10-07T09:04:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 -- start start 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 0x7feea015ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0159c60 0x7feea015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00b5ff0 con 0x7feea0069560 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00cde00 con 0x7feea0159c60 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7feea5d8c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea015da90 con 0x7feea0159890 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36426/0 (socket says 172.21.15.46:36426) 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7fee9f7fe700 1 -- 172.21.15.46:0/976913433 learned_addr learned my addr 172.21.15.46:0/976913433 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7fee9ffff700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0159c60 0x7feea015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.724+0000 7fee9effd700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 0x7feea015ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 -- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 msgr2=0x7feea015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 0x7feea015ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 -- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0159c60 msgr2=0x7feea015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0159c60 0x7feea015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 -- 172.21.15.46:0/976913433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009420 con 0x7feea0069560 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9effd700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 0x7feea015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee9f7fe700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee9000cc10 tx=0x7fee90001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90004dc0 con 0x7feea0069560 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000a600 con 0x7feea0069560 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea00ce0a0 con 0x7feea0069560 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000a9c0 con 0x7feea0069560 2023-10-07T09:04:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.725+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea015dd70 con 0x7feea0069560 2023-10-07T09:04:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.726+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea00ce5c0 con 0x7feea0069560 2023-10-07T09:04:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.726+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fee90007150 con 0x7feea0069560 2023-10-07T09:04:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.727+0000 7fee877fe700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 0x7fee8c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:06.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.727+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee90084410 con 0x7feea0069560 2023-10-07T09:04:06.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.727+0000 7fee9effd700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 0x7fee8c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:06.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.727+0000 7fee9effd700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 0x7fee8c0696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee94007fd0 tx=0x7fee94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:06.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.731+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee900513b0 con 0x7feea0069560 2023-10-07T09:04:06.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.923+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feea004c3c0 con 0x7feea0069560 2023-10-07T09:04:06.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.923+0000 7fee877fe700 1 -- 172.21.15.46:0/976913433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee900549d0 con 0x7feea0069560 2023-10-07T09:04:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:04:06.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 msgr2=0x7fee8c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 0x7fee8c0696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee94007fd0 tx=0x7fee94009040 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 msgr2=0x7feea0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee9000cc10 tx=0x7fee90001640 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 shutdown_connections 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee8c067200 0x7fee8c0696b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea0159c60 0x7feea015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea0069560 0x7feea0155300 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 --2- 172.21.15.46:0/976913433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea0159890 0x7feea015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 >> 172.21.15.46:0/976913433 conn(0x7feea0068e20 msgr2=0x7feea01579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 shutdown_connections 2023-10-07T09:04:06.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:06.925+0000 7feea5d8c700 1 -- 172.21.15.46:0/976913433 wait complete. 2023-10-07T09:04:06.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:07.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.056+0000 7f3e4560d700 1 Processor -- start 2023-10-07T09:04:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.057+0000 7f3e4560d700 1 -- start start 2023-10-07T09:04:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.057+0000 7f3e4560d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e4006f810 0x7f3e401649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.057+0000 7f3e4560d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4006ec70 con 0x7f3e40068920 2023-10-07T09:04:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.057+0000 7f3e4560d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400b2e70 con 0x7f3e40068550 2023-10-07T09:04:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.057+0000 7f3e4560d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e40068d90 con 0x7f3e4006f810 2023-10-07T09:04:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3e7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e40068920 0x7f3e4006f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59456/0 (socket says 172.21.15.46:59456) 2023-10-07T09:04:07.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3e7fc700 1 -- 172.21.15.46:0/1788092431 learned_addr learned my addr 172.21.15.46:0/1788092431 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3f7fe700 1 --2- 172.21.15.46:0/1788092431 >> v2:172.21.15.133:3300/0 conn(0x7f3e4006f810 0x7f3e401649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670108435 0 0) 0x7f3e4006ec70 con 0x7f3e40068920 2023-10-07T09:04:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e2c003570 con 0x7f3e40068920 2023-10-07T09:04:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127762472 0 0) 0x7f3e400b2e70 con 0x7f3e40068550 2023-10-07T09:04:07.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4006ec70 con 0x7f3e40068550 2023-10-07T09:04:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3f7fe700 1 -- 172.21.15.46:0/1788092431 >> v1:172.21.15.133:6789/0 conn(0x7f3e40068550 legacy=0x7f3e4015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3f7fe700 1 -- 172.21.15.46:0/1788092431 >> v1:172.21.15.46:6789/0 conn(0x7f3e40068920 legacy=0x7f3e4006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845744838 0 0) 0x7f3e2c003570 con 0x7f3e40068920 2023-10-07T09:04:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3f7fe700 1 -- 172.21.15.46:0/1788092431 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400b3150 con 0x7f3e4006f810 2023-10-07T09:04:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3f7fe700 1 --2- 172.21.15.46:0/1788092431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4006f810 0x7f3e401649f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3e380098e0 tx=0x7f3e380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f21e4d8980bdca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28001470 con 0x7f3e4006f810 2023-10-07T09:04:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e38011420 con 0x7f3e4006f810 2023-10-07T09:04:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.058+0000 7f3e3dffb700 1 -- 172.21.15.46:0/1788092431 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380117c0 con 0x7f3e4006f810 2023-10-07T09:04:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 -- 172.21.15.46:0/1788092431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4006f810 msgr2=0x7f3e401649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1788092431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4006f810 0x7f3e401649f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3e380098e0 tx=0x7f3e380091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 -- 172.21.15.46:0/1788092431 shutdown_connections 2023-10-07T09:04:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1788092431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4006f810 0x7f3e401649f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 -- 172.21.15.46:0/1788092431 >> 172.21.15.46:0/1788092431 conn(0x7f3e400cd480 msgr2=0x7f3e400cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 -- 172.21.15.46:0/1788092431 shutdown_connections 2023-10-07T09:04:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.059+0000 7f3e4560d700 1 -- 172.21.15.46:0/1788092431 wait complete. 2023-10-07T09:04:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.060+0000 7f3e4560d700 1 Processor -- start 2023-10-07T09:04:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.060+0000 7f3e4560d700 1 -- start start 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e40068920 0x7f3e4015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4006f810 0x7f3e4015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4014a100 con 0x7f3e40068550 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401388b0 con 0x7f3e40068920 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e4560d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40139710 con 0x7f3e4006f810 2023-10-07T09:04:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36430/0 (socket says 172.21.15.46:36430) 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 -- 172.21.15.46:0/1325826408 learned_addr learned my addr 172.21.15.46:0/1325826408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3f7fe700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4006f810 0x7f3e4015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3e7fc700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e40068920 0x7f3e4015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 -- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4006f810 msgr2=0x7f3e4015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4006f810 0x7f3e4015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 -- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e40068920 msgr2=0x7f3e4015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e40068920 0x7f3e4015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 -- 172.21.15.46:0/1325826408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e38009420 con 0x7f3e40068550 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.061+0000 7f3e3effd700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb10 tx=0x7f3e30002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.062+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000a760 con 0x7f3e40068550 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.062+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3000a8c0 con 0x7f3e40068550 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.062+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40138b00 con 0x7f3e40068550 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.062+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000ac60 con 0x7f3e40068550 2023-10-07T09:04:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.062+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e401390c0 con 0x7f3e40068550 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.063+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4004c3c0 con 0x7f3e40068550 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.063+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3e30012630 con 0x7f3e40068550 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.063+0000 7f3e36ffd700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 0x7f3e200696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.064+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e30084e30 con 0x7f3e40068550 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.064+0000 7f3e3e7fc700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 0x7f3e200696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.064+0000 7f3e3e7fc700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 0x7f3e200696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e4015e4a0 tx=0x7f3e28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.068+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e30051c70 con 0x7f3e40068550 2023-10-07T09:04:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.303+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e401583b0 con 0x7f3e40068550 2023-10-07T09:04:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.304+0000 7f3e36ffd700 1 -- 172.21.15.46:0/1325826408 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3e30055290 con 0x7f3e40068550 2023-10-07T09:04:07.305 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:07.305 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 msgr2=0x7f3e200696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 0x7f3e200696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e4015e4a0 tx=0x7f3e28009040 comp rx=0 tx=0).stop 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 msgr2=0x7f3e40149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb10 tx=0x7f3e30002820 comp rx=0 tx=0).stop 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 shutdown_connections 2023-10-07T09:04:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e20067200 0x7f3e200696b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4006f810 0x7f3e4015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e40068550 0x7f3e40149bc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 --2- 172.21.15.46:0/1325826408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e40068920 0x7f3e4015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 >> 172.21.15.46:0/1325826408 conn(0x7f3e400cd480 msgr2=0x7f3e401588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 shutdown_connections 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.306+0000 7f3e4560d700 1 -- 172.21.15.46:0/1325826408 wait complete. 2023-10-07T09:04:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 48 2023-10-07T09:04:07.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:07.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.438+0000 7f78d2572700 1 Processor -- start 2023-10-07T09:04:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.438+0000 7f78d2572700 1 -- start start 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d2572700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc159890 0x7f78cc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d2572700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78cc069560 0x7f78cc0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d2572700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc15a160 con 0x7f78cc159c60 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d2572700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc069f20 con 0x7f78cc069560 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d2572700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d13a0 con 0x7f78cc159890 2023-10-07T09:04:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78cc069560 0x7f78cc0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78cb7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f78cc159c60 0x7f78cc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59464/0 (socket says 172.21.15.46:59464) 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78cb7fe700 1 -- 172.21.15.46:0/1081348275 learned_addr learned my addr 172.21.15.46:0/1081348275 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78cbfff700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc159890 0x7f78cc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1081348275 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc159890 msgr2=0x7f78cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc159890 0x7f78cc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1081348275 >> v1:172.21.15.46:6789/0 conn(0x7f78cc159c60 legacy=0x7f78cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78caffd700 1 -- 172.21.15.46:0/1081348275 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715199510 0 0) 0x7f78cc15a160 con 0x7f78cc159c60 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1081348275 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc15e140 con 0x7f78cc069560 2023-10-07T09:04:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.439+0000 7f78d0b0f700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc069560 0x7f78cc0699e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009e60 tx=0x7f78c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0657d40ac719c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78caffd700 1 -- 172.21.15.46:0/1081348275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c400e070 con 0x7f78cc069560 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78caffd700 1 -- 172.21.15.46:0/1081348275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c400bc30 con 0x7f78cc069560 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78caffd700 1 -- 172.21.15.46:0/1081348275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4012430 con 0x7f78cc069560 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 -- 172.21.15.46:0/1081348275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc069560 msgr2=0x7f78cc0699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc069560 0x7f78cc0699e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009e60 tx=0x7f78c4009780 comp rx=0 tx=0).stop 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 -- 172.21.15.46:0/1081348275 shutdown_connections 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc069560 0x7f78cc0699e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 --2- 172.21.15.46:0/1081348275 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc159890 0x7f78cc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 -- 172.21.15.46:0/1081348275 >> 172.21.15.46:0/1081348275 conn(0x7f78cc068e20 msgr2=0x7f78cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 -- 172.21.15.46:0/1081348275 shutdown_connections 2023-10-07T09:04:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.440+0000 7f78d2572700 1 -- 172.21.15.46:0/1081348275 wait complete. 2023-10-07T09:04:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.441+0000 7f78d2572700 1 Processor -- start 2023-10-07T09:04:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.441+0000 7f78d2572700 1 -- start start 2023-10-07T09:04:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc069560 0x7f78cc0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78cc159890 0x7f78cc0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15bfe0 con 0x7f78cc159c60 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15bd00 con 0x7f78cc159890 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d2572700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15c2f0 con 0x7f78cc069560 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d0b0f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d0b0f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36446/0 (socket says 172.21.15.46:36446) 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1961831994 learned_addr learned my addr 172.21.15.46:0/1961831994 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78cbfff700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc069560 0x7f78cc0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78cb7fe700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78cc159890 0x7f78cc0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc069560 msgr2=0x7f78cc0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.442+0000 7f78d0b0f700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc069560 0x7f78cc0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78cc159890 msgr2=0x7f78cc0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d0b0f700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78cc159890 0x7f78cc0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d0b0f700 1 -- 172.21.15.46:0/1961831994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4009a20 con 0x7f78cc159c60 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d0b0f700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78c4013000 tx=0x7f78c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4027470 con 0x7f78cc159c60 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4027610 con 0x7f78cc159c60 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40279d0 con 0x7f78cc159c60 2023-10-07T09:04:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc15c5d0 con 0x7f78cc159c60 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.443+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc15b900 con 0x7f78cc159c60 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.444+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc04c3c0 con 0x7f78cc159c60 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.444+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f78c4024070 con 0x7f78cc159c60 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.445+0000 7f78b3fff700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 0x7f78b80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.445+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78c40870a0 con 0x7f78cc159c60 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.445+0000 7f78cbfff700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 0x7f78b80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.445+0000 7f78cbfff700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 0x7f78b80696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.449+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78c4053fc0 con 0x7f78cc159c60 2023-10-07T09:04:07.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.641+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78cc157720 con 0x7f78cc159c60 2023-10-07T09:04:07.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.642+0000 7f78b3fff700 1 -- 172.21.15.46:0/1961831994 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f78c40575e0 con 0x7f78cc159c60 2023-10-07T09:04:07.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":78,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:55.374764+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 msgr2=0x7f78b80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 0x7f78b80696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2023-10-07T09:04:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 msgr2=0x7f78cc154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78c4013000 tx=0x7f78c4019000 comp rx=0 tx=0).stop 2023-10-07T09:04:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 shutdown_connections 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78b8067200 0x7f78b80696b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78cc159c60 0x7f78cc154f90 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78cc069560 0x7f78cc0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 --2- 172.21.15.46:0/1961831994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78cc159890 0x7f78cc0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 >> 172.21.15.46:0/1961831994 conn(0x7f78cc068e20 msgr2=0x7f78cc1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 shutdown_connections 2023-10-07T09:04:07.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.644+0000 7f78d2572700 1 -- 172.21.15.46:0/1961831994 wait complete. 2023-10-07T09:04:07.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:04:07.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.776+0000 7f7efb59e700 1 Processor -- start 2023-10-07T09:04:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.776+0000 7f7efb59e700 1 -- start start 2023-10-07T09:04:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc159420 0x7f7efc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efb59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7efc15d230 0x7f7efc15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc15dbd0 con 0x7f7efc1597f0 2023-10-07T09:04:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efb59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0b2980 con 0x7f7efc15d230 2023-10-07T09:04:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b11d0 con 0x7f7efc159420 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7efc15d230 0x7f7efc15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7efc15d230 0x7f7efc15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36448/0 (socket says 172.21.15.46:36448) 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 -- 172.21.15.46:0/341301343 learned_addr learned my addr 172.21.15.46:0/341301343 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efa59c700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc159420 0x7f7efc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 -- 172.21.15.46:0/341301343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc159420 msgr2=0x7f7efc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc159420 0x7f7efc0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 -- 172.21.15.46:0/341301343 >> v1:172.21.15.133:6789/0 conn(0x7f7efc1597f0 legacy=0x7f7efc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 -- 172.21.15.46:0/341301343 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0b14b0 con 0x7f7efc15d230 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.777+0000 7f7efad9d700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc15d230 0x7f7efc15d690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40099b0 tx=0x7f7ef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32df5541fd30228f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7ef959a700 1 -- 172.21.15.46:0/341301343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400b820 con 0x7f7efc15d230 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7ef959a700 1 -- 172.21.15.46:0/341301343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef400b980 con 0x7f7efc15d230 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7ef959a700 1 -- 172.21.15.46:0/341301343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400bd20 con 0x7f7efc15d230 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 -- 172.21.15.46:0/341301343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc15d230 msgr2=0x7f7efc15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc15d230 0x7f7efc15d690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40099b0 tx=0x7f7ef4009250 comp rx=0 tx=0).stop 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 -- 172.21.15.46:0/341301343 shutdown_connections 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc15d230 0x7f7efc15d690 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 --2- 172.21.15.46:0/341301343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc159420 0x7f7efc0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 -- 172.21.15.46:0/341301343 >> 172.21.15.46:0/341301343 conn(0x7f7efc0d0660 msgr2=0x7f7efc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 -- 172.21.15.46:0/341301343 shutdown_connections 2023-10-07T09:04:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.778+0000 7f7efb59e700 1 -- 172.21.15.46:0/341301343 wait complete. 2023-10-07T09:04:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.779+0000 7f7efb59e700 1 Processor -- start 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.779+0000 7f7efb59e700 1 -- start start 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc1597f0 0x7f7efc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7efc15d230 0x7f7efc153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15cd20 con 0x7f7efc159420 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c5e90 con 0x7f7efc15d230 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c55a0 con 0x7f7efc1597f0 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36460/0 (socket says 172.21.15.46:36460) 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 -- 172.21.15.46:0/3951945579 learned_addr learned my addr 172.21.15.46:0/3951945579 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efad9d700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7efc15d230 0x7f7efc153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7ef9d9b700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc1597f0 0x7f7efc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 -- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc1597f0 msgr2=0x7f7efc1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc1597f0 0x7f7efc1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 -- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7efc15d230 msgr2=0x7f7efc153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7efc15d230 0x7f7efc153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.780+0000 7f7efa59c700 1 -- 172.21.15.46:0/3951945579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40094f0 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7efa59c700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e1c0 tx=0x7f7eec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00ee00 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec014420 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc0c5840 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0147e0 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.781+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0c6320 con 0x7f7efc159420 2023-10-07T09:04:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.782+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0c6540 con 0x7f7efc159420 2023-10-07T09:04:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.782+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7eec014b50 con 0x7f7efc159420 2023-10-07T09:04:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.782+0000 7f7ef27fc700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 0x7f7edc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.782+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7eec085180 con 0x7f7efc159420 2023-10-07T09:04:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.783+0000 7f7ef9d9b700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 0x7f7edc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.783+0000 7f7ef9d9b700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 0x7f7edc0696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0af540 tx=0x7f7ee4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:07.787+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7eec0520a0 con 0x7f7efc159420 2023-10-07T09:04:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.024+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7efc0c6170 con 0x7f7efc159420 2023-10-07T09:04:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.025+0000 7f7ef27fc700 1 -- 172.21.15.46:0/3951945579 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f7eec0556c0 con 0x7f7efc159420 2023-10-07T09:04:08.027 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:04:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 msgr2=0x7f7edc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 0x7f7edc0696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0af540 tx=0x7f7ee4009040 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 msgr2=0x7f7efc0c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e1c0 tx=0x7f7eec009900 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 shutdown_connections 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7edc067200 0x7f7edc0696b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7efc15d230 0x7f7efc153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7efc159420 0x7f7efc0c7140 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 --2- 172.21.15.46:0/3951945579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7efc1597f0 0x7f7efc1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 >> 172.21.15.46:0/3951945579 conn(0x7f7efc0d0660 msgr2=0x7f7efc156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 shutdown_connections 2023-10-07T09:04:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.027+0000 7f7efb59e700 1 -- 172.21.15.46:0/3951945579 wait complete. 2023-10-07T09:04:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 48 2023-10-07T09:04:08.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.157+0000 7f8a51c1d700 1 Processor -- start 2023-10-07T09:04:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.157+0000 7f8a51c1d700 1 -- start start 2023-10-07T09:04:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a51c1d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a4c1597f0 0x7f8a4c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a51c1d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0b11d0 con 0x7f8a4c15d230 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a51c1d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0b14b0 con 0x7f8a4c159420 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a51c1d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0b1790 con 0x7f8a4c1597f0 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a4bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a4c1597f0 0x7f8a4c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a5141c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8a4c15d230 0x7f8a4c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59476/0 (socket says 172.21.15.46:59476) 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a5141c700 1 -- 172.21.15.46:0/1574852611 learned_addr learned my addr 172.21.15.46:0/1574852611 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a4bfff700 1 -- 172.21.15.46:0/1574852611 >> v1:172.21.15.133:6789/0 conn(0x7f8a4c159420 legacy=0x7f8a4c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a4bfff700 1 -- 172.21.15.46:0/1574852611 >> v1:172.21.15.46:6789/0 conn(0x7f8a4c15d230 legacy=0x7f8a4c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.158+0000 7f8a4bfff700 1 -- 172.21.15.46:0/1574852611 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0b1a70 con 0x7f8a4c1597f0 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a4bfff700 1 --2- 172.21.15.46:0/1574852611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0b2270 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0098e0 tx=0x7f8a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef8662dd018ddc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a4b7fe700 1 -- 172.21.15.46:0/1574852611 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c009e80 con 0x7f8a4c1597f0 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a4b7fe700 1 -- 172.21.15.46:0/1574852611 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00b820 con 0x7f8a4c1597f0 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a4b7fe700 1 -- 172.21.15.46:0/1574852611 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00bba0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 -- 172.21.15.46:0/1574852611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 msgr2=0x7f8a4c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/1574852611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0b2270 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0098e0 tx=0x7f8a3c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 -- 172.21.15.46:0/1574852611 shutdown_connections 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/1574852611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0b2270 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 -- 172.21.15.46:0/1574852611 >> 172.21.15.46:0/1574852611 conn(0x7f8a4c0d0660 msgr2=0x7f8a4c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 -- 172.21.15.46:0/1574852611 shutdown_connections 2023-10-07T09:04:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.159+0000 7f8a51c1d700 1 -- 172.21.15.46:0/1574852611 wait complete. 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.160+0000 7f8a51c1d700 1 Processor -- start 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 -- start start 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a4c159420 0x7f8a4c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 0x7f8a4c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0cc490 con 0x7f8a4c1597f0 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0c6960 con 0x7f8a4c15d230 2023-10-07T09:04:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a51c1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0c7680 con 0x7f8a4c159420 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.161+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36474/0 (socket says 172.21.15.46:36474) 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 -- 172.21.15.46:0/4221673295 learned_addr learned my addr 172.21.15.46:0/4221673295 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a50c1b700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a4c159420 0x7f8a4c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a5141c700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 0x7f8a4c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 -- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a4c159420 msgr2=0x7f8a4c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a4c159420 0x7f8a4c0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 -- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 msgr2=0x7f8a4c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 0x7f8a4c0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 -- 172.21.15.46:0/4221673295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c009420 con 0x7f8a4c1597f0 2023-10-07T09:04:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a5141c700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 0x7f8a4c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a4bfff700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0030c0 tx=0x7f8a3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00ba60 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c020070 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c0c60c0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00bbe0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.162+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c0c6680 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.163+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c04c3c0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.164+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8a3c022030 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.164+0000 7f8a48ff9700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 0x7f8a2c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.164+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a3c0868d0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.164+0000 7f8a50c1b700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 0x7f8a2c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.165+0000 7f8a50c1b700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 0x7f8a2c0696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007fd0 tx=0x7f8a440026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.168+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a3c0537f0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.409+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a4c04c3c0 con 0x7f8a4c1597f0 2023-10-07T09:04:08.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.410+0000 7f8a48ff9700 1 -- 172.21.15.46:0/4221673295 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8a3c056e10 con 0x7f8a4c1597f0 2023-10-07T09:04:08.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:08.411 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:03:53.773708+0000","modified":"2023-10-07T09:03:57.384591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6123":{"gid":6123,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2936476891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2936476891},{"type":"v1","addr":"172.21.15.133:6836","nonce":2936476891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 msgr2=0x7f8a2c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 0x7f8a2c0696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007fd0 tx=0x7f8a440026a0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 msgr2=0x7f8a4c0c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0030c0 tx=0x7f8a3c016000 comp rx=0 tx=0).stop 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 shutdown_connections 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a2c067200 0x7f8a2c0696b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a4c15d230 0x7f8a4c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a4c159420 0x7f8a4c0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 --2- 172.21.15.46:0/4221673295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c1597f0 0x7f8a4c0c5550 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 >> 172.21.15.46:0/4221673295 conn(0x7f8a4c0d0660 msgr2=0x7f8a4c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 shutdown_connections 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.412+0000 7f8a51c1d700 1 -- 172.21.15.46:0/4221673295 wait complete. 2023-10-07T09:04:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 48 2023-10-07T09:04:08.425 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:08.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.542+0000 7f2fe8ba0700 1 Processor -- start 2023-10-07T09:04:08.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.542+0000 7f2fe8ba0700 1 -- start start 2023-10-07T09:04:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fe4159840 0x7f2fe40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fe40cba70 0x7f2fe40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159c10 0x7f2fe40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe40cfb30 con 0x7f2fe4159840 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe40cbf10 con 0x7f2fe40cba70 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe8ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40cf4e0 con 0x7f2fe4159c10 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fe4159840 0x7f2fe40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fe4159840 0x7f2fe40cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36476/0 (socket says 172.21.15.46:36476) 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.543+0000 7f2fe259c700 1 -- 172.21.15.46:0/3844073973 learned_addr learned my addr 172.21.15.46:0/3844073973 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe2d9d700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159c10 0x7f2fe40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe1d9b700 1 --2- 172.21.15.46:0/3844073973 >> v2:172.21.15.133:3300/0 conn(0x7f2fe40cba70 0x7f2fe40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 -- 172.21.15.46:0/3844073973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159c10 msgr2=0x7f2fe40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159c10 0x7f2fe40699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 -- 172.21.15.46:0/3844073973 >> v2:172.21.15.133:3300/0 conn(0x7f2fe40cba70 msgr2=0x7f2fe40694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3844073973 >> v2:172.21.15.133:3300/0 conn(0x7f2fe40cba70 0x7f2fe40694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 -- 172.21.15.46:0/3844073973 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe40cf7c0 con 0x7f2fe4159840 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159840 0x7f2fe40cb530 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40099b0 tx=0x7f2fd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba8ae384feaaa73 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe159a700 1 -- 172.21.15.46:0/3844073973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400b820 con 0x7f2fe4159840 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe159a700 1 -- 172.21.15.46:0/3844073973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400b980 con 0x7f2fe4159840 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.544+0000 7f2fe159a700 1 -- 172.21.15.46:0/3844073973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400bd40 con 0x7f2fe4159840 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3844073973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159840 msgr2=0x7f2fe40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159840 0x7f2fe40cb530 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40099b0 tx=0x7f2fd4009250 comp rx=0 tx=0).stop 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3844073973 shutdown_connections 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159c10 0x7f2fe40699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3844073973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159840 0x7f2fe40cb530 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3844073973 >> v2:172.21.15.133:3300/0 conn(0x7f2fe40cba70 0x7f2fe40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3844073973 >> 172.21.15.46:0/3844073973 conn(0x7f2fe4068e10 msgr2=0x7f2fe40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3844073973 shutdown_connections 2023-10-07T09:04:08.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.545+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3844073973 wait complete. 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.546+0000 7f2fe8ba0700 1 Processor -- start 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.546+0000 7f2fe8ba0700 1 -- start start 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe40cba70 0x7f2fe4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159840 0x7f2fe415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe415da80 con 0x7f2fe4159c10 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40b3630 con 0x7f2fe40cba70 2023-10-07T09:04:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40b38d0 con 0x7f2fe4159840 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36484/0 (socket says 172.21.15.46:36484) 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 -- 172.21.15.46:0/3384706166 learned_addr learned my addr 172.21.15.46:0/3384706166 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe1d9b700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159840 0x7f2fe415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe40cba70 0x7f2fe4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 -- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159840 msgr2=0x7f2fe415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159840 0x7f2fe415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 -- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe40cba70 msgr2=0x7f2fe4154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe40cba70 0x7f2fe4154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 -- 172.21.15.46:0/3384706166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40094f0 con 0x7f2fe4159c10 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe2d9d700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007ef0 tx=0x7f2fdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00ec10 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc00ed70 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe40b3bb0 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc014670 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.547+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe40b4170 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.548+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe4064550 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.549+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2fdc014a60 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.549+0000 7f2fd27fc700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 0x7f2fc40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.549+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fdc085100 con 0x7f2fe4159c10 2023-10-07T09:04:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.549+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 0x7f2fc40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.550+0000 7f2fe259c700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 0x7f2fc40696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40099b0 tx=0x7f2fd4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.553+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fdc051fe0 con 0x7f2fe4159c10 2023-10-07T09:04:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.750+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fe404c3c0 con 0x7f2fe4159c10 2023-10-07T09:04:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.751+0000 7f2fd27fc700 1 -- 172.21.15.46:0/3384706166 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f2fdc055600 con 0x7f2fe4159c10 2023-10-07T09:04:08.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:08.752 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":78,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:03:55.374764+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:03:52.162534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T09:03:52.738311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 msgr2=0x7f2fc40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 0x7f2fc40696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40099b0 tx=0x7f2fd4017000 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 msgr2=0x7f2fe40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007ef0 tx=0x7f2fdc009840 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 shutdown_connections 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fc4067200 0x7f2fc40696b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe4159c10 0x7f2fe40caff0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe40cba70 0x7f2fe4154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 --2- 172.21.15.46:0/3384706166 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fe4159840 0x7f2fe415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.753+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 >> 172.21.15.46:0/3384706166 conn(0x7f2fe4068e10 msgr2=0x7f2fe40b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.754+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 shutdown_connections 2023-10-07T09:04:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.754+0000 7f2fe8ba0700 1 -- 172.21.15.46:0/3384706166 wait complete. 2023-10-07T09:04:08.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:04:08.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.886+0000 7efe6e045700 1 Processor -- start 2023-10-07T09:04:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.886+0000 7efe6e045700 1 -- start start 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.886+0000 7efe6e045700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe68159c10 0x7efe6815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe6e045700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe68068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe6e045700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe68068bb0 0x7efe6815c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe6e045700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680b2a40 con 0x7efe68159c10 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe6e045700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6815c480 con 0x7efe68068bb0 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe6e045700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815b5d0 con 0x7efe680b5ea0 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe68159c10 0x7efe6815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe68159c10 0x7efe6815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36486/0 (socket says 172.21.15.46:36486) 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 -- 172.21.15.46:0/1452895448 learned_addr learned my addr 172.21.15.46:0/1452895448 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe67fff700 1 --2- 172.21.15.46:0/1452895448 >> v2:172.21.15.133:3300/0 conn(0x7efe68068bb0 0x7efe6815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe66ffd700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe68068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 -- 172.21.15.46:0/1452895448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 msgr2=0x7efe68068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe68068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 -- 172.21.15.46:0/1452895448 >> v2:172.21.15.133:3300/0 conn(0x7efe68068bb0 msgr2=0x7efe6815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 --2- 172.21.15.46:0/1452895448 >> v2:172.21.15.133:3300/0 conn(0x7efe68068bb0 0x7efe6815c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 -- 172.21.15.46:0/1452895448 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6815b870 con 0x7efe68159c10 2023-10-07T09:04:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe677fe700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe6815b090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe6808af20 tx=0x7efe58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e905109f0e7d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe667fc700 1 -- 172.21.15.46:0/1452895448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800e070 con 0x7efe68159c10 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe667fc700 1 -- 172.21.15.46:0/1452895448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5800ba50 con 0x7efe68159c10 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.887+0000 7efe667fc700 1 -- 172.21.15.46:0/1452895448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580092e0 con 0x7efe68159c10 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 -- 172.21.15.46:0/1452895448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 msgr2=0x7efe6815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe6815b090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe6808af20 tx=0x7efe58009840 comp rx=0 tx=0).stop 2023-10-07T09:04:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 -- 172.21.15.46:0/1452895448 shutdown_connections 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 --2- 172.21.15.46:0/1452895448 >> v2:172.21.15.133:3300/0 conn(0x7efe68068bb0 0x7efe6815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe6815b090 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 --2- 172.21.15.46:0/1452895448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe68068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 -- 172.21.15.46:0/1452895448 >> 172.21.15.46:0/1452895448 conn(0x7efe68099a20 msgr2=0x7efe680af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 -- 172.21.15.46:0/1452895448 shutdown_connections 2023-10-07T09:04:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.888+0000 7efe6e045700 1 -- 172.21.15.46:0/1452895448 wait complete. 2023-10-07T09:04:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.889+0000 7efe6e045700 1 Processor -- start 2023-10-07T09:04:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.889+0000 7efe6e045700 1 -- start start 2023-10-07T09:04:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe68068bb0 0x7efe6809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe680c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6816ca90 con 0x7efe68159c10 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6816cce0 con 0x7efe68068bb0 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe6e045700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6816cfc0 con 0x7efe680b5ea0 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36498/0 (socket says 172.21.15.46:36498) 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 -- 172.21.15.46:0/598864385 learned_addr learned my addr 172.21.15.46:0/598864385 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe677fe700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe68068bb0 0x7efe6809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe66ffd700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe680c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 -- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 msgr2=0x7efe680c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe680c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 -- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe68068bb0 msgr2=0x7efe6809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe68068bb0 0x7efe6809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe67fff700 1 -- 172.21.15.46:0/598864385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009ae0 con 0x7efe68159c10 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.890+0000 7efe66ffd700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe680c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe67fff700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d890 tx=0x7efe60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600125f0 con 0x7efe68159c10 2023-10-07T09:04:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe60012770 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6816d2a0 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60012b30 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.891+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6816d860 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.892+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6804c3c0 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.892+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7efe6001e460 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.892+0000 7efe4f7fe700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 0x7efe540696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.893+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe60084f50 con 0x7efe68159c10 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.893+0000 7efe677fe700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 0x7efe540696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.893+0000 7efe677fe700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 0x7efe540696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe58009880 tx=0x7efe58018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:08.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:08.897+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe60051e70 con 0x7efe68159c10 2023-10-07T09:04:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.135+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efe6815bb50 con 0x7efe68159c10 2023-10-07T09:04:09.136 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:04:09.135+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:04:09.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.139+0000 7efe4f7fe700 1 -- 172.21.15.46:0/598864385 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7efe60055490 con 0x7efe68159c10 2023-10-07T09:04:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 msgr2=0x7efe540696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 0x7efe540696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe58009880 tx=0x7efe58018000 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 msgr2=0x7efe680c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d890 tx=0x7efe60008040 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 shutdown_connections 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe54067200 0x7efe540696b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe68159c10 0x7efe680c8f10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe68068bb0 0x7efe6809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 --2- 172.21.15.46:0/598864385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe680b5ea0 0x7efe680c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 >> 172.21.15.46:0/598864385 conn(0x7efe68099a20 msgr2=0x7efe6809a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 shutdown_connections 2023-10-07T09:04:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.141+0000 7efe6e045700 1 -- 172.21.15.46:0/598864385 wait complete. 2023-10-07T09:04:09.143 INFO:tasks.ceph.mds.b.smithi133.stderr: -1773> 2023-10-07T09:03:59.680+0000 7f10c0282700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:04:09.143 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:04:09.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:04:09.165 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:04:09.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.274+0000 7fad6a709700 1 Processor -- start 2023-10-07T09:04:09.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.274+0000 7fad6a709700 1 -- start start 2023-10-07T09:04:09.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad6a709700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad640b1b40 0x7fad640b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad6a709700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640cfb00 con 0x7fad640b4e70 2023-10-07T09:04:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad6a709700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b5c40 con 0x7fad640b16d0 2023-10-07T09:04:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad6a709700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b5f20 con 0x7fad640b1b40 2023-10-07T09:04:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad69707700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fad640b4e70 0x7fad640ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59484/0 (socket says 172.21.15.46:59484) 2023-10-07T09:04:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad69707700 1 -- 172.21.15.46:0/4047200223 learned_addr learned my addr 172.21.15.46:0/4047200223 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480332885 0 0) 0x7fad640cfb00 con 0x7fad640b4e70 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad69f08700 1 --2- 172.21.15.46:0/4047200223 >> v2:172.21.15.133:3300/0 conn(0x7fad640b1b40 0x7fad640b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.275+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c003570 con 0x7fad640b4e70 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353236609 0 0) 0x7fad4c003570 con 0x7fad640b4e70 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 >> v2:172.21.15.133:3300/0 conn(0x7fad640b1b40 msgr2=0x7fad640b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 --2- 172.21.15.46:0/4047200223 >> v2:172.21.15.133:3300/0 conn(0x7fad640b1b40 0x7fad640b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 >> v1:172.21.15.133:6789/0 conn(0x7fad640b16d0 legacy=0x7fad640b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b6200 con 0x7fad640b4e70 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fad540017f0 con 0x7fad640b4e70 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 >> v1:172.21.15.46:6789/0 conn(0x7fad640b4e70 legacy=0x7fad640ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c003a60 0x7fad4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 0x7fad4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c0052e0 0x7fad4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad640b5f20 con 0x7fad4c004810 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c00c2a0 con 0x7fad4c003a60 2023-10-07T09:04:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c00c460 con 0x7fad4c0052e0 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 0x7fad4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad69707700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c003a60 0x7fad4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad69f08700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c0052e0 0x7fad4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 -- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c0052e0 msgr2=0x7fad4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c0052e0 0x7fad4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 -- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c003a60 msgr2=0x7fad4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c003a60 0x7fad4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 -- 172.21.15.46:0/4047200223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c003570 con 0x7fad4c004810 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad69f08700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c0052e0 0x7fad4c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad69707700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c003a60 0x7fad4c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad69f08700 1 -- 172.21.15.46:0/4047200223 reap_dead start 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad68f06700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 0x7fad4c004c80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fad580018b0 tx=0x7fad58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a9f426e912f89e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58012420 con 0x7fad4c004810 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580125a0 con 0x7fad4c004810 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.276+0000 7fad63fff700 1 -- 172.21.15.46:0/4047200223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58012960 con 0x7fad4c004810 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 -- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 msgr2=0x7fad4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 0x7fad4c004c80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fad580018b0 tx=0x7fad58007d30 comp rx=0 tx=0).stop 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 -- 172.21.15.46:0/4047200223 shutdown_connections 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 --2- 172.21.15.46:0/4047200223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c004810 0x7fad4c004c80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 -- 172.21.15.46:0/4047200223 >> 172.21.15.46:0/4047200223 conn(0x7fad640d10c0 msgr2=0x7fad640affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 -- 172.21.15.46:0/4047200223 shutdown_connections 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.277+0000 7fad6a709700 1 -- 172.21.15.46:0/4047200223 wait complete. 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.278+0000 7fad6a709700 1 Processor -- start 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.278+0000 7fad6a709700 1 -- start start 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c004810 0x7fad640c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad640cb210 0x7fad6415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6414b690 con 0x7fad6414acb0 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad640c9540 con 0x7fad4c004810 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad6a709700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640cb740 con 0x7fad640cb210 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad69f08700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad69f08700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36514/0 (socket says 172.21.15.46:36514) 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad69f08700 1 -- 172.21.15.46:0/4145838011 learned_addr learned my addr 172.21.15.46:0/4145838011 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad69707700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c004810 0x7fad640c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.279+0000 7fad68f06700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad640cb210 0x7fad6415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 -- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad640cb210 msgr2=0x7fad6415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad640cb210 0x7fad6415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 -- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c004810 msgr2=0x7fad640c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c004810 0x7fad640c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 -- 172.21.15.46:0/4145838011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640cba20 con 0x7fad6414acb0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad69f08700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fad6406b650 tx=0x7fad5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011ed0 con 0x7fad6414acb0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c015670 con 0x7fad6414acb0 2023-10-07T09:04:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad640cbd00 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c015a30 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.280+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad640cc2c0 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.281+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad640c6870 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.281+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fad5c01f410 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.282+0000 7fad617fa700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 0x7fad500696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.282+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fad5c0846c0 con 0x7fad6414acb0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.282+0000 7fad69707700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 0x7fad500696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.282+0000 7fad69707700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 0x7fad500696e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fad54001580 tx=0x7fad540013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.286+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad640c6870 con 0x7fad6414acb0 2023-10-07T09:04:09.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:09.527+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad640c6870 con 0x7fad6414acb0 2023-10-07T09:04:10.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.141+0000 7fad617fa700 1 -- 172.21.15.46:0/4145838011 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad640c6870 con 0x7fad6414acb0 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 msgr2=0x7fad500696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 0x7fad500696e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fad54001580 tx=0x7fad540013e0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 msgr2=0x7fad6414b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fad6406b650 tx=0x7fad5c008040 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 shutdown_connections 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad50067230 0x7fad500696e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6414acb0 0x7fad6414b150 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c004810 0x7fad640c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 --2- 172.21.15.46:0/4145838011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad640cb210 0x7fad6415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 >> 172.21.15.46:0/4145838011 conn(0x7fad640d10c0 msgr2=0x7fad640b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 shutdown_connections 2023-10-07T09:04:10.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.144+0000 7fad6a709700 1 -- 172.21.15.46:0/4145838011 wait complete. 2023-10-07T09:04:10.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:04:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.283+0000 7f93a4fa1700 1 Processor -- start 2023-10-07T09:04:10.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.283+0000 7f93a4fa1700 1 -- start start 2023-10-07T09:04:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f93a4fa1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93a00cd910 0x7f93a00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f93a4fa1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00b5b00 con 0x7f93a00b55a0 2023-10-07T09:04:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f93a4fa1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00b5da0 con 0x7f93a0159ec0 2023-10-07T09:04:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f93a4fa1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00b6080 con 0x7f93a00cd910 2023-10-07T09:04:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f939ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f93a00b55a0 0x7f93a00ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59948/0 (socket says 172.21.15.46:59948) 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.284+0000 7f939ed9d700 1 -- 172.21.15.46:0/3689481015 learned_addr learned my addr 172.21.15.46:0/3689481015 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939dd9b700 1 --2- 172.21.15.46:0/3689481015 >> v2:172.21.15.133:3300/0 conn(0x7f93a00cd910 0x7f93a00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101222021 0 0) 0x7f93a00b5b00 con 0x7f93a00b55a0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c003570 con 0x7f93a00b55a0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829060970 0 0) 0x7f93a00b5da0 con 0x7f93a0159ec0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a00b5b00 con 0x7f93a0159ec0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10955314 0 0) 0x7f938c003570 con 0x7f93a00b55a0 2023-10-07T09:04:10.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 >> v2:172.21.15.133:3300/0 conn(0x7f93a00cd910 msgr2=0x7f93a00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 --2- 172.21.15.46:0/3689481015 >> v2:172.21.15.133:3300/0 conn(0x7f93a00cd910 0x7f93a00ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 >> v1:172.21.15.133:6789/0 conn(0x7f93a0159ec0 legacy=0x7f93a00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00cc100 con 0x7f93a00b55a0 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f93980017f0 con 0x7f93a00b55a0 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 >> v1:172.21.15.46:6789/0 conn(0x7f93a00b55a0 legacy=0x7f93a00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 0x7f938c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f938c004810 0x7f938c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c0051c0 0x7f938c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00b6080 con 0x7f938c003c20 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c00c130 con 0x7f938c0051c0 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c00c2f0 con 0x7f938c004810 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939e59c700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 0x7f938c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939ed9d700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c0051c0 0x7f938c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.285+0000 7f939dd9b700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f938c004810 0x7f938c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 -- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f938c004810 msgr2=0x7f938c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f938c004810 0x7f938c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 -- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c0051c0 msgr2=0x7f938c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c0051c0 0x7f938c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 -- 172.21.15.46:0/3689481015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c003570 con 0x7f938c003c20 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939ed9d700 1 -- 172.21.15.46:0/3689481015 reap_dead start 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939dd9b700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f938c004810 0x7f938c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939e59c700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 0x7f938c004010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9390001a30 tx=0x7f9390007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bd6a140e0939a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93900013f0 con 0x7f938c003c20 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000c5d0 con 0x7f938c003c20 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f939d59a700 1 -- 172.21.15.46:0/3689481015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000c990 con 0x7f938c003c20 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f93a4fa1700 1 -- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 msgr2=0x7f938c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.286+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 0x7f938c004010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9390001a30 tx=0x7f9390007d80 comp rx=0 tx=0).stop 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.287+0000 7f93a4fa1700 1 -- 172.21.15.46:0/3689481015 shutdown_connections 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.287+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/3689481015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f938c003c20 0x7f938c004010 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.287+0000 7f93a4fa1700 1 -- 172.21.15.46:0/3689481015 >> 172.21.15.46:0/3689481015 conn(0x7f93a00999f0 msgr2=0x7f93a00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.287+0000 7f93a4fa1700 1 -- 172.21.15.46:0/3689481015 shutdown_connections 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.287+0000 7f93a4fa1700 1 -- 172.21.15.46:0/3689481015 wait complete. 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 Processor -- start 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 -- start start 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c003c20 0x7f93a009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 0x7f93a009c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a009b250 con 0x7f93a00c9a50 2023-10-07T09:04:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a009b530 con 0x7f938c003c20 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f93a4fa1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a009b810 con 0x7f93a00c9ec0 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f939dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.288+0000 7f939dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40938/0 (socket says 172.21.15.46:40938) 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 -- 172.21.15.46:0/1106984867 learned_addr learned my addr 172.21.15.46:0/1106984867 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939e59c700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c003c20 0x7f93a009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939ed9d700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 0x7f93a009c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 -- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 msgr2=0x7f93a009c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 0x7f93a009c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 -- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c003c20 msgr2=0x7f93a009c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c003c20 0x7f93a009c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 -- 172.21.15.46:0/1106984867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a009baf0 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939ed9d700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 0x7f93a009c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f939dd9b700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9388011710 tx=0x7f9388008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388015670 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880157d0 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a009bdd0 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388015b70 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.289+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a00c8fc0 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.290+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00c9240 con 0x7f93a00c9a50 2023-10-07T09:04:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.290+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9388013410 con 0x7f93a00c9a50 2023-10-07T09:04:10.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.291+0000 7f93967fc700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 0x7f93800696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:10.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.291+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f93880850f0 con 0x7f93a00c9a50 2023-10-07T09:04:10.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.291+0000 7f939e59c700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 0x7f93800696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:10.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.292+0000 7f939e59c700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 0x7f93800696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f9390015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:10.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.295+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9388051fc0 con 0x7f93a00c9a50 2023-10-07T09:04:10.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:10.495+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93a009c140 con 0x7f93a00c9a50 2023-10-07T09:04:11.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.143+0000 7f93967fc700 1 -- 172.21.15.46:0/1106984867 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7f93880555e0 con 0x7f93a00c9a50 2023-10-07T09:04:11.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 msgr2=0x7f93800696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 0x7f93800696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f9390015000 comp rx=0 tx=0).stop 2023-10-07T09:04:11.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 msgr2=0x7f93a00c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9388011710 tx=0x7f9388008040 comp rx=0 tx=0).stop 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 shutdown_connections 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9380067200 0x7f93800696b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93a00c9ec0 0x7f93a009c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f938c003c20 0x7f93a009c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 --2- 172.21.15.46:0/1106984867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a00c9a50 0x7f93a00c8a80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.147+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 >> 172.21.15.46:0/1106984867 conn(0x7f93a00999f0 msgr2=0x7f93a0158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.148+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 shutdown_connections 2023-10-07T09:04:11.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.148+0000 7f93a4fa1700 1 -- 172.21.15.46:0/1106984867 wait complete. 2023-10-07T09:04:11.150 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:04:11.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:04:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.292+0000 7fe70e11c700 1 Processor -- start 2023-10-07T09:04:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.293+0000 7fe70e11c700 1 -- start start 2023-10-07T09:04:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70e11c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe708154000 0x7fe70806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70e11c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080c9480 con 0x7fe7080685e0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70e11c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70815d880 con 0x7fe70815d3f0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70e11c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70815ae00 con 0x7fe708154000 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70d11a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe7080685e0 0x7fe70815a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59954/0 (socket says 172.21.15.46:59954) 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70d11a700 1 -- 172.21.15.46:0/4085755307 learned_addr learned my addr 172.21.15.46:0/4085755307 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe70d91b700 1 --2- 172.21.15.46:0/4085755307 >> v2:172.21.15.133:3300/0 conn(0x7fe708154000 0x7fe70806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659739352 0 0) 0x7fe7080c9480 con 0x7fe7080685e0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f4003570 con 0x7fe7080685e0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221740596 0 0) 0x7fe70815d880 con 0x7fe70815d3f0 2023-10-07T09:04:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7080c9480 con 0x7fe70815d3f0 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771572098 0 0) 0x7fe6f4003570 con 0x7fe7080685e0 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 >> v2:172.21.15.133:3300/0 conn(0x7fe708154000 msgr2=0x7fe70806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 --2- 172.21.15.46:0/4085755307 >> v2:172.21.15.133:3300/0 conn(0x7fe708154000 0x7fe70806eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 >> v1:172.21.15.133:6789/0 conn(0x7fe70815d3f0 legacy=0x7fe7081538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70815db60 con 0x7fe7080685e0 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fe704001470 con 0x7fe7080685e0 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 >> v1:172.21.15.46:6789/0 conn(0x7fe7080685e0 legacy=0x7fe70815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4003bf0 0x7fe6f4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f4004810 0x7fe6f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 0x7fe6f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f400c080 con 0x7fe6f40051c0 2023-10-07T09:04:11.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f400c1f0 con 0x7fe6f4003bf0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.294+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f400c3b0 con 0x7fe6f4004810 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 0x7fe6f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d11a700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4003bf0 0x7fe6f4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70c919700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f4004810 0x7fe6f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 -- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f4004810 msgr2=0x7fe6f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f4004810 0x7fe6f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 -- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4003bf0 msgr2=0x7fe6f4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4003bf0 0x7fe6f4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 -- 172.21.15.46:0/4085755307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4003570 con 0x7fe6f40051c0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 -- 172.21.15.46:0/4085755307 reap_dead start 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe70d91b700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 0x7fe6f400ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe70000e210 tx=0x7fe70000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e9992d3cebfea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000eac0 con 0x7fe6f40051c0 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000f040 con 0x7fe6f40051c0 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.295+0000 7fe6fffff700 1 -- 172.21.15.46:0/4085755307 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000ee70 con 0x7fe6f40051c0 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 -- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 msgr2=0x7fe6f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 0x7fe6f400ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe70000e210 tx=0x7fe70000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 -- 172.21.15.46:0/4085755307 shutdown_connections 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 --2- 172.21.15.46:0/4085755307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f40051c0 0x7fe6f400ba60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 -- 172.21.15.46:0/4085755307 >> 172.21.15.46:0/4085755307 conn(0x7fe70806b420 msgr2=0x7fe7080cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 -- 172.21.15.46:0/4085755307 shutdown_connections 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.296+0000 7fe70e11c700 1 -- 172.21.15.46:0/4085755307 wait complete. 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.297+0000 7fe70e11c700 1 Processor -- start 2023-10-07T09:04:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.297+0000 7fe70e11c700 1 -- start start 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f40051c0 0x7fe7080c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe70816ab80 0x7fe7080c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe708169ed0 con 0x7fe7081594e0 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe708159c50 con 0x7fe6f40051c0 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70e11c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816a6f0 con 0x7fe70816ab80 2023-10-07T09:04:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40962/0 (socket says 172.21.15.46:40962) 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 -- 172.21.15.46:0/1860933408 learned_addr learned my addr 172.21.15.46:0/1860933408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70d11a700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f40051c0 0x7fe7080c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70d91b700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe70816ab80 0x7fe7080c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 -- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe70816ab80 msgr2=0x7fe7080c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe70816ab80 0x7fe7080c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 -- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f40051c0 msgr2=0x7fe7080c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f40051c0 0x7fe7080c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 -- 172.21.15.46:0/1860933408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70816a0e0 con 0x7fe7081594e0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe70c919700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800f8b0 tx=0x7fe6f8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8006870 con 0x7fe7081594e0 2023-10-07T09:04:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.298+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80069d0 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.299+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe708159970 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.299+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8006d50 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.299+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7080c6a20 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.300+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70816a860 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.300+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe6f8007230 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.300+0000 7fe6fd7fa700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 0x7fe6ec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.300+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe6f8084590 con 0x7fe7081594e0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.300+0000 7fe70d11a700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 0x7fe6ec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.301+0000 7fe70d11a700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 0x7fe6ec0696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe704007fd0 tx=0x7fe704001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:11.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.305+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6f8051610 con 0x7fe7081594e0 2023-10-07T09:04:11.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:11.498+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe70804c3c0 con 0x7fe7081594e0 2023-10-07T09:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.154+0000 7fe6fd7fa700 1 -- 172.21.15.46:0/1860933408 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe6f8054c30 con 0x7fe7081594e0 2023-10-07T09:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.159+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 msgr2=0x7fe6ec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.159+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 0x7fe6ec0696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe704007fd0 tx=0x7fe704001e10 comp rx=0 tx=0).stop 2023-10-07T09:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.159+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 msgr2=0x7fe708150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.159+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800f8b0 tx=0x7fe6f8007d80 comp rx=0 tx=0).stop 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 shutdown_connections 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe6ec067200 0x7fe6ec0696b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe70816ab80 0x7fe7080c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f40051c0 0x7fe7080c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 --2- 172.21.15.46:0/1860933408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7081594e0 0x7fe708150e40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 >> 172.21.15.46:0/1860933408 conn(0x7fe70806b420 msgr2=0x7fe7080cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 shutdown_connections 2023-10-07T09:04:12.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.160+0000 7fe70e11c700 1 -- 172.21.15.46:0/1860933408 wait complete. 2023-10-07T09:04:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:04:12.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:04:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.300+0000 7ff6e9608700 1 Processor -- start 2023-10-07T09:04:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.300+0000 7ff6e9608700 1 -- start start 2023-10-07T09:04:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e9608700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e9608700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e40ac450 con 0x7ff6e40637d0 2023-10-07T09:04:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e9608700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e4069d00 con 0x7ff6e406a2b0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e9608700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40693d0 con 0x7ff6e406b160 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e27fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff6e40637d0 0x7ff6e4068cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59964/0 (socket says 172.21.15.46:59964) 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e27fc700 1 -- 172.21.15.46:0/1903568093 learned_addr learned my addr 172.21.15.46:0/1903568093 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e2ffd700 1 --2- 172.21.15.46:0/1903568093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153610944 0 0) 0x7ff6e40ac450 con 0x7ff6e40637d0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003570 con 0x7ff6e40637d0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288658818 0 0) 0x7ff6e4069d00 con 0x7ff6e406a2b0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e40ac450 con 0x7ff6e406a2b0 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/1903568093 >> v1:172.21.15.133:6789/0 conn(0x7ff6e406a2b0 legacy=0x7ff6e406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/1903568093 >> v1:172.21.15.46:6789/0 conn(0x7ff6e40637d0 legacy=0x7ff6e4068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/1903568093 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4068830 con 0x7ff6e406b160 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.301+0000 7ff6e2ffd700 1 --2- 172.21.15.46:0/1903568093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e406b530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009910 tx=0x7ff6d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d354bc6472e94bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011630 con 0x7ff6e406b160 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4011790 con 0x7ff6e406b160 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e1ffb700 1 -- 172.21.15.46:0/1903568093 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011b30 con 0x7ff6e406b160 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 -- 172.21.15.46:0/1903568093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 msgr2=0x7ff6e406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 --2- 172.21.15.46:0/1903568093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e406b530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009910 tx=0x7ff6d40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 -- 172.21.15.46:0/1903568093 shutdown_connections 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 --2- 172.21.15.46:0/1903568093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e406b530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 -- 172.21.15.46:0/1903568093 >> 172.21.15.46:0/1903568093 conn(0x7ff6e406ded0 msgr2=0x7ff6e406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 -- 172.21.15.46:0/1903568093 shutdown_connections 2023-10-07T09:04:12.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.302+0000 7ff6e9608700 1 -- 172.21.15.46:0/1903568093 wait complete. 2023-10-07T09:04:12.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.303+0000 7ff6e9608700 1 Processor -- start 2023-10-07T09:04:12.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.303+0000 7ff6e9608700 1 -- start start 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6e406a2b0 0x7ff6e4157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e4169d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e4159290 con 0x7ff6e40637d0 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e41579b0 con 0x7ff6e406a2b0 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e9608700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e416a5d0 con 0x7ff6e406b160 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40964/0 (socket says 172.21.15.46:40964) 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/3870333961 learned_addr learned my addr 172.21.15.46:0/3870333961 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e27fc700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6e406a2b0 0x7ff6e4157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.304+0000 7ff6e37fe700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e4169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 msgr2=0x7ff6e4169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e4169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6e406a2b0 msgr2=0x7ff6e4157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6e406a2b0 0x7ff6e4157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 -- 172.21.15.46:0/3870333961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009420 con 0x7ff6e40637d0 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e37fe700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e4169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e2ffd700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009f00 tx=0x7ff6d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401f070 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4002f70 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e416a8b0 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011900 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.305+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e416a250 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.306+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e40cc4f0 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.306+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff6d4023070 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.307+0000 7ff6caffd700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 0x7ff6d00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.307+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff6d40859b0 con 0x7ff6e40637d0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.307+0000 7ff6e27fc700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 0x7ff6d00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.308+0000 7ff6e27fc700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 0x7ff6d00696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8007fd0 tx=0x7ff6d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:04:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.311+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6d4052b90 con 0x7ff6e40637d0 2023-10-07T09:04:12.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:04:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.508+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff6e404c3c0 con 0x7ff6e40637d0 2023-10-07T09:04:12.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.511+0000 7ff6caffd700 1 -- 172.21.15.46:0/3870333961 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6d40150a0 con 0x7ff6e40637d0 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 msgr2=0x7ff6d00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 0x7ff6d00696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8007fd0 tx=0x7ff6d8009040 comp rx=0 tx=0).stop 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 msgr2=0x7ff6e4154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009f00 tx=0x7ff6d4017000 comp rx=0 tx=0).stop 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 shutdown_connections 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6d0067200 0x7ff6d00696b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6e406b160 0x7ff6e4169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6e40637d0 0x7ff6e4154da0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 --2- 172.21.15.46:0/3870333961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6e406a2b0 0x7ff6e4157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 >> 172.21.15.46:0/3870333961 conn(0x7ff6e406ded0 msgr2=0x7ff6e40b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 shutdown_connections 2023-10-07T09:04:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.514+0000 7ff6e9608700 1 -- 172.21.15.46:0/3870333961 wait complete. 2023-10-07T09:04:12.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-07T09:04:12.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.645+0000 7fd9b66b3700 1 Processor -- start 2023-10-07T09:04:12.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.645+0000 7fd9b66b3700 1 -- start start 2023-10-07T09:04:12.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9b66b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9b66b3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b015a160 con 0x7fd9b0159c60 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9b66b3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00d13a0 con 0x7fd9b0069560 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9b66b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b015e140 con 0x7fd9b0159890 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9af7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd9b0159c60 0x7fd9b015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59978/0 (socket says 172.21.15.46:59978) 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9af7fe700 1 -- 172.21.15.46:0/237284667 learned_addr learned my addr 172.21.15.46:0/237284667 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9affff700 1 --2- 172.21.15.46:0/237284667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518343912 0 0) 0x7fd9b015a160 con 0x7fd9b0159c60 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd998003570 con 0x7fd9b0159c60 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353436596 0 0) 0x7fd9b00d13a0 con 0x7fd9b0069560 2023-10-07T09:04:12.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b015a160 con 0x7fd9b0069560 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488810064 0 0) 0x7fd998003570 con 0x7fd9b0159c60 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9affff700 1 -- 172.21.15.46:0/237284667 >> v1:172.21.15.133:6789/0 conn(0x7fd9b0069560 legacy=0x7fd9b00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9affff700 1 -- 172.21.15.46:0/237284667 >> v1:172.21.15.46:6789/0 conn(0x7fd9b0159c60 legacy=0x7fd9b015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.646+0000 7fd9affff700 1 -- 172.21.15.46:0/237284667 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b015a3d0 con 0x7fd9b0159890 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9affff700 1 --2- 172.21.15.46:0/237284667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015abd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009910 tx=0x7fd9a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e9722492e45a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4001470 con 0x7fd9b0159890 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a0011420 con 0x7fd9b0159890 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9aeffd700 1 -- 172.21.15.46:0/237284667 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00117c0 con 0x7fd9b0159890 2023-10-07T09:04:12.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 -- 172.21.15.46:0/237284667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 msgr2=0x7fd9b015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/237284667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015abd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009910 tx=0x7fd9a00091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 -- 172.21.15.46:0/237284667 shutdown_connections 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/237284667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015abd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 -- 172.21.15.46:0/237284667 >> 172.21.15.46:0/237284667 conn(0x7fd9b0068e20 msgr2=0x7fd9b00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 -- 172.21.15.46:0/237284667 shutdown_connections 2023-10-07T09:04:12.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.647+0000 7fd9b66b3700 1 -- 172.21.15.46:0/237284667 wait complete. 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.648+0000 7fd9b66b3700 1 Processor -- start 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 -- start start 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0159c60 0x7fd9b015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b016ddc0 con 0x7fd9b0069560 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b016d1b0 con 0x7fd9b0159c60 2023-10-07T09:04:12.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9b66b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b016d490 con 0x7fd9b0159890 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40978/0 (socket says 172.21.15.46:40978) 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.649+0000 7fd9affff700 1 -- 172.21.15.46:0/3231685548 learned_addr learned my addr 172.21.15.46:0/3231685548 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9af7fe700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9b4c50700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0159c60 0x7fd9b015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 -- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 msgr2=0x7fd9b015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 -- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0159c60 msgr2=0x7fd9b015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0159c60 0x7fd9b015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 -- 172.21.15.46:0/3231685548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009420 con 0x7fd9b0069560 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9af7fe700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:12.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9affff700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00091e0 tx=0x7fd9a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a001cc90 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a001cdf0 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b016d770 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a001a6a0 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.650+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0152420 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.651+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b004c3c0 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.651+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd9a001aa90 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.652+0000 7fd997fff700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 0x7fd99c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.652+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd9a00865a0 con 0x7fd9b0069560 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.652+0000 7fd9af7fe700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 0x7fd99c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:12.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.653+0000 7fd9af7fe700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 0x7fd99c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4001ed0 tx=0x7fd9a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:12.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.656+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9a00537c0 con 0x7fd9b0069560 2023-10-07T09:04:12.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:12.930+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7fd9b006a5b0 con 0x7fd9b0069560 2023-10-07T09:04:13.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.153+0000 7fd997fff700 1 -- 172.21.15.46:0/3231685548 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v265) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd9a0056de0 con 0x7fd9b0069560 2023-10-07T09:04:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 msgr2=0x7fd99c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 0x7fd99c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4001ed0 tx=0x7fd9a4009040 comp rx=0 tx=0).stop 2023-10-07T09:04:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 msgr2=0x7fd9b0151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00091e0 tx=0x7fd9a0016000 comp rx=0 tx=0).stop 2023-10-07T09:04:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 shutdown_connections 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd99c067200 0x7fd99c0696b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0159c60 0x7fd9b015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b0069560 0x7fd9b0151ee0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 --2- 172.21.15.46:0/3231685548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9b0159890 0x7fd9b015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 >> 172.21.15.46:0/3231685548 conn(0x7fd9b0068e20 msgr2=0x7fd9b00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 shutdown_connections 2023-10-07T09:04:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.155+0000 7fd9b66b3700 1 -- 172.21.15.46:0/3231685548 wait complete. 2023-10-07T09:04:13.168 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-07T09:04:13.169 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-07T09:04:13.169 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:04:13.169 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-07T09:04:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.288+0000 7fb243c51700 1 Processor -- start 2023-10-07T09:04:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.288+0000 7fb243c51700 1 -- start start 2023-10-07T09:04:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb243c51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb23c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb243c51700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c15d7e0 con 0x7fb23c06c0a0 2023-10-07T09:04:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb243c51700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c15dac0 con 0x7fb23c06bcd0 2023-10-07T09:04:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb243c51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0caf30 con 0x7fb23c0caa90 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2411ec700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb23c06c0a0 0x7fb23c15df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59992/0 (socket says 172.21.15.46:59992) 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2411ec700 1 -- 172.21.15.46:0/2479926717 learned_addr learned my addr 172.21.15.46:0/2479926717 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177533422 0 0) 0x7fb23c15d7e0 con 0x7fb23c06c0a0 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2421ee700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb23c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb224003570 con 0x7fb23c06c0a0 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793511941 0 0) 0x7fb224003570 con 0x7fb23c06c0a0 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 msgr2=0x7fb23c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb23c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 >> v1:172.21.15.133:6789/0 conn(0x7fb23c06bcd0 legacy=0x7fb23c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c15aa30 con 0x7fb23c06c0a0 2023-10-07T09:04:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb230001470 con 0x7fb23c06c0a0 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 >> v1:172.21.15.46:6789/0 conn(0x7fb23c06c0a0 legacy=0x7fb23c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb224003a90 0x7fb224003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.289+0000 7fb2409eb700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb224004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb224004d50 0x7fb2240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0caf30 con 0x7fb224003a90 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22400bc20 con 0x7fb224004d50 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22400bde0 con 0x7fb23c0caa90 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb224003a90 0x7fb224003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2411ec700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb224004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2421ee700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb224004d50 0x7fb2240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 -- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 msgr2=0x7fb224004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb23c0caa90 0x7fb224004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 -- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb224004d50 msgr2=0x7fb2240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb224004d50 0x7fb2240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 -- 172.21.15.46:0/2479926717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224003570 con 0x7fb224003a90 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2419ed700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb224003a90 0x7fb224003ea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb234001fc0 tx=0x7fb234001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebe81597f43ea36 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234001980 con 0x7fb224003a90 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400c8b0 con 0x7fb224003a90 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.290+0000 7fb2409eb700 1 -- 172.21.15.46:0/2479926717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400cc50 con 0x7fb224003a90 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 -- 172.21.15.46:0/2479926717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb224003a90 msgr2=0x7fb224003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 --2- 172.21.15.46:0/2479926717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb224003a90 0x7fb224003ea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb234001fc0 tx=0x7fb234001670 comp rx=0 tx=0).stop 2023-10-07T09:04:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb2421ee700 1 -- 172.21.15.46:0/2479926717 reap_dead start 2023-10-07T09:04:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 -- 172.21.15.46:0/2479926717 shutdown_connections 2023-10-07T09:04:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 -- 172.21.15.46:0/2479926717 >> 172.21.15.46:0/2479926717 conn(0x7fb23c0ce600 msgr2=0x7fb23c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 -- 172.21.15.46:0/2479926717 shutdown_connections 2023-10-07T09:04:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.291+0000 7fb243c51700 1 -- 172.21.15.46:0/2479926717 wait complete. 2023-10-07T09:04:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.292+0000 7fb243c51700 1 Processor -- start 2023-10-07T09:04:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.292+0000 7fb243c51700 1 -- start start 2023-10-07T09:04:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 0x7fb23c160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb23c15de50 0x7fb23c169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c14cc00 con 0x7fb23c0b2020 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c158030 con 0x7fb23c15de50 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb243c51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c15e6a0 con 0x7fb224003a90 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40996/0 (socket says 172.21.15.46:40996) 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 -- 172.21.15.46:0/945712023 learned_addr learned my addr 172.21.15.46:0/945712023 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2411ec700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb23c15de50 0x7fb23c169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2419ed700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 0x7fb23c160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 -- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 msgr2=0x7fb23c160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 0x7fb23c160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 -- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb23c15de50 msgr2=0x7fb23c169650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb23c15de50 0x7fb23c169650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 -- 172.21.15.46:0/945712023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c15e980 con 0x7fb23c0b2020 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2419ed700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 0x7fb23c160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.293+0000 7fb2421ee700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b1140 tx=0x7fb22c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.294+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00f770 con 0x7fb23c0b2020 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.294+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00f8d0 con 0x7fb23c0b2020 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.294+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00fc70 con 0x7fb23c0b2020 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.294+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c15ec60 con 0x7fb23c0b2020 2023-10-07T09:04:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.294+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c15e2c0 con 0x7fb23c0b2020 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.295+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c157e00 con 0x7fb23c0b2020 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.295+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb22c014650 con 0x7fb23c0b2020 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.296+0000 7fb239ffb700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 0x7fb2280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.296+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb22c084c30 con 0x7fb23c0b2020 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.296+0000 7fb2419ed700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 0x7fb2280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.296+0000 7fb2419ed700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 0x7fb2280696b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b4620 tx=0x7fb234015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.300+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb23c157e00 con 0x7fb23c0b2020 2023-10-07T09:04:13.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:13.570+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7fb23c157e00 con 0x7fb23c0b2020 2023-10-07T09:04:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.157+0000 7fb239ffb700 1 -- 172.21.15.46:0/945712023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v266) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb23c157e00 con 0x7fb23c0b2020 2023-10-07T09:04:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 msgr2=0x7fb2280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 0x7fb2280696b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b4620 tx=0x7fb234015000 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 msgr2=0x7fb23c155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b1140 tx=0x7fb22c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 shutdown_connections 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb228067200 0x7fb2280696b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb23c0b2020 0x7fb23c155030 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb224003a90 0x7fb23c160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 --2- 172.21.15.46:0/945712023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb23c15de50 0x7fb23c169650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 >> 172.21.15.46:0/945712023 conn(0x7fb23c0ce600 msgr2=0x7fb23c15c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 shutdown_connections 2023-10-07T09:04:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.159+0000 7fb243c51700 1 -- 172.21.15.46:0/945712023 wait complete. 2023-10-07T09:04:14.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:04:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.297+0000 7f36cd33c700 1 Processor -- start 2023-10-07T09:04:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.297+0000 7f36cd33c700 1 -- start start 2023-10-07T09:04:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c8159890 0x7f36c815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36c8159c60 0x7f36c815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 0x7f36c8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c815a160 con 0x7f36c8159c60 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80d13a0 con 0x7f36c815db10 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36cd33c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c815e140 con 0x7f36c8159890 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36c8159c60 0x7f36c815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36c8159c60 0x7f36c815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41006/0 (socket says 172.21.15.46:41006) 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 -- 172.21.15.46:0/2457847075 learned_addr learned my addr 172.21.15.46:0/2457847075 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c77fe700 1 --2- 172.21.15.46:0/2457847075 >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 0x7f36c8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c6ffd700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c8159890 0x7f36c815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 -- 172.21.15.46:0/2457847075 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c8159890 msgr2=0x7f36c815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c8159890 0x7f36c815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 -- 172.21.15.46:0/2457847075 >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 msgr2=0x7f36c8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 --2- 172.21.15.46:0/2457847075 >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 0x7f36c8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 -- 172.21.15.46:0/2457847075 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c815a3d0 con 0x7f36c8159c60 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c77fe700 1 --2- 172.21.15.46:0/2457847075 >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 0x7f36c8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.298+0000 7f36c67fc700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c815d5d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f36c8089b50 tx=0x7f36bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9b2d70eb1e5483 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36c5ffb700 1 -- 172.21.15.46:0/2457847075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00b860 con 0x7f36c8159c60 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36c5ffb700 1 -- 172.21.15.46:0/2457847075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc00b9c0 con 0x7f36c8159c60 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36c5ffb700 1 -- 172.21.15.46:0/2457847075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00bd60 con 0x7f36c8159c60 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 -- 172.21.15.46:0/2457847075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 msgr2=0x7f36c815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c815d5d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f36c8089b50 tx=0x7f36bc009250 comp rx=0 tx=0).stop 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 -- 172.21.15.46:0/2457847075 shutdown_connections 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 --2- 172.21.15.46:0/2457847075 >> v2:172.21.15.133:3300/0 conn(0x7f36c815db10 0x7f36c8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c8159890 0x7f36c815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 --2- 172.21.15.46:0/2457847075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c815d5d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 -- 172.21.15.46:0/2457847075 >> 172.21.15.46:0/2457847075 conn(0x7f36c8068e20 msgr2=0x7f36c80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 -- 172.21.15.46:0/2457847075 shutdown_connections 2023-10-07T09:04:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.299+0000 7f36cd33c700 1 -- 172.21.15.46:0/2457847075 wait complete. 2023-10-07T09:04:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.300+0000 7f36cd33c700 1 Processor -- start 2023-10-07T09:04:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.300+0000 7f36cd33c700 1 -- start start 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c8159890 0x7f36c816dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c815db10 0x7f36c815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8156ad0 con 0x7f36c8159c60 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c816e110 con 0x7f36c8159890 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36cd33c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c816a520 con 0x7f36c815db10 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36c67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36c67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41018/0 (socket says 172.21.15.46:41018) 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36c67fc700 1 -- 172.21.15.46:0/978053774 learned_addr learned my addr 172.21.15.46:0/978053774 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.301+0000 7f36c6ffd700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c8159890 0x7f36c816dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c77fe700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c815db10 0x7f36c815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 -- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c815db10 msgr2=0x7f36c815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c815db10 0x7f36c815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 -- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c8159890 msgr2=0x7f36c816dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c8159890 0x7f36c816dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 -- 172.21.15.46:0/978053774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0094f0 con 0x7f36c8159c60 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36c67fc700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009290 tx=0x7f36bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00bd50 con 0x7f36c8159c60 2023-10-07T09:04:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc01a660 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c80c7da0 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc01aa00 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.302+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c816a1b0 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.303+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c816a6b0 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.303+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f36bc01b430 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.304+0000 7f36aeffd700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 0x7f36b40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.304+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f36bc085f60 con 0x7f36c8159c60 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.304+0000 7f36c6ffd700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 0x7f36b40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.305+0000 7f36c6ffd700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 0x7f36b40696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.308+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36bc053180 con 0x7f36c8159c60 2023-10-07T09:04:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.501+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36c804c3c0 con 0x7f36c8159c60 2023-10-07T09:04:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.505+0000 7f36aeffd700 1 -- 172.21.15.46:0/978053774 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36bc0150c0 con 0x7f36c8159c60 2023-10-07T09:04:14.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 msgr2=0x7f36b40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 0x7f36b40696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8008040 comp rx=0 tx=0).stop 2023-10-07T09:04:14.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 msgr2=0x7f36c81470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009290 tx=0x7f36bc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:14.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 shutdown_connections 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f36b4067200 0x7f36b40696b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36c815db10 0x7f36c815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c8159890 0x7f36c816dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 --2- 172.21.15.46:0/978053774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8159c60 0x7f36c81470c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 >> 172.21.15.46:0/978053774 conn(0x7f36c8068e20 msgr2=0x7f36c815b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 shutdown_connections 2023-10-07T09:04:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.507+0000 7f36cd33c700 1 -- 172.21.15.46:0/978053774 wait complete. 2023-10-07T09:04:14.520 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:04:14.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:14.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:14.612 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:04:14.613 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:04:14.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.732+0000 7fa737179700 1 Processor -- start 2023-10-07T09:04:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.732+0000 7fa737179700 1 -- start start 2023-10-07T09:04:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa737179700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 0x7fa7300b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa737179700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa73015d230 0x7fa73015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa737179700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73015db70 con 0x7fa730159420 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa737179700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7300b11d0 con 0x7fa73015d230 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa737179700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7300b14b0 con 0x7fa7301597f0 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa73015d230 0x7fa73015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa73015d230 0x7fa73015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41034/0 (socket says 172.21.15.46:41034) 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 -- 172.21.15.46:0/1294367952 learned_addr learned my addr 172.21.15.46:0/1294367952 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa735976700 1 --2- 172.21.15.46:0/1294367952 >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 0x7fa7300b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 -- 172.21.15.46:0/1294367952 >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 msgr2=0x7fa7300b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 --2- 172.21.15.46:0/1294367952 >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 0x7fa7300b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 -- 172.21.15.46:0/1294367952 >> v1:172.21.15.133:6789/0 conn(0x7fa730159420 legacy=0x7fa7300b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 -- 172.21.15.46:0/1294367952 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300b1790 con 0x7fa73015d230 2023-10-07T09:04:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa735976700 1 --2- 172.21.15.46:0/1294367952 >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 0x7fa7300b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.733+0000 7fa736978700 1 --2- 172.21.15.46:0/1294367952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa73015d630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa730089750 tx=0x7fa728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee3005d56cfbded server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa735175700 1 -- 172.21.15.46:0/1294367952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800b860 con 0x7fa73015d230 2023-10-07T09:04:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa735175700 1 -- 172.21.15.46:0/1294367952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800b9c0 con 0x7fa73015d230 2023-10-07T09:04:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa735175700 1 -- 172.21.15.46:0/1294367952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800bd60 con 0x7fa73015d230 2023-10-07T09:04:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 -- 172.21.15.46:0/1294367952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 msgr2=0x7fa73015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 --2- 172.21.15.46:0/1294367952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa73015d630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa730089750 tx=0x7fa728009250 comp rx=0 tx=0).stop 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 -- 172.21.15.46:0/1294367952 shutdown_connections 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 --2- 172.21.15.46:0/1294367952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa73015d630 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 --2- 172.21.15.46:0/1294367952 >> v2:172.21.15.133:3300/0 conn(0x7fa7301597f0 0x7fa7300b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 -- 172.21.15.46:0/1294367952 >> 172.21.15.46:0/1294367952 conn(0x7fa7300d0660 msgr2=0x7fa7300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 -- 172.21.15.46:0/1294367952 shutdown_connections 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.734+0000 7fa737179700 1 -- 172.21.15.46:0/1294367952 wait complete. 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.735+0000 7fa737179700 1 Processor -- start 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.735+0000 7fa737179700 1 -- start start 2023-10-07T09:04:14.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 0x7fa7300ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7301597f0 0x7fa730149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73014b370 con 0x7fa73015d230 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73014a760 con 0x7fa7301597f0 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa737179700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73014aa40 con 0x7fa730159420 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa736978700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa736978700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41036/0 (socket says 172.21.15.46:41036) 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa736978700 1 -- 172.21.15.46:0/1833590433 learned_addr learned my addr 172.21.15.46:0/1833590433 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa735976700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7301597f0 0x7fa730149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.736+0000 7fa736177700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 0x7fa7300ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 -- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 msgr2=0x7fa7300ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 0x7fa7300ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 -- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7301597f0 msgr2=0x7fa730149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7301597f0 0x7fa730149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 -- 172.21.15.46:0/1833590433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280094f0 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736177700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 0x7fa7300ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa736978700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa728006f50 tx=0x7fa728017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72801a640 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72801f070 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73014ad20 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72801a9d0 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.737+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7300aebd0 con 0x7fa73015d230 2023-10-07T09:04:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.738+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7300d1180 con 0x7fa73015d230 2023-10-07T09:04:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.738+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa728026480 con 0x7fa73015d230 2023-10-07T09:04:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.739+0000 7fa72e7fc700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 0x7fa71c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.739+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa728021070 con 0x7fa73015d230 2023-10-07T09:04:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.739+0000 7fa736177700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 0x7fa71c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.739+0000 7fa736177700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 0x7fa71c0696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa720007fd0 tx=0x7fa720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.743+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7280537d0 con 0x7fa73015d230 2023-10-07T09:04:14.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.982+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7300ccb90 con 0x7fa73015d230 2023-10-07T09:04:14.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.982+0000 7fa72e7fc700 1 -- 172.21.15.46:0/1833590433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa728015de0 con 0x7fa73015d230 2023-10-07T09:04:14.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:14.984 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4200096570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4200096570},{"type":"v1","addr":"172.21.15.133:6837","nonce":4200096570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5977,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/810547794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":810547794},{"type":"v1","addr":"172.21.15.133:6836","nonce":810547794}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/3535454289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3535454289},{"type":"v1","addr":"172.21.15.46:6834","nonce":3535454289}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/456167528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":456167528},{"type":"v1","addr":"172.21.15.46:6835","nonce":456167528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-10-07T09:04:14.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 msgr2=0x7fa71c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 0x7fa71c0696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa720007fd0 tx=0x7fa720009040 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 msgr2=0x7fa7300b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa728006f50 tx=0x7fa728017000 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 shutdown_connections 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa71c067200 0x7fa71c0696b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73015d230 0x7fa7300b5440 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa730159420 0x7fa7300ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 --2- 172.21.15.46:0/1833590433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7301597f0 0x7fa730149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:14.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 >> 172.21.15.46:0/1833590433 conn(0x7fa7300d0660 msgr2=0x7fa7300af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 shutdown_connections 2023-10-07T09:04:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:14.985+0000 7fa737179700 1 -- 172.21.15.46:0/1833590433 wait complete. 2023-10-07T09:04:14.987 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 50 2023-10-07T09:04:14.998 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:04:14.998 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:04:14.998 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:04:14.998 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:14.998 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:04:14.998 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:04:14.999 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:04:14.999 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:14.999 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:04:14.999 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:04:14.999 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:04:14.999 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:15.000 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:04:15.000 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:04:15.000 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:04:15.000 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:15.009 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:04:15.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:04:15.010 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:04:15.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:04:15.011 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:04:15.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:04:15.012 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:04:15.012 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:04:15.052 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:04:15.053 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:15.053 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:04:15.053 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:15.054 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:04:15.054 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:04:15.055 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:15.055 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:15.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:04:15.130 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:04:15.130 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:04:15.135 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:04:15.135 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:04:15.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.185+0000 7f9e820b4700 1 Processor -- start 2023-10-07T09:04:15.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.185+0000 7f9e820b4700 1 -- start start 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e820b4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e7c141500 0x7f9e7c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e820b4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c15c2a0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e820b4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c15b690 con 0x7f9e7c06c0a0 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e820b4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c15b970 con 0x7f9e7c141500 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e7c141500 0x7f9e7c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e7c141500 0x7f9e7c0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41062/0 (socket says 172.21.15.46:41062) 2023-10-07T09:04:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e7b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9e7c06bcd0 0x7f9e7c140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60030/0 (socket says 172.21.15.46:60030) 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 -- 172.21.15.46:0/2280125363 learned_addr learned my addr 172.21.15.46:0/2280125363 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 -- 172.21.15.46:0/2280125363 >> v1:172.21.15.133:6789/0 conn(0x7f9e7c06c0a0 legacy=0x7f9e7c0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 -- 172.21.15.46:0/2280125363 >> v1:172.21.15.46:6789/0 conn(0x7f9e7c06bcd0 legacy=0x7f9e7c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e72ffd700 1 -- 172.21.15.46:0/2280125363 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c15bc50 con 0x7f9e7c141500 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.186+0000 7f9e7affd700 1 -- 172.21.15.46:0/2280125363 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492386304 0 0) 0x7f9e7c15c2a0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e72ffd700 1 --2- 172.21.15.46:0/2280125363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c141500 0x7f9e7c0c8e00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9e640099b0 tx=0x7f9e64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b386ba31fffda server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e7affd700 1 -- 172.21.15.46:0/2280125363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400b820 con 0x7f9e7c141500 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e7affd700 1 -- 172.21.15.46:0/2280125363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6400b980 con 0x7f9e7c141500 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e7affd700 1 -- 172.21.15.46:0/2280125363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400bd20 con 0x7f9e7c141500 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 -- 172.21.15.46:0/2280125363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c141500 msgr2=0x7f9e7c0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 --2- 172.21.15.46:0/2280125363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c141500 0x7f9e7c0c8e00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9e640099b0 tx=0x7f9e64009250 comp rx=0 tx=0).stop 2023-10-07T09:04:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 -- 172.21.15.46:0/2280125363 shutdown_connections 2023-10-07T09:04:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 --2- 172.21.15.46:0/2280125363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c141500 0x7f9e7c0c8e00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 -- 172.21.15.46:0/2280125363 >> 172.21.15.46:0/2280125363 conn(0x7f9e7c0ce600 msgr2=0x7f9e7c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 -- 172.21.15.46:0/2280125363 shutdown_connections 2023-10-07T09:04:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.187+0000 7f9e820b4700 1 -- 172.21.15.46:0/2280125363 wait complete. 2023-10-07T09:04:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.188+0000 7f9e820b4700 1 Processor -- start 2023-10-07T09:04:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 -- start start 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 0x7f9e7c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e7c141500 0x7f9e7c16a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c156c70 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c06b590 con 0x7f9e7c141500 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e820b4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c13cc60 con 0x7f9e7c06c0a0 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41078/0 (socket says 172.21.15.46:41078) 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.189+0000 7f9e7b7fe700 1 -- 172.21.15.46:0/570038452 learned_addr learned my addr 172.21.15.46:0/570038452 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e72ffd700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 0x7f9e7c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:15.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7bfff700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e7c141500 0x7f9e7c16a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 -- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 msgr2=0x7f9e7c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 0x7f9e7c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 -- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e7c141500 msgr2=0x7f9e7c16a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e7c141500 0x7f9e7c16a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 -- 172.21.15.46:0/570038452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640094f0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e72ffd700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 0x7f9e7c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e7b7fe700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0011e0 tx=0x7f9e6c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c007300 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c007460 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004830 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c0cdb20 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.190+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c0cd560 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.191+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c04c3c0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.191+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9e6c004be0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.192+0000 7f9e73fff700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 0x7f9e5c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.192+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9e6c083bc0 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.192+0000 7f9e72ffd700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 0x7f9e5c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:15.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.192+0000 7f9e72ffd700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 0x7f9e5c0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9e640099b0 tx=0x7f9e64016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:15.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.196+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e6c050e60 con 0x7f9e7c06bcd0 2023-10-07T09:04:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:15.407+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9e7c15bf30 con 0x7f9e7c06bcd0 2023-10-07T09:04:16.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.178+0000 7f9e73fff700 1 -- 172.21.15.46:0/570038452 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9e6c018020 con 0x7f9e7c06bcd0 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 msgr2=0x7f9e5c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 0x7f9e5c0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9e640099b0 tx=0x7f9e64016000 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 msgr2=0x7f9e7c06b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0011e0 tx=0x7f9e6c007e10 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 shutdown_connections 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9e5c067200 0x7f9e5c0696b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e7c141500 0x7f9e7c16a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e7c06bcd0 0x7f9e7c06b050 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 --2- 172.21.15.46:0/570038452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e7c06c0a0 0x7f9e7c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 >> 172.21.15.46:0/570038452 conn(0x7f9e7c0ce600 msgr2=0x7f9e7c157470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:16.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 shutdown_connections 2023-10-07T09:04:16.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.181+0000 7f9e820b4700 1 -- 172.21.15.46:0/570038452 wait complete. 2023-10-07T09:04:16.183 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:04:16.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:04:16.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.319+0000 7fc590bdf700 1 Processor -- start 2023-10-07T09:04:16.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.319+0000 7fc590bdf700 1 -- start start 2023-10-07T09:04:16.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc590bdf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc58c142ea0 0x7fc58c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc590bdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0ad870 0x7fc58c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc590bdf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0b40f0 con 0x7fc58c0b3b70 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc590bdf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c069640 con 0x7fc58c142ea0 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc590bdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c069920 con 0x7fc58c0ad870 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc58c142ea0 0x7fc58c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc58c0b3b70 0x7fc58c06cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60032/0 (socket says 172.21.15.46:60032) 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58bfff700 1 -- 172.21.15.46:0/3987602488 learned_addr learned my addr 172.21.15.46:0/3987602488 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58affd700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0ad870 0x7fc58c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58b7fe700 1 -- 172.21.15.46:0/3987602488 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0ad870 msgr2=0x7fc58c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0ad870 0x7fc58c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58b7fe700 1 -- 172.21.15.46:0/3987602488 >> v1:172.21.15.46:6789/0 conn(0x7fc58c0b3b70 legacy=0x7fc58c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58a7fc700 1 -- 172.21.15.46:0/3987602488 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311237700 0 0) 0x7fc58c0b40f0 con 0x7fc58c0b3b70 2023-10-07T09:04:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.320+0000 7fc58b7fe700 1 -- 172.21.15.46:0/3987602488 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c069c00 con 0x7fc58c142ea0 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0b3630 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0098e0 tx=0x7fc57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446a01e7859f5031 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc58a7fc700 1 -- 172.21.15.46:0/3987602488 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c009e80 con 0x7fc58c142ea0 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc58a7fc700 1 -- 172.21.15.46:0/3987602488 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00b860 con 0x7fc58c142ea0 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc58a7fc700 1 -- 172.21.15.46:0/3987602488 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00bbe0 con 0x7fc58c142ea0 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 -- 172.21.15.46:0/3987602488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 msgr2=0x7fc58c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0b3630 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0098e0 tx=0x7fc57c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 -- 172.21.15.46:0/3987602488 shutdown_connections 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0b3630 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3987602488 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0ad870 0x7fc58c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 -- 172.21.15.46:0/3987602488 >> 172.21.15.46:0/3987602488 conn(0x7fc58c0ce430 msgr2=0x7fc58c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:16.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 -- 172.21.15.46:0/3987602488 shutdown_connections 2023-10-07T09:04:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.321+0000 7fc590bdf700 1 -- 172.21.15.46:0/3987602488 wait complete. 2023-10-07T09:04:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 Processor -- start 2023-10-07T09:04:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 -- start start 2023-10-07T09:04:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 0x7fc58c169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c159100 0x7fc58c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c16ab40 con 0x7fc58c142ea0 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0ca4f0 con 0x7fc58c159100 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc590bdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c16d3d0 con 0x7fc58c0b3b70 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc58affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc58affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41098/0 (socket says 172.21.15.46:41098) 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.323+0000 7fc58affd700 1 -- 172.21.15.46:0/3369859380 learned_addr learned my addr 172.21.15.46:0/3369859380 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 0x7fc58c169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58bfff700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c159100 0x7fc58c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 -- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 msgr2=0x7fc58c169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 0x7fc58c169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 -- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c159100 msgr2=0x7fc58c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c159100 0x7fc58c15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 -- 172.21.15.46:0/3369859380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009420 con 0x7fc58c142ea0 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 0x7fc58c169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc58affd700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc58000d8c0 tx=0x7fc580008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000b570 con 0x7fc58c142ea0 2023-10-07T09:04:16.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000b6d0 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c16a2a0 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000ba70 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.324+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c16a860 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.325+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c04c3c0 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.325+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc58001e460 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.326+0000 7fc5737fe700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 0x7fc5780696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.326+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc580084c40 con 0x7fc58c142ea0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.326+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 0x7fc5780696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.327+0000 7fc58b7fe700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 0x7fc5780696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0091e0 tx=0x7fc57c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.330+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc58008b080 con 0x7fc58c142ea0 2023-10-07T09:04:16.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.599+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc58c16d1a0 con 0x7fc58c142ea0 2023-10-07T09:04:16.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.600+0000 7fc5737fe700 1 -- 172.21.15.46:0/3369859380 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc580055940 con 0x7fc58c142ea0 2023-10-07T09:04:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:16.601 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:04:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:04:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.605 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:16.605 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:16.605 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.605 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.606 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.606 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:04:16.607 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:04:16.607 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.607 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.607 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:16.607 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:04:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:04:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:16.610 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.610 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.611 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:04:16.612 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.613 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.614 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.617 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.618 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:04:16.619 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.620 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:16.621 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.622 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.623 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:04:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:04:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:04:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:04:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:04:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:04:16.633 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:16.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.601+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 msgr2=0x7fc5780696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.601+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 0x7fc5780696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0091e0 tx=0x7fc57c017000 comp rx=0 tx=0).stop 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.601+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 msgr2=0x7fc58c0c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.601+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc58000d8c0 tx=0x7fc580008040 comp rx=0 tx=0).stop 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 shutdown_connections 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc578067200 0x7fc5780696b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c159100 0x7fc58c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc58c0b3b70 0x7fc58c169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 --2- 172.21.15.46:0/3369859380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc58c142ea0 0x7fc58c0c9fb0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 >> 172.21.15.46:0/3369859380 conn(0x7fc58c0ce430 msgr2=0x7fc58c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 shutdown_connections 2023-10-07T09:04:16.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.602+0000 7fc590bdf700 1 -- 172.21.15.46:0/3369859380 wait complete. 2023-10-07T09:04:16.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.757+0000 7f082e1e4700 1 Processor -- start 2023-10-07T09:04:16.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.757+0000 7f082e1e4700 1 -- start start 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.758+0000 7f082e1e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.758+0000 7f082e1e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.758+0000 7f082e1e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082815c2a0 con 0x7f08280c8e00 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.758+0000 7f082e1e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082815b690 con 0x7f082806c0a0 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.758+0000 7f082e1e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082815b970 con 0x7f082806bcd0 2023-10-07T09:04:16.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f0826ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39628/0 (socket says 172.21.15.46:39628) 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f0826ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:44360/0 (socket says 172.21.15.46:44360) 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 -- 172.21.15.46:0/1686470529 learned_addr learned my addr 172.21.15.46:0/1686470529 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f0827fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f08280c8e00 0x7f08280c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:52208/0 (socket says 172.21.15.46:52208) 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 -- 172.21.15.46:0/1686470529 >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 msgr2=0x7f0828141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 --2- 172.21.15.46:0/1686470529 >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 -- 172.21.15.46:0/1686470529 >> v1:172.21.15.133:6789/0 conn(0x7f08280c8e00 legacy=0x7f08280c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 -- 172.21.15.46:0/1686470529 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082815bc50 con 0x7f082806bcd0 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f0826ffd700 1 --2- 172.21.15.46:0/1686470529 >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08277fe700 1 --2- 172.21.15.46:0/1686470529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08180099b0 tx=0x7f0818009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e31aa16846b25d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08267fc700 1 -- 172.21.15.46:0/1686470529 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818009ea0 con 0x7f082806bcd0 2023-10-07T09:04:16.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08267fc700 1 -- 172.21.15.46:0/1686470529 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800b860 con 0x7f082806bcd0 2023-10-07T09:04:16.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.759+0000 7f08267fc700 1 -- 172.21.15.46:0/1686470529 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800bc00 con 0x7f082806bcd0 2023-10-07T09:04:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 -- 172.21.15.46:0/1686470529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 msgr2=0x7f0828140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 --2- 172.21.15.46:0/1686470529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08180099b0 tx=0x7f0818009250 comp rx=0 tx=0).stop 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 -- 172.21.15.46:0/1686470529 shutdown_connections 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 --2- 172.21.15.46:0/1686470529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f082806bcd0 0x7f0828140df0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 --2- 172.21.15.46:0/1686470529 >> v2:172.21.15.133:3300/0 conn(0x7f082806c0a0 0x7f0828141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 -- 172.21.15.46:0/1686470529 >> 172.21.15.46:0/1686470529 conn(0x7f08280ce600 msgr2=0x7f08280cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 -- 172.21.15.46:0/1686470529 shutdown_connections 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.760+0000 7f082e1e4700 1 -- 172.21.15.46:0/1686470529 wait complete. 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.761+0000 7f082e1e4700 1 Processor -- start 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.761+0000 7f082e1e4700 1 -- start start 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280c8e00 0x7f08280cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08281563b0 0x7f08280cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c5a10 con 0x7f082806c0a0 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c6ad0 con 0x7f08280c8e00 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f082e1e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c8030 con 0x7f08281563b0 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41100/0 (socket says 172.21.15.46:41100) 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 -- 172.21.15.46:0/4088467838 learned_addr learned my addr 172.21.15.46:0/4088467838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280c8e00 0x7f08280cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f0827fff700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08281563b0 0x7f08280cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 -- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08281563b0 msgr2=0x7f08280cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08281563b0 0x7f08280cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 -- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280c8e00 msgr2=0x7f08280cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280c8e00 0x7f08280cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.762+0000 7f08277fe700 1 -- 172.21.15.46:0/4088467838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c009420 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f08277fe700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0818006fd0 tx=0x7f0818017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800b9d0 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800bb30 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08180094f0 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818011630 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.763+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08280c7700 con 0x7f082806c0a0 2023-10-07T09:04:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.764+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082804c3c0 con 0x7f082806c0a0 2023-10-07T09:04:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.764+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0818011a60 con 0x7f082806c0a0 2023-10-07T09:04:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.765+0000 7f080f7fe700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 0x7f08140696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.765+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0818085de0 con 0x7f082806c0a0 2023-10-07T09:04:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.765+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 0x7f08140696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.766+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 0x7f08140696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f08280cdfb0 tx=0x7f081c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.769+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0818053050 con 0x7f082806c0a0 2023-10-07T09:04:16.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.964+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f082806c9d0 con 0x7f082806c0a0 2023-10-07T09:04:16.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.964+0000 7f080f7fe700 1 -- 172.21.15.46:0/4088467838 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f0818056670 con 0x7f082806c0a0 2023-10-07T09:04:16.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:16.966 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":86,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:16.174053+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:16.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 msgr2=0x7f08140696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 0x7f08140696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f08280cdfb0 tx=0x7f081c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 msgr2=0x7f08280c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0818006fd0 tx=0x7f0818017000 comp rx=0 tx=0).stop 2023-10-07T09:04:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 shutdown_connections 2023-10-07T09:04:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0814067200 0x7f08140696b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08281563b0 0x7f08280cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f082806c0a0 0x7f08280c6590 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 --2- 172.21.15.46:0/4088467838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280c8e00 0x7f08280cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 >> 172.21.15.46:0/4088467838 conn(0x7f08280ce600 msgr2=0x7f08280c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 shutdown_connections 2023-10-07T09:04:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:16.966+0000 7f082e1e4700 1 -- 172.21.15.46:0/4088467838 wait complete. 2023-10-07T09:04:16.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:04:16.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:04:17.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.101+0000 7f3d8c024700 1 Processor -- start 2023-10-07T09:04:17.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.101+0000 7f3d8c024700 1 -- start start 2023-10-07T09:04:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8c024700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d84159890 0x7f3d8415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8c024700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d84069560 0x7f3d840699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8c024700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d84069ee0 con 0x7f3d84159c60 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8c024700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8415a160 con 0x7f3d84159890 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8c024700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840d13a0 con 0x7f3d84069560 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d84159890 0x7f3d8415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d84159890 0x7f3d8415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41108/0 (socket says 172.21.15.46:41108) 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 -- 172.21.15.46:0/755673499 learned_addr learned my addr 172.21.15.46:0/755673499 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d8a5c1700 1 --2- 172.21.15.46:0/755673499 >> v2:172.21.15.133:3300/0 conn(0x7f3d84069560 0x7f3d840699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 -- 172.21.15.46:0/755673499 >> v2:172.21.15.133:3300/0 conn(0x7f3d84069560 msgr2=0x7f3d840699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 --2- 172.21.15.46:0/755673499 >> v2:172.21.15.133:3300/0 conn(0x7f3d84069560 0x7f3d840699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 -- 172.21.15.46:0/755673499 >> v1:172.21.15.133:6789/0 conn(0x7f3d84159c60 legacy=0x7f3d8415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 -- 172.21.15.46:0/755673499 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8415e140 con 0x7f3d84159890 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d89dc0700 1 --2- 172.21.15.46:0/755673499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84159890 0x7f3d8415abd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3d8406a890 tx=0x7f3d80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0a3bc9b5911baa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d88dbe700 1 -- 172.21.15.46:0/755673499 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000e070 con 0x7f3d84159890 2023-10-07T09:04:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d88dbe700 1 -- 172.21.15.46:0/755673499 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000ba50 con 0x7f3d84159890 2023-10-07T09:04:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.102+0000 7f3d88dbe700 1 -- 172.21.15.46:0/755673499 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d800092e0 con 0x7f3d84159890 2023-10-07T09:04:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 -- 172.21.15.46:0/755673499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84159890 msgr2=0x7f3d8415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 --2- 172.21.15.46:0/755673499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84159890 0x7f3d8415abd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3d8406a890 tx=0x7f3d80009840 comp rx=0 tx=0).stop 2023-10-07T09:04:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 -- 172.21.15.46:0/755673499 shutdown_connections 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 --2- 172.21.15.46:0/755673499 >> v2:172.21.15.133:3300/0 conn(0x7f3d84069560 0x7f3d840699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 --2- 172.21.15.46:0/755673499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84159890 0x7f3d8415abd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 -- 172.21.15.46:0/755673499 >> 172.21.15.46:0/755673499 conn(0x7f3d84068e20 msgr2=0x7f3d840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 -- 172.21.15.46:0/755673499 shutdown_connections 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.103+0000 7f3d8c024700 1 -- 172.21.15.46:0/755673499 wait complete. 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.104+0000 7f3d8c024700 1 Processor -- start 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.104+0000 7f3d8c024700 1 -- start start 2023-10-07T09:04:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d84159890 0x7f3d840c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 0x7f3d84152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840b36c0 con 0x7f3d84069560 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c87a0 con 0x7f3d84159c60 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8c024700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c8a70 con 0x7f3d84159890 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41116/0 (socket says 172.21.15.46:41116) 2023-10-07T09:04:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 -- 172.21.15.46:0/1965055736 learned_addr learned my addr 172.21.15.46:0/1965055736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d895bf700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d84159890 0x7f3d840c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8a5c1700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 0x7f3d84152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 -- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d84159890 msgr2=0x7f3d840c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d84159890 0x7f3d840c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 -- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 msgr2=0x7f3d84152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 0x7f3d84152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 -- 172.21.15.46:0/1965055736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009ae0 con 0x7f3d84069560 2023-10-07T09:04:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d8a5c1700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 0x7f3d84152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.105+0000 7f3d89dc0700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3d84070e20 tx=0x7f3d80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.106+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80008a80 con 0x7f3d84069560 2023-10-07T09:04:17.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.106+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80008c20 con 0x7f3d84069560 2023-10-07T09:04:17.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.106+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d840c8d50 con 0x7f3d84069560 2023-10-07T09:04:17.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.106+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80026460 con 0x7f3d84069560 2023-10-07T09:04:17.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.106+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d840c9310 con 0x7f3d84069560 2023-10-07T09:04:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.107+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8404c3c0 con 0x7f3d84069560 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.107+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3d80003040 con 0x7f3d84069560 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.108+0000 7f3d79ffb700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 0x7f3d680696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.108+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d80086040 con 0x7f3d84069560 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.108+0000 7f3d895bf700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 0x7f3d680696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.108+0000 7f3d895bf700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 0x7f3d680696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d74003950 tx=0x7f3d74007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.112+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d80053210 con 0x7f3d84069560 2023-10-07T09:04:17.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.304+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d841590c0 con 0x7f3d84069560 2023-10-07T09:04:17.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.305+0000 7f3d79ffb700 1 -- 172.21.15.46:0/1965055736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d80009940 con 0x7f3d84069560 2023-10-07T09:04:17.306 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 msgr2=0x7f3d680696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 0x7f3d680696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d74003950 tx=0x7f3d74007ec0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 msgr2=0x7f3d840b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3d84070e20 tx=0x7f3d80018000 comp rx=0 tx=0).stop 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 shutdown_connections 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3d68067200 0x7f3d680696b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d84159c60 0x7f3d84152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d84069560 0x7f3d840b60a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 --2- 172.21.15.46:0/1965055736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d84159890 0x7f3d840c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 >> 172.21.15.46:0/1965055736 conn(0x7f3d84068e20 msgr2=0x7f3d84153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 shutdown_connections 2023-10-07T09:04:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.307+0000 7f3d8c024700 1 -- 172.21.15.46:0/1965055736 wait complete. 2023-10-07T09:04:17.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:04:17.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.440+0000 7f9c5d758700 1 Processor -- start 2023-10-07T09:04:17.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.440+0000 7f9c5d758700 1 -- start start 2023-10-07T09:04:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.441+0000 7f9c5d758700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c58159890 0x7f9c5815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.441+0000 7f9c5d758700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.441+0000 7f9c5d758700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c58069ee0 con 0x7f9c58159c60 2023-10-07T09:04:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.441+0000 7f9c5d758700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5815a160 con 0x7f9c58159890 2023-10-07T09:04:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.441+0000 7f9c5d758700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580d13a0 con 0x7f9c58069560 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c56ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c58159890 0x7f9c5815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39660/0 (socket says 172.21.15.46:39660) 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 -- 172.21.15.46:0/2057493736 learned_addr learned my addr 172.21.15.46:0/2057493736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 -- 172.21.15.46:0/2057493736 >> v2:172.21.15.133:3300/0 conn(0x7f9c58159890 msgr2=0x7f9c5815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 --2- 172.21.15.46:0/2057493736 >> v2:172.21.15.133:3300/0 conn(0x7f9c58159890 0x7f9c5815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 -- 172.21.15.46:0/2057493736 >> v1:172.21.15.133:6789/0 conn(0x7f9c58159c60 legacy=0x7f9c5815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 -- 172.21.15.46:0/2057493736 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5815e140 con 0x7f9c58069560 2023-10-07T09:04:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c577fe700 1 --2- 172.21.15.46:0/2057493736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009f20 tx=0x7f9c50009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464ec90ba3a84e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.442+0000 7f9c55ffb700 1 -- 172.21.15.46:0/2057493736 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000e070 con 0x7f9c58069560 2023-10-07T09:04:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c55ffb700 1 -- 172.21.15.46:0/2057493736 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000b9d0 con 0x7f9c58069560 2023-10-07T09:04:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c55ffb700 1 -- 172.21.15.46:0/2057493736 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500092e0 con 0x7f9c58069560 2023-10-07T09:04:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 -- 172.21.15.46:0/2057493736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 msgr2=0x7f9c580699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2057493736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009f20 tx=0x7f9c50009840 comp rx=0 tx=0).stop 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 -- 172.21.15.46:0/2057493736 shutdown_connections 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2057493736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58069560 0x7f9c580699a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2057493736 >> v2:172.21.15.133:3300/0 conn(0x7f9c58159890 0x7f9c5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 -- 172.21.15.46:0/2057493736 >> 172.21.15.46:0/2057493736 conn(0x7f9c58068e20 msgr2=0x7f9c580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 -- 172.21.15.46:0/2057493736 shutdown_connections 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.443+0000 7f9c5d758700 1 -- 172.21.15.46:0/2057493736 wait complete. 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.444+0000 7f9c5d758700 1 Processor -- start 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.444+0000 7f9c5d758700 1 -- start start 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c58069560 0x7f9c580c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58159c60 0x7f9c5816cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58151fa0 con 0x7f9c58159890 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58151390 con 0x7f9c58069560 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c5d758700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58151670 con 0x7f9c58159c60 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c567fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c567fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41120/0 (socket says 172.21.15.46:41120) 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c567fc700 1 -- 172.21.15.46:0/2180351714 learned_addr learned my addr 172.21.15.46:0/2180351714 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c577fe700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58159c60 0x7f9c5816cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.445+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c58069560 0x7f9c580c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 -- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58159c60 msgr2=0x7f9c5816cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58159c60 0x7f9c5816cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 -- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c58069560 msgr2=0x7f9c580c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c58069560 0x7f9c580c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 -- 172.21.15.46:0/2180351714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009ae0 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c567fc700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c590 tx=0x7f9c4000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40011590 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40011710 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c58151950 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40011ad0 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.446+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c580c6e30 con 0x7f9c58159890 2023-10-07T09:04:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.447+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58152150 con 0x7f9c58159890 2023-10-07T09:04:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.447+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9c4001b3b0 con 0x7f9c58159890 2023-10-07T09:04:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.448+0000 7f9c4effd700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 0x7f9c380696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.448+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9c40083b00 con 0x7f9c58159890 2023-10-07T09:04:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.448+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 0x7f9c380696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.449+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 0x7f9c380696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009db0 tx=0x7f9c480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.452+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c58152150 con 0x7f9c58159890 2023-10-07T09:04:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.649+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c5804c3c0 con 0x7f9c58159890 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.649+0000 7f9c4effd700 1 -- 172.21.15.46:0/2180351714 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c40017070 con 0x7f9c58159890 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:17.650 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 msgr2=0x7f9c380696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 0x7f9c380696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009db0 tx=0x7f9c480091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 msgr2=0x7f9c58152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c590 tx=0x7f9c4000c8a0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 shutdown_connections 2023-10-07T09:04:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9c38067200 0x7f9c380696b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c58159c60 0x7f9c5816cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c58069560 0x7f9c580c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 --2- 172.21.15.46:0/2180351714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c58159890 0x7f9c58152430 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 >> 172.21.15.46:0/2180351714 conn(0x7f9c58068e20 msgr2=0x7f9c58157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 shutdown_connections 2023-10-07T09:04:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.651+0000 7f9c5d758700 1 -- 172.21.15.46:0/2180351714 wait complete. 2023-10-07T09:04:17.664 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:04:17.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:04:17.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.786+0000 7fe9b9d9d700 1 Processor -- start 2023-10-07T09:04:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.786+0000 7fe9b9d9d700 1 -- start start 2023-10-07T09:04:17.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b9d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9b40b03c0 0x7fe9b40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b9d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9b41591e0 0x7fe9b4159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b9d9d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b40cfa00 con 0x7fe9b40b0790 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b9d9d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b40cb580 con 0x7fe9b40b03c0 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b9d9d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b40cf160 con 0x7fe9b41591e0 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b8d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9b40b03c0 0x7fe9b40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b3fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe9b40b0790 0x7fe9b40b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60046/0 (socket says 172.21.15.46:60046) 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.787+0000 7fe9b3fff700 1 -- 172.21.15.46:0/86546548 learned_addr learned my addr 172.21.15.46:0/86546548 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b959c700 1 --2- 172.21.15.46:0/86546548 >> v2:172.21.15.133:3300/0 conn(0x7fe9b41591e0 0x7fe9b4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b8d9b700 1 -- 172.21.15.46:0/86546548 >> v2:172.21.15.133:3300/0 conn(0x7fe9b41591e0 msgr2=0x7fe9b4159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b8d9b700 1 --2- 172.21.15.46:0/86546548 >> v2:172.21.15.133:3300/0 conn(0x7fe9b41591e0 0x7fe9b4159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b8d9b700 1 -- 172.21.15.46:0/86546548 >> v1:172.21.15.46:6789/0 conn(0x7fe9b40b0790 legacy=0x7fe9b40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b37fe700 1 -- 172.21.15.46:0/86546548 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303766676 0 0) 0x7fe9b40cfa00 con 0x7fe9b40b0790 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b8d9b700 1 -- 172.21.15.46:0/86546548 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40cf440 con 0x7fe9b40b03c0 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b8d9b700 1 --2- 172.21.15.46:0/86546548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40cea70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009e60 tx=0x7fe9ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03c2ec77d590241 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b37fe700 1 -- 172.21.15.46:0/86546548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00e070 con 0x7fe9b40b03c0 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b37fe700 1 -- 172.21.15.46:0/86546548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00bb20 con 0x7fe9b40b03c0 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.788+0000 7fe9b37fe700 1 -- 172.21.15.46:0/86546548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac012430 con 0x7fe9b40b03c0 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/86546548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40b03c0 msgr2=0x7fe9b40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/86546548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40cea70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009e60 tx=0x7fe9ac009780 comp rx=0 tx=0).stop 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/86546548 shutdown_connections 2023-10-07T09:04:17.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/86546548 >> v2:172.21.15.133:3300/0 conn(0x7fe9b41591e0 0x7fe9b4159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/86546548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40cea70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/86546548 >> 172.21.15.46:0/86546548 conn(0x7fe9b4063230 msgr2=0x7fe9b4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/86546548 shutdown_connections 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.789+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/86546548 wait complete. 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.790+0000 7fe9b9d9d700 1 Processor -- start 2023-10-07T09:04:17.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.790+0000 7fe9b9d9d700 1 -- start start 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 0x7fe9b40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c7980 con 0x7fe9b41591e0 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c9d60 con 0x7fe9b40b03c0 2023-10-07T09:04:17.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40ca040 con 0x7fe9b40b0790 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41152/0 (socket says 172.21.15.46:41152) 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 -- 172.21.15.46:0/1139889889 learned_addr learned my addr 172.21.15.46:0/1139889889 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b8d9b700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b3fff700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 0x7fe9b40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 -- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 msgr2=0x7fe9b40c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 0x7fe9b40c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 -- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9b40b03c0 msgr2=0x7fe9b40c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 -- 172.21.15.46:0/1139889889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac009a20 con 0x7fe9b41591e0 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b3fff700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 0x7fe9b40c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:17.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b959c700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400ea50 tx=0x7fe9a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400c920 con 0x7fe9b41591e0 2023-10-07T09:04:17.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a400caa0 con 0x7fe9b41591e0 2023-10-07T09:04:17.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.791+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b40ca320 con 0x7fe9b41591e0 2023-10-07T09:04:17.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.792+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400ce60 con 0x7fe9b41591e0 2023-10-07T09:04:17.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.792+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b4151e70 con 0x7fe9b41591e0 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.792+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b40ca510 con 0x7fe9b41591e0 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.793+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe9a4013680 con 0x7fe9b41591e0 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.793+0000 7fe9b0ff9700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 0x7fe9940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.793+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe9a4084a20 con 0x7fe9b41591e0 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.793+0000 7fe9b8d9b700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 0x7fe9940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:17.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.794+0000 7fe9b8d9b700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 0x7fe9940696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0099f0 tx=0x7fe9ac019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:17.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.797+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9a4051c90 con 0x7fe9b41591e0 2023-10-07T09:04:17.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:17.992+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe9b404c3c0 con 0x7fe9b41591e0 2023-10-07T09:04:18.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.184+0000 7fe9b0ff9700 1 -- 172.21.15.46:0/1139889889 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe9a40552b0 con 0x7fe9b41591e0 2023-10-07T09:04:18.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 msgr2=0x7fe9940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 0x7fe9940696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0099f0 tx=0x7fe9ac019000 comp rx=0 tx=0).stop 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 msgr2=0x7fe9b416a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400ea50 tx=0x7fe9a40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 shutdown_connections 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe994067200 0x7fe9940696b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b41591e0 0x7fe9b416a080 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9b40b03c0 0x7fe9b40c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 --2- 172.21.15.46:0/1139889889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9b40b0790 0x7fe9b40c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 >> 172.21.15.46:0/1139889889 conn(0x7fe9b4063230 msgr2=0x7fe9b40b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.188+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 shutdown_connections 2023-10-07T09:04:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.189+0000 7fe9b9d9d700 1 -- 172.21.15.46:0/1139889889 wait complete. 2023-10-07T09:04:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:04:18.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:04:18.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.328+0000 7fa2e35d3700 1 Processor -- start 2023-10-07T09:04:18.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.328+0000 7fa2e35d3700 1 -- start start 2023-10-07T09:04:18.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e35d3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2dc069c70 0x7fa2dc0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e35d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 0x7fa2dc0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e35d3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0ce380 con 0x7fa2dc159950 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e35d3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cec20 con 0x7fa2dc069c70 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e35d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0afa90 con 0x7fa2dc0af320 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e0b6e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2dc069c70 0x7fa2dc0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e0b6e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2dc069c70 0x7fa2dc0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41164/0 (socket says 172.21.15.46:41164) 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e0b6e700 1 -- 172.21.15.46:0/1743595276 learned_addr learned my addr 172.21.15.46:0/1743595276 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.329+0000 7fa2e136f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa2dc159950 0x7fa2dc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60058/0 (socket says 172.21.15.46:60058) 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e1b70700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 0x7fa2dc0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e0b6e700 1 -- 172.21.15.46:0/1743595276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 msgr2=0x7fa2dc0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 0x7fa2dc0cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e0b6e700 1 -- 172.21.15.46:0/1743595276 >> v1:172.21.15.46:6789/0 conn(0x7fa2dc159950 legacy=0x7fa2dc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e0b6e700 1 -- 172.21.15.46:0/1743595276 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0ce5d0 con 0x7fa2dc069c70 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2dbfff700 1 -- 172.21.15.46:0/1743595276 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719782362 0 0) 0x7fa2dc0ce380 con 0x7fa2dc159950 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e1b70700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 0x7fa2dc0cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc0cbb90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373fd17720a32d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2dbfff700 1 -- 172.21.15.46:0/1743595276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000b860 con 0x7fa2dc069c70 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2dbfff700 1 -- 172.21.15.46:0/1743595276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000b9c0 con 0x7fa2dc069c70 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.330+0000 7fa2dbfff700 1 -- 172.21.15.46:0/1743595276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000bd60 con 0x7fa2dc069c70 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 -- 172.21.15.46:0/1743595276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 msgr2=0x7fa2dc0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc0cbb90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0009250 comp rx=0 tx=0).stop 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 -- 172.21.15.46:0/1743595276 shutdown_connections 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc0af320 0x7fa2dc0cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/1743595276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc0cbb90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 -- 172.21.15.46:0/1743595276 >> 172.21.15.46:0/1743595276 conn(0x7fa2dc068e00 msgr2=0x7fa2dc0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 -- 172.21.15.46:0/1743595276 shutdown_connections 2023-10-07T09:04:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.331+0000 7fa2e35d3700 1 -- 172.21.15.46:0/1743595276 wait complete. 2023-10-07T09:04:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.332+0000 7fa2e35d3700 1 Processor -- start 2023-10-07T09:04:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.332+0000 7fa2e35d3700 1 -- start start 2023-10-07T09:04:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 0x7fa2dc0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc159950 0x7fa2dc0b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b43a0 con 0x7fa2dc069c70 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc16e2e0 con 0x7fa2dc0af320 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc16d520 con 0x7fa2dc159950 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41178/0 (socket says 172.21.15.46:41178) 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 -- 172.21.15.46:0/2073691934 learned_addr learned my addr 172.21.15.46:0/2073691934 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e1b70700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc159950 0x7fa2dc0b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 -- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc159950 msgr2=0x7fa2dc0b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 0x7fa2dc0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc159950 0x7fa2dc0b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 -- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 msgr2=0x7fa2dc0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 0x7fa2dc0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 -- 172.21.15.46:0/2073691934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00094f0 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 0x7fa2dc0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e136f700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c5b0 tx=0x7fa2d4001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4005a70 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4005bd0 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc16d800 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40070d0 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.333+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc16ddc0 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.334+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc16dfb0 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.335+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa2d4007480 con 0x7fa2dc069c70 2023-10-07T09:04:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.335+0000 7fa2d97fa700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 0x7fa2c80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.336+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa2d4083cc0 con 0x7fa2dc069c70 2023-10-07T09:04:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.336+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 0x7fa2c80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.336+0000 7fa2e0b6e700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 0x7fa2c80696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.340+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2d4050dc0 con 0x7fa2dc069c70 2023-10-07T09:04:18.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:18.533+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa2dc16d660 con 0x7fa2dc069c70 2023-10-07T09:04:19.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.188+0000 7fa2d97fa700 1 -- 172.21.15.46:0/2073691934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2dc16d660 con 0x7fa2dc069c70 2023-10-07T09:04:19.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 msgr2=0x7fa2c80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 0x7fa2c80696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0017000 comp rx=0 tx=0).stop 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 msgr2=0x7fa2dc147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c5b0 tx=0x7fa2d4001040 comp rx=0 tx=0).stop 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 shutdown_connections 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa2c8067200 0x7fa2c80696b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2dc159950 0x7fa2dc0b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2dc069c70 0x7fa2dc147090 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 --2- 172.21.15.46:0/2073691934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0af320 0x7fa2dc0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.195+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 >> 172.21.15.46:0/2073691934 conn(0x7fa2dc068e00 msgr2=0x7fa2dc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:19.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.198+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 shutdown_connections 2023-10-07T09:04:19.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.198+0000 7fa2e35d3700 1 -- 172.21.15.46:0/2073691934 wait complete. 2023-10-07T09:04:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:04:19.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:04:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.349+0000 7f4e6798a700 1 Processor -- start 2023-10-07T09:04:19.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.349+0000 7f4e6798a700 1 -- start start 2023-10-07T09:04:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e6798a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4e60159890 0x7f4e6015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e6798a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6015a160 con 0x7f4e60069560 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e6798a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600d13a0 con 0x7f4e60159c60 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e6798a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6015e140 con 0x7f4e60159890 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e65f27700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e60069560 0x7f4e600ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e65f27700 1 -- 172.21.15.46:0/3067219998 learned_addr learned my addr 172.21.15.46:0/3067219998 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> v2:172.21.15.133:3300/0 conn(0x7f4e60159890 0x7f4e6015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696162246 0 0) 0x7f4e6015a160 con 0x7f4e60069560 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e48003570 con 0x7f4e60069560 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382073583 0 0) 0x7f4e600d13a0 con 0x7f4e60159c60 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6015a160 con 0x7f4e60159c60 2023-10-07T09:04:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2915101220 0 0) 0x7f4e48003570 con 0x7f4e60069560 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 >> v2:172.21.15.133:3300/0 conn(0x7f4e60159890 msgr2=0x7f4e6015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 --2- 172.21.15.46:0/3067219998 >> v2:172.21.15.133:3300/0 conn(0x7f4e60159890 0x7f4e6015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 >> v1:172.21.15.133:6789/0 conn(0x7f4e60159c60 legacy=0x7f4e6015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6015a3d0 con 0x7f4e60069560 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4e58001470 con 0x7f4e60069560 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> v2:172.21.15.133:3300/0 conn(0x7f4e60159890 0x7f4e6015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 >> v1:172.21.15.46:6789/0 conn(0x7f4e60069560 legacy=0x7f4e600ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e48003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.350+0000 7f4e5ffff700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e48004810 0x7f4e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e480051c0 0x7f4e4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6015e140 con 0x7f4e48003bf0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4800c0b0 con 0x7f4e48004810 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4800c270 con 0x7f4e480051c0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e48003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e64f25700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e48004810 0x7f4e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65f27700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e480051c0 0x7f4e4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 -- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e480051c0 msgr2=0x7f4e4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e480051c0 0x7f4e4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 -- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e48004810 msgr2=0x7f4e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e48004810 0x7f4e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 -- 172.21.15.46:0/3067219998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48003570 con 0x7f4e48003bf0 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e64f25700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e48004810 0x7f4e48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:19.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65f27700 1 -- 172.21.15.46:0/3067219998 reap_dead start 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e65726700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e48003fe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e3c0 tx=0x7f4e5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de4e9de47d8d622 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50009c50 con 0x7f4e48003bf0 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000f040 con 0x7f4e48003bf0 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.351+0000 7f4e5ffff700 1 -- 172.21.15.46:0/3067219998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000eea0 con 0x7f4e48003bf0 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 -- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 msgr2=0x7f4e48003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e48003fe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e3c0 tx=0x7f4e5000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 -- 172.21.15.46:0/3067219998 shutdown_connections 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 --2- 172.21.15.46:0/3067219998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e48003fe0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 -- 172.21.15.46:0/3067219998 >> 172.21.15.46:0/3067219998 conn(0x7f4e60068e20 msgr2=0x7f4e600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 -- 172.21.15.46:0/3067219998 shutdown_connections 2023-10-07T09:04:19.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.352+0000 7f4e6798a700 1 -- 172.21.15.46:0/3067219998 wait complete. 2023-10-07T09:04:19.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.353+0000 7f4e6798a700 1 Processor -- start 2023-10-07T09:04:19.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.353+0000 7f4e6798a700 1 -- start start 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e600cdd30 0x7f4e600ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e601546f0 0x7f4e60154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60155090 con 0x7f4e48003bf0 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600b4640 con 0x7f4e601546f0 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e6798a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600b3a70 con 0x7f4e600cdd30 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41196/0 (socket says 172.21.15.46:41196) 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 -- 172.21.15.46:0/1213378102 learned_addr learned my addr 172.21.15.46:0/1213378102 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65f27700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e601546f0 0x7f4e60154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e64f25700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e600cdd30 0x7f4e600ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 -- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e600cdd30 msgr2=0x7f4e600ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e600cdd30 0x7f4e600ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 -- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e601546f0 msgr2=0x7f4e60154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e601546f0 0x7f4e60154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 -- 172.21.15.46:0/1213378102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60158d60 con 0x7f4e48003bf0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.354+0000 7f4e65726700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4e500099f0 tx=0x7f4e5001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.355+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001d660 con 0x7f4e48003bf0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.355+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5001d7c0 con 0x7f4e48003bf0 2023-10-07T09:04:19.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.355+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001dbc0 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.355+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e600b3d10 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.355+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e600b42d0 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.356+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60069960 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.356+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4e50003040 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.356+0000 7f4e5d7fa700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 0x7f4e4c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.356+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4e50086c00 con 0x7f4e48003bf0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.357+0000 7f4e64f25700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 0x7f4e4c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:19.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.357+0000 7f4e64f25700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 0x7f4e4c0696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e600ce100 tx=0x7f4e54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:19.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.361+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e50053860 con 0x7f4e48003bf0 2023-10-07T09:04:19.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:19.597+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4e60158ef0 con 0x7f4e48003bf0 2023-10-07T09:04:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.208+0000 7f4e5d7fa700 1 -- 172.21.15.46:0/1213378102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4e60158ef0 con 0x7f4e48003bf0 2023-10-07T09:04:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 msgr2=0x7f4e4c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 0x7f4e4c0696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e600ce100 tx=0x7f4e54009040 comp rx=0 tx=0).stop 2023-10-07T09:04:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 msgr2=0x7f4e60158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4e500099f0 tx=0x7f4e5001a000 comp rx=0 tx=0).stop 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 shutdown_connections 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e4c067200 0x7f4e4c0696b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e601546f0 0x7f4e60154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e48003bf0 0x7f4e60158820 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 --2- 172.21.15.46:0/1213378102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e600cdd30 0x7f4e600ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 >> 172.21.15.46:0/1213378102 conn(0x7f4e60068e20 msgr2=0x7f4e60152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 shutdown_connections 2023-10-07T09:04:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.211+0000 7f4e6798a700 1 -- 172.21.15.46:0/1213378102 wait complete. 2023-10-07T09:04:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 14 and data pool 15 2023-10-07T09:04:20.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:20.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.347+0000 7fc4c3fe5700 1 Processor -- start 2023-10-07T09:04:20.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.347+0000 7fc4c3fe5700 1 -- start start 2023-10-07T09:04:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c3fe5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4bc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c3fe5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc15a160 con 0x7fc4bc159890 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c3fe5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0d13a0 con 0x7fc4bc15db10 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c3fe5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15e140 con 0x7fc4bc159c60 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c1d81700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc4bc159890 0x7fc4bc15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32826/0 (socket says 172.21.15.46:32826) 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c1d81700 1 -- 172.21.15.46:0/62280603 learned_addr learned my addr 172.21.15.46:0/62280603 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c1580700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4bc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468060414 0 0) 0x7fc4bc15a160 con 0x7fc4bc159890 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.348+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a4003570 con 0x7fc4bc159890 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284350006 0 0) 0x7fc4a4003570 con 0x7fc4bc159890 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 msgr2=0x7fc4bc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4bc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 >> v1:172.21.15.133:6789/0 conn(0x7fc4bc15db10 legacy=0x7fc4bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc15a3d0 con 0x7fc4bc159890 2023-10-07T09:04:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fc4b4001470 con 0x7fc4bc159890 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 >> v1:172.21.15.46:6789/0 conn(0x7fc4bc159890 legacy=0x7fc4bc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a4003a90 0x7fc4a4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4a4004d50 0x7fc4a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15e140 con 0x7fc4a4004d50 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a400bb70 con 0x7fc4a4003a90 2023-10-07T09:04:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a400bd30 con 0x7fc4bc159c60 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4a4004d50 0x7fc4a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c1d81700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a4003a90 0x7fc4a4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c1580700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 -- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 msgr2=0x7fc4a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc159c60 0x7fc4a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 -- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a4003a90 msgr2=0x7fc4a4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a4003a90 0x7fc4a4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 -- 172.21.15.46:0/62280603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a4003570 con 0x7fc4a4004d50 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c2582700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4a4004d50 0x7fc4a40051c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac001fc0 tx=0x7fc4ac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e206c32d4bd82bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.349+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac001950 con 0x7fc4a4004d50 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00c8b0 con 0x7fc4a4004d50 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c0d7f700 1 -- 172.21.15.46:0/62280603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00cc50 con 0x7fc4a4004d50 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/62280603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4a4004d50 msgr2=0x7fc4a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/62280603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4a4004d50 0x7fc4a40051c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac001fc0 tx=0x7fc4ac001640 comp rx=0 tx=0).stop 2023-10-07T09:04:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c2582700 1 -- 172.21.15.46:0/62280603 reap_dead start 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/62280603 shutdown_connections 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/62280603 >> 172.21.15.46:0/62280603 conn(0x7fc4bc068e20 msgr2=0x7fc4bc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/62280603 shutdown_connections 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.350+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/62280603 wait complete. 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.351+0000 7fc4c3fe5700 1 Processor -- start 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.351+0000 7fc4c3fe5700 1 -- start start 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc14c2d0 0x7fc4bc1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc0c5ed0 0x7fc4bc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc151370 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c6340 con 0x7fc4bc14c2d0 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c3fe5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b27f0 con 0x7fc4bc0c5ed0 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52654/0 (socket says 172.21.15.46:52654) 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 -- 172.21.15.46:0/635371819 learned_addr learned my addr 172.21.15.46:0/635371819 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1d81700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc14c2d0 0x7fc4bc1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c2582700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc0c5ed0 0x7fc4bc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 -- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc0c5ed0 msgr2=0x7fc4bc15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc0c5ed0 0x7fc4bc15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 -- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc14c2d0 msgr2=0x7fc4bc1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc14c2d0 0x7fc4bc1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.352+0000 7fc4c1580700 1 -- 172.21.15.46:0/635371819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc1506f0 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4c1580700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0011b40 tx=0x7fc4b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000f940 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000faa0 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000fe20 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc1509d0 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.353+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc150f90 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.354+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc151150 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.354+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc4b0014650 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.355+0000 7fc4b9ffb700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 0x7fc4a80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.355+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4b0018030 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.355+0000 7fc4c1d81700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 0x7fc4a80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.355+0000 7fc4c1d81700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 0x7fc4a80696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40010e0 tx=0x7fc4b4001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.359+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4b0052200 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.552+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4bc04c3c0 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.553+0000 7fc4b9ffb700 1 -- 172.21.15.46:0/635371819 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fc4b0055820 con 0x7fc4bc15cfb0 2023-10-07T09:04:20.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:20.554 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":89,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:19.598251+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 msgr2=0x7fc4a80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 0x7fc4a80696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40010e0 tx=0x7fc4b4001e50 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 msgr2=0x7fc4bc0c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0011b40 tx=0x7fc4b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 shutdown_connections 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4a8067200 0x7fc4a80696b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4bc0c5ed0 0x7fc4bc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc14c2d0 0x7fc4bc1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 --2- 172.21.15.46:0/635371819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4bc15cfb0 0x7fc4bc0c5990 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 >> 172.21.15.46:0/635371819 conn(0x7fc4bc068e20 msgr2=0x7fc4bc158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 shutdown_connections 2023-10-07T09:04:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.556+0000 7fc4c3fe5700 1 -- 172.21.15.46:0/635371819 wait complete. 2023-10-07T09:04:20.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.687+0000 7fd0100f9700 1 Processor -- start 2023-10-07T09:04:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.687+0000 7fd0100f9700 1 -- start start 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd0100f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd008159c10 0x7fd0080694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd0100f9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0080699e0 0x7fd0080b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd0100f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0080cfb30 con 0x7fd008159840 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd0100f9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd008069e80 con 0x7fd0080699e0 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd0100f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080cbc40 con 0x7fd008159c10 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0080699e0 0x7fd0080b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0080699e0 0x7fd0080b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52664/0 (socket says 172.21.15.46:52664) 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 -- 172.21.15.46:0/228808170 learned_addr learned my addr 172.21.15.46:0/228808170 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00d694700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd008159c10 0x7fd0080694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 -- 172.21.15.46:0/228808170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd008159c10 msgr2=0x7fd0080694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd008159c10 0x7fd0080694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 -- 172.21.15.46:0/228808170 >> v1:172.21.15.133:6789/0 conn(0x7fd008159840 legacy=0x7fd0080cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 -- 172.21.15.46:0/228808170 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080cbf10 con 0x7fd0080699e0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.688+0000 7fd00e696700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0080699e0 0x7fd0080b05e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd000009f50 tx=0x7fd000009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e005b3ba2ca1d9b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd00ce93700 1 -- 172.21.15.46:0/228808170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000e070 con 0x7fd0080699e0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd00ce93700 1 -- 172.21.15.46:0/228808170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000ba30 con 0x7fd0080699e0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd00ce93700 1 -- 172.21.15.46:0/228808170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000092e0 con 0x7fd0080699e0 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 -- 172.21.15.46:0/228808170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0080699e0 msgr2=0x7fd0080b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0080699e0 0x7fd0080b05e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd000009f50 tx=0x7fd000009840 comp rx=0 tx=0).stop 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 -- 172.21.15.46:0/228808170 shutdown_connections 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0080699e0 0x7fd0080b05e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 --2- 172.21.15.46:0/228808170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd008159c10 0x7fd0080694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 -- 172.21.15.46:0/228808170 >> 172.21.15.46:0/228808170 conn(0x7fd008068e10 msgr2=0x7fd0080d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 -- 172.21.15.46:0/228808170 shutdown_connections 2023-10-07T09:04:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.689+0000 7fd0100f9700 1 -- 172.21.15.46:0/228808170 wait complete. 2023-10-07T09:04:20.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.690+0000 7fd0100f9700 1 Processor -- start 2023-10-07T09:04:20.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.690+0000 7fd0100f9700 1 -- start start 2023-10-07T09:04:20.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0080699e0 0x7fd00815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd008159c10 0x7fd00815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815b410 con 0x7fd008159840 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815a5a0 con 0x7fd008159c10 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd0100f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815a800 con 0x7fd0080699e0 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd00d694700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd00d694700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52666/0 (socket says 172.21.15.46:52666) 2023-10-07T09:04:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd00d694700 1 -- 172.21.15.46:0/2701750510 learned_addr learned my addr 172.21.15.46:0/2701750510 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd00e696700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd008159c10 0x7fd00815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.691+0000 7fd00de95700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0080699e0 0x7fd00815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 -- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0080699e0 msgr2=0x7fd00815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0080699e0 0x7fd00815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 -- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd008159c10 msgr2=0x7fd00815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd008159c10 0x7fd00815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 -- 172.21.15.46:0/2701750510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000009ae0 con 0x7fd008159840 2023-10-07T09:04:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd00d694700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d860 tx=0x7fcff8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80125f0 con 0x7fd008159840 2023-10-07T09:04:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8012770 con 0x7fd008159840 2023-10-07T09:04:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00815aae0 con 0x7fd008159840 2023-10-07T09:04:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8012b30 con 0x7fd008159840 2023-10-07T09:04:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.692+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00815b0a0 con 0x7fd008159840 2023-10-07T09:04:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.693+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd008064550 con 0x7fd008159840 2023-10-07T09:04:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.693+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fcff8013480 con 0x7fd008159840 2023-10-07T09:04:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.694+0000 7fcffdffb700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 0x7fcfec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.694+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcff8084d20 con 0x7fd008159840 2023-10-07T09:04:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.694+0000 7fd00de95700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 0x7fcfec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:20.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.694+0000 7fd00de95700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 0x7fcfec0696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd004003a30 tx=0x7fd004007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:20.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.698+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcff8051c00 con 0x7fd008159840 2023-10-07T09:04:20.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.894+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd00815b260 con 0x7fd008159840 2023-10-07T09:04:20.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.895+0000 7fcffdffb700 1 -- 172.21.15.46:0/2701750510 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fcff8055220 con 0x7fd008159840 2023-10-07T09:04:20.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:20.896 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":89,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:19.598251+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 msgr2=0x7fcfec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 0x7fcfec0696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd004003a30 tx=0x7fd004007ea0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 msgr2=0x7fd0080c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d860 tx=0x7fcff8008040 comp rx=0 tx=0).stop 2023-10-07T09:04:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 shutdown_connections 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfec067200 0x7fcfec0696b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd008159c10 0x7fd00815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0080699e0 0x7fd00815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 --2- 172.21.15.46:0/2701750510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008159840 0x7fd0080c8470 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 >> 172.21.15.46:0/2701750510 conn(0x7fd008068e10 msgr2=0x7fd008157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 shutdown_connections 2023-10-07T09:04:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:20.897+0000 7fd0100f9700 1 -- 172.21.15.46:0/2701750510 wait complete. 2023-10-07T09:04:20.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:04:21.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.034+0000 7f7bfa4ce700 1 Processor -- start 2023-10-07T09:04:21.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.034+0000 7f7bfa4ce700 1 -- start start 2023-10-07T09:04:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 0x7f7bf415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf4159c60 0x7f7bf415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7bf415db10 0x7f7bf4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415a160 con 0x7f7bf415db10 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40d13a0 con 0x7f7bf4159890 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bfa4ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf415e140 con 0x7f7bf4159c60 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7bf415db10 0x7f7bf4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7bf415db10 0x7f7bf4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52680/0 (socket says 172.21.15.46:52680) 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 -- 172.21.15.46:0/3084016524 learned_addr learned my addr 172.21.15.46:0/3084016524 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 -- 172.21.15.46:0/3084016524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf4159c60 msgr2=0x7f7bf415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 --2- 172.21.15.46:0/3084016524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf4159c60 0x7f7bf415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 -- 172.21.15.46:0/3084016524 >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 msgr2=0x7f7bf415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf3fff700 1 --2- 172.21.15.46:0/3084016524 >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 0x7f7bf415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 --2- 172.21.15.46:0/3084016524 >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 0x7f7bf415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 -- 172.21.15.46:0/3084016524 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf415a3d0 con 0x7f7bf415db10 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf3fff700 1 --2- 172.21.15.46:0/3084016524 >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 0x7f7bf415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf8a6b700 1 --2- 172.21.15.46:0/3084016524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf415db10 0x7f7bf4069560 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40d1090 tx=0x7f7bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2b08635dbd1083 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/3084016524 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00e070 con 0x7f7bf415db10 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/3084016524 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00ba50 con 0x7f7bf415db10 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.035+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/3084016524 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0092e0 con 0x7f7bf415db10 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/3084016524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf415db10 msgr2=0x7f7bf4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/3084016524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf415db10 0x7f7bf4069560 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40d1090 tx=0x7f7bec009840 comp rx=0 tx=0).stop 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/3084016524 shutdown_connections 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/3084016524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf415db10 0x7f7bf4069560 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/3084016524 >> v2:172.21.15.133:3300/0 conn(0x7f7bf4159890 0x7f7bf415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/3084016524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf4159c60 0x7f7bf415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/3084016524 >> 172.21.15.46:0/3084016524 conn(0x7f7bf4068e20 msgr2=0x7f7bf40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/3084016524 shutdown_connections 2023-10-07T09:04:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.036+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/3084016524 wait complete. 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.037+0000 7f7bfa4ce700 1 Processor -- start 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.037+0000 7f7bfa4ce700 1 -- start start 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf4159890 0x7f7bf4157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf415db10 0x7f7bf40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40cf540 con 0x7f7bf4159c60 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40cf750 con 0x7f7bf4159890 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bfa4ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40cfa30 con 0x7f7bf415db10 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52692/0 (socket says 172.21.15.46:52692) 2023-10-07T09:04:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf4159890 0x7f7bf4157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 -- 172.21.15.46:0/2013795482 learned_addr learned my addr 172.21.15.46:0/2013795482 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf8a6b700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf415db10 0x7f7bf40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 -- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf415db10 msgr2=0x7f7bf40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf415db10 0x7f7bf40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 -- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf4159890 msgr2=0x7f7bf4157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf4159890 0x7f7bf4157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.038+0000 7f7bf37fe700 1 -- 172.21.15.46:0/2013795482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec009ae0 con 0x7f7bf4159c60 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bf37fe700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00b810 tx=0x7f7bdc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00f510 con 0x7f7bf4159c60 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00f670 con 0x7f7bf4159c60 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf40cfd10 con 0x7f7bf4159c60 2023-10-07T09:04:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00fa30 con 0x7f7bf4159c60 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.039+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf416cfd0 con 0x7f7bf4159c60 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.040+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404c3c0 con 0x7f7bf4159c60 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.040+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7bdc01a400 con 0x7f7bf4159c60 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.041+0000 7f7bebfff700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 0x7f7bd40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.041+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bdc0843b0 con 0x7f7bf4159c60 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.041+0000 7f7bf3fff700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 0x7f7bd40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.041+0000 7f7bf3fff700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 0x7f7bd40696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7be400adc0 tx=0x7f7be4006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.045+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bdc051350 con 0x7f7bf4159c60 2023-10-07T09:04:21.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:21.288+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7bf40cc860 con 0x7f7bf4159c60 2023-10-07T09:04:22.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.219+0000 7f7bebfff700 1 -- 172.21.15.46:0/2013795482 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7bdc054970 con 0x7f7bf4159c60 2023-10-07T09:04:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 msgr2=0x7f7bd40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 0x7f7bd40696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7be400adc0 tx=0x7f7be4006f90 comp rx=0 tx=0).stop 2023-10-07T09:04:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 msgr2=0x7f7bf40cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00b810 tx=0x7f7bdc009220 comp rx=0 tx=0).stop 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 shutdown_connections 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7bd4067200 0x7f7bd40696b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bf415db10 0x7f7bf40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf4159890 0x7f7bf4157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 --2- 172.21.15.46:0/2013795482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4159c60 0x7f7bf40cf000 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.222+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 >> 172.21.15.46:0/2013795482 conn(0x7f7bf4068e20 msgr2=0x7f7bf41508e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.223+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 shutdown_connections 2023-10-07T09:04:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.223+0000 7f7bfa4ce700 1 -- 172.21.15.46:0/2013795482 wait complete. 2023-10-07T09:04:22.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:04:22.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.366+0000 7fbb13ce5700 1 Processor -- start 2023-10-07T09:04:22.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.366+0000 7fbb13ce5700 1 -- start start 2023-10-07T09:04:22.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb13ce5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb0c159c60 0x7fbb0c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:22.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb13ce5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c15a160 con 0x7fbb0c159890 2023-10-07T09:04:22.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb13ce5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0d13a0 con 0x7fbb0c15db10 2023-10-07T09:04:22.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb13ce5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c15df50 con 0x7fbb0c159c60 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11a81700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbb0c159890 0x7fbb0c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32836/0 (socket says 172.21.15.46:32836) 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11a81700 1 -- 172.21.15.46:0/3654759489 learned_addr learned my addr 172.21.15.46:0/3654759489 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11280700 1 --2- 172.21.15.46:0/3654759489 >> v2:172.21.15.133:3300/0 conn(0x7fbb0c159c60 0x7fbb0c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786773287 0 0) 0x7fbb0c15a160 con 0x7fbb0c159890 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf8003570 con 0x7fbb0c159890 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11280700 1 -- 172.21.15.46:0/3654759489 >> v1:172.21.15.133:6789/0 conn(0x7fbb0c15db10 legacy=0x7fbb0c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11280700 1 -- 172.21.15.46:0/3654759489 >> v1:172.21.15.46:6789/0 conn(0x7fbb0c159890 legacy=0x7fbb0c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556738356 0 0) 0x7fbb0c0d13a0 con 0x7fbb0c15db10 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11280700 1 -- 172.21.15.46:0/3654759489 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c15e140 con 0x7fbb0c159c60 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.367+0000 7fbb11280700 1 --2- 172.21.15.46:0/3654759489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c159c60 0x7fbb0c15d5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098e0 tx=0x7fbafc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71dd8f7b4a79693e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080017f0 con 0x7fbb0c159c60 2023-10-07T09:04:22.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc011420 con 0x7fbb0c159c60 2023-10-07T09:04:22.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb10a7f700 1 -- 172.21.15.46:0/3654759489 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0117a0 con 0x7fbb0c159c60 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 -- 172.21.15.46:0/3654759489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c159c60 msgr2=0x7fbb0c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/3654759489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c159c60 0x7fbb0c15d5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098e0 tx=0x7fbafc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 -- 172.21.15.46:0/3654759489 shutdown_connections 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/3654759489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c159c60 0x7fbb0c15d5d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 -- 172.21.15.46:0/3654759489 >> 172.21.15.46:0/3654759489 conn(0x7fbb0c068e20 msgr2=0x7fbb0c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:22.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 -- 172.21.15.46:0/3654759489 shutdown_connections 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.368+0000 7fbb13ce5700 1 -- 172.21.15.46:0/3654759489 wait complete. 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.369+0000 7fbb13ce5700 1 Processor -- start 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.369+0000 7fbb13ce5700 1 -- start start 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0c159c60 0x7fbb0c16a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 0x7fbb0c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c147850 con 0x7fbb0c159890 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b3590 con 0x7fbb0c15db10 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb13ce5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0c6ce0 con 0x7fbb0c159c60 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11a81700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11a81700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52704/0 (socket says 172.21.15.46:52704) 2023-10-07T09:04:22.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11a81700 1 -- 172.21.15.46:0/4122183892 learned_addr learned my addr 172.21.15.46:0/4122183892 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb12282700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 0x7fbb0c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11280700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0c159c60 0x7fbb0c16a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11a81700 1 -- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0c159c60 msgr2=0x7fbb0c16a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.370+0000 7fbb11a81700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0c159c60 0x7fbb0c16a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb11a81700 1 -- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 msgr2=0x7fbb0c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb11a81700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 0x7fbb0c0b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb11a81700 1 -- 172.21.15.46:0/4122183892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc009420 con 0x7fbb0c159890 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb12282700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 0x7fbb0c0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb11a81700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbb08001920 tx=0x7fbb08007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08004e20 con 0x7fbb0c159890 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0800a8c0 con 0x7fbb0c159890 2023-10-07T09:04:22.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c0cd100 con 0x7fbb0c159890 2023-10-07T09:04:22.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800ac80 con 0x7fbb0c159890 2023-10-07T09:04:22.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.371+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c0b37a0 con 0x7fbb0c159890 2023-10-07T09:04:22.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.372+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c04c3c0 con 0x7fbb0c159890 2023-10-07T09:04:22.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.372+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fbb08007150 con 0x7fbb0c159890 2023-10-07T09:04:22.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.373+0000 7fbb01ffb700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 0x7fbaf00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:22.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.373+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb08084800 con 0x7fbb0c159890 2023-10-07T09:04:22.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.373+0000 7fbb11280700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 0x7fbaf00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:22.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.373+0000 7fbb11280700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 0x7fbaf00696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0093f0 tx=0x7fbafc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:22.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.377+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb08055020 con 0x7fbb0c159890 2023-10-07T09:04:22.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:22.617+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbb0c0cb9a0 con 0x7fbb0c159890 2023-10-07T09:04:23.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.224+0000 7fbb01ffb700 1 -- 172.21.15.46:0/4122183892 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbb080180c0 con 0x7fbb0c159890 2023-10-07T09:04:23.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.226+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 msgr2=0x7fbaf00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.226+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 0x7fbaf00696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0093f0 tx=0x7fbafc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.226+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 msgr2=0x7fbb0c147310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.226+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbb08001920 tx=0x7fbb08007e90 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 shutdown_connections 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbaf0067200 0x7fbaf00696b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb0c15db10 0x7fbb0c0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb0c159890 0x7fbb0c147310 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 --2- 172.21.15.46:0/4122183892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb0c159c60 0x7fbb0c16a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 >> 172.21.15.46:0/4122183892 conn(0x7fbb0c068e20 msgr2=0x7fbb0c155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 shutdown_connections 2023-10-07T09:04:23.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.227+0000 7fbb13ce5700 1 -- 172.21.15.46:0/4122183892 wait complete. 2023-10-07T09:04:23.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.366+0000 7f59fe7d2700 1 Processor -- start 2023-10-07T09:04:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.366+0000 7f59fe7d2700 1 -- start start 2023-10-07T09:04:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59fe7d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59f80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59fe7d2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f8069ee0 con 0x7f59f8159890 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59fe7d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f815a160 con 0x7f59f8159c60 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59fe7d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80d13a0 con 0x7f59f8069560 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59f7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f59f8159890 0x7f59f815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32844/0 (socket says 172.21.15.46:32844) 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59f7fff700 1 -- 172.21.15.46:0/4054695636 learned_addr learned my addr 172.21.15.46:0/4054695636 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.367+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256483952 0 0) 0x7f59f8069ee0 con 0x7f59f8159890 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e0003570 con 0x7f59f8159890 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59f80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698220712 0 0) 0x7f59e0003570 con 0x7f59f8159890 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 msgr2=0x7f59f80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59f80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 >> v1:172.21.15.133:6789/0 conn(0x7f59f8159c60 legacy=0x7f59f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f815e140 con 0x7f59f8159890 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f59ec001470 con 0x7f59f8159890 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 >> v1:172.21.15.46:6789/0 conn(0x7f59f8159890 legacy=0x7f59f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e0003a90 0x7f59e0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59e0004d50 0x7f59e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80d13a0 con 0x7f59e0004d50 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e000bba0 con 0x7f59e0003a90 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e000bd60 con 0x7f59f8069560 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59e0004d50 0x7f59e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f7fff700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e0003a90 0x7f59e0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59f77fe700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 -- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 msgr2=0x7f59e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f8069560 0x7f59e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 -- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e0003a90 msgr2=0x7f59e0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e0003a90 0x7f59e0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.368+0000 7f59fcd6f700 1 -- 172.21.15.46:0/4054695636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0003570 con 0x7f59e0004d50 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59e0004d50 0x7f59e00051c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e210 tx=0x7f59f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fabf72ac73334e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000eac0 con 0x7f59e0004d50 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000f040 con 0x7f59e0004d50 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59f6ffd700 1 -- 172.21.15.46:0/4054695636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000ee70 con 0x7f59e0004d50 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 -- 172.21.15.46:0/4054695636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59e0004d50 msgr2=0x7f59e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/4054695636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59e0004d50 0x7f59e00051c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e210 tx=0x7f59f000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fcd6f700 1 -- 172.21.15.46:0/4054695636 reap_dead start 2023-10-07T09:04:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 -- 172.21.15.46:0/4054695636 shutdown_connections 2023-10-07T09:04:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 -- 172.21.15.46:0/4054695636 >> 172.21.15.46:0/4054695636 conn(0x7f59f8068e20 msgr2=0x7f59f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 -- 172.21.15.46:0/4054695636 shutdown_connections 2023-10-07T09:04:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.369+0000 7f59fe7d2700 1 -- 172.21.15.46:0/4054695636 wait complete. 2023-10-07T09:04:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.370+0000 7f59fe7d2700 1 Processor -- start 2023-10-07T09:04:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 -- start start 2023-10-07T09:04:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f816a060 0x7f59f80b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 0x7f59f80b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f816b1c0 con 0x7f59f816a430 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f816c020 con 0x7f59f8167c30 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fe7d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f81402a0 con 0x7f59f816a060 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fcd6f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fcd6f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52730/0 (socket says 172.21.15.46:52730) 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59fcd6f700 1 -- 172.21.15.46:0/232991961 learned_addr learned my addr 172.21.15.46:0/232991961 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.371+0000 7f59f77fe700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 0x7f59f80b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59f7fff700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f816a060 0x7f59f80b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 -- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f816a060 msgr2=0x7f59f80b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f816a060 0x7f59f80b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 -- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 msgr2=0x7f59f80b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 0x7f59f80b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 -- 172.21.15.46:0/232991961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f816b410 con 0x7f59f816a430 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59f77fe700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 0x7f59f80b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fcd6f700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e800 tx=0x7f59f001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f001d630 con 0x7f59f816a430 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f001d7f0 con 0x7f59f816a430 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f001dbb0 con 0x7f59f816a430 2023-10-07T09:04:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f816b6f0 con 0x7f59f816a430 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.372+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f816bcb0 con 0x7f59f816a430 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.373+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f816c1b0 con 0x7f59f816a430 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.373+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f59f0003050 con 0x7f59f816a430 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.374+0000 7f59dffff700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 0x7f59e40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.374+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59f0085d00 con 0x7f59f816a430 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.374+0000 7f59f7fff700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 0x7f59e40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.374+0000 7f59f7fff700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 0x7f59e40696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59ec000e10 tx=0x7f59ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.378+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59f0052b10 con 0x7f59f816a430 2023-10-07T09:04:23.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.614+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59f804c3c0 con 0x7f59f816a430 2023-10-07T09:04:23.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.615+0000 7f59dffff700 1 -- 172.21.15.46:0/232991961 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f59f0018020 con 0x7f59f816a430 2023-10-07T09:04:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:23.616 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 msgr2=0x7f59e40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 0x7f59e40696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59ec000e10 tx=0x7f59ec009040 comp rx=0 tx=0).stop 2023-10-07T09:04:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 msgr2=0x7f59f816a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e800 tx=0x7f59f001a000 comp rx=0 tx=0).stop 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 shutdown_connections 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59e4067200 0x7f59e40696b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59f816a430 0x7f59f816a8d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59f816a060 0x7f59f80b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 --2- 172.21.15.46:0/232991961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59f8167c30 0x7f59f80b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 >> 172.21.15.46:0/232991961 conn(0x7f59f8068e20 msgr2=0x7f59f80cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 shutdown_connections 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.617+0000 7f59fe7d2700 1 -- 172.21.15.46:0/232991961 wait complete. 2023-10-07T09:04:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 56 2023-10-07T09:04:23.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.749+0000 7fddea751700 1 Processor -- start 2023-10-07T09:04:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.749+0000 7fddea751700 1 -- start start 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fddea751700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 0x7fdde415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fddea751700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdde4069560 0x7fdde40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fddea751700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde415a160 con 0x7fdde4159c60 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fddea751700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4069f20 con 0x7fdde4069560 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fddea751700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40d13a0 con 0x7fdde4159890 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdde4069560 0x7fdde40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdde4159c60 0x7fdde415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32848/0 (socket says 172.21.15.46:32848) 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde37fe700 1 -- 172.21.15.46:0/4122775199 learned_addr learned my addr 172.21.15.46:0/4122775199 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde3fff700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 0x7fdde415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 -- 172.21.15.46:0/4122775199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 msgr2=0x7fdde415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 0x7fdde415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 -- 172.21.15.46:0/4122775199 >> v1:172.21.15.46:6789/0 conn(0x7fdde4159c60 legacy=0x7fdde415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 -- 172.21.15.46:0/4122775199 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde415e140 con 0x7fdde4069560 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde2ffd700 1 -- 172.21.15.46:0/4122775199 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871456392 0 0) 0x7fdde415a160 con 0x7fdde4159c60 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde3fff700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 0x7fdde415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde8cee700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40699e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aed2af525b78ae server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde2ffd700 1 -- 172.21.15.46:0/4122775199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00e070 con 0x7fdde4069560 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde2ffd700 1 -- 172.21.15.46:0/4122775199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc00bc30 con 0x7fdde4069560 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.750+0000 7fdde2ffd700 1 -- 172.21.15.46:0/4122775199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc012430 con 0x7fdde4069560 2023-10-07T09:04:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 -- 172.21.15.46:0/4122775199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 msgr2=0x7fdde40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40699e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).stop 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 -- 172.21.15.46:0/4122775199 shutdown_connections 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40699e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 --2- 172.21.15.46:0/4122775199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159890 0x7fdde415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 -- 172.21.15.46:0/4122775199 >> 172.21.15.46:0/4122775199 conn(0x7fdde4068e20 msgr2=0x7fdde40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 -- 172.21.15.46:0/4122775199 shutdown_connections 2023-10-07T09:04:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.751+0000 7fddea751700 1 -- 172.21.15.46:0/4122775199 wait complete. 2023-10-07T09:04:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.752+0000 7fddea751700 1 Processor -- start 2023-10-07T09:04:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.752+0000 7fddea751700 1 -- start start 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 0x7fdde40b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159c60 0x7fdde4154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b5950 con 0x7fdde4069560 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b5c30 con 0x7fdde4159890 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fddea751700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b5f10 con 0x7fdde4159c60 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52750/0 (socket says 172.21.15.46:52750) 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 -- 172.21.15.46:0/3196319132 learned_addr learned my addr 172.21.15.46:0/3196319132 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde8cee700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159c60 0x7fdde4154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde37fe700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 0x7fdde40b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 -- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159c60 msgr2=0x7fdde4154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159c60 0x7fdde4154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 -- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 msgr2=0x7fdde40b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 0x7fdde40b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde3fff700 1 -- 172.21.15.46:0/3196319132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009a20 con 0x7fdde4069560 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.753+0000 7fdde37fe700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 0x7fdde40b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fdde3fff700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c830 tx=0x7fddd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011600 con 0x7fdde4069560 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4011760 con 0x7fdde4069560 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde40b61f0 con 0x7fdde4069560 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011b20 con 0x7fdde4069560 2023-10-07T09:04:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.754+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40b1bc0 con 0x7fdde4069560 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.755+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde40b1e10 con 0x7fdde4069560 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.755+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fddd400a3f0 con 0x7fdde4069560 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.755+0000 7fddcbfff700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 0x7fddd00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.756+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddd4084b20 con 0x7fdde4069560 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.756+0000 7fdde37fe700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 0x7fddd00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.756+0000 7fdde37fe700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 0x7fddd00696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdde41592b0 tx=0x7fddd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.760+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddd4051930 con 0x7fdde4069560 2023-10-07T09:04:23.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.953+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde404c3c0 con 0x7fdde4069560 2023-10-07T09:04:23.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.954+0000 7fddcbfff700 1 -- 172.21.15.46:0/3196319132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fddd4015090 con 0x7fdde4069560 2023-10-07T09:04:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:23.956 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:20.915210+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 msgr2=0x7fddd00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 0x7fddd00696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdde41592b0 tx=0x7fddd8009040 comp rx=0 tx=0).stop 2023-10-07T09:04:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 msgr2=0x7fdde40b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c830 tx=0x7fddd4008040 comp rx=0 tx=0).stop 2023-10-07T09:04:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 shutdown_connections 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fddd0067200 0x7fddd00696b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde4159c60 0x7fdde4154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdde4069560 0x7fdde40b3f70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 --2- 172.21.15.46:0/3196319132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde4159890 0x7fdde40b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 >> 172.21.15.46:0/3196319132 conn(0x7fdde4068e20 msgr2=0x7fdde4158810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 shutdown_connections 2023-10-07T09:04:23.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:23.956+0000 7fddea751700 1 -- 172.21.15.46:0/3196319132 wait complete. 2023-10-07T09:04:23.969 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:04:23.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:04:24.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.088+0000 7efc9d6d4700 1 Processor -- start 2023-10-07T09:04:24.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.088+0000 7efc9d6d4700 1 -- start start 2023-10-07T09:04:24.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.088+0000 7efc9d6d4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc980caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc9d6d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc9815df50 0x7efc9815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc9d6d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9815d7e0 con 0x7efc9806bcd0 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc9d6d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9815dac0 con 0x7efc9815df50 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc9d6d4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815aa30 con 0x7efc9806c0a0 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc967fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc980caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc9815df50 0x7efc9815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc967fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc980caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:47388/0 (socket says 172.21.15.46:47388) 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc967fc700 1 -- 172.21.15.46:0/2771316777 learned_addr learned my addr 172.21.15.46:0/2771316777 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc977fe700 1 -- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 msgr2=0x7efc980caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc977fe700 1 --2- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc980caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc977fe700 1 -- 172.21.15.46:0/2771316777 >> v1:172.21.15.133:6789/0 conn(0x7efc9806bcd0 legacy=0x7efc9815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc95ffb700 1 -- 172.21.15.46:0/2771316777 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853100881 0 0) 0x7efc9815d7e0 con 0x7efc9806bcd0 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.089+0000 7efc977fe700 1 -- 172.21.15.46:0/2771316777 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9815ad10 con 0x7efc9815df50 2023-10-07T09:04:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc977fe700 1 --2- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc9815e3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc900098e0 tx=0x7efc900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a43a8a2b6da84b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc95ffb700 1 -- 172.21.15.46:0/2771316777 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000b640 con 0x7efc9815df50 2023-10-07T09:04:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc95ffb700 1 -- 172.21.15.46:0/2771316777 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000b7a0 con 0x7efc9815df50 2023-10-07T09:04:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc95ffb700 1 -- 172.21.15.46:0/2771316777 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000bb40 con 0x7efc9815df50 2023-10-07T09:04:24.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 -- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 msgr2=0x7efc9815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc9815e3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc900098e0 tx=0x7efc900091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 -- 172.21.15.46:0/2771316777 shutdown_connections 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc9815e3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/2771316777 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc980caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 -- 172.21.15.46:0/2771316777 >> 172.21.15.46:0/2771316777 conn(0x7efc980ce600 msgr2=0x7efc980cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 -- 172.21.15.46:0/2771316777 shutdown_connections 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.090+0000 7efc9d6d4700 1 -- 172.21.15.46:0/2771316777 wait complete. 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 Processor -- start 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 -- start start 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc9816acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc981587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98159020 con 0x7efc9806bcd0 2023-10-07T09:04:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815ee70 con 0x7efc9815df50 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.092+0000 7efc9d6d4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815f150 con 0x7efc9806c0a0 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52758/0 (socket says 172.21.15.46:52758) 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 -- 172.21.15.46:0/358983601 learned_addr learned my addr 172.21.15.46:0/358983601 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc967fc700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc9816acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc977fe700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc981587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 -- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 msgr2=0x7efc9816acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc9816acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 -- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 msgr2=0x7efc981587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc981587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 -- 172.21.15.46:0/358983601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009420 con 0x7efc9806bcd0 2023-10-07T09:04:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc96ffd700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c910 tx=0x7efc88001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88012630 con 0x7efc9806bcd0 2023-10-07T09:04:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880127b0 con 0x7efc9806bcd0 2023-10-07T09:04:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88012b70 con 0x7efc9806bcd0 2023-10-07T09:04:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9815f430 con 0x7efc9806bcd0 2023-10-07T09:04:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.093+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc98158ce0 con 0x7efc9806bcd0 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.094+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9804c3c0 con 0x7efc9806bcd0 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.095+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7efc88003030 con 0x7efc9806bcd0 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.095+0000 7efc8effd700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 0x7efc780696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.095+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc880848b0 con 0x7efc9806bcd0 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.095+0000 7efc967fc700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 0x7efc780696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.096+0000 7efc967fc700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 0x7efc780696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efc9815eda0 tx=0x7efc80009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.099+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc880517d0 con 0x7efc9806bcd0 2023-10-07T09:04:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.289+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc9815efe0 con 0x7efc78067200 2023-10-07T09:04:24.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.298+0000 7efc8effd700 1 -- 172.21.15.46:0/358983601 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289246 (secure 0 0 0) 0x7efc9815efe0 con 0x7efc78067200 2023-10-07T09:04:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:24.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 msgr2=0x7efc780696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 0x7efc780696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efc9815eda0 tx=0x7efc80009250 comp rx=0 tx=0).stop 2023-10-07T09:04:24.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 msgr2=0x7efc98146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c910 tx=0x7efc88001700 comp rx=0 tx=0).stop 2023-10-07T09:04:24.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 shutdown_connections 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc78067200 0x7efc780696b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc9815df50 0x7efc981587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc9806bcd0 0x7efc98146450 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 --2- 172.21.15.46:0/358983601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc9806c0a0 0x7efc9816acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 >> 172.21.15.46:0/358983601 conn(0x7efc980ce600 msgr2=0x7efc9806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 shutdown_connections 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.301+0000 7efc9d6d4700 1 -- 172.21.15.46:0/358983601 wait complete. 2023-10-07T09:04:24.306 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:04:24.313 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-07T09:04:23.847738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408588,"kb_used_data":9804,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566132,"statfs":{"total":773094113280,"available":770627719168,"internally_reserved":0,"allocated":10039296,"data_stored":4966696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663701"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.927957+0000","last_change":"2023-10-07T09:04:19.927957+0000","last_active":"2023-10-07T09:04:19.927957+0000","last_peered":"2023-10-07T09:04:19.927957+0000","last_clean":"2023-10-07T09:04:19.927957+0000","last_became_active":"2023-10-07T09:04:19.927688+0000","last_became_peered":"2023-10-07T09:04:19.927688+0000","last_unstale":"2023-10-07T09:04:19.927957+0000","last_undegraded":"2023-10-07T09:04:19.927957+0000","last_fullsized":"2023-10-07T09:04:19.927957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:09.437195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928890+0000","last_change":"2023-10-07T09:04:19.928890+0000","last_active":"2023-10-07T09:04:19.928890+0000","last_peered":"2023-10-07T09:04:19.928890+0000","last_clean":"2023-10-07T09:04:19.928890+0000","last_became_active":"2023-10-07T09:04:19.928273+0000","last_became_peered":"2023-10-07T09:04:19.928273+0000","last_unstale":"2023-10-07T09:04:19.928890+0000","last_undegraded":"2023-10-07T09:04:19.928890+0000","last_fullsized":"2023-10-07T09:04:19.928890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:56.106038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928338+0000","last_change":"2023-10-07T09:04:19.928338+0000","last_active":"2023-10-07T09:04:19.928338+0000","last_peered":"2023-10-07T09:04:19.928338+0000","last_clean":"2023-10-07T09:04:19.928338+0000","last_became_active":"2023-10-07T09:04:19.928102+0000","last_became_peered":"2023-10-07T09:04:19.928102+0000","last_unstale":"2023-10-07T09:04:19.928338+0000","last_undegraded":"2023-10-07T09:04:19.928338+0000","last_fullsized":"2023-10-07T09:04:19.928338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:57.644340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.930502+0000","last_change":"2023-10-07T09:04:19.930502+0000","last_active":"2023-10-07T09:04:19.930502+0000","last_peered":"2023-10-07T09:04:19.930502+0000","last_clean":"2023-10-07T09:04:19.930502+0000","last_became_active":"2023-10-07T09:04:19.929721+0000","last_became_peered":"2023-10-07T09:04:19.929721+0000","last_unstale":"2023-10-07T09:04:19.930502+0000","last_undegraded":"2023-10-07T09:04:19.930502+0000","last_fullsized":"2023-10-07T09:04:19.930502+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:44.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939513+0000","last_change":"2023-10-07T09:04:19.930326+0000","last_active":"2023-10-07T09:04:19.939513+0000","last_peered":"2023-10-07T09:04:19.939513+0000","last_clean":"2023-10-07T09:04:19.939513+0000","last_became_active":"2023-10-07T09:04:19.930039+0000","last_became_peered":"2023-10-07T09:04:19.930039+0000","last_unstale":"2023-10-07T09:04:19.939513+0000","last_undegraded":"2023-10-07T09:04:19.939513+0000","last_fullsized":"2023-10-07T09:04:19.939513+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:16.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928219+0000","last_change":"2023-10-07T09:04:19.928219+0000","last_active":"2023-10-07T09:04:19.928219+0000","last_peered":"2023-10-07T09:04:19.928219+0000","last_clean":"2023-10-07T09:04:19.928219+0000","last_became_active":"2023-10-07T09:04:19.927881+0000","last_became_peered":"2023-10-07T09:04:19.927881+0000","last_unstale":"2023-10-07T09:04:19.928219+0000","last_undegraded":"2023-10-07T09:04:19.928219+0000","last_fullsized":"2023-10-07T09:04:19.928219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:32.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928122+0000","last_change":"2023-10-07T09:04:19.928122+0000","last_active":"2023-10-07T09:04:19.928122+0000","last_peered":"2023-10-07T09:04:19.928122+0000","last_clean":"2023-10-07T09:04:19.928122+0000","last_became_active":"2023-10-07T09:04:19.927849+0000","last_became_peered":"2023-10-07T09:04:19.927849+0000","last_unstale":"2023-10-07T09:04:19.928122+0000","last_undegraded":"2023-10-07T09:04:19.928122+0000","last_fullsized":"2023-10-07T09:04:19.928122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:00.015338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931623+0000","last_change":"2023-10-07T09:04:19.931623+0000","last_active":"2023-10-07T09:04:19.931623+0000","last_peered":"2023-10-07T09:04:19.931623+0000","last_clean":"2023-10-07T09:04:19.931623+0000","last_became_active":"2023-10-07T09:04:19.931353+0000","last_became_peered":"2023-10-07T09:04:19.931353+0000","last_unstale":"2023-10-07T09:04:19.931623+0000","last_undegraded":"2023-10-07T09:04:19.931623+0000","last_fullsized":"2023-10-07T09:04:19.931623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:03.466825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938015+0000","last_change":"2023-10-07T09:04:19.938015+0000","last_active":"2023-10-07T09:04:19.938015+0000","last_peered":"2023-10-07T09:04:19.938015+0000","last_clean":"2023-10-07T09:04:19.938015+0000","last_became_active":"2023-10-07T09:04:19.937778+0000","last_became_peered":"2023-10-07T09:04:19.937778+0000","last_unstale":"2023-10-07T09:04:19.938015+0000","last_undegraded":"2023-10-07T09:04:19.938015+0000","last_fullsized":"2023-10-07T09:04:19.938015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:14.307189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941602+0000","last_change":"2023-10-07T09:04:19.935702+0000","last_active":"2023-10-07T09:04:19.941602+0000","last_peered":"2023-10-07T09:04:19.941602+0000","last_clean":"2023-10-07T09:04:19.941602+0000","last_became_active":"2023-10-07T09:04:19.935359+0000","last_became_peered":"2023-10-07T09:04:19.935359+0000","last_unstale":"2023-10-07T09:04:19.941602+0000","last_undegraded":"2023-10-07T09:04:19.941602+0000","last_fullsized":"2023-10-07T09:04:19.941602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:59.294962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938242+0000","last_change":"2023-10-07T09:04:19.938242+0000","last_active":"2023-10-07T09:04:19.938242+0000","last_peered":"2023-10-07T09:04:19.938242+0000","last_clean":"2023-10-07T09:04:19.938242+0000","last_became_active":"2023-10-07T09:04:19.937944+0000","last_became_peered":"2023-10-07T09:04:19.937944+0000","last_unstale":"2023-10-07T09:04:19.938242+0000","last_undegraded":"2023-10-07T09:04:19.938242+0000","last_fullsized":"2023-10-07T09:04:19.938242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:38.476566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937396+0000","last_change":"2023-10-07T09:04:19.937396+0000","last_active":"2023-10-07T09:04:19.937396+0000","last_peered":"2023-10-07T09:04:19.937396+0000","last_clean":"2023-10-07T09:04:19.937396+0000","last_became_active":"2023-10-07T09:04:19.937033+0000","last_became_peered":"2023-10-07T09:04:19.937033+0000","last_unstale":"2023-10-07T09:04:19.937396+0000","last_undegraded":"2023-10-07T09:04:19.937396+0000","last_fullsized":"2023-10-07T09:04:19.937396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:32.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933707+0000","last_change":"2023-10-07T09:04:19.933707+0000","last_active":"2023-10-07T09:04:19.933707+0000","last_peered":"2023-10-07T09:04:19.933707+0000","last_clean":"2023-10-07T09:04:19.933707+0000","last_became_active":"2023-10-07T09:04:19.933421+0000","last_became_peered":"2023-10-07T09:04:19.933421+0000","last_unstale":"2023-10-07T09:04:19.933707+0000","last_undegraded":"2023-10-07T09:04:19.933707+0000","last_fullsized":"2023-10-07T09:04:19.933707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:23.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937099+0000","last_change":"2023-10-07T09:04:19.937099+0000","last_active":"2023-10-07T09:04:19.937099+0000","last_peered":"2023-10-07T09:04:19.937099+0000","last_clean":"2023-10-07T09:04:19.937099+0000","last_became_active":"2023-10-07T09:04:19.936858+0000","last_became_peered":"2023-10-07T09:04:19.936858+0000","last_unstale":"2023-10-07T09:04:19.937099+0000","last_undegraded":"2023-10-07T09:04:19.937099+0000","last_fullsized":"2023-10-07T09:04:19.937099+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:44.451010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931617+0000","last_change":"2023-10-07T09:04:19.931617+0000","last_active":"2023-10-07T09:04:19.931617+0000","last_peered":"2023-10-07T09:04:19.931617+0000","last_clean":"2023-10-07T09:04:19.931617+0000","last_became_active":"2023-10-07T09:04:19.931351+0000","last_became_peered":"2023-10-07T09:04:19.931351+0000","last_unstale":"2023-10-07T09:04:19.931617+0000","last_undegraded":"2023-10-07T09:04:19.931617+0000","last_fullsized":"2023-10-07T09:04:19.931617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:53.563280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.925897+0000","last_change":"2023-10-07T09:04:19.925897+0000","last_active":"2023-10-07T09:04:19.925897+0000","last_peered":"2023-10-07T09:04:19.925897+0000","last_clean":"2023-10-07T09:04:19.925897+0000","last_became_active":"2023-10-07T09:04:19.925615+0000","last_became_peered":"2023-10-07T09:04:19.925615+0000","last_unstale":"2023-10-07T09:04:19.925897+0000","last_undegraded":"2023-10-07T09:04:19.925897+0000","last_fullsized":"2023-10-07T09:04:19.925897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:23.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928390+0000","last_change":"2023-10-07T09:04:19.928390+0000","last_active":"2023-10-07T09:04:19.928390+0000","last_peered":"2023-10-07T09:04:19.928390+0000","last_clean":"2023-10-07T09:04:19.928390+0000","last_became_active":"2023-10-07T09:04:19.928132+0000","last_became_peered":"2023-10-07T09:04:19.928132+0000","last_unstale":"2023-10-07T09:04:19.928390+0000","last_undegraded":"2023-10-07T09:04:19.928390+0000","last_fullsized":"2023-10-07T09:04:19.928390+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:48.687356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933031+0000","last_change":"2023-10-07T09:04:19.933031+0000","last_active":"2023-10-07T09:04:19.933031+0000","last_peered":"2023-10-07T09:04:19.933031+0000","last_clean":"2023-10-07T09:04:19.933031+0000","last_became_active":"2023-10-07T09:04:19.932467+0000","last_became_peered":"2023-10-07T09:04:19.932467+0000","last_unstale":"2023-10-07T09:04:19.933031+0000","last_undegraded":"2023-10-07T09:04:19.933031+0000","last_fullsized":"2023-10-07T09:04:19.933031+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:48.687356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923112+0000","last_change":"2023-10-07T09:04:19.923112+0000","last_active":"2023-10-07T09:04:19.923112+0000","last_peered":"2023-10-07T09:04:19.923112+0000","last_clean":"2023-10-07T09:04:19.923112+0000","last_became_active":"2023-10-07T09:04:19.922772+0000","last_became_peered":"2023-10-07T09:04:19.922772+0000","last_unstale":"2023-10-07T09:04:19.923112+0000","last_undegraded":"2023-10-07T09:04:19.923112+0000","last_fullsized":"2023-10-07T09:04:19.923112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:47.669680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939081+0000","last_change":"2023-10-07T09:04:19.939081+0000","last_active":"2023-10-07T09:04:19.939081+0000","last_peered":"2023-10-07T09:04:19.939081+0000","last_clean":"2023-10-07T09:04:19.939081+0000","last_became_active":"2023-10-07T09:04:19.937520+0000","last_became_peered":"2023-10-07T09:04:19.937520+0000","last_unstale":"2023-10-07T09:04:19.939081+0000","last_undegraded":"2023-10-07T09:04:19.939081+0000","last_fullsized":"2023-10-07T09:04:19.939081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:19.237171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929583+0000","last_change":"2023-10-07T09:04:19.929583+0000","last_active":"2023-10-07T09:04:19.929583+0000","last_peered":"2023-10-07T09:04:19.929583+0000","last_clean":"2023-10-07T09:04:19.929583+0000","last_became_active":"2023-10-07T09:04:19.928954+0000","last_became_peered":"2023-10-07T09:04:19.928954+0000","last_unstale":"2023-10-07T09:04:19.929583+0000","last_undegraded":"2023-10-07T09:04:19.929583+0000","last_fullsized":"2023-10-07T09:04:19.929583+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:24.486190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928163+0000","last_change":"2023-10-07T09:04:19.928163+0000","last_active":"2023-10-07T09:04:19.928163+0000","last_peered":"2023-10-07T09:04:19.928163+0000","last_clean":"2023-10-07T09:04:19.928163+0000","last_became_active":"2023-10-07T09:04:19.927870+0000","last_became_peered":"2023-10-07T09:04:19.927870+0000","last_unstale":"2023-10-07T09:04:19.928163+0000","last_undegraded":"2023-10-07T09:04:19.928163+0000","last_fullsized":"2023-10-07T09:04:19.928163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:06.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.927929+0000","last_change":"2023-10-07T09:04:19.927929+0000","last_active":"2023-10-07T09:04:19.927929+0000","last_peered":"2023-10-07T09:04:19.927929+0000","last_clean":"2023-10-07T09:04:19.927929+0000","last_became_active":"2023-10-07T09:04:19.927653+0000","last_became_peered":"2023-10-07T09:04:19.927653+0000","last_unstale":"2023-10-07T09:04:19.927929+0000","last_undegraded":"2023-10-07T09:04:19.927929+0000","last_fullsized":"2023-10-07T09:04:19.927929+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:01.099513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923097+0000","last_change":"2023-10-07T09:04:19.923097+0000","last_active":"2023-10-07T09:04:19.923097+0000","last_peered":"2023-10-07T09:04:19.923097+0000","last_clean":"2023-10-07T09:04:19.923097+0000","last_became_active":"2023-10-07T09:04:19.922792+0000","last_became_peered":"2023-10-07T09:04:19.922792+0000","last_unstale":"2023-10-07T09:04:19.923097+0000","last_undegraded":"2023-10-07T09:04:19.923097+0000","last_fullsized":"2023-10-07T09:04:19.923097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:53.923906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939541+0000","last_change":"2023-10-07T09:04:19.932034+0000","last_active":"2023-10-07T09:04:19.939541+0000","last_peered":"2023-10-07T09:04:19.939541+0000","last_clean":"2023-10-07T09:04:19.939541+0000","last_became_active":"2023-10-07T09:04:19.931709+0000","last_became_peered":"2023-10-07T09:04:19.931709+0000","last_unstale":"2023-10-07T09:04:19.939541+0000","last_undegraded":"2023-10-07T09:04:19.939541+0000","last_fullsized":"2023-10-07T09:04:19.939541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:06.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.926317+0000","last_change":"2023-10-07T09:04:19.926317+0000","last_active":"2023-10-07T09:04:19.926317+0000","last_peered":"2023-10-07T09:04:19.926317+0000","last_clean":"2023-10-07T09:04:19.926317+0000","last_became_active":"2023-10-07T09:04:19.926079+0000","last_became_peered":"2023-10-07T09:04:19.926079+0000","last_unstale":"2023-10-07T09:04:19.926317+0000","last_undegraded":"2023-10-07T09:04:19.926317+0000","last_fullsized":"2023-10-07T09:04:19.926317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:16.380500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923987+0000","last_change":"2023-10-07T09:04:19.923987+0000","last_active":"2023-10-07T09:04:19.923987+0000","last_peered":"2023-10-07T09:04:19.923987+0000","last_clean":"2023-10-07T09:04:19.923987+0000","last_became_active":"2023-10-07T09:04:19.923723+0000","last_became_peered":"2023-10-07T09:04:19.923723+0000","last_unstale":"2023-10-07T09:04:19.923987+0000","last_undegraded":"2023-10-07T09:04:19.923987+0000","last_fullsized":"2023-10-07T09:04:19.923987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:34:25.716725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941744+0000","last_change":"2023-10-07T09:04:19.937059+0000","last_active":"2023-10-07T09:04:19.941744+0000","last_peered":"2023-10-07T09:04:19.941744+0000","last_clean":"2023-10-07T09:04:19.941744+0000","last_became_active":"2023-10-07T09:04:19.936529+0000","last_became_peered":"2023-10-07T09:04:19.936529+0000","last_unstale":"2023-10-07T09:04:19.941744+0000","last_undegraded":"2023-10-07T09:04:19.941744+0000","last_fullsized":"2023-10-07T09:04:19.941744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:56.509948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931349+0000","last_change":"2023-10-07T09:04:19.931349+0000","last_active":"2023-10-07T09:04:19.931349+0000","last_peered":"2023-10-07T09:04:19.931349+0000","last_clean":"2023-10-07T09:04:19.931349+0000","last_became_active":"2023-10-07T09:04:19.931064+0000","last_became_peered":"2023-10-07T09:04:19.931064+0000","last_unstale":"2023-10-07T09:04:19.931349+0000","last_undegraded":"2023-10-07T09:04:19.931349+0000","last_fullsized":"2023-10-07T09:04:19.931349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:12.456613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923606+0000","last_change":"2023-10-07T09:04:19.923606+0000","last_active":"2023-10-07T09:04:19.923606+0000","last_peered":"2023-10-07T09:04:19.923606+0000","last_clean":"2023-10-07T09:04:19.923606+0000","last_became_active":"2023-10-07T09:04:19.923340+0000","last_became_peered":"2023-10-07T09:04:19.923340+0000","last_unstale":"2023-10-07T09:04:19.923606+0000","last_undegraded":"2023-10-07T09:04:19.923606+0000","last_fullsized":"2023-10-07T09:04:19.923606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:16.398078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937483+0000","last_change":"2023-10-07T09:04:19.937483+0000","last_active":"2023-10-07T09:04:19.937483+0000","last_peered":"2023-10-07T09:04:19.937483+0000","last_clean":"2023-10-07T09:04:19.937483+0000","last_became_active":"2023-10-07T09:04:19.937175+0000","last_became_peered":"2023-10-07T09:04:19.937175+0000","last_unstale":"2023-10-07T09:04:19.937483+0000","last_undegraded":"2023-10-07T09:04:19.937483+0000","last_fullsized":"2023-10-07T09:04:19.937483+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:19.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933415+0000","last_change":"2023-10-07T09:04:19.933415+0000","last_active":"2023-10-07T09:04:19.933415+0000","last_peered":"2023-10-07T09:04:19.933415+0000","last_clean":"2023-10-07T09:04:19.933415+0000","last_became_active":"2023-10-07T09:04:19.932915+0000","last_became_peered":"2023-10-07T09:04:19.932915+0000","last_unstale":"2023-10-07T09:04:19.933415+0000","last_undegraded":"2023-10-07T09:04:19.933415+0000","last_fullsized":"2023-10-07T09:04:19.933415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:14.599898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929032+0000","last_change":"2023-10-07T09:04:19.929032+0000","last_active":"2023-10-07T09:04:19.929032+0000","last_peered":"2023-10-07T09:04:19.929032+0000","last_clean":"2023-10-07T09:04:19.929032+0000","last_became_active":"2023-10-07T09:04:19.928780+0000","last_became_peered":"2023-10-07T09:04:19.928780+0000","last_unstale":"2023-10-07T09:04:19.929032+0000","last_undegraded":"2023-10-07T09:04:19.929032+0000","last_fullsized":"2023-10-07T09:04:19.929032+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:00:14.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"89'4","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218281+0000","last_change":"2023-10-07T09:04:19.207424+0000","last_active":"2023-10-07T09:04:20.218281+0000","last_peered":"2023-10-07T09:04:20.218281+0000","last_clean":"2023-10-07T09:04:20.218281+0000","last_became_active":"2023-10-07T09:04:19.207152+0000","last_became_peered":"2023-10-07T09:04:19.207152+0000","last_unstale":"2023-10-07T09:04:20.218281+0000","last_undegraded":"2023-10-07T09:04:20.218281+0000","last_fullsized":"2023-10-07T09:04:20.218281+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:16.205759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937691+0000","last_change":"2023-10-07T09:04:19.937691+0000","last_active":"2023-10-07T09:04:19.937691+0000","last_peered":"2023-10-07T09:04:19.937691+0000","last_clean":"2023-10-07T09:04:19.937691+0000","last_became_active":"2023-10-07T09:04:19.936810+0000","last_became_peered":"2023-10-07T09:04:19.936810+0000","last_unstale":"2023-10-07T09:04:19.937691+0000","last_undegraded":"2023-10-07T09:04:19.937691+0000","last_fullsized":"2023-10-07T09:04:19.937691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:34:25.716725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.918235+0000","last_change":"2023-10-07T09:04:19.208360+0000","last_active":"2023-10-07T09:04:19.918235+0000","last_peered":"2023-10-07T09:04:19.918235+0000","last_clean":"2023-10-07T09:04:19.918235+0000","last_became_active":"2023-10-07T09:04:19.208089+0000","last_became_peered":"2023-10-07T09:04:19.208089+0000","last_unstale":"2023-10-07T09:04:19.918235+0000","last_undegraded":"2023-10-07T09:04:19.918235+0000","last_fullsized":"2023-10-07T09:04:19.918235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:31.420325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938111+0000","last_change":"2023-10-07T09:04:19.938111+0000","last_active":"2023-10-07T09:04:19.938111+0000","last_peered":"2023-10-07T09:04:19.938111+0000","last_clean":"2023-10-07T09:04:19.938111+0000","last_became_active":"2023-10-07T09:04:19.937766+0000","last_became_peered":"2023-10-07T09:04:19.937766+0000","last_unstale":"2023-10-07T09:04:19.938111+0000","last_undegraded":"2023-10-07T09:04:19.938111+0000","last_fullsized":"2023-10-07T09:04:19.938111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:34.269788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.216132+0000","last_change":"2023-10-07T09:04:19.206100+0000","last_active":"2023-10-07T09:04:20.216132+0000","last_peered":"2023-10-07T09:04:20.216132+0000","last_clean":"2023-10-07T09:04:20.216132+0000","last_became_active":"2023-10-07T09:04:19.205839+0000","last_became_peered":"2023-10-07T09:04:19.205839+0000","last_unstale":"2023-10-07T09:04:20.216132+0000","last_undegraded":"2023-10-07T09:04:20.216132+0000","last_fullsized":"2023-10-07T09:04:20.216132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:57.551400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.940779+0000","last_change":"2023-10-07T09:04:19.940779+0000","last_active":"2023-10-07T09:04:19.940779+0000","last_peered":"2023-10-07T09:04:19.940779+0000","last_clean":"2023-10-07T09:04:19.940779+0000","last_became_active":"2023-10-07T09:04:19.937227+0000","last_became_peered":"2023-10-07T09:04:19.937227+0000","last_unstale":"2023-10-07T09:04:19.940779+0000","last_undegraded":"2023-10-07T09:04:19.940779+0000","last_fullsized":"2023-10-07T09:04:19.940779+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:14.189637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221392+0000","last_change":"2023-10-07T09:04:19.206633+0000","last_active":"2023-10-07T09:04:20.221392+0000","last_peered":"2023-10-07T09:04:20.221392+0000","last_clean":"2023-10-07T09:04:20.221392+0000","last_became_active":"2023-10-07T09:04:19.206382+0000","last_became_peered":"2023-10-07T09:04:19.206382+0000","last_unstale":"2023-10-07T09:04:20.221392+0000","last_undegraded":"2023-10-07T09:04:20.221392+0000","last_fullsized":"2023-10-07T09:04:20.221392+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:29.893815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939081+0000","last_change":"2023-10-07T09:04:19.939081+0000","last_active":"2023-10-07T09:04:19.939081+0000","last_peered":"2023-10-07T09:04:19.939081+0000","last_clean":"2023-10-07T09:04:19.939081+0000","last_became_active":"2023-10-07T09:04:19.938671+0000","last_became_peered":"2023-10-07T09:04:19.938671+0000","last_unstale":"2023-10-07T09:04:19.939081+0000","last_undegraded":"2023-10-07T09:04:19.939081+0000","last_fullsized":"2023-10-07T09:04:19.939081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:06.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.921503+0000","last_change":"2023-10-07T09:04:19.202181+0000","last_active":"2023-10-07T09:04:19.921503+0000","last_peered":"2023-10-07T09:04:19.921503+0000","last_clean":"2023-10-07T09:04:19.921503+0000","last_became_active":"2023-10-07T09:04:19.201540+0000","last_became_peered":"2023-10-07T09:04:19.201540+0000","last_unstale":"2023-10-07T09:04:19.921503+0000","last_undegraded":"2023-10-07T09:04:19.921503+0000","last_fullsized":"2023-10-07T09:04:19.921503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:15.394212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.935832+0000","last_change":"2023-10-07T09:04:19.935832+0000","last_active":"2023-10-07T09:04:19.935832+0000","last_peered":"2023-10-07T09:04:19.935832+0000","last_clean":"2023-10-07T09:04:19.935832+0000","last_became_active":"2023-10-07T09:04:19.935615+0000","last_became_peered":"2023-10-07T09:04:19.935615+0000","last_unstale":"2023-10-07T09:04:19.935832+0000","last_undegraded":"2023-10-07T09:04:19.935832+0000","last_fullsized":"2023-10-07T09:04:19.935832+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:06.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.920136+0000","last_change":"2023-10-07T09:04:19.209108+0000","last_active":"2023-10-07T09:04:19.920136+0000","last_peered":"2023-10-07T09:04:19.920136+0000","last_clean":"2023-10-07T09:04:19.920136+0000","last_became_active":"2023-10-07T09:04:19.208721+0000","last_became_peered":"2023-10-07T09:04:19.208721+0000","last_unstale":"2023-10-07T09:04:19.920136+0000","last_undegraded":"2023-10-07T09:04:19.920136+0000","last_fullsized":"2023-10-07T09:04:19.920136+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:40.100247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934397+0000","last_change":"2023-10-07T09:04:19.934397+0000","last_active":"2023-10-07T09:04:19.934397+0000","last_peered":"2023-10-07T09:04:19.934397+0000","last_clean":"2023-10-07T09:04:19.934397+0000","last_became_active":"2023-10-07T09:04:19.934105+0000","last_became_peered":"2023-10-07T09:04:19.934105+0000","last_unstale":"2023-10-07T09:04:19.934397+0000","last_undegraded":"2023-10-07T09:04:19.934397+0000","last_fullsized":"2023-10-07T09:04:19.934397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:38.476566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928336+0000","last_change":"2023-10-07T09:04:19.203759+0000","last_active":"2023-10-07T09:04:19.928336+0000","last_peered":"2023-10-07T09:04:19.928336+0000","last_clean":"2023-10-07T09:04:19.928336+0000","last_became_active":"2023-10-07T09:04:19.203448+0000","last_became_peered":"2023-10-07T09:04:19.203448+0000","last_unstale":"2023-10-07T09:04:19.928336+0000","last_undegraded":"2023-10-07T09:04:19.928336+0000","last_fullsized":"2023-10-07T09:04:19.928336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:59.717963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933675+0000","last_change":"2023-10-07T09:04:19.933675+0000","last_active":"2023-10-07T09:04:19.933675+0000","last_peered":"2023-10-07T09:04:19.933675+0000","last_clean":"2023-10-07T09:04:19.933675+0000","last_became_active":"2023-10-07T09:04:19.933370+0000","last_became_peered":"2023-10-07T09:04:19.933370+0000","last_unstale":"2023-10-07T09:04:19.933675+0000","last_undegraded":"2023-10-07T09:04:19.933675+0000","last_fullsized":"2023-10-07T09:04:19.933675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:06.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.207482+0000","last_change":"2023-10-07T09:04:19.203008+0000","last_active":"2023-10-07T09:04:19.207482+0000","last_peered":"2023-10-07T09:04:19.207482+0000","last_clean":"2023-10-07T09:04:19.207482+0000","last_became_active":"2023-10-07T09:04:19.201977+0000","last_became_peered":"2023-10-07T09:04:19.201977+0000","last_unstale":"2023-10-07T09:04:19.207482+0000","last_undegraded":"2023-10-07T09:04:19.207482+0000","last_fullsized":"2023-10-07T09:04:19.207482+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937909+0000","last_change":"2023-10-07T09:04:19.937909+0000","last_active":"2023-10-07T09:04:19.937909+0000","last_peered":"2023-10-07T09:04:19.937909+0000","last_clean":"2023-10-07T09:04:19.937909+0000","last_became_active":"2023-10-07T09:04:19.937651+0000","last_became_peered":"2023-10-07T09:04:19.937651+0000","last_unstale":"2023-10-07T09:04:19.937909+0000","last_undegraded":"2023-10-07T09:04:19.937909+0000","last_fullsized":"2023-10-07T09:04:19.937909+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:19.200999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.207631+0000","last_change":"2023-10-07T09:04:19.201800+0000","last_active":"2023-10-07T09:04:19.207631+0000","last_peered":"2023-10-07T09:04:19.207631+0000","last_clean":"2023-10-07T09:04:19.207631+0000","last_became_active":"2023-10-07T09:04:19.201497+0000","last_became_peered":"2023-10-07T09:04:19.201497+0000","last_unstale":"2023-10-07T09:04:19.207631+0000","last_undegraded":"2023-10-07T09:04:19.207631+0000","last_fullsized":"2023-10-07T09:04:19.207631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:00:13.842478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937359+0000","last_change":"2023-10-07T09:04:19.937359+0000","last_active":"2023-10-07T09:04:19.937359+0000","last_peered":"2023-10-07T09:04:19.937359+0000","last_clean":"2023-10-07T09:04:19.937359+0000","last_became_active":"2023-10-07T09:04:19.936994+0000","last_became_peered":"2023-10-07T09:04:19.936994+0000","last_unstale":"2023-10-07T09:04:19.937359+0000","last_undegraded":"2023-10-07T09:04:19.937359+0000","last_fullsized":"2023-10-07T09:04:19.937359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:29.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.203628+0000","last_change":"2023-10-07T09:04:19.202886+0000","last_active":"2023-10-07T09:04:19.203628+0000","last_peered":"2023-10-07T09:04:19.203628+0000","last_clean":"2023-10-07T09:04:19.203628+0000","last_became_active":"2023-10-07T09:04:19.202534+0000","last_became_peered":"2023-10-07T09:04:19.202534+0000","last_unstale":"2023-10-07T09:04:19.203628+0000","last_undegraded":"2023-10-07T09:04:19.203628+0000","last_fullsized":"2023-10-07T09:04:19.203628+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:55.506081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941730+0000","last_change":"2023-10-07T09:04:19.936885+0000","last_active":"2023-10-07T09:04:19.941730+0000","last_peered":"2023-10-07T09:04:19.941730+0000","last_clean":"2023-10-07T09:04:19.941730+0000","last_became_active":"2023-10-07T09:04:19.936172+0000","last_became_peered":"2023-10-07T09:04:19.936172+0000","last_unstale":"2023-10-07T09:04:19.941730+0000","last_undegraded":"2023-10-07T09:04:19.941730+0000","last_fullsized":"2023-10-07T09:04:19.941730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:32.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"89'3","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.219442+0000","last_change":"2023-10-07T09:04:19.208722+0000","last_active":"2023-10-07T09:04:20.219442+0000","last_peered":"2023-10-07T09:04:20.219442+0000","last_clean":"2023-10-07T09:04:20.219442+0000","last_became_active":"2023-10-07T09:04:19.207860+0000","last_became_peered":"2023-10-07T09:04:19.207860+0000","last_unstale":"2023-10-07T09:04:20.219442+0000","last_undegraded":"2023-10-07T09:04:20.219442+0000","last_fullsized":"2023-10-07T09:04:20.219442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:15.008958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931481+0000","last_change":"2023-10-07T09:04:19.931481+0000","last_active":"2023-10-07T09:04:19.931481+0000","last_peered":"2023-10-07T09:04:19.931481+0000","last_clean":"2023-10-07T09:04:19.931481+0000","last_became_active":"2023-10-07T09:04:19.931254+0000","last_became_peered":"2023-10-07T09:04:19.931254+0000","last_unstale":"2023-10-07T09:04:19.931481+0000","last_undegraded":"2023-10-07T09:04:19.931481+0000","last_fullsized":"2023-10-07T09:04:19.931481+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:44.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"89'6","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221265+0000","last_change":"2023-10-07T09:04:19.194055+0000","last_active":"2023-10-07T09:04:20.221265+0000","last_peered":"2023-10-07T09:04:20.221265+0000","last_clean":"2023-10-07T09:04:20.221265+0000","last_became_active":"2023-10-07T09:04:19.193803+0000","last_became_peered":"2023-10-07T09:04:19.193803+0000","last_unstale":"2023-10-07T09:04:20.221265+0000","last_undegraded":"2023-10-07T09:04:20.221265+0000","last_fullsized":"2023-10-07T09:04:20.221265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931469+0000","last_change":"2023-10-07T09:04:19.931469+0000","last_active":"2023-10-07T09:04:19.931469+0000","last_peered":"2023-10-07T09:04:19.931469+0000","last_clean":"2023-10-07T09:04:19.931469+0000","last_became_active":"2023-10-07T09:04:19.931264+0000","last_became_peered":"2023-10-07T09:04:19.931264+0000","last_unstale":"2023-10-07T09:04:19.931469+0000","last_undegraded":"2023-10-07T09:04:19.931469+0000","last_fullsized":"2023-10-07T09:04:19.931469+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:58.688044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218946+0000","last_change":"2023-10-07T09:04:19.198928+0000","last_active":"2023-10-07T09:04:20.218946+0000","last_peered":"2023-10-07T09:04:20.218946+0000","last_clean":"2023-10-07T09:04:20.218946+0000","last_became_active":"2023-10-07T09:04:19.198698+0000","last_became_peered":"2023-10-07T09:04:19.198698+0000","last_unstale":"2023-10-07T09:04:20.218946+0000","last_undegraded":"2023-10-07T09:04:20.218946+0000","last_fullsized":"2023-10-07T09:04:20.218946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:31.636808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.926625+0000","last_change":"2023-10-07T09:04:19.926625+0000","last_active":"2023-10-07T09:04:19.926625+0000","last_peered":"2023-10-07T09:04:19.926625+0000","last_clean":"2023-10-07T09:04:19.926625+0000","last_became_active":"2023-10-07T09:04:19.926370+0000","last_became_peered":"2023-10-07T09:04:19.926370+0000","last_unstale":"2023-10-07T09:04:19.926625+0000","last_undegraded":"2023-10-07T09:04:19.926625+0000","last_fullsized":"2023-10-07T09:04:19.926625+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:26.001545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.209226+0000","last_change":"2023-10-07T09:04:19.205654+0000","last_active":"2023-10-07T09:04:19.209226+0000","last_peered":"2023-10-07T09:04:19.209226+0000","last_clean":"2023-10-07T09:04:19.209226+0000","last_became_active":"2023-10-07T09:04:19.205389+0000","last_became_peered":"2023-10-07T09:04:19.205389+0000","last_unstale":"2023-10-07T09:04:19.209226+0000","last_undegraded":"2023-10-07T09:04:19.209226+0000","last_fullsized":"2023-10-07T09:04:19.209226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:11.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.932631+0000","last_change":"2023-10-07T09:04:19.932631+0000","last_active":"2023-10-07T09:04:19.932631+0000","last_peered":"2023-10-07T09:04:19.932631+0000","last_clean":"2023-10-07T09:04:19.932631+0000","last_became_active":"2023-10-07T09:04:19.932295+0000","last_became_peered":"2023-10-07T09:04:19.932295+0000","last_unstale":"2023-10-07T09:04:19.932631+0000","last_undegraded":"2023-10-07T09:04:19.932631+0000","last_fullsized":"2023-10-07T09:04:19.932631+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:21.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.204214+0000","last_change":"2023-10-07T09:04:19.199423+0000","last_active":"2023-10-07T09:04:19.204214+0000","last_peered":"2023-10-07T09:04:19.204214+0000","last_clean":"2023-10-07T09:04:19.204214+0000","last_became_active":"2023-10-07T09:04:19.199109+0000","last_became_peered":"2023-10-07T09:04:19.199109+0000","last_unstale":"2023-10-07T09:04:19.204214+0000","last_undegraded":"2023-10-07T09:04:19.204214+0000","last_fullsized":"2023-10-07T09:04:19.204214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:50:44.439137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934513+0000","last_change":"2023-10-07T09:04:19.934513+0000","last_active":"2023-10-07T09:04:19.934513+0000","last_peered":"2023-10-07T09:04:19.934513+0000","last_clean":"2023-10-07T09:04:19.934513+0000","last_became_active":"2023-10-07T09:04:19.934269+0000","last_became_peered":"2023-10-07T09:04:19.934269+0000","last_unstale":"2023-10-07T09:04:19.934513+0000","last_undegraded":"2023-10-07T09:04:19.934513+0000","last_fullsized":"2023-10-07T09:04:19.934513+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:04:21.896033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"89'8","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221475+0000","last_change":"2023-10-07T09:04:19.204091+0000","last_active":"2023-10-07T09:04:20.221475+0000","last_peered":"2023-10-07T09:04:20.221475+0000","last_clean":"2023-10-07T09:04:20.221475+0000","last_became_active":"2023-10-07T09:04:19.203774+0000","last_became_peered":"2023-10-07T09:04:19.203774+0000","last_unstale":"2023-10-07T09:04:20.221475+0000","last_undegraded":"2023-10-07T09:04:20.221475+0000","last_fullsized":"2023-10-07T09:04:20.221475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:38.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.944156+0000","last_change":"2023-10-07T09:04:19.939163+0000","last_active":"2023-10-07T09:04:19.944156+0000","last_peered":"2023-10-07T09:04:19.944156+0000","last_clean":"2023-10-07T09:04:19.944156+0000","last_became_active":"2023-10-07T09:04:19.938896+0000","last_became_peered":"2023-10-07T09:04:19.938896+0000","last_unstale":"2023-10-07T09:04:19.944156+0000","last_undegraded":"2023-10-07T09:04:19.944156+0000","last_fullsized":"2023-10-07T09:04:19.944156+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:17.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.217744+0000","last_change":"2023-10-07T09:04:19.199995+0000","last_active":"2023-10-07T09:04:20.217744+0000","last_peered":"2023-10-07T09:04:20.217744+0000","last_clean":"2023-10-07T09:04:20.217744+0000","last_became_active":"2023-10-07T09:04:19.199718+0000","last_became_peered":"2023-10-07T09:04:19.199718+0000","last_unstale":"2023-10-07T09:04:20.217744+0000","last_undegraded":"2023-10-07T09:04:20.217744+0000","last_fullsized":"2023-10-07T09:04:20.217744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:43.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937848+0000","last_change":"2023-10-07T09:04:19.937848+0000","last_active":"2023-10-07T09:04:19.937848+0000","last_peered":"2023-10-07T09:04:19.937848+0000","last_clean":"2023-10-07T09:04:19.937848+0000","last_became_active":"2023-10-07T09:04:19.937604+0000","last_became_peered":"2023-10-07T09:04:19.937604+0000","last_unstale":"2023-10-07T09:04:19.937848+0000","last_undegraded":"2023-10-07T09:04:19.937848+0000","last_fullsized":"2023-10-07T09:04:19.937848+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:29.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218944+0000","last_change":"2023-10-07T09:04:19.198190+0000","last_active":"2023-10-07T09:04:20.218944+0000","last_peered":"2023-10-07T09:04:20.218944+0000","last_clean":"2023-10-07T09:04:20.218944+0000","last_became_active":"2023-10-07T09:04:19.197939+0000","last_became_peered":"2023-10-07T09:04:19.197939+0000","last_unstale":"2023-10-07T09:04:20.218944+0000","last_undegraded":"2023-10-07T09:04:20.218944+0000","last_fullsized":"2023-10-07T09:04:20.218944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:13.596032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938118+0000","last_change":"2023-10-07T09:04:19.938118+0000","last_active":"2023-10-07T09:04:19.938118+0000","last_peered":"2023-10-07T09:04:19.938118+0000","last_clean":"2023-10-07T09:04:19.938118+0000","last_became_active":"2023-10-07T09:04:19.937835+0000","last_became_peered":"2023-10-07T09:04:19.937835+0000","last_unstale":"2023-10-07T09:04:19.938118+0000","last_undegraded":"2023-10-07T09:04:19.938118+0000","last_fullsized":"2023-10-07T09:04:19.938118+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:04:16.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202913+0000","last_change":"2023-10-07T09:04:19.200479+0000","last_active":"2023-10-07T09:04:19.202913+0000","last_peered":"2023-10-07T09:04:19.202913+0000","last_clean":"2023-10-07T09:04:19.202913+0000","last_became_active":"2023-10-07T09:04:19.200202+0000","last_became_peered":"2023-10-07T09:04:19.200202+0000","last_unstale":"2023-10-07T09:04:19.202913+0000","last_undegraded":"2023-10-07T09:04:19.202913+0000","last_fullsized":"2023-10-07T09:04:19.202913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:31.291510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931264+0000","last_change":"2023-10-07T09:04:19.931264+0000","last_active":"2023-10-07T09:04:19.931264+0000","last_peered":"2023-10-07T09:04:19.931264+0000","last_clean":"2023-10-07T09:04:19.931264+0000","last_became_active":"2023-10-07T09:04:19.931019+0000","last_became_peered":"2023-10-07T09:04:19.931019+0000","last_unstale":"2023-10-07T09:04:19.931264+0000","last_undegraded":"2023-10-07T09:04:19.931264+0000","last_fullsized":"2023-10-07T09:04:19.931264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.944643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.215849+0000","last_change":"2023-10-07T09:04:19.206991+0000","last_active":"2023-10-07T09:04:20.215849+0000","last_peered":"2023-10-07T09:04:20.215849+0000","last_clean":"2023-10-07T09:04:20.215849+0000","last_became_active":"2023-10-07T09:04:19.204587+0000","last_became_peered":"2023-10-07T09:04:19.204587+0000","last_unstale":"2023-10-07T09:04:20.215849+0000","last_undegraded":"2023-10-07T09:04:20.215849+0000","last_fullsized":"2023-10-07T09:04:20.215849+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:15.975305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929749+0000","last_change":"2023-10-07T09:04:19.929749+0000","last_active":"2023-10-07T09:04:19.929749+0000","last_peered":"2023-10-07T09:04:19.929749+0000","last_clean":"2023-10-07T09:04:19.929749+0000","last_became_active":"2023-10-07T09:04:19.929307+0000","last_became_peered":"2023-10-07T09:04:19.929307+0000","last_unstale":"2023-10-07T09:04:19.929749+0000","last_undegraded":"2023-10-07T09:04:19.929749+0000","last_fullsized":"2023-10-07T09:04:19.929749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208481+0000","last_change":"2023-10-07T09:04:19.206932+0000","last_active":"2023-10-07T09:04:19.208481+0000","last_peered":"2023-10-07T09:04:19.208481+0000","last_clean":"2023-10-07T09:04:19.208481+0000","last_became_active":"2023-10-07T09:04:19.206589+0000","last_became_peered":"2023-10-07T09:04:19.206589+0000","last_unstale":"2023-10-07T09:04:19.208481+0000","last_undegraded":"2023-10-07T09:04:19.208481+0000","last_fullsized":"2023-10-07T09:04:19.208481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:33.265921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929336+0000","last_change":"2023-10-07T09:04:19.929336+0000","last_active":"2023-10-07T09:04:19.929336+0000","last_peered":"2023-10-07T09:04:19.929336+0000","last_clean":"2023-10-07T09:04:19.929336+0000","last_became_active":"2023-10-07T09:04:19.929056+0000","last_became_peered":"2023-10-07T09:04:19.929056+0000","last_unstale":"2023-10-07T09:04:19.929336+0000","last_undegraded":"2023-10-07T09:04:19.929336+0000","last_fullsized":"2023-10-07T09:04:19.929336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:22:34.587155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.206637+0000","last_change":"2023-10-07T09:04:19.199380+0000","last_active":"2023-10-07T09:04:19.206637+0000","last_peered":"2023-10-07T09:04:19.206637+0000","last_clean":"2023-10-07T09:04:19.206637+0000","last_became_active":"2023-10-07T09:04:19.199064+0000","last_became_peered":"2023-10-07T09:04:19.199064+0000","last_unstale":"2023-10-07T09:04:19.206637+0000","last_undegraded":"2023-10-07T09:04:19.206637+0000","last_fullsized":"2023-10-07T09:04:19.206637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:13.596032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941691+0000","last_change":"2023-10-07T09:04:19.935772+0000","last_active":"2023-10-07T09:04:19.941691+0000","last_peered":"2023-10-07T09:04:19.941691+0000","last_clean":"2023-10-07T09:04:19.941691+0000","last_became_active":"2023-10-07T09:04:19.935489+0000","last_became_peered":"2023-10-07T09:04:19.935489+0000","last_unstale":"2023-10-07T09:04:19.941691+0000","last_undegraded":"2023-10-07T09:04:19.941691+0000","last_fullsized":"2023-10-07T09:04:19.941691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:21.315921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.209859+0000","last_change":"2023-10-07T09:04:19.209013+0000","last_active":"2023-10-07T09:04:19.209859+0000","last_peered":"2023-10-07T09:04:19.209859+0000","last_clean":"2023-10-07T09:04:19.209859+0000","last_became_active":"2023-10-07T09:04:19.208685+0000","last_became_peered":"2023-10-07T09:04:19.208685+0000","last_unstale":"2023-10-07T09:04:19.209859+0000","last_undegraded":"2023-10-07T09:04:19.209859+0000","last_fullsized":"2023-10-07T09:04:19.209859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:20.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929045+0000","last_change":"2023-10-07T09:04:19.929045+0000","last_active":"2023-10-07T09:04:19.929045+0000","last_peered":"2023-10-07T09:04:19.929045+0000","last_clean":"2023-10-07T09:04:19.929045+0000","last_became_active":"2023-10-07T09:04:19.928627+0000","last_became_peered":"2023-10-07T09:04:19.928627+0000","last_unstale":"2023-10-07T09:04:19.929045+0000","last_undegraded":"2023-10-07T09:04:19.929045+0000","last_fullsized":"2023-10-07T09:04:19.929045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:59.215494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.219001+0000","last_change":"2023-10-07T09:04:19.202203+0000","last_active":"2023-10-07T09:04:20.219001+0000","last_peered":"2023-10-07T09:04:20.219001+0000","last_clean":"2023-10-07T09:04:20.219001+0000","last_became_active":"2023-10-07T09:04:19.201910+0000","last_became_peered":"2023-10-07T09:04:19.201910+0000","last_unstale":"2023-10-07T09:04:20.219001+0000","last_undegraded":"2023-10-07T09:04:20.219001+0000","last_fullsized":"2023-10-07T09:04:20.219001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:59.717963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923922+0000","last_change":"2023-10-07T09:04:19.923922+0000","last_active":"2023-10-07T09:04:19.923922+0000","last_peered":"2023-10-07T09:04:19.923922+0000","last_clean":"2023-10-07T09:04:19.923922+0000","last_became_active":"2023-10-07T09:04:19.923675+0000","last_became_peered":"2023-10-07T09:04:19.923675+0000","last_unstale":"2023-10-07T09:04:19.923922+0000","last_undegraded":"2023-10-07T09:04:19.923922+0000","last_fullsized":"2023-10-07T09:04:19.923922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:52.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208742+0000","last_change":"2023-10-07T09:04:19.207722+0000","last_active":"2023-10-07T09:04:19.208742+0000","last_peered":"2023-10-07T09:04:19.208742+0000","last_clean":"2023-10-07T09:04:19.208742+0000","last_became_active":"2023-10-07T09:04:19.207415+0000","last_became_peered":"2023-10-07T09:04:19.207415+0000","last_unstale":"2023-10-07T09:04:19.208742+0000","last_undegraded":"2023-10-07T09:04:19.208742+0000","last_fullsized":"2023-10-07T09:04:19.208742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:55.506081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938045+0000","last_change":"2023-10-07T09:04:19.938045+0000","last_active":"2023-10-07T09:04:19.938045+0000","last_peered":"2023-10-07T09:04:19.938045+0000","last_clean":"2023-10-07T09:04:19.938045+0000","last_became_active":"2023-10-07T09:04:19.937416+0000","last_became_peered":"2023-10-07T09:04:19.937416+0000","last_unstale":"2023-10-07T09:04:19.938045+0000","last_undegraded":"2023-10-07T09:04:19.938045+0000","last_fullsized":"2023-10-07T09:04:19.938045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:00.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202886+0000","last_change":"2023-10-07T09:04:19.200539+0000","last_active":"2023-10-07T09:04:19.202886+0000","last_peered":"2023-10-07T09:04:19.202886+0000","last_clean":"2023-10-07T09:04:19.202886+0000","last_became_active":"2023-10-07T09:04:19.200186+0000","last_became_peered":"2023-10-07T09:04:19.200186+0000","last_unstale":"2023-10-07T09:04:19.202886+0000","last_undegraded":"2023-10-07T09:04:19.202886+0000","last_fullsized":"2023-10-07T09:04:19.202886+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:05.277979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941386+0000","last_change":"2023-10-07T09:04:19.935547+0000","last_active":"2023-10-07T09:04:19.941386+0000","last_peered":"2023-10-07T09:04:19.941386+0000","last_clean":"2023-10-07T09:04:19.941386+0000","last_became_active":"2023-10-07T09:04:19.935252+0000","last_became_peered":"2023-10-07T09:04:19.935252+0000","last_unstale":"2023-10-07T09:04:19.941386+0000","last_undegraded":"2023-10-07T09:04:19.941386+0000","last_fullsized":"2023-10-07T09:04:19.941386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:04:09.672328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929156+0000","last_change":"2023-10-07T09:04:19.202215+0000","last_active":"2023-10-07T09:04:19.929156+0000","last_peered":"2023-10-07T09:04:19.929156+0000","last_clean":"2023-10-07T09:04:19.929156+0000","last_became_active":"2023-10-07T09:04:19.201955+0000","last_became_peered":"2023-10-07T09:04:19.201955+0000","last_unstale":"2023-10-07T09:04:19.929156+0000","last_undegraded":"2023-10-07T09:04:19.929156+0000","last_fullsized":"2023-10-07T09:04:19.929156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:33.265921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938220+0000","last_change":"2023-10-07T09:04:19.938220+0000","last_active":"2023-10-07T09:04:19.938220+0000","last_peered":"2023-10-07T09:04:19.938220+0000","last_clean":"2023-10-07T09:04:19.938220+0000","last_became_active":"2023-10-07T09:04:19.937978+0000","last_became_peered":"2023-10-07T09:04:19.937978+0000","last_unstale":"2023-10-07T09:04:19.938220+0000","last_undegraded":"2023-10-07T09:04:19.938220+0000","last_fullsized":"2023-10-07T09:04:19.938220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:28.576750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.203300+0000","last_change":"2023-10-07T09:04:19.199920+0000","last_active":"2023-10-07T09:04:19.203300+0000","last_peered":"2023-10-07T09:04:19.203300+0000","last_clean":"2023-10-07T09:04:19.203300+0000","last_became_active":"2023-10-07T09:04:19.199589+0000","last_became_peered":"2023-10-07T09:04:19.199589+0000","last_unstale":"2023-10-07T09:04:19.203300+0000","last_undegraded":"2023-10-07T09:04:19.203300+0000","last_fullsized":"2023-10-07T09:04:19.203300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:04:08.668462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937958+0000","last_change":"2023-10-07T09:04:19.937958+0000","last_active":"2023-10-07T09:04:19.937958+0000","last_peered":"2023-10-07T09:04:19.937958+0000","last_clean":"2023-10-07T09:04:19.937958+0000","last_became_active":"2023-10-07T09:04:19.937702+0000","last_became_peered":"2023-10-07T09:04:19.937702+0000","last_unstale":"2023-10-07T09:04:19.937958+0000","last_undegraded":"2023-10-07T09:04:19.937958+0000","last_fullsized":"2023-10-07T09:04:19.937958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:52.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928014+0000","last_change":"2023-10-07T09:04:19.204778+0000","last_active":"2023-10-07T09:04:19.928014+0000","last_peered":"2023-10-07T09:04:19.928014+0000","last_clean":"2023-10-07T09:04:19.928014+0000","last_became_active":"2023-10-07T09:04:19.204566+0000","last_became_peered":"2023-10-07T09:04:19.204566+0000","last_unstale":"2023-10-07T09:04:19.928014+0000","last_undegraded":"2023-10-07T09:04:19.928014+0000","last_fullsized":"2023-10-07T09:04:19.928014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:51.150546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934333+0000","last_change":"2023-10-07T09:04:19.934333+0000","last_active":"2023-10-07T09:04:19.934333+0000","last_peered":"2023-10-07T09:04:19.934333+0000","last_clean":"2023-10-07T09:04:19.934333+0000","last_became_active":"2023-10-07T09:04:19.934077+0000","last_became_peered":"2023-10-07T09:04:19.934077+0000","last_unstale":"2023-10-07T09:04:19.934333+0000","last_undegraded":"2023-10-07T09:04:19.934333+0000","last_fullsized":"2023-10-07T09:04:19.934333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:11.778168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.198662+0000","last_change":"2023-10-07T09:04:19.197810+0000","last_active":"2023-10-07T09:04:19.198662+0000","last_peered":"2023-10-07T09:04:19.198662+0000","last_clean":"2023-10-07T09:04:19.198662+0000","last_became_active":"2023-10-07T09:04:19.197526+0000","last_became_peered":"2023-10-07T09:04:19.197526+0000","last_unstale":"2023-10-07T09:04:19.198662+0000","last_undegraded":"2023-10-07T09:04:19.198662+0000","last_fullsized":"2023-10-07T09:04:19.198662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:15.975305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939714+0000","last_change":"2023-10-07T09:04:19.931739+0000","last_active":"2023-10-07T09:04:19.939714+0000","last_peered":"2023-10-07T09:04:19.939714+0000","last_clean":"2023-10-07T09:04:19.939714+0000","last_became_active":"2023-10-07T09:04:19.931473+0000","last_became_peered":"2023-10-07T09:04:19.931473+0000","last_unstale":"2023-10-07T09:04:19.939714+0000","last_undegraded":"2023-10-07T09:04:19.939714+0000","last_fullsized":"2023-10-07T09:04:19.939714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:41.104114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208446+0000","last_change":"2023-10-07T09:04:19.201971+0000","last_active":"2023-10-07T09:04:19.208446+0000","last_peered":"2023-10-07T09:04:19.208446+0000","last_clean":"2023-10-07T09:04:19.208446+0000","last_became_active":"2023-10-07T09:04:19.201000+0000","last_became_peered":"2023-10-07T09:04:19.201000+0000","last_unstale":"2023-10-07T09:04:19.208446+0000","last_undegraded":"2023-10-07T09:04:19.208446+0000","last_fullsized":"2023-10-07T09:04:19.208446+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:08.653728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.932155+0000","last_change":"2023-10-07T09:04:19.932155+0000","last_active":"2023-10-07T09:04:19.932155+0000","last_peered":"2023-10-07T09:04:19.932155+0000","last_clean":"2023-10-07T09:04:19.932155+0000","last_became_active":"2023-10-07T09:04:19.931872+0000","last_became_peered":"2023-10-07T09:04:19.931872+0000","last_unstale":"2023-10-07T09:04:19.932155+0000","last_undegraded":"2023-10-07T09:04:19.932155+0000","last_fullsized":"2023-10-07T09:04:19.932155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:29:59.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.919508+0000","last_change":"2023-10-07T09:04:19.207557+0000","last_active":"2023-10-07T09:04:19.919508+0000","last_peered":"2023-10-07T09:04:19.919508+0000","last_clean":"2023-10-07T09:04:19.919508+0000","last_became_active":"2023-10-07T09:04:19.207342+0000","last_became_peered":"2023-10-07T09:04:19.207342+0000","last_unstale":"2023-10-07T09:04:19.919508+0000","last_undegraded":"2023-10-07T09:04:19.919508+0000","last_fullsized":"2023-10-07T09:04:19.919508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:38.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202529+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:04:19.202529+0000","last_peered":"2023-10-07T09:04:19.202529+0000","last_clean":"2023-10-07T09:04:19.202529+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:04:19.202529+0000","last_undegraded":"2023-10-07T09:04:19.202529+0000","last_fullsized":"2023-10-07T09:04:19.202529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":1063434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.437},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.623}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47099999999999997,"5min":0.63,"15min":0.63},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35199999999999998,"15min":0.41399999999999998},"min":{"1min":0.223,"5min":0.221,"15min":0.221},"max":{"1min":0.49299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.39700000000000002},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.496,"15min":0.82799999999999996},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":11.32,"15min":11.32},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.504,"15min":0.85499999999999998},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.497},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.82699999999999996},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90000000000000002,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.84699999999999998},"min":{"1min":0.504,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89500000000000002,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64600000000000002,"15min":0.77700000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303044,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068796,"statfs":{"total":96636764160,"available":96326447104,"internally_reserved":0,"allocated":1699840,"data_stored":1063876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.191,"15min":0.191},"max":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36299999999999999,"15min":0.38800000000000001},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53400000000000003,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.22,"15min":0.22},"max":{"1min":0.48099999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.434}]},{"osd":4,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.625},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76600000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.754,"5min":1,"15min":1},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":1.006,"15min":1.006},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61599999999999999,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.748,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.41199999999999998,"15min":0.64900000000000002},"min":{"1min":0.23100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47999999999999998,"5min":10.214,"15min":10.214},"last":0.246},{"interface":"front","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.53600000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.755,"15min":0.755},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.47699999999999998,"15min":0.70799999999999996},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":10.144,"15min":10.144},"last":0.313}]},{"osd":3,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.496,"15min":0.77100000000000002},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59199999999999997,"5min":10.071,"15min":10.071},"last":0.378},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.51600000000000001,"15min":0.78500000000000003},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":10.183,"15min":10.183},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.76500000000000001,"15min":1.2450000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78800000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.81499999999999995,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.745,"5min":1.125,"15min":1.125},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":474512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.53300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.47799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59699999999999998,"15min":0.88300000000000001},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72299999999999998,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.60099999999999998,"15min":0.75700000000000001},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73199999999999998,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.64800000000000002,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.497}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.93899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.67500000000000004,"15min":0.97299999999999998},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":10.01,"15min":10.01},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58199999999999996,"15min":0.75},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":5.569,"15min":5.569},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65000000000000002,"15min":0.93799999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66700000000000004,"5min":10.131,"15min":10.131},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48399999999999999,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64200000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.32000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":1.127},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":9.7799999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.47999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":6.3970000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.46800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":6.5650000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.478},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":0.879},"last":1.234}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.503},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":2.1400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":3.9470000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:04:24.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:04:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.472+0000 7f7773651700 1 Processor -- start 2023-10-07T09:04:24.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.472+0000 7f7773651700 1 -- start start 2023-10-07T09:04:24.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7773651700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f776c159840 0x7f776c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7773651700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 0x7f776c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7773651700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c0cfb30 con 0x7f776c159c10 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7773651700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c0cbf10 con 0x7f776c159840 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7773651700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0cf4e0 con 0x7f776c0cba70 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f77713ed700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f776c159840 0x7f776c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7771bee700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f776c159c10 0x7f776c0ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32858/0 (socket says 172.21.15.46:32858) 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.473+0000 7f7771bee700 1 -- 172.21.15.46:0/16649533 learned_addr learned my addr 172.21.15.46:0/16649533 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7770bec700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 0x7f776c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f77713ed700 1 -- 172.21.15.46:0/16649533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 msgr2=0x7f776c0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f77713ed700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 0x7f776c0694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f77713ed700 1 -- 172.21.15.46:0/16649533 >> v1:172.21.15.46:6789/0 conn(0x7f776c159c10 legacy=0x7f776c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f776bfff700 1 -- 172.21.15.46:0/16649533 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205977958 0 0) 0x7f776c0cfb30 con 0x7f776c159c10 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f77713ed700 1 -- 172.21.15.46:0/16649533 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0cf7c0 con 0x7f776c159840 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7770bec700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 0x7f776c0694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f77713ed700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c159840 0x7f776c0cb530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f77640098e0 tx=0x7f77640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dccea5d993698f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f776bfff700 1 -- 172.21.15.46:0/16649533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764009e80 con 0x7f776c159840 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f776bfff700 1 -- 172.21.15.46:0/16649533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400b860 con 0x7f776c159840 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f776bfff700 1 -- 172.21.15.46:0/16649533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400bbe0 con 0x7f776c159840 2023-10-07T09:04:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7773651700 1 -- 172.21.15.46:0/16649533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c159840 msgr2=0x7f776c0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7773651700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c159840 0x7f776c0cb530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f77640098e0 tx=0x7f77640091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7773651700 1 -- 172.21.15.46:0/16649533 shutdown_connections 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7773651700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c159840 0x7f776c0cb530 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.474+0000 7f7773651700 1 --2- 172.21.15.46:0/16649533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c0cba70 0x7f776c0694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.475+0000 7f7773651700 1 -- 172.21.15.46:0/16649533 >> 172.21.15.46:0/16649533 conn(0x7f776c068e10 msgr2=0x7f776c0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.475+0000 7f7773651700 1 -- 172.21.15.46:0/16649533 shutdown_connections 2023-10-07T09:04:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.475+0000 7f7773651700 1 -- 172.21.15.46:0/16649533 wait complete. 2023-10-07T09:04:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.476+0000 7f7773651700 1 Processor -- start 2023-10-07T09:04:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.476+0000 7f7773651700 1 -- start start 2023-10-07T09:04:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c159840 0x7f776c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f776c159c10 0x7f776c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0c7810 con 0x7f776c0cba70 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0c80b0 con 0x7f776c159c10 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c153430 con 0x7f776c159840 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52778/0 (socket says 172.21.15.46:52778) 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 -- 172.21.15.46:0/1984259115 learned_addr learned my addr 172.21.15.46:0/1984259115 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 -- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c159840 msgr2=0x7f776c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c159840 0x7f776c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 -- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f776c159c10 msgr2=0x7f776c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f776c159c10 0x7f776c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 -- 172.21.15.46:0/1984259115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009420 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77713ed700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7764009f00 tx=0x7f7764017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764011420 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640115c0 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764011980 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c16a5a0 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.477+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c0c7d40 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.478+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c064550 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.479+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7764011d30 con 0x7f776c0cba70 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.479+0000 7f77697fa700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 0x7f77580696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.479+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77640863c0 con 0x7f776c0cba70 2023-10-07T09:04:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.479+0000 7f7770bec700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 0x7f77580696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.480+0000 7f7770bec700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 0x7f77580696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f776c0cf490 tx=0x7f7760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.483+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77640532e0 con 0x7f776c0cba70 2023-10-07T09:04:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.673+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f776c04c3c0 con 0x7f7758067200 2023-10-07T09:04:24.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.681+0000 7f77697fa700 1 -- 172.21.15.46:0/1984259115 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289246 (secure 0 0 0) 0x7f776c04c3c0 con 0x7f7758067200 2023-10-07T09:04:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:24.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.684+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 msgr2=0x7f77580696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.684+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 0x7f77580696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f776c0cf490 tx=0x7f7760008040 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.684+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 msgr2=0x7f776c152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.684+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7764009f00 tx=0x7f7764017000 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 shutdown_connections 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7758067200 0x7f77580696b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f776c159c10 0x7f776c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0cba70 0x7f776c152ef0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 --2- 172.21.15.46:0/1984259115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f776c159840 0x7f776c154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 >> 172.21.15.46:0/1984259115 conn(0x7f776c068e10 msgr2=0x7f776c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 shutdown_connections 2023-10-07T09:04:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.685+0000 7f7773651700 1 -- 172.21.15.46:0/1984259115 wait complete. 2023-10-07T09:04:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:04:24.697 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-07T09:04:23.847738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408588,"kb_used_data":9804,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566132,"statfs":{"total":773094113280,"available":770627719168,"internally_reserved":0,"allocated":10039296,"data_stored":4966696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663701"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.927957+0000","last_change":"2023-10-07T09:04:19.927957+0000","last_active":"2023-10-07T09:04:19.927957+0000","last_peered":"2023-10-07T09:04:19.927957+0000","last_clean":"2023-10-07T09:04:19.927957+0000","last_became_active":"2023-10-07T09:04:19.927688+0000","last_became_peered":"2023-10-07T09:04:19.927688+0000","last_unstale":"2023-10-07T09:04:19.927957+0000","last_undegraded":"2023-10-07T09:04:19.927957+0000","last_fullsized":"2023-10-07T09:04:19.927957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:42:09.437195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928890+0000","last_change":"2023-10-07T09:04:19.928890+0000","last_active":"2023-10-07T09:04:19.928890+0000","last_peered":"2023-10-07T09:04:19.928890+0000","last_clean":"2023-10-07T09:04:19.928890+0000","last_became_active":"2023-10-07T09:04:19.928273+0000","last_became_peered":"2023-10-07T09:04:19.928273+0000","last_unstale":"2023-10-07T09:04:19.928890+0000","last_undegraded":"2023-10-07T09:04:19.928890+0000","last_fullsized":"2023-10-07T09:04:19.928890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:56.106038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928338+0000","last_change":"2023-10-07T09:04:19.928338+0000","last_active":"2023-10-07T09:04:19.928338+0000","last_peered":"2023-10-07T09:04:19.928338+0000","last_clean":"2023-10-07T09:04:19.928338+0000","last_became_active":"2023-10-07T09:04:19.928102+0000","last_became_peered":"2023-10-07T09:04:19.928102+0000","last_unstale":"2023-10-07T09:04:19.928338+0000","last_undegraded":"2023-10-07T09:04:19.928338+0000","last_fullsized":"2023-10-07T09:04:19.928338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:57.644340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.930502+0000","last_change":"2023-10-07T09:04:19.930502+0000","last_active":"2023-10-07T09:04:19.930502+0000","last_peered":"2023-10-07T09:04:19.930502+0000","last_clean":"2023-10-07T09:04:19.930502+0000","last_became_active":"2023-10-07T09:04:19.929721+0000","last_became_peered":"2023-10-07T09:04:19.929721+0000","last_unstale":"2023-10-07T09:04:19.930502+0000","last_undegraded":"2023-10-07T09:04:19.930502+0000","last_fullsized":"2023-10-07T09:04:19.930502+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:44.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939513+0000","last_change":"2023-10-07T09:04:19.930326+0000","last_active":"2023-10-07T09:04:19.939513+0000","last_peered":"2023-10-07T09:04:19.939513+0000","last_clean":"2023-10-07T09:04:19.939513+0000","last_became_active":"2023-10-07T09:04:19.930039+0000","last_became_peered":"2023-10-07T09:04:19.930039+0000","last_unstale":"2023-10-07T09:04:19.939513+0000","last_undegraded":"2023-10-07T09:04:19.939513+0000","last_fullsized":"2023-10-07T09:04:19.939513+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:16.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928219+0000","last_change":"2023-10-07T09:04:19.928219+0000","last_active":"2023-10-07T09:04:19.928219+0000","last_peered":"2023-10-07T09:04:19.928219+0000","last_clean":"2023-10-07T09:04:19.928219+0000","last_became_active":"2023-10-07T09:04:19.927881+0000","last_became_peered":"2023-10-07T09:04:19.927881+0000","last_unstale":"2023-10-07T09:04:19.928219+0000","last_undegraded":"2023-10-07T09:04:19.928219+0000","last_fullsized":"2023-10-07T09:04:19.928219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:32.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928122+0000","last_change":"2023-10-07T09:04:19.928122+0000","last_active":"2023-10-07T09:04:19.928122+0000","last_peered":"2023-10-07T09:04:19.928122+0000","last_clean":"2023-10-07T09:04:19.928122+0000","last_became_active":"2023-10-07T09:04:19.927849+0000","last_became_peered":"2023-10-07T09:04:19.927849+0000","last_unstale":"2023-10-07T09:04:19.928122+0000","last_undegraded":"2023-10-07T09:04:19.928122+0000","last_fullsized":"2023-10-07T09:04:19.928122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:00.015338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931623+0000","last_change":"2023-10-07T09:04:19.931623+0000","last_active":"2023-10-07T09:04:19.931623+0000","last_peered":"2023-10-07T09:04:19.931623+0000","last_clean":"2023-10-07T09:04:19.931623+0000","last_became_active":"2023-10-07T09:04:19.931353+0000","last_became_peered":"2023-10-07T09:04:19.931353+0000","last_unstale":"2023-10-07T09:04:19.931623+0000","last_undegraded":"2023-10-07T09:04:19.931623+0000","last_fullsized":"2023-10-07T09:04:19.931623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:03.466825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938015+0000","last_change":"2023-10-07T09:04:19.938015+0000","last_active":"2023-10-07T09:04:19.938015+0000","last_peered":"2023-10-07T09:04:19.938015+0000","last_clean":"2023-10-07T09:04:19.938015+0000","last_became_active":"2023-10-07T09:04:19.937778+0000","last_became_peered":"2023-10-07T09:04:19.937778+0000","last_unstale":"2023-10-07T09:04:19.938015+0000","last_undegraded":"2023-10-07T09:04:19.938015+0000","last_fullsized":"2023-10-07T09:04:19.938015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:14.307189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941602+0000","last_change":"2023-10-07T09:04:19.935702+0000","last_active":"2023-10-07T09:04:19.941602+0000","last_peered":"2023-10-07T09:04:19.941602+0000","last_clean":"2023-10-07T09:04:19.941602+0000","last_became_active":"2023-10-07T09:04:19.935359+0000","last_became_peered":"2023-10-07T09:04:19.935359+0000","last_unstale":"2023-10-07T09:04:19.941602+0000","last_undegraded":"2023-10-07T09:04:19.941602+0000","last_fullsized":"2023-10-07T09:04:19.941602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:59.294962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938242+0000","last_change":"2023-10-07T09:04:19.938242+0000","last_active":"2023-10-07T09:04:19.938242+0000","last_peered":"2023-10-07T09:04:19.938242+0000","last_clean":"2023-10-07T09:04:19.938242+0000","last_became_active":"2023-10-07T09:04:19.937944+0000","last_became_peered":"2023-10-07T09:04:19.937944+0000","last_unstale":"2023-10-07T09:04:19.938242+0000","last_undegraded":"2023-10-07T09:04:19.938242+0000","last_fullsized":"2023-10-07T09:04:19.938242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:38.476566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937396+0000","last_change":"2023-10-07T09:04:19.937396+0000","last_active":"2023-10-07T09:04:19.937396+0000","last_peered":"2023-10-07T09:04:19.937396+0000","last_clean":"2023-10-07T09:04:19.937396+0000","last_became_active":"2023-10-07T09:04:19.937033+0000","last_became_peered":"2023-10-07T09:04:19.937033+0000","last_unstale":"2023-10-07T09:04:19.937396+0000","last_undegraded":"2023-10-07T09:04:19.937396+0000","last_fullsized":"2023-10-07T09:04:19.937396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:32.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933707+0000","last_change":"2023-10-07T09:04:19.933707+0000","last_active":"2023-10-07T09:04:19.933707+0000","last_peered":"2023-10-07T09:04:19.933707+0000","last_clean":"2023-10-07T09:04:19.933707+0000","last_became_active":"2023-10-07T09:04:19.933421+0000","last_became_peered":"2023-10-07T09:04:19.933421+0000","last_unstale":"2023-10-07T09:04:19.933707+0000","last_undegraded":"2023-10-07T09:04:19.933707+0000","last_fullsized":"2023-10-07T09:04:19.933707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:23.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937099+0000","last_change":"2023-10-07T09:04:19.937099+0000","last_active":"2023-10-07T09:04:19.937099+0000","last_peered":"2023-10-07T09:04:19.937099+0000","last_clean":"2023-10-07T09:04:19.937099+0000","last_became_active":"2023-10-07T09:04:19.936858+0000","last_became_peered":"2023-10-07T09:04:19.936858+0000","last_unstale":"2023-10-07T09:04:19.937099+0000","last_undegraded":"2023-10-07T09:04:19.937099+0000","last_fullsized":"2023-10-07T09:04:19.937099+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:44.451010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931617+0000","last_change":"2023-10-07T09:04:19.931617+0000","last_active":"2023-10-07T09:04:19.931617+0000","last_peered":"2023-10-07T09:04:19.931617+0000","last_clean":"2023-10-07T09:04:19.931617+0000","last_became_active":"2023-10-07T09:04:19.931351+0000","last_became_peered":"2023-10-07T09:04:19.931351+0000","last_unstale":"2023-10-07T09:04:19.931617+0000","last_undegraded":"2023-10-07T09:04:19.931617+0000","last_fullsized":"2023-10-07T09:04:19.931617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:53.563280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.925897+0000","last_change":"2023-10-07T09:04:19.925897+0000","last_active":"2023-10-07T09:04:19.925897+0000","last_peered":"2023-10-07T09:04:19.925897+0000","last_clean":"2023-10-07T09:04:19.925897+0000","last_became_active":"2023-10-07T09:04:19.925615+0000","last_became_peered":"2023-10-07T09:04:19.925615+0000","last_unstale":"2023-10-07T09:04:19.925897+0000","last_undegraded":"2023-10-07T09:04:19.925897+0000","last_fullsized":"2023-10-07T09:04:19.925897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:23.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928390+0000","last_change":"2023-10-07T09:04:19.928390+0000","last_active":"2023-10-07T09:04:19.928390+0000","last_peered":"2023-10-07T09:04:19.928390+0000","last_clean":"2023-10-07T09:04:19.928390+0000","last_became_active":"2023-10-07T09:04:19.928132+0000","last_became_peered":"2023-10-07T09:04:19.928132+0000","last_unstale":"2023-10-07T09:04:19.928390+0000","last_undegraded":"2023-10-07T09:04:19.928390+0000","last_fullsized":"2023-10-07T09:04:19.928390+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:48.687356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933031+0000","last_change":"2023-10-07T09:04:19.933031+0000","last_active":"2023-10-07T09:04:19.933031+0000","last_peered":"2023-10-07T09:04:19.933031+0000","last_clean":"2023-10-07T09:04:19.933031+0000","last_became_active":"2023-10-07T09:04:19.932467+0000","last_became_peered":"2023-10-07T09:04:19.932467+0000","last_unstale":"2023-10-07T09:04:19.933031+0000","last_undegraded":"2023-10-07T09:04:19.933031+0000","last_fullsized":"2023-10-07T09:04:19.933031+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:48.687356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923112+0000","last_change":"2023-10-07T09:04:19.923112+0000","last_active":"2023-10-07T09:04:19.923112+0000","last_peered":"2023-10-07T09:04:19.923112+0000","last_clean":"2023-10-07T09:04:19.923112+0000","last_became_active":"2023-10-07T09:04:19.922772+0000","last_became_peered":"2023-10-07T09:04:19.922772+0000","last_unstale":"2023-10-07T09:04:19.923112+0000","last_undegraded":"2023-10-07T09:04:19.923112+0000","last_fullsized":"2023-10-07T09:04:19.923112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:47.669680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939081+0000","last_change":"2023-10-07T09:04:19.939081+0000","last_active":"2023-10-07T09:04:19.939081+0000","last_peered":"2023-10-07T09:04:19.939081+0000","last_clean":"2023-10-07T09:04:19.939081+0000","last_became_active":"2023-10-07T09:04:19.937520+0000","last_became_peered":"2023-10-07T09:04:19.937520+0000","last_unstale":"2023-10-07T09:04:19.939081+0000","last_undegraded":"2023-10-07T09:04:19.939081+0000","last_fullsized":"2023-10-07T09:04:19.939081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:19.237171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929583+0000","last_change":"2023-10-07T09:04:19.929583+0000","last_active":"2023-10-07T09:04:19.929583+0000","last_peered":"2023-10-07T09:04:19.929583+0000","last_clean":"2023-10-07T09:04:19.929583+0000","last_became_active":"2023-10-07T09:04:19.928954+0000","last_became_peered":"2023-10-07T09:04:19.928954+0000","last_unstale":"2023-10-07T09:04:19.929583+0000","last_undegraded":"2023-10-07T09:04:19.929583+0000","last_fullsized":"2023-10-07T09:04:19.929583+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:24.486190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928163+0000","last_change":"2023-10-07T09:04:19.928163+0000","last_active":"2023-10-07T09:04:19.928163+0000","last_peered":"2023-10-07T09:04:19.928163+0000","last_clean":"2023-10-07T09:04:19.928163+0000","last_became_active":"2023-10-07T09:04:19.927870+0000","last_became_peered":"2023-10-07T09:04:19.927870+0000","last_unstale":"2023-10-07T09:04:19.928163+0000","last_undegraded":"2023-10-07T09:04:19.928163+0000","last_fullsized":"2023-10-07T09:04:19.928163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:06.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.927929+0000","last_change":"2023-10-07T09:04:19.927929+0000","last_active":"2023-10-07T09:04:19.927929+0000","last_peered":"2023-10-07T09:04:19.927929+0000","last_clean":"2023-10-07T09:04:19.927929+0000","last_became_active":"2023-10-07T09:04:19.927653+0000","last_became_peered":"2023-10-07T09:04:19.927653+0000","last_unstale":"2023-10-07T09:04:19.927929+0000","last_undegraded":"2023-10-07T09:04:19.927929+0000","last_fullsized":"2023-10-07T09:04:19.927929+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:01.099513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923097+0000","last_change":"2023-10-07T09:04:19.923097+0000","last_active":"2023-10-07T09:04:19.923097+0000","last_peered":"2023-10-07T09:04:19.923097+0000","last_clean":"2023-10-07T09:04:19.923097+0000","last_became_active":"2023-10-07T09:04:19.922792+0000","last_became_peered":"2023-10-07T09:04:19.922792+0000","last_unstale":"2023-10-07T09:04:19.923097+0000","last_undegraded":"2023-10-07T09:04:19.923097+0000","last_fullsized":"2023-10-07T09:04:19.923097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:53.923906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939541+0000","last_change":"2023-10-07T09:04:19.932034+0000","last_active":"2023-10-07T09:04:19.939541+0000","last_peered":"2023-10-07T09:04:19.939541+0000","last_clean":"2023-10-07T09:04:19.939541+0000","last_became_active":"2023-10-07T09:04:19.931709+0000","last_became_peered":"2023-10-07T09:04:19.931709+0000","last_unstale":"2023-10-07T09:04:19.939541+0000","last_undegraded":"2023-10-07T09:04:19.939541+0000","last_fullsized":"2023-10-07T09:04:19.939541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:06.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.926317+0000","last_change":"2023-10-07T09:04:19.926317+0000","last_active":"2023-10-07T09:04:19.926317+0000","last_peered":"2023-10-07T09:04:19.926317+0000","last_clean":"2023-10-07T09:04:19.926317+0000","last_became_active":"2023-10-07T09:04:19.926079+0000","last_became_peered":"2023-10-07T09:04:19.926079+0000","last_unstale":"2023-10-07T09:04:19.926317+0000","last_undegraded":"2023-10-07T09:04:19.926317+0000","last_fullsized":"2023-10-07T09:04:19.926317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:16.380500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923987+0000","last_change":"2023-10-07T09:04:19.923987+0000","last_active":"2023-10-07T09:04:19.923987+0000","last_peered":"2023-10-07T09:04:19.923987+0000","last_clean":"2023-10-07T09:04:19.923987+0000","last_became_active":"2023-10-07T09:04:19.923723+0000","last_became_peered":"2023-10-07T09:04:19.923723+0000","last_unstale":"2023-10-07T09:04:19.923987+0000","last_undegraded":"2023-10-07T09:04:19.923987+0000","last_fullsized":"2023-10-07T09:04:19.923987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:34:25.716725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941744+0000","last_change":"2023-10-07T09:04:19.937059+0000","last_active":"2023-10-07T09:04:19.941744+0000","last_peered":"2023-10-07T09:04:19.941744+0000","last_clean":"2023-10-07T09:04:19.941744+0000","last_became_active":"2023-10-07T09:04:19.936529+0000","last_became_peered":"2023-10-07T09:04:19.936529+0000","last_unstale":"2023-10-07T09:04:19.941744+0000","last_undegraded":"2023-10-07T09:04:19.941744+0000","last_fullsized":"2023-10-07T09:04:19.941744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:56.509948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931349+0000","last_change":"2023-10-07T09:04:19.931349+0000","last_active":"2023-10-07T09:04:19.931349+0000","last_peered":"2023-10-07T09:04:19.931349+0000","last_clean":"2023-10-07T09:04:19.931349+0000","last_became_active":"2023-10-07T09:04:19.931064+0000","last_became_peered":"2023-10-07T09:04:19.931064+0000","last_unstale":"2023-10-07T09:04:19.931349+0000","last_undegraded":"2023-10-07T09:04:19.931349+0000","last_fullsized":"2023-10-07T09:04:19.931349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:12.456613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923606+0000","last_change":"2023-10-07T09:04:19.923606+0000","last_active":"2023-10-07T09:04:19.923606+0000","last_peered":"2023-10-07T09:04:19.923606+0000","last_clean":"2023-10-07T09:04:19.923606+0000","last_became_active":"2023-10-07T09:04:19.923340+0000","last_became_peered":"2023-10-07T09:04:19.923340+0000","last_unstale":"2023-10-07T09:04:19.923606+0000","last_undegraded":"2023-10-07T09:04:19.923606+0000","last_fullsized":"2023-10-07T09:04:19.923606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:16.398078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937483+0000","last_change":"2023-10-07T09:04:19.937483+0000","last_active":"2023-10-07T09:04:19.937483+0000","last_peered":"2023-10-07T09:04:19.937483+0000","last_clean":"2023-10-07T09:04:19.937483+0000","last_became_active":"2023-10-07T09:04:19.937175+0000","last_became_peered":"2023-10-07T09:04:19.937175+0000","last_unstale":"2023-10-07T09:04:19.937483+0000","last_undegraded":"2023-10-07T09:04:19.937483+0000","last_fullsized":"2023-10-07T09:04:19.937483+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:19.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933415+0000","last_change":"2023-10-07T09:04:19.933415+0000","last_active":"2023-10-07T09:04:19.933415+0000","last_peered":"2023-10-07T09:04:19.933415+0000","last_clean":"2023-10-07T09:04:19.933415+0000","last_became_active":"2023-10-07T09:04:19.932915+0000","last_became_peered":"2023-10-07T09:04:19.932915+0000","last_unstale":"2023-10-07T09:04:19.933415+0000","last_undegraded":"2023-10-07T09:04:19.933415+0000","last_fullsized":"2023-10-07T09:04:19.933415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:14.599898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929032+0000","last_change":"2023-10-07T09:04:19.929032+0000","last_active":"2023-10-07T09:04:19.929032+0000","last_peered":"2023-10-07T09:04:19.929032+0000","last_clean":"2023-10-07T09:04:19.929032+0000","last_became_active":"2023-10-07T09:04:19.928780+0000","last_became_peered":"2023-10-07T09:04:19.928780+0000","last_unstale":"2023-10-07T09:04:19.929032+0000","last_undegraded":"2023-10-07T09:04:19.929032+0000","last_fullsized":"2023-10-07T09:04:19.929032+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:00:14.846344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"89'4","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218281+0000","last_change":"2023-10-07T09:04:19.207424+0000","last_active":"2023-10-07T09:04:20.218281+0000","last_peered":"2023-10-07T09:04:20.218281+0000","last_clean":"2023-10-07T09:04:20.218281+0000","last_became_active":"2023-10-07T09:04:19.207152+0000","last_became_peered":"2023-10-07T09:04:19.207152+0000","last_unstale":"2023-10-07T09:04:20.218281+0000","last_undegraded":"2023-10-07T09:04:20.218281+0000","last_fullsized":"2023-10-07T09:04:20.218281+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:16.205759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937691+0000","last_change":"2023-10-07T09:04:19.937691+0000","last_active":"2023-10-07T09:04:19.937691+0000","last_peered":"2023-10-07T09:04:19.937691+0000","last_clean":"2023-10-07T09:04:19.937691+0000","last_became_active":"2023-10-07T09:04:19.936810+0000","last_became_peered":"2023-10-07T09:04:19.936810+0000","last_unstale":"2023-10-07T09:04:19.937691+0000","last_undegraded":"2023-10-07T09:04:19.937691+0000","last_fullsized":"2023-10-07T09:04:19.937691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:34:25.716725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.918235+0000","last_change":"2023-10-07T09:04:19.208360+0000","last_active":"2023-10-07T09:04:19.918235+0000","last_peered":"2023-10-07T09:04:19.918235+0000","last_clean":"2023-10-07T09:04:19.918235+0000","last_became_active":"2023-10-07T09:04:19.208089+0000","last_became_peered":"2023-10-07T09:04:19.208089+0000","last_unstale":"2023-10-07T09:04:19.918235+0000","last_undegraded":"2023-10-07T09:04:19.918235+0000","last_fullsized":"2023-10-07T09:04:19.918235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:31.420325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938111+0000","last_change":"2023-10-07T09:04:19.938111+0000","last_active":"2023-10-07T09:04:19.938111+0000","last_peered":"2023-10-07T09:04:19.938111+0000","last_clean":"2023-10-07T09:04:19.938111+0000","last_became_active":"2023-10-07T09:04:19.937766+0000","last_became_peered":"2023-10-07T09:04:19.937766+0000","last_unstale":"2023-10-07T09:04:19.938111+0000","last_undegraded":"2023-10-07T09:04:19.938111+0000","last_fullsized":"2023-10-07T09:04:19.938111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:34.269788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.216132+0000","last_change":"2023-10-07T09:04:19.206100+0000","last_active":"2023-10-07T09:04:20.216132+0000","last_peered":"2023-10-07T09:04:20.216132+0000","last_clean":"2023-10-07T09:04:20.216132+0000","last_became_active":"2023-10-07T09:04:19.205839+0000","last_became_peered":"2023-10-07T09:04:19.205839+0000","last_unstale":"2023-10-07T09:04:20.216132+0000","last_undegraded":"2023-10-07T09:04:20.216132+0000","last_fullsized":"2023-10-07T09:04:20.216132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:57.551400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.940779+0000","last_change":"2023-10-07T09:04:19.940779+0000","last_active":"2023-10-07T09:04:19.940779+0000","last_peered":"2023-10-07T09:04:19.940779+0000","last_clean":"2023-10-07T09:04:19.940779+0000","last_became_active":"2023-10-07T09:04:19.937227+0000","last_became_peered":"2023-10-07T09:04:19.937227+0000","last_unstale":"2023-10-07T09:04:19.940779+0000","last_undegraded":"2023-10-07T09:04:19.940779+0000","last_fullsized":"2023-10-07T09:04:19.940779+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:14.189637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221392+0000","last_change":"2023-10-07T09:04:19.206633+0000","last_active":"2023-10-07T09:04:20.221392+0000","last_peered":"2023-10-07T09:04:20.221392+0000","last_clean":"2023-10-07T09:04:20.221392+0000","last_became_active":"2023-10-07T09:04:19.206382+0000","last_became_peered":"2023-10-07T09:04:19.206382+0000","last_unstale":"2023-10-07T09:04:20.221392+0000","last_undegraded":"2023-10-07T09:04:20.221392+0000","last_fullsized":"2023-10-07T09:04:20.221392+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:29.893815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939081+0000","last_change":"2023-10-07T09:04:19.939081+0000","last_active":"2023-10-07T09:04:19.939081+0000","last_peered":"2023-10-07T09:04:19.939081+0000","last_clean":"2023-10-07T09:04:19.939081+0000","last_became_active":"2023-10-07T09:04:19.938671+0000","last_became_peered":"2023-10-07T09:04:19.938671+0000","last_unstale":"2023-10-07T09:04:19.939081+0000","last_undegraded":"2023-10-07T09:04:19.939081+0000","last_fullsized":"2023-10-07T09:04:19.939081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:06.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.921503+0000","last_change":"2023-10-07T09:04:19.202181+0000","last_active":"2023-10-07T09:04:19.921503+0000","last_peered":"2023-10-07T09:04:19.921503+0000","last_clean":"2023-10-07T09:04:19.921503+0000","last_became_active":"2023-10-07T09:04:19.201540+0000","last_became_peered":"2023-10-07T09:04:19.201540+0000","last_unstale":"2023-10-07T09:04:19.921503+0000","last_undegraded":"2023-10-07T09:04:19.921503+0000","last_fullsized":"2023-10-07T09:04:19.921503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:15.394212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.935832+0000","last_change":"2023-10-07T09:04:19.935832+0000","last_active":"2023-10-07T09:04:19.935832+0000","last_peered":"2023-10-07T09:04:19.935832+0000","last_clean":"2023-10-07T09:04:19.935832+0000","last_became_active":"2023-10-07T09:04:19.935615+0000","last_became_peered":"2023-10-07T09:04:19.935615+0000","last_unstale":"2023-10-07T09:04:19.935832+0000","last_undegraded":"2023-10-07T09:04:19.935832+0000","last_fullsized":"2023-10-07T09:04:19.935832+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:06.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.920136+0000","last_change":"2023-10-07T09:04:19.209108+0000","last_active":"2023-10-07T09:04:19.920136+0000","last_peered":"2023-10-07T09:04:19.920136+0000","last_clean":"2023-10-07T09:04:19.920136+0000","last_became_active":"2023-10-07T09:04:19.208721+0000","last_became_peered":"2023-10-07T09:04:19.208721+0000","last_unstale":"2023-10-07T09:04:19.920136+0000","last_undegraded":"2023-10-07T09:04:19.920136+0000","last_fullsized":"2023-10-07T09:04:19.920136+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:40.100247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934397+0000","last_change":"2023-10-07T09:04:19.934397+0000","last_active":"2023-10-07T09:04:19.934397+0000","last_peered":"2023-10-07T09:04:19.934397+0000","last_clean":"2023-10-07T09:04:19.934397+0000","last_became_active":"2023-10-07T09:04:19.934105+0000","last_became_peered":"2023-10-07T09:04:19.934105+0000","last_unstale":"2023-10-07T09:04:19.934397+0000","last_undegraded":"2023-10-07T09:04:19.934397+0000","last_fullsized":"2023-10-07T09:04:19.934397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:38.476566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928336+0000","last_change":"2023-10-07T09:04:19.203759+0000","last_active":"2023-10-07T09:04:19.928336+0000","last_peered":"2023-10-07T09:04:19.928336+0000","last_clean":"2023-10-07T09:04:19.928336+0000","last_became_active":"2023-10-07T09:04:19.203448+0000","last_became_peered":"2023-10-07T09:04:19.203448+0000","last_unstale":"2023-10-07T09:04:19.928336+0000","last_undegraded":"2023-10-07T09:04:19.928336+0000","last_fullsized":"2023-10-07T09:04:19.928336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:59.717963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.933675+0000","last_change":"2023-10-07T09:04:19.933675+0000","last_active":"2023-10-07T09:04:19.933675+0000","last_peered":"2023-10-07T09:04:19.933675+0000","last_clean":"2023-10-07T09:04:19.933675+0000","last_became_active":"2023-10-07T09:04:19.933370+0000","last_became_peered":"2023-10-07T09:04:19.933370+0000","last_unstale":"2023-10-07T09:04:19.933675+0000","last_undegraded":"2023-10-07T09:04:19.933675+0000","last_fullsized":"2023-10-07T09:04:19.933675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:06.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.207482+0000","last_change":"2023-10-07T09:04:19.203008+0000","last_active":"2023-10-07T09:04:19.207482+0000","last_peered":"2023-10-07T09:04:19.207482+0000","last_clean":"2023-10-07T09:04:19.207482+0000","last_became_active":"2023-10-07T09:04:19.201977+0000","last_became_peered":"2023-10-07T09:04:19.201977+0000","last_unstale":"2023-10-07T09:04:19.207482+0000","last_undegraded":"2023-10-07T09:04:19.207482+0000","last_fullsized":"2023-10-07T09:04:19.207482+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937909+0000","last_change":"2023-10-07T09:04:19.937909+0000","last_active":"2023-10-07T09:04:19.937909+0000","last_peered":"2023-10-07T09:04:19.937909+0000","last_clean":"2023-10-07T09:04:19.937909+0000","last_became_active":"2023-10-07T09:04:19.937651+0000","last_became_peered":"2023-10-07T09:04:19.937651+0000","last_unstale":"2023-10-07T09:04:19.937909+0000","last_undegraded":"2023-10-07T09:04:19.937909+0000","last_fullsized":"2023-10-07T09:04:19.937909+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:19.200999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.207631+0000","last_change":"2023-10-07T09:04:19.201800+0000","last_active":"2023-10-07T09:04:19.207631+0000","last_peered":"2023-10-07T09:04:19.207631+0000","last_clean":"2023-10-07T09:04:19.207631+0000","last_became_active":"2023-10-07T09:04:19.201497+0000","last_became_peered":"2023-10-07T09:04:19.201497+0000","last_unstale":"2023-10-07T09:04:19.207631+0000","last_undegraded":"2023-10-07T09:04:19.207631+0000","last_fullsized":"2023-10-07T09:04:19.207631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:00:13.842478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937359+0000","last_change":"2023-10-07T09:04:19.937359+0000","last_active":"2023-10-07T09:04:19.937359+0000","last_peered":"2023-10-07T09:04:19.937359+0000","last_clean":"2023-10-07T09:04:19.937359+0000","last_became_active":"2023-10-07T09:04:19.936994+0000","last_became_peered":"2023-10-07T09:04:19.936994+0000","last_unstale":"2023-10-07T09:04:19.937359+0000","last_undegraded":"2023-10-07T09:04:19.937359+0000","last_fullsized":"2023-10-07T09:04:19.937359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:29.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.203628+0000","last_change":"2023-10-07T09:04:19.202886+0000","last_active":"2023-10-07T09:04:19.203628+0000","last_peered":"2023-10-07T09:04:19.203628+0000","last_clean":"2023-10-07T09:04:19.203628+0000","last_became_active":"2023-10-07T09:04:19.202534+0000","last_became_peered":"2023-10-07T09:04:19.202534+0000","last_unstale":"2023-10-07T09:04:19.203628+0000","last_undegraded":"2023-10-07T09:04:19.203628+0000","last_fullsized":"2023-10-07T09:04:19.203628+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:55.506081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941730+0000","last_change":"2023-10-07T09:04:19.936885+0000","last_active":"2023-10-07T09:04:19.941730+0000","last_peered":"2023-10-07T09:04:19.941730+0000","last_clean":"2023-10-07T09:04:19.941730+0000","last_became_active":"2023-10-07T09:04:19.936172+0000","last_became_peered":"2023-10-07T09:04:19.936172+0000","last_unstale":"2023-10-07T09:04:19.941730+0000","last_undegraded":"2023-10-07T09:04:19.941730+0000","last_fullsized":"2023-10-07T09:04:19.941730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:32.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"89'3","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.219442+0000","last_change":"2023-10-07T09:04:19.208722+0000","last_active":"2023-10-07T09:04:20.219442+0000","last_peered":"2023-10-07T09:04:20.219442+0000","last_clean":"2023-10-07T09:04:20.219442+0000","last_became_active":"2023-10-07T09:04:19.207860+0000","last_became_peered":"2023-10-07T09:04:19.207860+0000","last_unstale":"2023-10-07T09:04:20.219442+0000","last_undegraded":"2023-10-07T09:04:20.219442+0000","last_fullsized":"2023-10-07T09:04:20.219442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:15.008958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931481+0000","last_change":"2023-10-07T09:04:19.931481+0000","last_active":"2023-10-07T09:04:19.931481+0000","last_peered":"2023-10-07T09:04:19.931481+0000","last_clean":"2023-10-07T09:04:19.931481+0000","last_became_active":"2023-10-07T09:04:19.931254+0000","last_became_peered":"2023-10-07T09:04:19.931254+0000","last_unstale":"2023-10-07T09:04:19.931481+0000","last_undegraded":"2023-10-07T09:04:19.931481+0000","last_fullsized":"2023-10-07T09:04:19.931481+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:44.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"89'6","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221265+0000","last_change":"2023-10-07T09:04:19.194055+0000","last_active":"2023-10-07T09:04:20.221265+0000","last_peered":"2023-10-07T09:04:20.221265+0000","last_clean":"2023-10-07T09:04:20.221265+0000","last_became_active":"2023-10-07T09:04:19.193803+0000","last_became_peered":"2023-10-07T09:04:19.193803+0000","last_unstale":"2023-10-07T09:04:20.221265+0000","last_undegraded":"2023-10-07T09:04:20.221265+0000","last_fullsized":"2023-10-07T09:04:20.221265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:31.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931469+0000","last_change":"2023-10-07T09:04:19.931469+0000","last_active":"2023-10-07T09:04:19.931469+0000","last_peered":"2023-10-07T09:04:19.931469+0000","last_clean":"2023-10-07T09:04:19.931469+0000","last_became_active":"2023-10-07T09:04:19.931264+0000","last_became_peered":"2023-10-07T09:04:19.931264+0000","last_unstale":"2023-10-07T09:04:19.931469+0000","last_undegraded":"2023-10-07T09:04:19.931469+0000","last_fullsized":"2023-10-07T09:04:19.931469+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:58.688044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218946+0000","last_change":"2023-10-07T09:04:19.198928+0000","last_active":"2023-10-07T09:04:20.218946+0000","last_peered":"2023-10-07T09:04:20.218946+0000","last_clean":"2023-10-07T09:04:20.218946+0000","last_became_active":"2023-10-07T09:04:19.198698+0000","last_became_peered":"2023-10-07T09:04:19.198698+0000","last_unstale":"2023-10-07T09:04:20.218946+0000","last_undegraded":"2023-10-07T09:04:20.218946+0000","last_fullsized":"2023-10-07T09:04:20.218946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:31.636808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.926625+0000","last_change":"2023-10-07T09:04:19.926625+0000","last_active":"2023-10-07T09:04:19.926625+0000","last_peered":"2023-10-07T09:04:19.926625+0000","last_clean":"2023-10-07T09:04:19.926625+0000","last_became_active":"2023-10-07T09:04:19.926370+0000","last_became_peered":"2023-10-07T09:04:19.926370+0000","last_unstale":"2023-10-07T09:04:19.926625+0000","last_undegraded":"2023-10-07T09:04:19.926625+0000","last_fullsized":"2023-10-07T09:04:19.926625+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:26.001545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.209226+0000","last_change":"2023-10-07T09:04:19.205654+0000","last_active":"2023-10-07T09:04:19.209226+0000","last_peered":"2023-10-07T09:04:19.209226+0000","last_clean":"2023-10-07T09:04:19.209226+0000","last_became_active":"2023-10-07T09:04:19.205389+0000","last_became_peered":"2023-10-07T09:04:19.205389+0000","last_unstale":"2023-10-07T09:04:19.209226+0000","last_undegraded":"2023-10-07T09:04:19.209226+0000","last_fullsized":"2023-10-07T09:04:19.209226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:34:11.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.932631+0000","last_change":"2023-10-07T09:04:19.932631+0000","last_active":"2023-10-07T09:04:19.932631+0000","last_peered":"2023-10-07T09:04:19.932631+0000","last_clean":"2023-10-07T09:04:19.932631+0000","last_became_active":"2023-10-07T09:04:19.932295+0000","last_became_peered":"2023-10-07T09:04:19.932295+0000","last_unstale":"2023-10-07T09:04:19.932631+0000","last_undegraded":"2023-10-07T09:04:19.932631+0000","last_fullsized":"2023-10-07T09:04:19.932631+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:21.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.204214+0000","last_change":"2023-10-07T09:04:19.199423+0000","last_active":"2023-10-07T09:04:19.204214+0000","last_peered":"2023-10-07T09:04:19.204214+0000","last_clean":"2023-10-07T09:04:19.204214+0000","last_became_active":"2023-10-07T09:04:19.199109+0000","last_became_peered":"2023-10-07T09:04:19.199109+0000","last_unstale":"2023-10-07T09:04:19.204214+0000","last_undegraded":"2023-10-07T09:04:19.204214+0000","last_fullsized":"2023-10-07T09:04:19.204214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:50:44.439137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934513+0000","last_change":"2023-10-07T09:04:19.934513+0000","last_active":"2023-10-07T09:04:19.934513+0000","last_peered":"2023-10-07T09:04:19.934513+0000","last_clean":"2023-10-07T09:04:19.934513+0000","last_became_active":"2023-10-07T09:04:19.934269+0000","last_became_peered":"2023-10-07T09:04:19.934269+0000","last_unstale":"2023-10-07T09:04:19.934513+0000","last_undegraded":"2023-10-07T09:04:19.934513+0000","last_fullsized":"2023-10-07T09:04:19.934513+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:04:21.896033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"89'8","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.221475+0000","last_change":"2023-10-07T09:04:19.204091+0000","last_active":"2023-10-07T09:04:20.221475+0000","last_peered":"2023-10-07T09:04:20.221475+0000","last_clean":"2023-10-07T09:04:20.221475+0000","last_became_active":"2023-10-07T09:04:19.203774+0000","last_became_peered":"2023-10-07T09:04:19.203774+0000","last_unstale":"2023-10-07T09:04:20.221475+0000","last_undegraded":"2023-10-07T09:04:20.221475+0000","last_fullsized":"2023-10-07T09:04:20.221475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:38.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.944156+0000","last_change":"2023-10-07T09:04:19.939163+0000","last_active":"2023-10-07T09:04:19.944156+0000","last_peered":"2023-10-07T09:04:19.944156+0000","last_clean":"2023-10-07T09:04:19.944156+0000","last_became_active":"2023-10-07T09:04:19.938896+0000","last_became_peered":"2023-10-07T09:04:19.938896+0000","last_unstale":"2023-10-07T09:04:19.944156+0000","last_undegraded":"2023-10-07T09:04:19.944156+0000","last_fullsized":"2023-10-07T09:04:19.944156+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:17.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.217744+0000","last_change":"2023-10-07T09:04:19.199995+0000","last_active":"2023-10-07T09:04:20.217744+0000","last_peered":"2023-10-07T09:04:20.217744+0000","last_clean":"2023-10-07T09:04:20.217744+0000","last_became_active":"2023-10-07T09:04:19.199718+0000","last_became_peered":"2023-10-07T09:04:19.199718+0000","last_unstale":"2023-10-07T09:04:20.217744+0000","last_undegraded":"2023-10-07T09:04:20.217744+0000","last_fullsized":"2023-10-07T09:04:20.217744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:14:43.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937848+0000","last_change":"2023-10-07T09:04:19.937848+0000","last_active":"2023-10-07T09:04:19.937848+0000","last_peered":"2023-10-07T09:04:19.937848+0000","last_clean":"2023-10-07T09:04:19.937848+0000","last_became_active":"2023-10-07T09:04:19.937604+0000","last_became_peered":"2023-10-07T09:04:19.937604+0000","last_unstale":"2023-10-07T09:04:19.937848+0000","last_undegraded":"2023-10-07T09:04:19.937848+0000","last_fullsized":"2023-10-07T09:04:19.937848+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:29.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.218944+0000","last_change":"2023-10-07T09:04:19.198190+0000","last_active":"2023-10-07T09:04:20.218944+0000","last_peered":"2023-10-07T09:04:20.218944+0000","last_clean":"2023-10-07T09:04:20.218944+0000","last_became_active":"2023-10-07T09:04:19.197939+0000","last_became_peered":"2023-10-07T09:04:19.197939+0000","last_unstale":"2023-10-07T09:04:20.218944+0000","last_undegraded":"2023-10-07T09:04:20.218944+0000","last_fullsized":"2023-10-07T09:04:20.218944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:13.596032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938118+0000","last_change":"2023-10-07T09:04:19.938118+0000","last_active":"2023-10-07T09:04:19.938118+0000","last_peered":"2023-10-07T09:04:19.938118+0000","last_clean":"2023-10-07T09:04:19.938118+0000","last_became_active":"2023-10-07T09:04:19.937835+0000","last_became_peered":"2023-10-07T09:04:19.937835+0000","last_unstale":"2023-10-07T09:04:19.938118+0000","last_undegraded":"2023-10-07T09:04:19.938118+0000","last_fullsized":"2023-10-07T09:04:19.938118+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:04:16.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202913+0000","last_change":"2023-10-07T09:04:19.200479+0000","last_active":"2023-10-07T09:04:19.202913+0000","last_peered":"2023-10-07T09:04:19.202913+0000","last_clean":"2023-10-07T09:04:19.202913+0000","last_became_active":"2023-10-07T09:04:19.200202+0000","last_became_peered":"2023-10-07T09:04:19.200202+0000","last_unstale":"2023-10-07T09:04:19.202913+0000","last_undegraded":"2023-10-07T09:04:19.202913+0000","last_fullsized":"2023-10-07T09:04:19.202913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:50:31.291510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.931264+0000","last_change":"2023-10-07T09:04:19.931264+0000","last_active":"2023-10-07T09:04:19.931264+0000","last_peered":"2023-10-07T09:04:19.931264+0000","last_clean":"2023-10-07T09:04:19.931264+0000","last_became_active":"2023-10-07T09:04:19.931019+0000","last_became_peered":"2023-10-07T09:04:19.931019+0000","last_unstale":"2023-10-07T09:04:19.931264+0000","last_undegraded":"2023-10-07T09:04:19.931264+0000","last_fullsized":"2023-10-07T09:04:19.931264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.944643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.215849+0000","last_change":"2023-10-07T09:04:19.206991+0000","last_active":"2023-10-07T09:04:20.215849+0000","last_peered":"2023-10-07T09:04:20.215849+0000","last_clean":"2023-10-07T09:04:20.215849+0000","last_became_active":"2023-10-07T09:04:19.204587+0000","last_became_peered":"2023-10-07T09:04:19.204587+0000","last_unstale":"2023-10-07T09:04:20.215849+0000","last_undegraded":"2023-10-07T09:04:20.215849+0000","last_fullsized":"2023-10-07T09:04:20.215849+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:15.975305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929749+0000","last_change":"2023-10-07T09:04:19.929749+0000","last_active":"2023-10-07T09:04:19.929749+0000","last_peered":"2023-10-07T09:04:19.929749+0000","last_clean":"2023-10-07T09:04:19.929749+0000","last_became_active":"2023-10-07T09:04:19.929307+0000","last_became_peered":"2023-10-07T09:04:19.929307+0000","last_unstale":"2023-10-07T09:04:19.929749+0000","last_undegraded":"2023-10-07T09:04:19.929749+0000","last_fullsized":"2023-10-07T09:04:19.929749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208481+0000","last_change":"2023-10-07T09:04:19.206932+0000","last_active":"2023-10-07T09:04:19.208481+0000","last_peered":"2023-10-07T09:04:19.208481+0000","last_clean":"2023-10-07T09:04:19.208481+0000","last_became_active":"2023-10-07T09:04:19.206589+0000","last_became_peered":"2023-10-07T09:04:19.206589+0000","last_unstale":"2023-10-07T09:04:19.208481+0000","last_undegraded":"2023-10-07T09:04:19.208481+0000","last_fullsized":"2023-10-07T09:04:19.208481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:33.265921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929336+0000","last_change":"2023-10-07T09:04:19.929336+0000","last_active":"2023-10-07T09:04:19.929336+0000","last_peered":"2023-10-07T09:04:19.929336+0000","last_clean":"2023-10-07T09:04:19.929336+0000","last_became_active":"2023-10-07T09:04:19.929056+0000","last_became_peered":"2023-10-07T09:04:19.929056+0000","last_unstale":"2023-10-07T09:04:19.929336+0000","last_undegraded":"2023-10-07T09:04:19.929336+0000","last_fullsized":"2023-10-07T09:04:19.929336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:22:34.587155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.206637+0000","last_change":"2023-10-07T09:04:19.199380+0000","last_active":"2023-10-07T09:04:19.206637+0000","last_peered":"2023-10-07T09:04:19.206637+0000","last_clean":"2023-10-07T09:04:19.206637+0000","last_became_active":"2023-10-07T09:04:19.199064+0000","last_became_peered":"2023-10-07T09:04:19.199064+0000","last_unstale":"2023-10-07T09:04:19.206637+0000","last_undegraded":"2023-10-07T09:04:19.206637+0000","last_fullsized":"2023-10-07T09:04:19.206637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:13.596032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941691+0000","last_change":"2023-10-07T09:04:19.935772+0000","last_active":"2023-10-07T09:04:19.941691+0000","last_peered":"2023-10-07T09:04:19.941691+0000","last_clean":"2023-10-07T09:04:19.941691+0000","last_became_active":"2023-10-07T09:04:19.935489+0000","last_became_peered":"2023-10-07T09:04:19.935489+0000","last_unstale":"2023-10-07T09:04:19.941691+0000","last_undegraded":"2023-10-07T09:04:19.941691+0000","last_fullsized":"2023-10-07T09:04:19.941691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:21.315921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.209859+0000","last_change":"2023-10-07T09:04:19.209013+0000","last_active":"2023-10-07T09:04:19.209859+0000","last_peered":"2023-10-07T09:04:19.209859+0000","last_clean":"2023-10-07T09:04:19.209859+0000","last_became_active":"2023-10-07T09:04:19.208685+0000","last_became_peered":"2023-10-07T09:04:19.208685+0000","last_unstale":"2023-10-07T09:04:19.209859+0000","last_undegraded":"2023-10-07T09:04:19.209859+0000","last_fullsized":"2023-10-07T09:04:19.209859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:20.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929045+0000","last_change":"2023-10-07T09:04:19.929045+0000","last_active":"2023-10-07T09:04:19.929045+0000","last_peered":"2023-10-07T09:04:19.929045+0000","last_clean":"2023-10-07T09:04:19.929045+0000","last_became_active":"2023-10-07T09:04:19.928627+0000","last_became_peered":"2023-10-07T09:04:19.928627+0000","last_unstale":"2023-10-07T09:04:19.929045+0000","last_undegraded":"2023-10-07T09:04:19.929045+0000","last_fullsized":"2023-10-07T09:04:19.929045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:59.215494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"89'2","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:20.219001+0000","last_change":"2023-10-07T09:04:19.202203+0000","last_active":"2023-10-07T09:04:20.219001+0000","last_peered":"2023-10-07T09:04:20.219001+0000","last_clean":"2023-10-07T09:04:20.219001+0000","last_became_active":"2023-10-07T09:04:19.201910+0000","last_became_peered":"2023-10-07T09:04:19.201910+0000","last_unstale":"2023-10-07T09:04:20.219001+0000","last_undegraded":"2023-10-07T09:04:20.219001+0000","last_fullsized":"2023-10-07T09:04:20.219001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:59.717963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.923922+0000","last_change":"2023-10-07T09:04:19.923922+0000","last_active":"2023-10-07T09:04:19.923922+0000","last_peered":"2023-10-07T09:04:19.923922+0000","last_clean":"2023-10-07T09:04:19.923922+0000","last_became_active":"2023-10-07T09:04:19.923675+0000","last_became_peered":"2023-10-07T09:04:19.923675+0000","last_unstale":"2023-10-07T09:04:19.923922+0000","last_undegraded":"2023-10-07T09:04:19.923922+0000","last_fullsized":"2023-10-07T09:04:19.923922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:52.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208742+0000","last_change":"2023-10-07T09:04:19.207722+0000","last_active":"2023-10-07T09:04:19.208742+0000","last_peered":"2023-10-07T09:04:19.208742+0000","last_clean":"2023-10-07T09:04:19.208742+0000","last_became_active":"2023-10-07T09:04:19.207415+0000","last_became_peered":"2023-10-07T09:04:19.207415+0000","last_unstale":"2023-10-07T09:04:19.208742+0000","last_undegraded":"2023-10-07T09:04:19.208742+0000","last_fullsized":"2023-10-07T09:04:19.208742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:55.506081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938045+0000","last_change":"2023-10-07T09:04:19.938045+0000","last_active":"2023-10-07T09:04:19.938045+0000","last_peered":"2023-10-07T09:04:19.938045+0000","last_clean":"2023-10-07T09:04:19.938045+0000","last_became_active":"2023-10-07T09:04:19.937416+0000","last_became_peered":"2023-10-07T09:04:19.937416+0000","last_unstale":"2023-10-07T09:04:19.938045+0000","last_undegraded":"2023-10-07T09:04:19.938045+0000","last_fullsized":"2023-10-07T09:04:19.938045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:00.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202886+0000","last_change":"2023-10-07T09:04:19.200539+0000","last_active":"2023-10-07T09:04:19.202886+0000","last_peered":"2023-10-07T09:04:19.202886+0000","last_clean":"2023-10-07T09:04:19.202886+0000","last_became_active":"2023-10-07T09:04:19.200186+0000","last_became_peered":"2023-10-07T09:04:19.200186+0000","last_unstale":"2023-10-07T09:04:19.202886+0000","last_undegraded":"2023-10-07T09:04:19.202886+0000","last_fullsized":"2023-10-07T09:04:19.202886+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:55:05.277979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.941386+0000","last_change":"2023-10-07T09:04:19.935547+0000","last_active":"2023-10-07T09:04:19.941386+0000","last_peered":"2023-10-07T09:04:19.941386+0000","last_clean":"2023-10-07T09:04:19.941386+0000","last_became_active":"2023-10-07T09:04:19.935252+0000","last_became_peered":"2023-10-07T09:04:19.935252+0000","last_unstale":"2023-10-07T09:04:19.941386+0000","last_undegraded":"2023-10-07T09:04:19.941386+0000","last_fullsized":"2023-10-07T09:04:19.941386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:04:09.672328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.929156+0000","last_change":"2023-10-07T09:04:19.202215+0000","last_active":"2023-10-07T09:04:19.929156+0000","last_peered":"2023-10-07T09:04:19.929156+0000","last_clean":"2023-10-07T09:04:19.929156+0000","last_became_active":"2023-10-07T09:04:19.201955+0000","last_became_peered":"2023-10-07T09:04:19.201955+0000","last_unstale":"2023-10-07T09:04:19.929156+0000","last_undegraded":"2023-10-07T09:04:19.929156+0000","last_fullsized":"2023-10-07T09:04:19.929156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:33.265921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.938220+0000","last_change":"2023-10-07T09:04:19.938220+0000","last_active":"2023-10-07T09:04:19.938220+0000","last_peered":"2023-10-07T09:04:19.938220+0000","last_clean":"2023-10-07T09:04:19.938220+0000","last_became_active":"2023-10-07T09:04:19.937978+0000","last_became_peered":"2023-10-07T09:04:19.937978+0000","last_unstale":"2023-10-07T09:04:19.938220+0000","last_undegraded":"2023-10-07T09:04:19.938220+0000","last_fullsized":"2023-10-07T09:04:19.938220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:28.576750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.203300+0000","last_change":"2023-10-07T09:04:19.199920+0000","last_active":"2023-10-07T09:04:19.203300+0000","last_peered":"2023-10-07T09:04:19.203300+0000","last_clean":"2023-10-07T09:04:19.203300+0000","last_became_active":"2023-10-07T09:04:19.199589+0000","last_became_peered":"2023-10-07T09:04:19.199589+0000","last_unstale":"2023-10-07T09:04:19.203300+0000","last_undegraded":"2023-10-07T09:04:19.203300+0000","last_fullsized":"2023-10-07T09:04:19.203300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:04:08.668462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.937958+0000","last_change":"2023-10-07T09:04:19.937958+0000","last_active":"2023-10-07T09:04:19.937958+0000","last_peered":"2023-10-07T09:04:19.937958+0000","last_clean":"2023-10-07T09:04:19.937958+0000","last_became_active":"2023-10-07T09:04:19.937702+0000","last_became_peered":"2023-10-07T09:04:19.937702+0000","last_unstale":"2023-10-07T09:04:19.937958+0000","last_undegraded":"2023-10-07T09:04:19.937958+0000","last_fullsized":"2023-10-07T09:04:19.937958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:52.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.928014+0000","last_change":"2023-10-07T09:04:19.204778+0000","last_active":"2023-10-07T09:04:19.928014+0000","last_peered":"2023-10-07T09:04:19.928014+0000","last_clean":"2023-10-07T09:04:19.928014+0000","last_became_active":"2023-10-07T09:04:19.204566+0000","last_became_peered":"2023-10-07T09:04:19.204566+0000","last_unstale":"2023-10-07T09:04:19.928014+0000","last_undegraded":"2023-10-07T09:04:19.928014+0000","last_fullsized":"2023-10-07T09:04:19.928014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:51.150546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.934333+0000","last_change":"2023-10-07T09:04:19.934333+0000","last_active":"2023-10-07T09:04:19.934333+0000","last_peered":"2023-10-07T09:04:19.934333+0000","last_clean":"2023-10-07T09:04:19.934333+0000","last_became_active":"2023-10-07T09:04:19.934077+0000","last_became_peered":"2023-10-07T09:04:19.934077+0000","last_unstale":"2023-10-07T09:04:19.934333+0000","last_undegraded":"2023-10-07T09:04:19.934333+0000","last_fullsized":"2023-10-07T09:04:19.934333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:11.778168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.198662+0000","last_change":"2023-10-07T09:04:19.197810+0000","last_active":"2023-10-07T09:04:19.198662+0000","last_peered":"2023-10-07T09:04:19.198662+0000","last_clean":"2023-10-07T09:04:19.198662+0000","last_became_active":"2023-10-07T09:04:19.197526+0000","last_became_peered":"2023-10-07T09:04:19.197526+0000","last_unstale":"2023-10-07T09:04:19.198662+0000","last_undegraded":"2023-10-07T09:04:19.198662+0000","last_fullsized":"2023-10-07T09:04:19.198662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:15.975305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.939714+0000","last_change":"2023-10-07T09:04:19.931739+0000","last_active":"2023-10-07T09:04:19.939714+0000","last_peered":"2023-10-07T09:04:19.939714+0000","last_clean":"2023-10-07T09:04:19.939714+0000","last_became_active":"2023-10-07T09:04:19.931473+0000","last_became_peered":"2023-10-07T09:04:19.931473+0000","last_unstale":"2023-10-07T09:04:19.939714+0000","last_undegraded":"2023-10-07T09:04:19.939714+0000","last_fullsized":"2023-10-07T09:04:19.939714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:44:41.104114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.208446+0000","last_change":"2023-10-07T09:04:19.201971+0000","last_active":"2023-10-07T09:04:19.208446+0000","last_peered":"2023-10-07T09:04:19.208446+0000","last_clean":"2023-10-07T09:04:19.208446+0000","last_became_active":"2023-10-07T09:04:19.201000+0000","last_became_peered":"2023-10-07T09:04:19.201000+0000","last_unstale":"2023-10-07T09:04:19.208446+0000","last_undegraded":"2023-10-07T09:04:19.208446+0000","last_fullsized":"2023-10-07T09:04:19.208446+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:08.653728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.932155+0000","last_change":"2023-10-07T09:04:19.932155+0000","last_active":"2023-10-07T09:04:19.932155+0000","last_peered":"2023-10-07T09:04:19.932155+0000","last_clean":"2023-10-07T09:04:19.932155+0000","last_became_active":"2023-10-07T09:04:19.931872+0000","last_became_peered":"2023-10-07T09:04:19.931872+0000","last_unstale":"2023-10-07T09:04:19.932155+0000","last_undegraded":"2023-10-07T09:04:19.932155+0000","last_fullsized":"2023-10-07T09:04:19.932155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:19.183093+0000","last_clean_scrub_stamp":"2023-10-07T09:04:19.183093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:29:59.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.919508+0000","last_change":"2023-10-07T09:04:19.207557+0000","last_active":"2023-10-07T09:04:19.919508+0000","last_peered":"2023-10-07T09:04:19.919508+0000","last_clean":"2023-10-07T09:04:19.919508+0000","last_became_active":"2023-10-07T09:04:19.207342+0000","last_became_peered":"2023-10-07T09:04:19.207342+0000","last_unstale":"2023-10-07T09:04:19.919508+0000","last_undegraded":"2023-10-07T09:04:19.919508+0000","last_fullsized":"2023-10-07T09:04:19.919508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:18.179226+0000","last_clean_scrub_stamp":"2023-10-07T09:04:18.179226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:38.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T09:04:19.202529+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:04:19.202529+0000","last_peered":"2023-10-07T09:04:19.202529+0000","last_clean":"2023-10-07T09:04:19.202529+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:04:19.202529+0000","last_undegraded":"2023-10-07T09:04:19.202529+0000","last_fullsized":"2023-10-07T09:04:19.202529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":1063434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.437},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.623}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47099999999999997,"5min":0.63,"15min":0.63},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35199999999999998,"15min":0.41399999999999998},"min":{"1min":0.223,"5min":0.221,"15min":0.221},"max":{"1min":0.49299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.39700000000000002},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.496,"15min":0.82799999999999996},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":11.32,"15min":11.32},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.504,"15min":0.85499999999999998},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":11.880000000000001,"15min":11.880000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.497},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.82699999999999996},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90000000000000002,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.84699999999999998},"min":{"1min":0.504,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89500000000000002,"5min":5.3920000000000003,"15min":5.3920000000000003},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64600000000000002,"15min":0.77700000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303044,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068796,"statfs":{"total":96636764160,"available":96326447104,"internally_reserved":0,"allocated":1699840,"data_stored":1063876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.191,"15min":0.191},"max":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36299999999999999,"15min":0.38800000000000001},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53400000000000003,"5min":0.625,"15min":0.625},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.22,"15min":0.22},"max":{"1min":0.48099999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.434}]},{"osd":4,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.625},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76600000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.754,"5min":1,"15min":1},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":1.006,"15min":1.006},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61599999999999999,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.748,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.41199999999999998,"15min":0.64900000000000002},"min":{"1min":0.23100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47999999999999998,"5min":10.214,"15min":10.214},"last":0.246},{"interface":"front","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.53600000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.755,"15min":0.755},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.47699999999999998,"15min":0.70799999999999996},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":10.144,"15min":10.144},"last":0.313}]},{"osd":3,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.496,"15min":0.77100000000000002},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59199999999999997,"5min":10.071,"15min":10.071},"last":0.378},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.51600000000000001,"15min":0.78500000000000003},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":10.183,"15min":10.183},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.76500000000000001,"15min":1.2450000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":20.922000000000001,"15min":20.922000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78800000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.81499999999999995,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.745,"5min":1.125,"15min":1.125},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":474512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.53300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.47799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":472954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59699999999999998,"15min":0.88300000000000001},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72299999999999998,"5min":9.7040000000000006,"15min":9.7040000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.60099999999999998,"15min":0.75700000000000001},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73199999999999998,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.64800000000000002,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":9.8620000000000001,"15min":9.8620000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":9.8439999999999994,"15min":9.8439999999999994},"last":0.497}]},{"osd":2,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.93899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.67500000000000004,"15min":0.97299999999999998},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":10.01,"15min":10.01},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58199999999999996,"15min":0.75},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":5.569,"15min":5.569},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65000000000000002,"15min":0.93799999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66700000000000004,"5min":10.131,"15min":10.131},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.48399999999999999,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64200000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.32000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":1.127},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":9.7799999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.47999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":6.3970000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.46800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":6.5650000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.478},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":0.879},"last":1.234}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.503},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":2.1400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":3.9470000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:04:24.704 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:04:24.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:04:24.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.862+0000 7f060b425700 1 Processor -- start 2023-10-07T09:04:24.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 -- start start 2023-10-07T09:04:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040ce380 con 0x7f0604069aa0 2023-10-07T09:04:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0604069f20 con 0x7f06040af320 2023-10-07T09:04:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.863+0000 7f060b425700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040cec20 con 0x7f0604159950 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06089c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06089c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:59126/0 (socket says 172.21.15.46:59126) 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:47428/0 (socket says 172.21.15.46:47428) 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06089c0700 1 -- 172.21.15.46:0/4080515838 learned_addr learned my addr 172.21.15.46:0/4080515838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 -- 172.21.15.46:0/4080515838 >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 msgr2=0x7f0604069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 --2- 172.21.15.46:0/4080515838 >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 -- 172.21.15.46:0/4080515838 >> v1:172.21.15.133:6789/0 conn(0x7f0604069aa0 legacy=0x7f060415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f0603fff700 1 -- 172.21.15.46:0/4080515838 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269952187 0 0) 0x7f06040ce380 con 0x7f0604069aa0 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 -- 172.21.15.46:0/4080515838 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040afa90 con 0x7f0604159950 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06089c0700 1 --2- 172.21.15.46:0/4080515838 >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.864+0000 7f06091c1700 1 --2- 172.21.15.46:0/4080515838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009e60 tx=0x7f05fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3515d3b583cd8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f0603fff700 1 -- 172.21.15.46:0/4080515838 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00e070 con 0x7f0604159950 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f0603fff700 1 -- 172.21.15.46:0/4080515838 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00bb60 con 0x7f0604159950 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f0603fff700 1 -- 172.21.15.46:0/4080515838 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc012430 con 0x7f0604159950 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 -- 172.21.15.46:0/4080515838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 msgr2=0x7f06040cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 --2- 172.21.15.46:0/4080515838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009e60 tx=0x7f05fc009780 comp rx=0 tx=0).stop 2023-10-07T09:04:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 -- 172.21.15.46:0/4080515838 shutdown_connections 2023-10-07T09:04:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 --2- 172.21.15.46:0/4080515838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604159950 0x7f06040cbb90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 --2- 172.21.15.46:0/4080515838 >> v2:172.21.15.133:3300/0 conn(0x7f06040af320 0x7f0604069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 -- 172.21.15.46:0/4080515838 >> 172.21.15.46:0/4080515838 conn(0x7f0604068e00 msgr2=0x7f06040d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 -- 172.21.15.46:0/4080515838 shutdown_connections 2023-10-07T09:04:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.865+0000 7f060b425700 1 -- 172.21.15.46:0/4080515838 wait complete. 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.866+0000 7f060b425700 1 Processor -- start 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.866+0000 7f060b425700 1 -- start start 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604069aa0 0x7f0604143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06040af320 0x7f060415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041437d0 con 0x7f0604159950 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0604159ec0 con 0x7f06040af320 2023-10-07T09:04:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f060b425700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060415a1a0 con 0x7f0604069aa0 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f06099c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f06099c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52790/0 (socket says 172.21.15.46:52790) 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f06099c2700 1 -- 172.21.15.46:0/2490750706 learned_addr learned my addr 172.21.15.46:0/2490750706 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f06091c1700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604069aa0 0x7f0604143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.867+0000 7f06089c0700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06040af320 0x7f060415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 -- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604069aa0 msgr2=0x7f0604143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604069aa0 0x7f0604143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 -- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06040af320 msgr2=0x7f060415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06040af320 0x7f060415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 -- 172.21.15.46:0/2490750706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80094f0 con 0x7f0604159950 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06099c2700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c5d0 tx=0x7f05f4007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011590 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f40116f0 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc009a20 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011ab0 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.868+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060415a760 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.869+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06040718b0 con 0x7f0604159950 2023-10-07T09:04:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.869+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f05f401b3b0 con 0x7f0604159950 2023-10-07T09:04:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.870+0000 7f06017fa700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 0x7f05f00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.870+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05f4083e50 con 0x7f0604159950 2023-10-07T09:04:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.870+0000 7f06091c1700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 0x7f05f00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.871+0000 7f06091c1700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 0x7f05f00696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f060415e580 tx=0x7f05fc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:24.874+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05f4050d70 con 0x7f0604159950 2023-10-07T09:04:25.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.147+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f06040ce5d0 con 0x7f0604159950 2023-10-07T09:04:25.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.151+0000 7f06017fa700 1 -- 172.21.15.46:0/2490750706 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f05f4017070 con 0x7f0604159950 2023-10-07T09:04:25.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 msgr2=0x7f05f00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 0x7f05f00696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f060415e580 tx=0x7f05fc019000 comp rx=0 tx=0).stop 2023-10-07T09:04:25.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 msgr2=0x7f060415b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c5d0 tx=0x7f05f4007d70 comp rx=0 tx=0).stop 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 shutdown_connections 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05f0067200 0x7f05f00696b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0604159950 0x7f060415b4a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0604069aa0 0x7f0604143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 --2- 172.21.15.46:0/2490750706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06040af320 0x7f060415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 >> 172.21.15.46:0/2490750706 conn(0x7f0604068e00 msgr2=0x7f06040b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 shutdown_connections 2023-10-07T09:04:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.153+0000 7f060b425700 1 -- 172.21.15.46:0/2490750706 wait complete. 2023-10-07T09:04:25.156 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:04:25.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:25.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.286+0000 7fd11ff51700 1 Processor -- start 2023-10-07T09:04:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.286+0000 7fd11ff51700 1 -- start start 2023-10-07T09:04:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11ff51700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd118159890 0x7fd11815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11ff51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 0x7fd11815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11ff51700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11815a160 con 0x7fd11815db10 2023-10-07T09:04:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11ff51700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11815df50 con 0x7fd118159890 2023-10-07T09:04:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11ff51700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180d13a0 con 0x7fd118159c60 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd118159890 0x7fd11815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd118159890 0x7fd11815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52804/0 (socket says 172.21.15.46:52804) 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 -- 172.21.15.46:0/2075297428 learned_addr learned my addr 172.21.15.46:0/2075297428 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11d4ec700 1 --2- 172.21.15.46:0/2075297428 >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 0x7fd11815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 -- 172.21.15.46:0/2075297428 >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 msgr2=0x7fd11815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 --2- 172.21.15.46:0/2075297428 >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 0x7fd11815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 -- 172.21.15.46:0/2075297428 >> v1:172.21.15.133:6789/0 conn(0x7fd11815db10 legacy=0x7fd118069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 -- 172.21.15.46:0/2075297428 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11815e140 con 0x7fd118159890 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11d4ec700 1 --2- 172.21.15.46:0/2075297428 >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 0x7fd11815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.287+0000 7fd11dced700 1 --2- 172.21.15.46:0/2075297428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd11815abd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd1180b67f0 tx=0x7fd108009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bb26637ac117cc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11cceb700 1 -- 172.21.15.46:0/2075297428 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800e070 con 0x7fd118159890 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11cceb700 1 -- 172.21.15.46:0/2075297428 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10800ba10 con 0x7fd118159890 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11cceb700 1 -- 172.21.15.46:0/2075297428 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1080092e0 con 0x7fd118159890 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 -- 172.21.15.46:0/2075297428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 msgr2=0x7fd11815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2075297428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd11815abd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd1180b67f0 tx=0x7fd108009840 comp rx=0 tx=0).stop 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 -- 172.21.15.46:0/2075297428 shutdown_connections 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2075297428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd11815abd0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2075297428 >> v2:172.21.15.133:3300/0 conn(0x7fd118159c60 0x7fd11815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 -- 172.21.15.46:0/2075297428 >> 172.21.15.46:0/2075297428 conn(0x7fd118068e20 msgr2=0x7fd1180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 -- 172.21.15.46:0/2075297428 shutdown_connections 2023-10-07T09:04:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.288+0000 7fd11ff51700 1 -- 172.21.15.46:0/2075297428 wait complete. 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.289+0000 7fd11ff51700 1 Processor -- start 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.289+0000 7fd11ff51700 1 -- start start 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd118159c60 0x7fd1180ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 0x7fd1180c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118152c10 con 0x7fd118159890 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118155ba0 con 0x7fd118159c60 2023-10-07T09:04:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11ff51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd118154fd0 con 0x7fd11815db10 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52810/0 (socket says 172.21.15.46:52810) 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 -- 172.21.15.46:0/2482468038 learned_addr learned my addr 172.21.15.46:0/2482468038 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11d4ec700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd118159c60 0x7fd1180ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11e4ee700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 0x7fd1180c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 -- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 msgr2=0x7fd1180c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 0x7fd1180c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 -- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd118159c60 msgr2=0x7fd1180ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.290+0000 7fd11dced700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd118159c60 0x7fd1180ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd11dced700 1 -- 172.21.15.46:0/2482468038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009ae0 con 0x7fd118159890 2023-10-07T09:04:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd11e4ee700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 0x7fd1180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd11dced700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd118070e20 tx=0x7fd108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108012a20 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108012b80 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118155270 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10801d420 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.291+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd118155830 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.292+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11804c3c0 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.292+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd10801d850 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.293+0000 7fd115ffb700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 0x7fd1040696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.293+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd108086170 con 0x7fd118159890 2023-10-07T09:04:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.293+0000 7fd11d4ec700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 0x7fd1040696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.294+0000 7fd11d4ec700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 0x7fd1040696b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd118157c00 tx=0x7fd10c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.297+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd108052f80 con 0x7fd118159890 2023-10-07T09:04:25.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.534+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd11806a5b0 con 0x7fd118159890 2023-10-07T09:04:25.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.535+0000 7fd115ffb700 1 -- 172.21.15.46:0/2482468038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd1080565a0 con 0x7fd118159890 2023-10-07T09:04:25.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:25.536 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 msgr2=0x7fd1040696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 0x7fd1040696b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd118157c00 tx=0x7fd10c006f90 comp rx=0 tx=0).stop 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 msgr2=0x7fd1181526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd118070e20 tx=0x7fd108017000 comp rx=0 tx=0).stop 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 shutdown_connections 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd104067200 0x7fd1040696b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd11815db10 0x7fd1180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd118159890 0x7fd1181526d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 --2- 172.21.15.46:0/2482468038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd118159c60 0x7fd1180ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 >> 172.21.15.46:0/2482468038 conn(0x7fd118068e20 msgr2=0x7fd118152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 shutdown_connections 2023-10-07T09:04:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:25.537+0000 7fd11ff51700 1 -- 172.21.15.46:0/2482468038 wait complete. 2023-10-07T09:04:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 56 2023-10-07T09:04:25.922 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-10-07T09:04:25.921+0000 7f2ae5b22700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:04:25.952 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:04:19.598548+0000', 'modified': '2023-10-07T09:04:23.222185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6474}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6474': {'gid': 6474, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2597632474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 2597632474}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2597632474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:04:25.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:04:25.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T09:04:26.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.076+0000 7f6d6f15e700 1 Processor -- start 2023-10-07T09:04:26.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.076+0000 7f6d6f15e700 1 -- start start 2023-10-07T09:04:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6f15e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d680caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6f15e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d6815df50 0x7f6d6815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6f15e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6815d7e0 con 0x7f6d6806bcd0 2023-10-07T09:04:26.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6f15e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6815dac0 con 0x7f6d6815df50 2023-10-07T09:04:26.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6f15e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6815aa30 con 0x7f6d6806c0a0 2023-10-07T09:04:26.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6cefa700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6d6806bcd0 0x7f6d6815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32872/0 (socket says 172.21.15.46:32872) 2023-10-07T09:04:26.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6cefa700 1 -- 172.21.15.46:0/4289443705 learned_addr learned my addr 172.21.15.46:0/4289443705 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:26.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d67fff700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d680caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245607134 0 0) 0x7f6d6815d7e0 con 0x7f6d6806bcd0 2023-10-07T09:04:26.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.077+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/4289443705 >> v2:172.21.15.133:3300/0 conn(0x7f6d6815df50 0x7f6d6815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d50003570 con 0x7f6d6806bcd0 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639445787 0 0) 0x7f6d50003570 con 0x7f6d6806bcd0 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 msgr2=0x7f6d680caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d680caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 >> v2:172.21.15.133:3300/0 conn(0x7f6d6815df50 msgr2=0x7f6d6815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 --2- 172.21.15.46:0/4289443705 >> v2:172.21.15.133:3300/0 conn(0x7f6d6815df50 0x7f6d6815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6815ad10 con 0x7f6d6806bcd0 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f6d580017f0 con 0x7f6d6806bcd0 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 >> v1:172.21.15.46:6789/0 conn(0x7f6d6806bcd0 legacy=0x7f6d6815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50003a60 0x7f6d50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d50004810 0x7f6d50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6815dac0 con 0x7f6d50003a60 2023-10-07T09:04:26.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6815aa30 con 0x7f6d50004810 2023-10-07T09:04:26.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5000bae0 con 0x7f6d6806c0a0 2023-10-07T09:04:26.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50003a60 0x7f6d50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d67fff700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d50004810 0x7f6d50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 -- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 msgr2=0x7f6d500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 -- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d50004810 msgr2=0x7f6d50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d50004810 0x7f6d50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 -- 172.21.15.46:0/4289443705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50003570 con 0x7f6d50003a60 2023-10-07T09:04:26.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d6806c0a0 0x7f6d500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:26.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.078+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50003a60 0x7f6d50003e70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800a970 tx=0x7f6d58002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f9e0a00e2e7e12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580070d0 con 0x7f6d50003a60 2023-10-07T09:04:26.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58007230 con 0x7f6d50003a60 2023-10-07T09:04:26.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d677fe700 1 -- 172.21.15.46:0/4289443705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580075d0 con 0x7f6d50003a60 2023-10-07T09:04:26.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 -- 172.21.15.46:0/4289443705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50003a60 msgr2=0x7f6d50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/4289443705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50003a60 0x7f6d50003e70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800a970 tx=0x7f6d58002210 comp rx=0 tx=0).stop 2023-10-07T09:04:26.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/4289443705 reap_dead start 2023-10-07T09:04:26.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 -- 172.21.15.46:0/4289443705 shutdown_connections 2023-10-07T09:04:26.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 -- 172.21.15.46:0/4289443705 >> 172.21.15.46:0/4289443705 conn(0x7f6d680ce600 msgr2=0x7f6d680cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 -- 172.21.15.46:0/4289443705 shutdown_connections 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.079+0000 7f6d6f15e700 1 -- 172.21.15.46:0/4289443705 wait complete. 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.080+0000 7f6d6f15e700 1 Processor -- start 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.080+0000 7f6d6f15e700 1 -- start start 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d680c7e20 0x7f6d680b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d680b3bb0 0x7f6d680cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680cbc40 con 0x7f6d680cb7d0 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d681587a0 con 0x7f6d680b3bb0 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6f15e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68158190 con 0x7f6d680c7e20 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6d6fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6d6fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52818/0 (socket says 172.21.15.46:52818) 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/1624273297 learned_addr learned my addr 172.21.15.46:0/1624273297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d680c7e20 0x7f6d680b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.081+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d680b3bb0 0x7f6d680cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d680c7e20 msgr2=0x7f6d680b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d680c7e20 0x7f6d680b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d680b3bb0 msgr2=0x7f6d680cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d680b3bb0 0x7f6d680cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/1624273297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680b4110 con 0x7f6d680cb7d0 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6d68157db0 tx=0x7f6d60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d64ff9700 1 -- 172.21.15.46:0/1624273297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011ed0 con 0x7f6d680cb7d0 2023-10-07T09:04:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d64ff9700 1 -- 172.21.15.46:0/1624273297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60015670 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d68158430 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d64ff9700 1 -- 172.21.15.46:0/1624273297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60015a10 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.082+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680c81f0 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.083+0000 7f6d64ff9700 1 -- 172.21.15.46:0/1624273297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6d6001e400 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.084+0000 7f6d64ff9700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 0x7f6d540696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.084+0000 7f6d64ff9700 1 -- 172.21.15.46:0/1624273297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d60084b50 con 0x7f6d680cb7d0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.084+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 0x7f6d540696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.085+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 0x7f6d540696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c8bd0 tx=0x7f6d58015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.086+0000 7f6d78456b80 1 Processor -- start 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.086+0000 7f6d78456b80 1 -- start start 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.086+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.086+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f07ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d78456b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2efd7a70 con 0x557b2f080a50 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2efd5270 con 0x557b2f0a9f60 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b2efd1060 con 0x557b2f0cad00 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52822/0 (socket says 172.21.15.46:52822) 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1443453081 learned_addr learned my addr 172.21.15.46:0/1443453081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f07ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 msgr2=0x557b2f0a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 msgr2=0x557b2f07ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f07ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1443453081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b2ee6b270 con 0x557b2f080a50 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800af60 tx=0x7f6d58023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237ada9d1f623013 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d4dffb700 1 -- 172.21.15.46:0/1443453081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5802f070 con 0x557b2f080a50 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d4dffb700 1 -- 172.21.15.46:0/1443453081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58001350 con 0x557b2f080a50 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.087+0000 7f6d4dffb700 1 -- 172.21.15.46:0/1443453081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58023070 con 0x557b2f080a50 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 -- 172.21.15.46:0/1443453081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 msgr2=0x557b2f080e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800af60 tx=0x7f6d58023000 comp rx=0 tx=0).stop 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 -- 172.21.15.46:0/1443453081 shutdown_connections 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f07ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f080e20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1443453081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 -- 172.21.15.46:0/1443453081 >> 172.21.15.46:0/1443453081 conn(0x557b2f082370 msgr2=0x557b2f082740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 -- 172.21.15.46:0/1443453081 shutdown_connections 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.088+0000 7f6d78456b80 1 -- 172.21.15.46:0/1443453081 wait complete. 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.089+0000 7f6d78456b80 1 -- start start 2023-10-07T09:04:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.089+0000 7f6d78456b80 1 Processor -- start 2023-10-07T09:04:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0dae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2ef7c890 con 0x557b2f080a50 2023-10-07T09:04:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2ef97ea0 con 0x557b2f0a9f60 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b2ee53e30 con 0x557b2f0cad00 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 10 client.0 _ll_register_callbacks cb 0x557b2f044110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52838/0 (socket says 172.21.15.46:52838) 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 -- 172.21.15.46:0/2165390578 learned_addr learned my addr 172.21.15.46:0/2165390578 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d67fff700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 -- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 msgr2=0x557b2f0dae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0dae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 -- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 msgr2=0x557b2f0a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f0a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 -- 172.21.15.46:0/2165390578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50003570 con 0x557b2f080a50 2023-10-07T09:04:26.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6d58002250 tx=0x7f6d5802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41007e340aba604e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5803b070 con 0x557b2f080a50 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d58036600 con 0x557b2f080a50 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.090+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b2f052aa0 con 0x557b2f080a50 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d58023040 con 0x557b2f080a50 2023-10-07T09:04:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 10 client.6600 fetch_fsmap learned FSMap version 56 2023-10-07T09:04:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x557b2ee0dfe0 con 0x557b2f080a50 2023-10-07T09:04:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b2f052aa0 con 0x557b2f080a50 2023-10-07T09:04:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6d580369d0 con 0x557b2f080a50 2023-10-07T09:04:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 10 client.6600 fetch_fsmap finished waiting for FSMap version 56 2023-10-07T09:04:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 10 client.6600 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 20 client.6600 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0c4a30 0x557b2f0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 4 client.6600 mds_command: new command op to 6474 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 --> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b2ef73e00 con 0x557b2f0c4a30 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d67fff700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0c4a30 0x557b2f0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d46ffd700 10 client.6600 ms_handle_connect on v2:172.21.15.133:6835/2597632474 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.091+0000 7f6d67fff700 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0c4a30 0x557b2f0c30d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73e57af06e405a25 server_cookie=dc98aa50e34c212e in_seq=0 out_seq=0 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d46ffd700 1 -- 172.21.15.46:0/2165390578 <== mds.0 v2:172.21.15.133:6835/2597632474 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557b2ef73e00 con 0x557b2f0c4a30 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d46ffd700 10 client.6600 handle_command_reply: tid=0 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 client.6600 shutdown 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 msgr2=0x557b2f0c0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6d58002250 tx=0x7f6d5802f000 comp rx=0 tx=0).stop 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 shutdown_connections 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0c4a30 0x557b2f0c30d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0cad00 0x557b2f0dae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d46ffd700 0 client.6600 ms_handle_reset on v2:172.21.15.133:6835/2597632474 2023-10-07T09:04:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.092+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f0c0190 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.093+0000 7f6d78456b80 1 --2- 172.21.15.46:0/2165390578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0a9f60 0x557b2f0a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.093+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 >> 172.21.15.46:0/2165390578 conn(0x557b2f082370 msgr2=0x557b2f07bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.093+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 shutdown_connections 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.093+0000 7f6d78456b80 1 -- 172.21.15.46:0/2165390578 wait complete. 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.093+0000 7f6d78456b80 20 client.6600 trim_cache size 0 max 16384 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.109+0000 7f6d78456b80 1 Processor -- start 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 -- start start 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 0x557b2f0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2f0c5630 con 0x557b2f0c4a30 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2f07b830 con 0x557b2f080a50 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b2f07f180 con 0x557b2f0a9f60 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d6d6fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d6d6fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52848/0 (socket says 172.21.15.46:52848) 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.110+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/3938801327 learned_addr learned my addr 172.21.15.46:0/3938801327 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 0x557b2f0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d67fff700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 msgr2=0x557b2f0a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f0a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 msgr2=0x557b2f0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 0x557b2f0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 -- 172.21.15.46:0/3938801327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b2ef9f780 con 0x557b2f0c4a30 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 0x557b2f0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6d60055430 tx=0x7f6d60017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0b12f199e7197d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d4e7fc700 1 -- 172.21.15.46:0/3938801327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60055730 con 0x557b2f0c4a30 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d4e7fc700 1 -- 172.21.15.46:0/3938801327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60058980 con 0x557b2f0c4a30 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d4e7fc700 1 -- 172.21.15.46:0/3938801327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6005c6d0 con 0x557b2f0c4a30 2023-10-07T09:04:26.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 -- 172.21.15.46:0/3938801327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 msgr2=0x557b2f080e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6d60055430 tx=0x7f6d60017040 comp rx=0 tx=0).stop 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 -- 172.21.15.46:0/3938801327 shutdown_connections 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f0c4a30 0x557b2f080e20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f080a50 0x557b2f0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 --2- 172.21.15.46:0/3938801327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f0a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 -- 172.21.15.46:0/3938801327 >> 172.21.15.46:0/3938801327 conn(0x557b2f082370 msgr2=0x557b2f07ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 -- 172.21.15.46:0/3938801327 shutdown_connections 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.111+0000 7f6d78456b80 1 -- 172.21.15.46:0/3938801327 wait complete. 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.112+0000 7f6d78456b80 1 -- start start 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.112+0000 7f6d78456b80 1 Processor -- start 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f07de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 0x557b2f0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2f0b0130 con 0x557b2f080a50 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2f081040 con 0x557b2f0c4a30 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b2f0bd7c0 con 0x557b2f0a9f60 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d78456b80 10 client.0 _ll_register_callbacks cb 0x557b2f044110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:26.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52864/0 (socket says 172.21.15.46:52864) 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1224295939 learned_addr learned my addr 172.21.15.46:0/1224295939 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f07de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 0x557b2f0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 msgr2=0x557b2f07de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f07de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 msgr2=0x557b2f0c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 0x557b2f0c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 -- 172.21.15.46:0/1224295939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680c81f0 con 0x557b2f080a50 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f07de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6d6fb700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 0x557b2f0c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d6cefa700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6d58040af0 tx=0x7f6d58038070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95bc45009fe7a72 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.113+0000 7f6d46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5802f030 con 0x557b2f080a50 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d58036e40 con 0x557b2f080a50 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b2f075b70 con 0x557b2f080a50 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d5803b040 con 0x557b2f080a50 2023-10-07T09:04:26.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 10 client.6606 fetch_fsmap learned FSMap version 56 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x557b2ef86470 con 0x557b2f080a50 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b2f075b70 con 0x557b2f080a50 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6d58034620 con 0x557b2f080a50 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 10 client.6606 fetch_fsmap finished waiting for FSMap version 56 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 10 client.6606 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 20 client.6606 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0cad00 0x557b2f0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 4 client.6606 mds_command: new command op to 6474 tid=0[{"prefix": "status"}] 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 --> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b2ef73b20 con 0x557b2f0cad00 2023-10-07T09:04:26.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.114+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0cad00 0x557b2f0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d46ffd700 10 client.6606 ms_handle_connect on v2:172.21.15.133:6835/2597632474 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d67fff700 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0cad00 0x557b2f0c2110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8767e6c44f215717 server_cookie=ba0336c8e9f97d18 in_seq=0 out_seq=0 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d46ffd700 1 -- 172.21.15.46:0/1224295939 <== mds.0 v2:172.21.15.133:6835/2597632474 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557b2ef73b20 con 0x557b2f0cad00 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d46ffd700 10 client.6606 handle_command_reply: tid=0 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 client.6606 shutdown 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 msgr2=0x557b2f07d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6d58040af0 tx=0x7f6d58038070 comp rx=0 tx=0).stop 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 shutdown_connections 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:6835/2597632474,v1:172.21.15.133:6837/2597632474] conn(0x557b2f0cad00 0x557b2f0c2110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b2f0c4a30 0x557b2f0c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b2f080a50 0x557b2f07d8d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 --2- 172.21.15.46:0/1224295939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557b2f0a9f60 0x557b2f07de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d46ffd700 0 client.6606 ms_handle_reset on v2:172.21.15.133:6835/2597632474 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 >> 172.21.15.46:0/1224295939 conn(0x557b2f082370 msgr2=0x557b2f0794b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 shutdown_connections 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 1 -- 172.21.15.46:0/1224295939 wait complete. 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.115+0000 7f6d78456b80 20 client.6606 trim_cache size 0 max 16384 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:26.174 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 6474, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9076696330000003, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 56, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 90, 2023-10-07T09:04:26.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.979112674 2023-10-07T09:04:26.260 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 msgr2=0x7f6d540696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 0x7f6d540696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c8bd0 tx=0x7f6d58015000 comp rx=0 tx=0).stop 2023-10-07T09:04:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 msgr2=0x7f6d681533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6d68157db0 tx=0x7f6d60008040 comp rx=0 tx=0).stop 2023-10-07T09:04:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 shutdown_connections 2023-10-07T09:04:26.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6d54067200 0x7f6d540696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d680cb7d0 0x7f6d681533d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6d680c7e20 0x7f6d680b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 --2- 172.21.15.46:0/1624273297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d680b3bb0 0x7f6d680cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 >> 172.21.15.46:0/1624273297 conn(0x7f6d680ce600 msgr2=0x7f6d6815b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 shutdown_connections 2023-10-07T09:04:26.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.116+0000 7f6d6f15e700 1 -- 172.21.15.46:0/1624273297 wait complete. 2023-10-07T09:04:26.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:26.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.387+0000 7f30f2136700 1 Processor -- start 2023-10-07T09:04:26.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.387+0000 7f30f2136700 1 -- start start 2023-10-07T09:04:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f2136700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f2136700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30ec1597f0 0x7f30ec0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f2136700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec0b11d0 con 0x7f30ec15d230 2023-10-07T09:04:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f2136700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec0b14b0 con 0x7f30ec1597f0 2023-10-07T09:04:26.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f2136700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0b1790 con 0x7f30ec159420 2023-10-07T09:04:26.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f0933700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30ec1597f0 0x7f30ec0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f0933700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30ec1597f0 0x7f30ec0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52868/0 (socket says 172.21.15.46:52868) 2023-10-07T09:04:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f0933700 1 -- 172.21.15.46:0/2584301732 learned_addr learned my addr 172.21.15.46:0/2584301732 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.388+0000 7f30f1134700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f0933700 1 -- 172.21.15.46:0/2584301732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 msgr2=0x7f30ec0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:26.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f0933700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f0933700 1 -- 172.21.15.46:0/2584301732 >> v1:172.21.15.133:6789/0 conn(0x7f30ec15d230 legacy=0x7f30ec0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f0933700 1 -- 172.21.15.46:0/2584301732 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0b1a70 con 0x7f30ec1597f0 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f0933700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec0b2270 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30e00099b0 tx=0x7f30e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82449a1ec2b4797b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30ebfff700 1 -- 172.21.15.46:0/2584301732 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0009ea0 con 0x7f30ec1597f0 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30ebfff700 1 -- 172.21.15.46:0/2584301732 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000b860 con 0x7f30ec1597f0 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30ebfff700 1 -- 172.21.15.46:0/2584301732 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e000bc00 con 0x7f30ec1597f0 2023-10-07T09:04:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 -- 172.21.15.46:0/2584301732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 msgr2=0x7f30ec0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec0b2270 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30e00099b0 tx=0x7f30e0009250 comp rx=0 tx=0).stop 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 -- 172.21.15.46:0/2584301732 shutdown_connections 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 --2- 172.21.15.46:0/2584301732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec0b2270 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.389+0000 7f30f2136700 1 -- 172.21.15.46:0/2584301732 >> 172.21.15.46:0/2584301732 conn(0x7f30ec0d0660 msgr2=0x7f30ec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.390+0000 7f30f2136700 1 -- 172.21.15.46:0/2584301732 shutdown_connections 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.390+0000 7f30f2136700 1 -- 172.21.15.46:0/2584301732 wait complete. 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.391+0000 7f30f2136700 1 Processor -- start 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.391+0000 7f30f2136700 1 -- start start 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec15d230 0x7f30ec156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec16a420 con 0x7f30ec1597f0 2023-10-07T09:04:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec151850 con 0x7f30ec15d230 2023-10-07T09:04:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec169af0 con 0x7f30ec159420 2023-10-07T09:04:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52876/0 (socket says 172.21.15.46:52876) 2023-10-07T09:04:26.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 -- 172.21.15.46:0/1171202942 learned_addr learned my addr 172.21.15.46:0/1171202942 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:26.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f1134700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f1935700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec15d230 0x7f30ec156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 -- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 msgr2=0x7f30ec166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 -- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec15d230 msgr2=0x7f30ec156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec15d230 0x7f30ec156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 -- 172.21.15.46:0/1171202942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00094f0 con 0x7f30ec1597f0 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f0933700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30ec089340 tx=0x7f30e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0000d10 con 0x7f30ec1597f0 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000bbe0 con 0x7f30ec1597f0 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec169dd0 con 0x7f30ec1597f0 2023-10-07T09:04:26.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0011670 con 0x7f30ec1597f0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.392+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec16ddd0 con 0x7f30ec1597f0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.393+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec16a590 con 0x7f30ec1597f0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.394+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f30e0011aa0 con 0x7f30ec1597f0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.394+0000 7f30e97fa700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 0x7f30d80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.394+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30e00861e0 con 0x7f30ec1597f0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.394+0000 7f30f1134700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 0x7f30d80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.395+0000 7f30f1134700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 0x7f30d80696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fd0 tx=0x7f30dc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:26.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.398+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30e0053100 con 0x7f30ec1597f0 2023-10-07T09:04:26.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.635+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30ec04c3c0 con 0x7f30ec1597f0 2023-10-07T09:04:26.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.636+0000 7f30e97fa700 1 -- 172.21.15.46:0/1171202942 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f30e0056720 con 0x7f30ec1597f0 2023-10-07T09:04:26.721 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 msgr2=0x7f30d80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 0x7f30d80696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fd0 tx=0x7f30dc00b040 comp rx=0 tx=0).stop 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 msgr2=0x7f30ec150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30ec089340 tx=0x7f30e0017000 comp rx=0 tx=0).stop 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 shutdown_connections 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30d8067200 0x7f30d80696b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec15d230 0x7f30ec156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30ec159420 0x7f30ec166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 --2- 172.21.15.46:0/1171202942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec1597f0 0x7f30ec150db0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 >> 172.21.15.46:0/1171202942 conn(0x7f30ec0d0660 msgr2=0x7f30ec0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 shutdown_connections 2023-10-07T09:04:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:26.638+0000 7f30f2136700 1 -- 172.21.15.46:0/1171202942 wait complete. 2023-10-07T09:04:26.724 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:26.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:26.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:04:26.724 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:04:26.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:26.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:26.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:26.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:26.725 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:26.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.725 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:04:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:26.741 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42147sec preferred_lft 42147sec 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:04:26.745 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:04:26.745 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:26.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.745 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:26.810 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:04:26.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:04:26.870 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:04:26.870 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:26.870 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:04:26.870 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:04:26.871 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:26.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:04:26.871 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:04:26.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:04:26.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:04:26.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:04:26.872 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:04:26.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.973 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:04:26.990 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:04:26.990 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:04:26.990 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:26.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:26.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:04:27.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:27.056 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:27.111 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:27.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:27.111 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:27.166 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:04:27.166 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:27.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:27.247 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:27.266 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:27.266 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:27.266 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:27.266 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:27.267 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:27.267 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:27.267 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:27.267 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:27.290 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:27.291 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:27.291 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:27.291 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:27.292 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:27.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:27.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:27.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.518+0000 7f380ceeb700 1 Processor -- start 2023-10-07T09:04:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.518+0000 7f380ceeb700 1 -- start start 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f380ceeb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 0x7f38080b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f380ceeb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f380815d230 0x7f380815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f380ceeb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380815db70 con 0x7f3808159420 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f380ceeb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080b11d0 con 0x7f380815d230 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f380ceeb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080b14b0 con 0x7f38081597f0 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3807fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f380815d230 0x7f380815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f38077fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3808159420 0x7f38080b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32876/0 (socket says 172.21.15.46:32876) 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f38077fe700 1 -- 172.21.15.46:0/1389178302 learned_addr learned my addr 172.21.15.46:0/1389178302 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3806ffd700 1 --2- 172.21.15.46:0/1389178302 >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 0x7f38080b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3807fff700 1 -- 172.21.15.46:0/1389178302 >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 msgr2=0x7f38080b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3807fff700 1 --2- 172.21.15.46:0/1389178302 >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 0x7f38080b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3807fff700 1 -- 172.21.15.46:0/1389178302 >> v1:172.21.15.46:6789/0 conn(0x7f3808159420 legacy=0x7f38080b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3807fff700 1 -- 172.21.15.46:0/1389178302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080b1790 con 0x7f380815d230 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f38067fc700 1 -- 172.21.15.46:0/1389178302 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994773357 0 0) 0x7f380815db70 con 0x7f3808159420 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.519+0000 7f3806ffd700 1 --2- 172.21.15.46:0/1389178302 >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 0x7f38080b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f3807fff700 1 --2- 172.21.15.46:0/1389178302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f380815d230 0x7f380815d630 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3808089750 tx=0x7f3800009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0766fbafd6c323 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f38067fc700 1 -- 172.21.15.46:0/1389178302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000e070 con 0x7f380815d230 2023-10-07T09:04:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f38067fc700 1 -- 172.21.15.46:0/1389178302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000bc30 con 0x7f380815d230 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f38067fc700 1 -- 172.21.15.46:0/1389178302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800012430 con 0x7f380815d230 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 -- 172.21.15.46:0/1389178302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f380815d230 msgr2=0x7f380815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 --2- 172.21.15.46:0/1389178302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f380815d230 0x7f380815d630 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3808089750 tx=0x7f3800009780 comp rx=0 tx=0).stop 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 -- 172.21.15.46:0/1389178302 shutdown_connections 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 --2- 172.21.15.46:0/1389178302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f380815d230 0x7f380815d630 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 --2- 172.21.15.46:0/1389178302 >> v2:172.21.15.133:3300/0 conn(0x7f38081597f0 0x7f38080b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 -- 172.21.15.46:0/1389178302 >> 172.21.15.46:0/1389178302 conn(0x7f38080d0660 msgr2=0x7f38080d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 -- 172.21.15.46:0/1389178302 shutdown_connections 2023-10-07T09:04:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.520+0000 7f380ceeb700 1 -- 172.21.15.46:0/1389178302 wait complete. 2023-10-07T09:04:27.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 Processor -- start 2023-10-07T09:04:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 -- start start 2023-10-07T09:04:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3808159420 0x7f3808153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380815d230 0x7f380815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808153810 con 0x7f38081597f0 2023-10-07T09:04:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808153200 con 0x7f380815d230 2023-10-07T09:04:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f380ceeb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380815bdc0 con 0x7f3808159420 2023-10-07T09:04:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f3806ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.522+0000 7f3806ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52894/0 (socket says 172.21.15.46:52894) 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 -- 172.21.15.46:0/2056964059 learned_addr learned my addr 172.21.15.46:0/2056964059 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f38077fe700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3808159420 0x7f3808153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 -- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3808159420 msgr2=0x7f3808153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3808159420 0x7f3808153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 -- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380815d230 msgr2=0x7f380815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380815d230 0x7f380815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 -- 172.21.15.46:0/2056964059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800009a20 con 0x7f38081597f0 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f3806ffd700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c880 tx=0x7f37fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011600 con 0x7f38081597f0 2023-10-07T09:04:27.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc011760 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011ae0 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380815c0a0 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.523+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380814f9e0 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.524+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380804c3c0 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.524+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f37fc0073d0 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.525+0000 7f37ef7fe700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 0x7f37f40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.525+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37fc084b50 con 0x7f38081597f0 2023-10-07T09:04:27.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.525+0000 7f38077fe700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 0x7f37f40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:27.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.526+0000 7f38077fe700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 0x7f37f40696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:27.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.529+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37fc051960 con 0x7f38081597f0 2023-10-07T09:04:27.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.765+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38080b1a70 con 0x7f38081597f0 2023-10-07T09:04:27.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.765+0000 7f37ef7fe700 1 -- 172.21.15.46:0/2056964059 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37fc015070 con 0x7f38081597f0 2023-10-07T09:04:27.766 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 msgr2=0x7f37f40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 0x7f37f40696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8009040 comp rx=0 tx=0).stop 2023-10-07T09:04:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 msgr2=0x7f380814f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c880 tx=0x7f37fc008040 comp rx=0 tx=0).stop 2023-10-07T09:04:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 shutdown_connections 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f37f4067200 0x7f37f40696b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380815d230 0x7f380815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3808159420 0x7f3808153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 --2- 172.21.15.46:0/2056964059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38081597f0 0x7f380814f4a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 >> 172.21.15.46:0/2056964059 conn(0x7f38080d0660 msgr2=0x7f3808157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 shutdown_connections 2023-10-07T09:04:27.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:27.768+0000 7f380ceeb700 1 -- 172.21.15.46:0/2056964059 wait complete. 2023-10-07T09:04:27.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:27.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:27.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:04:27.814 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:04:27.814 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:27.814 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:27.815 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:27.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:27.815 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:27.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:27.816 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:04:27.835 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:27.835 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:27.835 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:27.835 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:27.836 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42138sec preferred_lft 42138sec 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:04:27.837 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:27.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:27.838 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:27.903 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:04:27.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:27.905 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:04:27.963 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:04:27.968 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:27.968 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:04:27.968 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:04:27.968 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:27.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:27.968 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:04:27.968 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:04:27.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:04:27.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:04:27.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:04:27.969 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:04:28.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:28.068 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:04:28.083 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:04:28.083 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:04:28.083 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:28.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:28.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:04:28.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:28.148 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:28.202 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:28.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:28.203 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:28.258 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:04:28.259 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:28.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:28.339 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:28.339 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:28.360 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:28.379 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:28.380 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:28.380 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:28.380 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:28.381 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:28.382 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:28.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:28.383 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:28.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:04:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.576+0000 7f422a8ac700 1 Processor -- start 2023-10-07T09:04:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.576+0000 7f422a8ac700 1 -- start start 2023-10-07T09:04:28.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a8ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f42240cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a8ac700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42241591e0 0x7f4224159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a8ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240cfa00 con 0x7f42240b03c0 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a8ac700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240cb580 con 0x7f42241591e0 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a8ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240cf160 con 0x7f42240b0790 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a0ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42241591e0 0x7f4224159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a0ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42241591e0 0x7f4224159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52908/0 (socket says 172.21.15.46:52908) 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f422a0ab700 1 -- 172.21.15.46:0/520742142 learned_addr learned my addr 172.21.15.46:0/520742142 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.577+0000 7f42290a9700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f42240cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a0ab700 1 -- 172.21.15.46:0/520742142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 msgr2=0x7f42240cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a0ab700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f42240cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a0ab700 1 -- 172.21.15.46:0/520742142 >> v1:172.21.15.133:6789/0 conn(0x7f42240b03c0 legacy=0x7f42240b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a0ab700 1 -- 172.21.15.46:0/520742142 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240cf440 con 0x7f42241591e0 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f42290a9700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f42240cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a0ab700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f4224159620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4214009f20 tx=0x7f4214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce70d7c96b45037 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f42288a8700 1 -- 172.21.15.46:0/520742142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400e070 con 0x7f42241591e0 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f42288a8700 1 -- 172.21.15.46:0/520742142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400ba80 con 0x7f42241591e0 2023-10-07T09:04:28.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f42288a8700 1 -- 172.21.15.46:0/520742142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140092e0 con 0x7f42241591e0 2023-10-07T09:04:28.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 -- 172.21.15.46:0/520742142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 msgr2=0x7f4224159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:28.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f4224159620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4214009f20 tx=0x7f4214009840 comp rx=0 tx=0).stop 2023-10-07T09:04:28.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 -- 172.21.15.46:0/520742142 shutdown_connections 2023-10-07T09:04:28.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f4224159620 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 --2- 172.21.15.46:0/520742142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f42240cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.578+0000 7f422a8ac700 1 -- 172.21.15.46:0/520742142 >> 172.21.15.46:0/520742142 conn(0x7f4224063230 msgr2=0x7f4224063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.579+0000 7f422a8ac700 1 -- 172.21.15.46:0/520742142 shutdown_connections 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.579+0000 7f422a8ac700 1 -- 172.21.15.46:0/520742142 wait complete. 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 Processor -- start 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 -- start start 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42240b03c0 0x7f4224169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f4224169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224166e00 con 0x7f42241591e0 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240c51a0 con 0x7f42240b03c0 2023-10-07T09:04:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a8ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240c4590 con 0x7f42240b0790 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a0ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a0ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52920/0 (socket says 172.21.15.46:52920) 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.580+0000 7f422a0ab700 1 -- 172.21.15.46:0/2297298904 learned_addr learned my addr 172.21.15.46:0/2297298904 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 -- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 msgr2=0x7f4224169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f42298aa700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42240b03c0 0x7f4224169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f4224169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 -- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42240b03c0 msgr2=0x7f4224169390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42240b03c0 0x7f4224169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 -- 172.21.15.46:0/2297298904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214009ae0 con 0x7f42241591e0 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a0ab700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f421400b6c0 tx=0x7f4214018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140032f0 con 0x7f42241591e0 2023-10-07T09:04:28.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214008e40 con 0x7f42241591e0 2023-10-07T09:04:28.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240c4870 con 0x7f42241591e0 2023-10-07T09:04:28.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214026690 con 0x7f42241591e0 2023-10-07T09:04:28.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.581+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240c4e30 con 0x7f42241591e0 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.582+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422404c3c0 con 0x7f42241591e0 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.583+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4214003040 con 0x7f42241591e0 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.583+0000 7f4221ffb700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 0x7f42100696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.583+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4214086af0 con 0x7f42241591e0 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.583+0000 7f42298aa700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 0x7f42100696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.584+0000 7f42298aa700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 0x7f42100696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f421c0016c0 tx=0x7f421c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:28.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.587+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4214053820 con 0x7f42241591e0 2023-10-07T09:04:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:28.825+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42240c52e0 con 0x7f42241591e0 2023-10-07T09:04:29.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.160+0000 7f4221ffb700 1 -- 172.21.15.46:0/2297298904 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4214056e40 con 0x7f42241591e0 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 msgr2=0x7f42100696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 0x7f42100696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f421c0016c0 tx=0x7f421c009040 comp rx=0 tx=0).stop 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 msgr2=0x7f42240c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f421400b6c0 tx=0x7f4214018000 comp rx=0 tx=0).stop 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 shutdown_connections 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4210067200 0x7f42100696b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42241591e0 0x7f42240c6020 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42240b03c0 0x7f4224169390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 --2- 172.21.15.46:0/2297298904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42240b0790 0x7f4224169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 >> 172.21.15.46:0/2297298904 conn(0x7f4224063230 msgr2=0x7f42240b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:29.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 shutdown_connections 2023-10-07T09:04:29.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.163+0000 7f422a8ac700 1 -- 172.21.15.46:0/2297298904 wait complete. 2023-10-07T09:04:29.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:04:29.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.298+0000 7fd275403700 1 Processor -- start 2023-10-07T09:04:29.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.298+0000 7fd275403700 1 -- start start 2023-10-07T09:04:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd275403700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2701594d0 0x7fd2700cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd275403700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd275403700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700d01f0 con 0x7fd270159de0 2023-10-07T09:04:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd275403700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700cf5e0 con 0x7fd2701594d0 2023-10-07T09:04:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd275403700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700cf8c0 con 0x7fd2700b5fb0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2701594d0 0x7fd2700cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2701594d0 0x7fd2700cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52934/0 (socket says 172.21.15.46:52934) 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 -- 172.21.15.46:0/29833520 learned_addr learned my addr 172.21.15.46:0/29833520 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26e7fc700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 -- 172.21.15.46:0/29833520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 msgr2=0x7fd2701598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 -- 172.21.15.46:0/29833520 >> v1:172.21.15.133:6789/0 conn(0x7fd270159de0 legacy=0x7fd27015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 -- 172.21.15.46:0/29833520 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700cfba0 con 0x7fd2701594d0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.299+0000 7fd26effd700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd2700cd0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575b4ea1f9a30108 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd26dffb700 1 -- 172.21.15.46:0/29833520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268009ea0 con 0x7fd2701594d0 2023-10-07T09:04:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd26dffb700 1 -- 172.21.15.46:0/29833520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800b860 con 0x7fd2701594d0 2023-10-07T09:04:29.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd26dffb700 1 -- 172.21.15.46:0/29833520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800bc00 con 0x7fd2701594d0 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 -- 172.21.15.46:0/29833520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 msgr2=0x7fd2700cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd2700cd0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268009250 comp rx=0 tx=0).stop 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 -- 172.21.15.46:0/29833520 shutdown_connections 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd2700cd0f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 --2- 172.21.15.46:0/29833520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 -- 172.21.15.46:0/29833520 >> 172.21.15.46:0/29833520 conn(0x7fd2700d05f0 msgr2=0x7fd2700d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:29.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 -- 172.21.15.46:0/29833520 shutdown_connections 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.300+0000 7fd275403700 1 -- 172.21.15.46:0/29833520 wait complete. 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.301+0000 7fd275403700 1 Processor -- start 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.301+0000 7fd275403700 1 -- start start 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd270159de0 0x7fd270068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270158430 con 0x7fd2701594d0 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270158e00 con 0x7fd270159de0 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd275403700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd270140c80 con 0x7fd2700b5fb0 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd26e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd26e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52944/0 (socket says 172.21.15.46:52944) 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd26e7fc700 1 -- 172.21.15.46:0/3951590184 learned_addr learned my addr 172.21.15.46:0/3951590184 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:29.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd26effd700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.302+0000 7fd26f7fe700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd270159de0 0x7fd270068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 -- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 msgr2=0x7fd2701588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 -- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd270159de0 msgr2=0x7fd270068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd270159de0 0x7fd270068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 -- 172.21.15.46:0/3951590184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680094f0 con 0x7fd2701594d0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd26e7fc700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd25800ec80 tx=0x7fd2580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800c850 con 0x7fd2701594d0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800c9b0 con 0x7fd2701594d0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd270157820 con 0x7fd2701594d0 2023-10-07T09:04:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800cd50 con 0x7fd2701594d0 2023-10-07T09:04:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.303+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd270157de0 con 0x7fd2701594d0 2023-10-07T09:04:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.304+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27004c3c0 con 0x7fd2701594d0 2023-10-07T09:04:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.304+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd258013680 con 0x7fd2701594d0 2023-10-07T09:04:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.305+0000 7fd266ffd700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 0x7fd2500696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.305+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd258084bb0 con 0x7fd2701594d0 2023-10-07T09:04:29.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.305+0000 7fd26effd700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 0x7fd2500696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.305+0000 7fd26effd700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 0x7fd2500696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.309+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd258051ad0 con 0x7fd2701594d0 2023-10-07T09:04:29.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.531+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd270158570 con 0x7fd250067200 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.533+0000 7fd266ffd700 1 -- 172.21.15.46:0/3951590184 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd270158570 con 0x7fd250067200 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:29.533 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:04:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 msgr2=0x7fd2500696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 0x7fd2500696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268017000 comp rx=0 tx=0).stop 2023-10-07T09:04:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 msgr2=0x7fd270140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd25800ec80 tx=0x7fd2580091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 shutdown_connections 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd250067200 0x7fd2500696b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd270159de0 0x7fd270068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2700b5fb0 0x7fd2701588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 --2- 172.21.15.46:0/3951590184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2701594d0 0x7fd270140740 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 >> 172.21.15.46:0/3951590184 conn(0x7fd2700d05f0 msgr2=0x7fd270155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 shutdown_connections 2023-10-07T09:04:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.534+0000 7fd275403700 1 -- 172.21.15.46:0/3951590184 wait complete. 2023-10-07T09:04:29.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:04:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.669+0000 7f5f3eb60700 1 Processor -- start 2023-10-07T09:04:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.669+0000 7f5f3eb60700 1 -- start start 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.669+0000 7f5f3eb60700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 0x7f5f3815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3eb60700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 0x7f5f380699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3eb60700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3815a160 con 0x7f5f38159c60 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3eb60700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f38069f20 con 0x7f5f38069560 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3eb60700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380d13a0 con 0x7f5f38159890 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3d0fd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 0x7f5f380699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 0x7f5f3815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f37fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5f38159c60 0x7f5f3815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39416/0 (socket says 172.21.15.46:39416) 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f37fff700 1 -- 172.21.15.46:0/31404169 learned_addr learned my addr 172.21.15.46:0/31404169 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f377fe700 1 -- 172.21.15.46:0/31404169 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630336564 0 0) 0x7f5f3815a160 con 0x7f5f38159c60 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f377fe700 1 -- 172.21.15.46:0/31404169 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f20003570 con 0x7f5f38159c60 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 -- 172.21.15.46:0/31404169 >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 msgr2=0x7f5f380699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 --2- 172.21.15.46:0/31404169 >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 0x7f5f380699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 -- 172.21.15.46:0/31404169 >> v1:172.21.15.133:6789/0 conn(0x7f5f38159c60 legacy=0x7f5f3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 -- 172.21.15.46:0/31404169 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3815e140 con 0x7f5f38159890 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3d0fd700 1 --2- 172.21.15.46:0/31404169 >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 0x7f5f380699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.670+0000 7f5f3c8fc700 1 --2- 172.21.15.46:0/31404169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 0x7f5f3815abd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e60 tx=0x7f5f30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6e434ae2502cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f377fe700 1 -- 172.21.15.46:0/31404169 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000e070 con 0x7f5f38159890 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f377fe700 1 -- 172.21.15.46:0/31404169 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000bab0 con 0x7f5f38159890 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f377fe700 1 -- 172.21.15.46:0/31404169 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000be70 con 0x7f5f38159890 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 -- 172.21.15.46:0/31404169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 msgr2=0x7f5f3815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/31404169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 0x7f5f3815abd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e60 tx=0x7f5f30009780 comp rx=0 tx=0).stop 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 -- 172.21.15.46:0/31404169 shutdown_connections 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/31404169 >> v2:172.21.15.133:3300/0 conn(0x7f5f38069560 0x7f5f380699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/31404169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38159890 0x7f5f3815abd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 -- 172.21.15.46:0/31404169 >> 172.21.15.46:0/31404169 conn(0x7f5f38068e20 msgr2=0x7f5f380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 -- 172.21.15.46:0/31404169 shutdown_connections 2023-10-07T09:04:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.671+0000 7f5f3eb60700 1 -- 172.21.15.46:0/31404169 wait complete. 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.672+0000 7f5f3eb60700 1 Processor -- start 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 -- start start 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38069560 0x7f5f380c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f38159c60 0x7f5f3816a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38157f30 con 0x7f5f38159890 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c80d0 con 0x7f5f38159c60 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f3eb60700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c83b0 con 0x7f5f38069560 2023-10-07T09:04:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35792/0 (socket says 172.21.15.46:35792) 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.673+0000 7f5f37fff700 1 -- 172.21.15.46:0/934293640 learned_addr learned my addr 172.21.15.46:0/934293640 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f3d0fd700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f38159c60 0x7f5f3816a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f3c8fc700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38069560 0x7f5f380c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 -- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38069560 msgr2=0x7f5f380c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38069560 0x7f5f380c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 -- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f38159c60 msgr2=0x7f5f3816a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f38159c60 0x7f5f3816a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 -- 172.21.15.46:0/934293640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009420 con 0x7f5f38159890 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f37fff700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c7c0 tx=0x7f5f2c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c005c00 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c005d60 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f30009a20 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c007300 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.674+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f380c8970 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.675+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f380b3690 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.675+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5f2c01b3b0 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.676+0000 7f5f34ff9700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 0x7f5f240696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.676+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f2c083e20 con 0x7f5f38159890 2023-10-07T09:04:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.676+0000 7f5f3c8fc700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 0x7f5f240696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:29.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.677+0000 7f5f3c8fc700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 0x7f5f240696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f30019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:29.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.680+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f380b3690 con 0x7f5f38159890 2023-10-07T09:04:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.871+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5f380b3690 con 0x7f5f38159890 2023-10-07T09:04:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.871+0000 7f5f34ff9700 1 -- 172.21.15.46:0/934293640 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5f380b3690 con 0x7f5f38159890 2023-10-07T09:04:29.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 msgr2=0x7f5f240696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 0x7f5f240696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f30019000 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 msgr2=0x7f5f38169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c7c0 tx=0x7f5f2c007dd0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 shutdown_connections 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f24067200 0x7f5f240696b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f38159c60 0x7f5f3816a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f38069560 0x7f5f380c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 --2- 172.21.15.46:0/934293640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38159890 0x7f5f38169cd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.873+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 >> 172.21.15.46:0/934293640 conn(0x7f5f38068e20 msgr2=0x7f5f381588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.874+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 shutdown_connections 2023-10-07T09:04:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:29.874+0000 7f5f3eb60700 1 -- 172.21.15.46:0/934293640 wait complete. 2023-10-07T09:04:29.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-07T09:04:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.007+0000 7f3516da6700 1 Processor -- start 2023-10-07T09:04:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.007+0000 7f3516da6700 1 -- start start 2023-10-07T09:04:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3516da6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f351006bcd0 0x7f3510140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3516da6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006c0a0 0x7f3510141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3516da6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351015c2a0 con 0x7f35100c8e00 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3516da6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351015b690 con 0x7f351006bcd0 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3516da6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351015b970 con 0x7f351006c0a0 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3514b42700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f351006bcd0 0x7f3510140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3515343700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f35100c8e00 0x7f35100c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43974/0 (socket says 172.21.15.46:43974) 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.008+0000 7f3515343700 1 -- 172.21.15.46:0/1529182828 learned_addr learned my addr 172.21.15.46:0/1529182828 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f350ffff700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006c0a0 0x7f3510141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f3514b42700 1 -- 172.21.15.46:0/1529182828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006c0a0 msgr2=0x7f3510141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f3514b42700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006c0a0 0x7f3510141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f3514b42700 1 -- 172.21.15.46:0/1529182828 >> v1:172.21.15.46:6789/0 conn(0x7f35100c8e00 legacy=0x7f35100c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f350f7fe700 1 -- 172.21.15.46:0/1529182828 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197157611 0 0) 0x7f351015c2a0 con 0x7f35100c8e00 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f3514b42700 1 -- 172.21.15.46:0/1529182828 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351015bc50 con 0x7f351006bcd0 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f3514b42700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f351006bcd0 0x7f3510140df0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f35000098e0 tx=0x7f35000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711828998dc4051f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f350f7fe700 1 -- 172.21.15.46:0/1529182828 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500009e80 con 0x7f351006bcd0 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f350f7fe700 1 -- 172.21.15.46:0/1529182828 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000b860 con 0x7f351006bcd0 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.009+0000 7f350f7fe700 1 -- 172.21.15.46:0/1529182828 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000bbe0 con 0x7f351006bcd0 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 -- 172.21.15.46:0/1529182828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f351006bcd0 msgr2=0x7f3510140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f351006bcd0 0x7f3510140df0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f35000098e0 tx=0x7f35000091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 -- 172.21.15.46:0/1529182828 shutdown_connections 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f351006bcd0 0x7f3510140df0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 --2- 172.21.15.46:0/1529182828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006c0a0 0x7f3510141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 -- 172.21.15.46:0/1529182828 >> 172.21.15.46:0/1529182828 conn(0x7f35100ce600 msgr2=0x7f35100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 -- 172.21.15.46:0/1529182828 shutdown_connections 2023-10-07T09:04:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.010+0000 7f3516da6700 1 -- 172.21.15.46:0/1529182828 wait complete. 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.011+0000 7f3516da6700 1 Processor -- start 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.011+0000 7f3516da6700 1 -- start start 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006bcd0 0x7f35100afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f351006c0a0 0x7f3510069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b0420 con 0x7f35100c8e00 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351006a690 con 0x7f351006c0a0 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351006a970 con 0x7f351006bcd0 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35812/0 (socket says 172.21.15.46:35812) 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 -- 172.21.15.46:0/1386424430 learned_addr learned my addr 172.21.15.46:0/1386424430 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f350ffff700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f351006c0a0 0x7f3510069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3514b42700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006bcd0 0x7f35100afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 -- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006bcd0 msgr2=0x7f35100afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006bcd0 0x7f35100afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 -- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f351006c0a0 msgr2=0x7f3510069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f351006c0a0 0x7f3510069e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 -- 172.21.15.46:0/1386424430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500009420 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3515343700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f350800cc90 tx=0x7f3508001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800cea0 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800ab70 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351006ac50 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080070f0 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.012+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351006a390 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.013+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100cd330 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.014+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f35080074a0 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.014+0000 7f350cff9700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 0x7f34fc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.014+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3508084df0 con 0x7f35100c8e00 2023-10-07T09:04:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.014+0000 7f3514b42700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 0x7f34fc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.015+0000 7f3514b42700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 0x7f34fc0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3500003080 tx=0x7f3500017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.018+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3508051d90 con 0x7f35100c8e00 2023-10-07T09:04:30.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.241+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f351004c3c0 con 0x7f34fc067200 2023-10-07T09:04:30.243 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.242+0000 7f470fd46700 -1 client.5483 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-07T09:04:04.521999+0000 mtime=2023-10-07T09:04:04.521999+0000 ctime=2023-10-07T09:04:04.527667+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000543178"] has_dir_layout 0x564a4a7ffe00) 2023-10-07T09:04:30.248 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.247+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:30.248 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.247+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:30.248 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.247+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:30.248 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.247+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:30.248 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:30.247+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.254+0000 7f350cff9700 1 -- 172.21.15.46:0/1386424430 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+470 (secure 0 0 0) 0x7f351004c3c0 con 0x7f34fc067200 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_addrs": [ 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.46:6789", 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6789", 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6790" 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": { 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "data": [ 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": " 340G", 2023-10-07T09:04:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_data", 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "used": " 0 " 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": [ 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": " 340G", 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_metadata", 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "used": "64.0k" 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:30.256 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:30.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 msgr2=0x7f34fc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 0x7f34fc0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3500003080 tx=0x7f3500017000 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 msgr2=0x7f35100b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f350800cc90 tx=0x7f3508001a80 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 shutdown_connections 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f34fc067200 0x7f34fc0696b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35100c8e00 0x7f35100b1e90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f351006bcd0 0x7f35100afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 --2- 172.21.15.46:0/1386424430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f351006c0a0 0x7f3510069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 >> 172.21.15.46:0/1386424430 conn(0x7f35100ce600 msgr2=0x7f35100cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 shutdown_connections 2023-10-07T09:04:30.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.256+0000 7f3516da6700 1 -- 172.21.15.46:0/1386424430 wait complete. 2023-10-07T09:04:30.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:04:30.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:30.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:30.345 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:04:30.346 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:04:30.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:30.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:30.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:04:30.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:30.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:04:30.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:04:30.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:30.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:30.457 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:04:30.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:30.458 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:04:30.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.632+0000 7fa6085b0700 1 Processor -- start 2023-10-07T09:04:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.632+0000 7fa6085b0700 1 -- start start 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa6085b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa600159890 0x7fa60015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa6085b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa6085b0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60015a160 con 0x7fa60015db10 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa6085b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6000d13a0 con 0x7fa600159890 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa6085b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60015e140 con 0x7fa600159c60 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa605b4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa60634c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa600159890 0x7fa60015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa605b4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:43256/0 (socket says 172.21.15.46:43256) 2023-10-07T09:04:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.633+0000 7fa605b4b700 1 -- 172.21.15.46:0/3672535953 learned_addr learned my addr 172.21.15.46:0/3672535953 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60634c700 1 -- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 msgr2=0x7fa60015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60634c700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60634c700 1 -- 172.21.15.46:0/3672535953 >> v1:172.21.15.133:6789/0 conn(0x7fa60015db10 legacy=0x7fa600069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60534a700 1 -- 172.21.15.46:0/3672535953 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695900385 0 0) 0x7fa60015a160 con 0x7fa60015db10 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60634c700 1 -- 172.21.15.46:0/3672535953 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60015a3d0 con 0x7fa600159890 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa605b4b700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60634c700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa60015abd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80098e0 tx=0x7fa5f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f2462d1df3a2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60534a700 1 -- 172.21.15.46:0/3672535953 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800b640 con 0x7fa600159890 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60534a700 1 -- 172.21.15.46:0/3672535953 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800b7a0 con 0x7fa600159890 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.634+0000 7fa60534a700 1 -- 172.21.15.46:0/3672535953 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800bb40 con 0x7fa600159890 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 -- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 msgr2=0x7fa60015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa60015abd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80098e0 tx=0x7fa5f80091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 -- 172.21.15.46:0/3672535953 shutdown_connections 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa60015abd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 --2- 172.21.15.46:0/3672535953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa600159c60 0x7fa60015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 -- 172.21.15.46:0/3672535953 >> 172.21.15.46:0/3672535953 conn(0x7fa600068e20 msgr2=0x7fa6000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 -- 172.21.15.46:0/3672535953 shutdown_connections 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.635+0000 7fa6085b0700 1 -- 172.21.15.46:0/3672535953 wait complete. 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.636+0000 7fa6085b0700 1 Processor -- start 2023-10-07T09:04:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.636+0000 7fa6085b0700 1 -- start start 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa600149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa60015db10 0x7fa6001519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ca2b0 con 0x7fa600159c60 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c96a0 con 0x7fa600159890 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c9980 con 0x7fa60015db10 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35824/0 (socket says 172.21.15.46:35824) 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 -- 172.21.15.46:0/4186998798 learned_addr learned my addr 172.21.15.46:0/4186998798 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa60634c700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa600149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa606b4d700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa60015db10 0x7fa6001519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 -- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa60015db10 msgr2=0x7fa6001519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa60015db10 0x7fa6001519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 -- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 msgr2=0x7fa600149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa600149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 -- 172.21.15.46:0/4186998798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40094f0 con 0x7fa600159c60 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa605b4b700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400ec80 tx=0x7fa5f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400c850 con 0x7fa600159c60 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f400c9b0 con 0x7fa600159c60 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400cd30 con 0x7fa600159c60 2023-10-07T09:04:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.637+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f8009420 con 0x7fa600159c60 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.638+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6000c9f40 con 0x7fa600159c60 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.638+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60004c3c0 con 0x7fa600159c60 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.639+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa5f4013680 con 0x7fa600159c60 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.639+0000 7fa5fe7fc700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 0x7fa5ec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.639+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5f4084f80 con 0x7fa600159c60 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.640+0000 7fa60634c700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 0x7fa5ec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.640+0000 7fa60634c700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 0x7fa5ec0696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80091e0 tx=0x7fa5f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:30.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.644+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5f4051ea0 con 0x7fa600159c60 2023-10-07T09:04:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.880+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6000ca3f0 con 0x7fa600159c60 2023-10-07T09:04:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.881+0000 7fa5fe7fc700 1 -- 172.21.15.46:0/4186998798 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa5f4017090 con 0x7fa600159c60 2023-10-07T09:04:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:30.882 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 msgr2=0x7fa5ec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 0x7fa5ec0696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80091e0 tx=0x7fa5f8017000 comp rx=0 tx=0).stop 2023-10-07T09:04:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 msgr2=0x7fa6000c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400ec80 tx=0x7fa5f4009250 comp rx=0 tx=0).stop 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 shutdown_connections 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa5ec067200 0x7fa5ec0696b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa60015db10 0x7fa6001519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa600159890 0x7fa600149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 --2- 172.21.15.46:0/4186998798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa600159c60 0x7fa6000c8b90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 >> 172.21.15.46:0/4186998798 conn(0x7fa600068e20 msgr2=0x7fa6000d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 shutdown_connections 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:30.883+0000 7fa6085b0700 1 -- 172.21.15.46:0/4186998798 wait complete. 2023-10-07T09:04:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 57 2023-10-07T09:04:30.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.014+0000 7fe72c448700 1 Processor -- start 2023-10-07T09:04:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.015+0000 7fe72c448700 1 -- start start 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.015+0000 7fe72c448700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe72415c910 0x7fe72415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72c448700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72415c480 con 0x7fe724159c10 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72c448700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72415d290 con 0x7fe7240b5ea0 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72c448700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7240b2a40 con 0x7fe72415c910 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a1e4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe724159c10 0x7fe72415b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43984/0 (socket says 172.21.15.46:43984) 2023-10-07T09:04:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a9e5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe72415c910 0x7fe72415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a1e4700 1 -- 172.21.15.46:0/692467494 learned_addr learned my addr 172.21.15.46:0/692467494 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe7291e2700 1 -- 172.21.15.46:0/692467494 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932305574 0 0) 0x7fe72415c480 con 0x7fe724159c10 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe7291e2700 1 -- 172.21.15.46:0/692467494 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c003570 con 0x7fe724159c10 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a9e5700 1 -- 172.21.15.46:0/692467494 >> v1:172.21.15.133:6789/0 conn(0x7fe7240b5ea0 legacy=0x7fe724068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a9e5700 1 -- 172.21.15.46:0/692467494 >> v1:172.21.15.46:6789/0 conn(0x7fe724159c10 legacy=0x7fe72415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a9e5700 1 -- 172.21.15.46:0/692467494 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72415b870 con 0x7fe72415c910 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe72a9e5700 1 --2- 172.21.15.46:0/692467494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe72415cd50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e60 tx=0x7fe714009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdbb65705d30277 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe7291e2700 1 -- 172.21.15.46:0/692467494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400e070 con 0x7fe72415c910 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe7291e2700 1 -- 172.21.15.46:0/692467494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400bb60 con 0x7fe72415c910 2023-10-07T09:04:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.016+0000 7fe7291e2700 1 -- 172.21.15.46:0/692467494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714012430 con 0x7fe72415c910 2023-10-07T09:04:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 -- 172.21.15.46:0/692467494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 msgr2=0x7fe72415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 --2- 172.21.15.46:0/692467494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe72415cd50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e60 tx=0x7fe714009780 comp rx=0 tx=0).stop 2023-10-07T09:04:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 -- 172.21.15.46:0/692467494 shutdown_connections 2023-10-07T09:04:31.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 --2- 172.21.15.46:0/692467494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe72415cd50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 -- 172.21.15.46:0/692467494 >> 172.21.15.46:0/692467494 conn(0x7fe724099a20 msgr2=0x7fe7240af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 -- 172.21.15.46:0/692467494 shutdown_connections 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.017+0000 7fe72c448700 1 -- 172.21.15.46:0/692467494 wait complete. 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.018+0000 7fe72c448700 1 Processor -- start 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.018+0000 7fe72c448700 1 -- start start 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7240b5ea0 0x7fe7240cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe724159c10 0x7fe7240add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72416afe0 con 0x7fe72415c910 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72416b2c0 con 0x7fe724159c10 2023-10-07T09:04:31.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72c448700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240ae6a0 con 0x7fe7240b5ea0 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35840/0 (socket says 172.21.15.46:35840) 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 -- 172.21.15.46:0/1825648394 learned_addr learned my addr 172.21.15.46:0/1825648394 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a1e4700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7240b5ea0 0x7fe7240cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe7299e3700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe724159c10 0x7fe7240add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 -- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7240b5ea0 msgr2=0x7fe7240cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7240b5ea0 0x7fe7240cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 -- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe724159c10 msgr2=0x7fe7240add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe724159c10 0x7fe7240add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.019+0000 7fe72a9e5700 1 -- 172.21.15.46:0/1825648394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009a20 con 0x7fe72415c910 2023-10-07T09:04:31.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe72a9e5700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b6c0 tx=0x7fe714018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71401e430 con 0x7fe72415c910 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71401e5d0 con 0x7fe72415c910 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7240ae980 con 0x7fe72415c910 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71401e990 con 0x7fe72415c910 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.020+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7240ae290 con 0x7fe72415c910 2023-10-07T09:04:31.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.021+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7240b2e00 con 0x7fe72415c910 2023-10-07T09:04:31.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.021+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe71402f3f0 con 0x7fe72415c910 2023-10-07T09:04:31.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.022+0000 7fe7227fc700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 0x7fe7100696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.022+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe714087500 con 0x7fe72415c910 2023-10-07T09:04:31.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.022+0000 7fe72a1e4700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 0x7fe7100696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.022+0000 7fe72a1e4700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 0x7fe7100696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0058d0 tx=0x7fe71c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.026+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe714054310 con 0x7fe72415c910 2023-10-07T09:04:31.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.221+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe72404c3c0 con 0x7fe72415c910 2023-10-07T09:04:31.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.222+0000 7fe7227fc700 1 -- 172.21.15.46:0/1825648394 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fe714057930 con 0x7fe72415c910 2023-10-07T09:04:31.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:31.223 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:20.915210+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:31.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 msgr2=0x7fe7100696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 0x7fe7100696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0058d0 tx=0x7fe71c009040 comp rx=0 tx=0).stop 2023-10-07T09:04:31.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 msgr2=0x7fe7240c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b6c0 tx=0x7fe714018000 comp rx=0 tx=0).stop 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 shutdown_connections 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe710067200 0x7fe7100696b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe72415c910 0x7fe7240c5520 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7240b5ea0 0x7fe7240cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 --2- 172.21.15.46:0/1825648394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe724159c10 0x7fe7240add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 >> 172.21.15.46:0/1825648394 conn(0x7fe724099a20 msgr2=0x7fe72415b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 shutdown_connections 2023-10-07T09:04:31.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.224+0000 7fe72c448700 1 -- 172.21.15.46:0/1825648394 wait complete. 2023-10-07T09:04:31.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:04:18.022754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:04:18.563919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:04:31.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 Processor -- start 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 -- start start 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59d8069560 0x7f59d80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d8069ee0 con 0x7f59d8159890 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d815a160 con 0x7f59d8159c60 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.359+0000 7f59dee39700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80d13a0 con 0x7f59d8069560 2023-10-07T09:04:31.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59dcbd5700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f59d8159890 0x7f59d815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43992/0 (socket says 172.21.15.46:43992) 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59dcbd5700 1 -- 172.21.15.46:0/214888939 learned_addr learned my addr 172.21.15.46:0/214888939 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59dd3d6700 1 --2- 172.21.15.46:0/214888939 >> v2:172.21.15.133:3300/0 conn(0x7f59d8069560 0x7f59d80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119272316 0 0) 0x7f59d8069ee0 con 0x7f59d8159890 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c4003570 con 0x7f59d8159890 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394112748 0 0) 0x7f59c4003570 con 0x7f59d8159890 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 >> v2:172.21.15.133:3300/0 conn(0x7f59d8069560 msgr2=0x7f59d80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 --2- 172.21.15.46:0/214888939 >> v2:172.21.15.133:3300/0 conn(0x7f59d8069560 0x7f59d80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 >> v1:172.21.15.133:6789/0 conn(0x7f59d8159c60 legacy=0x7f59d815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d815e140 con 0x7f59d8159890 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f59c0001470 con 0x7f59d8159890 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 >> v1:172.21.15.46:6789/0 conn(0x7f59d8159890 legacy=0x7f59d815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c4003a60 0x7f59c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 0x7f59c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c40051c0 0x7f59c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80d13a0 con 0x7f59c4004810 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c400c0d0 con 0x7f59c4003a60 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c400c290 con 0x7f59c40051c0 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59d7fff700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 0x7f59c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59dcbd5700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c4003a60 0x7f59c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.360+0000 7f59dd3d6700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c40051c0 0x7f59c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 -- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c40051c0 msgr2=0x7f59c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c40051c0 0x7f59c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 -- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c4003a60 msgr2=0x7f59c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c4003a60 0x7f59c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 -- 172.21.15.46:0/214888939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4003570 con 0x7f59c4004810 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59dd3d6700 1 -- 172.21.15.46:0/214888939 reap_dead start 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d7fff700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 0x7f59c4004c80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f59c80018b0 tx=0x7f59c8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5964836c464fe528 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8012420 con 0x7f59c4004810 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8012580 con 0x7f59c4004810 2023-10-07T09:04:31.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.361+0000 7f59d77fe700 1 -- 172.21.15.46:0/214888939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8012920 con 0x7f59c4004810 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 -- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 msgr2=0x7f59c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 0x7f59c4004c80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f59c80018b0 tx=0x7f59c8007d30 comp rx=0 tx=0).stop 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 -- 172.21.15.46:0/214888939 shutdown_connections 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 --2- 172.21.15.46:0/214888939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4004810 0x7f59c4004c80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 -- 172.21.15.46:0/214888939 >> 172.21.15.46:0/214888939 conn(0x7f59d8068e20 msgr2=0x7f59d80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 -- 172.21.15.46:0/214888939 shutdown_connections 2023-10-07T09:04:31.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.362+0000 7f59dee39700 1 -- 172.21.15.46:0/214888939 wait complete. 2023-10-07T09:04:31.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.363+0000 7f59dee39700 1 Processor -- start 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.363+0000 7f59dee39700 1 -- start start 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 0x7f59d815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 0x7f59d80d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80cd410 con 0x7f59d8149440 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80cf830 con 0x7f59d8149890 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80cfb10 con 0x7f59c4004810 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35856/0 (socket says 172.21.15.46:35856) 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 -- 172.21.15.46:0/3029604081 learned_addr learned my addr 172.21.15.46:0/3029604081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:31.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dd3d6700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 0x7f59d80d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dcbd5700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 0x7f59d815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 -- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 msgr2=0x7f59d815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 0x7f59d815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 -- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 msgr2=0x7f59d80d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 0x7f59d80d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 -- 172.21.15.46:0/3029604081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80cfdf0 con 0x7f59d8149440 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dd3d6700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 0x7f59d80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dcbd5700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 0x7f59d815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:31.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d7fff700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c3f0 tx=0x7f59c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8006b00 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8006c60 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80c5630 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8007030 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.364+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d815cb20 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.365+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d804c3c0 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.366+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f59c8007420 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.366+0000 7f59d4ff9700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 0x7f59b80696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.366+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59c8086010 con 0x7f59d8149440 2023-10-07T09:04:31.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.367+0000 7f59dcbd5700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 0x7f59b80696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.367+0000 7f59dcbd5700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 0x7f59b80696e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59c0001ce0 tx=0x7f59c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.371+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59c8052f30 con 0x7f59d8149440 2023-10-07T09:04:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.559+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59d806a5b0 con 0x7f59d8149440 2023-10-07T09:04:31.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.560+0000 7f59d4ff9700 1 -- 172.21.15.46:0/3029604081 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59c80240a0 con 0x7f59d8149440 2023-10-07T09:04:31.561 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 msgr2=0x7f59b80696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 0x7f59b80696e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59c0001ce0 tx=0x7f59c0009040 comp rx=0 tx=0).stop 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 msgr2=0x7f59d80d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c3f0 tx=0x7f59c8015000 comp rx=0 tx=0).stop 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 shutdown_connections 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59b8067230 0x7f59b80696e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d8149890 0x7f59d80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c4004810 0x7f59d815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 --2- 172.21.15.46:0/3029604081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d8149440 0x7f59d80d05f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 >> 172.21.15.46:0/3029604081 conn(0x7f59d8068e20 msgr2=0x7f59d8153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 shutdown_connections 2023-10-07T09:04:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.562+0000 7f59dee39700 1 -- 172.21.15.46:0/3029604081 wait complete. 2023-10-07T09:04:31.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:04:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.696+0000 7ff1eb28c700 1 Processor -- start 2023-10-07T09:04:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.696+0000 7ff1eb28c700 1 -- start start 2023-10-07T09:04:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1eb28c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e40b4e70 0x7ff1e40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1eb28c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b16d0 0x7ff1e40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1eb28c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40b2080 con 0x7ff1e415d240 2023-10-07T09:04:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1eb28c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40cfb00 con 0x7ff1e40b4e70 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1eb28c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b5c40 con 0x7ff1e40b16d0 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1ea28a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e40b4e70 0x7ff1e40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1ea28a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e40b4e70 0x7ff1e40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35858/0 (socket says 172.21.15.46:35858) 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3907803795 learned_addr learned my addr 172.21.15.46:0/3907803795 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1e9a89700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b16d0 0x7ff1e40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.697+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3907803795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b16d0 msgr2=0x7ff1e40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1ea28a700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b16d0 0x7ff1e40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3907803795 >> v1:172.21.15.133:6789/0 conn(0x7ff1e415d240 legacy=0x7ff1e415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3907803795 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40b5f20 con 0x7ff1e40b4e70 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1ea28a700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b4e70 0x7ff1e40ccff0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0099b0 tx=0x7ff1dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35637b80d6f5705a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1e9288700 1 -- 172.21.15.46:0/3907803795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc009ea0 con 0x7ff1e40b4e70 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1e9288700 1 -- 172.21.15.46:0/3907803795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00b860 con 0x7ff1e40b4e70 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1e9288700 1 -- 172.21.15.46:0/3907803795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00bc00 con 0x7ff1e40b4e70 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3907803795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b4e70 msgr2=0x7ff1e40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b4e70 0x7ff1e40ccff0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0099b0 tx=0x7ff1dc009250 comp rx=0 tx=0).stop 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3907803795 shutdown_connections 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b4e70 0x7ff1e40ccff0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3907803795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b16d0 0x7ff1e40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3907803795 >> 172.21.15.46:0/3907803795 conn(0x7ff1e40d10c0 msgr2=0x7ff1e40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.698+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3907803795 shutdown_connections 2023-10-07T09:04:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.699+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3907803795 wait complete. 2023-10-07T09:04:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 Processor -- start 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 -- start start 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b4e70 0x7ff1e414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 0x7ff1e4068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e414b600 con 0x7ff1e40b16d0 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40caf10 con 0x7ff1e415d240 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1eb28c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40cb1f0 con 0x7ff1e40b4e70 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1ea28a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1ea28a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35872/0 (socket says 172.21.15.46:35872) 2023-10-07T09:04:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.700+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3282825421 learned_addr learned my addr 172.21.15.46:0/3282825421 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1e9a89700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b4e70 0x7ff1e414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1eaa8b700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 0x7ff1e4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b4e70 msgr2=0x7ff1e414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b4e70 0x7ff1e414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 msgr2=0x7ff1e4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 0x7ff1e4068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 -- 172.21.15.46:0/3282825421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0094f0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1eaa8b700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 0x7ff1e4068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1ea28a700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4070dd0 tx=0x7ff1dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00bbe0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc011420 con 0x7ff1e40b16d0 2023-10-07T09:04:31.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40cb4d0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0117c0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.701+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40cba90 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.702+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e4088990 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.702+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff1dc011b70 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.703+0000 7ff1e27fc700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 0x7ff1d00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.703+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1dc0861b0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.703+0000 7ff1e9a89700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 0x7ff1d00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:31.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.704+0000 7ff1e9a89700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 0x7ff1d00696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1e415eab0 tx=0x7ff1d80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:31.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.707+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1dc0530d0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.899+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1e404bb80 con 0x7ff1e40b16d0 2023-10-07T09:04:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.900+0000 7ff1e27fc700 1 -- 172.21.15.46:0/3282825421 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1dc0566f0 con 0x7ff1e40b16d0 2023-10-07T09:04:31.901 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 msgr2=0x7ff1d00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 0x7ff1d00696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1e415eab0 tx=0x7ff1d80091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 msgr2=0x7ff1e40ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4070dd0 tx=0x7ff1dc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 shutdown_connections 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1d0067200 0x7ff1d00696b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e415d240 0x7ff1e4068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e40b16d0 0x7ff1e40ca8a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 --2- 172.21.15.46:0/3282825421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e40b4e70 0x7ff1e414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 >> 172.21.15.46:0/3282825421 conn(0x7ff1e40d10c0 msgr2=0x7ff1e41590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 shutdown_connections 2023-10-07T09:04:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:31.902+0000 7ff1eb28c700 1 -- 172.21.15.46:0/3282825421 wait complete. 2023-10-07T09:04:31.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:04:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.037+0000 7f05d2f6c700 1 Processor -- start 2023-10-07T09:04:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.037+0000 7f05d2f6c700 1 -- start start 2023-10-07T09:04:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d2f6c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05cc159890 0x7f05cc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d2f6c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05cc159c60 0x7f05cc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d2f6c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc15a160 con 0x7f05cc15db10 2023-10-07T09:04:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d2f6c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc15df50 con 0x7f05cc159c60 2023-10-07T09:04:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d2f6c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc0d13a0 con 0x7f05cc159890 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05cbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05cc159c60 0x7f05cc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05cbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05cc159c60 0x7f05cc15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35874/0 (socket says 172.21.15.46:35874) 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05cbfff700 1 -- 172.21.15.46:0/111700191 learned_addr learned my addr 172.21.15.46:0/111700191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.038+0000 7f05d0d08700 1 --2- 172.21.15.46:0/111700191 >> v2:172.21.15.133:3300/0 conn(0x7f05cc159890 0x7f05cc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cbfff700 1 -- 172.21.15.46:0/111700191 >> v2:172.21.15.133:3300/0 conn(0x7f05cc159890 msgr2=0x7f05cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cbfff700 1 --2- 172.21.15.46:0/111700191 >> v2:172.21.15.133:3300/0 conn(0x7f05cc159890 0x7f05cc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cbfff700 1 -- 172.21.15.46:0/111700191 >> v1:172.21.15.133:6789/0 conn(0x7f05cc15db10 legacy=0x7f05cc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cbfff700 1 -- 172.21.15.46:0/111700191 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc15e140 con 0x7f05cc159c60 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cbfff700 1 --2- 172.21.15.46:0/111700191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc159c60 0x7f05cc15d5d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0d1090 tx=0x7f05c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb84f5271dee8fb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cb7fe700 1 -- 172.21.15.46:0/111700191 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000b860 con 0x7f05cc159c60 2023-10-07T09:04:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cb7fe700 1 -- 172.21.15.46:0/111700191 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000b9c0 con 0x7f05cc159c60 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05cb7fe700 1 -- 172.21.15.46:0/111700191 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000bd60 con 0x7f05cc159c60 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 -- 172.21.15.46:0/111700191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc159c60 msgr2=0x7f05cc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/111700191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc159c60 0x7f05cc15d5d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0d1090 tx=0x7f05c0009250 comp rx=0 tx=0).stop 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 -- 172.21.15.46:0/111700191 shutdown_connections 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/111700191 >> v2:172.21.15.133:3300/0 conn(0x7f05cc159890 0x7f05cc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/111700191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc159c60 0x7f05cc15d5d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.039+0000 7f05d2f6c700 1 -- 172.21.15.46:0/111700191 >> 172.21.15.46:0/111700191 conn(0x7f05cc068e20 msgr2=0x7f05cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.040+0000 7f05d2f6c700 1 -- 172.21.15.46:0/111700191 shutdown_connections 2023-10-07T09:04:32.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.040+0000 7f05d2f6c700 1 -- 172.21.15.46:0/111700191 wait complete. 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 Processor -- start 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 -- start start 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc159890 0x7f05cc0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05cc159c60 0x7f05cc0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc153e60 con 0x7f05cc15db10 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc169f30 con 0x7f05cc159890 2023-10-07T09:04:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.041+0000 7f05d2f6c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc16aa50 con 0x7f05cc159c60 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35876/0 (socket says 172.21.15.46:35876) 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 -- 172.21.15.46:0/2788703169 learned_addr learned my addr 172.21.15.46:0/2788703169 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05cbfff700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05cc159c60 0x7f05cc0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d0d08700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc159890 0x7f05cc0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 -- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05cc159c60 msgr2=0x7f05cc0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05cc159c60 0x7f05cc0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 -- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc159890 msgr2=0x7f05cc0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc159890 0x7f05cc0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 -- 172.21.15.46:0/2788703169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00094f0 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d1509700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00c4c0 tx=0x7f05bc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc011590 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc011710 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc011ad0 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc16a120 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.042+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc16a6e0 con 0x7f05cc15db10 2023-10-07T09:04:32.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.043+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc16ac00 con 0x7f05cc15db10 2023-10-07T09:04:32.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.044+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f05bc01b3b0 con 0x7f05cc15db10 2023-10-07T09:04:32.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.044+0000 7f05c8ff9700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 0x7f05b80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.044+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05bc083de0 con 0x7f05cc15db10 2023-10-07T09:04:32.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.044+0000 7f05d0d08700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 0x7f05b80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.045+0000 7f05d0d08700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 0x7f05b80696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f05c40075a0 tx=0x7f05c40097a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.048+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05bc050d00 con 0x7f05cc15db10 2023-10-07T09:04:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.172+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f05bc0510d0 con 0x7f05cc15db10 2023-10-07T09:04:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.242+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05cc04c3c0 con 0x7f05cc15db10 2023-10-07T09:04:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.242+0000 7f05c8ff9700 1 -- 172.21.15.46:0/2788703169 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05bc054790 con 0x7f05cc15db10 2023-10-07T09:04:32.243 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:04:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 msgr2=0x7f05b80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 0x7f05b80696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f05c40075a0 tx=0x7f05c40097a0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 msgr2=0x7f05cc0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00c4c0 tx=0x7f05bc007f50 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 shutdown_connections 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f05b8067200 0x7f05b80696b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05cc15db10 0x7f05cc0b5ef0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc159890 0x7f05cc0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 --2- 172.21.15.46:0/2788703169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05cc159c60 0x7f05cc0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.244+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 >> 172.21.15.46:0/2788703169 conn(0x7f05cc068e20 msgr2=0x7f05cc0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.245+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 shutdown_connections 2023-10-07T09:04:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.245+0000 7f05d2f6c700 1 -- 172.21.15.46:0/2788703169 wait complete. 2023-10-07T09:04:32.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:32.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.375+0000 7fc0c7f0f700 1 Processor -- start 2023-10-07T09:04:32.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 -- start start 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0c0159890 0x7fc0c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0159c60 0x7fc0c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c015a160 con 0x7fc0c015db10 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00d13a0 con 0x7fc0c0159890 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.376+0000 7fc0c7f0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c015e140 con 0x7fc0c0159c60 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c64ac700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc0c015db10 0x7fc0c0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43998/0 (socket says 172.21.15.46:43998) 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c64ac700 1 -- 172.21.15.46:0/1929576918 learned_addr learned my addr 172.21.15.46:0/1929576918 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0159c60 0x7fc0c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/1929576918 >> v2:172.21.15.133:3300/0 conn(0x7fc0c0159890 0x7fc0c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197232819 0 0) 0x7fc0c015a160 con 0x7fc0c015db10 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a8003570 con 0x7fc0c015db10 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496914851 0 0) 0x7fc0a8003570 con 0x7fc0c015db10 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0159c60 msgr2=0x7fc0c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0159c60 0x7fc0c015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 >> v2:172.21.15.133:3300/0 conn(0x7fc0c0159890 msgr2=0x7fc0c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 --2- 172.21.15.46:0/1929576918 >> v2:172.21.15.133:3300/0 conn(0x7fc0c0159890 0x7fc0c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c015a3d0 con 0x7fc0c015db10 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fc0b0001470 con 0x7fc0c015db10 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 >> v1:172.21.15.46:6789/0 conn(0x7fc0c015db10 legacy=0x7fc0c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0a8003a60 0x7fc0a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a8004810 0x7fc0a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0a80051c0 0x7fc0a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00d13a0 con 0x7fc0a80051c0 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c015e140 con 0x7fc0a8004810 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a800bfa0 con 0x7fc0a8003a60 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/1929576918 >> v2:172.21.15.133:3300/0 conn(0x7fc0c0159890 0x7fc0c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0159c60 0x7fc0c015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.377+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0a80051c0 0x7fc0a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0a8003a60 0x7fc0a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a8004810 0x7fc0a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 -- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0a8003a60 msgr2=0x7fc0a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0a8003a60 0x7fc0a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 -- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a8004810 msgr2=0x7fc0a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a8004810 0x7fc0a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 -- 172.21.15.46:0/1929576918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8003570 con 0x7fc0a80051c0 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a8004810 0x7fc0a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0a80051c0 0x7fc0a800ba60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c3c0 tx=0x7fc0b0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a9b90a1ac14e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000cc90 con 0x7fc0a80051c0 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b000ce30 con 0x7fc0a80051c0 2023-10-07T09:04:32.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c4ca9700 1 -- 172.21.15.46:0/1929576918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0005b70 con 0x7fc0a80051c0 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/1929576918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0a80051c0 msgr2=0x7fc0a800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.378+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/1929576918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0a80051c0 0x7fc0a800ba60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c3c0 tx=0x7fc0b0001e90 comp rx=0 tx=0).stop 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.379+0000 7fc0c64ac700 1 -- 172.21.15.46:0/1929576918 reap_dead start 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.379+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/1929576918 shutdown_connections 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.379+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/1929576918 >> 172.21.15.46:0/1929576918 conn(0x7fc0c0068e20 msgr2=0x7fc0c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.379+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/1929576918 shutdown_connections 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.379+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/1929576918 wait complete. 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 Processor -- start 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 -- start start 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c01586d0 0x7fc0c01521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 0x7fc0c01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00cfbe0 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00cefd0 con 0x7fc0c01586d0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.380+0000 7fc0c7f0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00cf2b0 con 0x7fc0c0158aa0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35892/0 (socket says 172.21.15.46:35892) 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 -- 172.21.15.46:0/2677943688 learned_addr learned my addr 172.21.15.46:0/2677943688 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 0x7fc0c01526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c01586d0 0x7fc0c01521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 -- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 msgr2=0x7fc0c01526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 0x7fc0c01526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 -- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c01586d0 msgr2=0x7fc0c01521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c01586d0 0x7fc0c01521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 -- 172.21.15.46:0/2677943688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00cf590 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c54aa700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 0x7fc0c01526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c64ac700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8004650 tx=0x7fc0b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0021070 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0001430 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00cf870 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000cc90 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.381+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c00cd0d0 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.382+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00cfd50 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.383+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc0b0007760 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.383+0000 7fc0bdffb700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 0x7fc0ac069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.383+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0b00851d0 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.384+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 0x7fc0ac069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.384+0000 7fc0c5cab700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 0x7fc0ac069740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009750 tx=0x7fc0b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.388+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0b0052030 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.623+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0c004c3c0 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.623+0000 7fc0bdffb700 1 -- 172.21.15.46:0/2677943688 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc0b0055650 con 0x7fc0c00ce2e0 2023-10-07T09:04:32.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:32.625 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 msgr2=0x7fc0ac069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 0x7fc0ac069740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009750 tx=0x7fc0b800b040 comp rx=0 tx=0).stop 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 msgr2=0x7fc0c00ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8004650 tx=0x7fc0b0015000 comp rx=0 tx=0).stop 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 shutdown_connections 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0ac067290 0x7fc0ac069740 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0c00ce2e0 0x7fc0c00ce760 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c01586d0 0x7fc0c01521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 --2- 172.21.15.46:0/2677943688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0c0158aa0 0x7fc0c01526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.625+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 >> 172.21.15.46:0/2677943688 conn(0x7fc0c0068e20 msgr2=0x7fc0c0149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.626+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 shutdown_connections 2023-10-07T09:04:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.626+0000 7fc0c7f0f700 1 -- 172.21.15.46:0/2677943688 wait complete. 2023-10-07T09:04:32.628 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 57 2023-10-07T09:04:32.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:32.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.756+0000 7f5737877700 1 Processor -- start 2023-10-07T09:04:32.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 -- start start 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 0x7f57300caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 0x7f573015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f573015df50 0x7f573015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573015d7e0 con 0x7f573015df50 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573015dac0 con 0x7f573006bcd0 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.757+0000 7f5737877700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573015aa30 con 0x7f573006c0a0 2023-10-07T09:04:32.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f573015df50 0x7f573015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f573015df50 0x7f573015e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35900/0 (socket says 172.21.15.46:35900) 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 -- 172.21.15.46:0/163777224 learned_addr learned my addr 172.21.15.46:0/163777224 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5734e12700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 0x7f573015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 -- 172.21.15.46:0/163777224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 msgr2=0x7f573015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 0x7f573015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735613700 1 --2- 172.21.15.46:0/163777224 >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 0x7f57300caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 -- 172.21.15.46:0/163777224 >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 msgr2=0x7f57300caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 --2- 172.21.15.46:0/163777224 >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 0x7f57300caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 -- 172.21.15.46:0/163777224 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573015ad10 con 0x7f573015df50 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5734e12700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 0x7f573015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735613700 1 --2- 172.21.15.46:0/163777224 >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 0x7f57300caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5735e14700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573015df50 0x7f573015e3c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f57300691a0 tx=0x7f5728009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de863442ff8cd91c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5727fff700 1 -- 172.21.15.46:0/163777224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800e070 con 0x7f573015df50 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5727fff700 1 -- 172.21.15.46:0/163777224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800ba50 con 0x7f573015df50 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.758+0000 7f5727fff700 1 -- 172.21.15.46:0/163777224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280092e0 con 0x7f573015df50 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 -- 172.21.15.46:0/163777224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573015df50 msgr2=0x7f573015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573015df50 0x7f573015e3c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f57300691a0 tx=0x7f5728009840 comp rx=0 tx=0).stop 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 -- 172.21.15.46:0/163777224 shutdown_connections 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573015df50 0x7f573015e3c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 --2- 172.21.15.46:0/163777224 >> v2:172.21.15.133:3300/0 conn(0x7f573006bcd0 0x7f57300caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 --2- 172.21.15.46:0/163777224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573006c0a0 0x7f573015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 -- 172.21.15.46:0/163777224 >> 172.21.15.46:0/163777224 conn(0x7f57300ce600 msgr2=0x7f57300cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 -- 172.21.15.46:0/163777224 shutdown_connections 2023-10-07T09:04:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.759+0000 7f5737877700 1 -- 172.21.15.46:0/163777224 wait complete. 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.760+0000 7f5737877700 1 Processor -- start 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.760+0000 7f5737877700 1 -- start start 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573006c0a0 0x7f573016e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573015df50 0x7f57300c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57300c8560 con 0x7f573006bcd0 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573016e580 con 0x7f573006c0a0 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5737877700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57300c7950 con 0x7f573015df50 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35910/0 (socket says 172.21.15.46:35910) 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 -- 172.21.15.46:0/3334343982 learned_addr learned my addr 172.21.15.46:0/3334343982 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735e14700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573015df50 0x7f57300c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5734e12700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573006c0a0 0x7f573016e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 -- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573015df50 msgr2=0x7f57300c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573015df50 0x7f57300c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 -- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573006c0a0 msgr2=0x7f573016e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573006c0a0 0x7f573016e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 -- 172.21.15.46:0/3334343982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728009ae0 con 0x7f573006bcd0 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.761+0000 7f5735613700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c880 tx=0x7f572c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.762+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011600 con 0x7f573006bcd0 2023-10-07T09:04:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.762+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c011760 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.762+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57300c7c30 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.762+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011b20 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.762+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57300c81f0 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.763+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573004c3c0 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.763+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f572c0193b0 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.763+0000 7f57257fa700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 0x7f5714069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.764+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f572c084a00 con 0x7f573006bcd0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.764+0000 7f5734e12700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 0x7f5714069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.764+0000 7f5734e12700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 0x7f5714069740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f57300cf7d0 tx=0x7f5720008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:32.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.768+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f572c051710 con 0x7f573006bcd0 2023-10-07T09:04:32.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.963+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57300c7a90 con 0x7f573006bcd0 2023-10-07T09:04:32.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.964+0000 7f57257fa700 1 -- 172.21.15.46:0/3334343982 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f57300c7a90 con 0x7f573006bcd0 2023-10-07T09:04:32.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:32.965 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:20.915210+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 msgr2=0x7f5714069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 0x7f5714069740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f57300cf7d0 tx=0x7f5720008040 comp rx=0 tx=0).stop 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 msgr2=0x7f5730143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c880 tx=0x7f572c008040 comp rx=0 tx=0).stop 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 shutdown_connections 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067290 0x7f5714069740 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573015df50 0x7f57300c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f573006bcd0 0x7f5730143c00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 --2- 172.21.15.46:0/3334343982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573006c0a0 0x7f573016e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 >> 172.21.15.46:0/3334343982 conn(0x7f57300ce600 msgr2=0x7f57300c8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 shutdown_connections 2023-10-07T09:04:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:32.966+0000 7f5737877700 1 -- 172.21.15.46:0/3334343982 wait complete. 2023-10-07T09:04:32.979 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:04:32.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:33.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.097+0000 7feb7d891700 1 Processor -- start 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.097+0000 7feb7d891700 1 -- start start 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb7d891700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 0x7feb780b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb7d891700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780b2980 con 0x7feb781597f0 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb7d891700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780b11d0 con 0x7feb7815d230 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb7d891700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780b14b0 con 0x7feb78159420 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb77fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feb781597f0 0x7feb780b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44006/0 (socket says 172.21.15.46:44006) 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb77fff700 1 -- 172.21.15.46:0/991965454 learned_addr learned my addr 172.21.15.46:0/991965454 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb7c88f700 1 --2- 172.21.15.46:0/991965454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 0x7feb780b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188098310 0 0) 0x7feb780b2980 con 0x7feb781597f0 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.098+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb60003570 con 0x7feb781597f0 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605033264 0 0) 0x7feb780b11d0 con 0x7feb7815d230 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb780b2980 con 0x7feb7815d230 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7c88f700 1 -- 172.21.15.46:0/991965454 >> v1:172.21.15.133:6789/0 conn(0x7feb7815d230 legacy=0x7feb780b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7c88f700 1 -- 172.21.15.46:0/991965454 >> v1:172.21.15.46:6789/0 conn(0x7feb781597f0 legacy=0x7feb780b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7c88f700 1 -- 172.21.15.46:0/991965454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780b1790 con 0x7feb78159420 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7c88f700 1 --2- 172.21.15.46:0/991965454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 0x7feb780b5f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb68009910 tx=0x7feb680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae4de6583f6e923 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68011630 con 0x7feb78159420 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68011790 con 0x7feb78159420 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb777fe700 1 -- 172.21.15.46:0/991965454 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68011b10 con 0x7feb78159420 2023-10-07T09:04:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7d891700 1 -- 172.21.15.46:0/991965454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 msgr2=0x7feb780b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.099+0000 7feb7d891700 1 --2- 172.21.15.46:0/991965454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 0x7feb780b5f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb68009910 tx=0x7feb680091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.100+0000 7feb7d891700 1 -- 172.21.15.46:0/991965454 shutdown_connections 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.100+0000 7feb7d891700 1 --2- 172.21.15.46:0/991965454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb78159420 0x7feb780b5f40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.100+0000 7feb7d891700 1 -- 172.21.15.46:0/991965454 >> 172.21.15.46:0/991965454 conn(0x7feb780d0660 msgr2=0x7feb780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.100+0000 7feb7d891700 1 -- 172.21.15.46:0/991965454 shutdown_connections 2023-10-07T09:04:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.100+0000 7feb7d891700 1 -- 172.21.15.46:0/991965454 wait complete. 2023-10-07T09:04:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.101+0000 7feb7d891700 1 Processor -- start 2023-10-07T09:04:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.101+0000 7feb7d891700 1 -- start start 2023-10-07T09:04:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.101+0000 7feb7d891700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb78159420 0x7feb78151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7815d230 0x7feb78169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7816a2b0 con 0x7feb781597f0 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb78154df0 con 0x7feb78159420 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815adf0 con 0x7feb7815d230 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35922/0 (socket says 172.21.15.46:35922) 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 -- 172.21.15.46:0/728608576 learned_addr learned my addr 172.21.15.46:0/728608576 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d090700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7815d230 0x7feb78169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7c88f700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb78159420 0x7feb78151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 -- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7815d230 msgr2=0x7feb78169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7815d230 0x7feb78169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 -- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb78159420 msgr2=0x7feb78151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb78159420 0x7feb78151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 -- 172.21.15.46:0/728608576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68009420 con 0x7feb781597f0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb77fff700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c7c0 tx=0x7feb6c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c005b30 con 0x7feb781597f0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c005c90 con 0x7feb781597f0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb78154550 con 0x7feb781597f0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c007300 con 0x7feb781597f0 2023-10-07T09:04:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.102+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78154b10 con 0x7feb781597f0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.103+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7804c3c0 con 0x7feb781597f0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.104+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7feb6c007670 con 0x7feb781597f0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.104+0000 7feb74ff9700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 0x7feb64069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.104+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb6c083ee0 con 0x7feb781597f0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.104+0000 7feb7c88f700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 0x7feb64069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.105+0000 7feb7c88f700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 0x7feb64069740 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb68009860 tx=0x7feb68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.108+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb6c050d40 con 0x7feb781597f0 2023-10-07T09:04:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.345+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb7815af30 con 0x7feb781597f0 2023-10-07T09:04:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.346+0000 7feb74ff9700 1 -- 172.21.15.46:0/728608576 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4602 (secure 0 0 0) 0x7feb6c017020 con 0x7feb781597f0 2023-10-07T09:04:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:33.347 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 msgr2=0x7feb64069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 0x7feb64069740 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb68009860 tx=0x7feb68017000 comp rx=0 tx=0).stop 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 msgr2=0x7feb78169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c7c0 tx=0x7feb6c007ea0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 shutdown_connections 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb64067290 0x7feb64069740 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7815d230 0x7feb78169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb78159420 0x7feb78151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 --2- 172.21.15.46:0/728608576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb781597f0 0x7feb78169830 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 >> 172.21.15.46:0/728608576 conn(0x7feb780d0660 msgr2=0x7feb78157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 shutdown_connections 2023-10-07T09:04:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.348+0000 7feb7d891700 1 -- 172.21.15.46:0/728608576 wait complete. 2023-10-07T09:04:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 57 2023-10-07T09:04:33.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:33.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.478+0000 7f236e840700 1 Processor -- start 2023-10-07T09:04:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 -- start start 2023-10-07T09:04:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 0x7f23680cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 0x7f236806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680cc210 con 0x7f236806aa40 2023-10-07T09:04:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680cc4f0 con 0x7f236806ae10 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.479+0000 7f236e840700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680cc7d0 con 0x7f23680c91e0 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f2367fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f236806aa40 0x7f236806bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44012/0 (socket says 172.21.15.46:44012) 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f2367fff700 1 -- 172.21.15.46:0/1529559633 learned_addr learned my addr 172.21.15.46:0/1529559633 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f236cddd700 1 --2- 172.21.15.46:0/1529559633 >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 0x7f236806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 --2- 172.21.15.46:0/1529559633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 0x7f23680cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967013006 0 0) 0x7f23680cc210 con 0x7f236806aa40 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2354003570 con 0x7f236806aa40 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749084989 0 0) 0x7f2354003570 con 0x7f236806aa40 2023-10-07T09:04:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 -- 172.21.15.46:0/1529559633 >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 msgr2=0x7f236806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 --2- 172.21.15.46:0/1529559633 >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 0x7f236806b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 -- 172.21.15.46:0/1529559633 >> v1:172.21.15.46:6789/0 conn(0x7f236806aa40 legacy=0x7f236806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 -- 172.21.15.46:0/1529559633 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680ccab0 con 0x7f23680c91e0 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f236cddd700 1 --2- 172.21.15.46:0/1529559633 >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 0x7f236806b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.480+0000 7f23677fe700 1 --2- 172.21.15.46:0/1529559633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 0x7f23680cbc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23580098e0 tx=0x7f23580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f402a70de7a11f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500015f0 con 0x7f23680c91e0 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358011420 con 0x7f23680c91e0 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f2366ffd700 1 -- 172.21.15.46:0/1529559633 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580117c0 con 0x7f23680c91e0 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 -- 172.21.15.46:0/1529559633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 msgr2=0x7f23680cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 --2- 172.21.15.46:0/1529559633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 0x7f23680cbc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23580098e0 tx=0x7f23580091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 -- 172.21.15.46:0/1529559633 shutdown_connections 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 --2- 172.21.15.46:0/1529559633 >> v2:172.21.15.133:3300/0 conn(0x7f236806ae10 0x7f236806b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 --2- 172.21.15.46:0/1529559633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23680c91e0 0x7f23680cbc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 -- 172.21.15.46:0/1529559633 >> 172.21.15.46:0/1529559633 conn(0x7f23680cd670 msgr2=0x7f23680cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 -- 172.21.15.46:0/1529559633 shutdown_connections 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.481+0000 7f236e840700 1 -- 172.21.15.46:0/1529559633 wait complete. 2023-10-07T09:04:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.482+0000 7f236e840700 1 Processor -- start 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.482+0000 7f236e840700 1 -- start start 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236806aa40 0x7f236814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236806ae10 0x7f236814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236816ba90 con 0x7f23680c91e0 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b0610 con 0x7f236806ae10 2023-10-07T09:04:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236e840700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236814da80 con 0x7f236806aa40 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236cddd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236cddd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35936/0 (socket says 172.21.15.46:35936) 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f236cddd700 1 -- 172.21.15.46:0/2142809083 learned_addr learned my addr 172.21.15.46:0/2142809083 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f2367fff700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236806aa40 0x7f236814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.483+0000 7f23677fe700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236806ae10 0x7f236814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 -- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236806aa40 msgr2=0x7f236814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236806aa40 0x7f236814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 -- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236806ae10 msgr2=0x7f236814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236806ae10 0x7f236814dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 -- 172.21.15.46:0/2142809083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360009a20 con 0x7f23680c91e0 2023-10-07T09:04:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236cddd700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2360009fc0 tx=0x7f236000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000cbd0 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236000f040 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360014480 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2358009420 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.484+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236816b160 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.485+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236804c3c0 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.485+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2360003020 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.486+0000 7f235ffff700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 0x7f2348069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.486+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2360085500 con 0x7f23680c91e0 2023-10-07T09:04:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.486+0000 7f2367fff700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 0x7f2348069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.486+0000 7f2367fff700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 0x7f2348069740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2350002c70 tx=0x7f2350002c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.490+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2360052250 con 0x7f23680c91e0 2023-10-07T09:04:33.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.725+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23680c7cb0 con 0x7f23680c91e0 2023-10-07T09:04:33.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.726+0000 7f235ffff700 1 -- 172.21.15.46:0/2142809083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f2360055870 con 0x7f23680c91e0 2023-10-07T09:04:33.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:33.727 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:19.598548+0000","modified":"2023-10-07T09:04:23.222185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6474":{"gid":6474,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2597632474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2597632474},{"type":"v1","addr":"172.21.15.133:6837","nonce":2597632474}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T09:04:33.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.727+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 msgr2=0x7f2348069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.727+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 0x7f2348069740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2350002c70 tx=0x7f2350002c00 comp rx=0 tx=0).stop 2023-10-07T09:04:33.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.727+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 msgr2=0x7f2368155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.727+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2360009fc0 tx=0x7f236000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 shutdown_connections 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2348067290 0x7f2348069740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23680c91e0 0x7f2368155410 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236806aa40 0x7f236814d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 --2- 172.21.15.46:0/2142809083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236806ae10 0x7f236814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 >> 172.21.15.46:0/2142809083 conn(0x7f23680cd670 msgr2=0x7f23680c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 shutdown_connections 2023-10-07T09:04:33.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.728+0000 7f236e840700 1 -- 172.21.15.46:0/2142809083 wait complete. 2023-10-07T09:04:33.730 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 57 2023-10-07T09:04:33.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.861+0000 7f9493afd700 1 Processor -- start 2023-10-07T09:04:33.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.861+0000 7f9493afd700 1 -- start start 2023-10-07T09:04:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9493afd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 0x7f948c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9493afd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c069ee0 con 0x7f948c159c60 2023-10-07T09:04:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9493afd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c15a160 con 0x7f948c159890 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9493afd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0d13a0 con 0x7f948c069560 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9491098700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f948c159c60 0x7f948c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44016/0 (socket says 172.21.15.46:44016) 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9491098700 1 -- 172.21.15.46:0/3264412570 learned_addr learned my addr 172.21.15.46:0/3264412570 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f949209a700 1 --2- 172.21.15.46:0/3264412570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 0x7f948c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.862+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932973139 0 0) 0x7f948c069ee0 con 0x7f948c159c60 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9474003570 con 0x7f948c159c60 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 618983912 0 0) 0x7f9474003570 con 0x7f948c159c60 2023-10-07T09:04:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f949209a700 1 -- 172.21.15.46:0/3264412570 >> v1:172.21.15.133:6789/0 conn(0x7f948c159890 legacy=0x7f948c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f949209a700 1 -- 172.21.15.46:0/3264412570 >> v1:172.21.15.46:6789/0 conn(0x7f948c159c60 legacy=0x7f948c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f949209a700 1 -- 172.21.15.46:0/3264412570 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c15e140 con 0x7f948c069560 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f949209a700 1 --2- 172.21.15.46:0/3264412570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 0x7f948c0699a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e90 tx=0x7f9484009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f2d9b8559f6e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400e070 con 0x7f948c069560 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400b920 con 0x7f948c069560 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.863+0000 7f9490897700 1 -- 172.21.15.46:0/3264412570 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480001470 con 0x7f948c069560 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 -- 172.21.15.46:0/3264412570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 msgr2=0x7f948c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 --2- 172.21.15.46:0/3264412570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 0x7f948c0699a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e90 tx=0x7f9484009780 comp rx=0 tx=0).stop 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 -- 172.21.15.46:0/3264412570 shutdown_connections 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 --2- 172.21.15.46:0/3264412570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c069560 0x7f948c0699a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 -- 172.21.15.46:0/3264412570 >> 172.21.15.46:0/3264412570 conn(0x7f948c068e20 msgr2=0x7f948c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 -- 172.21.15.46:0/3264412570 shutdown_connections 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.864+0000 7f9493afd700 1 -- 172.21.15.46:0/3264412570 wait complete. 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.865+0000 7f9493afd700 1 Processor -- start 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.865+0000 7f9493afd700 1 -- start start 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c159890 0x7f948c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c159c60 0x7f948c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15c9e0 con 0x7f948c069560 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15cc60 con 0x7f948c159890 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15cf40 con 0x7f948c159c60 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35938/0 (socket says 172.21.15.46:35938) 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 -- 172.21.15.46:0/2349685913 learned_addr learned my addr 172.21.15.46:0/2349685913 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 -- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c159c60 msgr2=0x7f948c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c159c60 0x7f948c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 -- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c159890 msgr2=0x7f948c15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c159890 0x7f948c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 -- 172.21.15.46:0/2349685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009a20 con 0x7f948c069560 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9491899700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c760 tx=0x7f947c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012630 con 0x7f948c069560 2023-10-07T09:04:33.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c012790 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c15d220 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.866+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012b50 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.867+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c0c81f0 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.868+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c04c3c0 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.868+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f947c01b400 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.868+0000 7f9489ffb700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 0x7f9478069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.868+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f947c084d40 con 0x7f948c069560 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.868+0000 7f9491098700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 0x7f9478069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.869+0000 7f9491098700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 0x7f9478069740 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f94800011e0 tx=0x7f94800012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:33.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:33.873+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f947c051ba0 con 0x7f948c069560 2023-10-07T09:04:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.067+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948c06a5b0 con 0x7f948c069560 2023-10-07T09:04:34.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.068+0000 7f9489ffb700 1 -- 172.21.15.46:0/2349685913 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f947c016020 con 0x7f948c069560 2023-10-07T09:04:34.069 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:34.069 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:20.915210+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:18.022754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:18.563919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:34.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 msgr2=0x7f9478069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 0x7f9478069740 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f94800011e0 tx=0x7f94800012c0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 msgr2=0x7f948c1493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c760 tx=0x7f947c007f20 comp rx=0 tx=0).stop 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 shutdown_connections 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9478067290 0x7f9478069740 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f948c159c60 0x7f948c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f948c069560 0x7f948c1493d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 --2- 172.21.15.46:0/2349685913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c159890 0x7f948c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 >> 172.21.15.46:0/2349685913 conn(0x7f948c068e20 msgr2=0x7f948c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.070+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 shutdown_connections 2023-10-07T09:04:34.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.071+0000 7f9493afd700 1 -- 172.21.15.46:0/2349685913 wait complete. 2023-10-07T09:04:34.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:04:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.204+0000 7f1e74263700 1 Processor -- start 2023-10-07T09:04:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.204+0000 7f1e74263700 1 -- start start 2023-10-07T09:04:34.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e74263700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e6c0b5ea0 0x7f1e6c068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e74263700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e6c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e74263700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c15c480 con 0x7f1e6c159c10 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e74263700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b2a40 con 0x7f1e6c0b5ea0 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e74263700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15b870 con 0x7f1e6c068bb0 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e71fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1e6c159c10 0x7f1e6c15b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44026/0 (socket says 172.21.15.46:44026) 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e71fff700 1 -- 172.21.15.46:0/1679535107 learned_addr learned my addr 172.21.15.46:0/1679535107 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e717fe700 1 --2- 172.21.15.46:0/1679535107 >> v2:172.21.15.133:3300/0 conn(0x7f1e6c0b5ea0 0x7f1e6c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e72800700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e6c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442007634 0 0) 0x7f1e6c15c480 con 0x7f1e6c159c10 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.205+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e58003570 con 0x7f1e6c159c10 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2260931743 0 0) 0x7f1e58003570 con 0x7f1e6c159c10 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 msgr2=0x7f1e6c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e6c15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 >> v2:172.21.15.133:3300/0 conn(0x7f1e6c0b5ea0 msgr2=0x7f1e6c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 --2- 172.21.15.46:0/1679535107 >> v2:172.21.15.133:3300/0 conn(0x7f1e6c0b5ea0 0x7f1e6c068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c15bb50 con 0x7f1e6c159c10 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f1e68001470 con 0x7f1e6c159c10 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e72800700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e6c15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 >> v1:172.21.15.46:6789/0 conn(0x7f1e6c159c10 legacy=0x7f1e6c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003a60 0x7f1e58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e58004810 0x7f1e58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15b870 con 0x7f1e58004810 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800ba60 con 0x7f1e58003a60 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800bba0 con 0x7f1e6c068bb0 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e58004810 0x7f1e58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e71fff700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003a60 0x7f1e58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e72800700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 -- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 msgr2=0x7f1e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 -- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003a60 msgr2=0x7f1e58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003a60 0x7f1e58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 -- 172.21.15.46:0/1679535107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64009a20 con 0x7f1e58004810 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e72800700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c068bb0 0x7f1e580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e71fff700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003a60 0x7f1e58003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e717fe700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e58004810 0x7f1e58004c80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009c00 tx=0x7f1e5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211c19f2f3673cdb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00e710 con 0x7f1e58004810 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00e870 con 0x7f1e58004810 2023-10-07T09:04:34.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.206+0000 7f1e70ffd700 1 -- 172.21.15.46:0/1679535107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00ec30 con 0x7f1e58004810 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 -- 172.21.15.46:0/1679535107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e58004810 msgr2=0x7f1e58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 --2- 172.21.15.46:0/1679535107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e58004810 0x7f1e58004c80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009c00 tx=0x7f1e5c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e72800700 1 -- 172.21.15.46:0/1679535107 reap_dead start 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 -- 172.21.15.46:0/1679535107 shutdown_connections 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 -- 172.21.15.46:0/1679535107 >> 172.21.15.46:0/1679535107 conn(0x7f1e6c099a20 msgr2=0x7f1e6c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 -- 172.21.15.46:0/1679535107 shutdown_connections 2023-10-07T09:04:34.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.207+0000 7f1e74263700 1 -- 172.21.15.46:0/1679535107 wait complete. 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.208+0000 7f1e74263700 1 Processor -- start 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.208+0000 7f1e74263700 1 -- start start 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58004810 0x7f1e6c1699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c14f660 0x7f1e6c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c169f20 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0c7420 con 0x7f1e58004810 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e74263700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0c6810 con 0x7f1e6c14f660 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35954/0 (socket says 172.21.15.46:35954) 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 -- 172.21.15.46:0/2949283938 learned_addr learned my addr 172.21.15.46:0/2949283938 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e71fff700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58004810 0x7f1e6c1699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e72800700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c14f660 0x7f1e6c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 -- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c14f660 msgr2=0x7f1e6c0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c14f660 0x7f1e6c0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 -- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58004810 msgr2=0x7f1e6c1699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.209+0000 7f1e717fe700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58004810 0x7f1e6c1699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e717fe700 1 -- 172.21.15.46:0/2949283938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0c6af0 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e717fe700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009ad0 tx=0x7f1e5c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c022070 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00e9e0 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00e710 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c0c6dd0 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.210+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c0c6450 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.211+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c04c3c0 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.211+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1e5c01c660 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.212+0000 7f1e61ffb700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 0x7f1e50069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.212+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e5c086100 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.212+0000 7f1e71fff700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 0x7f1e50069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.212+0000 7f1e71fff700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 0x7f1e50069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1e68001ed0 tx=0x7f1e68007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.216+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e5c052f60 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.457+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1e6c15be30 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.458 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:04:34.458+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:04:34.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.462+0000 7f1e61ffb700 1 -- 172.21.15.46:0/2949283938 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1e5c056540 con 0x7f1e6c14f1f0 2023-10-07T09:04:34.464 INFO:tasks.ceph.mds.b.smithi133.stderr: -782> 2023-10-07T09:04:25.921+0000 7f2ae5b22700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:04:34.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 msgr2=0x7f1e50069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 0x7f1e50069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1e68001ed0 tx=0x7f1e68007040 comp rx=0 tx=0).stop 2023-10-07T09:04:34.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 msgr2=0x7f1e6c0b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009ad0 tx=0x7f1e5c01a000 comp rx=0 tx=0).stop 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 shutdown_connections 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e50067290 0x7f1e50069740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e6c14f660 0x7f1e6c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58004810 0x7f1e6c1699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 --2- 172.21.15.46:0/2949283938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e6c14f1f0 0x7f1e6c0b0e40 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 >> 172.21.15.46:0/2949283938 conn(0x7f1e6c099a20 msgr2=0x7f1e6c09b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 shutdown_connections 2023-10-07T09:04:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.465+0000 7f1e74263700 1 -- 172.21.15.46:0/2949283938 wait complete. 2023-10-07T09:04:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:04:34.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:04:34.486 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:04:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.598+0000 7f6b37e77700 1 Processor -- start 2023-10-07T09:04:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.598+0000 7f6b37e77700 1 -- start start 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b37e77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b300cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b37e77700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300cc210 con 0x7f6b3006ae10 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b37e77700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300cc4f0 con 0x7f6b3006aa40 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b37e77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300cc7d0 con 0x7f6b300c91e0 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b36414700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6b3006ae10 0x7f6b3006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44040/0 (socket says 172.21.15.46:44040) 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.599+0000 7f6b36414700 1 -- 172.21.15.46:0/1416412425 learned_addr learned my addr 172.21.15.46:0/1416412425 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b35412700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b300cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035506282 0 0) 0x7f6b300cc210 con 0x7f6b3006ae10 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b18003570 con 0x7f6b3006ae10 2023-10-07T09:04:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4066018608 0 0) 0x7f6b18003570 con 0x7f6b3006ae10 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 msgr2=0x7f6b300cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b300cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 >> v1:172.21.15.133:6789/0 conn(0x7f6b3006aa40 legacy=0x7f6b3006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300ccab0 con 0x7f6b3006ae10 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f6b200017f0 con 0x7f6b3006ae10 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 >> v1:172.21.15.46:6789/0 conn(0x7f6b3006ae10 legacy=0x7f6b3006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b18003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b18004d50 0x7f6b180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300cc7d0 con 0x7f6b18003a90 2023-10-07T09:04:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800bb40 con 0x7f6b18004d50 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800bd00 con 0x7f6b300c91e0 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b35c13700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b18003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b35412700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.600+0000 7f6b36414700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b18004d50 0x7f6b180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 -- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 msgr2=0x7f6b18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c91e0 0x7f6b18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 -- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b18004d50 msgr2=0x7f6b180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b18004d50 0x7f6b180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 -- 172.21.15.46:0/1416412425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18003570 con 0x7f6b18003a90 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b35c13700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b18003e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6b280019c0 tx=0x7f6b28007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d0fec9d6cd1686 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28001330 con 0x7f6b18003a90 2023-10-07T09:04:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800c5d0 con 0x7f6b18003a90 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b34c11700 1 -- 172.21.15.46:0/1416412425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800c970 con 0x7f6b18003a90 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b37e77700 1 -- 172.21.15.46:0/1416412425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 msgr2=0x7f6b18003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b37e77700 1 --2- 172.21.15.46:0/1416412425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b18003e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6b280019c0 tx=0x7f6b28007d60 comp rx=0 tx=0).stop 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b36414700 1 -- 172.21.15.46:0/1416412425 reap_dead start 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b37e77700 1 -- 172.21.15.46:0/1416412425 shutdown_connections 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b37e77700 1 -- 172.21.15.46:0/1416412425 >> 172.21.15.46:0/1416412425 conn(0x7f6b300cd670 msgr2=0x7f6b300cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.601+0000 7f6b37e77700 1 -- 172.21.15.46:0/1416412425 shutdown_connections 2023-10-07T09:04:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.602+0000 7f6b37e77700 1 -- 172.21.15.46:0/1416412425 wait complete. 2023-10-07T09:04:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 Processor -- start 2023-10-07T09:04:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 -- start start 2023-10-07T09:04:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 0x7f6b300c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 0x7f6b300c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b27c0 con 0x7f6b18003a90 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c5b00 con 0x7f6b30155900 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b37e77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b18d0 con 0x7f6b300c5690 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b35c13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b35c13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35972/0 (socket says 172.21.15.46:35972) 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.603+0000 7f6b35c13700 1 -- 172.21.15.46:0/948145805 learned_addr learned my addr 172.21.15.46:0/948145805 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35412700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 0x7f6b300c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b36414700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 0x7f6b300c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 -- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 msgr2=0x7f6b300c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 0x7f6b300c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 -- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 msgr2=0x7f6b300c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 0x7f6b300c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 -- 172.21.15.46:0/948145805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300b1bb0 con 0x7f6b18003a90 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35412700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 0x7f6b300c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b36414700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 0x7f6b300c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b35c13700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6b28011fa0 tx=0x7f6b28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800c740 con 0x7f6b18003a90 2023-10-07T09:04:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800c8a0 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28026660 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b300b1e90 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.604+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b300b2450 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.605+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b300b2aa0 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.606+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6b280193f0 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.606+0000 7f6b2dffb700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 0x7f6b1c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.606+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6b28087fd0 con 0x7f6b18003a90 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.606+0000 7f6b35412700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 0x7f6b1c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.607+0000 7f6b35412700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 0x7f6b1c069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6b24006d60 tx=0x7f6b24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.610+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b28054de0 con 0x7f6b18003a90 2023-10-07T09:04:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:34.851+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6b300b2610 con 0x7f6b18003a90 2023-10-07T09:04:35.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.462+0000 7f6b2dffb700 1 -- 172.21.15.46:0/948145805 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b2802b0a0 con 0x7f6b18003a90 2023-10-07T09:04:35.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 msgr2=0x7f6b1c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:35.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 0x7f6b1c069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6b24006d60 tx=0x7f6b24008040 comp rx=0 tx=0).stop 2023-10-07T09:04:35.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 msgr2=0x7f6b300b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:35.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6b28011fa0 tx=0x7f6b28017000 comp rx=0 tx=0).stop 2023-10-07T09:04:35.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 shutdown_connections 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b1c067290 0x7f6b1c069740 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b300c5690 0x7f6b300c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b18003a90 0x7f6b300b2c50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 --2- 172.21.15.46:0/948145805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b30155900 0x7f6b300c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 >> 172.21.15.46:0/948145805 conn(0x7f6b300cd670 msgr2=0x7f6b3014a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 shutdown_connections 2023-10-07T09:04:35.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.465+0000 7f6b37e77700 1 -- 172.21.15.46:0/948145805 wait complete. 2023-10-07T09:04:35.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:04:35.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.605+0000 7f54e9037700 1 Processor -- start 2023-10-07T09:04:35.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.605+0000 7f54e9037700 1 -- start start 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54e4155360 0x7f54e40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54e40ceb60 0x7f54e406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e40b4560 con 0x7f54e4155360 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e415c320 con 0x7f54e40ceb60 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e9037700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40cef90 con 0x7f54e40b40f0 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54e4155360 0x7f54e40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54e4155360 0x7f54e40b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35974/0 (socket says 172.21.15.46:35974) 2023-10-07T09:04:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e2d9d700 1 -- 172.21.15.46:0/3125081408 learned_addr learned my addr 172.21.15.46:0/3125081408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e259c700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.606+0000 7f54e359e700 1 --2- 172.21.15.46:0/3125081408 >> v2:172.21.15.133:3300/0 conn(0x7f54e40ceb60 0x7f54e406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 -- 172.21.15.46:0/3125081408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 msgr2=0x7f54e40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e40ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 -- 172.21.15.46:0/3125081408 >> v2:172.21.15.133:3300/0 conn(0x7f54e40ceb60 msgr2=0x7f54e406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/3125081408 >> v2:172.21.15.133:3300/0 conn(0x7f54e40ceb60 0x7f54e406d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 -- 172.21.15.46:0/3125081408 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e415b710 con 0x7f54e4155360 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e4155360 0x7f54e40b3bb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f54e4070f60 tx=0x7f54dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c980064dc23eda14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e1d9b700 1 -- 172.21.15.46:0/3125081408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00b640 con 0x7f54e4155360 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e1d9b700 1 -- 172.21.15.46:0/3125081408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00b7a0 con 0x7f54e4155360 2023-10-07T09:04:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.607+0000 7f54e1d9b700 1 -- 172.21.15.46:0/3125081408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00bb60 con 0x7f54e4155360 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 -- 172.21.15.46:0/3125081408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e4155360 msgr2=0x7f54e40b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e4155360 0x7f54e40b3bb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f54e4070f60 tx=0x7f54dc009250 comp rx=0 tx=0).stop 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 -- 172.21.15.46:0/3125081408 shutdown_connections 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 --2- 172.21.15.46:0/3125081408 >> v2:172.21.15.133:3300/0 conn(0x7f54e40ceb60 0x7f54e406d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e4155360 0x7f54e40b3bb0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 --2- 172.21.15.46:0/3125081408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 -- 172.21.15.46:0/3125081408 >> 172.21.15.46:0/3125081408 conn(0x7f54e406baf0 msgr2=0x7f54e406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 -- 172.21.15.46:0/3125081408 shutdown_connections 2023-10-07T09:04:35.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.608+0000 7f54e9037700 1 -- 172.21.15.46:0/3125081408 wait complete. 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.609+0000 7f54e9037700 1 Processor -- start 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.609+0000 7f54e9037700 1 -- start start 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e4155360 0x7f54e416bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e416c550 con 0x7f54e40ceb60 2023-10-07T09:04:35.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40c41b0 con 0x7f54e4155360 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40c4490 con 0x7f54e40b40f0 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35982/0 (socket says 172.21.15.46:35982) 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 -- 172.21.15.46:0/4055116638 learned_addr learned my addr 172.21.15.46:0/4055116638 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e359e700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e4155360 0x7f54e416bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 -- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 msgr2=0x7f54e414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 -- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e4155360 msgr2=0x7f54e416bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e4155360 0x7f54e416bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 -- 172.21.15.46:0/4055116638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc0094f0 con 0x7f54e40ceb60 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e259c700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00ec80 tx=0x7f54cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00c850 con 0x7f54e40ceb60 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc00c9b0 con 0x7f54e40ceb60 2023-10-07T09:04:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.610+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e40c4770 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.611+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00cd50 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.611+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e414dfb0 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.611+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e40718b0 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.612+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f54cc013680 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.612+0000 7f54daffd700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 0x7f54c4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.612+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f54cc084cf0 con 0x7f54e40ceb60 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.612+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 0x7f54c4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:35.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.613+0000 7f54e2d9d700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 0x7f54c4069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54e4070f60 tx=0x7f54dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:35.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.617+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54cc051b00 con 0x7f54e40ceb60 2023-10-07T09:04:35.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:35.809+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54e415b9f0 con 0x7f54e40ceb60 2023-10-07T09:04:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.471+0000 7f54daffd700 1 -- 172.21.15.46:0/4055116638 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7f54cc055120 con 0x7f54e40ceb60 2023-10-07T09:04:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.477+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 msgr2=0x7f54c4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.477+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 0x7f54c4069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54e4070f60 tx=0x7f54dc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.477+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 msgr2=0x7f54e416b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.477+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00ec80 tx=0x7f54cc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 shutdown_connections 2023-10-07T09:04:36.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f54c4067290 0x7f54c4069740 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e4155360 0x7f54e416bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e40b40f0 0x7f54e414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 --2- 172.21.15.46:0/4055116638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54e40ceb60 0x7f54e416b700 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.479+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 >> 172.21.15.46:0/4055116638 conn(0x7f54e406baf0 msgr2=0x7f54e41593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.480+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 shutdown_connections 2023-10-07T09:04:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.480+0000 7f54e9037700 1 -- 172.21.15.46:0/4055116638 wait complete. 2023-10-07T09:04:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:04:36.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:04:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.627+0000 7f32b5d66700 1 Processor -- start 2023-10-07T09:04:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.627+0000 7f32b5d66700 1 -- start start 2023-10-07T09:04:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b5d66700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32b00b0790 0x7f32b00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b5d66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32b01591e0 0x7f32b0159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b5d66700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00cfa00 con 0x7f32b00b03c0 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b5d66700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cb580 con 0x7f32b00b0790 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b5d66700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cf160 con 0x7f32b01591e0 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32b00b0790 0x7f32b00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b4d64700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f32b00b03c0 0x7f32b00b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44052/0 (socket says 172.21.15.46:44052) 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.628+0000 7f32b4d64700 1 -- 172.21.15.46:0/1418655956 learned_addr learned my addr 172.21.15.46:0/1418655956 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32b5565700 1 --2- 172.21.15.46:0/1418655956 >> v2:172.21.15.133:3300/0 conn(0x7f32b01591e0 0x7f32b0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32affff700 1 -- 172.21.15.46:0/1418655956 >> v2:172.21.15.133:3300/0 conn(0x7f32b01591e0 msgr2=0x7f32b0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32affff700 1 --2- 172.21.15.46:0/1418655956 >> v2:172.21.15.133:3300/0 conn(0x7f32b01591e0 0x7f32b0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32affff700 1 -- 172.21.15.46:0/1418655956 >> v1:172.21.15.46:6789/0 conn(0x7f32b00b03c0 legacy=0x7f32b00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32affff700 1 -- 172.21.15.46:0/1418655956 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00cf440 con 0x7f32b00b0790 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32affff700 1 --2- 172.21.15.46:0/1418655956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b00cea70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32a40098e0 tx=0x7f32a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e9fcd58a04fc4d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32af7fe700 1 -- 172.21.15.46:0/1418655956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4009e80 con 0x7f32b00b0790 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32af7fe700 1 -- 172.21.15.46:0/1418655956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400b820 con 0x7f32b00b0790 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.629+0000 7f32af7fe700 1 -- 172.21.15.46:0/1418655956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400bba0 con 0x7f32b00b0790 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 -- 172.21.15.46:0/1418655956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 msgr2=0x7f32b00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 --2- 172.21.15.46:0/1418655956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b00cea70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32a40098e0 tx=0x7f32a40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 -- 172.21.15.46:0/1418655956 shutdown_connections 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 --2- 172.21.15.46:0/1418655956 >> v2:172.21.15.133:3300/0 conn(0x7f32b01591e0 0x7f32b0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 --2- 172.21.15.46:0/1418655956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b00cea70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 -- 172.21.15.46:0/1418655956 >> 172.21.15.46:0/1418655956 conn(0x7f32b0063230 msgr2=0x7f32b0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 -- 172.21.15.46:0/1418655956 shutdown_connections 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.630+0000 7f32b5d66700 1 -- 172.21.15.46:0/1418655956 wait complete. 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.631+0000 7f32b5d66700 1 Processor -- start 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.631+0000 7f32b5d66700 1 -- start start 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b00b03c0 0x7f32b00c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b01591e0 0x7f32b015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c8c00 con 0x7f32b00b0790 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c7ff0 con 0x7f32b01591e0 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c82d0 con 0x7f32b00b03c0 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35996/0 (socket says 172.21.15.46:35996) 2023-10-07T09:04:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 -- 172.21.15.46:0/2834327234 learned_addr learned my addr 172.21.15.46:0/2834327234 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5565700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b01591e0 0x7f32b015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b4d64700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b00b03c0 0x7f32b00c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 -- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b00b03c0 msgr2=0x7f32b00c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b00b03c0 0x7f32b00c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 -- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b01591e0 msgr2=0x7f32b015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b01591e0 0x7f32b015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 -- 172.21.15.46:0/2834327234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009420 con 0x7f32b00b0790 2023-10-07T09:04:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32affff700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32b00cfe40 tx=0x7f32a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4000c90 con 0x7f32b00b0790 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400b990 con 0x7f32b00b0790 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00c85b0 con 0x7f32b00b0790 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.632+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4026680 con 0x7f32b00b0790 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.633+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b0156c30 con 0x7f32b00b0790 2023-10-07T09:04:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.634+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b004c3c0 con 0x7f32b00b0790 2023-10-07T09:04:36.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.634+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f32a4023030 con 0x7f32b00b0790 2023-10-07T09:04:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.634+0000 7f32acff9700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 0x7f329c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.634+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f32a4086020 con 0x7f32b00b0790 2023-10-07T09:04:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.635+0000 7f32b4d64700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 0x7f329c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.635+0000 7f32b4d64700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 0x7f329c069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f32a0001950 tx=0x7f32a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.639+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32a40b75a0 con 0x7f32b00b0790 2023-10-07T09:04:36.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:36.833+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32b00c8d40 con 0x7f32b00b0790 2023-10-07T09:04:37.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.473+0000 7f32acff9700 1 -- 172.21.15.46:0/2834327234 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7f32a4053060 con 0x7f32b00b0790 2023-10-07T09:04:37.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.478+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 msgr2=0x7f329c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.478+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 0x7f329c069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f32a0001950 tx=0x7f32a0009040 comp rx=0 tx=0).stop 2023-10-07T09:04:37.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.478+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 msgr2=0x7f32b015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.478+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32b00cfe40 tx=0x7f32a4017000 comp rx=0 tx=0).stop 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 shutdown_connections 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f329c067290 0x7f329c069740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b01591e0 0x7f32b015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b00b03c0 0x7f32b00c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 --2- 172.21.15.46:0/2834327234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32b00b0790 0x7f32b015a2f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 >> 172.21.15.46:0/2834327234 conn(0x7f32b0063230 msgr2=0x7f32b00d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 shutdown_connections 2023-10-07T09:04:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.479+0000 7f32b5d66700 1 -- 172.21.15.46:0/2834327234 wait complete. 2023-10-07T09:04:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:04:37.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:04:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.625+0000 7fe61b174700 1 Processor -- start 2023-10-07T09:04:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.625+0000 7fe61b174700 1 -- start start 2023-10-07T09:04:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe61b174700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe614159890 0x7fe61415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe61b174700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61415a160 con 0x7fe614159c60 2023-10-07T09:04:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe61b174700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140d13a0 con 0x7fe614069560 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe61b174700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61415e140 con 0x7fe614159890 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe618f10700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe614159890 0x7fe61415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe613fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe614159c60 0x7fe61415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44060/0 (socket says 172.21.15.46:44060) 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe613fff700 1 -- 172.21.15.46:0/2979396249 learned_addr learned my addr 172.21.15.46:0/2979396249 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe618f10700 1 -- 172.21.15.46:0/2979396249 >> v1:172.21.15.133:6789/0 conn(0x7fe614069560 legacy=0x7fe6140ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe618f10700 1 -- 172.21.15.46:0/2979396249 >> v1:172.21.15.46:6789/0 conn(0x7fe614159c60 legacy=0x7fe61415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe618f10700 1 -- 172.21.15.46:0/2979396249 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61415a3d0 con 0x7fe614159890 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.626+0000 7fe6137fe700 1 -- 172.21.15.46:0/2979396249 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676958237 0 0) 0x7fe61415a160 con 0x7fe614159c60 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe618f10700 1 --2- 172.21.15.46:0/2979396249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe61415abd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8417bd80562b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe6137fe700 1 -- 172.21.15.46:0/2979396249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00e070 con 0x7fe614159890 2023-10-07T09:04:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe6137fe700 1 -- 172.21.15.46:0/2979396249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00bbf0 con 0x7fe614159890 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe6137fe700 1 -- 172.21.15.46:0/2979396249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c012430 con 0x7fe614159890 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 -- 172.21.15.46:0/2979396249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 msgr2=0x7fe61415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 --2- 172.21.15.46:0/2979396249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe61415abd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).stop 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 -- 172.21.15.46:0/2979396249 shutdown_connections 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 --2- 172.21.15.46:0/2979396249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe61415abd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 -- 172.21.15.46:0/2979396249 >> 172.21.15.46:0/2979396249 conn(0x7fe614068e20 msgr2=0x7fe6140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 -- 172.21.15.46:0/2979396249 shutdown_connections 2023-10-07T09:04:37.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.627+0000 7fe61b174700 1 -- 172.21.15.46:0/2979396249 wait complete. 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.628+0000 7fe61b174700 1 Processor -- start 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 -- start start 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614069560 0x7fe6140ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe614159c60 0x7fe6140c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c81c0 con 0x7fe614159890 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c7ee0 con 0x7fe614069560 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe61b174700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140b36c0 con 0x7fe614159c60 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36004/0 (socket says 172.21.15.46:36004) 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.629+0000 7fe613fff700 1 -- 172.21.15.46:0/1251195466 learned_addr learned my addr 172.21.15.46:0/1251195466 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe619711700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe614159c60 0x7fe6140c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe618f10700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614069560 0x7fe6140ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 -- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe614159c60 msgr2=0x7fe6140c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe614159c60 0x7fe6140c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 -- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614069560 msgr2=0x7fe6140ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614069560 0x7fe6140ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 -- 172.21.15.46:0/1251195466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009a20 con 0x7fe614159890 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe613fff700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c7e0 tx=0x7fe608007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608005b30 con 0x7fe614159890 2023-10-07T09:04:37.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608005c90 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6140b39a0 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608007300 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.630+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6140c7b20 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.631+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61404c3c0 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.631+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe60801b400 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.632+0000 7fe610ff9700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 0x7fe600069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.632+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe608084300 con 0x7fe614159890 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.632+0000 7fe618f10700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 0x7fe600069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.633+0000 7fe618f10700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 0x7fe600069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0099f0 tx=0x7fe60c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.636+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe608051490 con 0x7fe614159890 2023-10-07T09:04:37.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.832+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe614159030 con 0x7fe614159890 2023-10-07T09:04:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.835+0000 7fe610ff9700 1 -- 172.21.15.46:0/1251195466 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe608007730 con 0x7fe614159890 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.837+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 msgr2=0x7fe600069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.837+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 0x7fe600069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0099f0 tx=0x7fe60c018000 comp rx=0 tx=0).stop 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 msgr2=0x7fe6140b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c7e0 tx=0x7fe608007df0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 shutdown_connections 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe600067290 0x7fe600069740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe614159c60 0x7fe6140c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614069560 0x7fe6140ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 --2- 172.21.15.46:0/1251195466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe614159890 0x7fe6140b5fb0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 >> 172.21.15.46:0/1251195466 conn(0x7fe614068e20 msgr2=0x7fe614152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 shutdown_connections 2023-10-07T09:04:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.838+0000 7fe61b174700 1 -- 172.21.15.46:0/1251195466 wait complete. 2023-10-07T09:04:37.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-07T09:04:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.970+0000 7f1f5eaea700 1 Processor -- start 2023-10-07T09:04:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.970+0000 7f1f5eaea700 1 -- start start 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5eaea700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f58069560 0x7f1f580699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5eaea700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f58069ee0 con 0x7f1f58159c60 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5eaea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5815a160 con 0x7f1f58159890 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5eaea700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f580d13a0 con 0x7f1f58069560 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f58069560 0x7f1f580699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f58069560 0x7f1f580699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36010/0 (socket says 172.21.15.46:36010) 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f57fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1f58159c60 0x7f1f5815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44072/0 (socket says 172.21.15.46:44072) 2023-10-07T09:04:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 -- 172.21.15.46:0/3450778314 learned_addr learned my addr 172.21.15.46:0/3450778314 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 -- 172.21.15.46:0/3450778314 >> v1:172.21.15.133:6789/0 conn(0x7f1f58159890 legacy=0x7f1f5815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 -- 172.21.15.46:0/3450778314 >> v1:172.21.15.46:6789/0 conn(0x7f1f58159c60 legacy=0x7f1f5815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 -- 172.21.15.46:0/3450778314 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5815e140 con 0x7f1f58069560 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f577fe700 1 -- 172.21.15.46:0/3450778314 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748527529 0 0) 0x7f1f58069ee0 con 0x7f1f58159c60 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.971+0000 7f1f5d087700 1 --2- 172.21.15.46:0/3450778314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58069560 0x7f1f580699a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009f20 tx=0x7f1f50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeabb520fb87d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f577fe700 1 -- 172.21.15.46:0/3450778314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000e070 con 0x7f1f58069560 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f577fe700 1 -- 172.21.15.46:0/3450778314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5000ba40 con 0x7f1f58069560 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f577fe700 1 -- 172.21.15.46:0/3450778314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500092e0 con 0x7f1f58069560 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 -- 172.21.15.46:0/3450778314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58069560 msgr2=0x7f1f580699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/3450778314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58069560 0x7f1f580699a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009f20 tx=0x7f1f50009840 comp rx=0 tx=0).stop 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 -- 172.21.15.46:0/3450778314 shutdown_connections 2023-10-07T09:04:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/3450778314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58069560 0x7f1f580699a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 -- 172.21.15.46:0/3450778314 >> 172.21.15.46:0/3450778314 conn(0x7f1f58068e20 msgr2=0x7f1f580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 -- 172.21.15.46:0/3450778314 shutdown_connections 2023-10-07T09:04:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.972+0000 7f1f5eaea700 1 -- 172.21.15.46:0/3450778314 wait complete. 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.973+0000 7f1f5eaea700 1 Processor -- start 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.973+0000 7f1f5eaea700 1 -- start start 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f58069560 0x7f1f580c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f58159890 0x7f1f58151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580c78a0 con 0x7f1f58159c60 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580c7b40 con 0x7f1f58069560 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5eaea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58152420 con 0x7f1f58159890 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5d087700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5d087700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36018/0 (socket says 172.21.15.46:36018) 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5d087700 1 -- 172.21.15.46:0/1745607215 learned_addr learned my addr 172.21.15.46:0/1745607215 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f57fff700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f58159890 0x7f1f58151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.974+0000 7f1f5c886700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f58069560 0x7f1f580c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 -- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f58159890 msgr2=0x7f1f58151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f58159890 0x7f1f58151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 -- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f58069560 msgr2=0x7f1f580c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f58069560 0x7f1f580c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 -- 172.21.15.46:0/1745607215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50009ae0 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5d087700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1f5806a070 tx=0x7f1f50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500092e0 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50012d00 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f58169e40 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5001e660 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.975+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5816a3f0 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.976+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580c7cd0 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.976+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1f5001ea10 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.976+0000 7f1f54ff9700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 0x7f1f3c069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.977+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f50086300 con 0x7f1f58159c60 2023-10-07T09:04:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.977+0000 7f1f5c886700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 0x7f1f3c069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.977+0000 7f1f5c886700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 0x7f1f3c069730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c003a30 tx=0x7f1f4c007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:37.981+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f50053430 con 0x7f1f58159c60 2023-10-07T09:04:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.254+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f1f5804c3c0 con 0x7f1f58159c60 2023-10-07T09:04:38.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.474+0000 7f1f54ff9700 1 -- 172.21.15.46:0/1745607215 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v289) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1f50056a50 con 0x7f1f58159c60 2023-10-07T09:04:38.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 msgr2=0x7f1f3c069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 0x7f1f3c069730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c003a30 tx=0x7f1f4c007ea0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 msgr2=0x7f1f58169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1f5806a070 tx=0x7f1f50017000 comp rx=0 tx=0).stop 2023-10-07T09:04:38.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 shutdown_connections 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f3c067280 0x7f1f3c069730 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f58159c60 0x7f1f58169900 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f58069560 0x7f1f580c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 --2- 172.21.15.46:0/1745607215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f58159890 0x7f1f58151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 >> 172.21.15.46:0/1745607215 conn(0x7f1f58068e20 msgr2=0x7f1f580c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 shutdown_connections 2023-10-07T09:04:38.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.477+0000 7f1f5eaea700 1 -- 172.21.15.46:0/1745607215 wait complete. 2023-10-07T09:04:38.490 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-07T09:04:38.490 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-07T09:04:38.490 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:04:38.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-07T09:04:38.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.610+0000 7f78114b9700 1 Processor -- start 2023-10-07T09:04:38.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.610+0000 7f78114b9700 1 -- start start 2023-10-07T09:04:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f78114b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f780c159c60 0x7f780c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f78114b9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f780c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f78114b9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c15a160 con 0x7f780c159890 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f78114b9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c15df50 con 0x7f780c159c60 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f78114b9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0d13a0 con 0x7f780c15db10 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f780affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f780c159890 0x7f780c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44076/0 (socket says 172.21.15.46:44076) 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f780affd700 1 -- 172.21.15.46:0/152773602 learned_addr learned my addr 172.21.15.46:0/152773602 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f780a7fc700 1 --2- 172.21.15.46:0/152773602 >> v2:172.21.15.133:3300/0 conn(0x7f780c159c60 0x7f780c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f780b7fe700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f780c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215827729 0 0) 0x7f780c15a160 con 0x7f780c159890 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.611+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003570 con 0x7f780c159890 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 420999657 0 0) 0x7f77f8003570 con 0x7f780c159890 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 msgr2=0x7f780c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f780c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 >> v2:172.21.15.133:3300/0 conn(0x7f780c159c60 msgr2=0x7f780c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 --2- 172.21.15.46:0/152773602 >> v2:172.21.15.133:3300/0 conn(0x7f780c159c60 0x7f780c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c15e140 con 0x7f780c159890 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f77fc001470 con 0x7f780c159890 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 >> v1:172.21.15.46:6789/0 conn(0x7f780c159890 legacy=0x7f780c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f77f8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f77f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f8004d50 0x7f77f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0d13a0 con 0x7f77f8003fe0 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800ba60 con 0x7f77f8004d50 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800bbd0 con 0x7f780c15db10 2023-10-07T09:04:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f77f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780affd700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f77f8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780b7fe700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f8004d50 0x7f77f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 -- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 msgr2=0x7f77f8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c15db10 0x7f77f8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 -- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f8004d50 msgr2=0x7f77f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f8004d50 0x7f77f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 -- 172.21.15.46:0/152773602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8003570 con 0x7f77f8003fe0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.612+0000 7f780a7fc700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f77f8004810 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009c00 tx=0x7f77f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43d2f4c28e6fa29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400e6b0 con 0x7f77f8003fe0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f400e810 con 0x7f77f8003fe0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f7809ffb700 1 -- 172.21.15.46:0/152773602 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400ebd0 con 0x7f77f8003fe0 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 -- 172.21.15.46:0/152773602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 msgr2=0x7f77f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 --2- 172.21.15.46:0/152773602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f77f8004810 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009c00 tx=0x7f77f40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f780b7fe700 1 -- 172.21.15.46:0/152773602 reap_dead start 2023-10-07T09:04:38.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 -- 172.21.15.46:0/152773602 shutdown_connections 2023-10-07T09:04:38.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 -- 172.21.15.46:0/152773602 >> 172.21.15.46:0/152773602 conn(0x7f780c068e20 msgr2=0x7f780c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:38.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 -- 172.21.15.46:0/152773602 shutdown_connections 2023-10-07T09:04:38.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.613+0000 7f78114b9700 1 -- 172.21.15.46:0/152773602 wait complete. 2023-10-07T09:04:38.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.614+0000 7f78114b9700 1 Processor -- start 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.614+0000 7f78114b9700 1 -- start start 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780c0b10d0 0x7f780c0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c169e50 0x7f780c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c152c80 con 0x7f77f8003fe0 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c169670 con 0x7f780c0b10d0 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f78114b9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c152ed0 con 0x7f780c169e50 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36048/0 (socket says 172.21.15.46:36048) 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 -- 172.21.15.46:0/2541828781 learned_addr learned my addr 172.21.15.46:0/2541828781 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780a7fc700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780c0b10d0 0x7f780c0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780b7fe700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c169e50 0x7f780c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 -- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c169e50 msgr2=0x7f780c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c169e50 0x7f780c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 -- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780c0b10d0 msgr2=0x7f780c0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.615+0000 7f780affd700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780c0b10d0 0x7f780c0cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f780affd700 1 -- 172.21.15.46:0/2541828781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c1531b0 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f780affd700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f77fc007310 tx=0x7f77fc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc018030 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00f740 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c169930 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00fb00 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.616+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0cfdd0 con 0x7f77f8003fe0 2023-10-07T09:04:38.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.617+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c04c3c0 con 0x7f77f8003fe0 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.617+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f77fc01b070 con 0x7f77f8003fe0 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.618+0000 7f7802ffd700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 0x7f77ec069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.618+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f77fc019070 con 0x7f77f8003fe0 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.618+0000 7f780a7fc700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 0x7f77ec069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.618+0000 7f780a7fc700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 0x7f77ec069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f77f40091e0 tx=0x7f77f401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:38.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.622+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77fc051670 con 0x7f77f8003fe0 2023-10-07T09:04:38.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:38.898+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f780c06a5b0 con 0x7f77f8003fe0 2023-10-07T09:04:39.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.475+0000 7f7802ffd700 1 -- 172.21.15.46:0/2541828781 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v290) v1 ==== 159+0+0 (secure 0 0 0) 0x7f77fc054c90 con 0x7f77f8003fe0 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 msgr2=0x7f77ec069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 0x7f77ec069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f77f40091e0 tx=0x7f77f401a000 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 msgr2=0x7f780c15e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f77fc007310 tx=0x7f77fc001e90 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 shutdown_connections 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f77ec067290 0x7f77ec069740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f780c169e50 0x7f780c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f8003fe0 0x7f780c15e420 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 --2- 172.21.15.46:0/2541828781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780c0b10d0 0x7f780c0cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 >> 172.21.15.46:0/2541828781 conn(0x7f780c068e20 msgr2=0x7f780c1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 shutdown_connections 2023-10-07T09:04:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.478+0000 7f78114b9700 1 -- 172.21.15.46:0/2541828781 wait complete. 2023-10-07T09:04:39.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:04:39.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.616+0000 7f343e0ac700 1 Processor -- start 2023-10-07T09:04:39.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.616+0000 7f343e0ac700 1 -- start start 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f343e0ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f343e0ac700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3438159c60 0x7f343815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f343e0ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343815a160 con 0x7f343815db10 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f343e0ac700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34380d13a0 con 0x7f3438159c60 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f343e0ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343815e140 con 0x7f3438159890 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f34377fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f3436ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3438159c60 0x7f343815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f34377fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:43468/0 (socket says 172.21.15.46:43468) 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f3436ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3438159c60 0x7f343815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33918/0 (socket says 172.21.15.46:33918) 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f34377fe700 1 -- 172.21.15.46:0/2849367194 learned_addr learned my addr 172.21.15.46:0/2849367194 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.617+0000 7f3437fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f343815db10 0x7f3438069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:39486/0 (socket says 172.21.15.46:39486) 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f3436ffd700 1 -- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 msgr2=0x7f343815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f3436ffd700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f3436ffd700 1 -- 172.21.15.46:0/2849367194 >> v1:172.21.15.133:6789/0 conn(0x7f343815db10 legacy=0x7f3438069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f3436ffd700 1 -- 172.21.15.46:0/2849367194 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343815a3d0 con 0x7f3438159c60 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f34377fe700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f3436ffd700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3438159c60 0x7f343815d5d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098e0 tx=0x7f342c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dd25ac0a3411a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f34367fc700 1 -- 172.21.15.46:0/2849367194 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00b640 con 0x7f3438159c60 2023-10-07T09:04:39.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f34367fc700 1 -- 172.21.15.46:0/2849367194 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00b7a0 con 0x7f3438159c60 2023-10-07T09:04:39.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.618+0000 7f34367fc700 1 -- 172.21.15.46:0/2849367194 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00bb40 con 0x7f3438159c60 2023-10-07T09:04:39.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 -- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3438159c60 msgr2=0x7f343815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3438159c60 0x7f343815d5d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098e0 tx=0x7f342c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 -- 172.21.15.46:0/2849367194 shutdown_connections 2023-10-07T09:04:39.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f343815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 --2- 172.21.15.46:0/2849367194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3438159c60 0x7f343815d5d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 -- 172.21.15.46:0/2849367194 >> 172.21.15.46:0/2849367194 conn(0x7f3438068e20 msgr2=0x7f34380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 -- 172.21.15.46:0/2849367194 shutdown_connections 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.619+0000 7f343e0ac700 1 -- 172.21.15.46:0/2849367194 wait complete. 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.620+0000 7f343e0ac700 1 Processor -- start 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.620+0000 7f343e0ac700 1 -- start start 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f34380cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f343815db10 0x7f34380b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b0700 con 0x7f3438159c60 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b09e0 con 0x7f343815db10 2023-10-07T09:04:39.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f343e0ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b0cc0 con 0x7f3438159890 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f3436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f34377fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f34380cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f3436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36050/0 (socket says 172.21.15.46:36050) 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f3436ffd700 1 -- 172.21.15.46:0/3547442121 learned_addr learned my addr 172.21.15.46:0/3547442121 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.621+0000 7f3437fff700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f343815db10 0x7f34380b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 -- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f343815db10 msgr2=0x7f34380b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f343815db10 0x7f34380b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 -- 172.21.15.46:0/3547442121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 msgr2=0x7f34381523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 -- 172.21.15.46:0/3547442121 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280094f0 con 0x7f3438159890 2023-10-07T09:04:39.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f3436ffd700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f34377fe700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f34380cd960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3428006fd0 tx=0x7f3428009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800c850 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342800c9b0 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c009420 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800cd30 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.622+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34380b1280 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.623+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34380b15f0 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.623+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3428013680 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.624+0000 7f341f7fe700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 0x7f3424069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.624+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f34280848d0 con 0x7f3438159890 2023-10-07T09:04:39.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.624+0000 7f3436ffd700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 0x7f3424069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:39.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.624+0000 7f3436ffd700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 0x7f3424069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f343816d750 tx=0x7f342c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:39.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.629+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3428051a30 con 0x7f3438159890 2023-10-07T09:04:39.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.822+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f343804c3c0 con 0x7f3438159890 2023-10-07T09:04:39.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.827+0000 7f341f7fe700 1 -- 172.21.15.46:0/3547442121 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f34280200c0 con 0x7f3438159890 2023-10-07T09:04:39.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 msgr2=0x7f3424069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 0x7f3424069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f343816d750 tx=0x7f342c017000 comp rx=0 tx=0).stop 2023-10-07T09:04:39.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 msgr2=0x7f34380cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f34380cd960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3428006fd0 tx=0x7f3428009250 comp rx=0 tx=0).stop 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 shutdown_connections 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3424067290 0x7f3424069740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f343815db10 0x7f34380b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3438159890 0x7f34380cd960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 --2- 172.21.15.46:0/3547442121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3438159c60 0x7f34381523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 >> 172.21.15.46:0/3547442121 conn(0x7f3438068e20 msgr2=0x7f34381585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 shutdown_connections 2023-10-07T09:04:39.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:39.829+0000 7f343e0ac700 1 -- 172.21.15.46:0/3547442121 wait complete. 2023-10-07T09:04:39.842 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:04:39.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:39.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:39.924 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:04:39.924 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:04:39.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:40.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.043+0000 7fe99ee5c700 1 Processor -- start 2023-10-07T09:04:40.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.043+0000 7fe99ee5c700 1 -- start start 2023-10-07T09:04:40.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99ee5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99ee5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9980ac6a0 0x7fe9980b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99ee5c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980acac0 con 0x7fe9980ac230 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99ee5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980ad930 con 0x7fe9980ac6a0 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99ee5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980acd20 con 0x7fe998155c10 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99cbf8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99d3f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9980ac6a0 0x7fe9980b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99d3f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9980ac6a0 0x7fe9980b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:54258/0 (socket says 172.21.15.46:54258) 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99cbf8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44770/0 (socket says 172.21.15.46:44770) 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe997fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9980ac230 0x7fe9981568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43076/0 (socket says 172.21.15.46:43076) 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.044+0000 7fe99d3f9700 1 -- 172.21.15.46:0/4241631575 learned_addr learned my addr 172.21.15.46:0/4241631575 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99d3f9700 1 -- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 msgr2=0x7fe998155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99d3f9700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99d3f9700 1 -- 172.21.15.46:0/4241631575 >> v1:172.21.15.133:6789/0 conn(0x7fe9980ac230 legacy=0x7fe9981568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe9977fe700 1 -- 172.21.15.46:0/4241631575 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287058946 0 0) 0x7fe9980acac0 con 0x7fe9980ac230 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99d3f9700 1 -- 172.21.15.46:0/4241631575 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980ad000 con 0x7fe9980ac6a0 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99cbf8700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99d3f9700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac6a0 0x7fe9980b0300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe99000aa50 tx=0x7fe99000a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3687de1649ec713d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe9977fe700 1 -- 172.21.15.46:0/4241631575 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000b750 con 0x7fe9980ac6a0 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe9977fe700 1 -- 172.21.15.46:0/4241631575 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000b8b0 con 0x7fe9980ac6a0 2023-10-07T09:04:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe9977fe700 1 -- 172.21.15.46:0/4241631575 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000bc50 con 0x7fe9980ac6a0 2023-10-07T09:04:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 -- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac6a0 msgr2=0x7fe9980b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac6a0 0x7fe9980b0300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe99000aa50 tx=0x7fe99000a330 comp rx=0 tx=0).stop 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 -- 172.21.15.46:0/4241631575 shutdown_connections 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac6a0 0x7fe9980b0300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/4241631575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe998155c10 0x7fe998155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 -- 172.21.15.46:0/4241631575 >> 172.21.15.46:0/4241631575 conn(0x7fe99806a320 msgr2=0x7fe9980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.045+0000 7fe99ee5c700 1 -- 172.21.15.46:0/4241631575 shutdown_connections 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.046+0000 7fe99ee5c700 1 -- 172.21.15.46:0/4241631575 wait complete. 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 Processor -- start 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 -- start start 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac230 0x7fe99814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9980ac6a0 0x7fe998150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99814ee50 con 0x7fe998155c10 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980cb4f0 con 0x7fe9980ac230 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.047+0000 7fe99ee5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981517b0 con 0x7fe9980ac6a0 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39332/0 (socket says 172.21.15.46:39332) 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 -- 172.21.15.46:0/3277965023 learned_addr learned my addr 172.21.15.46:0/3277965023 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99cbf8700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac230 0x7fe99814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe997fff700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9980ac6a0 0x7fe998150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 -- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9980ac6a0 msgr2=0x7fe998150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9980ac6a0 0x7fe998150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 -- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac230 msgr2=0x7fe99814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac230 0x7fe99814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 -- 172.21.15.46:0/3277965023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98000b6d0 con 0x7fe998155c10 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99d3f9700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe990006fd0 tx=0x7fe990019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99001f070 con 0x7fe998155c10 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990019450 con 0x7fe998155c10 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99000a590 con 0x7fe998155c10 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990019830 con 0x7fe998155c10 2023-10-07T09:04:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.048+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe998151550 con 0x7fe998155c10 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.049+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99806d170 con 0x7fe998155c10 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.050+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe990019ba0 con 0x7fe998155c10 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.050+0000 7fe994ff9700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 0x7fe978069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.050+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe990085e30 con 0x7fe998155c10 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.050+0000 7fe99cbf8700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 0x7fe978069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.051+0000 7fe99cbf8700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 0x7fe978069740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe980011650 tx=0x7fe98000b430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.055+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe990052e80 con 0x7fe998155c10 2023-10-07T09:04:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.290+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe99804c3c0 con 0x7fe998155c10 2023-10-07T09:04:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.291+0000 7fe994ff9700 1 -- 172.21.15.46:0/3277965023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe990014de0 con 0x7fe998155c10 2023-10-07T09:04:40.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:40.292 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3069705256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3069705256},{"type":"v1","addr":"172.21.15.133:6836","nonce":3069705256}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":5756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3748463195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3748463195},{"type":"v1","addr":"172.21.15.133:6837","nonce":3748463195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2542436293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2542436293},{"type":"v1","addr":"172.21.15.46:6834","nonce":2542436293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/324826028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":324826028},{"type":"v1","addr":"172.21.15.46:6835","nonce":324826028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 msgr2=0x7fe978069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 0x7fe978069740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe980011650 tx=0x7fe98000b430 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 msgr2=0x7fe99814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe990006fd0 tx=0x7fe990019000 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 shutdown_connections 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe978067290 0x7fe978069740 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe998155c10 0x7fe99814d420 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9980ac230 0x7fe99814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 --2- 172.21.15.46:0/3277965023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9980ac6a0 0x7fe998150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 >> 172.21.15.46:0/3277965023 conn(0x7fe99806a320 msgr2=0x7fe998153920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 shutdown_connections 2023-10-07T09:04:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.293+0000 7fe99ee5c700 1 -- 172.21.15.46:0/3277965023 wait complete. 2023-10-07T09:04:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 59 2023-10-07T09:04:40.306 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:04:40.306 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:04:40.306 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:04:40.307 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:40.307 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:04:40.307 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:04:40.307 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:04:40.307 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:40.307 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:04:40.307 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:04:40.308 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:04:40.308 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:40.308 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:04:40.308 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:04:40.308 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:04:40.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:04:40.315 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:04:40.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:04:40.316 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:04:40.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:04:40.318 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:04:40.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:04:40.319 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:04:40.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:04:40.358 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:04:40.358 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:40.359 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:04:40.359 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:40.361 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:04:40.361 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:40.362 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:04:40.362 DEBUG:teuthology.parallel:result is None 2023-10-07T09:04:40.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:04:40.439 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:04:40.440 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:04:40.442 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:04:40.442 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:04:40.443 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-10-07T09:04:40.442+0000 7faa105bb700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-07T09:04:40.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.487+0000 7f0e31f70700 1 Processor -- start 2023-10-07T09:04:40.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.487+0000 7f0e31f70700 1 -- start start 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e31f70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 0x7f0e2c157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e31f70700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c157cc0 con 0x7f0e2c1584b0 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e31f70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c0b0760 con 0x7f0e2c156790 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e31f70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0afb70 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e3176f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0e2c1584b0 0x7f0e2c1588f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46272/0 (socket says 172.21.15.46:46272) 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e3176f700 1 -- 172.21.15.46:0/1164991003 learned_addr learned my addr 172.21.15.46:0/1164991003 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.488+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1164991003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 0x7f0e2c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032574167 0 0) 0x7f0e2c157cc0 con 0x7f0e2c1584b0 2023-10-07T09:04:40.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e1c003570 con 0x7f0e2c1584b0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627270632 0 0) 0x7f0e2c0b0760 con 0x7f0e2c156790 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c157cc0 con 0x7f0e2c156790 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2bfff700 1 -- 172.21.15.46:0/1164991003 >> v1:172.21.15.133:6789/0 conn(0x7f0e2c156790 legacy=0x7f0e2c0b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2bfff700 1 -- 172.21.15.46:0/1164991003 >> v1:172.21.15.46:6789/0 conn(0x7f0e2c1584b0 legacy=0x7f0e2c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2bfff700 1 -- 172.21.15.46:0/1164991003 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0afe50 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1164991003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 0x7f0e2c157780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009910 tx=0x7f0e180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16cae5676a0a9f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18011630 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18011790 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.489+0000 7f0e2b7fe700 1 -- 172.21.15.46:0/1164991003 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18011b30 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1164991003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 msgr2=0x7f0e2c157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1164991003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 0x7f0e2c157780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009910 tx=0x7f0e180091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1164991003 shutdown_connections 2023-10-07T09:04:40.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1164991003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c0b25c0 0x7f0e2c157780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1164991003 >> 172.21.15.46:0/1164991003 conn(0x7f0e2c06ddb0 msgr2=0x7f0e2c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:40.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1164991003 shutdown_connections 2023-10-07T09:04:40.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1164991003 wait complete. 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.491+0000 7f0e31f70700 1 Processor -- start 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.491+0000 7f0e31f70700 1 -- start start 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 0x7f0e2c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 0x7f0e2c06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c14e2c0 con 0x7f0e2c156790 2023-10-07T09:04:40.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c166dc0 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e31f70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c167b40 con 0x7f0e2c1584b0 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e3176f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 0x7f0e2c06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e30f6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e30f6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:54292/0 (socket says 172.21.15.46:54292) 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e3176f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 0x7f0e2c06b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44810/0 (socket says 172.21.15.46:44810) 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.492+0000 7f0e30f6e700 1 -- 172.21.15.46:0/1952736857 learned_addr learned my addr 172.21.15.46:0/1952736857 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 0x7f0e2c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 -- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 msgr2=0x7f0e2c06b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 0x7f0e2c06b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 -- 172.21.15.46:0/1952736857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 msgr2=0x7f0e2c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 0x7f0e2c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:40.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 -- 172.21.15.46:0/1952736857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18009420 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 0x7f0e2c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e30f6e700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000c7c0 tx=0x7f0e20007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20001520 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200016a0 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c167060 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20001a60 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.493+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c167620 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.494+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c04c3c0 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.495+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0e2001b3b0 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.495+0000 7f0e28ff9700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 0x7f0e10069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.495+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0e20084110 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.495+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 0x7f0e10069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.496+0000 7f0e2bfff700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 0x7f0e10069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009860 tx=0x7f0e18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:40.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.500+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e20051270 con 0x7f0e2c0b25c0 2023-10-07T09:04:40.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:40.709+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0e2c156b60 con 0x7f0e2c0b25c0 2023-10-07T09:04:41.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.488+0000 7f0e28ff9700 1 -- 172.21.15.46:0/1952736857 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0e20054890 con 0x7f0e2c0b25c0 2023-10-07T09:04:41.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 msgr2=0x7f0e10069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 0x7f0e10069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009860 tx=0x7f0e18017000 comp rx=0 tx=0).stop 2023-10-07T09:04:41.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 msgr2=0x7f0e2c0c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000c7c0 tx=0x7f0e20007dd0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 shutdown_connections 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e10067290 0x7f0e10069740 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e2c1584b0 0x7f0e2c06b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e2c0b25c0 0x7f0e2c0c7810 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 --2- 172.21.15.46:0/1952736857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e2c156790 0x7f0e2c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 >> 172.21.15.46:0/1952736857 conn(0x7f0e2c06ddb0 msgr2=0x7f0e2c1540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 shutdown_connections 2023-10-07T09:04:41.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.490+0000 7f0e31f70700 1 -- 172.21.15.46:0/1952736857 wait complete. 2023-10-07T09:04:41.493 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:04:41.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:04:41.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.627+0000 7fb4ed1e5700 1 Processor -- start 2023-10-07T09:04:41.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.627+0000 7fb4ed1e5700 1 -- start start 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4ed1e5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4e8159c60 0x7fb4e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4ed1e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 0x7fb4e8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4ed1e5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e815a160 con 0x7fb4e8159890 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4ed1e5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e815df50 con 0x7fb4e8159c60 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4ed1e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80d13a0 con 0x7fb4e815db10 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4e659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4e8159c60 0x7fb4e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.628+0000 7fb4e759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 0x7fb4e8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4e8159890 0x7fb4e815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43104/0 (socket says 172.21.15.46:43104) 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e6d9d700 1 -- 172.21.15.46:0/2198671270 learned_addr learned my addr 172.21.15.46:0/2198671270 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e659c700 1 -- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 msgr2=0x7fb4e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e659c700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 0x7fb4e8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e659c700 1 -- 172.21.15.46:0/2198671270 >> v1:172.21.15.133:6789/0 conn(0x7fb4e8159890 legacy=0x7fb4e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e659c700 1 -- 172.21.15.46:0/2198671270 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e815e140 con 0x7fb4e8159c60 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e5d9b700 1 -- 172.21.15.46:0/2198671270 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55883382 0 0) 0x7fb4e815a160 con 0x7fb4e8159890 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e759e700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 0x7fb4e8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e659c700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e8159c60 0x7fb4e815d5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0098e0 tx=0x7fb4dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=475513c627b75900 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e5d9b700 1 -- 172.21.15.46:0/2198671270 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00b640 con 0x7fb4e8159c60 2023-10-07T09:04:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e5d9b700 1 -- 172.21.15.46:0/2198671270 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00b7a0 con 0x7fb4e8159c60 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.629+0000 7fb4e5d9b700 1 -- 172.21.15.46:0/2198671270 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00bb40 con 0x7fb4e8159c60 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e8159c60 msgr2=0x7fb4e815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e8159c60 0x7fb4e815d5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0098e0 tx=0x7fb4dc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/2198671270 shutdown_connections 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e815db10 0x7fb4e8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/2198671270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e8159c60 0x7fb4e815d5d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/2198671270 >> 172.21.15.46:0/2198671270 conn(0x7fb4e8068e20 msgr2=0x7fb4e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/2198671270 shutdown_connections 2023-10-07T09:04:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.630+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/2198671270 wait complete. 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.632+0000 7fb4ed1e5700 1 Processor -- start 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.632+0000 7fb4ed1e5700 1 -- start start 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e8159890 0x7fb4e815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 0x7fb4e8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80b14d0 con 0x7fb4e8159c60 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80b11f0 con 0x7fb4e815db10 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e815b600 con 0x7fb4e8159890 2023-10-07T09:04:41.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39384/0 (socket says 172.21.15.46:39384) 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 -- 172.21.15.46:0/123811786 learned_addr learned my addr 172.21.15.46:0/123811786 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e759e700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 0x7fb4e8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e6d9d700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e8159890 0x7fb4e815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 -- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e8159890 msgr2=0x7fb4e815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e8159890 0x7fb4e815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 -- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 msgr2=0x7fb4e8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 0x7fb4e8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 -- 172.21.15.46:0/123811786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a20 con 0x7fb4e8159c60 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e759e700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 0x7fb4e8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4e659c700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80899c0 tx=0x7fb4dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:41.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00bb20 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc011420 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009420 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.633+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0117c0 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.634+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e815bbc0 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.634+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e815bdb0 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.635+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb4dc011b70 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.635+0000 7fb4ceffd700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 0x7fb4d4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.635+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb4dc085e40 con 0x7fb4e8159c60 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.635+0000 7fb4e6d9d700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 0x7fb4d4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:41.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.636+0000 7fb4e6d9d700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 0x7fb4d4069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80011e0 tx=0x7fb4d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:41.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.639+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4dc052fb0 con 0x7fb4e8159c60 2023-10-07T09:04:41.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.909+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb4e804c3c0 con 0x7fb4e8159c60 2023-10-07T09:04:41.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.910+0000 7fb4ceffd700 1 -- 172.21.15.46:0/123811786 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb4dc0565d0 con 0x7fb4e8159c60 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:41.911 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.913 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:04:41.914 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.915 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.916 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.918 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.919 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:41.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.922 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:04:41.923 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:04:41.925 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.926 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:41.926 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:04:41.926 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.911+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 msgr2=0x7fb4d4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.911+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 0x7fb4d4069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80011e0 tx=0x7fb4d8009040 comp rx=0 tx=0).stop 2023-10-07T09:04:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.911+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 msgr2=0x7fb4e814b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.911+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80899c0 tx=0x7fb4dc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 shutdown_connections 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb4d4067290 0x7fb4d4069740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e815db10 0x7fb4e8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4e8159890 0x7fb4e815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 --2- 172.21.15.46:0/123811786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4e8159c60 0x7fb4e814b120 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 >> 172.21.15.46:0/123811786 conn(0x7fb4e8068e20 msgr2=0x7fb4e814d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 shutdown_connections 2023-10-07T09:04:41.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:41.912+0000 7fb4ed1e5700 1 -- 172.21.15.46:0/123811786 wait complete. 2023-10-07T09:04:41.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.046+0000 7f3c9525f700 1 Processor -- start 2023-10-07T09:04:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.046+0000 7f3c9525f700 1 -- start start 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c9525f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c9525f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c9015df50 0x7f3c9015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c9525f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9015d7e0 con 0x7f3c9006c0a0 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c9525f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9015dac0 con 0x7f3c9015df50 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c9525f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9015aa30 con 0x7f3c9006bcd0 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c9015df50 0x7f3c9015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8ed9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c9015df50 0x7f3c9015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:54314/0 (socket says 172.21.15.46:54314) 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8f59e700 1 -- 172.21.15.46:0/3911462986 learned_addr learned my addr 172.21.15.46:0/3911462986 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8ed9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44824/0 (socket says 172.21.15.46:44824) 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.047+0000 7f3c8e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3c9006c0a0 0x7f3c9015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43118/0 (socket says 172.21.15.46:43118) 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8f59e700 1 -- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 msgr2=0x7f3c900caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8f59e700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8f59e700 1 -- 172.21.15.46:0/3911462986 >> v1:172.21.15.133:6789/0 conn(0x7f3c9006c0a0 legacy=0x7f3c9015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8f59e700 1 -- 172.21.15.46:0/3911462986 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9015ad10 con 0x7f3c9015df50 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8dd9b700 1 -- 172.21.15.46:0/3911462986 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594918003 0 0) 0x7f3c9015d7e0 con 0x7f3c9006c0a0 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8ed9d700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8f59e700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9015df50 0x7f3c9015e3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c880099b0 tx=0x7f3c88009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65856a909e1d003 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8dd9b700 1 -- 172.21.15.46:0/3911462986 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88009ea0 con 0x7f3c9015df50 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8dd9b700 1 -- 172.21.15.46:0/3911462986 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800b860 con 0x7f3c9015df50 2023-10-07T09:04:42.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.048+0000 7f3c8dd9b700 1 -- 172.21.15.46:0/3911462986 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800bc20 con 0x7f3c9015df50 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 -- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9015df50 msgr2=0x7f3c9015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9015df50 0x7f3c9015e3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c880099b0 tx=0x7f3c88009250 comp rx=0 tx=0).stop 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 -- 172.21.15.46:0/3911462986 shutdown_connections 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9015df50 0x7f3c9015e3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 --2- 172.21.15.46:0/3911462986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9006bcd0 0x7f3c900caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 -- 172.21.15.46:0/3911462986 >> 172.21.15.46:0/3911462986 conn(0x7f3c900ce600 msgr2=0x7f3c900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 -- 172.21.15.46:0/3911462986 shutdown_connections 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.049+0000 7f3c9525f700 1 -- 172.21.15.46:0/3911462986 wait complete. 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.050+0000 7f3c9525f700 1 Processor -- start 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.050+0000 7f3c9525f700 1 -- start start 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9006c0a0 0x7f3c900b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9015df50 0x7f3c90145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b2c10 con 0x7f3c9006bcd0 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9015eba0 con 0x7f3c9006c0a0 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9015ee80 con 0x7f3c9015df50 2023-10-07T09:04:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39400/0 (socket says 172.21.15.46:39400) 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 -- 172.21.15.46:0/2791010993 learned_addr learned my addr 172.21.15.46:0/2791010993 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8f59e700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9015df50 0x7f3c90145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8e59c700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9006c0a0 0x7f3c900b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 -- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9015df50 msgr2=0x7f3c90145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9015df50 0x7f3c90145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 -- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9006c0a0 msgr2=0x7f3c900b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9006c0a0 0x7f3c900b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 -- 172.21.15.46:0/2791010993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80009a20 con 0x7f3c9006bcd0 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c8ed9d700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c0c0 tx=0x7f3c8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000cd60 con 0x7f3c9006bcd0 2023-10-07T09:04:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8000f040 con 0x7f3c9006bcd0 2023-10-07T09:04:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c880094f0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.051+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800146b0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.052+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900b2870 con 0x7f3c9006bcd0 2023-10-07T09:04:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.052+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9004c3c0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.053+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3c80014a20 con 0x7f3c9006bcd0 2023-10-07T09:04:42.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.053+0000 7f3c86ffd700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 0x7f3c70069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.053+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c80085660 con 0x7f3c9006bcd0 2023-10-07T09:04:42.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.054+0000 7f3c8e59c700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 0x7f3c70069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.054+0000 7f3c8e59c700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 0x7f3c70069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c78007fd0 tx=0x7f3c78007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.058+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c800526c0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.250+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c9015aff0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.251+0000 7f3c86ffd700 1 -- 172.21.15.46:0/2791010993 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f3c80055ce0 con 0x7f3c9006bcd0 2023-10-07T09:04:42.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:42.252 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":98,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:41.484983+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 msgr2=0x7f3c70069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 0x7f3c70069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c78007fd0 tx=0x7f3c78007e10 comp rx=0 tx=0).stop 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 msgr2=0x7f3c90145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c0c0 tx=0x7f3c8000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 shutdown_connections 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c70067290 0x7f3c70069740 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c9015df50 0x7f3c90145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c9006bcd0 0x7f3c90145d00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 --2- 172.21.15.46:0/2791010993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9006c0a0 0x7f3c900b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 >> 172.21.15.46:0/2791010993 conn(0x7f3c900ce600 msgr2=0x7f3c90069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 shutdown_connections 2023-10-07T09:04:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.253+0000 7f3c9525f700 1 -- 172.21.15.46:0/2791010993 wait complete. 2023-10-07T09:04:42.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:04:42.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:04:42.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.387+0000 7fb5f6e69700 1 Processor -- start 2023-10-07T09:04:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.387+0000 7fb5f6e69700 1 -- start start 2023-10-07T09:04:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f6e69700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb5f00b16d0 0x7fb5f00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f6e69700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00b2080 con 0x7fb5f00b4e70 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f6e69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00cfb00 con 0x7fb5f00b33b0 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f6e69700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00b5c40 con 0x7fb5f00b16d0 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb5f00b16d0 0x7fb5f00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb5f00b16d0 0x7fb5f00b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39414/0 (socket says 172.21.15.46:39414) 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 -- 172.21.15.46:0/3564478323 learned_addr learned my addr 172.21.15.46:0/3564478323 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5e67700 1 --1- 172.21.15.46:0/3564478323 >> v1:172.21.15.46:6789/0 conn(0x7fb5f00b4e70 0x7fb5f00ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46274/0 (socket says 172.21.15.46:46274) 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 -- 172.21.15.46:0/3564478323 >> v1:172.21.15.133:6789/0 conn(0x7fb5f00b33b0 legacy=0x7fb5f00b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 -- 172.21.15.46:0/3564478323 >> v1:172.21.15.46:6789/0 conn(0x7fb5f00b4e70 legacy=0x7fb5f00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 -- 172.21.15.46:0/3564478323 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00b5f20 con 0x7fb5f00b16d0 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.388+0000 7fb5f5666700 1 --2- 172.21.15.46:0/3564478323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f00b1b40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40099b0 tx=0x7fb5e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853feba4ba119f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f4e65700 1 -- 172.21.15.46:0/3564478323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400b820 con 0x7fb5f00b16d0 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f4e65700 1 -- 172.21.15.46:0/3564478323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e400b980 con 0x7fb5f00b16d0 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f4e65700 1 -- 172.21.15.46:0/3564478323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400bd40 con 0x7fb5f00b16d0 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 -- 172.21.15.46:0/3564478323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 msgr2=0x7fb5f00b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/3564478323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f00b1b40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40099b0 tx=0x7fb5e4009250 comp rx=0 tx=0).stop 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 -- 172.21.15.46:0/3564478323 shutdown_connections 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/3564478323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f00b1b40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 -- 172.21.15.46:0/3564478323 >> 172.21.15.46:0/3564478323 conn(0x7fb5f00d10c0 msgr2=0x7fb5f00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 -- 172.21.15.46:0/3564478323 shutdown_connections 2023-10-07T09:04:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.389+0000 7fb5f6e69700 1 -- 172.21.15.46:0/3564478323 wait complete. 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.390+0000 7fb5f6e69700 1 Processor -- start 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.390+0000 7fb5f6e69700 1 -- start start 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f00b33b0 0x7fb5f00a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00b4e70 0x7fb5f00a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c8800 con 0x7fb5f00b16d0 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c8ae0 con 0x7fb5f00b4e70 2023-10-07T09:04:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6e69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c8dc0 con 0x7fb5f00b33b0 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f5e67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f5e67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39428/0 (socket says 172.21.15.46:39428) 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f5e67700 1 -- 172.21.15.46:0/2949669482 learned_addr learned my addr 172.21.15.46:0/2949669482 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f6668700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00b4e70 0x7fb5f00a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.391+0000 7fb5f5666700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f00b33b0 0x7fb5f00a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 -- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f00b33b0 msgr2=0x7fb5f00a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f00b33b0 0x7fb5f00a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 -- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00b4e70 msgr2=0x7fb5f00a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00b4e70 0x7fb5f00a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 -- 172.21.15.46:0/2949669482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e40094f0 con 0x7fb5f00b16d0 2023-10-07T09:04:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f5e67700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c560 tx=0x7fb5e8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8005a70 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8005bd0 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f00c90a0 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80070d0 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.392+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f00a7110 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.393+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f016b510 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.393+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb5e8007480 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.394+0000 7fb5edffb700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 0x7fb5dc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.394+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb5e8083a90 con 0x7fb5f00b16d0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.394+0000 7fb5f5666700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 0x7fb5dc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.395+0000 7fb5f5666700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 0x7fb5dc069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40099b0 tx=0x7fb5e4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.398+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5e8050c40 con 0x7fb5f00b16d0 2023-10-07T09:04:42.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:04:42.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:04:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.596+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5f00cd820 con 0x7fb5f00b16d0 2023-10-07T09:04:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.596+0000 7fb5edffb700 1 -- 172.21.15.46:0/2949669482 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5e8017020 con 0x7fb5f00b16d0 2023-10-07T09:04:42.597 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:04:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 msgr2=0x7fb5dc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 0x7fb5dc069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40099b0 tx=0x7fb5e4016000 comp rx=0 tx=0).stop 2023-10-07T09:04:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 msgr2=0x7fb5f016ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c560 tx=0x7fb5e8007f70 comp rx=0 tx=0).stop 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 shutdown_connections 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb5dc067290 0x7fb5dc069740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00b4e70 0x7fb5f00a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f00b16d0 0x7fb5f016ac30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 --2- 172.21.15.46:0/2949669482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5f00b33b0 0x7fb5f00a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 >> 172.21.15.46:0/2949669482 conn(0x7fb5f00d10c0 msgr2=0x7fb5f00b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 shutdown_connections 2023-10-07T09:04:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.598+0000 7fb5f6e69700 1 -- 172.21.15.46:0/2949669482 wait complete. 2023-10-07T09:04:42.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:04:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.729+0000 7f17a080d700 1 Processor -- start 2023-10-07T09:04:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.729+0000 7f17a080d700 1 -- start start 2023-10-07T09:04:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f17a080d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 0x7f179c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f17a080d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f179c1597f0 0x7f179c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f17a080d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0b11d0 con 0x7f179c15d230 2023-10-07T09:04:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f17a080d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0b14b0 con 0x7f179c1597f0 2023-10-07T09:04:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f17a080d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0b1790 con 0x7f179c159420 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f179c1597f0 0x7f179c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f179c1597f0 0x7f179c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39432/0 (socket says 172.21.15.46:39432) 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 -- 172.21.15.46:0/2654904715 learned_addr learned my addr 172.21.15.46:0/2654904715 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2654904715 >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 0x7f179c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 -- 172.21.15.46:0/2654904715 >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 msgr2=0x7f179c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 --2- 172.21.15.46:0/2654904715 >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 0x7f179c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 -- 172.21.15.46:0/2654904715 >> v1:172.21.15.133:6789/0 conn(0x7f179c15d230 legacy=0x7f179c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179affd700 1 -- 172.21.15.46:0/2654904715 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0b1a70 con 0x7f179c1597f0 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.730+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2654904715 >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 0x7f179c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f179affd700 1 --2- 172.21.15.46:0/2654904715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0b2270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b2f20 tx=0x7f1790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f7694f7c6b7f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f179a7fc700 1 -- 172.21.15.46:0/2654904715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000b860 con 0x7f179c1597f0 2023-10-07T09:04:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f179a7fc700 1 -- 172.21.15.46:0/2654904715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179000b9c0 con 0x7f179c1597f0 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f179a7fc700 1 -- 172.21.15.46:0/2654904715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000bd60 con 0x7f179c1597f0 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 -- 172.21.15.46:0/2654904715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 msgr2=0x7f179c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 --2- 172.21.15.46:0/2654904715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0b2270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b2f20 tx=0x7f1790009250 comp rx=0 tx=0).stop 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 -- 172.21.15.46:0/2654904715 shutdown_connections 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 --2- 172.21.15.46:0/2654904715 >> v2:172.21.15.133:3300/0 conn(0x7f179c159420 0x7f179c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 --2- 172.21.15.46:0/2654904715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0b2270 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 -- 172.21.15.46:0/2654904715 >> 172.21.15.46:0/2654904715 conn(0x7f179c0d0660 msgr2=0x7f179c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 -- 172.21.15.46:0/2654904715 shutdown_connections 2023-10-07T09:04:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.731+0000 7f17a080d700 1 -- 172.21.15.46:0/2654904715 wait complete. 2023-10-07T09:04:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 Processor -- start 2023-10-07T09:04:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 -- start start 2023-10-07T09:04:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 0x7f179c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 0x7f179c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0c9050 con 0x7f179c1597f0 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0c5940 con 0x7f179c15d230 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f17a080d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0c9550 con 0x7f179c159420 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f179affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.733+0000 7f179affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39442/0 (socket says 172.21.15.46:39442) 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 -- 172.21.15.46:0/2283799953 learned_addr learned my addr 172.21.15.46:0/2283799953 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 0x7f179c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179bfff700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 0x7f179c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 -- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 msgr2=0x7f179c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 0x7f179c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 -- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 msgr2=0x7f179c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 0x7f179c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 -- 172.21.15.46:0/2283799953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900094f0 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 0x7f179c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179bfff700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 0x7f179c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f179affd700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1790009290 tx=0x7f1790017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790011e60 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179001f070 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c0c5b70 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179001a870 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.734+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c0c6130 con 0x7f179c1597f0 2023-10-07T09:04:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.735+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c04c3c0 con 0x7f179c1597f0 2023-10-07T09:04:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.736+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f179001abe0 con 0x7f179c1597f0 2023-10-07T09:04:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.736+0000 7f17837fe700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 0x7f1788069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.736+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1790021070 con 0x7f179c1597f0 2023-10-07T09:04:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.736+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 0x7f1788069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.737+0000 7f179b7fe700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 0x7f1788069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f178c006f00 tx=0x7f178c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.740+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17900538d0 con 0x7f179c1597f0 2023-10-07T09:04:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.935+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f179c0b37c0 con 0x7f179c1597f0 2023-10-07T09:04:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.936+0000 7f17837fe700 1 -- 172.21.15.46:0/2283799953 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1790015090 con 0x7f179c1597f0 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:42.937 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 msgr2=0x7f1788069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 0x7f1788069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f178c006f00 tx=0x7f178c008040 comp rx=0 tx=0).stop 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 msgr2=0x7f179c0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1790009290 tx=0x7f1790017000 comp rx=0 tx=0).stop 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 shutdown_connections 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1788067290 0x7f1788069740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f179c15d230 0x7f179c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f179c159420 0x7f179c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 --2- 172.21.15.46:0/2283799953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f179c1597f0 0x7f179c0c5400 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 >> 172.21.15.46:0/2283799953 conn(0x7f179c0d0660 msgr2=0x7f179c1553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 shutdown_connections 2023-10-07T09:04:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:42.938+0000 7f17a080d700 1 -- 172.21.15.46:0/2283799953 wait complete. 2023-10-07T09:04:42.951 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:04:42.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:04:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.073+0000 7f7c8d6c2700 1 Processor -- start 2023-10-07T09:04:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.073+0000 7f7c8d6c2700 1 -- start start 2023-10-07T09:04:43.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c8d6c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c880b3b00 0x7f7c8806a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c8d6c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c880b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c8d6c2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c88069a00 con 0x7f7c880b3ed0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c8d6c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c88069ce0 con 0x7f7c880b3b00 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c8d6c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88069fc0 con 0x7f7c8815df00 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c877fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7c880b3ed0 0x7f7c8806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46284/0 (socket says 172.21.15.46:46284) 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c877fe700 1 -- 172.21.15.46:0/2193080105 learned_addr learned my addr 172.21.15.46:0/2193080105 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c867fc700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c880b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c86ffd700 1 --2- 172.21.15.46:0/2193080105 >> v2:172.21.15.133:3300/0 conn(0x7f7c880b3b00 0x7f7c8806a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386232659 0 0) 0x7f7c88069a00 con 0x7f7c880b3ed0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.074+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c74003570 con 0x7f7c880b3ed0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496652814 0 0) 0x7f7c74003570 con 0x7f7c880b3ed0 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 msgr2=0x7f7c880b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c880b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 >> v2:172.21.15.133:3300/0 conn(0x7f7c880b3b00 msgr2=0x7f7c8806a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 --2- 172.21.15.46:0/2193080105 >> v2:172.21.15.133:3300/0 conn(0x7f7c880b3b00 0x7f7c8806a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8806a2a0 con 0x7f7c880b3ed0 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f7c78001470 con 0x7f7c880b3ed0 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 >> v1:172.21.15.46:6789/0 conn(0x7f7c880b3ed0 legacy=0x7f7c8806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c74003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74003fe0 0x7f7c74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c74004d50 0x7f7c740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88069ce0 con 0x7f7c74004d50 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88069fc0 con 0x7f7c74003fe0 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7400ba90 con 0x7f7c8815df00 2023-10-07T09:04:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c74004d50 0x7f7c740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c86ffd700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c74003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c867fc700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74003fe0 0x7f7c74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 -- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 msgr2=0x7f7c74003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8815df00 0x7f7c74003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 -- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74003fe0 msgr2=0x7f7c74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74003fe0 0x7f7c74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 -- 172.21.15.46:0/2193080105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74003570 con 0x7f7c74004d50 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c877fe700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c74004d50 0x7f7c740051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c3c0 tx=0x7f7c78001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81869e74d401bb94 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800cc30 con 0x7f7c74004d50 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.075+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800cdb0 con 0x7f7c74004d50 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c85ffb700 1 -- 172.21.15.46:0/2193080105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005b70 con 0x7f7c74004d50 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/2193080105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c74004d50 msgr2=0x7f7c740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/2193080105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c74004d50 0x7f7c740051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c3c0 tx=0x7f7c78001e90 comp rx=0 tx=0).stop 2023-10-07T09:04:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c877fe700 1 -- 172.21.15.46:0/2193080105 reap_dead start 2023-10-07T09:04:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/2193080105 shutdown_connections 2023-10-07T09:04:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/2193080105 >> 172.21.15.46:0/2193080105 conn(0x7f7c8806d1e0 msgr2=0x7f7c8806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/2193080105 shutdown_connections 2023-10-07T09:04:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.076+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/2193080105 wait complete. 2023-10-07T09:04:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.077+0000 7f7c8d6c2700 1 Processor -- start 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.077+0000 7f7c8d6c2700 1 -- start start 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c74004d50 0x7f7c88143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 0x7f7c880c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881444b0 con 0x7f7c880cc890 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880cd240 con 0x7f7c880ceb10 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c8d6c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880ca0c0 con 0x7f7c74004d50 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39456/0 (socket says 172.21.15.46:39456) 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c877fe700 1 -- 172.21.15.46:0/3874941760 learned_addr learned my addr 172.21.15.46:0/3874941760 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c86ffd700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c74004d50 0x7f7c88143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c867fc700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 0x7f7c880c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c877fe700 1 -- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c74004d50 msgr2=0x7f7c88143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.078+0000 7f7c877fe700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c74004d50 0x7f7c88143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c877fe700 1 -- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 msgr2=0x7f7c880c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c877fe700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 0x7f7c880c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c877fe700 1 -- 172.21.15.46:0/3874941760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880c8ab0 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c867fc700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 0x7f7c880c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c877fe700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7c78000c00 tx=0x7f7c78015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800cc30 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78001bb0 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c880c8d90 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78007840 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.079+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c880c9350 con 0x7f7c880cc890 2023-10-07T09:04:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.080+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c880ca250 con 0x7f7c880cc890 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.080+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7c78019030 con 0x7f7c880cc890 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.081+0000 7f7c7effd700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 0x7f7c68069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.081+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7c78084f90 con 0x7f7c880cc890 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.081+0000 7f7c86ffd700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 0x7f7c68069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.081+0000 7f7c86ffd700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 0x7f7c68069740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009fd0 tx=0x7f7c8000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.085+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c78052140 con 0x7f7c880cc890 2023-10-07T09:04:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.278+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c8804c3c0 con 0x7f7c880cc890 2023-10-07T09:04:43.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.495+0000 7f7c7effd700 1 -- 172.21.15.46:0/3874941760 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c78055760 con 0x7f7c880cc890 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 msgr2=0x7f7c68069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 0x7f7c68069740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009fd0 tx=0x7f7c8000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 msgr2=0x7f7c880ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7c78000c00 tx=0x7f7c78015000 comp rx=0 tx=0).stop 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 shutdown_connections 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c68067290 0x7f7c68069740 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009fd0 tx=0x7f7c8000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c880cc890 0x7f7c880ccd00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c74004d50 0x7f7c88143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 --2- 172.21.15.46:0/3874941760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c880ceb10 0x7f7c880c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.499+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 >> 172.21.15.46:0/3874941760 conn(0x7f7c8806d1e0 msgr2=0x7f7c8815b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:43.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.500+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 shutdown_connections 2023-10-07T09:04:43.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.500+0000 7f7c8d6c2700 1 -- 172.21.15.46:0/3874941760 wait complete. 2023-10-07T09:04:43.503 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:04:43.515 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:04:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.640+0000 7f738129c700 1 Processor -- start 2023-10-07T09:04:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.640+0000 7f738129c700 1 -- start start 2023-10-07T09:04:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f738129c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f737c06af90 0x7f737c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f738129c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f737c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f738129c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0c9860 con 0x7f737c15e020 2023-10-07T09:04:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f738129c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0c8cd0 con 0x7f737c06af90 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f738129c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0cd200 con 0x7f737c06b360 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f7380a9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f737c15e020 0x7f737c06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46288/0 (socket says 172.21.15.46:46288) 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f7380a9b700 1 -- 172.21.15.46:0/55345541 learned_addr learned my addr 172.21.15.46:0/55345541 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675333060 0 0) 0x7f737c0c9860 con 0x7f737c15e020 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f737bfff700 1 --2- 172.21.15.46:0/55345541 >> v2:172.21.15.133:3300/0 conn(0x7f737c06af90 0x7f737c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7368003570 con 0x7f737c15e020 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.641+0000 7f7373fff700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f737c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3357322998 0 0) 0x7f7368003570 con 0x7f737c15e020 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 msgr2=0x7f737c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f737c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 >> v2:172.21.15.133:3300/0 conn(0x7f737c06af90 msgr2=0x7f737c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 --2- 172.21.15.46:0/55345541 >> v2:172.21.15.133:3300/0 conn(0x7f737c06af90 0x7f737c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c15e4c0 con 0x7f737c15e020 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f73740017f0 con 0x7f737c15e020 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 >> v1:172.21.15.46:6789/0 conn(0x7f737c15e020 legacy=0x7f737c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368003a60 0x7f7368003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f7368004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7368004d50 0x7f73680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c8cd0 con 0x7f7368004d50 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0cd200 con 0x7f7368003a60 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736800ba60 con 0x7f737c06b360 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7368004d50 0x7f73680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7373fff700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f7368004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737bfff700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368003a60 0x7f7368003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 -- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 msgr2=0x7f7368004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c06b360 0x7f7368004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 -- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368003a60 msgr2=0x7f7368003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368003a60 0x7f7368003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 -- 172.21.15.46:0/55345541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368003570 con 0x7f7368004d50 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f7380a9b700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7368004d50 0x7f73680051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f737400a970 tx=0x7f737c0c97d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4b20658b4ebe3e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.642+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740070d0 con 0x7f7368004d50 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7374007270 con 0x7f7368004d50 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f737b7fe700 1 -- 172.21.15.46:0/55345541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374007630 con 0x7f7368004d50 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 -- 172.21.15.46:0/55345541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7368004d50 msgr2=0x7f73680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 --2- 172.21.15.46:0/55345541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7368004d50 0x7f73680051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f737400a970 tx=0x7f737c0c97d0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f7380a9b700 1 -- 172.21.15.46:0/55345541 reap_dead start 2023-10-07T09:04:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 -- 172.21.15.46:0/55345541 shutdown_connections 2023-10-07T09:04:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 -- 172.21.15.46:0/55345541 >> 172.21.15.46:0/55345541 conn(0x7f737c06baa0 msgr2=0x7f737c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 -- 172.21.15.46:0/55345541 shutdown_connections 2023-10-07T09:04:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.643+0000 7f738129c700 1 -- 172.21.15.46:0/55345541 wait complete. 2023-10-07T09:04:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.644+0000 7f738129c700 1 Processor -- start 2023-10-07T09:04:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.644+0000 7f738129c700 1 -- start start 2023-10-07T09:04:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368004d50 0x7f737c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c0b2290 0x7f737c0b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c153f50 con 0x7f737c0afd40 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0b06f0 con 0x7f7368004d50 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f738129c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0b3940 con 0x7f737c0b2290 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39464/0 (socket says 172.21.15.46:39464) 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 -- 172.21.15.46:0/2829987798 learned_addr learned my addr 172.21.15.46:0/2829987798 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f737bfff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368004d50 0x7f737c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7380a9b700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c0b2290 0x7f737c0b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 -- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c0b2290 msgr2=0x7f737c0b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c0b2290 0x7f737c0b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 -- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368004d50 msgr2=0x7f737c0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:43.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368004d50 0x7f737c0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.645+0000 7f7373fff700 1 -- 172.21.15.46:0/2829987798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c15a0e0 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f7373fff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7364011b10 tx=0x7f73640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400f940 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400faa0 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400fe20 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0b30a0 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.646+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0b3660 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.647+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c04c3c0 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.647+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7364014650 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.648+0000 7f7378ff9700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 0x7f735c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.648+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7364018030 con 0x7f737c0afd40 2023-10-07T09:04:43.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.648+0000 7f737bfff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 0x7f735c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.648+0000 7f737bfff700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 0x7f735c069740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f736c006f00 tx=0x7f736c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:43.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.652+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73640522a0 con 0x7f737c0afd40 2023-10-07T09:04:43.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:43.844+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f737c0c8f30 con 0x7f737c0afd40 2023-10-07T09:04:44.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.505+0000 7f7378ff9700 1 -- 172.21.15.46:0/2829987798 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7f73640558c0 con 0x7f737c0afd40 2023-10-07T09:04:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 msgr2=0x7f735c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 0x7f735c069740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f736c006f00 tx=0x7f736c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 msgr2=0x7f737c0b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7364011b10 tx=0x7f73640091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 shutdown_connections 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f735c067290 0x7f735c069740 secure :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f736c006f00 tx=0x7f736c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f737c0b2290 0x7f737c0b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7368004d50 0x7f737c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 --2- 172.21.15.46:0/2829987798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f737c0afd40 0x7f737c0b01b0 secure :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7364011b10 tx=0x7f73640091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.512+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 >> 172.21.15.46:0/2829987798 conn(0x7f737c06baa0 msgr2=0x7f737c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.515+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 shutdown_connections 2023-10-07T09:04:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.515+0000 7f738129c700 1 -- 172.21.15.46:0/2829987798 wait complete. 2023-10-07T09:04:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:04:44.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:04:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.662+0000 7f62cbe40700 1 Processor -- start 2023-10-07T09:04:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.662+0000 7f62cbe40700 1 -- start start 2023-10-07T09:04:44.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62c4159890 0x7f62c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62c4159c60 0x7f62c415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c415db10 0x7f62c4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c415df50 con 0x7f62c4159890 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c415a160 con 0x7f62c4159c60 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62cbe40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40d13a0 con 0x7f62c415db10 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62c9bdc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62c4159890 0x7f62c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62c9bdc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62c4159890 0x7f62c415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39478/0 (socket says 172.21.15.46:39478) 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62c9bdc700 1 -- 172.21.15.46:0/257424235 learned_addr learned my addr 172.21.15.46:0/257424235 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62ca3dd700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c415db10 0x7f62c4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.663+0000 7f62c93db700 1 --2- 172.21.15.46:0/257424235 >> v2:172.21.15.133:3300/0 conn(0x7f62c4159c60 0x7f62c415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 -- 172.21.15.46:0/257424235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c415db10 msgr2=0x7f62c4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c415db10 0x7f62c4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 -- 172.21.15.46:0/257424235 >> v2:172.21.15.133:3300/0 conn(0x7f62c4159c60 msgr2=0x7f62c415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/257424235 >> v2:172.21.15.133:3300/0 conn(0x7f62c4159c60 0x7f62c415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 -- 172.21.15.46:0/257424235 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c415e140 con 0x7f62c4159890 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159890 0x7f62c415abd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f62c40b67f0 tx=0x7f62bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf7a529391b70de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c8bda700 1 -- 172.21.15.46:0/257424235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00b640 con 0x7f62c4159890 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c8bda700 1 -- 172.21.15.46:0/257424235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00b7a0 con 0x7f62c4159890 2023-10-07T09:04:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62c8bda700 1 -- 172.21.15.46:0/257424235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00bb60 con 0x7f62c4159890 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 -- 172.21.15.46:0/257424235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159890 msgr2=0x7f62c415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159890 0x7f62c415abd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f62c40b67f0 tx=0x7f62bc009250 comp rx=0 tx=0).stop 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 -- 172.21.15.46:0/257424235 shutdown_connections 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c415db10 0x7f62c4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 --2- 172.21.15.46:0/257424235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159890 0x7f62c415abd0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 --2- 172.21.15.46:0/257424235 >> v2:172.21.15.133:3300/0 conn(0x7f62c4159c60 0x7f62c415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.664+0000 7f62cbe40700 1 -- 172.21.15.46:0/257424235 >> 172.21.15.46:0/257424235 conn(0x7f62c4068e20 msgr2=0x7f62c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.665+0000 7f62cbe40700 1 -- 172.21.15.46:0/257424235 shutdown_connections 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.665+0000 7f62cbe40700 1 -- 172.21.15.46:0/257424235 wait complete. 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 Processor -- start 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 -- start start 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c4159890 0x7f62c40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 0x7f62c40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4151c80 con 0x7f62c4159c60 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4151390 con 0x7f62c415db10 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.666+0000 7f62cbe40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4151630 con 0x7f62c4159890 2023-10-07T09:04:44.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39484/0 (socket says 172.21.15.46:39484) 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 -- 172.21.15.46:0/488632107 learned_addr learned my addr 172.21.15.46:0/488632107 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c4159890 0x7f62c40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62ca3dd700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 0x7f62c40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 -- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c4159890 msgr2=0x7f62c40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c4159890 0x7f62c40b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 -- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 msgr2=0x7f62c40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 0x7f62c40b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 -- 172.21.15.46:0/488632107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0094f0 con 0x7f62c4159c60 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62ca3dd700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 0x7f62c40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c93db700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ec80 tx=0x7f62b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800c850 con 0x7f62c4159c60 2023-10-07T09:04:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b800c9b0 con 0x7f62c4159c60 2023-10-07T09:04:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4151910 con 0x7f62c4159c60 2023-10-07T09:04:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800cd70 con 0x7f62c4159c60 2023-10-07T09:04:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.667+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4152110 con 0x7f62c4159c60 2023-10-07T09:04:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.668+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404c3c0 con 0x7f62c4159c60 2023-10-07T09:04:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.669+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f62b8013680 con 0x7f62c4159c60 2023-10-07T09:04:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.669+0000 7f62c1ffb700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 0x7f62b0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.669+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f62b8084c50 con 0x7f62c4159c60 2023-10-07T09:04:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.670+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 0x7f62b0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.670+0000 7f62c9bdc700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 0x7f62b0069740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f62c40b67f0 tx=0x7f62bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.674+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62b8051ad0 con 0x7f62c4159c60 2023-10-07T09:04:44.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:44.913+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f62c406a5b0 con 0x7f62c4159c60 2023-10-07T09:04:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.505+0000 7f62c1ffb700 1 -- 172.21.15.46:0/488632107 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f62b80550f0 con 0x7f62c4159c60 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.509+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 msgr2=0x7f62b0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.509+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 0x7f62b0069740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f62c40b67f0 tx=0x7f62bc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 msgr2=0x7f62c40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ec80 tx=0x7f62b80091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 shutdown_connections 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62b0067290 0x7f62b0069740 secure :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f62c40b67f0 tx=0x7f62bc017000 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c415db10 0x7f62c40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c4159890 0x7f62c40b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 --2- 172.21.15.46:0/488632107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c4159c60 0x7f62c40b3590 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.510+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 >> 172.21.15.46:0/488632107 conn(0x7f62c4068e20 msgr2=0x7f62c41533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.512+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 shutdown_connections 2023-10-07T09:04:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.512+0000 7f62cbe40700 1 -- 172.21.15.46:0/488632107 wait complete. 2023-10-07T09:04:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 16 and data pool 17 2023-10-07T09:04:45.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.651+0000 7f6a54b41700 1 Processor -- start 2023-10-07T09:04:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.651+0000 7f6a54b41700 1 -- start start 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a54b41700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6a501597f0 0x7f6a500b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a54b41700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500b11d0 con 0x7f6a50159420 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a54b41700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500b14b0 con 0x7f6a5015d230 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a54b41700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500b1790 con 0x7f6a501597f0 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6a501597f0 0x7f6a500b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6a50159420 0x7f6a500b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46294/0 (socket says 172.21.15.46:46294) 2023-10-07T09:04:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4f7fe700 1 -- 172.21.15.46:0/2245881894 learned_addr learned my addr 172.21.15.46:0/2245881894 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4effd700 1 -- 172.21.15.46:0/2245881894 >> v1:172.21.15.133:6789/0 conn(0x7f6a5015d230 legacy=0x7f6a5015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4effd700 1 -- 172.21.15.46:0/2245881894 >> v1:172.21.15.46:6789/0 conn(0x7f6a50159420 legacy=0x7f6a500b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4effd700 1 -- 172.21.15.46:0/2245881894 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500b1a70 con 0x7f6a501597f0 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.652+0000 7f6a4e7fc700 1 -- 172.21.15.46:0/2245881894 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032079314 0 0) 0x7f6a500b11d0 con 0x7f6a50159420 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a4effd700 1 --2- 172.21.15.46:0/2245881894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a500b2270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098e0 tx=0x7f6a440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210da556898db3b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a4e7fc700 1 -- 172.21.15.46:0/2245881894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44009e80 con 0x7f6a501597f0 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a4e7fc700 1 -- 172.21.15.46:0/2245881894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400b860 con 0x7f6a501597f0 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a4e7fc700 1 -- 172.21.15.46:0/2245881894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400bbe0 con 0x7f6a501597f0 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 -- 172.21.15.46:0/2245881894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 msgr2=0x7f6a500b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 --2- 172.21.15.46:0/2245881894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a500b2270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098e0 tx=0x7f6a440091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 -- 172.21.15.46:0/2245881894 shutdown_connections 2023-10-07T09:04:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 --2- 172.21.15.46:0/2245881894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a500b2270 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 -- 172.21.15.46:0/2245881894 >> 172.21.15.46:0/2245881894 conn(0x7f6a500d0660 msgr2=0x7f6a500d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:45.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 -- 172.21.15.46:0/2245881894 shutdown_connections 2023-10-07T09:04:45.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.653+0000 7f6a54b41700 1 -- 172.21.15.46:0/2245881894 wait complete. 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.654+0000 7f6a54b41700 1 Processor -- start 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 -- start start 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50159420 0x7f6a50153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a5015d230 0x7f6a50069220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c6120 con 0x7f6a501597f0 2023-10-07T09:04:45.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c5510 con 0x7f6a50159420 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a54b41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c57f0 con 0x7f6a5015d230 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39508/0 (socket says 172.21.15.46:39508) 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.655+0000 7f6a4effd700 1 -- 172.21.15.46:0/772988154 learned_addr learned my addr 172.21.15.46:0/772988154 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4ffff700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a5015d230 0x7f6a50069220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4f7fe700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50159420 0x7f6a50153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 -- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a5015d230 msgr2=0x7f6a50069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a5015d230 0x7f6a50069220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 -- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50159420 msgr2=0x7f6a50153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50159420 0x7f6a50153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 -- 172.21.15.46:0/772988154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44009420 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a4effd700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6a44013000 tx=0x7f6a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4401f070 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44000c90 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44025420 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500c5ad0 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.656+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a50169650 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.657+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a500c6290 con 0x7f6a501597f0 2023-10-07T09:04:45.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.657+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6a44023070 con 0x7f6a501597f0 2023-10-07T09:04:45.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.658+0000 7f6a377fe700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 0x7f6a3c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.658+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a44085f00 con 0x7f6a501597f0 2023-10-07T09:04:45.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.658+0000 7f6a4f7fe700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 0x7f6a3c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:45.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.659+0000 7f6a4f7fe700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 0x7f6a3c069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a40007fd0 tx=0x7f6a40007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:45.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.662+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a44052de0 con 0x7f6a501597f0 2023-10-07T09:04:45.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.858+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5004c3c0 con 0x7f6a501597f0 2023-10-07T09:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.859+0000 7f6a377fe700 1 -- 172.21.15.46:0/772988154 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f6a44056380 con 0x7f6a501597f0 2023-10-07T09:04:45.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:45.861 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":101,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:44.915125+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:45.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 msgr2=0x7f6a3c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 0x7f6a3c069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a40007fd0 tx=0x7f6a40007d10 comp rx=0 tx=0).stop 2023-10-07T09:04:45.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 msgr2=0x7f6a50068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:45.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6a44013000 tx=0x7f6a44017000 comp rx=0 tx=0).stop 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 shutdown_connections 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a3c067290 0x7f6a3c069740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a5015d230 0x7f6a50069220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50159420 0x7f6a50153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 --2- 172.21.15.46:0/772988154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a501597f0 0x7f6a50068ce0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 >> 172.21.15.46:0/772988154 conn(0x7f6a500d0660 msgr2=0x7f6a500b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 shutdown_connections 2023-10-07T09:04:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.861+0000 7f6a54b41700 1 -- 172.21.15.46:0/772988154 wait complete. 2023-10-07T09:04:45.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.995+0000 7f55518bd700 1 Processor -- start 2023-10-07T09:04:45.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.995+0000 7f55518bd700 1 -- start start 2023-10-07T09:04:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f55518bd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c06a250 0x7f554c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f55518bd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0c7fc0 con 0x7f554c157120 2023-10-07T09:04:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f55518bd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c06e070 con 0x7f554c0c9db0 2023-10-07T09:04:45.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f55518bd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c06dd20 con 0x7f554c06a250 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c06a250 0x7f554c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c06a250 0x7f554c0c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39524/0 (socket says 172.21.15.46:39524) 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f554c157120 0x7f554c06e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46306/0 (socket says 172.21.15.46:46306) 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 -- 172.21.15.46:0/4127564262 learned_addr learned my addr 172.21.15.46:0/4127564262 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 -- 172.21.15.46:0/4127564262 >> v1:172.21.15.133:6789/0 conn(0x7f554c0c9db0 legacy=0x7f554c14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 -- 172.21.15.46:0/4127564262 >> v1:172.21.15.46:6789/0 conn(0x7f554c157120 legacy=0x7f554c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f5549ffb700 1 -- 172.21.15.46:0/4127564262 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879299888 0 0) 0x7f5544001490 con 0x7f554c157120 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 -- 172.21.15.46:0/4127564262 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0c7720 con 0x7f554c06a250 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f554affd700 1 --2- 172.21.15.46:0/4127564262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c0c6e90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f553c00ab50 tx=0x7f553c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31f233ef60cd642 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f5549ffb700 1 -- 172.21.15.46:0/4127564262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00ca20 con 0x7f554c06a250 2023-10-07T09:04:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.996+0000 7f5549ffb700 1 -- 172.21.15.46:0/4127564262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c00cb80 con 0x7f554c06a250 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f5549ffb700 1 -- 172.21.15.46:0/4127564262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0183f0 con 0x7f554c06a250 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 -- 172.21.15.46:0/4127564262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 msgr2=0x7f554c0c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 --2- 172.21.15.46:0/4127564262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c0c6e90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f553c00ab50 tx=0x7f553c00a3f0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 -- 172.21.15.46:0/4127564262 shutdown_connections 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 --2- 172.21.15.46:0/4127564262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c0c6e90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 -- 172.21.15.46:0/4127564262 >> 172.21.15.46:0/4127564262 conn(0x7f554c0cc1e0 msgr2=0x7f554c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 -- 172.21.15.46:0/4127564262 shutdown_connections 2023-10-07T09:04:46.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.997+0000 7f55518bd700 1 -- 172.21.15.46:0/4127564262 wait complete. 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.998+0000 7f55518bd700 1 Processor -- start 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.998+0000 7f55518bd700 1 -- start start 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 0x7f554c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 0x7f554c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c3a50 con 0x7f554c06a250 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c140420 con 0x7f554c0c9db0 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f55518bd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c154af0 con 0x7f554c157120 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39536/0 (socket says 172.21.15.46:39536) 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 -- 172.21.15.46:0/3980800750 learned_addr learned my addr 172.21.15.46:0/3980800750 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554b7fe700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 0x7f554c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554a7fc700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 0x7f554c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 -- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 msgr2=0x7f554c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 0x7f554c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 -- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 msgr2=0x7f554c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 0x7f554c0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554affd700 1 -- 172.21.15.46:0/3980800750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c00a690 con 0x7f554c06a250 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554b7fe700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 0x7f554c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:45.999+0000 7f554a7fc700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 0x7f554c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f554affd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a430 tx=0x7f553c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c010750 con 0x7f554c06a250 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0108d0 con 0x7f554c06a250 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c154d90 con 0x7f554c06a250 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c010c90 con 0x7f554c06a250 2023-10-07T09:04:46.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.000+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c155350 con 0x7f554c06a250 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.001+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c04c3c0 con 0x7f554c06a250 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.001+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f553c02a450 con 0x7f554c06a250 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.002+0000 7f5532ffd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 0x7f5538069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.002+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f553c086350 con 0x7f554c06a250 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.002+0000 7f554a7fc700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 0x7f5538069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.002+0000 7f554a7fc700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 0x7f5538069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5540006fd0 tx=0x7f5540008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.006+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f553c0531b0 con 0x7f554c06a250 2023-10-07T09:04:46.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.197+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f554c06b200 con 0x7f554c06a250 2023-10-07T09:04:46.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.198+0000 7f5532ffd700 1 -- 172.21.15.46:0/3980800750 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f553c0567d0 con 0x7f554c06a250 2023-10-07T09:04:46.199 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:46.199 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:45.919277+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 msgr2=0x7f5538069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 0x7f5538069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5540006fd0 tx=0x7f5540008040 comp rx=0 tx=0).stop 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 msgr2=0x7f554c13fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a430 tx=0x7f553c019000 comp rx=0 tx=0).stop 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 shutdown_connections 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5538067290 0x7f5538069740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f554c157120 0x7f554c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c06a250 0x7f554c13fee0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 --2- 172.21.15.46:0/3980800750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f554c0c9db0 0x7f554c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 >> 172.21.15.46:0/3980800750 conn(0x7f554c0cc1e0 msgr2=0x7f554c0cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 shutdown_connections 2023-10-07T09:04:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.200+0000 7f55518bd700 1 -- 172.21.15.46:0/3980800750 wait complete. 2023-10-07T09:04:46.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:04:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.334+0000 7fd13da0c700 1 Processor -- start 2023-10-07T09:04:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.334+0000 7fd13da0c700 1 -- start start 2023-10-07T09:04:46.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd13da0c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd13806bcd0 0x7fd138140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd13da0c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd13806c0a0 0x7fd138141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd13da0c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13815c2a0 con 0x7fd1380c8e00 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd13da0c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13815b690 con 0x7fd13806c0a0 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd13da0c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13815b970 con 0x7fd13806bcd0 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd1367fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd13806c0a0 0x7fd138141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd1367fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd13806c0a0 0x7fd138141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39544/0 (socket says 172.21.15.46:39544) 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd1367fc700 1 -- 172.21.15.46:0/3558807512 learned_addr learned my addr 172.21.15.46:0/3558807512 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.335+0000 7fd136ffd700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd13806bcd0 0x7fd138140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd1367fc700 1 -- 172.21.15.46:0/3558807512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd13806bcd0 msgr2=0x7fd138140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd1367fc700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd13806bcd0 0x7fd138140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd1367fc700 1 -- 172.21.15.46:0/3558807512 >> v1:172.21.15.133:6789/0 conn(0x7fd1380c8e00 legacy=0x7fd1380c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd1367fc700 1 -- 172.21.15.46:0/3558807512 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13815bc50 con 0x7fd13806c0a0 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd1367fc700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd138141330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd1200099b0 tx=0x7fd120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4c72b5c3042d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd135ffb700 1 -- 172.21.15.46:0/3558807512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120009ea0 con 0x7fd13806c0a0 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd135ffb700 1 -- 172.21.15.46:0/3558807512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000b860 con 0x7fd13806c0a0 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd135ffb700 1 -- 172.21.15.46:0/3558807512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000bc00 con 0x7fd13806c0a0 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 -- 172.21.15.46:0/3558807512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 msgr2=0x7fd138141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd138141330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd1200099b0 tx=0x7fd120009250 comp rx=0 tx=0).stop 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 -- 172.21.15.46:0/3558807512 shutdown_connections 2023-10-07T09:04:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd13806bcd0 0x7fd138140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3558807512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd138141330 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.336+0000 7fd13da0c700 1 -- 172.21.15.46:0/3558807512 >> 172.21.15.46:0/3558807512 conn(0x7fd1380ce600 msgr2=0x7fd1380cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.337+0000 7fd13da0c700 1 -- 172.21.15.46:0/3558807512 shutdown_connections 2023-10-07T09:04:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.337+0000 7fd13da0c700 1 -- 172.21.15.46:0/3558807512 wait complete. 2023-10-07T09:04:46.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 Processor -- start 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 -- start start 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 0x7fd13813f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1380c8e00 0x7fd1380c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138168040 con 0x7fd13806c0a0 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c7cb0 con 0x7fd13806bcd0 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.338+0000 7fd13da0c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c7f90 con 0x7fd1380c8e00 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39550/0 (socket says 172.21.15.46:39550) 2023-10-07T09:04:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 -- 172.21.15.46:0/3677443971 learned_addr learned my addr 172.21.15.46:0/3677443971 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd136ffd700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 0x7fd13813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1377fe700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1380c8e00 0x7fd1380c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 -- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1380c8e00 msgr2=0x7fd1380c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1380c8e00 0x7fd1380c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 -- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 msgr2=0x7fd13813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 0x7fd13813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 -- 172.21.15.46:0/3677443971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200094f0 con 0x7fd13806c0a0 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd136ffd700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 0x7fd13813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd1367fc700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd1380ce1c0 tx=0x7fd120017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000bbe0 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120011420 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380c8270 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200117c0 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.339+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380a60a0 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.340+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1381681f0 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.341+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fd120011bf0 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.341+0000 7fd12effd700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 0x7fd118069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.341+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd120086400 con 0x7fd13806c0a0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.341+0000 7fd136ffd700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 0x7fd118069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:46.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.342+0000 7fd136ffd700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 0x7fd118069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd130007620 tx=0x7fd13000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:46.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.345+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1381681f0 con 0x7fd13806c0a0 2023-10-07T09:04:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:46.588+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd13804c3c0 con 0x7fd13806c0a0 2023-10-07T09:04:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.517+0000 7fd12effd700 1 -- 172.21.15.46:0/3677443971 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd120053260 con 0x7fd13806c0a0 2023-10-07T09:04:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 msgr2=0x7fd118069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 0x7fd118069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd130007620 tx=0x7fd13000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 msgr2=0x7fd1380c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd1380ce1c0 tx=0x7fd120017000 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 shutdown_connections 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd118067290 0x7fd118069740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1380c8e00 0x7fd1380c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13806bcd0 0x7fd13813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 --2- 172.21.15.46:0/3677443971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd13806c0a0 0x7fd1380c71c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.519+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 >> 172.21.15.46:0/3677443971 conn(0x7fd1380ce600 msgr2=0x7fd1380b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.520+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 shutdown_connections 2023-10-07T09:04:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.520+0000 7fd13da0c700 1 -- 172.21.15.46:0/3677443971 wait complete. 2023-10-07T09:04:47.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:04:47.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.662+0000 7f1adda4d700 1 Processor -- start 2023-10-07T09:04:47.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.662+0000 7f1adda4d700 1 -- start start 2023-10-07T09:04:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adda4d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 0x7f1ad80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adda4d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ad80b33b0 0x7f1ad80b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adda4d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80b2080 con 0x7f1ad80b4e70 2023-10-07T09:04:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adda4d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80cfb00 con 0x7f1ad80b33b0 2023-10-07T09:04:47.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adda4d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80b5c40 con 0x7f1ad80b16d0 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1add24c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ad80b33b0 0x7f1ad80b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adca4b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1ad80b4e70 0x7f1ad80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46314/0 (socket says 172.21.15.46:46314) 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1adca4b700 1 -- 172.21.15.46:0/4253402775 learned_addr learned my addr 172.21.15.46:0/4253402775 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/4253402775 >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 0x7f1ad80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1add24c700 1 -- 172.21.15.46:0/4253402775 >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 msgr2=0x7f1ad80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1add24c700 1 --2- 172.21.15.46:0/4253402775 >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 0x7f1ad80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1add24c700 1 -- 172.21.15.46:0/4253402775 >> v1:172.21.15.46:6789/0 conn(0x7f1ad80b4e70 legacy=0x7f1ad80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1add24c700 1 -- 172.21.15.46:0/4253402775 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80b5f20 con 0x7f1ad80b33b0 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1ad77fe700 1 -- 172.21.15.46:0/4253402775 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714455172 0 0) 0x7f1ad80b2080 con 0x7f1ad80b4e70 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.663+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/4253402775 >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 0x7f1ad80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1add24c700 1 --2- 172.21.15.46:0/4253402775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b33b0 0x7f1ad80b37d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8089830 tx=0x7f1ad0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13809439ef04dc6c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1ad77fe700 1 -- 172.21.15.46:0/4253402775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000e070 con 0x7f1ad80b33b0 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1ad77fe700 1 -- 172.21.15.46:0/4253402775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000bc30 con 0x7f1ad80b33b0 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1ad77fe700 1 -- 172.21.15.46:0/4253402775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0012430 con 0x7f1ad80b33b0 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 -- 172.21.15.46:0/4253402775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b33b0 msgr2=0x7f1ad80b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 --2- 172.21.15.46:0/4253402775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b33b0 0x7f1ad80b37d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8089830 tx=0x7f1ad0009780 comp rx=0 tx=0).stop 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 -- 172.21.15.46:0/4253402775 shutdown_connections 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 --2- 172.21.15.46:0/4253402775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b33b0 0x7f1ad80b37d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 --2- 172.21.15.46:0/4253402775 >> v2:172.21.15.133:3300/0 conn(0x7f1ad80b16d0 0x7f1ad80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 -- 172.21.15.46:0/4253402775 >> 172.21.15.46:0/4253402775 conn(0x7f1ad80d10c0 msgr2=0x7f1ad80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 -- 172.21.15.46:0/4253402775 shutdown_connections 2023-10-07T09:04:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.664+0000 7f1adda4d700 1 -- 172.21.15.46:0/4253402775 wait complete. 2023-10-07T09:04:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.665+0000 7f1adda4d700 1 Processor -- start 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.665+0000 7f1adda4d700 1 -- start start 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 0x7f1ad8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad80b4e70 0x7f1ad8169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c7e50 con 0x7f1ad80b16d0 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c8130 con 0x7f1ad80b33b0 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adda4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad816a010 con 0x7f1ad80b4e70 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adca4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adca4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39572/0 (socket says 172.21.15.46:39572) 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1adca4b700 1 -- 172.21.15.46:0/443889456 learned_addr learned my addr 172.21.15.46:0/443889456 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1add24c700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad80b4e70 0x7f1ad8169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.666+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 0x7f1ad8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 -- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad80b4e70 msgr2=0x7f1ad8169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad80b4e70 0x7f1ad8169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 -- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 msgr2=0x7f1ad8157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 0x7f1ad8157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 -- 172.21.15.46:0/443889456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009a20 con 0x7f1ad80b16d0 2023-10-07T09:04:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 0x7f1ad8157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adca4b700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c7e0 tx=0x7f1acc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc005b30 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc005c90 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad816a2f0 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc007300 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.667+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad8169cd0 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.668+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad8088990 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.668+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1acc01b400 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.669+0000 7f1ad4ff9700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 0x7f1abc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.669+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1acc084680 con 0x7f1ad80b16d0 2023-10-07T09:04:47.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.669+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 0x7f1abc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:47.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.669+0000 7f1ad7fff700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 0x7f1abc069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8158b30 tx=0x7f1ac4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:47.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.673+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1acc051460 con 0x7f1ad80b16d0 2023-10-07T09:04:47.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:47.909+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ad804bb80 con 0x7f1ad80b16d0 2023-10-07T09:04:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.522+0000 7f1ad4ff9700 1 -- 172.21.15.46:0/443889456 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1acc054a80 con 0x7f1ad80b16d0 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 msgr2=0x7f1abc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 0x7f1abc069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8158b30 tx=0x7f1ac4008040 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 msgr2=0x7f1ad80cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c7e0 tx=0x7f1acc007df0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 shutdown_connections 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1abc067290 0x7f1abc069740 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad80b4e70 0x7f1ad8169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad80b16d0 0x7f1ad80cbe60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 --2- 172.21.15.46:0/443889456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad80b33b0 0x7f1ad8157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 >> 172.21.15.46:0/443889456 conn(0x7f1ad80d10c0 msgr2=0x7f1ad80699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:48.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 shutdown_connections 2023-10-07T09:04:48.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.525+0000 7f1adda4d700 1 -- 172.21.15.46:0/443889456 wait complete. 2023-10-07T09:04:48.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.666+0000 7fedf2ada700 1 Processor -- start 2023-10-07T09:04:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.666+0000 7fedf2ada700 1 -- start start 2023-10-07T09:04:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf2ada700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedec1593b0 0x7fedec159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf2ada700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec0b1e50 0x7fedec0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf2ada700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec0b6570 con 0x7fedec0ceaa0 2023-10-07T09:04:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf2ada700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec0cfe20 con 0x7fedec1593b0 2023-10-07T09:04:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf2ada700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0cf210 con 0x7fedec0b1e50 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf12d7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fedec0ceaa0 0x7fedec0b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46322/0 (socket says 172.21.15.46:46322) 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf12d7700 1 -- 172.21.15.46:0/2228946775 learned_addr learned my addr 172.21.15.46:0/2228946775 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf22d9700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec0b1e50 0x7fedec0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> v2:172.21.15.133:3300/0 conn(0x7fedec1593b0 0x7fedec159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055374303 0 0) 0x7fede0001110 con 0x7fedec0ceaa0 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd4003570 con 0x7fedec0ceaa0 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006325677 0 0) 0x7fedd4003570 con 0x7fedec0ceaa0 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec0b1e50 msgr2=0x7fedec0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec0b1e50 0x7fedec0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 >> v2:172.21.15.133:3300/0 conn(0x7fedec1593b0 msgr2=0x7fedec159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.667+0000 7fedf0ad6700 1 --2- 172.21.15.46:0/2228946775 >> v2:172.21.15.133:3300/0 conn(0x7fedec1593b0 0x7fedec159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0cf4f0 con 0x7fedec0ceaa0 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fede0001600 con 0x7fedec0ceaa0 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 >> v1:172.21.15.46:6789/0 conn(0x7fedec0ceaa0 legacy=0x7fedec0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd4004810 0x7fedd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd40051c0 0x7fedd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0cfe20 con 0x7fedd4003a60 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0cf210 con 0x7fedd40051c0 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd400bfa0 con 0x7fedd4004810 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf22d9700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec0b1e50 0x7fedec0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> v2:172.21.15.133:3300/0 conn(0x7fedec1593b0 0x7fedec159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf12d7700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd4004810 0x7fedd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf22d9700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd40051c0 0x7fedd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 -- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd4004810 msgr2=0x7fedd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd4004810 0x7fedd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 -- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd40051c0 msgr2=0x7fedd400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd40051c0 0x7fedd400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 -- 172.21.15.46:0/2228946775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4003570 con 0x7fedd4003a60 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.668+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedd4003e70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fede4009de0 tx=0x7fede40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f147aee36facfc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede400e8c0 con 0x7fedd4003a60 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede400ea20 con 0x7fedd4003a60 2023-10-07T09:04:48.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf0ad6700 1 -- 172.21.15.46:0/2228946775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede400edc0 con 0x7fedd4003a60 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 -- 172.21.15.46:0/2228946775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 msgr2=0x7fedd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 --2- 172.21.15.46:0/2228946775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedd4003e70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fede4009de0 tx=0x7fede40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf22d9700 1 -- 172.21.15.46:0/2228946775 reap_dead start 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 -- 172.21.15.46:0/2228946775 shutdown_connections 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 -- 172.21.15.46:0/2228946775 >> 172.21.15.46:0/2228946775 conn(0x7fedec0d1130 msgr2=0x7fedec0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 -- 172.21.15.46:0/2228946775 shutdown_connections 2023-10-07T09:04:48.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.669+0000 7fedf2ada700 1 -- 172.21.15.46:0/2228946775 wait complete. 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.670+0000 7fedf2ada700 1 Processor -- start 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.670+0000 7fedf2ada700 1 -- start start 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec15aa20 0x7fedec15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec16c220 0x7fedec16c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15c210 con 0x7fedd4003a60 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec16cbb0 con 0x7fedec16c220 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf2ada700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec155800 con 0x7fedec15aa20 2023-10-07T09:04:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39596/0 (socket says 172.21.15.46:39596) 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 -- 172.21.15.46:0/3796314483 learned_addr learned my addr 172.21.15.46:0/3796314483 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf12d7700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec15aa20 0x7fedec15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf22d9700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec16c220 0x7fedec16c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 -- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec15aa20 msgr2=0x7fedec15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec15aa20 0x7fedec15ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 -- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec16c220 msgr2=0x7fedec16c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec16c220 0x7fedec16c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.671+0000 7fedf1ad8700 1 -- 172.21.15.46:0/3796314483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec15b590 con 0x7fedd4003a60 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fedf1ad8700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fede4009c80 tx=0x7fede4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4013e10 con 0x7fedd4003a60 2023-10-07T09:04:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4026440 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec15b870 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4026800 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.672+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec15be30 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.673+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0b2280 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.674+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fede401b3f0 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.674+0000 7fede9ffb700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 0x7fedd8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.674+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fede40864d0 con 0x7fedd4003a60 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.674+0000 7fedf12d7700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 0x7fedd8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.675+0000 7fedf12d7700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 0x7fedd8069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fede0007fd0 tx=0x7fedec0cfd90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.678+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fede4053330 con 0x7fedd4003a60 2023-10-07T09:04:48.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.916+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedec04c3c0 con 0x7fedd4003a60 2023-10-07T09:04:48.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.916+0000 7fede9ffb700 1 -- 172.21.15.46:0/3796314483 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fede4056950 con 0x7fedd4003a60 2023-10-07T09:04:48.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:48.918 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 msgr2=0x7fedd8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 0x7fedd8069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fede0007fd0 tx=0x7fedec0cfd90 comp rx=0 tx=0).stop 2023-10-07T09:04:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 msgr2=0x7fedec15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fede4009c80 tx=0x7fede4019000 comp rx=0 tx=0).stop 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 shutdown_connections 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fedd8067290 0x7fedd8069740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec16c220 0x7fedec16c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedd4003a60 0x7fedec15e5d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 --2- 172.21.15.46:0/3796314483 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedec15aa20 0x7fedec15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 >> 172.21.15.46:0/3796314483 conn(0x7fedec0d1130 msgr2=0x7fedec0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 shutdown_connections 2023-10-07T09:04:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:48.919+0000 7fedf2ada700 1 -- 172.21.15.46:0/3796314483 wait complete. 2023-10-07T09:04:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 65 2023-10-07T09:04:48.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.050+0000 7f05281ac700 1 Processor -- start 2023-10-07T09:04:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.050+0000 7f05281ac700 1 -- start start 2023-10-07T09:04:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f05281ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05200699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f05281ac700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0520069ee0 con 0x7f0520159890 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f05281ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052015a160 con 0x7f0520159c60 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f05281ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200d13a0 con 0x7f0520069560 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0525f48700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0520159890 0x7f052015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46338/0 (socket says 172.21.15.46:46338) 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0525f48700 1 -- 172.21.15.46:0/3059019924 learned_addr learned my addr 172.21.15.46:0/3059019924 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0526749700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05200699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843083245 0 0) 0x7f0520069ee0 con 0x7f0520159890 2023-10-07T09:04:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0508003570 con 0x7f0520159890 2023-10-07T09:04:49.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110750519 0 0) 0x7f0508003570 con 0x7f0520159890 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 msgr2=0x7f05200699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05200699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 >> v1:172.21.15.133:6789/0 conn(0x7f0520159c60 legacy=0x7f052015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052015e140 con 0x7f0520159890 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f0518001470 con 0x7f0520159890 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 >> v1:172.21.15.46:6789/0 conn(0x7f0520159890 legacy=0x7f052015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508003a90 0x7f0508003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0508004810 0x7f0508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05080051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200d13a0 con 0x7f0508004810 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050800bb90 con 0x7f0508003a90 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050800bd50 con 0x7f0520069560 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.051+0000 7f0525747700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0508004810 0x7f0508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525f48700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508003a90 0x7f0508003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0526749700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05080051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 -- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 msgr2=0x7f05080051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520069560 0x7f05080051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 -- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508003a90 msgr2=0x7f0508003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:49.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508003a90 0x7f0508003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 -- 172.21.15.46:0/3059019924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508003570 con 0x7f0508004810 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0525747700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0508004810 0x7f0508004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0514001870 tx=0x7f0514007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae49c80422e6faa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514012400 con 0x7f0508004810 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514012580 con 0x7f0508004810 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.052+0000 7f0524f46700 1 -- 172.21.15.46:0/3059019924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514012940 con 0x7f0508004810 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 -- 172.21.15.46:0/3059019924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0508004810 msgr2=0x7f0508004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 --2- 172.21.15.46:0/3059019924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0508004810 0x7f0508004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0514001870 tx=0x7f0514007d10 comp rx=0 tx=0).stop 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f0526749700 1 -- 172.21.15.46:0/3059019924 reap_dead start 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 -- 172.21.15.46:0/3059019924 shutdown_connections 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 -- 172.21.15.46:0/3059019924 >> 172.21.15.46:0/3059019924 conn(0x7f0520068e20 msgr2=0x7f05200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 -- 172.21.15.46:0/3059019924 shutdown_connections 2023-10-07T09:04:49.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.053+0000 7f05281ac700 1 -- 172.21.15.46:0/3059019924 wait complete. 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 Processor -- start 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 -- start start 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 0x7f05200cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 0x7f052016dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052016e1c0 con 0x7f05200b5f80 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200b5af0 con 0x7f0508004810 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.054+0000 7f05281ac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520140f70 con 0x7f0520140b00 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39608/0 (socket says 172.21.15.46:39608) 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 -- 172.21.15.46:0/2165157632 learned_addr learned my addr 172.21.15.46:0/2165157632 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:49.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0525747700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 0x7f052016dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0525f48700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 0x7f05200cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 -- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 msgr2=0x7f052016dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 0x7f052016dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 -- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 msgr2=0x7f05200cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 0x7f05200cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 -- 172.21.15.46:0/2165157632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200b51c0 con 0x7f05200b5f80 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0525747700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 0x7f052016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0525f48700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 0x7f05200cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f0526749700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f05100094d0 tx=0x7f051000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000e040 con 0x7f05200b5f80 2023-10-07T09:04:49.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000f040 con 0x7f05200b5f80 2023-10-07T09:04:49.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05200b54a0 con 0x7f05200b5f80 2023-10-07T09:04:49.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000fdf0 con 0x7f05200b5f80 2023-10-07T09:04:49.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.055+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05200b63f0 con 0x7f05200b5f80 2023-10-07T09:04:49.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.056+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052004c3c0 con 0x7f05200b5f80 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.057+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0510015640 con 0x7f05200b5f80 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.057+0000 7f051dffb700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 0x7f050c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.057+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0510085470 con 0x7f05200b5f80 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.057+0000 7f0525f48700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 0x7f050c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.058+0000 7f0525f48700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 0x7f050c069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0518001ce0 tx=0x7f0518009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.061+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05100521c0 con 0x7f05200b5f80 2023-10-07T09:04:49.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.256+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05200b5c30 con 0x7f05200b5f80 2023-10-07T09:04:49.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.257+0000 7f051dffb700 1 -- 172.21.15.46:0/2165157632 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f05100557e0 con 0x7f05200b5f80 2023-10-07T09:04:49.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:49.259 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:45.919277+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:49.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.259+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 msgr2=0x7f050c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.259+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 0x7f050c069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0518001ce0 tx=0x7f0518009040 comp rx=0 tx=0).stop 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.259+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 msgr2=0x7f05201579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.259+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f05100094d0 tx=0x7f051000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 shutdown_connections 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f050c067290 0x7f050c069740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05200b5f80 0x7f05201579b0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0508004810 0x7f05200cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 --2- 172.21.15.46:0/2165157632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0520140b00 0x7f052016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 >> 172.21.15.46:0/2165157632 conn(0x7f0520068e20 msgr2=0x7f0520158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 shutdown_connections 2023-10-07T09:04:49.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.260+0000 7f05281ac700 1 -- 172.21.15.46:0/2165157632 wait complete. 2023-10-07T09:04:49.274 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:04:49.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:04:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.390+0000 7f03a3ca2700 1 Processor -- start 2023-10-07T09:04:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 -- start start 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f039c159890 0x7f039c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f039c069560 0x7f039c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c069ee0 con 0x7f039c159c60 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c15a160 con 0x7f039c069560 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.391+0000 7f03a3ca2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0d13a0 con 0x7f039c159890 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a123d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f039c159c60 0x7f039c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46344/0 (socket says 172.21.15.46:46344) 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a123d700 1 -- 172.21.15.46:0/3269978005 learned_addr learned my addr 172.21.15.46:0/3269978005 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 --2- 172.21.15.46:0/3269978005 >> v2:172.21.15.46:3300/0 conn(0x7f039c069560 0x7f039c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a1a3e700 1 --2- 172.21.15.46:0/3269978005 >> v2:172.21.15.133:3300/0 conn(0x7f039c159890 0x7f039c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a0a3c700 1 -- 172.21.15.46:0/3269978005 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396974158 0 0) 0x7f039c069ee0 con 0x7f039c159c60 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a0a3c700 1 -- 172.21.15.46:0/3269978005 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0384003570 con 0x7f039c159c60 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 -- 172.21.15.46:0/3269978005 >> v2:172.21.15.133:3300/0 conn(0x7f039c159890 msgr2=0x7f039c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 --2- 172.21.15.46:0/3269978005 >> v2:172.21.15.133:3300/0 conn(0x7f039c159890 0x7f039c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 -- 172.21.15.46:0/3269978005 >> v1:172.21.15.46:6789/0 conn(0x7f039c159c60 legacy=0x7f039c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 -- 172.21.15.46:0/3269978005 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c15e140 con 0x7f039c069560 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a223f700 1 --2- 172.21.15.46:0/3269978005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c069560 0x7f039c0699a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f039c0d1090 tx=0x7f038c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cb9e42feda6d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a0a3c700 1 -- 172.21.15.46:0/3269978005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00e070 con 0x7f039c069560 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a0a3c700 1 -- 172.21.15.46:0/3269978005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00bab0 con 0x7f039c069560 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.392+0000 7f03a0a3c700 1 -- 172.21.15.46:0/3269978005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00be70 con 0x7f039c069560 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 -- 172.21.15.46:0/3269978005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c069560 msgr2=0x7f039c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/3269978005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c069560 0x7f039c0699a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f039c0d1090 tx=0x7f038c009780 comp rx=0 tx=0).stop 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 -- 172.21.15.46:0/3269978005 shutdown_connections 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/3269978005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c069560 0x7f039c0699a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/3269978005 >> v2:172.21.15.133:3300/0 conn(0x7f039c159890 0x7f039c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 -- 172.21.15.46:0/3269978005 >> 172.21.15.46:0/3269978005 conn(0x7f039c068e20 msgr2=0x7f039c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 -- 172.21.15.46:0/3269978005 shutdown_connections 2023-10-07T09:04:49.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.393+0000 7f03a3ca2700 1 -- 172.21.15.46:0/3269978005 wait complete. 2023-10-07T09:04:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.394+0000 7f03a3ca2700 1 Processor -- start 2023-10-07T09:04:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.394+0000 7f03a3ca2700 1 -- start start 2023-10-07T09:04:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039c069560 0x7f039c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039c159890 0x7f039c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0ce4b0 con 0x7f039c159c60 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0cdb60 con 0x7f039c069560 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a3ca2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0cde40 con 0x7f039c159890 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39628/0 (socket says 172.21.15.46:39628) 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 -- 172.21.15.46:0/1561303142 learned_addr learned my addr 172.21.15.46:0/1561303142 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a1a3e700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039c069560 0x7f039c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a123d700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039c159890 0x7f039c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 -- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039c159890 msgr2=0x7f039c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039c159890 0x7f039c15c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 -- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039c069560 msgr2=0x7f039c0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039c069560 0x7f039c0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 -- 172.21.15.46:0/1561303142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009a20 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.395+0000 7f03a223f700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f039c070e20 tx=0x7f038c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.396+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c027470 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.396+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c0275d0 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.396+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c027990 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.396+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c0ce750 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.396+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c16d650 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.397+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c0d1560 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.397+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f038c024070 con 0x7f039c159c60 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.397+0000 7f0399ffb700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 0x7f0388069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.398+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f038c087450 con 0x7f039c159c60 2023-10-07T09:04:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.398+0000 7f03a1a3e700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 0x7f0388069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.398+0000 7f03a1a3e700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 0x7f0388069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f03940093f0 tx=0x7f0394008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.402+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f038c054270 con 0x7f039c159c60 2023-10-07T09:04:49.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.591+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f039c04c3c0 con 0x7f0388067290 2023-10-07T09:04:49.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.600+0000 7f0399ffb700 1 -- 172.21.15.46:0/1561303142 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289614 (secure 0 0 0) 0x7f039c04c3c0 con 0x7f0388067290 2023-10-07T09:04:49.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 msgr2=0x7f0388069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 0x7f0388069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f03940093f0 tx=0x7f0394008040 comp rx=0 tx=0).stop 2023-10-07T09:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 msgr2=0x7f039c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f039c070e20 tx=0x7f038c019000 comp rx=0 tx=0).stop 2023-10-07T09:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 shutdown_connections 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0388067290 0x7f0388069740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f039c159c60 0x7f039c0cd0c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039c069560 0x7f039c0b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 --2- 172.21.15.46:0/1561303142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039c159890 0x7f039c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 >> 172.21.15.46:0/1561303142 conn(0x7f039c068e20 msgr2=0x7f039c149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 shutdown_connections 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.603+0000 7f03a3ca2700 1 -- 172.21.15.46:0/1561303142 wait complete. 2023-10-07T09:04:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:04:49.617 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2023-10-07T09:04:47.852611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409832,"kb_used_data":11048,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752564888,"statfs":{"total":773094113280,"available":770626445312,"internally_reserved":0,"allocated":11313152,"data_stored":5515948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.356276"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941645+0000","last_change":"2023-10-07T09:04:44.941645+0000","last_active":"2023-10-07T09:04:44.941645+0000","last_peered":"2023-10-07T09:04:44.941645+0000","last_clean":"2023-10-07T09:04:44.941645+0000","last_became_active":"2023-10-07T09:04:44.940401+0000","last_became_peered":"2023-10-07T09:04:44.940401+0000","last_unstale":"2023-10-07T09:04:44.941645+0000","last_undegraded":"2023-10-07T09:04:44.941645+0000","last_fullsized":"2023-10-07T09:04:44.941645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:10.626048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926672+0000","last_change":"2023-10-07T09:04:44.926672+0000","last_active":"2023-10-07T09:04:44.926672+0000","last_peered":"2023-10-07T09:04:44.926672+0000","last_clean":"2023-10-07T09:04:44.926672+0000","last_became_active":"2023-10-07T09:04:44.926422+0000","last_became_peered":"2023-10-07T09:04:44.926422+0000","last_unstale":"2023-10-07T09:04:44.926672+0000","last_undegraded":"2023-10-07T09:04:44.926672+0000","last_fullsized":"2023-10-07T09:04:44.926672+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:13:26.971188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.927875+0000","last_change":"2023-10-07T09:04:44.927875+0000","last_active":"2023-10-07T09:04:44.927875+0000","last_peered":"2023-10-07T09:04:44.927875+0000","last_clean":"2023-10-07T09:04:44.927875+0000","last_became_active":"2023-10-07T09:04:44.927600+0000","last_became_peered":"2023-10-07T09:04:44.927600+0000","last_unstale":"2023-10-07T09:04:44.927875+0000","last_undegraded":"2023-10-07T09:04:44.927875+0000","last_fullsized":"2023-10-07T09:04:44.927875+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:08.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941754+0000","last_change":"2023-10-07T09:04:44.941754+0000","last_active":"2023-10-07T09:04:44.941754+0000","last_peered":"2023-10-07T09:04:44.941754+0000","last_clean":"2023-10-07T09:04:44.941754+0000","last_became_active":"2023-10-07T09:04:44.939587+0000","last_became_peered":"2023-10-07T09:04:44.939587+0000","last_unstale":"2023-10-07T09:04:44.941754+0000","last_undegraded":"2023-10-07T09:04:44.941754+0000","last_fullsized":"2023-10-07T09:04:44.941754+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:58:35.843243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933149+0000","last_change":"2023-10-07T09:04:44.933149+0000","last_active":"2023-10-07T09:04:44.933149+0000","last_peered":"2023-10-07T09:04:44.933149+0000","last_clean":"2023-10-07T09:04:44.933149+0000","last_became_active":"2023-10-07T09:04:44.932836+0000","last_became_peered":"2023-10-07T09:04:44.932836+0000","last_unstale":"2023-10-07T09:04:44.933149+0000","last_undegraded":"2023-10-07T09:04:44.933149+0000","last_fullsized":"2023-10-07T09:04:44.933149+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:59.771526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933386+0000","last_change":"2023-10-07T09:04:44.933386+0000","last_active":"2023-10-07T09:04:44.933386+0000","last_peered":"2023-10-07T09:04:44.933386+0000","last_clean":"2023-10-07T09:04:44.933386+0000","last_became_active":"2023-10-07T09:04:44.933089+0000","last_became_peered":"2023-10-07T09:04:44.933089+0000","last_unstale":"2023-10-07T09:04:44.933386+0000","last_undegraded":"2023-10-07T09:04:44.933386+0000","last_fullsized":"2023-10-07T09:04:44.933386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:59.280515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938994+0000","last_change":"2023-10-07T09:04:44.938994+0000","last_active":"2023-10-07T09:04:44.938994+0000","last_peered":"2023-10-07T09:04:44.938994+0000","last_clean":"2023-10-07T09:04:44.938994+0000","last_became_active":"2023-10-07T09:04:44.938708+0000","last_became_peered":"2023-10-07T09:04:44.938708+0000","last_unstale":"2023-10-07T09:04:44.938994+0000","last_undegraded":"2023-10-07T09:04:44.938994+0000","last_fullsized":"2023-10-07T09:04:44.938994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:51.615965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926738+0000","last_change":"2023-10-07T09:04:44.926738+0000","last_active":"2023-10-07T09:04:44.926738+0000","last_peered":"2023-10-07T09:04:44.926738+0000","last_clean":"2023-10-07T09:04:44.926738+0000","last_became_active":"2023-10-07T09:04:44.926457+0000","last_became_peered":"2023-10-07T09:04:44.926457+0000","last_unstale":"2023-10-07T09:04:44.926738+0000","last_undegraded":"2023-10-07T09:04:44.926738+0000","last_fullsized":"2023-10-07T09:04:44.926738+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:20.785301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942530+0000","last_change":"2023-10-07T09:04:44.942530+0000","last_active":"2023-10-07T09:04:44.942530+0000","last_peered":"2023-10-07T09:04:44.942530+0000","last_clean":"2023-10-07T09:04:44.942530+0000","last_became_active":"2023-10-07T09:04:44.941561+0000","last_became_peered":"2023-10-07T09:04:44.941561+0000","last_unstale":"2023-10-07T09:04:44.942530+0000","last_undegraded":"2023-10-07T09:04:44.942530+0000","last_fullsized":"2023-10-07T09:04:44.942530+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.556879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938648+0000","last_change":"2023-10-07T09:04:44.938648+0000","last_active":"2023-10-07T09:04:44.938648+0000","last_peered":"2023-10-07T09:04:44.938648+0000","last_clean":"2023-10-07T09:04:44.938648+0000","last_became_active":"2023-10-07T09:04:44.938079+0000","last_became_peered":"2023-10-07T09:04:44.938079+0000","last_unstale":"2023-10-07T09:04:44.938648+0000","last_undegraded":"2023-10-07T09:04:44.938648+0000","last_fullsized":"2023-10-07T09:04:44.938648+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:57.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935853+0000","last_change":"2023-10-07T09:04:44.935853+0000","last_active":"2023-10-07T09:04:44.935853+0000","last_peered":"2023-10-07T09:04:44.935853+0000","last_clean":"2023-10-07T09:04:44.935853+0000","last_became_active":"2023-10-07T09:04:44.935580+0000","last_became_peered":"2023-10-07T09:04:44.935580+0000","last_unstale":"2023-10-07T09:04:44.935853+0000","last_undegraded":"2023-10-07T09:04:44.935853+0000","last_fullsized":"2023-10-07T09:04:44.935853+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:53.855444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938162+0000","last_change":"2023-10-07T09:04:44.938162+0000","last_active":"2023-10-07T09:04:44.938162+0000","last_peered":"2023-10-07T09:04:44.938162+0000","last_clean":"2023-10-07T09:04:44.938162+0000","last_became_active":"2023-10-07T09:04:44.935582+0000","last_became_peered":"2023-10-07T09:04:44.935582+0000","last_unstale":"2023-10-07T09:04:44.938162+0000","last_undegraded":"2023-10-07T09:04:44.938162+0000","last_fullsized":"2023-10-07T09:04:44.938162+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:52:15.845535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929958+0000","last_change":"2023-10-07T09:04:44.929958+0000","last_active":"2023-10-07T09:04:44.929958+0000","last_peered":"2023-10-07T09:04:44.929958+0000","last_clean":"2023-10-07T09:04:44.929958+0000","last_became_active":"2023-10-07T09:04:44.928804+0000","last_became_peered":"2023-10-07T09:04:44.928804+0000","last_unstale":"2023-10-07T09:04:44.929958+0000","last_undegraded":"2023-10-07T09:04:44.929958+0000","last_fullsized":"2023-10-07T09:04:44.929958+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:04.493085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936475+0000","last_change":"2023-10-07T09:04:44.936475+0000","last_active":"2023-10-07T09:04:44.936475+0000","last_peered":"2023-10-07T09:04:44.936475+0000","last_clean":"2023-10-07T09:04:44.936475+0000","last_became_active":"2023-10-07T09:04:44.936190+0000","last_became_peered":"2023-10-07T09:04:44.936190+0000","last_unstale":"2023-10-07T09:04:44.936475+0000","last_undegraded":"2023-10-07T09:04:44.936475+0000","last_fullsized":"2023-10-07T09:04:44.936475+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:27.905888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932770+0000","last_change":"2023-10-07T09:04:44.932770+0000","last_active":"2023-10-07T09:04:44.932770+0000","last_peered":"2023-10-07T09:04:44.932770+0000","last_clean":"2023-10-07T09:04:44.932770+0000","last_became_active":"2023-10-07T09:04:44.932558+0000","last_became_peered":"2023-10-07T09:04:44.932558+0000","last_unstale":"2023-10-07T09:04:44.932770+0000","last_undegraded":"2023-10-07T09:04:44.932770+0000","last_fullsized":"2023-10-07T09:04:44.932770+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:26.734549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938749+0000","last_change":"2023-10-07T09:04:44.938749+0000","last_active":"2023-10-07T09:04:44.938749+0000","last_peered":"2023-10-07T09:04:44.938749+0000","last_clean":"2023-10-07T09:04:44.938749+0000","last_became_active":"2023-10-07T09:04:44.938169+0000","last_became_peered":"2023-10-07T09:04:44.938169+0000","last_unstale":"2023-10-07T09:04:44.938749+0000","last_undegraded":"2023-10-07T09:04:44.938749+0000","last_fullsized":"2023-10-07T09:04:44.938749+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:05.856465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936065+0000","last_change":"2023-10-07T09:04:44.936065+0000","last_active":"2023-10-07T09:04:44.936065+0000","last_peered":"2023-10-07T09:04:44.936065+0000","last_clean":"2023-10-07T09:04:44.936065+0000","last_became_active":"2023-10-07T09:04:44.935795+0000","last_became_peered":"2023-10-07T09:04:44.935795+0000","last_unstale":"2023-10-07T09:04:44.936065+0000","last_undegraded":"2023-10-07T09:04:44.936065+0000","last_fullsized":"2023-10-07T09:04:44.936065+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938922+0000","last_change":"2023-10-07T09:04:44.938922+0000","last_active":"2023-10-07T09:04:44.938922+0000","last_peered":"2023-10-07T09:04:44.938922+0000","last_clean":"2023-10-07T09:04:44.938922+0000","last_became_active":"2023-10-07T09:04:44.938501+0000","last_became_peered":"2023-10-07T09:04:44.938501+0000","last_unstale":"2023-10-07T09:04:44.938922+0000","last_undegraded":"2023-10-07T09:04:44.938922+0000","last_fullsized":"2023-10-07T09:04:44.938922+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:13:26.971188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930730+0000","last_change":"2023-10-07T09:04:44.930730+0000","last_active":"2023-10-07T09:04:44.930730+0000","last_peered":"2023-10-07T09:04:44.930730+0000","last_clean":"2023-10-07T09:04:44.930730+0000","last_became_active":"2023-10-07T09:04:44.930435+0000","last_became_peered":"2023-10-07T09:04:44.930435+0000","last_unstale":"2023-10-07T09:04:44.930730+0000","last_undegraded":"2023-10-07T09:04:44.930730+0000","last_fullsized":"2023-10-07T09:04:44.930730+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:26:56.240282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930762+0000","last_change":"2023-10-07T09:04:44.930762+0000","last_active":"2023-10-07T09:04:44.930762+0000","last_peered":"2023-10-07T09:04:44.930762+0000","last_clean":"2023-10-07T09:04:44.930762+0000","last_became_active":"2023-10-07T09:04:44.930490+0000","last_became_peered":"2023-10-07T09:04:44.930490+0000","last_unstale":"2023-10-07T09:04:44.930762+0000","last_undegraded":"2023-10-07T09:04:44.930762+0000","last_fullsized":"2023-10-07T09:04:44.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:42.459267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933211+0000","last_change":"2023-10-07T09:04:44.933211+0000","last_active":"2023-10-07T09:04:44.933211+0000","last_peered":"2023-10-07T09:04:44.933211+0000","last_clean":"2023-10-07T09:04:44.933211+0000","last_became_active":"2023-10-07T09:04:44.932551+0000","last_became_peered":"2023-10-07T09:04:44.932551+0000","last_unstale":"2023-10-07T09:04:44.933211+0000","last_undegraded":"2023-10-07T09:04:44.933211+0000","last_fullsized":"2023-10-07T09:04:44.933211+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.955003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938315+0000","last_change":"2023-10-07T09:04:44.938315+0000","last_active":"2023-10-07T09:04:44.938315+0000","last_peered":"2023-10-07T09:04:44.938315+0000","last_clean":"2023-10-07T09:04:44.938315+0000","last_became_active":"2023-10-07T09:04:44.937987+0000","last_became_peered":"2023-10-07T09:04:44.937987+0000","last_unstale":"2023-10-07T09:04:44.938315+0000","last_undegraded":"2023-10-07T09:04:44.938315+0000","last_fullsized":"2023-10-07T09:04:44.938315+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:42.151284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.931778+0000","last_change":"2023-10-07T09:04:44.931778+0000","last_active":"2023-10-07T09:04:44.931778+0000","last_peered":"2023-10-07T09:04:44.931778+0000","last_clean":"2023-10-07T09:04:44.931778+0000","last_became_active":"2023-10-07T09:04:44.931508+0000","last_became_peered":"2023-10-07T09:04:44.931508+0000","last_unstale":"2023-10-07T09:04:44.931778+0000","last_undegraded":"2023-10-07T09:04:44.931778+0000","last_fullsized":"2023-10-07T09:04:44.931778+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:46:22.491688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933816+0000","last_change":"2023-10-07T09:04:44.933816+0000","last_active":"2023-10-07T09:04:44.933816+0000","last_peered":"2023-10-07T09:04:44.933816+0000","last_clean":"2023-10-07T09:04:44.933816+0000","last_became_active":"2023-10-07T09:04:44.933401+0000","last_became_peered":"2023-10-07T09:04:44.933401+0000","last_unstale":"2023-10-07T09:04:44.933816+0000","last_undegraded":"2023-10-07T09:04:44.933816+0000","last_fullsized":"2023-10-07T09:04:44.933816+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:44.379418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935913+0000","last_change":"2023-10-07T09:04:44.935913+0000","last_active":"2023-10-07T09:04:44.935913+0000","last_peered":"2023-10-07T09:04:44.935913+0000","last_clean":"2023-10-07T09:04:44.935913+0000","last_became_active":"2023-10-07T09:04:44.935621+0000","last_became_peered":"2023-10-07T09:04:44.935621+0000","last_unstale":"2023-10-07T09:04:44.935913+0000","last_undegraded":"2023-10-07T09:04:44.935913+0000","last_fullsized":"2023-10-07T09:04:44.935913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:48:53.873371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939104+0000","last_change":"2023-10-07T09:04:44.939104+0000","last_active":"2023-10-07T09:04:44.939104+0000","last_peered":"2023-10-07T09:04:44.939104+0000","last_clean":"2023-10-07T09:04:44.939104+0000","last_became_active":"2023-10-07T09:04:44.938865+0000","last_became_peered":"2023-10-07T09:04:44.938865+0000","last_unstale":"2023-10-07T09:04:44.939104+0000","last_undegraded":"2023-10-07T09:04:44.939104+0000","last_fullsized":"2023-10-07T09:04:44.939104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:23.534212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940727+0000","last_change":"2023-10-07T09:04:44.940727+0000","last_active":"2023-10-07T09:04:44.940727+0000","last_peered":"2023-10-07T09:04:44.940727+0000","last_clean":"2023-10-07T09:04:44.940727+0000","last_became_active":"2023-10-07T09:04:44.940452+0000","last_became_peered":"2023-10-07T09:04:44.940452+0000","last_unstale":"2023-10-07T09:04:44.940727+0000","last_undegraded":"2023-10-07T09:04:44.940727+0000","last_fullsized":"2023-10-07T09:04:44.940727+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:51.615965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940889+0000","last_change":"2023-10-07T09:04:44.940889+0000","last_active":"2023-10-07T09:04:44.940889+0000","last_peered":"2023-10-07T09:04:44.940889+0000","last_clean":"2023-10-07T09:04:44.940889+0000","last_became_active":"2023-10-07T09:04:44.940590+0000","last_became_peered":"2023-10-07T09:04:44.940590+0000","last_unstale":"2023-10-07T09:04:44.940889+0000","last_undegraded":"2023-10-07T09:04:44.940889+0000","last_fullsized":"2023-10-07T09:04:44.940889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:06:23.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930960+0000","last_change":"2023-10-07T09:04:44.930960+0000","last_active":"2023-10-07T09:04:44.930960+0000","last_peered":"2023-10-07T09:04:44.930960+0000","last_clean":"2023-10-07T09:04:44.930960+0000","last_became_active":"2023-10-07T09:04:44.930664+0000","last_became_peered":"2023-10-07T09:04:44.930664+0000","last_unstale":"2023-10-07T09:04:44.930960+0000","last_undegraded":"2023-10-07T09:04:44.930960+0000","last_fullsized":"2023-10-07T09:04:44.930960+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:45.054788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936481+0000","last_change":"2023-10-07T09:04:44.936481+0000","last_active":"2023-10-07T09:04:44.936481+0000","last_peered":"2023-10-07T09:04:44.936481+0000","last_clean":"2023-10-07T09:04:44.936481+0000","last_became_active":"2023-10-07T09:04:44.936174+0000","last_became_peered":"2023-10-07T09:04:44.936174+0000","last_unstale":"2023-10-07T09:04:44.936481+0000","last_undegraded":"2023-10-07T09:04:44.936481+0000","last_fullsized":"2023-10-07T09:04:44.936481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:49.344555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936865+0000","last_change":"2023-10-07T09:04:44.936865+0000","last_active":"2023-10-07T09:04:44.936865+0000","last_peered":"2023-10-07T09:04:44.936865+0000","last_clean":"2023-10-07T09:04:44.936865+0000","last_became_active":"2023-10-07T09:04:44.936601+0000","last_became_peered":"2023-10-07T09:04:44.936601+0000","last_unstale":"2023-10-07T09:04:44.936865+0000","last_undegraded":"2023-10-07T09:04:44.936865+0000","last_fullsized":"2023-10-07T09:04:44.936865+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:06.369310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936392+0000","last_change":"2023-10-07T09:04:44.936392+0000","last_active":"2023-10-07T09:04:44.936392+0000","last_peered":"2023-10-07T09:04:44.936392+0000","last_clean":"2023-10-07T09:04:44.936392+0000","last_became_active":"2023-10-07T09:04:44.936140+0000","last_became_peered":"2023-10-07T09:04:44.936140+0000","last_unstale":"2023-10-07T09:04:44.936392+0000","last_undegraded":"2023-10-07T09:04:44.936392+0000","last_fullsized":"2023-10-07T09:04:44.936392+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:59.131488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.925369+0000","last_change":"2023-10-07T09:04:44.925369+0000","last_active":"2023-10-07T09:04:44.925369+0000","last_peered":"2023-10-07T09:04:44.925369+0000","last_clean":"2023-10-07T09:04:44.925369+0000","last_became_active":"2023-10-07T09:04:44.925145+0000","last_became_peered":"2023-10-07T09:04:44.925145+0000","last_unstale":"2023-10-07T09:04:44.925369+0000","last_undegraded":"2023-10-07T09:04:44.925369+0000","last_fullsized":"2023-10-07T09:04:44.925369+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:12.181762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.516062+0000","last_change":"2023-10-07T09:04:44.518922+0000","last_active":"2023-10-07T09:04:45.516062+0000","last_peered":"2023-10-07T09:04:45.516062+0000","last_clean":"2023-10-07T09:04:45.516062+0000","last_became_active":"2023-10-07T09:04:44.518587+0000","last_became_peered":"2023-10-07T09:04:44.518587+0000","last_unstale":"2023-10-07T09:04:45.516062+0000","last_undegraded":"2023-10-07T09:04:45.516062+0000","last_fullsized":"2023-10-07T09:04:45.516062+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:40.688202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933669+0000","last_change":"2023-10-07T09:04:44.933669+0000","last_active":"2023-10-07T09:04:44.933669+0000","last_peered":"2023-10-07T09:04:44.933669+0000","last_clean":"2023-10-07T09:04:44.933669+0000","last_became_active":"2023-10-07T09:04:44.933406+0000","last_became_peered":"2023-10-07T09:04:44.933406+0000","last_unstale":"2023-10-07T09:04:44.933669+0000","last_undegraded":"2023-10-07T09:04:44.933669+0000","last_fullsized":"2023-10-07T09:04:44.933669+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:48:53.873371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.923331+0000","last_change":"2023-10-07T09:04:44.520637+0000","last_active":"2023-10-07T09:04:44.923331+0000","last_peered":"2023-10-07T09:04:44.923331+0000","last_clean":"2023-10-07T09:04:44.923331+0000","last_became_active":"2023-10-07T09:04:44.520343+0000","last_became_peered":"2023-10-07T09:04:44.520343+0000","last_unstale":"2023-10-07T09:04:44.923331+0000","last_undegraded":"2023-10-07T09:04:44.923331+0000","last_fullsized":"2023-10-07T09:04:44.923331+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:44.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936082+0000","last_change":"2023-10-07T09:04:44.936082+0000","last_active":"2023-10-07T09:04:44.936082+0000","last_peered":"2023-10-07T09:04:44.936082+0000","last_clean":"2023-10-07T09:04:44.936082+0000","last_became_active":"2023-10-07T09:04:44.935843+0000","last_became_peered":"2023-10-07T09:04:44.935843+0000","last_unstale":"2023-10-07T09:04:44.936082+0000","last_undegraded":"2023-10-07T09:04:44.936082+0000","last_fullsized":"2023-10-07T09:04:44.936082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:42:12.243771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515411+0000","last_change":"2023-10-07T09:04:44.517377+0000","last_active":"2023-10-07T09:04:45.515411+0000","last_peered":"2023-10-07T09:04:45.515411+0000","last_clean":"2023-10-07T09:04:45.515411+0000","last_became_active":"2023-10-07T09:04:44.517073+0000","last_became_peered":"2023-10-07T09:04:44.517073+0000","last_unstale":"2023-10-07T09:04:45.515411+0000","last_undegraded":"2023-10-07T09:04:45.515411+0000","last_fullsized":"2023-10-07T09:04:45.515411+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:25.407216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930193+0000","last_change":"2023-10-07T09:04:44.930193+0000","last_active":"2023-10-07T09:04:44.930193+0000","last_peered":"2023-10-07T09:04:44.930193+0000","last_clean":"2023-10-07T09:04:44.930193+0000","last_became_active":"2023-10-07T09:04:44.929192+0000","last_became_peered":"2023-10-07T09:04:44.929192+0000","last_unstale":"2023-10-07T09:04:44.930193+0000","last_undegraded":"2023-10-07T09:04:44.930193+0000","last_fullsized":"2023-10-07T09:04:44.930193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:53.036907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515173+0000","last_change":"2023-10-07T09:04:44.518795+0000","last_active":"2023-10-07T09:04:45.515173+0000","last_peered":"2023-10-07T09:04:45.515173+0000","last_clean":"2023-10-07T09:04:45.515173+0000","last_became_active":"2023-10-07T09:04:44.517083+0000","last_became_peered":"2023-10-07T09:04:44.517083+0000","last_unstale":"2023-10-07T09:04:45.515173+0000","last_undegraded":"2023-10-07T09:04:45.515173+0000","last_fullsized":"2023-10-07T09:04:45.515173+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:43.508701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.934441+0000","last_change":"2023-10-07T09:04:44.934441+0000","last_active":"2023-10-07T09:04:44.934441+0000","last_peered":"2023-10-07T09:04:44.934441+0000","last_clean":"2023-10-07T09:04:44.934441+0000","last_became_active":"2023-10-07T09:04:44.934188+0000","last_became_peered":"2023-10-07T09:04:44.934188+0000","last_unstale":"2023-10-07T09:04:44.934441+0000","last_undegraded":"2023-10-07T09:04:44.934441+0000","last_fullsized":"2023-10-07T09:04:44.934441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:00.889344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929599+0000","last_change":"2023-10-07T09:04:44.522516+0000","last_active":"2023-10-07T09:04:44.929599+0000","last_peered":"2023-10-07T09:04:44.929599+0000","last_clean":"2023-10-07T09:04:44.929599+0000","last_became_active":"2023-10-07T09:04:44.522213+0000","last_became_peered":"2023-10-07T09:04:44.522213+0000","last_unstale":"2023-10-07T09:04:44.929599+0000","last_undegraded":"2023-10-07T09:04:44.929599+0000","last_fullsized":"2023-10-07T09:04:44.929599+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:20.800071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.928375+0000","last_change":"2023-10-07T09:04:44.928375+0000","last_active":"2023-10-07T09:04:44.928375+0000","last_peered":"2023-10-07T09:04:44.928375+0000","last_clean":"2023-10-07T09:04:44.928375+0000","last_became_active":"2023-10-07T09:04:44.927950+0000","last_became_peered":"2023-10-07T09:04:44.927950+0000","last_unstale":"2023-10-07T09:04:44.928375+0000","last_undegraded":"2023-10-07T09:04:44.928375+0000","last_fullsized":"2023-10-07T09:04:44.928375+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:53.891597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926644+0000","last_change":"2023-10-07T09:04:44.519621+0000","last_active":"2023-10-07T09:04:44.926644+0000","last_peered":"2023-10-07T09:04:44.926644+0000","last_clean":"2023-10-07T09:04:44.926644+0000","last_became_active":"2023-10-07T09:04:44.519360+0000","last_became_peered":"2023-10-07T09:04:44.519360+0000","last_unstale":"2023-10-07T09:04:44.926644+0000","last_undegraded":"2023-10-07T09:04:44.926644+0000","last_fullsized":"2023-10-07T09:04:44.926644+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:00.086938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935191+0000","last_change":"2023-10-07T09:04:44.935191+0000","last_active":"2023-10-07T09:04:44.935191+0000","last_peered":"2023-10-07T09:04:44.935191+0000","last_clean":"2023-10-07T09:04:44.935191+0000","last_became_active":"2023-10-07T09:04:44.935020+0000","last_became_peered":"2023-10-07T09:04:44.935020+0000","last_unstale":"2023-10-07T09:04:44.935191+0000","last_undegraded":"2023-10-07T09:04:44.935191+0000","last_fullsized":"2023-10-07T09:04:44.935191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:03:00.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.519404+0000","last_change":"2023-10-07T09:04:44.517895+0000","last_active":"2023-10-07T09:04:44.519404+0000","last_peered":"2023-10-07T09:04:44.519404+0000","last_clean":"2023-10-07T09:04:44.519404+0000","last_became_active":"2023-10-07T09:04:44.517641+0000","last_became_peered":"2023-10-07T09:04:44.517641+0000","last_unstale":"2023-10-07T09:04:44.519404+0000","last_undegraded":"2023-10-07T09:04:44.519404+0000","last_fullsized":"2023-10-07T09:04:44.519404+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:20.800071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938864+0000","last_change":"2023-10-07T09:04:44.938864+0000","last_active":"2023-10-07T09:04:44.938864+0000","last_peered":"2023-10-07T09:04:44.938864+0000","last_clean":"2023-10-07T09:04:44.938864+0000","last_became_active":"2023-10-07T09:04:44.938650+0000","last_became_peered":"2023-10-07T09:04:44.938650+0000","last_unstale":"2023-10-07T09:04:44.938864+0000","last_undegraded":"2023-10-07T09:04:44.938864+0000","last_fullsized":"2023-10-07T09:04:44.938864+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:34.021308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527292+0000","last_change":"2023-10-07T09:04:44.526521+0000","last_active":"2023-10-07T09:04:44.527292+0000","last_peered":"2023-10-07T09:04:44.527292+0000","last_clean":"2023-10-07T09:04:44.527292+0000","last_became_active":"2023-10-07T09:04:44.526205+0000","last_became_peered":"2023-10-07T09:04:44.526205+0000","last_unstale":"2023-10-07T09:04:44.527292+0000","last_undegraded":"2023-10-07T09:04:44.527292+0000","last_fullsized":"2023-10-07T09:04:44.527292+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:03.488503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937068+0000","last_change":"2023-10-07T09:04:44.937068+0000","last_active":"2023-10-07T09:04:44.937068+0000","last_peered":"2023-10-07T09:04:44.937068+0000","last_clean":"2023-10-07T09:04:44.937068+0000","last_became_active":"2023-10-07T09:04:44.936747+0000","last_became_peered":"2023-10-07T09:04:44.936747+0000","last_unstale":"2023-10-07T09:04:44.937068+0000","last_undegraded":"2023-10-07T09:04:44.937068+0000","last_fullsized":"2023-10-07T09:04:44.937068+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:38.449118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522585+0000","last_change":"2023-10-07T09:04:44.519574+0000","last_active":"2023-10-07T09:04:44.522585+0000","last_peered":"2023-10-07T09:04:44.522585+0000","last_clean":"2023-10-07T09:04:44.522585+0000","last_became_active":"2023-10-07T09:04:44.519326+0000","last_became_peered":"2023-10-07T09:04:44.519326+0000","last_unstale":"2023-10-07T09:04:44.522585+0000","last_undegraded":"2023-10-07T09:04:44.522585+0000","last_fullsized":"2023-10-07T09:04:44.522585+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:23.523197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942241+0000","last_change":"2023-10-07T09:04:44.942241+0000","last_active":"2023-10-07T09:04:44.942241+0000","last_peered":"2023-10-07T09:04:44.942241+0000","last_clean":"2023-10-07T09:04:44.942241+0000","last_became_active":"2023-10-07T09:04:44.941746+0000","last_became_peered":"2023-10-07T09:04:44.941746+0000","last_unstale":"2023-10-07T09:04:44.942241+0000","last_undegraded":"2023-10-07T09:04:44.942241+0000","last_fullsized":"2023-10-07T09:04:44.942241+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:46:22.491688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.524378+0000","last_change":"2023-10-07T09:04:44.520487+0000","last_active":"2023-10-07T09:04:44.524378+0000","last_peered":"2023-10-07T09:04:44.524378+0000","last_clean":"2023-10-07T09:04:44.524378+0000","last_became_active":"2023-10-07T09:04:44.520191+0000","last_became_peered":"2023-10-07T09:04:44.520191+0000","last_unstale":"2023-10-07T09:04:44.524378+0000","last_undegraded":"2023-10-07T09:04:44.524378+0000","last_fullsized":"2023-10-07T09:04:44.524378+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:30.036754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936316+0000","last_change":"2023-10-07T09:04:44.936316+0000","last_active":"2023-10-07T09:04:44.936316+0000","last_peered":"2023-10-07T09:04:44.936316+0000","last_clean":"2023-10-07T09:04:44.936316+0000","last_became_active":"2023-10-07T09:04:44.936071+0000","last_became_peered":"2023-10-07T09:04:44.936071+0000","last_unstale":"2023-10-07T09:04:44.936316+0000","last_undegraded":"2023-10-07T09:04:44.936316+0000","last_fullsized":"2023-10-07T09:04:44.936316+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:51.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.514574+0000","last_change":"2023-10-07T09:04:44.526944+0000","last_active":"2023-10-07T09:04:45.514574+0000","last_peered":"2023-10-07T09:04:45.514574+0000","last_clean":"2023-10-07T09:04:45.514574+0000","last_became_active":"2023-10-07T09:04:44.526672+0000","last_became_peered":"2023-10-07T09:04:44.526672+0000","last_unstale":"2023-10-07T09:04:45.514574+0000","last_undegraded":"2023-10-07T09:04:45.514574+0000","last_fullsized":"2023-10-07T09:04:45.514574+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:19.780718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940589+0000","last_change":"2023-10-07T09:04:44.940589+0000","last_active":"2023-10-07T09:04:44.940589+0000","last_peered":"2023-10-07T09:04:44.940589+0000","last_clean":"2023-10-07T09:04:44.940589+0000","last_became_active":"2023-10-07T09:04:44.940320+0000","last_became_peered":"2023-10-07T09:04:44.940320+0000","last_unstale":"2023-10-07T09:04:44.940589+0000","last_undegraded":"2023-10-07T09:04:44.940589+0000","last_fullsized":"2023-10-07T09:04:44.940589+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:19.281363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.517607+0000","last_change":"2023-10-07T09:04:44.522862+0000","last_active":"2023-10-07T09:04:45.517607+0000","last_peered":"2023-10-07T09:04:45.517607+0000","last_clean":"2023-10-07T09:04:45.517607+0000","last_became_active":"2023-10-07T09:04:44.522271+0000","last_became_peered":"2023-10-07T09:04:44.522271+0000","last_unstale":"2023-10-07T09:04:45.517607+0000","last_undegraded":"2023-10-07T09:04:45.517607+0000","last_fullsized":"2023-10-07T09:04:45.517607+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.799551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940995+0000","last_change":"2023-10-07T09:04:44.940995+0000","last_active":"2023-10-07T09:04:44.940995+0000","last_peered":"2023-10-07T09:04:44.940995+0000","last_clean":"2023-10-07T09:04:44.940995+0000","last_became_active":"2023-10-07T09:04:44.940698+0000","last_became_peered":"2023-10-07T09:04:44.940698+0000","last_unstale":"2023-10-07T09:04:44.940995+0000","last_undegraded":"2023-10-07T09:04:44.940995+0000","last_fullsized":"2023-10-07T09:04:44.940995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:29.758283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.516099+0000","last_change":"2023-10-07T09:04:44.519299+0000","last_active":"2023-10-07T09:04:45.516099+0000","last_peered":"2023-10-07T09:04:45.516099+0000","last_clean":"2023-10-07T09:04:45.516099+0000","last_became_active":"2023-10-07T09:04:44.519034+0000","last_became_peered":"2023-10-07T09:04:44.519034+0000","last_unstale":"2023-10-07T09:04:45.516099+0000","last_undegraded":"2023-10-07T09:04:45.516099+0000","last_fullsized":"2023-10-07T09:04:45.516099+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:20.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.931544+0000","last_change":"2023-10-07T09:04:44.931544+0000","last_active":"2023-10-07T09:04:44.931544+0000","last_peered":"2023-10-07T09:04:44.931544+0000","last_clean":"2023-10-07T09:04:44.931544+0000","last_became_active":"2023-10-07T09:04:44.931254+0000","last_became_peered":"2023-10-07T09:04:44.931254+0000","last_unstale":"2023-10-07T09:04:44.931544+0000","last_undegraded":"2023-10-07T09:04:44.931544+0000","last_fullsized":"2023-10-07T09:04:44.931544+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:08.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527226+0000","last_change":"2023-10-07T09:04:44.523349+0000","last_active":"2023-10-07T09:04:44.527226+0000","last_peered":"2023-10-07T09:04:44.527226+0000","last_clean":"2023-10-07T09:04:44.527226+0000","last_became_active":"2023-10-07T09:04:44.523068+0000","last_became_peered":"2023-10-07T09:04:44.523068+0000","last_unstale":"2023-10-07T09:04:44.527226+0000","last_undegraded":"2023-10-07T09:04:44.527226+0000","last_fullsized":"2023-10-07T09:04:44.527226+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:48.339972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937189+0000","last_change":"2023-10-07T09:04:44.937189+0000","last_active":"2023-10-07T09:04:44.937189+0000","last_peered":"2023-10-07T09:04:44.937189+0000","last_clean":"2023-10-07T09:04:44.937189+0000","last_became_active":"2023-10-07T09:04:44.936751+0000","last_became_peered":"2023-10-07T09:04:44.936751+0000","last_unstale":"2023-10-07T09:04:44.937189+0000","last_undegraded":"2023-10-07T09:04:44.937189+0000","last_fullsized":"2023-10-07T09:04:44.937189+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:07.219179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.517658+0000","last_change":"2023-10-07T09:04:44.522120+0000","last_active":"2023-10-07T09:04:45.517658+0000","last_peered":"2023-10-07T09:04:45.517658+0000","last_clean":"2023-10-07T09:04:45.517658+0000","last_became_active":"2023-10-07T09:04:44.521835+0000","last_became_peered":"2023-10-07T09:04:44.521835+0000","last_unstale":"2023-10-07T09:04:45.517658+0000","last_undegraded":"2023-10-07T09:04:45.517658+0000","last_fullsized":"2023-10-07T09:04:45.517658+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:20.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936545+0000","last_change":"2023-10-07T09:04:44.936545+0000","last_active":"2023-10-07T09:04:44.936545+0000","last_peered":"2023-10-07T09:04:44.936545+0000","last_clean":"2023-10-07T09:04:44.936545+0000","last_became_active":"2023-10-07T09:04:44.936252+0000","last_became_peered":"2023-10-07T09:04:44.936252+0000","last_unstale":"2023-10-07T09:04:44.936545+0000","last_undegraded":"2023-10-07T09:04:44.936545+0000","last_fullsized":"2023-10-07T09:04:44.936545+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:01:30.911958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933496+0000","last_change":"2023-10-07T09:04:44.526609+0000","last_active":"2023-10-07T09:04:44.933496+0000","last_peered":"2023-10-07T09:04:44.933496+0000","last_clean":"2023-10-07T09:04:44.933496+0000","last_became_active":"2023-10-07T09:04:44.526269+0000","last_became_peered":"2023-10-07T09:04:44.526269+0000","last_unstale":"2023-10-07T09:04:44.933496+0000","last_undegraded":"2023-10-07T09:04:44.933496+0000","last_fullsized":"2023-10-07T09:04:44.933496+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:06.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942457+0000","last_change":"2023-10-07T09:04:44.942457+0000","last_active":"2023-10-07T09:04:44.942457+0000","last_peered":"2023-10-07T09:04:44.942457+0000","last_clean":"2023-10-07T09:04:44.942457+0000","last_became_active":"2023-10-07T09:04:44.942128+0000","last_became_peered":"2023-10-07T09:04:44.942128+0000","last_unstale":"2023-10-07T09:04:44.942457+0000","last_undegraded":"2023-10-07T09:04:44.942457+0000","last_fullsized":"2023-10-07T09:04:44.942457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:38.449118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515110+0000","last_change":"2023-10-07T09:04:44.514316+0000","last_active":"2023-10-07T09:04:45.515110+0000","last_peered":"2023-10-07T09:04:45.515110+0000","last_clean":"2023-10-07T09:04:45.515110+0000","last_became_active":"2023-10-07T09:04:44.514010+0000","last_became_peered":"2023-10-07T09:04:44.514010+0000","last_unstale":"2023-10-07T09:04:45.515110+0000","last_undegraded":"2023-10-07T09:04:45.515110+0000","last_fullsized":"2023-10-07T09:04:45.515110+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:22.995747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937163+0000","last_change":"2023-10-07T09:04:44.937163+0000","last_active":"2023-10-07T09:04:44.937163+0000","last_peered":"2023-10-07T09:04:44.937163+0000","last_clean":"2023-10-07T09:04:44.937163+0000","last_became_active":"2023-10-07T09:04:44.936842+0000","last_became_peered":"2023-10-07T09:04:44.936842+0000","last_unstale":"2023-10-07T09:04:44.937163+0000","last_undegraded":"2023-10-07T09:04:44.937163+0000","last_fullsized":"2023-10-07T09:04:44.937163+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:32.755065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.928749+0000","last_change":"2023-10-07T09:04:44.519428+0000","last_active":"2023-10-07T09:04:44.928749+0000","last_peered":"2023-10-07T09:04:44.928749+0000","last_clean":"2023-10-07T09:04:44.928749+0000","last_became_active":"2023-10-07T09:04:44.519144+0000","last_became_peered":"2023-10-07T09:04:44.519144+0000","last_unstale":"2023-10-07T09:04:44.928749+0000","last_undegraded":"2023-10-07T09:04:44.928749+0000","last_fullsized":"2023-10-07T09:04:44.928749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:18.276780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940763+0000","last_change":"2023-10-07T09:04:44.940763+0000","last_active":"2023-10-07T09:04:44.940763+0000","last_peered":"2023-10-07T09:04:44.940763+0000","last_clean":"2023-10-07T09:04:44.940763+0000","last_became_active":"2023-10-07T09:04:44.940486+0000","last_became_peered":"2023-10-07T09:04:44.940486+0000","last_unstale":"2023-10-07T09:04:44.940763+0000","last_undegraded":"2023-10-07T09:04:44.940763+0000","last_fullsized":"2023-10-07T09:04:44.940763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:38.479474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.529610+0000","last_change":"2023-10-07T09:04:44.525146+0000","last_active":"2023-10-07T09:04:44.529610+0000","last_peered":"2023-10-07T09:04:44.529610+0000","last_clean":"2023-10-07T09:04:44.529610+0000","last_became_active":"2023-10-07T09:04:44.524885+0000","last_became_peered":"2023-10-07T09:04:44.524885+0000","last_unstale":"2023-10-07T09:04:44.529610+0000","last_undegraded":"2023-10-07T09:04:44.529610+0000","last_fullsized":"2023-10-07T09:04:44.529610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:27.774527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.927840+0000","last_change":"2023-10-07T09:04:44.927840+0000","last_active":"2023-10-07T09:04:44.927840+0000","last_peered":"2023-10-07T09:04:44.927840+0000","last_clean":"2023-10-07T09:04:44.927840+0000","last_became_active":"2023-10-07T09:04:44.927486+0000","last_became_peered":"2023-10-07T09:04:44.927486+0000","last_unstale":"2023-10-07T09:04:44.927840+0000","last_undegraded":"2023-10-07T09:04:44.927840+0000","last_fullsized":"2023-10-07T09:04:44.927840+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:19.278202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515864+0000","last_change":"2023-10-07T09:04:44.517264+0000","last_active":"2023-10-07T09:04:45.515864+0000","last_peered":"2023-10-07T09:04:45.515864+0000","last_clean":"2023-10-07T09:04:45.515864+0000","last_became_active":"2023-10-07T09:04:44.516960+0000","last_became_peered":"2023-10-07T09:04:44.516960+0000","last_unstale":"2023-10-07T09:04:45.515864+0000","last_undegraded":"2023-10-07T09:04:45.515864+0000","last_fullsized":"2023-10-07T09:04:45.515864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:30.944816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938036+0000","last_change":"2023-10-07T09:04:44.938036+0000","last_active":"2023-10-07T09:04:44.938036+0000","last_peered":"2023-10-07T09:04:44.938036+0000","last_clean":"2023-10-07T09:04:44.938036+0000","last_became_active":"2023-10-07T09:04:44.937746+0000","last_became_peered":"2023-10-07T09:04:44.937746+0000","last_unstale":"2023-10-07T09:04:44.938036+0000","last_undegraded":"2023-10-07T09:04:44.938036+0000","last_fullsized":"2023-10-07T09:04:44.938036+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:18.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.518192+0000","last_change":"2023-10-07T09:04:44.515795+0000","last_active":"2023-10-07T09:04:44.518192+0000","last_peered":"2023-10-07T09:04:44.518192+0000","last_clean":"2023-10-07T09:04:44.518192+0000","last_became_active":"2023-10-07T09:04:44.515535+0000","last_became_peered":"2023-10-07T09:04:44.515535+0000","last_unstale":"2023-10-07T09:04:44.518192+0000","last_undegraded":"2023-10-07T09:04:44.518192+0000","last_fullsized":"2023-10-07T09:04:44.518192+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:12.995059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932728+0000","last_change":"2023-10-07T09:04:44.932728+0000","last_active":"2023-10-07T09:04:44.932728+0000","last_peered":"2023-10-07T09:04:44.932728+0000","last_clean":"2023-10-07T09:04:44.932728+0000","last_became_active":"2023-10-07T09:04:44.931417+0000","last_became_peered":"2023-10-07T09:04:44.931417+0000","last_unstale":"2023-10-07T09:04:44.932728+0000","last_undegraded":"2023-10-07T09:04:44.932728+0000","last_fullsized":"2023-10-07T09:04:44.932728+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:32.433194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.525308+0000","last_change":"2023-10-07T09:04:44.519126+0000","last_active":"2023-10-07T09:04:44.525308+0000","last_peered":"2023-10-07T09:04:44.525308+0000","last_clean":"2023-10-07T09:04:44.525308+0000","last_became_active":"2023-10-07T09:04:44.517756+0000","last_became_peered":"2023-10-07T09:04:44.517756+0000","last_unstale":"2023-10-07T09:04:44.525308+0000","last_undegraded":"2023-10-07T09:04:44.525308+0000","last_fullsized":"2023-10-07T09:04:44.525308+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:23.523197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939253+0000","last_change":"2023-10-07T09:04:44.939253+0000","last_active":"2023-10-07T09:04:44.939253+0000","last_peered":"2023-10-07T09:04:44.939253+0000","last_clean":"2023-10-07T09:04:44.939253+0000","last_became_active":"2023-10-07T09:04:44.938932+0000","last_became_peered":"2023-10-07T09:04:44.938932+0000","last_unstale":"2023-10-07T09:04:44.939253+0000","last_undegraded":"2023-10-07T09:04:44.939253+0000","last_fullsized":"2023-10-07T09:04:44.939253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:58:01.298657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526405+0000","last_change":"2023-10-07T09:04:44.524560+0000","last_active":"2023-10-07T09:04:44.526405+0000","last_peered":"2023-10-07T09:04:44.526405+0000","last_clean":"2023-10-07T09:04:44.526405+0000","last_became_active":"2023-10-07T09:04:44.524225+0000","last_became_peered":"2023-10-07T09:04:44.524225+0000","last_unstale":"2023-10-07T09:04:44.526405+0000","last_undegraded":"2023-10-07T09:04:44.526405+0000","last_fullsized":"2023-10-07T09:04:44.526405+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:26.901306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941772+0000","last_change":"2023-10-07T09:04:44.941772+0000","last_active":"2023-10-07T09:04:44.941772+0000","last_peered":"2023-10-07T09:04:44.941772+0000","last_clean":"2023-10-07T09:04:44.941772+0000","last_became_active":"2023-10-07T09:04:44.941467+0000","last_became_peered":"2023-10-07T09:04:44.941467+0000","last_unstale":"2023-10-07T09:04:44.941772+0000","last_undegraded":"2023-10-07T09:04:44.941772+0000","last_fullsized":"2023-10-07T09:04:44.941772+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515259+0000","last_change":"2023-10-07T09:04:44.525096+0000","last_active":"2023-10-07T09:04:45.515259+0000","last_peered":"2023-10-07T09:04:45.515259+0000","last_clean":"2023-10-07T09:04:45.515259+0000","last_became_active":"2023-10-07T09:04:44.524818+0000","last_became_peered":"2023-10-07T09:04:44.524818+0000","last_unstale":"2023-10-07T09:04:45.515259+0000","last_undegraded":"2023-10-07T09:04:45.515259+0000","last_fullsized":"2023-10-07T09:04:45.515259+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:11.023081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941908+0000","last_change":"2023-10-07T09:04:44.941908+0000","last_active":"2023-10-07T09:04:44.941908+0000","last_peered":"2023-10-07T09:04:44.941908+0000","last_clean":"2023-10-07T09:04:44.941908+0000","last_became_active":"2023-10-07T09:04:44.940681+0000","last_became_peered":"2023-10-07T09:04:44.940681+0000","last_unstale":"2023-10-07T09:04:44.941908+0000","last_undegraded":"2023-10-07T09:04:44.941908+0000","last_fullsized":"2023-10-07T09:04:44.941908+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:03.409518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522422+0000","last_change":"2023-10-07T09:04:44.520323+0000","last_active":"2023-10-07T09:04:44.522422+0000","last_peered":"2023-10-07T09:04:44.522422+0000","last_clean":"2023-10-07T09:04:44.522422+0000","last_became_active":"2023-10-07T09:04:44.520035+0000","last_became_peered":"2023-10-07T09:04:44.520035+0000","last_unstale":"2023-10-07T09:04:44.522422+0000","last_undegraded":"2023-10-07T09:04:44.522422+0000","last_fullsized":"2023-10-07T09:04:44.522422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:09:58.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939963+0000","last_change":"2023-10-07T09:04:44.939963+0000","last_active":"2023-10-07T09:04:44.939963+0000","last_peered":"2023-10-07T09:04:44.939963+0000","last_clean":"2023-10-07T09:04:44.939963+0000","last_became_active":"2023-10-07T09:04:44.935779+0000","last_became_peered":"2023-10-07T09:04:44.935779+0000","last_unstale":"2023-10-07T09:04:44.939963+0000","last_undegraded":"2023-10-07T09:04:44.939963+0000","last_fullsized":"2023-10-07T09:04:44.939963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:42.146368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526439+0000","last_change":"2023-10-07T09:04:44.525009+0000","last_active":"2023-10-07T09:04:44.526439+0000","last_peered":"2023-10-07T09:04:44.526439+0000","last_clean":"2023-10-07T09:04:44.526439+0000","last_became_active":"2023-10-07T09:04:44.524162+0000","last_became_peered":"2023-10-07T09:04:44.524162+0000","last_unstale":"2023-10-07T09:04:44.526439+0000","last_undegraded":"2023-10-07T09:04:44.526439+0000","last_fullsized":"2023-10-07T09:04:44.526439+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:31.428612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941380+0000","last_change":"2023-10-07T09:04:44.941380+0000","last_active":"2023-10-07T09:04:44.941380+0000","last_peered":"2023-10-07T09:04:44.941380+0000","last_clean":"2023-10-07T09:04:44.941380+0000","last_became_active":"2023-10-07T09:04:44.941106+0000","last_became_peered":"2023-10-07T09:04:44.941106+0000","last_unstale":"2023-10-07T09:04:44.941380+0000","last_undegraded":"2023-10-07T09:04:44.941380+0000","last_fullsized":"2023-10-07T09:04:44.941380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:09:03.894133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526048+0000","last_change":"2023-10-07T09:04:44.522441+0000","last_active":"2023-10-07T09:04:44.526048+0000","last_peered":"2023-10-07T09:04:44.526048+0000","last_clean":"2023-10-07T09:04:44.526048+0000","last_became_active":"2023-10-07T09:04:44.522179+0000","last_became_peered":"2023-10-07T09:04:44.522179+0000","last_unstale":"2023-10-07T09:04:44.526048+0000","last_undegraded":"2023-10-07T09:04:44.526048+0000","last_fullsized":"2023-10-07T09:04:44.526048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:15:24.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941732+0000","last_change":"2023-10-07T09:04:44.941732+0000","last_active":"2023-10-07T09:04:44.941732+0000","last_peered":"2023-10-07T09:04:44.941732+0000","last_clean":"2023-10-07T09:04:44.941732+0000","last_became_active":"2023-10-07T09:04:44.941459+0000","last_became_peered":"2023-10-07T09:04:44.941459+0000","last_unstale":"2023-10-07T09:04:44.941732+0000","last_undegraded":"2023-10-07T09:04:44.941732+0000","last_fullsized":"2023-10-07T09:04:44.941732+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:05.549836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522424+0000","last_change":"2023-10-07T09:04:44.518909+0000","last_active":"2023-10-07T09:04:44.522424+0000","last_peered":"2023-10-07T09:04:44.522424+0000","last_clean":"2023-10-07T09:04:44.522424+0000","last_became_active":"2023-10-07T09:04:44.518597+0000","last_became_peered":"2023-10-07T09:04:44.518597+0000","last_unstale":"2023-10-07T09:04:44.522424+0000","last_undegraded":"2023-10-07T09:04:44.522424+0000","last_fullsized":"2023-10-07T09:04:44.522424+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:01:29.907375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929339+0000","last_change":"2023-10-07T09:04:44.929339+0000","last_active":"2023-10-07T09:04:44.929339+0000","last_peered":"2023-10-07T09:04:44.929339+0000","last_clean":"2023-10-07T09:04:44.929339+0000","last_became_active":"2023-10-07T09:04:44.927662+0000","last_became_peered":"2023-10-07T09:04:44.927662+0000","last_unstale":"2023-10-07T09:04:44.929339+0000","last_undegraded":"2023-10-07T09:04:44.929339+0000","last_fullsized":"2023-10-07T09:04:44.929339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:38.574836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527209+0000","last_change":"2023-10-07T09:04:44.523780+0000","last_active":"2023-10-07T09:04:44.527209+0000","last_peered":"2023-10-07T09:04:44.527209+0000","last_clean":"2023-10-07T09:04:44.527209+0000","last_became_active":"2023-10-07T09:04:44.523552+0000","last_became_peered":"2023-10-07T09:04:44.523552+0000","last_unstale":"2023-10-07T09:04:44.527209+0000","last_undegraded":"2023-10-07T09:04:44.527209+0000","last_fullsized":"2023-10-07T09:04:44.527209+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:17:49.256159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932199+0000","last_change":"2023-10-07T09:04:44.932199+0000","last_active":"2023-10-07T09:04:44.932199+0000","last_peered":"2023-10-07T09:04:44.932199+0000","last_clean":"2023-10-07T09:04:44.932199+0000","last_became_active":"2023-10-07T09:04:44.931083+0000","last_became_peered":"2023-10-07T09:04:44.931083+0000","last_unstale":"2023-10-07T09:04:44.932199+0000","last_undegraded":"2023-10-07T09:04:44.932199+0000","last_fullsized":"2023-10-07T09:04:44.932199+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:07.219179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.523708+0000","last_change":"2023-10-07T09:04:44.519856+0000","last_active":"2023-10-07T09:04:44.523708+0000","last_peered":"2023-10-07T09:04:44.523708+0000","last_clean":"2023-10-07T09:04:44.523708+0000","last_became_active":"2023-10-07T09:04:44.519411+0000","last_became_peered":"2023-10-07T09:04:44.519411+0000","last_unstale":"2023-10-07T09:04:44.523708+0000","last_undegraded":"2023-10-07T09:04:44.523708+0000","last_fullsized":"2023-10-07T09:04:44.523708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:30.944816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935185+0000","last_change":"2023-10-07T09:04:44.935185+0000","last_active":"2023-10-07T09:04:44.935185+0000","last_peered":"2023-10-07T09:04:44.935185+0000","last_clean":"2023-10-07T09:04:44.935185+0000","last_became_active":"2023-10-07T09:04:44.934924+0000","last_became_peered":"2023-10-07T09:04:44.934924+0000","last_unstale":"2023-10-07T09:04:44.935185+0000","last_undegraded":"2023-10-07T09:04:44.935185+0000","last_fullsized":"2023-10-07T09:04:44.935185+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:12.098291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527038+0000","last_change":"2023-10-07T09:04:44.525908+0000","last_active":"2023-10-07T09:04:44.527038+0000","last_peered":"2023-10-07T09:04:44.527038+0000","last_clean":"2023-10-07T09:04:44.527038+0000","last_became_active":"2023-10-07T09:04:44.525600+0000","last_became_peered":"2023-10-07T09:04:44.525600+0000","last_unstale":"2023-10-07T09:04:44.527038+0000","last_undegraded":"2023-10-07T09:04:44.527038+0000","last_fullsized":"2023-10-07T09:04:44.527038+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:18.273620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933984+0000","last_change":"2023-10-07T09:04:44.933984+0000","last_active":"2023-10-07T09:04:44.933984+0000","last_peered":"2023-10-07T09:04:44.933984+0000","last_clean":"2023-10-07T09:04:44.933984+0000","last_became_active":"2023-10-07T09:04:44.933738+0000","last_became_peered":"2023-10-07T09:04:44.933738+0000","last_unstale":"2023-10-07T09:04:44.933984+0000","last_undegraded":"2023-10-07T09:04:44.933984+0000","last_fullsized":"2023-10-07T09:04:44.933984+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:32.755065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.524807+0000","last_change":"2023-10-07T09:04:44.520414+0000","last_active":"2023-10-07T09:04:44.524807+0000","last_peered":"2023-10-07T09:04:44.524807+0000","last_clean":"2023-10-07T09:04:44.524807+0000","last_became_active":"2023-10-07T09:04:44.520103+0000","last_became_peered":"2023-10-07T09:04:44.520103+0000","last_unstale":"2023-10-07T09:04:44.524807+0000","last_undegraded":"2023-10-07T09:04:44.524807+0000","last_fullsized":"2023-10-07T09:04:44.524807+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:36.764315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.514063+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:04:44.514063+0000","last_peered":"2023-10-07T09:04:44.514063+0000","last_clean":"2023-10-07T09:04:44.514063+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:04:44.514063+0000","last_undegraded":"2023-10-07T09:04:44.514063+0000","last_fullsized":"2023-10-07T09:04:44.514063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1132281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.505}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.441}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.38600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298520,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073320,"statfs":{"total":96636764160,"available":96331079680,"internally_reserved":0,"allocated":1261568,"data_stored":541395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.624}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":541449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.63},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":1.3859999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.68300000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.78900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":0.81799999999999995,"15min":11.32},"last":0.433}]},{"osd":3,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.81100000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.79300000000000004,"15min":11.880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":0.69099999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.72299999999999998},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":4.4850000000000003},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.80800000000000005},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.90000000000000002,"15min":5.3540000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.63400000000000001,"15min":0.82699999999999996},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":5.3920000000000003},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":4.5209999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1133341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47799999999999998,"5min":0.501,"15min":0.54500000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.29399999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.58999999999999997,"15min":0.61199999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.38900000000000001},"min":{"1min":0.252,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.56699999999999995,"15min":0.625},"last":0.35999999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.35399999999999998},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.57899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.91700000000000004,"15min":0.95399999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0249999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.89300000000000002,"15min":1},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.66000000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":1.006},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.68000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":1.0389999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":541325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.31900000000000001,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":10.214},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.308}]},{"osd":1,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.60099999999999998,"15min":0.755},"last":0.252},{"interface":"front","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.67800000000000005},"min":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":10.144},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.73599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.628,"5min":0.755,"15min":10.071},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.752},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":10.183},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.93500000000000005,"15min":1.1579999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.87,"15min":1.0549999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":1.181},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":20.922000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.96399999999999997,"15min":1.0880000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.624,"15min":1.232},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75,"5min":0.97199999999999998,"15min":20.963999999999999},"last":0.754}]},{"osd":7,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.628},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":542931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.374},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":541325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.84699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":9.7040000000000006},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.73599999999999999},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":3.024,"15min":5.6319999999999997},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":9.8620000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.93700000000000006},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.976,"15min":9.8439999999999994},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.90500000000000003},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.93400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.78000000000000003,"15min":10.01},"last":0.61799999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":5.569},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":0.751,"15min":10.131},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46899999999999997,"15min":0.51400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.83599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.5,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.82199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85499999999999998},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":541901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.76700000000000002,"15min":0.81200000000000006},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.65700000000000003,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.7799999999999994,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.3970000000000002,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.61699999999999999,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.5650000000000004,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92900000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50600000000000001,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.67100000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.42199999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.29799999999999999},"max":{"1min":0.95999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.374},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:04:49.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:04:49.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 Processor -- start 2023-10-07T09:04:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 -- start start 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 0x7f5d940cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d94069bb0 0x7f5d940b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940cfb30 con 0x7f5d940cba70 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.775+0000 7f5d99e66700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940cbf10 con 0x7f5d94069bb0 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d99e66700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940cf4e0 con 0x7f5d94159840 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d94069bb0 0x7f5d940b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d92ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5d940cba70 0x7f5d940694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38858/0 (socket says 172.21.15.46:38858) 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d92ffd700 1 -- 172.21.15.46:0/3053726294 learned_addr learned my addr 172.21.15.46:0/3053726294 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 -- 172.21.15.46:0/3053726294 >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 msgr2=0x7f5d940cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d937fe700 1 --2- 172.21.15.46:0/3053726294 >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 0x7f5d940cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d927fc700 1 -- 172.21.15.46:0/3053726294 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112769510 0 0) 0x7f5d940cfb30 con 0x7f5d940cba70 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 --2- 172.21.15.46:0/3053726294 >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 0x7f5d940cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 -- 172.21.15.46:0/3053726294 >> v1:172.21.15.46:6789/0 conn(0x7f5d940cba70 legacy=0x7f5d940694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 -- 172.21.15.46:0/3053726294 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940cf7c0 con 0x7f5d94069bb0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d937fe700 1 --2- 172.21.15.46:0/3053726294 >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 0x7f5d940cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d93fff700 1 --2- 172.21.15.46:0/3053726294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d94069bb0 0x7f5d940b05e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098e0 tx=0x7f5d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf8c2bfcb9201e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d927fc700 1 -- 172.21.15.46:0/3053726294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c009e80 con 0x7f5d94069bb0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d927fc700 1 -- 172.21.15.46:0/3053726294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c00b820 con 0x7f5d94069bb0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.776+0000 7f5d927fc700 1 -- 172.21.15.46:0/3053726294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00bba0 con 0x7f5d94069bb0 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 -- 172.21.15.46:0/3053726294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d94069bb0 msgr2=0x7f5d940b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 --2- 172.21.15.46:0/3053726294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d94069bb0 0x7f5d940b05e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098e0 tx=0x7f5d8c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 -- 172.21.15.46:0/3053726294 shutdown_connections 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 --2- 172.21.15.46:0/3053726294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d94069bb0 0x7f5d940b05e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 --2- 172.21.15.46:0/3053726294 >> v2:172.21.15.133:3300/0 conn(0x7f5d94159840 0x7f5d940cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 -- 172.21.15.46:0/3053726294 >> 172.21.15.46:0/3053726294 conn(0x7f5d94068e10 msgr2=0x7f5d940d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 -- 172.21.15.46:0/3053726294 shutdown_connections 2023-10-07T09:04:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.777+0000 7f5d99e66700 1 -- 172.21.15.46:0/3053726294 wait complete. 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.778+0000 7f5d99e66700 1 Processor -- start 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.778+0000 7f5d99e66700 1 -- start start 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d94069bb0 0x7f5d94157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 0x7f5d94154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c94a0 con 0x7f5d940cba70 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c9780 con 0x7f5d94159840 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d99e66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415d5c0 con 0x7f5d94069bb0 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32798/0 (socket says 172.21.15.46:32798) 2023-10-07T09:04:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 -- 172.21.15.46:0/2161439711 learned_addr learned my addr 172.21.15.46:0/2161439711 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d937fe700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d94069bb0 0x7f5d94157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d93fff700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 0x7f5d94154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 -- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d94069bb0 msgr2=0x7f5d94157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d94069bb0 0x7f5d94157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 -- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 msgr2=0x7f5d94154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 0x7f5d94154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d92ffd700 1 -- 172.21.15.46:0/2161439711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009420 con 0x7f5d940cba70 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.779+0000 7f5d93fff700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 0x7f5d94154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d92ffd700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c7e0 tx=0x7f5d7c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c005b30 con 0x7f5d940cba70 2023-10-07T09:04:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c005c90 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9415d8a0 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c007300 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.780+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d941581d0 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.781+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d941583f0 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.781+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5d7c0076b0 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.782+0000 7f5d8b7fe700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 0x7f5d74069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.782+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d7c083fe0 con 0x7f5d940cba70 2023-10-07T09:04:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.782+0000 7f5d937fe700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 0x7f5d74069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.782+0000 7f5d937fe700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 0x7f5d74069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400f600 tx=0x7f5d840077b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.786+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d7c050e40 con 0x7f5d940cba70 2023-10-07T09:04:49.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.976+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d9415ddc0 con 0x7f5d74067290 2023-10-07T09:04:49.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.985+0000 7f5d8b7fe700 1 -- 172.21.15.46:0/2161439711 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289614 (secure 0 0 0) 0x7f5d9415ddc0 con 0x7f5d74067290 2023-10-07T09:04:49.990 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:49.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 msgr2=0x7f5d74069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 0x7f5d74069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400f600 tx=0x7f5d840077b0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 msgr2=0x7f5d940b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c7e0 tx=0x7f5d7c007df0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 shutdown_connections 2023-10-07T09:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5d74067290 0x7f5d74069740 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d94159840 0x7f5d94154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5d94069bb0 0x7f5d94157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 --2- 172.21.15.46:0/2161439711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d940cba70 0x7f5d940b4960 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 >> 172.21.15.46:0/2161439711 conn(0x7f5d94068e10 msgr2=0x7f5d940704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 shutdown_connections 2023-10-07T09:04:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:49.988+0000 7f5d99e66700 1 -- 172.21.15.46:0/2161439711 wait complete. 2023-10-07T09:04:49.996 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:04:50.002 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2023-10-07T09:04:49.853070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409832,"kb_used_data":11048,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752564888,"statfs":{"total":773094113280,"available":770626445312,"internally_reserved":0,"allocated":11313152,"data_stored":5515948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001286"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941645+0000","last_change":"2023-10-07T09:04:44.941645+0000","last_active":"2023-10-07T09:04:44.941645+0000","last_peered":"2023-10-07T09:04:44.941645+0000","last_clean":"2023-10-07T09:04:44.941645+0000","last_became_active":"2023-10-07T09:04:44.940401+0000","last_became_peered":"2023-10-07T09:04:44.940401+0000","last_unstale":"2023-10-07T09:04:44.941645+0000","last_undegraded":"2023-10-07T09:04:44.941645+0000","last_fullsized":"2023-10-07T09:04:44.941645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:10.626048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926672+0000","last_change":"2023-10-07T09:04:44.926672+0000","last_active":"2023-10-07T09:04:44.926672+0000","last_peered":"2023-10-07T09:04:44.926672+0000","last_clean":"2023-10-07T09:04:44.926672+0000","last_became_active":"2023-10-07T09:04:44.926422+0000","last_became_peered":"2023-10-07T09:04:44.926422+0000","last_unstale":"2023-10-07T09:04:44.926672+0000","last_undegraded":"2023-10-07T09:04:44.926672+0000","last_fullsized":"2023-10-07T09:04:44.926672+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:13:26.971188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.927875+0000","last_change":"2023-10-07T09:04:44.927875+0000","last_active":"2023-10-07T09:04:44.927875+0000","last_peered":"2023-10-07T09:04:44.927875+0000","last_clean":"2023-10-07T09:04:44.927875+0000","last_became_active":"2023-10-07T09:04:44.927600+0000","last_became_peered":"2023-10-07T09:04:44.927600+0000","last_unstale":"2023-10-07T09:04:44.927875+0000","last_undegraded":"2023-10-07T09:04:44.927875+0000","last_fullsized":"2023-10-07T09:04:44.927875+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:08.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941754+0000","last_change":"2023-10-07T09:04:44.941754+0000","last_active":"2023-10-07T09:04:44.941754+0000","last_peered":"2023-10-07T09:04:44.941754+0000","last_clean":"2023-10-07T09:04:44.941754+0000","last_became_active":"2023-10-07T09:04:44.939587+0000","last_became_peered":"2023-10-07T09:04:44.939587+0000","last_unstale":"2023-10-07T09:04:44.941754+0000","last_undegraded":"2023-10-07T09:04:44.941754+0000","last_fullsized":"2023-10-07T09:04:44.941754+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:58:35.843243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933149+0000","last_change":"2023-10-07T09:04:44.933149+0000","last_active":"2023-10-07T09:04:44.933149+0000","last_peered":"2023-10-07T09:04:44.933149+0000","last_clean":"2023-10-07T09:04:44.933149+0000","last_became_active":"2023-10-07T09:04:44.932836+0000","last_became_peered":"2023-10-07T09:04:44.932836+0000","last_unstale":"2023-10-07T09:04:44.933149+0000","last_undegraded":"2023-10-07T09:04:44.933149+0000","last_fullsized":"2023-10-07T09:04:44.933149+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:59.771526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933386+0000","last_change":"2023-10-07T09:04:44.933386+0000","last_active":"2023-10-07T09:04:44.933386+0000","last_peered":"2023-10-07T09:04:44.933386+0000","last_clean":"2023-10-07T09:04:44.933386+0000","last_became_active":"2023-10-07T09:04:44.933089+0000","last_became_peered":"2023-10-07T09:04:44.933089+0000","last_unstale":"2023-10-07T09:04:44.933386+0000","last_undegraded":"2023-10-07T09:04:44.933386+0000","last_fullsized":"2023-10-07T09:04:44.933386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:59.280515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938994+0000","last_change":"2023-10-07T09:04:44.938994+0000","last_active":"2023-10-07T09:04:44.938994+0000","last_peered":"2023-10-07T09:04:44.938994+0000","last_clean":"2023-10-07T09:04:44.938994+0000","last_became_active":"2023-10-07T09:04:44.938708+0000","last_became_peered":"2023-10-07T09:04:44.938708+0000","last_unstale":"2023-10-07T09:04:44.938994+0000","last_undegraded":"2023-10-07T09:04:44.938994+0000","last_fullsized":"2023-10-07T09:04:44.938994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:51.615965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926738+0000","last_change":"2023-10-07T09:04:44.926738+0000","last_active":"2023-10-07T09:04:44.926738+0000","last_peered":"2023-10-07T09:04:44.926738+0000","last_clean":"2023-10-07T09:04:44.926738+0000","last_became_active":"2023-10-07T09:04:44.926457+0000","last_became_peered":"2023-10-07T09:04:44.926457+0000","last_unstale":"2023-10-07T09:04:44.926738+0000","last_undegraded":"2023-10-07T09:04:44.926738+0000","last_fullsized":"2023-10-07T09:04:44.926738+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:20.785301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942530+0000","last_change":"2023-10-07T09:04:44.942530+0000","last_active":"2023-10-07T09:04:44.942530+0000","last_peered":"2023-10-07T09:04:44.942530+0000","last_clean":"2023-10-07T09:04:44.942530+0000","last_became_active":"2023-10-07T09:04:44.941561+0000","last_became_peered":"2023-10-07T09:04:44.941561+0000","last_unstale":"2023-10-07T09:04:44.942530+0000","last_undegraded":"2023-10-07T09:04:44.942530+0000","last_fullsized":"2023-10-07T09:04:44.942530+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.556879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938648+0000","last_change":"2023-10-07T09:04:44.938648+0000","last_active":"2023-10-07T09:04:44.938648+0000","last_peered":"2023-10-07T09:04:44.938648+0000","last_clean":"2023-10-07T09:04:44.938648+0000","last_became_active":"2023-10-07T09:04:44.938079+0000","last_became_peered":"2023-10-07T09:04:44.938079+0000","last_unstale":"2023-10-07T09:04:44.938648+0000","last_undegraded":"2023-10-07T09:04:44.938648+0000","last_fullsized":"2023-10-07T09:04:44.938648+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:57.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935853+0000","last_change":"2023-10-07T09:04:44.935853+0000","last_active":"2023-10-07T09:04:44.935853+0000","last_peered":"2023-10-07T09:04:44.935853+0000","last_clean":"2023-10-07T09:04:44.935853+0000","last_became_active":"2023-10-07T09:04:44.935580+0000","last_became_peered":"2023-10-07T09:04:44.935580+0000","last_unstale":"2023-10-07T09:04:44.935853+0000","last_undegraded":"2023-10-07T09:04:44.935853+0000","last_fullsized":"2023-10-07T09:04:44.935853+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:53.855444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938162+0000","last_change":"2023-10-07T09:04:44.938162+0000","last_active":"2023-10-07T09:04:44.938162+0000","last_peered":"2023-10-07T09:04:44.938162+0000","last_clean":"2023-10-07T09:04:44.938162+0000","last_became_active":"2023-10-07T09:04:44.935582+0000","last_became_peered":"2023-10-07T09:04:44.935582+0000","last_unstale":"2023-10-07T09:04:44.938162+0000","last_undegraded":"2023-10-07T09:04:44.938162+0000","last_fullsized":"2023-10-07T09:04:44.938162+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:52:15.845535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929958+0000","last_change":"2023-10-07T09:04:44.929958+0000","last_active":"2023-10-07T09:04:44.929958+0000","last_peered":"2023-10-07T09:04:44.929958+0000","last_clean":"2023-10-07T09:04:44.929958+0000","last_became_active":"2023-10-07T09:04:44.928804+0000","last_became_peered":"2023-10-07T09:04:44.928804+0000","last_unstale":"2023-10-07T09:04:44.929958+0000","last_undegraded":"2023-10-07T09:04:44.929958+0000","last_fullsized":"2023-10-07T09:04:44.929958+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:04.493085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936475+0000","last_change":"2023-10-07T09:04:44.936475+0000","last_active":"2023-10-07T09:04:44.936475+0000","last_peered":"2023-10-07T09:04:44.936475+0000","last_clean":"2023-10-07T09:04:44.936475+0000","last_became_active":"2023-10-07T09:04:44.936190+0000","last_became_peered":"2023-10-07T09:04:44.936190+0000","last_unstale":"2023-10-07T09:04:44.936475+0000","last_undegraded":"2023-10-07T09:04:44.936475+0000","last_fullsized":"2023-10-07T09:04:44.936475+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:27.905888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932770+0000","last_change":"2023-10-07T09:04:44.932770+0000","last_active":"2023-10-07T09:04:44.932770+0000","last_peered":"2023-10-07T09:04:44.932770+0000","last_clean":"2023-10-07T09:04:44.932770+0000","last_became_active":"2023-10-07T09:04:44.932558+0000","last_became_peered":"2023-10-07T09:04:44.932558+0000","last_unstale":"2023-10-07T09:04:44.932770+0000","last_undegraded":"2023-10-07T09:04:44.932770+0000","last_fullsized":"2023-10-07T09:04:44.932770+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:26.734549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938749+0000","last_change":"2023-10-07T09:04:44.938749+0000","last_active":"2023-10-07T09:04:44.938749+0000","last_peered":"2023-10-07T09:04:44.938749+0000","last_clean":"2023-10-07T09:04:44.938749+0000","last_became_active":"2023-10-07T09:04:44.938169+0000","last_became_peered":"2023-10-07T09:04:44.938169+0000","last_unstale":"2023-10-07T09:04:44.938749+0000","last_undegraded":"2023-10-07T09:04:44.938749+0000","last_fullsized":"2023-10-07T09:04:44.938749+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:05.856465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936065+0000","last_change":"2023-10-07T09:04:44.936065+0000","last_active":"2023-10-07T09:04:44.936065+0000","last_peered":"2023-10-07T09:04:44.936065+0000","last_clean":"2023-10-07T09:04:44.936065+0000","last_became_active":"2023-10-07T09:04:44.935795+0000","last_became_peered":"2023-10-07T09:04:44.935795+0000","last_unstale":"2023-10-07T09:04:44.936065+0000","last_undegraded":"2023-10-07T09:04:44.936065+0000","last_fullsized":"2023-10-07T09:04:44.936065+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938922+0000","last_change":"2023-10-07T09:04:44.938922+0000","last_active":"2023-10-07T09:04:44.938922+0000","last_peered":"2023-10-07T09:04:44.938922+0000","last_clean":"2023-10-07T09:04:44.938922+0000","last_became_active":"2023-10-07T09:04:44.938501+0000","last_became_peered":"2023-10-07T09:04:44.938501+0000","last_unstale":"2023-10-07T09:04:44.938922+0000","last_undegraded":"2023-10-07T09:04:44.938922+0000","last_fullsized":"2023-10-07T09:04:44.938922+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:13:26.971188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930730+0000","last_change":"2023-10-07T09:04:44.930730+0000","last_active":"2023-10-07T09:04:44.930730+0000","last_peered":"2023-10-07T09:04:44.930730+0000","last_clean":"2023-10-07T09:04:44.930730+0000","last_became_active":"2023-10-07T09:04:44.930435+0000","last_became_peered":"2023-10-07T09:04:44.930435+0000","last_unstale":"2023-10-07T09:04:44.930730+0000","last_undegraded":"2023-10-07T09:04:44.930730+0000","last_fullsized":"2023-10-07T09:04:44.930730+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:26:56.240282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930762+0000","last_change":"2023-10-07T09:04:44.930762+0000","last_active":"2023-10-07T09:04:44.930762+0000","last_peered":"2023-10-07T09:04:44.930762+0000","last_clean":"2023-10-07T09:04:44.930762+0000","last_became_active":"2023-10-07T09:04:44.930490+0000","last_became_peered":"2023-10-07T09:04:44.930490+0000","last_unstale":"2023-10-07T09:04:44.930762+0000","last_undegraded":"2023-10-07T09:04:44.930762+0000","last_fullsized":"2023-10-07T09:04:44.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:42.459267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933211+0000","last_change":"2023-10-07T09:04:44.933211+0000","last_active":"2023-10-07T09:04:44.933211+0000","last_peered":"2023-10-07T09:04:44.933211+0000","last_clean":"2023-10-07T09:04:44.933211+0000","last_became_active":"2023-10-07T09:04:44.932551+0000","last_became_peered":"2023-10-07T09:04:44.932551+0000","last_unstale":"2023-10-07T09:04:44.933211+0000","last_undegraded":"2023-10-07T09:04:44.933211+0000","last_fullsized":"2023-10-07T09:04:44.933211+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.955003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938315+0000","last_change":"2023-10-07T09:04:44.938315+0000","last_active":"2023-10-07T09:04:44.938315+0000","last_peered":"2023-10-07T09:04:44.938315+0000","last_clean":"2023-10-07T09:04:44.938315+0000","last_became_active":"2023-10-07T09:04:44.937987+0000","last_became_peered":"2023-10-07T09:04:44.937987+0000","last_unstale":"2023-10-07T09:04:44.938315+0000","last_undegraded":"2023-10-07T09:04:44.938315+0000","last_fullsized":"2023-10-07T09:04:44.938315+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:42.151284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.931778+0000","last_change":"2023-10-07T09:04:44.931778+0000","last_active":"2023-10-07T09:04:44.931778+0000","last_peered":"2023-10-07T09:04:44.931778+0000","last_clean":"2023-10-07T09:04:44.931778+0000","last_became_active":"2023-10-07T09:04:44.931508+0000","last_became_peered":"2023-10-07T09:04:44.931508+0000","last_unstale":"2023-10-07T09:04:44.931778+0000","last_undegraded":"2023-10-07T09:04:44.931778+0000","last_fullsized":"2023-10-07T09:04:44.931778+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:46:22.491688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933816+0000","last_change":"2023-10-07T09:04:44.933816+0000","last_active":"2023-10-07T09:04:44.933816+0000","last_peered":"2023-10-07T09:04:44.933816+0000","last_clean":"2023-10-07T09:04:44.933816+0000","last_became_active":"2023-10-07T09:04:44.933401+0000","last_became_peered":"2023-10-07T09:04:44.933401+0000","last_unstale":"2023-10-07T09:04:44.933816+0000","last_undegraded":"2023-10-07T09:04:44.933816+0000","last_fullsized":"2023-10-07T09:04:44.933816+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:44.379418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935913+0000","last_change":"2023-10-07T09:04:44.935913+0000","last_active":"2023-10-07T09:04:44.935913+0000","last_peered":"2023-10-07T09:04:44.935913+0000","last_clean":"2023-10-07T09:04:44.935913+0000","last_became_active":"2023-10-07T09:04:44.935621+0000","last_became_peered":"2023-10-07T09:04:44.935621+0000","last_unstale":"2023-10-07T09:04:44.935913+0000","last_undegraded":"2023-10-07T09:04:44.935913+0000","last_fullsized":"2023-10-07T09:04:44.935913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:48:53.873371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939104+0000","last_change":"2023-10-07T09:04:44.939104+0000","last_active":"2023-10-07T09:04:44.939104+0000","last_peered":"2023-10-07T09:04:44.939104+0000","last_clean":"2023-10-07T09:04:44.939104+0000","last_became_active":"2023-10-07T09:04:44.938865+0000","last_became_peered":"2023-10-07T09:04:44.938865+0000","last_unstale":"2023-10-07T09:04:44.939104+0000","last_undegraded":"2023-10-07T09:04:44.939104+0000","last_fullsized":"2023-10-07T09:04:44.939104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:23.534212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940727+0000","last_change":"2023-10-07T09:04:44.940727+0000","last_active":"2023-10-07T09:04:44.940727+0000","last_peered":"2023-10-07T09:04:44.940727+0000","last_clean":"2023-10-07T09:04:44.940727+0000","last_became_active":"2023-10-07T09:04:44.940452+0000","last_became_peered":"2023-10-07T09:04:44.940452+0000","last_unstale":"2023-10-07T09:04:44.940727+0000","last_undegraded":"2023-10-07T09:04:44.940727+0000","last_fullsized":"2023-10-07T09:04:44.940727+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:51.615965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940889+0000","last_change":"2023-10-07T09:04:44.940889+0000","last_active":"2023-10-07T09:04:44.940889+0000","last_peered":"2023-10-07T09:04:44.940889+0000","last_clean":"2023-10-07T09:04:44.940889+0000","last_became_active":"2023-10-07T09:04:44.940590+0000","last_became_peered":"2023-10-07T09:04:44.940590+0000","last_unstale":"2023-10-07T09:04:44.940889+0000","last_undegraded":"2023-10-07T09:04:44.940889+0000","last_fullsized":"2023-10-07T09:04:44.940889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:06:23.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930960+0000","last_change":"2023-10-07T09:04:44.930960+0000","last_active":"2023-10-07T09:04:44.930960+0000","last_peered":"2023-10-07T09:04:44.930960+0000","last_clean":"2023-10-07T09:04:44.930960+0000","last_became_active":"2023-10-07T09:04:44.930664+0000","last_became_peered":"2023-10-07T09:04:44.930664+0000","last_unstale":"2023-10-07T09:04:44.930960+0000","last_undegraded":"2023-10-07T09:04:44.930960+0000","last_fullsized":"2023-10-07T09:04:44.930960+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:45.054788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936481+0000","last_change":"2023-10-07T09:04:44.936481+0000","last_active":"2023-10-07T09:04:44.936481+0000","last_peered":"2023-10-07T09:04:44.936481+0000","last_clean":"2023-10-07T09:04:44.936481+0000","last_became_active":"2023-10-07T09:04:44.936174+0000","last_became_peered":"2023-10-07T09:04:44.936174+0000","last_unstale":"2023-10-07T09:04:44.936481+0000","last_undegraded":"2023-10-07T09:04:44.936481+0000","last_fullsized":"2023-10-07T09:04:44.936481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:49.344555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936865+0000","last_change":"2023-10-07T09:04:44.936865+0000","last_active":"2023-10-07T09:04:44.936865+0000","last_peered":"2023-10-07T09:04:44.936865+0000","last_clean":"2023-10-07T09:04:44.936865+0000","last_became_active":"2023-10-07T09:04:44.936601+0000","last_became_peered":"2023-10-07T09:04:44.936601+0000","last_unstale":"2023-10-07T09:04:44.936865+0000","last_undegraded":"2023-10-07T09:04:44.936865+0000","last_fullsized":"2023-10-07T09:04:44.936865+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:06.369310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936392+0000","last_change":"2023-10-07T09:04:44.936392+0000","last_active":"2023-10-07T09:04:44.936392+0000","last_peered":"2023-10-07T09:04:44.936392+0000","last_clean":"2023-10-07T09:04:44.936392+0000","last_became_active":"2023-10-07T09:04:44.936140+0000","last_became_peered":"2023-10-07T09:04:44.936140+0000","last_unstale":"2023-10-07T09:04:44.936392+0000","last_undegraded":"2023-10-07T09:04:44.936392+0000","last_fullsized":"2023-10-07T09:04:44.936392+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:59.131488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.925369+0000","last_change":"2023-10-07T09:04:44.925369+0000","last_active":"2023-10-07T09:04:44.925369+0000","last_peered":"2023-10-07T09:04:44.925369+0000","last_clean":"2023-10-07T09:04:44.925369+0000","last_became_active":"2023-10-07T09:04:44.925145+0000","last_became_peered":"2023-10-07T09:04:44.925145+0000","last_unstale":"2023-10-07T09:04:44.925369+0000","last_undegraded":"2023-10-07T09:04:44.925369+0000","last_fullsized":"2023-10-07T09:04:44.925369+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:12.181762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.516062+0000","last_change":"2023-10-07T09:04:44.518922+0000","last_active":"2023-10-07T09:04:45.516062+0000","last_peered":"2023-10-07T09:04:45.516062+0000","last_clean":"2023-10-07T09:04:45.516062+0000","last_became_active":"2023-10-07T09:04:44.518587+0000","last_became_peered":"2023-10-07T09:04:44.518587+0000","last_unstale":"2023-10-07T09:04:45.516062+0000","last_undegraded":"2023-10-07T09:04:45.516062+0000","last_fullsized":"2023-10-07T09:04:45.516062+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:40.688202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933669+0000","last_change":"2023-10-07T09:04:44.933669+0000","last_active":"2023-10-07T09:04:44.933669+0000","last_peered":"2023-10-07T09:04:44.933669+0000","last_clean":"2023-10-07T09:04:44.933669+0000","last_became_active":"2023-10-07T09:04:44.933406+0000","last_became_peered":"2023-10-07T09:04:44.933406+0000","last_unstale":"2023-10-07T09:04:44.933669+0000","last_undegraded":"2023-10-07T09:04:44.933669+0000","last_fullsized":"2023-10-07T09:04:44.933669+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:48:53.873371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.923331+0000","last_change":"2023-10-07T09:04:44.520637+0000","last_active":"2023-10-07T09:04:44.923331+0000","last_peered":"2023-10-07T09:04:44.923331+0000","last_clean":"2023-10-07T09:04:44.923331+0000","last_became_active":"2023-10-07T09:04:44.520343+0000","last_became_peered":"2023-10-07T09:04:44.520343+0000","last_unstale":"2023-10-07T09:04:44.923331+0000","last_undegraded":"2023-10-07T09:04:44.923331+0000","last_fullsized":"2023-10-07T09:04:44.923331+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:44.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936082+0000","last_change":"2023-10-07T09:04:44.936082+0000","last_active":"2023-10-07T09:04:44.936082+0000","last_peered":"2023-10-07T09:04:44.936082+0000","last_clean":"2023-10-07T09:04:44.936082+0000","last_became_active":"2023-10-07T09:04:44.935843+0000","last_became_peered":"2023-10-07T09:04:44.935843+0000","last_unstale":"2023-10-07T09:04:44.936082+0000","last_undegraded":"2023-10-07T09:04:44.936082+0000","last_fullsized":"2023-10-07T09:04:44.936082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:42:12.243771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515411+0000","last_change":"2023-10-07T09:04:44.517377+0000","last_active":"2023-10-07T09:04:45.515411+0000","last_peered":"2023-10-07T09:04:45.515411+0000","last_clean":"2023-10-07T09:04:45.515411+0000","last_became_active":"2023-10-07T09:04:44.517073+0000","last_became_peered":"2023-10-07T09:04:44.517073+0000","last_unstale":"2023-10-07T09:04:45.515411+0000","last_undegraded":"2023-10-07T09:04:45.515411+0000","last_fullsized":"2023-10-07T09:04:45.515411+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:25.407216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.930193+0000","last_change":"2023-10-07T09:04:44.930193+0000","last_active":"2023-10-07T09:04:44.930193+0000","last_peered":"2023-10-07T09:04:44.930193+0000","last_clean":"2023-10-07T09:04:44.930193+0000","last_became_active":"2023-10-07T09:04:44.929192+0000","last_became_peered":"2023-10-07T09:04:44.929192+0000","last_unstale":"2023-10-07T09:04:44.930193+0000","last_undegraded":"2023-10-07T09:04:44.930193+0000","last_fullsized":"2023-10-07T09:04:44.930193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:53.036907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515173+0000","last_change":"2023-10-07T09:04:44.518795+0000","last_active":"2023-10-07T09:04:45.515173+0000","last_peered":"2023-10-07T09:04:45.515173+0000","last_clean":"2023-10-07T09:04:45.515173+0000","last_became_active":"2023-10-07T09:04:44.517083+0000","last_became_peered":"2023-10-07T09:04:44.517083+0000","last_unstale":"2023-10-07T09:04:45.515173+0000","last_undegraded":"2023-10-07T09:04:45.515173+0000","last_fullsized":"2023-10-07T09:04:45.515173+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:43.508701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.934441+0000","last_change":"2023-10-07T09:04:44.934441+0000","last_active":"2023-10-07T09:04:44.934441+0000","last_peered":"2023-10-07T09:04:44.934441+0000","last_clean":"2023-10-07T09:04:44.934441+0000","last_became_active":"2023-10-07T09:04:44.934188+0000","last_became_peered":"2023-10-07T09:04:44.934188+0000","last_unstale":"2023-10-07T09:04:44.934441+0000","last_undegraded":"2023-10-07T09:04:44.934441+0000","last_fullsized":"2023-10-07T09:04:44.934441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:00.889344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929599+0000","last_change":"2023-10-07T09:04:44.522516+0000","last_active":"2023-10-07T09:04:44.929599+0000","last_peered":"2023-10-07T09:04:44.929599+0000","last_clean":"2023-10-07T09:04:44.929599+0000","last_became_active":"2023-10-07T09:04:44.522213+0000","last_became_peered":"2023-10-07T09:04:44.522213+0000","last_unstale":"2023-10-07T09:04:44.929599+0000","last_undegraded":"2023-10-07T09:04:44.929599+0000","last_fullsized":"2023-10-07T09:04:44.929599+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:20.800071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.928375+0000","last_change":"2023-10-07T09:04:44.928375+0000","last_active":"2023-10-07T09:04:44.928375+0000","last_peered":"2023-10-07T09:04:44.928375+0000","last_clean":"2023-10-07T09:04:44.928375+0000","last_became_active":"2023-10-07T09:04:44.927950+0000","last_became_peered":"2023-10-07T09:04:44.927950+0000","last_unstale":"2023-10-07T09:04:44.928375+0000","last_undegraded":"2023-10-07T09:04:44.928375+0000","last_fullsized":"2023-10-07T09:04:44.928375+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:53.891597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.926644+0000","last_change":"2023-10-07T09:04:44.519621+0000","last_active":"2023-10-07T09:04:44.926644+0000","last_peered":"2023-10-07T09:04:44.926644+0000","last_clean":"2023-10-07T09:04:44.926644+0000","last_became_active":"2023-10-07T09:04:44.519360+0000","last_became_peered":"2023-10-07T09:04:44.519360+0000","last_unstale":"2023-10-07T09:04:44.926644+0000","last_undegraded":"2023-10-07T09:04:44.926644+0000","last_fullsized":"2023-10-07T09:04:44.926644+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:00.086938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935191+0000","last_change":"2023-10-07T09:04:44.935191+0000","last_active":"2023-10-07T09:04:44.935191+0000","last_peered":"2023-10-07T09:04:44.935191+0000","last_clean":"2023-10-07T09:04:44.935191+0000","last_became_active":"2023-10-07T09:04:44.935020+0000","last_became_peered":"2023-10-07T09:04:44.935020+0000","last_unstale":"2023-10-07T09:04:44.935191+0000","last_undegraded":"2023-10-07T09:04:44.935191+0000","last_fullsized":"2023-10-07T09:04:44.935191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:03:00.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.519404+0000","last_change":"2023-10-07T09:04:44.517895+0000","last_active":"2023-10-07T09:04:44.519404+0000","last_peered":"2023-10-07T09:04:44.519404+0000","last_clean":"2023-10-07T09:04:44.519404+0000","last_became_active":"2023-10-07T09:04:44.517641+0000","last_became_peered":"2023-10-07T09:04:44.517641+0000","last_unstale":"2023-10-07T09:04:44.519404+0000","last_undegraded":"2023-10-07T09:04:44.519404+0000","last_fullsized":"2023-10-07T09:04:44.519404+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:20.800071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938864+0000","last_change":"2023-10-07T09:04:44.938864+0000","last_active":"2023-10-07T09:04:44.938864+0000","last_peered":"2023-10-07T09:04:44.938864+0000","last_clean":"2023-10-07T09:04:44.938864+0000","last_became_active":"2023-10-07T09:04:44.938650+0000","last_became_peered":"2023-10-07T09:04:44.938650+0000","last_unstale":"2023-10-07T09:04:44.938864+0000","last_undegraded":"2023-10-07T09:04:44.938864+0000","last_fullsized":"2023-10-07T09:04:44.938864+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:34.021308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527292+0000","last_change":"2023-10-07T09:04:44.526521+0000","last_active":"2023-10-07T09:04:44.527292+0000","last_peered":"2023-10-07T09:04:44.527292+0000","last_clean":"2023-10-07T09:04:44.527292+0000","last_became_active":"2023-10-07T09:04:44.526205+0000","last_became_peered":"2023-10-07T09:04:44.526205+0000","last_unstale":"2023-10-07T09:04:44.527292+0000","last_undegraded":"2023-10-07T09:04:44.527292+0000","last_fullsized":"2023-10-07T09:04:44.527292+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:03.488503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937068+0000","last_change":"2023-10-07T09:04:44.937068+0000","last_active":"2023-10-07T09:04:44.937068+0000","last_peered":"2023-10-07T09:04:44.937068+0000","last_clean":"2023-10-07T09:04:44.937068+0000","last_became_active":"2023-10-07T09:04:44.936747+0000","last_became_peered":"2023-10-07T09:04:44.936747+0000","last_unstale":"2023-10-07T09:04:44.937068+0000","last_undegraded":"2023-10-07T09:04:44.937068+0000","last_fullsized":"2023-10-07T09:04:44.937068+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:38.449118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522585+0000","last_change":"2023-10-07T09:04:44.519574+0000","last_active":"2023-10-07T09:04:44.522585+0000","last_peered":"2023-10-07T09:04:44.522585+0000","last_clean":"2023-10-07T09:04:44.522585+0000","last_became_active":"2023-10-07T09:04:44.519326+0000","last_became_peered":"2023-10-07T09:04:44.519326+0000","last_unstale":"2023-10-07T09:04:44.522585+0000","last_undegraded":"2023-10-07T09:04:44.522585+0000","last_fullsized":"2023-10-07T09:04:44.522585+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:23.523197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942241+0000","last_change":"2023-10-07T09:04:44.942241+0000","last_active":"2023-10-07T09:04:44.942241+0000","last_peered":"2023-10-07T09:04:44.942241+0000","last_clean":"2023-10-07T09:04:44.942241+0000","last_became_active":"2023-10-07T09:04:44.941746+0000","last_became_peered":"2023-10-07T09:04:44.941746+0000","last_unstale":"2023-10-07T09:04:44.942241+0000","last_undegraded":"2023-10-07T09:04:44.942241+0000","last_fullsized":"2023-10-07T09:04:44.942241+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:46:22.491688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.524378+0000","last_change":"2023-10-07T09:04:44.520487+0000","last_active":"2023-10-07T09:04:44.524378+0000","last_peered":"2023-10-07T09:04:44.524378+0000","last_clean":"2023-10-07T09:04:44.524378+0000","last_became_active":"2023-10-07T09:04:44.520191+0000","last_became_peered":"2023-10-07T09:04:44.520191+0000","last_unstale":"2023-10-07T09:04:44.524378+0000","last_undegraded":"2023-10-07T09:04:44.524378+0000","last_fullsized":"2023-10-07T09:04:44.524378+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:30.036754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936316+0000","last_change":"2023-10-07T09:04:44.936316+0000","last_active":"2023-10-07T09:04:44.936316+0000","last_peered":"2023-10-07T09:04:44.936316+0000","last_clean":"2023-10-07T09:04:44.936316+0000","last_became_active":"2023-10-07T09:04:44.936071+0000","last_became_peered":"2023-10-07T09:04:44.936071+0000","last_unstale":"2023-10-07T09:04:44.936316+0000","last_undegraded":"2023-10-07T09:04:44.936316+0000","last_fullsized":"2023-10-07T09:04:44.936316+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:51.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.514574+0000","last_change":"2023-10-07T09:04:44.526944+0000","last_active":"2023-10-07T09:04:45.514574+0000","last_peered":"2023-10-07T09:04:45.514574+0000","last_clean":"2023-10-07T09:04:45.514574+0000","last_became_active":"2023-10-07T09:04:44.526672+0000","last_became_peered":"2023-10-07T09:04:44.526672+0000","last_unstale":"2023-10-07T09:04:45.514574+0000","last_undegraded":"2023-10-07T09:04:45.514574+0000","last_fullsized":"2023-10-07T09:04:45.514574+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:19.780718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940589+0000","last_change":"2023-10-07T09:04:44.940589+0000","last_active":"2023-10-07T09:04:44.940589+0000","last_peered":"2023-10-07T09:04:44.940589+0000","last_clean":"2023-10-07T09:04:44.940589+0000","last_became_active":"2023-10-07T09:04:44.940320+0000","last_became_peered":"2023-10-07T09:04:44.940320+0000","last_unstale":"2023-10-07T09:04:44.940589+0000","last_undegraded":"2023-10-07T09:04:44.940589+0000","last_fullsized":"2023-10-07T09:04:44.940589+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:19.281363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.517607+0000","last_change":"2023-10-07T09:04:44.522862+0000","last_active":"2023-10-07T09:04:45.517607+0000","last_peered":"2023-10-07T09:04:45.517607+0000","last_clean":"2023-10-07T09:04:45.517607+0000","last_became_active":"2023-10-07T09:04:44.522271+0000","last_became_peered":"2023-10-07T09:04:44.522271+0000","last_unstale":"2023-10-07T09:04:45.517607+0000","last_undegraded":"2023-10-07T09:04:45.517607+0000","last_fullsized":"2023-10-07T09:04:45.517607+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.799551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940995+0000","last_change":"2023-10-07T09:04:44.940995+0000","last_active":"2023-10-07T09:04:44.940995+0000","last_peered":"2023-10-07T09:04:44.940995+0000","last_clean":"2023-10-07T09:04:44.940995+0000","last_became_active":"2023-10-07T09:04:44.940698+0000","last_became_peered":"2023-10-07T09:04:44.940698+0000","last_unstale":"2023-10-07T09:04:44.940995+0000","last_undegraded":"2023-10-07T09:04:44.940995+0000","last_fullsized":"2023-10-07T09:04:44.940995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:29.758283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.516099+0000","last_change":"2023-10-07T09:04:44.519299+0000","last_active":"2023-10-07T09:04:45.516099+0000","last_peered":"2023-10-07T09:04:45.516099+0000","last_clean":"2023-10-07T09:04:45.516099+0000","last_became_active":"2023-10-07T09:04:44.519034+0000","last_became_peered":"2023-10-07T09:04:44.519034+0000","last_unstale":"2023-10-07T09:04:45.516099+0000","last_undegraded":"2023-10-07T09:04:45.516099+0000","last_fullsized":"2023-10-07T09:04:45.516099+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:20.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.931544+0000","last_change":"2023-10-07T09:04:44.931544+0000","last_active":"2023-10-07T09:04:44.931544+0000","last_peered":"2023-10-07T09:04:44.931544+0000","last_clean":"2023-10-07T09:04:44.931544+0000","last_became_active":"2023-10-07T09:04:44.931254+0000","last_became_peered":"2023-10-07T09:04:44.931254+0000","last_unstale":"2023-10-07T09:04:44.931544+0000","last_undegraded":"2023-10-07T09:04:44.931544+0000","last_fullsized":"2023-10-07T09:04:44.931544+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:08.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527226+0000","last_change":"2023-10-07T09:04:44.523349+0000","last_active":"2023-10-07T09:04:44.527226+0000","last_peered":"2023-10-07T09:04:44.527226+0000","last_clean":"2023-10-07T09:04:44.527226+0000","last_became_active":"2023-10-07T09:04:44.523068+0000","last_became_peered":"2023-10-07T09:04:44.523068+0000","last_unstale":"2023-10-07T09:04:44.527226+0000","last_undegraded":"2023-10-07T09:04:44.527226+0000","last_fullsized":"2023-10-07T09:04:44.527226+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:48.339972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937189+0000","last_change":"2023-10-07T09:04:44.937189+0000","last_active":"2023-10-07T09:04:44.937189+0000","last_peered":"2023-10-07T09:04:44.937189+0000","last_clean":"2023-10-07T09:04:44.937189+0000","last_became_active":"2023-10-07T09:04:44.936751+0000","last_became_peered":"2023-10-07T09:04:44.936751+0000","last_unstale":"2023-10-07T09:04:44.937189+0000","last_undegraded":"2023-10-07T09:04:44.937189+0000","last_fullsized":"2023-10-07T09:04:44.937189+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:07.219179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.517658+0000","last_change":"2023-10-07T09:04:44.522120+0000","last_active":"2023-10-07T09:04:45.517658+0000","last_peered":"2023-10-07T09:04:45.517658+0000","last_clean":"2023-10-07T09:04:45.517658+0000","last_became_active":"2023-10-07T09:04:44.521835+0000","last_became_peered":"2023-10-07T09:04:44.521835+0000","last_unstale":"2023-10-07T09:04:45.517658+0000","last_undegraded":"2023-10-07T09:04:45.517658+0000","last_fullsized":"2023-10-07T09:04:45.517658+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:20.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.936545+0000","last_change":"2023-10-07T09:04:44.936545+0000","last_active":"2023-10-07T09:04:44.936545+0000","last_peered":"2023-10-07T09:04:44.936545+0000","last_clean":"2023-10-07T09:04:44.936545+0000","last_became_active":"2023-10-07T09:04:44.936252+0000","last_became_peered":"2023-10-07T09:04:44.936252+0000","last_unstale":"2023-10-07T09:04:44.936545+0000","last_undegraded":"2023-10-07T09:04:44.936545+0000","last_fullsized":"2023-10-07T09:04:44.936545+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:01:30.911958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933496+0000","last_change":"2023-10-07T09:04:44.526609+0000","last_active":"2023-10-07T09:04:44.933496+0000","last_peered":"2023-10-07T09:04:44.933496+0000","last_clean":"2023-10-07T09:04:44.933496+0000","last_became_active":"2023-10-07T09:04:44.526269+0000","last_became_peered":"2023-10-07T09:04:44.526269+0000","last_unstale":"2023-10-07T09:04:44.933496+0000","last_undegraded":"2023-10-07T09:04:44.933496+0000","last_fullsized":"2023-10-07T09:04:44.933496+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:06.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.942457+0000","last_change":"2023-10-07T09:04:44.942457+0000","last_active":"2023-10-07T09:04:44.942457+0000","last_peered":"2023-10-07T09:04:44.942457+0000","last_clean":"2023-10-07T09:04:44.942457+0000","last_became_active":"2023-10-07T09:04:44.942128+0000","last_became_peered":"2023-10-07T09:04:44.942128+0000","last_unstale":"2023-10-07T09:04:44.942457+0000","last_undegraded":"2023-10-07T09:04:44.942457+0000","last_fullsized":"2023-10-07T09:04:44.942457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:38.449118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515110+0000","last_change":"2023-10-07T09:04:44.514316+0000","last_active":"2023-10-07T09:04:45.515110+0000","last_peered":"2023-10-07T09:04:45.515110+0000","last_clean":"2023-10-07T09:04:45.515110+0000","last_became_active":"2023-10-07T09:04:44.514010+0000","last_became_peered":"2023-10-07T09:04:44.514010+0000","last_unstale":"2023-10-07T09:04:45.515110+0000","last_undegraded":"2023-10-07T09:04:45.515110+0000","last_fullsized":"2023-10-07T09:04:45.515110+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:22.995747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.937163+0000","last_change":"2023-10-07T09:04:44.937163+0000","last_active":"2023-10-07T09:04:44.937163+0000","last_peered":"2023-10-07T09:04:44.937163+0000","last_clean":"2023-10-07T09:04:44.937163+0000","last_became_active":"2023-10-07T09:04:44.936842+0000","last_became_peered":"2023-10-07T09:04:44.936842+0000","last_unstale":"2023-10-07T09:04:44.937163+0000","last_undegraded":"2023-10-07T09:04:44.937163+0000","last_fullsized":"2023-10-07T09:04:44.937163+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:32.755065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.928749+0000","last_change":"2023-10-07T09:04:44.519428+0000","last_active":"2023-10-07T09:04:44.928749+0000","last_peered":"2023-10-07T09:04:44.928749+0000","last_clean":"2023-10-07T09:04:44.928749+0000","last_became_active":"2023-10-07T09:04:44.519144+0000","last_became_peered":"2023-10-07T09:04:44.519144+0000","last_unstale":"2023-10-07T09:04:44.928749+0000","last_undegraded":"2023-10-07T09:04:44.928749+0000","last_fullsized":"2023-10-07T09:04:44.928749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:18.276780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.940763+0000","last_change":"2023-10-07T09:04:44.940763+0000","last_active":"2023-10-07T09:04:44.940763+0000","last_peered":"2023-10-07T09:04:44.940763+0000","last_clean":"2023-10-07T09:04:44.940763+0000","last_became_active":"2023-10-07T09:04:44.940486+0000","last_became_peered":"2023-10-07T09:04:44.940486+0000","last_unstale":"2023-10-07T09:04:44.940763+0000","last_undegraded":"2023-10-07T09:04:44.940763+0000","last_fullsized":"2023-10-07T09:04:44.940763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:38.479474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.529610+0000","last_change":"2023-10-07T09:04:44.525146+0000","last_active":"2023-10-07T09:04:44.529610+0000","last_peered":"2023-10-07T09:04:44.529610+0000","last_clean":"2023-10-07T09:04:44.529610+0000","last_became_active":"2023-10-07T09:04:44.524885+0000","last_became_peered":"2023-10-07T09:04:44.524885+0000","last_unstale":"2023-10-07T09:04:44.529610+0000","last_undegraded":"2023-10-07T09:04:44.529610+0000","last_fullsized":"2023-10-07T09:04:44.529610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:27.774527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.927840+0000","last_change":"2023-10-07T09:04:44.927840+0000","last_active":"2023-10-07T09:04:44.927840+0000","last_peered":"2023-10-07T09:04:44.927840+0000","last_clean":"2023-10-07T09:04:44.927840+0000","last_became_active":"2023-10-07T09:04:44.927486+0000","last_became_peered":"2023-10-07T09:04:44.927486+0000","last_unstale":"2023-10-07T09:04:44.927840+0000","last_undegraded":"2023-10-07T09:04:44.927840+0000","last_fullsized":"2023-10-07T09:04:44.927840+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:19.278202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515864+0000","last_change":"2023-10-07T09:04:44.517264+0000","last_active":"2023-10-07T09:04:45.515864+0000","last_peered":"2023-10-07T09:04:45.515864+0000","last_clean":"2023-10-07T09:04:45.515864+0000","last_became_active":"2023-10-07T09:04:44.516960+0000","last_became_peered":"2023-10-07T09:04:44.516960+0000","last_unstale":"2023-10-07T09:04:45.515864+0000","last_undegraded":"2023-10-07T09:04:45.515864+0000","last_fullsized":"2023-10-07T09:04:45.515864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:30.944816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.938036+0000","last_change":"2023-10-07T09:04:44.938036+0000","last_active":"2023-10-07T09:04:44.938036+0000","last_peered":"2023-10-07T09:04:44.938036+0000","last_clean":"2023-10-07T09:04:44.938036+0000","last_became_active":"2023-10-07T09:04:44.937746+0000","last_became_peered":"2023-10-07T09:04:44.937746+0000","last_unstale":"2023-10-07T09:04:44.938036+0000","last_undegraded":"2023-10-07T09:04:44.938036+0000","last_fullsized":"2023-10-07T09:04:44.938036+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:18.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.518192+0000","last_change":"2023-10-07T09:04:44.515795+0000","last_active":"2023-10-07T09:04:44.518192+0000","last_peered":"2023-10-07T09:04:44.518192+0000","last_clean":"2023-10-07T09:04:44.518192+0000","last_became_active":"2023-10-07T09:04:44.515535+0000","last_became_peered":"2023-10-07T09:04:44.515535+0000","last_unstale":"2023-10-07T09:04:44.518192+0000","last_undegraded":"2023-10-07T09:04:44.518192+0000","last_fullsized":"2023-10-07T09:04:44.518192+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:12.995059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932728+0000","last_change":"2023-10-07T09:04:44.932728+0000","last_active":"2023-10-07T09:04:44.932728+0000","last_peered":"2023-10-07T09:04:44.932728+0000","last_clean":"2023-10-07T09:04:44.932728+0000","last_became_active":"2023-10-07T09:04:44.931417+0000","last_became_peered":"2023-10-07T09:04:44.931417+0000","last_unstale":"2023-10-07T09:04:44.932728+0000","last_undegraded":"2023-10-07T09:04:44.932728+0000","last_fullsized":"2023-10-07T09:04:44.932728+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:32.433194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.525308+0000","last_change":"2023-10-07T09:04:44.519126+0000","last_active":"2023-10-07T09:04:44.525308+0000","last_peered":"2023-10-07T09:04:44.525308+0000","last_clean":"2023-10-07T09:04:44.525308+0000","last_became_active":"2023-10-07T09:04:44.517756+0000","last_became_peered":"2023-10-07T09:04:44.517756+0000","last_unstale":"2023-10-07T09:04:44.525308+0000","last_undegraded":"2023-10-07T09:04:44.525308+0000","last_fullsized":"2023-10-07T09:04:44.525308+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:23.523197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939253+0000","last_change":"2023-10-07T09:04:44.939253+0000","last_active":"2023-10-07T09:04:44.939253+0000","last_peered":"2023-10-07T09:04:44.939253+0000","last_clean":"2023-10-07T09:04:44.939253+0000","last_became_active":"2023-10-07T09:04:44.938932+0000","last_became_peered":"2023-10-07T09:04:44.938932+0000","last_unstale":"2023-10-07T09:04:44.939253+0000","last_undegraded":"2023-10-07T09:04:44.939253+0000","last_fullsized":"2023-10-07T09:04:44.939253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:58:01.298657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526405+0000","last_change":"2023-10-07T09:04:44.524560+0000","last_active":"2023-10-07T09:04:44.526405+0000","last_peered":"2023-10-07T09:04:44.526405+0000","last_clean":"2023-10-07T09:04:44.526405+0000","last_became_active":"2023-10-07T09:04:44.524225+0000","last_became_peered":"2023-10-07T09:04:44.524225+0000","last_unstale":"2023-10-07T09:04:44.526405+0000","last_undegraded":"2023-10-07T09:04:44.526405+0000","last_fullsized":"2023-10-07T09:04:44.526405+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:04:26.901306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941772+0000","last_change":"2023-10-07T09:04:44.941772+0000","last_active":"2023-10-07T09:04:44.941772+0000","last_peered":"2023-10-07T09:04:44.941772+0000","last_clean":"2023-10-07T09:04:44.941772+0000","last_became_active":"2023-10-07T09:04:44.941467+0000","last_became_peered":"2023-10-07T09:04:44.941467+0000","last_unstale":"2023-10-07T09:04:44.941772+0000","last_undegraded":"2023-10-07T09:04:44.941772+0000","last_fullsized":"2023-10-07T09:04:44.941772+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:45.515259+0000","last_change":"2023-10-07T09:04:44.525096+0000","last_active":"2023-10-07T09:04:45.515259+0000","last_peered":"2023-10-07T09:04:45.515259+0000","last_clean":"2023-10-07T09:04:45.515259+0000","last_became_active":"2023-10-07T09:04:44.524818+0000","last_became_peered":"2023-10-07T09:04:44.524818+0000","last_unstale":"2023-10-07T09:04:45.515259+0000","last_undegraded":"2023-10-07T09:04:45.515259+0000","last_fullsized":"2023-10-07T09:04:45.515259+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:12:11.023081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941908+0000","last_change":"2023-10-07T09:04:44.941908+0000","last_active":"2023-10-07T09:04:44.941908+0000","last_peered":"2023-10-07T09:04:44.941908+0000","last_clean":"2023-10-07T09:04:44.941908+0000","last_became_active":"2023-10-07T09:04:44.940681+0000","last_became_peered":"2023-10-07T09:04:44.940681+0000","last_unstale":"2023-10-07T09:04:44.941908+0000","last_undegraded":"2023-10-07T09:04:44.941908+0000","last_fullsized":"2023-10-07T09:04:44.941908+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:03.409518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522422+0000","last_change":"2023-10-07T09:04:44.520323+0000","last_active":"2023-10-07T09:04:44.522422+0000","last_peered":"2023-10-07T09:04:44.522422+0000","last_clean":"2023-10-07T09:04:44.522422+0000","last_became_active":"2023-10-07T09:04:44.520035+0000","last_became_peered":"2023-10-07T09:04:44.520035+0000","last_unstale":"2023-10-07T09:04:44.522422+0000","last_undegraded":"2023-10-07T09:04:44.522422+0000","last_fullsized":"2023-10-07T09:04:44.522422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:09:58.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.939963+0000","last_change":"2023-10-07T09:04:44.939963+0000","last_active":"2023-10-07T09:04:44.939963+0000","last_peered":"2023-10-07T09:04:44.939963+0000","last_clean":"2023-10-07T09:04:44.939963+0000","last_became_active":"2023-10-07T09:04:44.935779+0000","last_became_peered":"2023-10-07T09:04:44.935779+0000","last_unstale":"2023-10-07T09:04:44.939963+0000","last_undegraded":"2023-10-07T09:04:44.939963+0000","last_fullsized":"2023-10-07T09:04:44.939963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:42.146368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526439+0000","last_change":"2023-10-07T09:04:44.525009+0000","last_active":"2023-10-07T09:04:44.526439+0000","last_peered":"2023-10-07T09:04:44.526439+0000","last_clean":"2023-10-07T09:04:44.526439+0000","last_became_active":"2023-10-07T09:04:44.524162+0000","last_became_peered":"2023-10-07T09:04:44.524162+0000","last_unstale":"2023-10-07T09:04:44.526439+0000","last_undegraded":"2023-10-07T09:04:44.526439+0000","last_fullsized":"2023-10-07T09:04:44.526439+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:31.428612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941380+0000","last_change":"2023-10-07T09:04:44.941380+0000","last_active":"2023-10-07T09:04:44.941380+0000","last_peered":"2023-10-07T09:04:44.941380+0000","last_clean":"2023-10-07T09:04:44.941380+0000","last_became_active":"2023-10-07T09:04:44.941106+0000","last_became_peered":"2023-10-07T09:04:44.941106+0000","last_unstale":"2023-10-07T09:04:44.941380+0000","last_undegraded":"2023-10-07T09:04:44.941380+0000","last_fullsized":"2023-10-07T09:04:44.941380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:09:03.894133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.526048+0000","last_change":"2023-10-07T09:04:44.522441+0000","last_active":"2023-10-07T09:04:44.526048+0000","last_peered":"2023-10-07T09:04:44.526048+0000","last_clean":"2023-10-07T09:04:44.526048+0000","last_became_active":"2023-10-07T09:04:44.522179+0000","last_became_peered":"2023-10-07T09:04:44.522179+0000","last_unstale":"2023-10-07T09:04:44.526048+0000","last_undegraded":"2023-10-07T09:04:44.526048+0000","last_fullsized":"2023-10-07T09:04:44.526048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:15:24.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.941732+0000","last_change":"2023-10-07T09:04:44.941732+0000","last_active":"2023-10-07T09:04:44.941732+0000","last_peered":"2023-10-07T09:04:44.941732+0000","last_clean":"2023-10-07T09:04:44.941732+0000","last_became_active":"2023-10-07T09:04:44.941459+0000","last_became_peered":"2023-10-07T09:04:44.941459+0000","last_unstale":"2023-10-07T09:04:44.941732+0000","last_undegraded":"2023-10-07T09:04:44.941732+0000","last_fullsized":"2023-10-07T09:04:44.941732+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:05.549836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.522424+0000","last_change":"2023-10-07T09:04:44.518909+0000","last_active":"2023-10-07T09:04:44.522424+0000","last_peered":"2023-10-07T09:04:44.522424+0000","last_clean":"2023-10-07T09:04:44.522424+0000","last_became_active":"2023-10-07T09:04:44.518597+0000","last_became_peered":"2023-10-07T09:04:44.518597+0000","last_unstale":"2023-10-07T09:04:44.522424+0000","last_undegraded":"2023-10-07T09:04:44.522424+0000","last_fullsized":"2023-10-07T09:04:44.522424+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:01:29.907375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.929339+0000","last_change":"2023-10-07T09:04:44.929339+0000","last_active":"2023-10-07T09:04:44.929339+0000","last_peered":"2023-10-07T09:04:44.929339+0000","last_clean":"2023-10-07T09:04:44.929339+0000","last_became_active":"2023-10-07T09:04:44.927662+0000","last_became_peered":"2023-10-07T09:04:44.927662+0000","last_unstale":"2023-10-07T09:04:44.929339+0000","last_undegraded":"2023-10-07T09:04:44.929339+0000","last_fullsized":"2023-10-07T09:04:44.929339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:38.574836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527209+0000","last_change":"2023-10-07T09:04:44.523780+0000","last_active":"2023-10-07T09:04:44.527209+0000","last_peered":"2023-10-07T09:04:44.527209+0000","last_clean":"2023-10-07T09:04:44.527209+0000","last_became_active":"2023-10-07T09:04:44.523552+0000","last_became_peered":"2023-10-07T09:04:44.523552+0000","last_unstale":"2023-10-07T09:04:44.527209+0000","last_undegraded":"2023-10-07T09:04:44.527209+0000","last_fullsized":"2023-10-07T09:04:44.527209+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:17:49.256159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.932199+0000","last_change":"2023-10-07T09:04:44.932199+0000","last_active":"2023-10-07T09:04:44.932199+0000","last_peered":"2023-10-07T09:04:44.932199+0000","last_clean":"2023-10-07T09:04:44.932199+0000","last_became_active":"2023-10-07T09:04:44.931083+0000","last_became_peered":"2023-10-07T09:04:44.931083+0000","last_unstale":"2023-10-07T09:04:44.932199+0000","last_undegraded":"2023-10-07T09:04:44.932199+0000","last_fullsized":"2023-10-07T09:04:44.932199+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:42:07.219179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.523708+0000","last_change":"2023-10-07T09:04:44.519856+0000","last_active":"2023-10-07T09:04:44.523708+0000","last_peered":"2023-10-07T09:04:44.523708+0000","last_clean":"2023-10-07T09:04:44.523708+0000","last_became_active":"2023-10-07T09:04:44.519411+0000","last_became_peered":"2023-10-07T09:04:44.519411+0000","last_unstale":"2023-10-07T09:04:44.523708+0000","last_undegraded":"2023-10-07T09:04:44.523708+0000","last_fullsized":"2023-10-07T09:04:44.523708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:30.944816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.935185+0000","last_change":"2023-10-07T09:04:44.935185+0000","last_active":"2023-10-07T09:04:44.935185+0000","last_peered":"2023-10-07T09:04:44.935185+0000","last_clean":"2023-10-07T09:04:44.935185+0000","last_became_active":"2023-10-07T09:04:44.934924+0000","last_became_peered":"2023-10-07T09:04:44.934924+0000","last_unstale":"2023-10-07T09:04:44.935185+0000","last_undegraded":"2023-10-07T09:04:44.935185+0000","last_fullsized":"2023-10-07T09:04:44.935185+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:12.098291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.527038+0000","last_change":"2023-10-07T09:04:44.525908+0000","last_active":"2023-10-07T09:04:44.527038+0000","last_peered":"2023-10-07T09:04:44.527038+0000","last_clean":"2023-10-07T09:04:44.527038+0000","last_became_active":"2023-10-07T09:04:44.525600+0000","last_became_peered":"2023-10-07T09:04:44.525600+0000","last_unstale":"2023-10-07T09:04:44.527038+0000","last_undegraded":"2023-10-07T09:04:44.527038+0000","last_fullsized":"2023-10-07T09:04:44.527038+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:18.273620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.933984+0000","last_change":"2023-10-07T09:04:44.933984+0000","last_active":"2023-10-07T09:04:44.933984+0000","last_peered":"2023-10-07T09:04:44.933984+0000","last_clean":"2023-10-07T09:04:44.933984+0000","last_became_active":"2023-10-07T09:04:44.933738+0000","last_became_peered":"2023-10-07T09:04:44.933738+0000","last_unstale":"2023-10-07T09:04:44.933984+0000","last_undegraded":"2023-10-07T09:04:44.933984+0000","last_fullsized":"2023-10-07T09:04:44.933984+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:44.495378+0000","last_clean_scrub_stamp":"2023-10-07T09:04:44.495378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:32.755065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.524807+0000","last_change":"2023-10-07T09:04:44.520414+0000","last_active":"2023-10-07T09:04:44.524807+0000","last_peered":"2023-10-07T09:04:44.524807+0000","last_clean":"2023-10-07T09:04:44.524807+0000","last_became_active":"2023-10-07T09:04:44.520103+0000","last_became_peered":"2023-10-07T09:04:44.520103+0000","last_unstale":"2023-10-07T09:04:44.524807+0000","last_undegraded":"2023-10-07T09:04:44.524807+0000","last_fullsized":"2023-10-07T09:04:44.524807+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:04:43.490795+0000","last_clean_scrub_stamp":"2023-10-07T09:04:43.490795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:36.764315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T09:04:44.514063+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:04:44.514063+0000","last_peered":"2023-10-07T09:04:44.514063+0000","last_clean":"2023-10-07T09:04:44.514063+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:04:44.514063+0000","last_undegraded":"2023-10-07T09:04:44.514063+0000","last_fullsized":"2023-10-07T09:04:44.514063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1132281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.505}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69599999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.51100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.441}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.38600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298520,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073320,"statfs":{"total":96636764160,"available":96331079680,"internally_reserved":0,"allocated":1261568,"data_stored":541395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.746,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71999999999999997,"5min":1.29,"15min":1.29},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73999999999999999,"5min":4.0880000000000001,"15min":4.0880000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.624}]},{"osd":4,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.626},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":541449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.63},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":1.3859999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.68300000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.78900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":0.81799999999999995,"15min":11.32},"last":0.433}]},{"osd":3,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.81100000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.79300000000000004,"15min":11.880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":0.69099999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.72299999999999998},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":4.4850000000000003},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.80800000000000005},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.90000000000000002,"15min":5.3540000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.63400000000000001,"15min":0.82699999999999996},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":5.3920000000000003},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":4.5209999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1133341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47799999999999998,"5min":0.501,"15min":0.54500000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.29399999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.58999999999999997,"15min":0.61199999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.38900000000000001},"min":{"1min":0.252,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.56699999999999995,"15min":0.625},"last":0.35999999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.35399999999999998},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.57899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.91700000000000004,"15min":0.95399999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0249999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.89300000000000002,"15min":1},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.66000000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":1.006},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.68000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":1.0389999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":541325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.31900000000000001,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":10.214},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.308}]},{"osd":1,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.60099999999999998,"15min":0.755},"last":0.252},{"interface":"front","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.67800000000000005},"min":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":10.144},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.73599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.628,"5min":0.755,"15min":10.071},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.752},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":10.183},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.93500000000000005,"15min":1.1579999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.87,"15min":1.0549999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":1.181},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":20.922000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.96399999999999997,"15min":1.0880000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.624,"15min":1.232},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75,"5min":0.97199999999999998,"15min":20.963999999999999},"last":0.754}]},{"osd":7,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.628},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":542931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.39900000000000002,"15min":0.436},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50900000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.51100000000000001,"15min":0.78700000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":12.038,"15min":12.038},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.37,"15min":0.44600000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.437,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40100000000000002,"15min":0.48099999999999998},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.44600000000000001,"15min":0.627},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.497,"5min":6.1230000000000002,"15min":6.1230000000000002},"last":0.374},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.67300000000000004,"15min":0.96599999999999997},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":2.081,"15min":2.081},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.67200000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.67300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.745,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.71999999999999997,"15min":1.0209999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":12.007,"15min":12.007},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.73199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:03:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.73199999999999998,"15min":1.04},"min":{"1min":0.498,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":11.973000000000001,"15min":11.973000000000001},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":541325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.84699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":9.7040000000000006},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.73599999999999999},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":3.024,"15min":5.6319999999999997},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":9.8620000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.93700000000000006},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.976,"15min":9.8439999999999994},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.90500000000000003},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.93400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.78000000000000003,"15min":10.01},"last":0.61799999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":5.569},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":0.751,"15min":10.131},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46899999999999997,"15min":0.51400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.83599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.5,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.82199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85499999999999998},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":541901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.76700000000000002,"15min":0.81200000000000006},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.65700000000000003,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.7799999999999994,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.3970000000000002,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.61699999999999999,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.5650000000000004,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92900000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50600000000000001,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.67100000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.42199999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.29799999999999999},"max":{"1min":0.95999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.374},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:04:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:04:50.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:04:50.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.167+0000 7f68270b0700 1 Processor -- start 2023-10-07T09:04:50.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.167+0000 7f68270b0700 1 -- start start 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.167+0000 7f68270b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6820159950 0x7f68200cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.167+0000 7f68270b0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68200af320 0x7f6820069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f68270b0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200ce380 con 0x7f6820069aa0 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f68270b0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68200cec20 con 0x7f68200af320 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f68270b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6820069ee0 con 0x7f6820159950 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68200af320 0x7f6820069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68200af320 0x7f6820069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32808/0 (socket says 172.21.15.46:32808) 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 -- 172.21.15.46:0/2196729884 learned_addr learned my addr 172.21.15.46:0/2196729884 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f6824e4c700 1 --2- 172.21.15.46:0/2196729884 >> v2:172.21.15.133:3300/0 conn(0x7f6820159950 0x7f68200cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 -- 172.21.15.46:0/2196729884 >> v2:172.21.15.133:3300/0 conn(0x7f6820159950 msgr2=0x7f68200cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 --2- 172.21.15.46:0/2196729884 >> v2:172.21.15.133:3300/0 conn(0x7f6820159950 0x7f68200cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 -- 172.21.15.46:0/2196729884 >> v1:172.21.15.133:6789/0 conn(0x7f6820069aa0 legacy=0x7f682015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 -- 172.21.15.46:0/2196729884 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200afa90 con 0x7f68200af320 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681ffff700 1 --2- 172.21.15.46:0/2196729884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68200af320 0x7f6820069560 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f68200896e0 tx=0x7f6814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf59e511906481a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681f7fe700 1 -- 172.21.15.46:0/2196729884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814009e70 con 0x7f68200af320 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681f7fe700 1 -- 172.21.15.46:0/2196729884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681400b860 con 0x7f68200af320 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.168+0000 7f681f7fe700 1 -- 172.21.15.46:0/2196729884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681400bc00 con 0x7f68200af320 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 -- 172.21.15.46:0/2196729884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68200af320 msgr2=0x7f6820069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 --2- 172.21.15.46:0/2196729884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68200af320 0x7f6820069560 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f68200896e0 tx=0x7f6814009250 comp rx=0 tx=0).stop 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 -- 172.21.15.46:0/2196729884 shutdown_connections 2023-10-07T09:04:50.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 --2- 172.21.15.46:0/2196729884 >> v2:172.21.15.133:3300/0 conn(0x7f6820159950 0x7f68200cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 --2- 172.21.15.46:0/2196729884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68200af320 0x7f6820069560 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 -- 172.21.15.46:0/2196729884 >> 172.21.15.46:0/2196729884 conn(0x7f6820068e00 msgr2=0x7f68200d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 -- 172.21.15.46:0/2196729884 shutdown_connections 2023-10-07T09:04:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.169+0000 7f68270b0700 1 -- 172.21.15.46:0/2196729884 wait complete. 2023-10-07T09:04:50.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.170+0000 7f68270b0700 1 Processor -- start 2023-10-07T09:04:50.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.170+0000 7f68270b0700 1 -- start start 2023-10-07T09:04:50.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68200af320 0x7f682014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6820159950 0x7f68200ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682014a890 con 0x7f6820069aa0 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682014d320 con 0x7f6820159950 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f68270b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682014dcf0 con 0x7f68200af320 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32816/0 (socket says 172.21.15.46:32816) 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 -- 172.21.15.46:0/422632205 learned_addr learned my addr 172.21.15.46:0/422632205 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f682564d700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6820159950 0x7f68200ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f681ffff700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68200af320 0x7f682014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 -- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68200af320 msgr2=0x7f682014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68200af320 0x7f682014d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 -- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6820159950 msgr2=0x7f68200ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6820159950 0x7f68200ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 -- 172.21.15.46:0/422632205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140094f0 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.171+0000 7f6824e4c700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6818009e50 tx=0x7f681800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.172+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800cc20 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.172+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800f040 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.172+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818014480 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.172+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682014c710 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.172+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682014ccd0 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.173+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682014d600 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.173+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f68180147f0 con 0x7f6820069aa0 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.174+0000 7f681cff9700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 0x7f680c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.174+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68180855f0 con 0x7f6820069aa0 2023-10-07T09:04:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.174+0000 7f681ffff700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 0x7f680c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.174+0000 7f681ffff700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 0x7f680c069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f68200896e0 tx=0x7f6814017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.178+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6818052340 con 0x7f6820069aa0 2023-10-07T09:04:50.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.450+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f68200718b0 con 0x7f6820069aa0 2023-10-07T09:04:50.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.453+0000 7f681cff9700 1 -- 172.21.15.46:0/422632205 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6818055960 con 0x7f6820069aa0 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 msgr2=0x7f680c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 0x7f680c069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f68200896e0 tx=0x7f6814017000 comp rx=0 tx=0).stop 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 msgr2=0x7f682014a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6818009e50 tx=0x7f681800b040 comp rx=0 tx=0).stop 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 shutdown_connections 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f680c067290 0x7f680c069740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6820159950 0x7f68200ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6820069aa0 0x7f682014a350 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 --2- 172.21.15.46:0/422632205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68200af320 0x7f682014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 >> 172.21.15.46:0/422632205 conn(0x7f6820068e00 msgr2=0x7f68200b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:50.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 shutdown_connections 2023-10-07T09:04:50.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.456+0000 7f68270b0700 1 -- 172.21.15.46:0/422632205 wait complete. 2023-10-07T09:04:50.459 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:04:50.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:50.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 Processor -- start 2023-10-07T09:04:50.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 -- start start 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ca0069560 0x7f7ca00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca0069ee0 con 0x7f7ca0159890 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca015a160 con 0x7f7ca0159c60 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.589+0000 7f7ca65f1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00d13a0 con 0x7f7ca0069560 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7ca0159890 0x7f7ca015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38874/0 (socket says 172.21.15.46:38874) 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9ffff700 1 -- 172.21.15.46:0/289388039 learned_addr learned my addr 172.21.15.46:0/289388039 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7ca4b8e700 1 --2- 172.21.15.46:0/289388039 >> v2:172.21.15.133:3300/0 conn(0x7f7ca0069560 0x7f7ca00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102104372 0 0) 0x7f7ca0069ee0 con 0x7f7ca0159890 2023-10-07T09:04:50.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c003570 con 0x7f7ca0159890 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958707515 0 0) 0x7f7ca015a160 con 0x7f7ca0159c60 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca0069ee0 con 0x7f7ca0159c60 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 793773801 0 0) 0x7f7c8c003570 con 0x7f7ca0159890 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 >> v2:172.21.15.133:3300/0 conn(0x7f7ca0069560 msgr2=0x7f7ca00699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 --2- 172.21.15.46:0/289388039 >> v2:172.21.15.133:3300/0 conn(0x7f7ca0069560 0x7f7ca00699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 >> v1:172.21.15.133:6789/0 conn(0x7f7ca0159c60 legacy=0x7f7ca015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca015e140 con 0x7f7ca0159890 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f7c88001470 con 0x7f7ca0159890 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 >> v1:172.21.15.46:6789/0 conn(0x7f7ca0159890 legacy=0x7f7ca015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8c003c40 0x7f7c8c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7c8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c005210 0x7f7c8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00d13a0 con 0x7f7c8c004810 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c00c130 con 0x7f7c8c005210 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c00c2c0 con 0x7f7c8c003c40 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.590+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7c8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9ffff700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8c003c40 0x7f7c8c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7ca4b8e700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c005210 0x7f7c8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 -- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8c003c40 msgr2=0x7f7c8c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7c8c003c40 0x7f7c8c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 -- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c005210 msgr2=0x7f7c8c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c005210 0x7f7c8c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 -- 172.21.15.46:0/289388039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c003570 con 0x7f7c8c004810 2023-10-07T09:04:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7ca4b8e700 1 -- 172.21.15.46:0/289388039 reap_dead start 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7c8c004c80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001a40 tx=0x7f7c90007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca03ee7ce83046d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000c550 con 0x7f7c8c004810 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000c6b0 con 0x7f7c8c004810 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.591+0000 7f7c9effd700 1 -- 172.21.15.46:0/289388039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000ca50 con 0x7f7c8c004810 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 -- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 msgr2=0x7f7c8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7c8c004c80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001a40 tx=0x7f7c90007d30 comp rx=0 tx=0).stop 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 -- 172.21.15.46:0/289388039 shutdown_connections 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/289388039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7c8c004c80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 -- 172.21.15.46:0/289388039 >> 172.21.15.46:0/289388039 conn(0x7f7ca0068e20 msgr2=0x7f7ca00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 -- 172.21.15.46:0/289388039 shutdown_connections 2023-10-07T09:04:50.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.592+0000 7f7ca65f1700 1 -- 172.21.15.46:0/289388039 wait complete. 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.593+0000 7f7ca65f1700 1 Processor -- start 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.593+0000 7f7ca65f1700 1 -- start start 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 0x7f7ca015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 0x7f7ca015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00cdd00 con 0x7f7c8c004810 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca015b800 con 0x7f7ca014d0b0 2023-10-07T09:04:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca015b4d0 con 0x7f7ca014d520 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32844/0 (socket says 172.21.15.46:32844) 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 -- 172.21.15.46:0/3634355198 learned_addr learned my addr 172.21.15.46:0/3634355198 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca4b8e700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 0x7f7ca015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 0x7f7ca015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 -- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 msgr2=0x7f7ca015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 0x7f7ca015d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 -- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 msgr2=0x7f7ca015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 0x7f7ca015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 -- 172.21.15.46:0/3634355198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca015d6b0 con 0x7f7c8c004810 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca4b8e700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 0x7f7ca015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 0x7f7ca015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c9ffff700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7c88007f90 tx=0x7f7c88001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88000bc0 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88011590 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca015d990 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011930 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.594+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00b3ad0 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.595+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca004c3c0 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.596+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7c88011d20 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.596+0000 7f7c97fff700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 0x7f7c80069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.596+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c88084b50 con 0x7f7c8c004810 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.596+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 0x7f7c80069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.597+0000 7f7c9f7fe700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 0x7f7c80069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00cad90 tx=0x7f7c90015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.600+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c880519b0 con 0x7f7c8c004810 2023-10-07T09:04:50.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.835+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca006a580 con 0x7f7c8c004810 2023-10-07T09:04:50.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.836+0000 7f7c97fff700 1 -- 172.21.15.46:0/3634355198 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f7c88054fd0 con 0x7f7c8c004810 2023-10-07T09:04:50.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:50.838 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 msgr2=0x7f7c80069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 0x7f7c80069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00cad90 tx=0x7f7c90015000 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 msgr2=0x7f7ca00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7c88007f90 tx=0x7f7c88001d20 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 shutdown_connections 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7c80067290 0x7f7c80069740 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ca014d520 0x7f7ca015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c8c004810 0x7f7ca00b3590 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 --2- 172.21.15.46:0/3634355198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ca014d0b0 0x7f7ca015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 >> 172.21.15.46:0/3634355198 conn(0x7f7ca0068e20 msgr2=0x7f7ca00b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 shutdown_connections 2023-10-07T09:04:50.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:50.838+0000 7f7ca65f1700 1 -- 172.21.15.46:0/3634355198 wait complete. 2023-10-07T09:04:50.841 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 65 2023-10-07T09:04:50.925 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-10-07T09:04:50.923+0000 7f1d7c6c9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:04:51.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:04:44.915421+0000', 'modified': '2023-10-07T09:04:48.517981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6798}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6798': {'gid': 6798, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/1479846001', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6833', 'nonce': 1479846001}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1479846001}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:04:51.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:04:51.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T09:04:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.376+0000 7f8a21aca700 1 Processor -- start 2023-10-07T09:04:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.376+0000 7f8a21aca700 1 -- start start 2023-10-07T09:04:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.376+0000 7f8a21aca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.376+0000 7f8a21aca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a21aca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c06ec70 con 0x7f8a1c15e010 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a21aca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b3430 con 0x7f8a1c06f810 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a21aca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06fc90 con 0x7f8a1c068550 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:34244/0 (socket says 172.21.15.46:34244) 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44370/0 (socket says 172.21.15.46:44370) 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1bfff700 1 -- 172.21.15.46:0/3388943971 learned_addr learned my addr 172.21.15.46:0/3388943971 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1affd700 1 --1- 172.21.15.46:0/3388943971 >> v1:172.21.15.133:6789/0 conn(0x7f8a1c15e010 0x7f8a1c06f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:45486/0 (socket says 172.21.15.46:45486) 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/3388943971 >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 msgr2=0x7f8a1c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/3388943971 >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/3388943971 >> v1:172.21.15.133:6789/0 conn(0x7f8a1c15e010 legacy=0x7f8a1c06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/3388943971 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0b2e70 con 0x7f8a1c068550 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.377+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/3388943971 >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/3388943971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009e60 tx=0x7f8a0c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b140b9695bb02ac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a1a7fc700 1 -- 172.21.15.46:0/3388943971 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00e070 con 0x7f8a1c068550 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a1a7fc700 1 -- 172.21.15.46:0/3388943971 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c00bb60 con 0x7f8a1c068550 2023-10-07T09:04:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a1a7fc700 1 -- 172.21.15.46:0/3388943971 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c012430 con 0x7f8a1c068550 2023-10-07T09:04:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 -- 172.21.15.46:0/3388943971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 msgr2=0x7f8a1c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 --2- 172.21.15.46:0/3388943971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009e60 tx=0x7f8a0c009780 comp rx=0 tx=0).stop 2023-10-07T09:04:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 -- 172.21.15.46:0/3388943971 shutdown_connections 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 --2- 172.21.15.46:0/3388943971 >> v2:172.21.15.133:3300/0 conn(0x7f8a1c06f810 0x7f8a1c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 --2- 172.21.15.46:0/3388943971 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c068550 0x7f8a1c068920 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 -- 172.21.15.46:0/3388943971 >> 172.21.15.46:0/3388943971 conn(0x7f8a1c0cd480 msgr2=0x7f8a1c0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 -- 172.21.15.46:0/3388943971 shutdown_connections 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.378+0000 7f8a21aca700 1 -- 172.21.15.46:0/3388943971 wait complete. 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 Processor -- start 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 -- start start 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a1c068550 0x7f8a1c159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c06f810 0x7f8a1c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0aaf30 con 0x7f8a1c15e010 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0ab1f0 con 0x7f8a1c068550 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.380+0000 7f8a21aca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0ab4d0 con 0x7f8a1c06f810 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32850/0 (socket says 172.21.15.46:32850) 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 -- 172.21.15.46:0/2235759137 learned_addr learned my addr 172.21.15.46:0/2235759137 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a1c068550 0x7f8a1c159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1affd700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c06f810 0x7f8a1c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 -- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c06f810 msgr2=0x7f8a1c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c06f810 0x7f8a1c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 -- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a1c068550 msgr2=0x7f8a1c159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a1c068550 0x7f8a1c159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 -- 172.21.15.46:0/2235759137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140094f0 con 0x7f8a1c15e010 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ec50 tx=0x7f8a14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a037fe700 1 -- 172.21.15.46:0/2235759137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400c850 con 0x7f8a1c15e010 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a037fe700 1 -- 172.21.15.46:0/2235759137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400c9b0 con 0x7f8a1c15e010 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c009a20 con 0x7f8a1c15e010 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a037fe700 1 -- 172.21.15.46:0/2235759137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400cd50 con 0x7f8a1c15e010 2023-10-07T09:04:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.381+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c15a040 con 0x7f8a1c15e010 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.383+0000 7f8a037fe700 1 -- 172.21.15.46:0/2235759137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f8a14013680 con 0x7f8a1c15e010 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.383+0000 7f8a037fe700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 0x7f8a08069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.383+0000 7f8a037fe700 1 -- 172.21.15.46:0/2235759137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a14084c50 con 0x7f8a1c15e010 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.383+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 0x7f8a08069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.384+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 0x7f8a08069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0097c0 tx=0x7f8a0c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.385+0000 7f8a2adc2b80 1 Processor -- start 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.385+0000 7f8a2adc2b80 1 -- start start 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 0x56361e69dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e5f8a70 con 0x56361e6a1a50 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e5f6270 con 0x56361e6caf60 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361e5f2060 con 0x56361e6ebd00 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32866/0 (socket says 172.21.15.46:32866) 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/4032437569 learned_addr learned my addr 172.21.15.46:0/4032437569 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 0x56361e69dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1affd700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 msgr2=0x56361e6caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 msgr2=0x56361e69dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 0x56361e69dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 -- 172.21.15.46:0/4032437569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56361e48c270 con 0x56361e6a1a50 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1affd700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 0x56361e69dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.386+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0127a0 tx=0x7f8a0c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a79a18204cfeb0a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a00ff9700 1 -- 172.21.15.46:0/4032437569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01f600 con 0x56361e6a1a50 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a00ff9700 1 -- 172.21.15.46:0/4032437569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c01f760 con 0x56361e6a1a50 2023-10-07T09:04:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a00ff9700 1 -- 172.21.15.46:0/4032437569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01fae0 con 0x56361e6a1a50 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/4032437569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 msgr2=0x56361e6a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0127a0 tx=0x7f8a0c021040 comp rx=0 tx=0).stop 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/4032437569 shutdown_connections 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6caf60 0x56361e69dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6a1a50 0x56361e6a1e20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/4032437569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/4032437569 >> 172.21.15.46:0/4032437569 conn(0x56361e6a3370 msgr2=0x56361e6a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/4032437569 shutdown_connections 2023-10-07T09:04:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.387+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/4032437569 wait complete. 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.388+0000 7f8a2adc2b80 1 -- start start 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.388+0000 7f8a2adc2b80 1 Processor -- start 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 0x56361e6e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e59d890 con 0x56361e6ebd00 2023-10-07T09:04:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e5b8ea0 con 0x56361e6a1a50 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361e474e30 con 0x56361e6caf60 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 10 client.0 _ll_register_callbacks cb 0x56361e665110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32876/0 (socket says 172.21.15.46:32876) 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 -- 172.21.15.46:0/523863575 learned_addr learned my addr 172.21.15.46:0/523863575 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 -- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 msgr2=0x56361e6e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1affd700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 0x56361e6e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 0x56361e6e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 -- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 msgr2=0x56361e6eb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6eb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 -- 172.21.15.46:0/523863575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c0b2e70 con 0x56361e6ebd00 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1affd700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 0x56361e6e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8a14055700 tx=0x7f8a14015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a987b45b73f20a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f89f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14054e70 con 0x56361e6ebd00 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a1405c280 con 0x56361e6ebd00 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.389+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56361e696b70 con 0x56361e6ebd00 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a14071250 con 0x56361e6ebd00 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 10 client.6930 fetch_fsmap learned FSMap version 65 2023-10-07T09:04:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x56361e42efe0 con 0x56361e6ebd00 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14082030 con 0x56361e6ebd00 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 65) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a14051560 con 0x56361e6ebd00 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 10 client.6930 fetch_fsmap finished waiting for FSMap version 65 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 10 client.6930 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 20 client.6930 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e1d30 0x56361e6e2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 4 client.6930 mds_command: new command op to 6798 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 --> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56361e673aa0 con 0x56361e6e1d30 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e1d30 0x56361e6e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f89f9ffb700 10 client.6930 ms_handle_connect on v2:172.21.15.46:6833/1479846001 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.390+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e1d30 0x56361e6e2100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afca721be8ec119a server_cookie=25b5289b9a25f96d in_seq=0 out_seq=0 2023-10-07T09:04:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f89f9ffb700 1 -- 172.21.15.46:0/523863575 <== mds.0 v2:172.21.15.46:6833/1479846001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56361e673aa0 con 0x56361e6e1d30 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f89f9ffb700 10 client.6930 handle_command_reply: tid=0 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 client.6930 shutdown 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 msgr2=0x56361e69cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8a14055700 tx=0x7f8a14015040 comp rx=0 tx=0).stop 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 shutdown_connections 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6ebd00 0x56361e69cc20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e1d30 0x56361e6e2100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/523863575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6caf60 0x56361e6e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f89f9ffb700 0 client.6930 ms_handle_reset on v2:172.21.15.46:6833/1479846001 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 >> 172.21.15.46:0/523863575 conn(0x56361e6a3370 msgr2=0x56361e6e7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 shutdown_connections 2023-10-07T09:04:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/523863575 wait complete. 2023-10-07T09:04:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.391+0000 7f8a2adc2b80 20 client.6930 trim_cache size 0 max 16384 2023-10-07T09:04:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.408+0000 7f8a2adc2b80 1 Processor -- start 2023-10-07T09:04:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.408+0000 7f8a2adc2b80 1 -- start start 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e69e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e69d9e0 con 0x56361e6caf60 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e681510 con 0x56361e6a1a50 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361e67a410 con 0x56361e6ebd00 2023-10-07T09:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32882/0 (socket says 172.21.15.46:32882) 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 -- 172.21.15.46:0/1328243627 learned_addr learned my addr 172.21.15.46:0/1328243627 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e69e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 -- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 msgr2=0x56361e6a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 -- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 msgr2=0x56361e69e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e69e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 -- 172.21.15.46:0/1328243627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56361e5c0780 con 0x56361e6caf60 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a1affd700 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8a10004bf0 tx=0x7f8a10009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87801d713a1bac32 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a017fa700 1 -- 172.21.15.46:0/1328243627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a100153e0 con 0x56361e6caf60 2023-10-07T09:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a017fa700 1 -- 172.21.15.46:0/1328243627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10015540 con 0x56361e6caf60 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.409+0000 7f8a017fa700 1 -- 172.21.15.46:0/1328243627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a100158e0 con 0x56361e6caf60 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/1328243627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 msgr2=0x56361e6a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8a10004bf0 tx=0x7f8a10009040 comp rx=0 tx=0).stop 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/1328243627 shutdown_connections 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e6a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e69e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/1328243627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e6a1e20 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/1328243627 >> 172.21.15.46:0/1328243627 conn(0x56361e6a3370 msgr2=0x56361e6e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/1328243627 shutdown_connections 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/1328243627 wait complete. 2023-10-07T09:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.410+0000 7f8a2adc2b80 1 -- start start 2023-10-07T09:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 Processor -- start 2023-10-07T09:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e74d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e74dec0 con 0x56361e6caf60 2023-10-07T09:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361e6d15d0 con 0x56361e6a1a50 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361e6cd930 con 0x56361e6ebd00 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a2adc2b80 10 client.0 _ll_register_callbacks cb 0x56361e665110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a1affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a1affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32898/0 (socket says 172.21.15.46:32898) 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a1affd700 1 -- 172.21.15.46:0/3953808711 learned_addr learned my addr 172.21.15.46:0/3953808711 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.411+0000 7f8a1bfff700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e74d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 -- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 msgr2=0x56361e74d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e74d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 -- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 msgr2=0x56361e6ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 -- 172.21.15.46:0/3953808711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c06ec70 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a1affd700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8a10016000 tx=0x7f8a10010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1928010ebe1b988 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10016440 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a100165a0 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a0c01f760 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a10016970 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 10 client.6936 fetch_fsmap learned FSMap version 65 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x56361e5a7470 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c01f760 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 65) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a10016ad0 con 0x56361e6caf60 2023-10-07T09:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 10 client.6936 fetch_fsmap finished waiting for FSMap version 65 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 10 client.6936 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 20 client.6936 populate_metadata read hostname 'smithi046' 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e3c10 0x56361e6e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.412+0000 7f8a2adc2b80 4 client.6936 mds_command: new command op to 6798 tid=0[{"prefix": "status"}] 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 --> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56361e594e00 con 0x56361e6e3c10 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e3c10 0x56361e6e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f89f9ffb700 10 client.6936 ms_handle_connect on v2:172.21.15.46:6833/1479846001 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a1b7fe700 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e3c10 0x56361e6e3fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce961be587ade53c server_cookie=2360d094c4ba385 in_seq=0 out_seq=0 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f89f9ffb700 1 -- 172.21.15.46:0/3953808711 <== mds.0 v2:172.21.15.46:6833/1479846001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56361e594e00 con 0x56361e6e3c10 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f89f9ffb700 10 client.6936 handle_command_reply: tid=0 2023-10-07T09:04:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 client.6936 shutdown 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 msgr2=0x56361e74d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8a10016000 tx=0x7f8a10010000 comp rx=0 tx=0).stop 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 shutdown_connections 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56361e6ebd00 0x56361e74d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:6833/1479846001,v1:172.21.15.46:6835/1479846001] conn(0x56361e6e3c10 0x56361e6e3fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56361e6a1a50 0x56361e6ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 --2- 172.21.15.46:0/3953808711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56361e6caf60 0x56361e74d440 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f89f9ffb700 0 client.6936 ms_handle_reset on v2:172.21.15.46:6833/1479846001 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 >> 172.21.15.46:0/3953808711 conn(0x56361e6a3370 msgr2=0x56361e6e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 shutdown_connections 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 1 -- 172.21.15.46:0/3953808711 wait complete. 2023-10-07T09:04:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.413+0000 7f8a2adc2b80 20 client.6936 trim_cache size 0 max 16384 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 6798, 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9106456380000001, 2023-10-07T09:04:51.423 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 65, 2023-10-07T09:04:51.424 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 102, 2023-10-07T09:04:51.424 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 102, 2023-10-07T09:04:51.424 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.973527549 2023-10-07T09:04:51.424 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 msgr2=0x7f8a08069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 0x7f8a08069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0097c0 tx=0x7f8a0c019000 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 msgr2=0x7f8a1c16b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ec50 tx=0x7f8a14009250 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 shutdown_connections 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8a08067290 0x7f8a08069740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a1c15e010 0x7f8a1c16b010 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a1c068550 0x7f8a1c159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 --2- 172.21.15.46:0/2235759137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a1c06f810 0x7f8a1c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 >> 172.21.15.46:0/2235759137 conn(0x7f8a1c0cd480 msgr2=0x7f8a1c15d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 shutdown_connections 2023-10-07T09:04:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.414+0000 7f8a21aca700 1 -- 172.21.15.46:0/2235759137 wait complete. 2023-10-07T09:04:51.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.544+0000 7fcae82b8700 1 Processor -- start 2023-10-07T09:04:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.544+0000 7fcae82b8700 1 -- start start 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.545+0000 7fcae82b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcae0159c10 0x7fcae00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.545+0000 7fcae82b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.545+0000 7fcae82b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0069e40 con 0x7fcae0159840 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.545+0000 7fcae82b8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00cfb30 con 0x7fcae0159c10 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.545+0000 7fcae82b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00cbc40 con 0x7fcae00699e0 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:44400/0 (socket says 172.21.15.46:44400) 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae5853700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcae0159c10 0x7fcae00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 -- 172.21.15.46:0/89871924 learned_addr learned my addr 172.21.15.46:0/89871924 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae5052700 1 -- 172.21.15.46:0/89871924 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960562419 0 0) 0x7fcad8001110 con 0x7fcae0159840 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 -- 172.21.15.46:0/89871924 >> v2:172.21.15.133:3300/0 conn(0x7fcae0159c10 msgr2=0x7fcae00694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 --2- 172.21.15.46:0/89871924 >> v2:172.21.15.133:3300/0 conn(0x7fcae0159c10 0x7fcae00694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 -- 172.21.15.46:0/89871924 >> v1:172.21.15.133:6789/0 conn(0x7fcae0159840 legacy=0x7fcae00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 -- 172.21.15.46:0/89871924 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00cbf10 con 0x7fcae00699e0 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae6855700 1 --2- 172.21.15.46:0/89871924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009f20 tx=0x7fcad0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4bbf876ce7d2beb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae5052700 1 -- 172.21.15.46:0/89871924 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcae00699e0 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae5052700 1 -- 172.21.15.46:0/89871924 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000b9d0 con 0x7fcae00699e0 2023-10-07T09:04:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.546+0000 7fcae5052700 1 -- 172.21.15.46:0/89871924 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad00092e0 con 0x7fcae00699e0 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 -- 172.21.15.46:0/89871924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 msgr2=0x7fcae00b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 --2- 172.21.15.46:0/89871924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009f20 tx=0x7fcad0009840 comp rx=0 tx=0).stop 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 -- 172.21.15.46:0/89871924 shutdown_connections 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 --2- 172.21.15.46:0/89871924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae00b05e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 --2- 172.21.15.46:0/89871924 >> v2:172.21.15.133:3300/0 conn(0x7fcae0159c10 0x7fcae00694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 -- 172.21.15.46:0/89871924 >> 172.21.15.46:0/89871924 conn(0x7fcae0068e10 msgr2=0x7fcae00d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 -- 172.21.15.46:0/89871924 shutdown_connections 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.547+0000 7fcae82b8700 1 -- 172.21.15.46:0/89871924 wait complete. 2023-10-07T09:04:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.548+0000 7fcae82b8700 1 Processor -- start 2023-10-07T09:04:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.548+0000 7fcae82b8700 1 -- start start 2023-10-07T09:04:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae0154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcae0159840 0x7fcae00c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00c7d30 con 0x7fcae0159c10 2023-10-07T09:04:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00c7a00 con 0x7fcae0159840 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae82b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00ca0b0 con 0x7fcae00699e0 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32910/0 (socket says 172.21.15.46:32910) 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 -- 172.21.15.46:0/1195451771 learned_addr learned my addr 172.21.15.46:0/1195451771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae5853700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcae0159840 0x7fcae00c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6054700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 -- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 msgr2=0x7fcae0154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae0154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 -- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcae0159840 msgr2=0x7fcae00c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcae0159840 0x7fcae00c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 -- 172.21.15.46:0/1195451771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009ae0 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.549+0000 7fcae6855700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcad000b610 tx=0x7fcad0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.550+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0007020 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.550+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0007b70 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.550+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae00ca390 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.550+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad001d420 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.550+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae00ca670 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.551+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0064550 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.551+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fcad0003050 con 0x7fcae0159c10 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.551+0000 7fcade7fc700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 0x7fcacc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.551+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcad00867f0 con 0x7fcae0159c10 2023-10-07T09:04:51.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.552+0000 7fcae6054700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 0x7fcacc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:51.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.552+0000 7fcae6054700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 0x7fcacc069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001370 tx=0x7fcad8007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:51.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.556+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcad0053540 con 0x7fcae0159c10 2023-10-07T09:04:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.796+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcae004c3c0 con 0x7fcae0159c10 2023-10-07T09:04:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.796+0000 7fcade7fc700 1 -- 172.21.15.46:0/1195451771 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcad0056b60 con 0x7fcae0159c10 2023-10-07T09:04:51.798 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 msgr2=0x7fcacc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 0x7fcacc069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001370 tx=0x7fcad8007ba0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 msgr2=0x7fcae0169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcad000b610 tx=0x7fcad0018000 comp rx=0 tx=0).stop 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 shutdown_connections 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcacc067290 0x7fcacc069740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcae0159c10 0x7fcae0169640 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcae00699e0 0x7fcae0154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 --2- 172.21.15.46:0/1195451771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcae0159840 0x7fcae00c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 >> 172.21.15.46:0/1195451771 conn(0x7fcae0068e10 msgr2=0x7fcae0155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 shutdown_connections 2023-10-07T09:04:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:51.798+0000 7fcae82b8700 1 -- 172.21.15.46:0/1195451771 wait complete. 2023-10-07T09:04:51.811 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:51.812 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:51.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:51.812 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:04:51.827 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:04:51.828 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42122sec preferred_lft 42122sec 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:51.829 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.830 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:51.831 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:04:51.831 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:04:51.831 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:51.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:51.831 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:51.895 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:04:51.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:51.898 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:04:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:04:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:04:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:04:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:51.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:04:51.955 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:04:52.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.057 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:04:52.071 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:04:52.072 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:04:52.072 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:52.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:04:52.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:52.137 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:52.192 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:04:52.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:52.193 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:52.247 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:04:52.247 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:52.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:52.328 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:52.328 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:52.347 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:52.368 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:52.368 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:52.369 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:52.371 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:52.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:52.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:04:52.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.597+0000 7fac32fc2700 1 Processor -- start 2023-10-07T09:04:52.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.597+0000 7fac32fc2700 1 -- start start 2023-10-07T09:04:52.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac32fc2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac2c159890 0x7fac2c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac32fc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 0x7fac2c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac32fc2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c15a160 con 0x7fac2c15db10 2023-10-07T09:04:52.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac32fc2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c15df50 con 0x7fac2c159890 2023-10-07T09:04:52.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac32fc2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0d13a0 con 0x7fac2c159c60 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac2c159890 0x7fac2c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac3155f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fac2c15db10 0x7fac2c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38890/0 (socket says 172.21.15.46:38890) 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac3155f700 1 -- 172.21.15.46:0/2755298609 learned_addr learned my addr 172.21.15.46:0/2755298609 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 -- 172.21.15.46:0/2755298609 >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 msgr2=0x7fac2c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac2bfff700 1 --2- 172.21.15.46:0/2755298609 >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 0x7fac2c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 --2- 172.21.15.46:0/2755298609 >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 0x7fac2c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 -- 172.21.15.46:0/2755298609 >> v1:172.21.15.46:6789/0 conn(0x7fac2c15db10 legacy=0x7fac2c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 -- 172.21.15.46:0/2755298609 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c15e140 con 0x7fac2c159890 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac2b7fe700 1 -- 172.21.15.46:0/2755298609 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751306324 0 0) 0x7fac2c15a160 con 0x7fac2c15db10 2023-10-07T09:04:52.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac2bfff700 1 --2- 172.21.15.46:0/2755298609 >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 0x7fac2c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.598+0000 7fac30d5e700 1 --2- 172.21.15.46:0/2755298609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c159890 0x7fac2c15abd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0b67f0 tx=0x7fac200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d4375047a73b59 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac2b7fe700 1 -- 172.21.15.46:0/2755298609 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000b6b0 con 0x7fac2c159890 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac2b7fe700 1 -- 172.21.15.46:0/2755298609 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000b810 con 0x7fac2c159890 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac2b7fe700 1 -- 172.21.15.46:0/2755298609 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000bbb0 con 0x7fac2c159890 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 -- 172.21.15.46:0/2755298609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c159890 msgr2=0x7fac2c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 --2- 172.21.15.46:0/2755298609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c159890 0x7fac2c15abd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0b67f0 tx=0x7fac200091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 -- 172.21.15.46:0/2755298609 shutdown_connections 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 --2- 172.21.15.46:0/2755298609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c159890 0x7fac2c15abd0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 --2- 172.21.15.46:0/2755298609 >> v2:172.21.15.133:3300/0 conn(0x7fac2c159c60 0x7fac2c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 -- 172.21.15.46:0/2755298609 >> 172.21.15.46:0/2755298609 conn(0x7fac2c068e20 msgr2=0x7fac2c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:52.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 -- 172.21.15.46:0/2755298609 shutdown_connections 2023-10-07T09:04:52.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.599+0000 7fac32fc2700 1 -- 172.21.15.46:0/2755298609 wait complete. 2023-10-07T09:04:52.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.600+0000 7fac32fc2700 1 Processor -- start 2023-10-07T09:04:52.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 -- start start 2023-10-07T09:04:52.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 0x7fac2c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 0x7fac2c147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0b4df0 con 0x7fac2c15db10 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1477a0 con 0x7fac2c159c60 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac32fc2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c169f90 con 0x7fac2c159890 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac3155f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac3155f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32934/0 (socket says 172.21.15.46:32934) 2023-10-07T09:04:52.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac3155f700 1 -- 172.21.15.46:0/3523845990 learned_addr learned my addr 172.21.15.46:0/3523845990 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac30d5e700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 0x7fac2c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.601+0000 7fac2bfff700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 0x7fac2c147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 -- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 msgr2=0x7fac2c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 0x7fac2c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 -- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 msgr2=0x7fac2c147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 0x7fac2c147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 -- 172.21.15.46:0/3523845990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009420 con 0x7fac2c15db10 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac30d5e700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 0x7fac2c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:52.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac2bfff700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 0x7fac2c147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac3155f700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fac2400cbf0 tx=0x7fac240019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400a9c0 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400ab20 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c16a270 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240070f0 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.602+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c16a830 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.603+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c04c3c0 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.604+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fac24007520 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.604+0000 7fac28ff9700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 0x7fac10069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.604+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac24084f70 con 0x7fac2c15db10 2023-10-07T09:04:52.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.604+0000 7fac30d5e700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 0x7fac10069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:52.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.605+0000 7fac30d5e700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 0x7fac10069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fac200093f0 tx=0x7fac20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:52.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.608+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac24051d50 con 0x7fac2c15db10 2023-10-07T09:04:52.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.851+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac2c06a5b0 con 0x7fac2c15db10 2023-10-07T09:04:52.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.851+0000 7fac28ff9700 1 -- 172.21.15.46:0/3523845990 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac24055370 con 0x7fac2c15db10 2023-10-07T09:04:52.853 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:04:52.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 msgr2=0x7fac10069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 0x7fac10069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fac200093f0 tx=0x7fac20017000 comp rx=0 tx=0).stop 2023-10-07T09:04:52.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 msgr2=0x7fac2c0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fac2400cbf0 tx=0x7fac240019b0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 shutdown_connections 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fac10067290 0x7fac10069740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2c15db10 0x7fac2c0ca4a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac2c159890 0x7fac2c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 --2- 172.21.15.46:0/3523845990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac2c159c60 0x7fac2c147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 >> 172.21.15.46:0/3523845990 conn(0x7fac2c068e20 msgr2=0x7fac2c0b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 shutdown_connections 2023-10-07T09:04:52.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:52.853+0000 7fac32fc2700 1 -- 172.21.15.46:0/3523845990 wait complete. 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:04:52.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:04:52.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:04:52.868 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:52.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.868 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:04:52.886 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:52.887 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42113sec preferred_lft 42113sec 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:04:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:04:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:04:52.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.890 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:04:52.955 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:04:52.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:52.957 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:04:53.015 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:04:53.016 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:04:53.016 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:04:53.016 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:04:53.016 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:04:53.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:53.016 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:04:53.016 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:04:53.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:04:53.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:04:53.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:04:53.017 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:04:53.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:53.124 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:04:53.139 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:04:53.140 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:04:53.140 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:53.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:53.140 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:04:53.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:53.206 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:53.263 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:04:53.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:04:53.264 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:53.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:04:53.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:04:53.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:53.399 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:53.399 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:53.418 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:53.419 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:53.419 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:53.440 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:04:53.440 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:04:53.440 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:04:53.440 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:04:53.440 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:04:53.441 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:04:53.442 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:04:53.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:53.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:53.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 Processor -- start 2023-10-07T09:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 -- start start 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0153f50 0x7f7cc00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cc006d840 0x7f7cc0069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00b4570 con 0x7f7cc0154320 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc015a730 con 0x7f7cc006d840 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.633+0000 7f7cc610d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc015aa10 con 0x7f7cc0153f50 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cc006d840 0x7f7cc0069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cc006d840 0x7f7cc0069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32950/0 (socket says 172.21.15.46:32950) 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 -- 172.21.15.46:0/2464061809 learned_addr learned my addr 172.21.15.46:0/2464061809 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbeffd700 1 --1- 172.21.15.46:0/2464061809 >> v1:172.21.15.46:6789/0 conn(0x7f7cc0154320 0x7f7cc006d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38894/0 (socket says 172.21.15.46:38894) 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbf7fe700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0153f50 0x7f7cc00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 -- 172.21.15.46:0/2464061809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0153f50 msgr2=0x7f7cc00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0153f50 0x7f7cc00b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 -- 172.21.15.46:0/2464061809 >> v1:172.21.15.46:6789/0 conn(0x7f7cc0154320 legacy=0x7f7cc006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 -- 172.21.15.46:0/2464061809 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc015acf0 con 0x7f7cc006d840 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbe7fc700 1 -- 172.21.15.46:0/2464061809 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497499775 0 0) 0x7f7cc00b4570 con 0x7f7cc0154320 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbffff700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0069e30 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80099b0 tx=0x7f7cb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715e3c7cfe332faa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbe7fc700 1 -- 172.21.15.46:0/2464061809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8009ea0 con 0x7f7cc006d840 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbe7fc700 1 -- 172.21.15.46:0/2464061809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb800b860 con 0x7f7cc006d840 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.634+0000 7f7cbe7fc700 1 -- 172.21.15.46:0/2464061809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800bc00 con 0x7f7cc006d840 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 -- 172.21.15.46:0/2464061809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 msgr2=0x7f7cc0069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0069e30 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80099b0 tx=0x7f7cb8009250 comp rx=0 tx=0).stop 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 -- 172.21.15.46:0/2464061809 shutdown_connections 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0069e30 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 --2- 172.21.15.46:0/2464061809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0153f50 0x7f7cc00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 -- 172.21.15.46:0/2464061809 >> 172.21.15.46:0/2464061809 conn(0x7f7cc006baf0 msgr2=0x7f7cc006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 -- 172.21.15.46:0/2464061809 shutdown_connections 2023-10-07T09:04:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.635+0000 7f7cc610d700 1 -- 172.21.15.46:0/2464061809 wait complete. 2023-10-07T09:04:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.636+0000 7f7cc610d700 1 Processor -- start 2023-10-07T09:04:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.636+0000 7f7cc610d700 1 -- start start 2023-10-07T09:04:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 0x7f7cc015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0154320 0x7f7cc015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0146600 con 0x7f7cc006d840 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01459f0 con 0x7f7cc0153f50 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cc610d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0145cd0 con 0x7f7cc0154320 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32962/0 (socket says 172.21.15.46:32962) 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 -- 172.21.15.46:0/3359286110 learned_addr learned my addr 172.21.15.46:0/3359286110 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbffff700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0154320 0x7f7cc015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbeffd700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 0x7f7cc015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 -- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0154320 msgr2=0x7f7cc015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0154320 0x7f7cc015e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 -- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 msgr2=0x7f7cc015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 0x7f7cc015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 -- 172.21.15.46:0/3359286110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80094f0 con 0x7f7cc006d840 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbeffd700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 0x7f7cc015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7cbf7fe700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009ef0 tx=0x7f7cb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.637+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000cc20 con 0x7f7cc006d840 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.638+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000f040 con 0x7f7cc006d840 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.638+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc0145fb0 con 0x7f7cc006d840 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.638+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0014480 con 0x7f7cc006d840 2023-10-07T09:04:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.638+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0146a90 con 0x7f7cc006d840 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.639+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc00718b0 con 0x7f7cc006d840 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.639+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7cb00147f0 con 0x7f7cc006d840 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.639+0000 7f7ca77fe700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 0x7f7cac069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.640+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cb0085570 con 0x7f7cc006d840 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.640+0000 7f7cbeffd700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 0x7f7cac069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.640+0000 7f7cbeffd700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 0x7f7cac069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4007fd0 tx=0x7f7cb4007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.644+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cb00522c0 con 0x7f7cc006d840 2023-10-07T09:04:53.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.888+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7cc015afd0 con 0x7f7cc006d840 2023-10-07T09:04:53.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.929+0000 7f7ca77fe700 1 -- 172.21.15.46:0/3359286110 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7cb00558e0 con 0x7f7cc006d840 2023-10-07T09:04:53.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 msgr2=0x7f7cac069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 0x7f7cac069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4007fd0 tx=0x7f7cb4007e30 comp rx=0 tx=0).stop 2023-10-07T09:04:53.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 msgr2=0x7f7cc0158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009ef0 tx=0x7f7cb000b040 comp rx=0 tx=0).stop 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 shutdown_connections 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7cac067290 0x7f7cac069740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7cc0154320 0x7f7cc015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cc006d840 0x7f7cc0158fe0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 --2- 172.21.15.46:0/3359286110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cc0153f50 0x7f7cc015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 >> 172.21.15.46:0/3359286110 conn(0x7f7cc006baf0 msgr2=0x7f7cc01530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 shutdown_connections 2023-10-07T09:04:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:53.931+0000 7f7cc610d700 1 -- 172.21.15.46:0/3359286110 wait complete. 2023-10-07T09:04:53.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:04:54.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.063+0000 7f27fd7fe700 1 Processor -- start 2023-10-07T09:04:54.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.063+0000 7f27fd7fe700 1 -- start start 2023-10-07T09:04:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27fd7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27f80b2060 0x7f27f8159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27fd7fe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80d01f0 con 0x7f27f80cd0f0 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27fd7fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80cd540 con 0x7f27f81594d0 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27fd7fe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80cf5e0 con 0x7f27f80b2060 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27f80b2060 0x7f27f8159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f67fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f27f80cd0f0 0x7f27f81598a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38904/0 (socket says 172.21.15.46:38904) 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f67fc700 1 -- 172.21.15.46:0/4236882775 learned_addr learned my addr 172.21.15.46:0/4236882775 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f77fe700 1 -- 172.21.15.46:0/4236882775 >> v1:172.21.15.133:6789/0 conn(0x7f27f81594d0 legacy=0x7f27f80b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f77fe700 1 -- 172.21.15.46:0/4236882775 >> v1:172.21.15.46:6789/0 conn(0x7f27f80cd0f0 legacy=0x7f27f81598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.064+0000 7f27f77fe700 1 -- 172.21.15.46:0/4236882775 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80cf8c0 con 0x7f27f80b2060 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27f77fe700 1 --2- 172.21.15.46:0/4236882775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f8159fb0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009e60 tx=0x7f27e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc9cf99cd933544 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27f5ffb700 1 -- 172.21.15.46:0/4236882775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800e070 con 0x7f27f80b2060 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27f5ffb700 1 -- 172.21.15.46:0/4236882775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800bc30 con 0x7f27f80b2060 2023-10-07T09:04:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27f5ffb700 1 -- 172.21.15.46:0/4236882775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8012430 con 0x7f27f80b2060 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 -- 172.21.15.46:0/4236882775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 msgr2=0x7f27f8159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/4236882775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f8159fb0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009e60 tx=0x7f27e8009780 comp rx=0 tx=0).stop 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 -- 172.21.15.46:0/4236882775 shutdown_connections 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/4236882775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f8159fb0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 -- 172.21.15.46:0/4236882775 >> 172.21.15.46:0/4236882775 conn(0x7f27f80d05f0 msgr2=0x7f27f80d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 -- 172.21.15.46:0/4236882775 shutdown_connections 2023-10-07T09:04:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.065+0000 7f27fd7fe700 1 -- 172.21.15.46:0/4236882775 wait complete. 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 Processor -- start 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 -- start start 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 0x7f27f81562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27f81594d0 0x7f27f8144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8156820 con 0x7f27f80b2060 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c5a00 con 0x7f27f80cd0f0 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27fd7fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f815d260 con 0x7f27f81594d0 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32982/0 (socket says 172.21.15.46:32982) 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.067+0000 7f27f6ffd700 1 -- 172.21.15.46:0/2613007246 learned_addr learned my addr 172.21.15.46:0/2613007246 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f67fc700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 0x7f27f81562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 -- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27f81594d0 msgr2=0x7f27f8144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27f81594d0 0x7f27f8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 -- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 msgr2=0x7f27f81562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 0x7f27f81562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 -- 172.21.15.46:0/2613007246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009a20 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f67fc700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 0x7f27f81562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27f6ffd700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c590 tx=0x7f27f0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011590 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0011730 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f815d540 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011af0 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.068+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f815db00 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.069+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f815dd20 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.070+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f27f0012420 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.070+0000 7f27eeffd700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 0x7f27d8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.070+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27f0083db0 con 0x7f27f80b2060 2023-10-07T09:04:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.070+0000 7f27f67fc700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 0x7f27d8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.071+0000 7f27f67fc700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 0x7f27d8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b5a70 tx=0x7f27e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.074+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27f004b5a0 con 0x7f27f80b2060 2023-10-07T09:04:54.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.294+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f27f804c3c0 con 0x7f27d8067290 2023-10-07T09:04:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.296+0000 7f27eeffd700 1 -- 172.21.15.46:0/2613007246 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f27f804c3c0 con 0x7f27d8067290 2023-10-07T09:04:54.298 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:04:54.298 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:54.298 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:04:54.298 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:54.299 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:04:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 msgr2=0x7f27d8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 0x7f27d8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b5a70 tx=0x7f27e0009040 comp rx=0 tx=0).stop 2023-10-07T09:04:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 msgr2=0x7f27f80c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c590 tx=0x7f27f0007f30 comp rx=0 tx=0).stop 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 shutdown_connections 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27d8067290 0x7f27d8069740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27f81594d0 0x7f27f8144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27f80b2060 0x7f27f80c5390 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 --2- 172.21.15.46:0/2613007246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80cd0f0 0x7f27f81562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 >> 172.21.15.46:0/2613007246 conn(0x7f27f80d05f0 msgr2=0x7f27f8155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:54.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 shutdown_connections 2023-10-07T09:04:54.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.298+0000 7f27fd7fe700 1 -- 172.21.15.46:0/2613007246 wait complete. 2023-10-07T09:04:54.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:04:54.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 Processor -- start 2023-10-07T09:04:54.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 -- start start 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e28140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2815c2a0 con 0x7f8e280c9510 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2815b690 con 0x7f8e2806c0a0 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.433+0000 7f8e2d6a4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815b970 con 0x7f8e2806bcd0 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e277fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8e280c9510 0x7f8e280cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38920/0 (socket says 172.21.15.46:38920) 2023-10-07T09:04:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e277fe700 1 -- 172.21.15.46:0/1124556224 learned_addr learned my addr 172.21.15.46:0/1124556224 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e28140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520922522 0 0) 0x7f8e2815c2a0 con 0x7f8e280c9510 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e14003570 con 0x7f8e280c9510 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15727362 0 0) 0x7f8e14003570 con 0x7f8e280c9510 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 msgr2=0x7f8e28140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e28140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 >> v1:172.21.15.133:6789/0 conn(0x7f8e2806c0a0 legacy=0x7f8e280c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2815bc50 con 0x7f8e280c9510 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f8e20001470 con 0x7f8e280c9510 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 >> v1:172.21.15.46:6789/0 conn(0x7f8e280c9510 legacy=0x7f8e280cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e14004810 0x7f8e14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e140051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815b970 con 0x7f8e14004810 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1400bb60 con 0x7f8e14003a90 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1400bd20 con 0x7f8e2806bcd0 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e267fc700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e14004810 0x7f8e14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.434+0000 7f8e277fe700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e140051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 -- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 msgr2=0x7f8e140051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e140051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 -- 172.21.15.46:0/1124556224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e14004810 msgr2=0x7f8e14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:54.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e14004810 0x7f8e14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 -- 172.21.15.46:0/1124556224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14003570 con 0x7f8e14003a90 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e267fc700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e14004810 0x7f8e14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e277fe700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e2806bcd0 0x7f8e140051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e14003ea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800e210 tx=0x7f8e1800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637059d73c74ab64 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800eac0 con 0x7f8e14003a90 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800f040 con 0x7f8e14003a90 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.435+0000 7f8e25ffb700 1 -- 172.21.15.46:0/1124556224 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800ee70 con 0x7f8e14003a90 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 msgr2=0x7f8e14003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/1124556224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e14003ea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800e210 tx=0x7f8e1800b040 comp rx=0 tx=0).stop 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e277fe700 1 -- 172.21.15.46:0/1124556224 reap_dead start 2023-10-07T09:04:54.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/1124556224 shutdown_connections 2023-10-07T09:04:54.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/1124556224 >> 172.21.15.46:0/1124556224 conn(0x7f8e280ce600 msgr2=0x7f8e280cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:54.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/1124556224 shutdown_connections 2023-10-07T09:04:54.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.436+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/1124556224 wait complete. 2023-10-07T09:04:54.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.437+0000 7f8e2d6a4700 1 Processor -- start 2023-10-07T09:04:54.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.437+0000 7f8e2d6a4700 1 -- start start 2023-10-07T09:04:54.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e2813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e280c8640 0x7f8e280c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2813ee50 con 0x7f8e2813f2e0 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28158d60 con 0x7f8e14003a90 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2813c0c0 con 0x7f8e280c8640 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33012/0 (socket says 172.21.15.46:33012) 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 -- 172.21.15.46:0/871656603 learned_addr learned my addr 172.21.15.46:0/871656603 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e277fe700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e280c8640 0x7f8e280c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e2813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 -- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e280c8640 msgr2=0x7f8e280c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e280c8640 0x7f8e280c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 -- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 msgr2=0x7f8e2813bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e2813bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 -- 172.21.15.46:0/871656603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2813e240 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e2813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e267fc700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000fa00 tx=0x7f8e10009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000d850 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000d9b0 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2813e520 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000dd50 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.438+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2813eae0 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.439+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2804c3c0 con 0x7f8e2813f2e0 2023-10-07T09:04:54.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.440+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f8e10013600 con 0x7f8e2813f2e0 2023-10-07T09:04:54.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.440+0000 7f8e1effd700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 0x7f8e08069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.440+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e10084cc0 con 0x7f8e2813f2e0 2023-10-07T09:04:54.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.440+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 0x7f8e08069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.441+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 0x7f8e08069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800afd0 tx=0x7f8e1801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.444+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e10051be0 con 0x7f8e2813f2e0 2023-10-07T09:04:54.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.636+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e2815bf30 con 0x7f8e2813f2e0 2023-10-07T09:04:54.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.636+0000 7f8e1effd700 1 -- 172.21.15.46:0/871656603 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e10055200 con 0x7f8e2813f2e0 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 msgr2=0x7f8e08069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 0x7f8e08069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800afd0 tx=0x7f8e1801a000 comp rx=0 tx=0).stop 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 msgr2=0x7f8e280c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000fa00 tx=0x7f8e10009040 comp rx=0 tx=0).stop 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 shutdown_connections 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8e08067290 0x7f8e08069740 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e280c8640 0x7f8e280c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e14003a90 0x7f8e2813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 --2- 172.21.15.46:0/871656603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2813f2e0 0x7f8e280c8100 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 >> 172.21.15.46:0/871656603 conn(0x7f8e280ce600 msgr2=0x7f8e280c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 shutdown_connections 2023-10-07T09:04:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.638+0000 7f8e2d6a4700 1 -- 172.21.15.46:0/871656603 wait complete. 2023-10-07T09:04:54.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-07T09:04:54.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.771+0000 7fd5f9780700 1 Processor -- start 2023-10-07T09:04:54.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.771+0000 7fd5f9780700 1 -- start start 2023-10-07T09:04:54.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f9780700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd5f40b16d0 0x7fd5f40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f9780700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 0x7fd5f40b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f9780700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40b2080 con 0x7fd5f40b4e70 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f9780700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40cfb00 con 0x7fd5f40b16d0 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f9780700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40b5c40 con 0x7fd5f40b33b0 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f3fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5f40b4e70 0x7fd5f40ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38922/0 (socket says 172.21.15.46:38922) 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f3fff700 1 -- 172.21.15.46:0/1171543082 learned_addr learned my addr 172.21.15.46:0/1171543082 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/1171543082 >> v2:172.21.15.46:3300/0 conn(0x7fd5f40b16d0 0x7fd5f40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f2ffd700 1 -- 172.21.15.46:0/1171543082 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208636016 0 0) 0x7fd5f40b2080 con 0x7fd5f40b4e70 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f2ffd700 1 -- 172.21.15.46:0/1171543082 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc003570 con 0x7fd5f40b4e70 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f8f7f700 1 --2- 172.21.15.46:0/1171543082 >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 0x7fd5f40b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f37fe700 1 -- 172.21.15.46:0/1171543082 >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 msgr2=0x7fd5f40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/1171543082 >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 0x7fd5f40b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f37fe700 1 -- 172.21.15.46:0/1171543082 >> v1:172.21.15.46:6789/0 conn(0x7fd5f40b4e70 legacy=0x7fd5f40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.772+0000 7fd5f37fe700 1 -- 172.21.15.46:0/1171543082 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40b5f20 con 0x7fd5f40b16d0 2023-10-07T09:04:54.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f8f7f700 1 --2- 172.21.15.46:0/1171543082 >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 0x7fd5f40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/1171543082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b16d0 0x7fd5f40b1b40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4071380 tx=0x7fd5e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db10b634e02ee06 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f2ffd700 1 -- 172.21.15.46:0/1171543082 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011630 con 0x7fd5f40b16d0 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f2ffd700 1 -- 172.21.15.46:0/1171543082 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8011790 con 0x7fd5f40b16d0 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f2ffd700 1 -- 172.21.15.46:0/1171543082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011b30 con 0x7fd5f40b16d0 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 -- 172.21.15.46:0/1171543082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b16d0 msgr2=0x7fd5f40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 --2- 172.21.15.46:0/1171543082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b16d0 0x7fd5f40b1b40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4071380 tx=0x7fd5e80091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 -- 172.21.15.46:0/1171543082 shutdown_connections 2023-10-07T09:04:54.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 --2- 172.21.15.46:0/1171543082 >> v2:172.21.15.133:3300/0 conn(0x7fd5f40b33b0 0x7fd5f40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 --2- 172.21.15.46:0/1171543082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b16d0 0x7fd5f40b1b40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 -- 172.21.15.46:0/1171543082 >> 172.21.15.46:0/1171543082 conn(0x7fd5f40d10c0 msgr2=0x7fd5f40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:54.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 -- 172.21.15.46:0/1171543082 shutdown_connections 2023-10-07T09:04:54.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.773+0000 7fd5f9780700 1 -- 172.21.15.46:0/1171543082 wait complete. 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.774+0000 7fd5f9780700 1 Processor -- start 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 -- start start 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 0x7fd5f414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5f40b4e70 0x7fd5f40b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c7250 con 0x7fd5f40b33b0 2023-10-07T09:04:54.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c6360 con 0x7fd5f40b16d0 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f9780700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c6640 con 0x7fd5f40b4e70 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33034/0 (socket says 172.21.15.46:33034) 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.775+0000 7fd5f37fe700 1 -- 172.21.15.46:0/2447109872 learned_addr learned my addr 172.21.15.46:0/2447109872 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f8f7f700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5f40b4e70 0x7fd5f40b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f3fff700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 0x7fd5f414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 -- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5f40b4e70 msgr2=0x7fd5f40b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5f40b4e70 0x7fd5f40b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 -- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 msgr2=0x7fd5f414c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 0x7fd5f414c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 -- 172.21.15.46:0/2447109872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009420 con 0x7fd5f40b33b0 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f3fff700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 0x7fd5f414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:54.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f37fe700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4070dd0 tx=0x7fd5e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011b10 con 0x7fd5f40b33b0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e80253f0 con 0x7fd5f40b33b0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40c6920 con 0x7fd5f40b33b0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80257d0 con 0x7fd5f40b33b0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.776+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40c6ee0 con 0x7fd5f40b33b0 2023-10-07T09:04:54.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.777+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f4088990 con 0x7fd5f40b33b0 2023-10-07T09:04:54.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.778+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fd5e8025c00 con 0x7fd5f40b33b0 2023-10-07T09:04:54.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.778+0000 7fd5dbfff700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 0x7fd5e0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:54.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.778+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5e8086270 con 0x7fd5f40b33b0 2023-10-07T09:04:54.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.778+0000 7fd5f3fff700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 0x7fd5e0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:54.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.779+0000 7fd5f3fff700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 0x7fd5e0069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:54.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:54.782+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5e80530d0 con 0x7fd5f40b33b0 2023-10-07T09:04:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.008+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5f40c7390 con 0x7fd5e0067290 2023-10-07T09:04:55.016 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:55.015+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:55.016 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:55.015+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:55.016 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:55.015+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:55.016 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:55.015+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:55.016 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:04:55.015+0000 7f470fd46700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T09:04:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.020+0000 7fd5dbfff700 1 -- 172.21.15.46:0/2447109872 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+472 (secure 0 0 0) 0x7fd5f40c7390 con 0x7fd5e0067290 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_addrs": [ 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.46:6789", 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6789", 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "172.21.15.133:6790" 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": { 2023-10-07T09:04:55.022 INFO:teuthology.orchestra.run.smithi046.stdout: "data": [ 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365977698304, 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_data", 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 0 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": [ 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "avail": 365977698304, 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs_metadata", 2023-10-07T09:04:55.023 INFO:teuthology.orchestra.run.smithi046.stdout: "used": 65536 2023-10-07T09:04:55.024 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:55.024 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:04:55.024 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:04:55.024 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 msgr2=0x7fd5e0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 0x7fd5e0069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 msgr2=0x7fd5f40afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4070dd0 tx=0x7fd5e8017000 comp rx=0 tx=0).stop 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 shutdown_connections 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5e0067290 0x7fd5e0069740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5f40b4e70 0x7fd5f40b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f40b16d0 0x7fd5f414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 --2- 172.21.15.46:0/2447109872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5f40b33b0 0x7fd5f40afef0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 >> 172.21.15.46:0/2447109872 conn(0x7fd5f40d10c0 msgr2=0x7fd5f40b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 shutdown_connections 2023-10-07T09:04:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.022+0000 7fd5f9780700 1 -- 172.21.15.46:0/2447109872 wait complete. 2023-10-07T09:04:55.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:04:55.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:55.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:04:55.120 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:04:55.121 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:04:55.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:55.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:04:55.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:04:55.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:55.162 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:04:55.217 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:04:55.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:04:55.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:04:55.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:04:55.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:04:55.263 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:04:55.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:55.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.396+0000 7f1c78cae700 1 Processor -- start 2023-10-07T09:04:55.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.396+0000 7f1c78cae700 1 -- start start 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c78cae700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c74141500 0x7f1c740c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c78cae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c7406c0a0 0x7f1c740c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c78cae700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7415c2a0 con 0x7f1c7406bcd0 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c78cae700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c740c9880 con 0x7f1c74141500 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c78cae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7415b690 con 0x7f1c7406c0a0 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c7259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c7406bcd0 0x7f1c74140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38932/0 (socket says 172.21.15.46:38932) 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c7259c700 1 -- 172.21.15.46:0/3275699637 learned_addr learned my addr 172.21.15.46:0/3275699637 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.397+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3275699637 >> v2:172.21.15.46:3300/0 conn(0x7f1c74141500 0x7f1c740c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c72d9d700 1 --2- 172.21.15.46:0/3275699637 >> v2:172.21.15.133:3300/0 conn(0x7f1c7406c0a0 0x7f1c740c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c6bfff700 1 -- 172.21.15.46:0/3275699637 >> v2:172.21.15.133:3300/0 conn(0x7f1c7406c0a0 msgr2=0x7f1c740c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3275699637 >> v2:172.21.15.133:3300/0 conn(0x7f1c7406c0a0 0x7f1c740c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c6bfff700 1 -- 172.21.15.46:0/3275699637 >> v1:172.21.15.46:6789/0 conn(0x7f1c7406bcd0 legacy=0x7f1c74140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c6bfff700 1 -- 172.21.15.46:0/3275699637 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7415b970 con 0x7f1c74141500 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c71d9b700 1 -- 172.21.15.46:0/3275699637 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962650772 0 0) 0x7f1c7415c2a0 con 0x7f1c7406bcd0 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3275699637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c74141500 0x7f1c740c8e00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cf210 tx=0x7f1c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1273dab81e69b5c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c71d9b700 1 -- 172.21.15.46:0/3275699637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00b6b0 con 0x7f1c74141500 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c71d9b700 1 -- 172.21.15.46:0/3275699637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00b810 con 0x7f1c74141500 2023-10-07T09:04:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.398+0000 7f1c71d9b700 1 -- 172.21.15.46:0/3275699637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00bbb0 con 0x7f1c74141500 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 -- 172.21.15.46:0/3275699637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c74141500 msgr2=0x7f1c740c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 --2- 172.21.15.46:0/3275699637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c74141500 0x7f1c740c8e00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cf210 tx=0x7f1c5c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 -- 172.21.15.46:0/3275699637 shutdown_connections 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 --2- 172.21.15.46:0/3275699637 >> v2:172.21.15.133:3300/0 conn(0x7f1c7406c0a0 0x7f1c740c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 --2- 172.21.15.46:0/3275699637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c74141500 0x7f1c740c8e00 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 -- 172.21.15.46:0/3275699637 >> 172.21.15.46:0/3275699637 conn(0x7f1c740ce600 msgr2=0x7f1c740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:55.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 -- 172.21.15.46:0/3275699637 shutdown_connections 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.399+0000 7f1c78cae700 1 -- 172.21.15.46:0/3275699637 wait complete. 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 Processor -- start 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 -- start start 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c7406bcd0 0x7f1c74169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 0x7f1c7416b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7413d770 con 0x7f1c7406c0a0 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c741287e0 con 0x7f1c7406bcd0 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.400+0000 7f1c78cae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c74127bd0 con 0x7f1c74141500 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33058/0 (socket says 172.21.15.46:33058) 2023-10-07T09:04:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 -- 172.21.15.46:0/730791118 learned_addr learned my addr 172.21.15.46:0/730791118 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c7259c700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c7406bcd0 0x7f1c74169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c72d9d700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 0x7f1c7416b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 -- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 msgr2=0x7f1c7416b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 0x7f1c7416b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 -- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c7406bcd0 msgr2=0x7f1c74169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c7406bcd0 0x7f1c74169540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 -- 172.21.15.46:0/730791118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c7406c0a0 2023-10-07T09:04:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c72d9d700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 0x7f1c7416b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00b0e0 tx=0x7f1c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00bb90 con 0x7f1c7406c0a0 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c011420 con 0x7f1c7406c0a0 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c74127eb0 con 0x7f1c7406c0a0 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0117c0 con 0x7f1c7406c0a0 2023-10-07T09:04:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.401+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c74128470 con 0x7f1c7406c0a0 2023-10-07T09:04:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.402+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c74157e90 con 0x7f1c7406c0a0 2023-10-07T09:04:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.403+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1c5c011b70 con 0x7f1c7406c0a0 2023-10-07T09:04:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.403+0000 7f1c6a7fc700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 0x7f1c54069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.403+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c5c0862f0 con 0x7f1c7406c0a0 2023-10-07T09:04:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.403+0000 7f1c7259c700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 0x7f1c54069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.404+0000 7f1c7259c700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 0x7f1c54069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1c64007fd0 tx=0x7f1c64007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.407+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c5c053150 con 0x7f1c7406c0a0 2023-10-07T09:04:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.642+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c74128970 con 0x7f1c7406c0a0 2023-10-07T09:04:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.643+0000 7f1c6a7fc700 1 -- 172.21.15.46:0/730791118 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f1c5c056770 con 0x7f1c7406c0a0 2023-10-07T09:04:55.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:55.645 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.644+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 msgr2=0x7f1c54069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.644+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 0x7f1c54069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1c64007fd0 tx=0x7f1c64007d30 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 msgr2=0x7f1c7416ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00b0e0 tx=0x7f1c5c017000 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 shutdown_connections 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c54067290 0x7f1c54069740 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c74141500 0x7f1c7416b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c7406bcd0 0x7f1c74169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 --2- 172.21.15.46:0/730791118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7406c0a0 0x7f1c7416ae80 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 >> 172.21.15.46:0/730791118 conn(0x7f1c740ce600 msgr2=0x7f1c74157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:55.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 shutdown_connections 2023-10-07T09:04:55.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.645+0000 7f1c78cae700 1 -- 172.21.15.46:0/730791118 wait complete. 2023-10-07T09:04:55.648 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 66 2023-10-07T09:04:55.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:55.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.775+0000 7f139ba6f700 1 Processor -- start 2023-10-07T09:04:55.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 -- start start 2023-10-07T09:04:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1394159c60 0x7f139415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f139415db10 0x7f1394069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139415a160 con 0x7f1394159890 2023-10-07T09:04:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940d13a0 con 0x7f139415db10 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.776+0000 7f139ba6f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139415e140 con 0x7f1394159c60 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f139415db10 0x7f1394069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f139415db10 0x7f1394069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33062/0 (socket says 172.21.15.46:33062) 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 -- 172.21.15.46:0/384986862 learned_addr learned my addr 172.21.15.46:0/384986862 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139900a700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1394159c60 0x7f139415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 -- 172.21.15.46:0/384986862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1394159c60 msgr2=0x7f139415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1394159c60 0x7f139415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 -- 172.21.15.46:0/384986862 >> v1:172.21.15.133:6789/0 conn(0x7f1394159890 legacy=0x7f139415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 -- 172.21.15.46:0/384986862 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139415a3d0 con 0x7f139415db10 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f139a00c700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f139415db10 0x7f1394069560 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f20 tx=0x7f1384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b1261721b7bc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f1398809700 1 -- 172.21.15.46:0/384986862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400e070 con 0x7f139415db10 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f1398809700 1 -- 172.21.15.46:0/384986862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138400ba80 con 0x7f139415db10 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.777+0000 7f1398809700 1 -- 172.21.15.46:0/384986862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13840092e0 con 0x7f139415db10 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 -- 172.21.15.46:0/384986862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f139415db10 msgr2=0x7f1394069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f139415db10 0x7f1394069560 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f20 tx=0x7f1384009840 comp rx=0 tx=0).stop 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 -- 172.21.15.46:0/384986862 shutdown_connections 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f139415db10 0x7f1394069560 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 --2- 172.21.15.46:0/384986862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1394159c60 0x7f139415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 -- 172.21.15.46:0/384986862 >> 172.21.15.46:0/384986862 conn(0x7f1394068e20 msgr2=0x7f13940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 -- 172.21.15.46:0/384986862 shutdown_connections 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.778+0000 7f139ba6f700 1 -- 172.21.15.46:0/384986862 wait complete. 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.779+0000 7f139ba6f700 1 Processor -- start 2023-10-07T09:04:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.779+0000 7f139ba6f700 1 -- start start 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1394159890 0x7f13941496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139415db10 0x7f1394152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394149c10 con 0x7f1394159c60 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940cdf20 con 0x7f1394159890 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139ba6f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1394152a90 con 0x7f139415db10 2023-10-07T09:04:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33064/0 (socket says 172.21.15.46:33064) 2023-10-07T09:04:55.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 -- 172.21.15.46:0/2462647223 learned_addr learned my addr 172.21.15.46:0/2462647223 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:55.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139980b700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1394159890 0x7f13941496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139a00c700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139415db10 0x7f1394152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 -- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139415db10 msgr2=0x7f1394152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139415db10 0x7f1394152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 -- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1394159890 msgr2=0x7f13941496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1394159890 0x7f13941496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 -- 172.21.15.46:0/2462647223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009ae0 con 0x7f1394159c60 2023-10-07T09:04:55.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.780+0000 7f139900a700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f138800d890 tx=0x7f1388008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.781+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880125f0 con 0x7f1394159c60 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.781+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388012770 con 0x7f1394159c60 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.781+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13940cd160 con 0x7f1394159c60 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.781+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388012b30 con 0x7f1394159c60 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.781+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13940cd720 con 0x7f1394159c60 2023-10-07T09:04:55.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.782+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139404c3c0 con 0x7f1394159c60 2023-10-07T09:04:55.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.782+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f138801e460 con 0x7f1394159c60 2023-10-07T09:04:55.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.782+0000 7f1391ffb700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 0x7f1380069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:55.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.783+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13880850b0 con 0x7f1394159c60 2023-10-07T09:04:55.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.783+0000 7f139980b700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 0x7f1380069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:55.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.783+0000 7f139980b700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 0x7f1380069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f138c003a80 tx=0x7f138c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:55.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.787+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1388051f10 con 0x7f1394159c60 2023-10-07T09:04:55.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.986+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f139415d2d0 con 0x7f1394159c60 2023-10-07T09:04:55.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.987+0000 7f1391ffb700 1 -- 172.21.15.46:0/2462647223 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1388055530 con 0x7f1394159c60 2023-10-07T09:04:55.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:55.989 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:45.919277+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:55.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 msgr2=0x7f1380069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 0x7f1380069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f138c003a80 tx=0x7f138c007ec0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 msgr2=0x7f1394151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:55.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f138800d890 tx=0x7f1388008040 comp rx=0 tx=0).stop 2023-10-07T09:04:55.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 shutdown_connections 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1380067290 0x7f1380069740 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139415db10 0x7f1394152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1394159890 0x7f13941496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 --2- 172.21.15.46:0/2462647223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1394159c60 0x7f1394151f20 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 >> 172.21.15.46:0/2462647223 conn(0x7f1394068e20 msgr2=0x7f13941538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 shutdown_connections 2023-10-07T09:04:55.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:55.989+0000 7f139ba6f700 1 -- 172.21.15.46:0/2462647223 wait complete. 2023-10-07T09:04:56.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:04:43.309433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:04:43.875055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:04:56.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:04:56.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.123+0000 7f28097d8700 1 Processor -- start 2023-10-07T09:04:56.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.123+0000 7f28097d8700 1 -- start start 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.124+0000 7f28097d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 0x7f28040c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.124+0000 7f28097d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 0x7f28040cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.124+0000 7f28097d8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28040c8650 con 0x7f28040aca80 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.124+0000 7f28097d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280406bdb0 con 0x7f2804069d60 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.124+0000 7f28097d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cb370 con 0x7f28040c81f0 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 0x7f28040cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28027fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 0x7f28040c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f2802ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28040aca80 0x7f280406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:45528/0 (socket says 172.21.15.46:45528) 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f2802ffd700 1 -- 172.21.15.46:0/2576637871 learned_addr learned my addr 172.21.15.46:0/2576637871 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:56.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 -- 172.21.15.46:0/2576637871 >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 msgr2=0x7f28040c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 --2- 172.21.15.46:0/2576637871 >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 0x7f28040c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 -- 172.21.15.46:0/2576637871 >> v1:172.21.15.133:6789/0 conn(0x7f28040aca80 legacy=0x7f280406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 -- 172.21.15.46:0/2576637871 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2804159f60 con 0x7f28040c81f0 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28027fc700 1 --2- 172.21.15.46:0/2576637871 >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 0x7f28040c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f2801ffb700 1 -- 172.21.15.46:0/2576637871 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197767864 0 0) 0x7f27fc0014e0 con 0x7f28040aca80 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f28037fe700 1 --2- 172.21.15.46:0/2576637871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 0x7f28040cb800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27f40098e0 tx=0x7f27f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcefc008cc94ec98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.125+0000 7f2801ffb700 1 -- 172.21.15.46:0/2576637871 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400b640 con 0x7f28040c81f0 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f2801ffb700 1 -- 172.21.15.46:0/2576637871 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400b7a0 con 0x7f28040c81f0 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f2801ffb700 1 -- 172.21.15.46:0/2576637871 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400bb40 con 0x7f28040c81f0 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 -- 172.21.15.46:0/2576637871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 msgr2=0x7f28040cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 --2- 172.21.15.46:0/2576637871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 0x7f28040cb800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27f40098e0 tx=0x7f27f40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 -- 172.21.15.46:0/2576637871 shutdown_connections 2023-10-07T09:04:56.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 --2- 172.21.15.46:0/2576637871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040c81f0 0x7f28040cb800 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 --2- 172.21.15.46:0/2576637871 >> v2:172.21.15.133:3300/0 conn(0x7f2804069d60 0x7f28040c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 -- 172.21.15.46:0/2576637871 >> 172.21.15.46:0/2576637871 conn(0x7f28040cd670 msgr2=0x7f28040cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:56.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 -- 172.21.15.46:0/2576637871 shutdown_connections 2023-10-07T09:04:56.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.126+0000 7f28097d8700 1 -- 172.21.15.46:0/2576637871 wait complete. 2023-10-07T09:04:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.127+0000 7f28097d8700 1 Processor -- start 2023-10-07T09:04:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.127+0000 7f28097d8700 1 -- start start 2023-10-07T09:04:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040aca80 0x7f280415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28040c81f0 0x7f28040b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040c5530 con 0x7f2804069d60 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040c5810 con 0x7f28040c81f0 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28097d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040c5af0 con 0x7f28040aca80 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33068/0 (socket says 172.21.15.46:33068) 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 -- 172.21.15.46:0/3467912490 learned_addr learned my addr 172.21.15.46:0/3467912490 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28037fe700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28040c81f0 0x7f28040b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f28027fc700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040aca80 0x7f280415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 -- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040aca80 msgr2=0x7f280415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040aca80 0x7f280415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 -- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28040c81f0 msgr2=0x7f28040b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28040c81f0 0x7f28040b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.128+0000 7f2802ffd700 1 -- 172.21.15.46:0/3467912490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009420 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f2802ffd700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00ccc0 tx=0x7f27fc001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00a810 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00a990 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f4009420 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00ad50 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.129+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28040c6130 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.130+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404c3c0 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.130+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f27fc012610 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.131+0000 7f27faffd700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 0x7f27e4069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.131+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27fc084ca0 con 0x7f2804069d60 2023-10-07T09:04:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.131+0000 7f28027fc700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 0x7f27e4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.131+0000 7f28027fc700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 0x7f27e4069770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f28040ac230 tx=0x7f27ec0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.135+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27fc051a80 con 0x7f2804069d60 2023-10-07T09:04:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.327+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28040c8650 con 0x7f2804069d60 2023-10-07T09:04:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.327+0000 7f27faffd700 1 -- 172.21.15.46:0/3467912490 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28040c8650 con 0x7f2804069d60 2023-10-07T09:04:56.329 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 msgr2=0x7f27e4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 0x7f27e4069770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f28040ac230 tx=0x7f27ec0091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 msgr2=0x7f28041594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00ccc0 tx=0x7f27fc001ac0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 shutdown_connections 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f27e40672c0 0x7f27e4069770 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28040c81f0 0x7f28040b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2804069d60 0x7f28041594f0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 --2- 172.21.15.46:0/3467912490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28040aca80 0x7f280415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 >> 172.21.15.46:0/3467912490 conn(0x7f28040cd670 msgr2=0x7f28040cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:56.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 shutdown_connections 2023-10-07T09:04:56.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.329+0000 7f28097d8700 1 -- 172.21.15.46:0/3467912490 wait complete. 2023-10-07T09:04:56.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:04:56.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.463+0000 7f0857620700 1 Processor -- start 2023-10-07T09:04:56.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.463+0000 7f0857620700 1 -- start start 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0857620700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0850159c60 0x7f085015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0857620700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f085015db10 0x7f0850069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0857620700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085015a160 con 0x7f0850159890 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0857620700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085015df50 con 0x7f0850159c60 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0857620700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500d13a0 con 0x7f085015db10 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0854bbb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0850159c60 0x7f085015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0854bbb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0850159c60 0x7f085015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33080/0 (socket says 172.21.15.46:33080) 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0854bbb700 1 -- 172.21.15.46:0/13745246 learned_addr learned my addr 172.21.15.46:0/13745246 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.464+0000 7f0855bbd700 1 --2- 172.21.15.46:0/13745246 >> v2:172.21.15.133:3300/0 conn(0x7f085015db10 0x7f0850069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0854bbb700 1 -- 172.21.15.46:0/13745246 >> v2:172.21.15.133:3300/0 conn(0x7f085015db10 msgr2=0x7f0850069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0854bbb700 1 --2- 172.21.15.46:0/13745246 >> v2:172.21.15.133:3300/0 conn(0x7f085015db10 0x7f0850069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0854bbb700 1 -- 172.21.15.46:0/13745246 >> v1:172.21.15.133:6789/0 conn(0x7f0850159890 legacy=0x7f085015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0854bbb700 1 -- 172.21.15.46:0/13745246 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085015e140 con 0x7f0850159c60 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0854bbb700 1 --2- 172.21.15.46:0/13745246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159c60 0x7f085015d5d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f085006a890 tx=0x7f0844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abc0f0d9611f821 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f084ffff700 1 -- 172.21.15.46:0/13745246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400b860 con 0x7f0850159c60 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f084ffff700 1 -- 172.21.15.46:0/13745246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084400b9c0 con 0x7f0850159c60 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f084ffff700 1 -- 172.21.15.46:0/13745246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400bd60 con 0x7f0850159c60 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 -- 172.21.15.46:0/13745246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159c60 msgr2=0x7f085015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 --2- 172.21.15.46:0/13745246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159c60 0x7f085015d5d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f085006a890 tx=0x7f0844009250 comp rx=0 tx=0).stop 2023-10-07T09:04:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 -- 172.21.15.46:0/13745246 shutdown_connections 2023-10-07T09:04:56.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 --2- 172.21.15.46:0/13745246 >> v2:172.21.15.133:3300/0 conn(0x7f085015db10 0x7f0850069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 --2- 172.21.15.46:0/13745246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159c60 0x7f085015d5d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 -- 172.21.15.46:0/13745246 >> 172.21.15.46:0/13745246 conn(0x7f0850068e20 msgr2=0x7f08500d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:56.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.465+0000 7f0857620700 1 -- 172.21.15.46:0/13745246 shutdown_connections 2023-10-07T09:04:56.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.466+0000 7f0857620700 1 -- 172.21.15.46:0/13745246 wait complete. 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 Processor -- start 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 -- start start 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0850159c60 0x7f085015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f085015db10 0x7f085015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850169ed0 con 0x7f0850159890 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.467+0000 7f0857620700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085016a1b0 con 0x7f0850159c60 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f0857620700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085016a490 con 0x7f085015db10 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33088/0 (socket says 172.21.15.46:33088) 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 -- 172.21.15.46:0/3218751709 learned_addr learned my addr 172.21.15.46:0/3218751709 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 -- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f085015db10 msgr2=0x7f085015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f085015db10 0x7f085015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 -- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0850159c60 msgr2=0x7f085015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0850159c60 0x7f085015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 -- 172.21.15.46:0/3218751709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440094f0 con 0x7f0850159890 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f08553bc700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f084800c590 tx=0x7f084800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848011590 con 0x7f0850159890 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480116f0 con 0x7f0850159890 2023-10-07T09:04:56.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085016a770 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848011ab0 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.468+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0850169b80 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.469+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08500d16c0 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.470+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f084801b3b0 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.470+0000 7f084d7fa700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 0x7f083c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.470+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0848084050 con 0x7f0850159890 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.470+0000 7f0854bbb700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 0x7f083c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.471+0000 7f0854bbb700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 0x7f083c069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f085006a890 tx=0x7f0844017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.474+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0848050eb0 con 0x7f0850159890 2023-10-07T09:04:56.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.667+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f085004c3c0 con 0x7f0850159890 2023-10-07T09:04:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.668+0000 7f084d7fa700 1 -- 172.21.15.46:0/3218751709 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08480170a0 con 0x7f0850159890 2023-10-07T09:04:56.670 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 msgr2=0x7f083c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 0x7f083c069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f085006a890 tx=0x7f0844017000 comp rx=0 tx=0).stop 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 msgr2=0x7f08501585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f084800c590 tx=0x7f084800c950 comp rx=0 tx=0).stop 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 shutdown_connections 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f083c067290 0x7f083c069740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f085015db10 0x7f085015d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850159890 0x7f08501585e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 --2- 172.21.15.46:0/3218751709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0850159c60 0x7f085015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 >> 172.21.15.46:0/3218751709 conn(0x7f0850068e20 msgr2=0x7f08500b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 shutdown_connections 2023-10-07T09:04:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.670+0000 7f0857620700 1 -- 172.21.15.46:0/3218751709 wait complete. 2023-10-07T09:04:56.684 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:04:56.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.804+0000 7fdb19a24700 1 Processor -- start 2023-10-07T09:04:56.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.804+0000 7fdb19a24700 1 -- start start 2023-10-07T09:04:56.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb19a24700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb14159c60 0x7fdb1415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb19a24700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb1415db10 0x7fdb14069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb19a24700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1415a160 con 0x7fdb14159890 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb19a24700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1415df50 con 0x7fdb1415db10 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb19a24700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140d13a0 con 0x7fdb14159c60 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb137fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb1415db10 0x7fdb14069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb12ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdb14159890 0x7fdb1415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38936/0 (socket says 172.21.15.46:38936) 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.805+0000 7fdb12ffd700 1 -- 172.21.15.46:0/286437077 learned_addr learned my addr 172.21.15.46:0/286437077 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb127fc700 1 --2- 172.21.15.46:0/286437077 >> v2:172.21.15.133:3300/0 conn(0x7fdb14159c60 0x7fdb1415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb11ffb700 1 -- 172.21.15.46:0/286437077 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575420904 0 0) 0x7fdb1415a160 con 0x7fdb14159890 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb11ffb700 1 -- 172.21.15.46:0/286437077 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb00003570 con 0x7fdb14159890 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb137fe700 1 -- 172.21.15.46:0/286437077 >> v2:172.21.15.133:3300/0 conn(0x7fdb14159c60 msgr2=0x7fdb1415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:56.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb137fe700 1 --2- 172.21.15.46:0/286437077 >> v2:172.21.15.133:3300/0 conn(0x7fdb14159c60 0x7fdb1415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb137fe700 1 -- 172.21.15.46:0/286437077 >> v1:172.21.15.46:6789/0 conn(0x7fdb14159890 legacy=0x7fdb1415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb137fe700 1 -- 172.21.15.46:0/286437077 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1415e140 con 0x7fdb1415db10 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb137fe700 1 --2- 172.21.15.46:0/286437077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1415db10 0x7fdb14069560 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdb140b67f0 tx=0x7fdb04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573803755ff78087 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb11ffb700 1 -- 172.21.15.46:0/286437077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400e070 con 0x7fdb1415db10 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb11ffb700 1 -- 172.21.15.46:0/286437077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400bb60 con 0x7fdb1415db10 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.806+0000 7fdb11ffb700 1 -- 172.21.15.46:0/286437077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04012430 con 0x7fdb1415db10 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 -- 172.21.15.46:0/286437077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1415db10 msgr2=0x7fdb14069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 --2- 172.21.15.46:0/286437077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1415db10 0x7fdb14069560 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdb140b67f0 tx=0x7fdb04009780 comp rx=0 tx=0).stop 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 -- 172.21.15.46:0/286437077 shutdown_connections 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 --2- 172.21.15.46:0/286437077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1415db10 0x7fdb14069560 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 --2- 172.21.15.46:0/286437077 >> v2:172.21.15.133:3300/0 conn(0x7fdb14159c60 0x7fdb1415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 -- 172.21.15.46:0/286437077 >> 172.21.15.46:0/286437077 conn(0x7fdb14068e20 msgr2=0x7fdb140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:56.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 -- 172.21.15.46:0/286437077 shutdown_connections 2023-10-07T09:04:56.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.807+0000 7fdb19a24700 1 -- 172.21.15.46:0/286437077 wait complete. 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.808+0000 7fdb19a24700 1 Processor -- start 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.808+0000 7fdb19a24700 1 -- start start 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb14159c60 0x7fdb140b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb1415db10 0x7fdb140c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14154770 con 0x7fdb14159890 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb141542e0 con 0x7fdb14159c60 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb19a24700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb141536d0 con 0x7fdb1415db10 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33116/0 (socket says 172.21.15.46:33116) 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 -- 172.21.15.46:0/117554638 learned_addr learned my addr 172.21.15.46:0/117554638 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb127fc700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb14159c60 0x7fdb140b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb137fe700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb1415db10 0x7fdb140c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 -- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb1415db10 msgr2=0x7fdb140c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb1415db10 0x7fdb140c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 -- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb14159c60 msgr2=0x7fdb140b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb14159c60 0x7fdb140b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 -- 172.21.15.46:0/117554638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04009a20 con 0x7fdb14159890 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.809+0000 7fdb12ffd700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c7c0 tx=0x7fdb0c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c005b30 con 0x7fdb14159890 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c005c90 con 0x7fdb14159890 2023-10-07T09:04:56.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb141539b0 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c007340 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb14153f70 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.810+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1404c3c0 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.811+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdb0c01b400 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.811+0000 7fdb0affd700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 0x7fdaf4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.811+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb0c084630 con 0x7fdb14159890 2023-10-07T09:04:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.812+0000 7fdb127fc700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 0x7fdaf4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.812+0000 7fdb127fc700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 0x7fdaf4069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb140cf9e0 tx=0x7fdafc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:56.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.816+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb0c051410 con 0x7fdb14159890 2023-10-07T09:04:56.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:56.943+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdb0c0517e0 con 0x7fdb14159890 2023-10-07T09:04:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.011+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb1406a5b0 con 0x7fdb14159890 2023-10-07T09:04:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.012+0000 7fdb0affd700 1 -- 172.21.15.46:0/117554638 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb0c054ea0 con 0x7fdb14159890 2023-10-07T09:04:57.014 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 msgr2=0x7fdaf4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 0x7fdaf4069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb140cf9e0 tx=0x7fdafc008040 comp rx=0 tx=0).stop 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 msgr2=0x7fdb14144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c7c0 tx=0x7fdb0c007e00 comp rx=0 tx=0).stop 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 shutdown_connections 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdaf4067290 0x7fdaf4069740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb1415db10 0x7fdb140c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb14159890 0x7fdb14144250 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 --2- 172.21.15.46:0/117554638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb14159c60 0x7fdb140b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 >> 172.21.15.46:0/117554638 conn(0x7fdb14068e20 msgr2=0x7fdb1415ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 shutdown_connections 2023-10-07T09:04:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.014+0000 7fdb19a24700 1 -- 172.21.15.46:0/117554638 wait complete. 2023-10-07T09:04:57.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.158+0000 7fb3d6e76700 1 Processor -- start 2023-10-07T09:04:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.158+0000 7fb3d6e76700 1 -- start start 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d6e76700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3d006bcd0 0x7fb3d0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d6e76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d6e76700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d015c2a0 con 0x7fb3d00c8e00 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d6e76700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d015b690 con 0x7fb3d006bcd0 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d6e76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d015b970 con 0x7fb3d006c0a0 2023-10-07T09:04:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3d006bcd0 0x7fb3d0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d5413700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb3d00c8e00 0x7fb3d00c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38940/0 (socket says 172.21.15.46:38940) 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3d006bcd0 0x7fb3d0140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33118/0 (socket says 172.21.15.46:33118) 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d5413700 1 -- 172.21.15.46:0/1331457472 learned_addr learned my addr 172.21.15.46:0/1331457472 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3cffff700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 -- 172.21.15.46:0/1331457472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 msgr2=0x7fb3d0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d0141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 -- 172.21.15.46:0/1331457472 >> v1:172.21.15.46:6789/0 conn(0x7fb3d00c8e00 legacy=0x7fb3d00c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3cf7fe700 1 -- 172.21.15.46:0/1331457472 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215099984 0 0) 0x7fb3d015c2a0 con 0x7fb3d00c8e00 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 -- 172.21.15.46:0/1331457472 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d015bc50 con 0x7fb3d006bcd0 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3cffff700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.159+0000 7fb3d4c12700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0140df0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009e60 tx=0x7fb3c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec435a9f42db5371 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3cf7fe700 1 -- 172.21.15.46:0/1331457472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800e070 con 0x7fb3d006bcd0 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3cf7fe700 1 -- 172.21.15.46:0/1331457472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c800bc30 con 0x7fb3d006bcd0 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3cf7fe700 1 -- 172.21.15.46:0/1331457472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8012430 con 0x7fb3d006bcd0 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 -- 172.21.15.46:0/1331457472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d006bcd0 msgr2=0x7fb3d0140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0140df0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009e60 tx=0x7fb3c8009780 comp rx=0 tx=0).stop 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 -- 172.21.15.46:0/1331457472 shutdown_connections 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0140df0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/1331457472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 -- 172.21.15.46:0/1331457472 >> 172.21.15.46:0/1331457472 conn(0x7fb3d00ce600 msgr2=0x7fb3d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 -- 172.21.15.46:0/1331457472 shutdown_connections 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.160+0000 7fb3d6e76700 1 -- 172.21.15.46:0/1331457472 wait complete. 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.161+0000 7fb3d6e76700 1 Processor -- start 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.161+0000 7fb3d6e76700 1 -- start start 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d016ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d016a890 con 0x7fb3d00c8e00 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0169c80 con 0x7fb3d006bcd0 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d6e76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0169f60 con 0x7fb3d006c0a0 2023-10-07T09:04:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d5413700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d5413700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33124/0 (socket says 172.21.15.46:33124) 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d5413700 1 -- 172.21.15.46:0/772793454 learned_addr learned my addr 172.21.15.46:0/772793454 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3cffff700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d016ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.162+0000 7fb3d4c12700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 -- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 msgr2=0x7fb3d016ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d016ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 -- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d006bcd0 msgr2=0x7fb3d0154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 -- 172.21.15.46:0/772793454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009a20 con 0x7fb3d00c8e00 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d5413700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800c7e0 tx=0x7fb3b8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8005c00 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8005d60 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d016a240 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004a80 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.163+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d0155230 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.164+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d016aa40 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.164+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb3b8005030 con 0x7fb3d00c8e00 2023-10-07T09:04:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.165+0000 7fb3ccff9700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 0x7fb3b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.165+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3b80840b0 con 0x7fb3d00c8e00 2023-10-07T09:04:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.165+0000 7fb3d4c12700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 0x7fb3b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.165+0000 7fb3d4c12700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 0x7fb3b00697d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009e60 tx=0x7fb3c8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.169+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3b804b5a0 con 0x7fb3d00c8e00 2023-10-07T09:04:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.405+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3d004c3c0 con 0x7fb3d00c8e00 2023-10-07T09:04:57.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.406+0000 7fb3ccff9700 1 -- 172.21.15.46:0/772793454 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fb3d016aa40 con 0x7fb3d00c8e00 2023-10-07T09:04:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:57.408 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 msgr2=0x7fb3b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 0x7fb3b00697d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009e60 tx=0x7fb3c8019000 comp rx=0 tx=0).stop 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 msgr2=0x7fb3d0169230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800c7e0 tx=0x7fb3b8007d90 comp rx=0 tx=0).stop 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 shutdown_connections 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3b0067320 0x7fb3b00697d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d00c8e00 0x7fb3d0169230 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d006bcd0 0x7fb3d0154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 --2- 172.21.15.46:0/772793454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3d006c0a0 0x7fb3d016ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 >> 172.21.15.46:0/772793454 conn(0x7fb3d00ce600 msgr2=0x7fb3d00c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 shutdown_connections 2023-10-07T09:04:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.408+0000 7fb3d6e76700 1 -- 172.21.15.46:0/772793454 wait complete. 2023-10-07T09:04:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 66 2023-10-07T09:04:57.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:57.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 Processor -- start 2023-10-07T09:04:57.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 -- start start 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f80141500 0x7f1f800c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f8006c0a0 0x7f1f800c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8015c2a0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800c9880 con 0x7f1f8006c0a0 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.541+0000 7f1f8643c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8015b690 con 0x7f1f80141500 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f8006c0a0 0x7f1f800c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f8006c0a0 0x7f1f800c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33126/0 (socket says 172.21.15.46:33126) 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 -- 172.21.15.46:0/2670714389 learned_addr learned my addr 172.21.15.46:0/2670714389 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f7f7fe700 1 --2- 172.21.15.46:0/2670714389 >> v2:172.21.15.133:3300/0 conn(0x7f1f80141500 0x7f1f800c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 -- 172.21.15.46:0/2670714389 >> v2:172.21.15.133:3300/0 conn(0x7f1f80141500 msgr2=0x7f1f800c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:57.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 --2- 172.21.15.46:0/2670714389 >> v2:172.21.15.133:3300/0 conn(0x7f1f80141500 0x7f1f800c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 -- 172.21.15.46:0/2670714389 >> v1:172.21.15.133:6789/0 conn(0x7f1f8006bcd0 legacy=0x7f1f80140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 -- 172.21.15.46:0/2670714389 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8015b970 con 0x7f1f8006c0a0 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f849d9700 1 --2- 172.21.15.46:0/2670714389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006c0a0 0x7f1f800c9340 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006c6e0 tx=0x7f1f78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c312b9d0f90234 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f7effd700 1 -- 172.21.15.46:0/2670714389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800e070 con 0x7f1f8006c0a0 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f7effd700 1 -- 172.21.15.46:0/2670714389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800ba20 con 0x7f1f8006c0a0 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.542+0000 7f1f7effd700 1 -- 172.21.15.46:0/2670714389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780092e0 con 0x7f1f8006c0a0 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 -- 172.21.15.46:0/2670714389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006c0a0 msgr2=0x7f1f800c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 --2- 172.21.15.46:0/2670714389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006c0a0 0x7f1f800c9340 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006c6e0 tx=0x7f1f78009840 comp rx=0 tx=0).stop 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 -- 172.21.15.46:0/2670714389 shutdown_connections 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 --2- 172.21.15.46:0/2670714389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006c0a0 0x7f1f800c9340 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 --2- 172.21.15.46:0/2670714389 >> v2:172.21.15.133:3300/0 conn(0x7f1f80141500 0x7f1f800c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 -- 172.21.15.46:0/2670714389 >> 172.21.15.46:0/2670714389 conn(0x7f1f800ce600 msgr2=0x7f1f800cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 -- 172.21.15.46:0/2670714389 shutdown_connections 2023-10-07T09:04:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.543+0000 7f1f8643c700 1 -- 172.21.15.46:0/2670714389 wait complete. 2023-10-07T09:04:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.544+0000 7f1f8643c700 1 Processor -- start 2023-10-07T09:04:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.544+0000 7f1f8643c700 1 -- start start 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f8006c0a0 0x7f1f801561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f80141500 0x7f1f8013d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b13a0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b1960 con 0x7f1f8006c0a0 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f8643c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8013dec0 con 0x7f1f80141500 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33136/0 (socket says 172.21.15.46:33136) 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 -- 172.21.15.46:0/4037367318 learned_addr learned my addr 172.21.15.46:0/4037367318 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f849d9700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f80141500 0x7f1f8013d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7f7fe700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f8006c0a0 0x7f1f801561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 -- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f80141500 msgr2=0x7f1f8013d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f80141500 0x7f1f8013d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 -- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f8006c0a0 msgr2=0x7f1f801561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f8006c0a0 0x7f1f801561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.545+0000 7f1f7ffff700 1 -- 172.21.15.46:0/4037367318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009ae0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f7ffff700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c590 tx=0x7f1f7000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011590 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70011710 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8013e1a0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011ad0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.546+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800c81b0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.547+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800b1c40 con 0x7f1f8006bcd0 2023-10-07T09:04:57.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.547+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f7001b3b0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.548+0000 7f1f67fff700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.548+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f700840a0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.548+0000 7f1f7f7fe700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.548+0000 7f1f7f7fe700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 0x7f1f6c0697d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f800c3970 tx=0x7f1f740091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.552+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f70050d30 con 0x7f1f8006bcd0 2023-10-07T09:04:57.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.748+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f8004c3c0 con 0x7f1f8006bcd0 2023-10-07T09:04:57.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.748+0000 7f1f67fff700 1 -- 172.21.15.46:0/4037367318 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1f70017090 con 0x7f1f8006bcd0 2023-10-07T09:04:57.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:57.750 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:45.919277+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 msgr2=0x7f1f6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 0x7f1f6c0697d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f800c3970 tx=0x7f1f740091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 msgr2=0x7f1f800b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c590 tx=0x7f1f7000c8a0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 shutdown_connections 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f80141500 0x7f1f8013d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8006bcd0 0x7f1f800b1df0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 --2- 172.21.15.46:0/4037367318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f8006c0a0 0x7f1f801561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.750+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 >> 172.21.15.46:0/4037367318 conn(0x7f1f800ce600 msgr2=0x7f1f8006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.751+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 shutdown_connections 2023-10-07T09:04:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.751+0000 7f1f8643c700 1 -- 172.21.15.46:0/4037367318 wait complete. 2023-10-07T09:04:57.765 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:04:57.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.882+0000 7f067f59e700 1 Processor -- start 2023-10-07T09:04:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.882+0000 7f067f59e700 1 -- start start 2023-10-07T09:04:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06801597f0 0x7f06800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068015dbb0 con 0x7f0680159420 2023-10-07T09:04:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800b11d0 con 0x7f06801597f0 2023-10-07T09:04:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b14b0 con 0x7f068015d230 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06801597f0 0x7f06800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06801597f0 0x7f06800b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 -- 172.21.15.46:0/3545186297 learned_addr learned my addr 172.21.15.46:0/3545186297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067ed9d700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 -- 172.21.15.46:0/3545186297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 msgr2=0x7f068015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 -- 172.21.15.46:0/3545186297 >> v1:172.21.15.133:6789/0 conn(0x7f0680159420 legacy=0x7f06800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.883+0000 7f067dd9b700 1 -- 172.21.15.46:0/3545186297 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800b1790 con 0x7f06801597f0 2023-10-07T09:04:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067dd9b700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f06800b2270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f06680099b0 tx=0x7f0668009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3af10eb065c39e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067d59a700 1 -- 172.21.15.46:0/3545186297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800b860 con 0x7f06801597f0 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067d59a700 1 -- 172.21.15.46:0/3545186297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800b9c0 con 0x7f06801597f0 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067d59a700 1 -- 172.21.15.46:0/3545186297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bd60 con 0x7f06801597f0 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 -- 172.21.15.46:0/3545186297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 msgr2=0x7f06800b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f06800b2270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f06680099b0 tx=0x7f0668009250 comp rx=0 tx=0).stop 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 -- 172.21.15.46:0/3545186297 shutdown_connections 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 --2- 172.21.15.46:0/3545186297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f06800b2270 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 -- 172.21.15.46:0/3545186297 >> 172.21.15.46:0/3545186297 conn(0x7f06800d0660 msgr2=0x7f06800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:57.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 -- 172.21.15.46:0/3545186297 shutdown_connections 2023-10-07T09:04:57.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.884+0000 7f067f59e700 1 -- 172.21.15.46:0/3545186297 wait complete. 2023-10-07T09:04:57.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 Processor -- start 2023-10-07T09:04:57.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 -- start start 2023-10-07T09:04:57.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0680159420 0x7f068015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0680155810 con 0x7f06801597f0 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0680152dc0 con 0x7f0680159420 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068014ead0 con 0x7f068015d230 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.886+0000 7f067dd9b700 1 -- 172.21.15.46:0/3500502588 learned_addr learned my addr 172.21.15.46:0/3500502588 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067ed9d700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067e59c700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0680159420 0x7f068015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 -- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 msgr2=0x7f068014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 -- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0680159420 msgr2=0x7f068015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0680159420 0x7f068015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 -- 172.21.15.46:0/3500502588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680094f0 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067dd9b700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0680089340 tx=0x7f0668017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668011e40 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668024440 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0680155a60 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06680247e0 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.887+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0680156020 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.888+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068004c3c0 con 0x7f06801597f0 2023-10-07T09:04:57.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.889+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f066801a420 con 0x7f06801597f0 2023-10-07T09:04:57.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.889+0000 7f06767fc700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 0x7f06600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:57.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.889+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0668086ac0 con 0x7f06801597f0 2023-10-07T09:04:57.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.889+0000 7f067e59c700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 0x7f06600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:57.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.890+0000 7f067e59c700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 0x7f06600697d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f06780016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:57.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:57.894+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06680537d0 con 0x7f06801597f0 2023-10-07T09:04:58.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.134+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06800b1a70 con 0x7f06801597f0 2023-10-07T09:04:58.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.135+0000 7f06767fc700 1 -- 172.21.15.46:0/3500502588 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f0668015090 con 0x7f06801597f0 2023-10-07T09:04:58.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:58.137 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 msgr2=0x7f06600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 0x7f06600697d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f06780016f0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 msgr2=0x7f0680152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0680089340 tx=0x7f0668017000 comp rx=0 tx=0).stop 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 shutdown_connections 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0660067320 0x7f06600697d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f068015d230 0x7f068014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0680159420 0x7f068015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 --2- 172.21.15.46:0/3500502588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801597f0 0x7f0680152880 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 >> 172.21.15.46:0/3500502588 conn(0x7f06800d0660 msgr2=0x7f06800d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 shutdown_connections 2023-10-07T09:04:58.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.137+0000 7f067f59e700 1 -- 172.21.15.46:0/3500502588 wait complete. 2023-10-07T09:04:58.140 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 66 2023-10-07T09:04:58.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:04:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.268+0000 7f02fc816700 1 Processor -- start 2023-10-07T09:04:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.268+0000 7f02fc816700 1 -- start start 2023-10-07T09:04:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 0x7f02f80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 0x7f02f815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02f815df50 0x7f02f815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f815d7e0 con 0x7f02f815df50 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f815dac0 con 0x7f02f806bcd0 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02fc816700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f815aa30 con 0x7f02f806c0a0 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02f815df50 0x7f02f815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02f815df50 0x7f02f815e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33168/0 (socket says 172.21.15.46:33168) 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f6d9d700 1 -- 172.21.15.46:0/752362575 learned_addr learned my addr 172.21.15.46:0/752362575 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 0x7f02f815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f659c700 1 --2- 172.21.15.46:0/752362575 >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 0x7f02f80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.269+0000 7f02f6d9d700 1 -- 172.21.15.46:0/752362575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 msgr2=0x7f02f815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f6d9d700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 0x7f02f815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f6d9d700 1 -- 172.21.15.46:0/752362575 >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 msgr2=0x7f02f80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f6d9d700 1 --2- 172.21.15.46:0/752362575 >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 0x7f02f80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f6d9d700 1 -- 172.21.15.46:0/752362575 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f815ad10 con 0x7f02f815df50 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 0x7f02f815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f659c700 1 --2- 172.21.15.46:0/752362575 >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 0x7f02f80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f6d9d700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f815df50 0x7f02f815e3c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f02f80691a0 tx=0x7f02e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8773b9585f4df1eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f559a700 1 -- 172.21.15.46:0/752362575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800e070 con 0x7f02f815df50 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f559a700 1 -- 172.21.15.46:0/752362575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800ba50 con 0x7f02f815df50 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02f559a700 1 -- 172.21.15.46:0/752362575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80092e0 con 0x7f02f815df50 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 -- 172.21.15.46:0/752362575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f815df50 msgr2=0x7f02f815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f815df50 0x7f02f815e3c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f02f80691a0 tx=0x7f02e8009840 comp rx=0 tx=0).stop 2023-10-07T09:04:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 -- 172.21.15.46:0/752362575 shutdown_connections 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f815df50 0x7f02f815e3c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 --2- 172.21.15.46:0/752362575 >> v2:172.21.15.133:3300/0 conn(0x7f02f806bcd0 0x7f02f80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 --2- 172.21.15.46:0/752362575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f806c0a0 0x7f02f815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.270+0000 7f02fc816700 1 -- 172.21.15.46:0/752362575 >> 172.21.15.46:0/752362575 conn(0x7f02f80ce600 msgr2=0x7f02f80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.271+0000 7f02fc816700 1 -- 172.21.15.46:0/752362575 shutdown_connections 2023-10-07T09:04:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.271+0000 7f02fc816700 1 -- 172.21.15.46:0/752362575 wait complete. 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 Processor -- start 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 -- start start 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 0x7f02f81598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f815df50 0x7f02f8169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80c8410 con 0x7f02f806bcd0 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80b37f0 con 0x7f02f806c0a0 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02fc816700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80b3ad0 con 0x7f02f815df50 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02f659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02f659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33180/0 (socket says 172.21.15.46:33180) 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.272+0000 7f02f659c700 1 -- 172.21.15.46:0/2817252317 learned_addr learned my addr 172.21.15.46:0/2817252317 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f6d9d700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f815df50 0x7f02f8169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 0x7f02f81598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 -- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f815df50 msgr2=0x7f02f8169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f815df50 0x7f02f8169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 -- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 msgr2=0x7f02f81598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 0x7f02f81598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 -- 172.21.15.46:0/2817252317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009ae0 con 0x7f02f806bcd0 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 0x7f02f81598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02f659c700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f02f000d860 tx=0x7f02f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f00125f0 con 0x7f02f806bcd0 2023-10-07T09:04:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0012750 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80b3db0 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0012af0 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.273+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f8159e00 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.274+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f80b4400 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.274+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02f0014430 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.275+0000 7f02ee7fc700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 0x7f02d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.275+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02f0085010 con 0x7f02f806bcd0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.275+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 0x7f02d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.276+0000 7f02f5d9b700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 0x7f02d80697d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02e0006fd0 tx=0x7f02e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.279+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02f0051ca0 con 0x7f02f806bcd0 2023-10-07T09:04:58.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.513+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02f804c3c0 con 0x7f02f806bcd0 2023-10-07T09:04:58.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.514+0000 7f02ee7fc700 1 -- 172.21.15.46:0/2817252317 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f02f00552c0 con 0x7f02f806bcd0 2023-10-07T09:04:58.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:58.516 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:04:44.915421+0000","modified":"2023-10-07T09:04:48.517981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1479846001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1479846001},{"type":"v1","addr":"172.21.15.46:6835","nonce":1479846001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.515+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 msgr2=0x7f02d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 0x7f02d80697d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02e0006fd0 tx=0x7f02e0008040 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 msgr2=0x7f02f80c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f02f000d860 tx=0x7f02f0008040 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 shutdown_connections 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f02d8067320 0x7f02d80697d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02f815df50 0x7f02f8169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f806bcd0 0x7f02f80c7ed0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 --2- 172.21.15.46:0/2817252317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02f806c0a0 0x7f02f81598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 >> 172.21.15.46:0/2817252317 conn(0x7f02f80ce600 msgr2=0x7f02f806d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 shutdown_connections 2023-10-07T09:04:58.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.516+0000 7f02fc816700 1 -- 172.21.15.46:0/2817252317 wait complete. 2023-10-07T09:04:58.519 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 66 2023-10-07T09:04:58.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:04:58.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.646+0000 7f1244253700 1 Processor -- start 2023-10-07T09:04:58.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.647+0000 7f1244253700 1 -- start start 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1244253700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f123c0ccf90 0x7f123c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1244253700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0cc300 con 0x7f123c0cbf30 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1244253700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0ad370 con 0x7f123c0b1420 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1244253700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c156bf0 con 0x7f123c0ccf90 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1241fef700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f123c0cbf30 0x7f123c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38952/0 (socket says 172.21.15.46:38952) 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1241fef700 1 -- 172.21.15.46:0/758083508 learned_addr learned my addr 172.21.15.46:0/758083508 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190920802 0 0) 0x7f123c0cc300 con 0x7f123c0cbf30 2023-10-07T09:04:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f12427f0700 1 --2- 172.21.15.46:0/758083508 >> v2:172.21.15.133:3300/0 conn(0x7f123c0ccf90 0x7f123c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1224003570 con 0x7f123c0cbf30 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950189221 0 0) 0x7f1224003570 con 0x7f123c0cbf30 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 >> v2:172.21.15.133:3300/0 conn(0x7f123c0ccf90 msgr2=0x7f123c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 --2- 172.21.15.46:0/758083508 >> v2:172.21.15.133:3300/0 conn(0x7f123c0ccf90 0x7f123c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 >> v1:172.21.15.133:6789/0 conn(0x7f123c0b1420 legacy=0x7f123c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0ad650 con 0x7f123c0cbf30 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f1234001470 con 0x7f123c0cbf30 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 >> v1:172.21.15.46:6789/0 conn(0x7f123c0cbf30 legacy=0x7f123c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f1224003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1224004810 0x7f1224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12240051c0 0x7f122400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c156bf0 con 0x7f1224003a60 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122400c0d0 con 0x7f1224004810 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122400c290 con 0x7f12240051c0 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.648+0000 7f1241fef700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f1224003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f12417ee700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1224004810 0x7f1224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f12427f0700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12240051c0 0x7f122400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 -- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12240051c0 msgr2=0x7f122400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12240051c0 0x7f122400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 -- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1224004810 msgr2=0x7f1224004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1224004810 0x7f1224004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 -- 172.21.15.46:0/758083508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224003570 con 0x7f1224003a60 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f12427f0700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12240051c0 0x7f122400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:04:58.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f12427f0700 1 -- 172.21.15.46:0/758083508 reap_dead start 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1241fef700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f1224003e70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f123400c3c0 tx=0x7f1234001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23020b902a82aed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400cc90 con 0x7f1224003a60 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400cdf0 con 0x7f1224003a60 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.649+0000 7f1240fed700 1 -- 172.21.15.46:0/758083508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234005b50 con 0x7f1224003a60 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 -- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 msgr2=0x7f1224003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f1224003e70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f123400c3c0 tx=0x7f1234001e50 comp rx=0 tx=0).stop 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 -- 172.21.15.46:0/758083508 shutdown_connections 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 --2- 172.21.15.46:0/758083508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f1224003e70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 -- 172.21.15.46:0/758083508 >> 172.21.15.46:0/758083508 conn(0x7f123c06a320 msgr2=0x7f123c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 -- 172.21.15.46:0/758083508 shutdown_connections 2023-10-07T09:04:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.650+0000 7f1244253700 1 -- 172.21.15.46:0/758083508 wait complete. 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.651+0000 7f1244253700 1 Processor -- start 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.651+0000 7f1244253700 1 -- start start 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.651+0000 7f1244253700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f123c142460 0x7f123c1428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f123c16a400 0x7f123c16a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c16adc0 con 0x7f1224003a60 2023-10-07T09:04:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c142eb0 con 0x7f123c142460 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c143190 con 0x7f123c16a400 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33194/0 (socket says 172.21.15.46:33194) 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 -- 172.21.15.46:0/2150538459 learned_addr learned my addr 172.21.15.46:0/2150538459 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f12417ee700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f123c142460 0x7f123c1428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f12427f0700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f123c16a400 0x7f123c16a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 -- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f123c16a400 msgr2=0x7f123c16a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f123c16a400 0x7f123c16a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 -- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f123c142460 msgr2=0x7f123c1428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f123c142460 0x7f123c1428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 -- 172.21.15.46:0/2150538459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c143470 con 0x7f1224003a60 2023-10-07T09:04:58.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1241fef700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f123400c9b0 tx=0x7f1234015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234020070 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234004e70 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c143750 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400cc90 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.652+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c142090 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.653+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c06d170 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.654+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1234025460 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.654+0000 7f1239ffb700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 0x7f12280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.654+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1234087930 con 0x7f1224003a60 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.654+0000 7f12417ee700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 0x7f12280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.655+0000 7f12417ee700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 0x7f12280697d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f1230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.659+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12340545c0 con 0x7f1224003a60 2023-10-07T09:04:58.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.853+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f123c04c3c0 con 0x7f1224003a60 2023-10-07T09:04:58.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.854+0000 7f1239ffb700 1 -- 172.21.15.46:0/2150538459 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1234001b70 con 0x7f1224003a60 2023-10-07T09:04:58.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:04:58.856 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:04:45.919277+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:04:43.309433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T09:04:43.875055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:04:58.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 msgr2=0x7f12280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 0x7f12280697d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f1230009040 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 msgr2=0x7f123c141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f123400c9b0 tx=0x7f1234015000 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 shutdown_connections 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1228067320 0x7f12280697d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f123c16a400 0x7f123c16a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1224003a60 0x7f123c141b50 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 --2- 172.21.15.46:0/2150538459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f123c142460 0x7f123c1428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.856+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 >> 172.21.15.46:0/2150538459 conn(0x7f123c06a320 msgr2=0x7f123c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.857+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 shutdown_connections 2023-10-07T09:04:58.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.857+0000 7f1244253700 1 -- 172.21.15.46:0/2150538459 wait complete. 2023-10-07T09:04:58.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:04:58.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.989+0000 7efce19d7700 1 Processor -- start 2023-10-07T09:04:58.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.989+0000 7efce19d7700 1 -- start start 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efce19d7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcdc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efce19d7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc15c2a0 con 0x7efcdc06c0a0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efce19d7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc15b690 con 0x7efcdc06bcd0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efce19d7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15b970 con 0x7efcdc141500 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efcdb7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efcdc06c0a0 0x7efcdc0c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38962/0 (socket says 172.21.15.46:38962) 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.990+0000 7efcdb7fe700 1 -- 172.21.15.46:0/396959125 learned_addr learned my addr 172.21.15.46:0/396959125 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcda7fc700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcdc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176941476 0 0) 0x7efcdc15c2a0 con 0x7efcdc06c0a0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc8003570 con 0x7efcdc06c0a0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622613207 0 0) 0x7efcdc15b690 con 0x7efcdc06bcd0 2023-10-07T09:04:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc15c2a0 con 0x7efcdc06bcd0 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093733929 0 0) 0x7efcc8003570 con 0x7efcdc06c0a0 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 msgr2=0x7efcdc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcdc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 >> v1:172.21.15.133:6789/0 conn(0x7efcdc06bcd0 legacy=0x7efcdc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc15bc50 con 0x7efcdc06c0a0 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7efccc0017f0 con 0x7efcdc06c0a0 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 >> v1:172.21.15.46:6789/0 conn(0x7efcdc06c0a0 legacy=0x7efcdc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8003c20 0x7efcc8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc8004d50 0x7efcc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15b970 con 0x7efcc8004d50 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc800bbf0 con 0x7efcc8003c20 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc800bd60 con 0x7efcdc141500 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcdaffd700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8003c20 0x7efcc8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcdb7fe700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc8004d50 0x7efcc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.991+0000 7efcda7fc700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 -- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 msgr2=0x7efcc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc141500 0x7efcc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 -- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8003c20 msgr2=0x7efcc8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8003c20 0x7efcc8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 -- 172.21.15.46:0/396959125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8003570 con 0x7efcc8004d50 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc8004d50 0x7efcc80051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7efccc00a7d0 tx=0x7efcdc06e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626033d72a57ae4d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:58.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0070d0 con 0x7efcc8004d50 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc007270 con 0x7efcc8004d50 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcd9ffb700 1 -- 172.21.15.46:0/396959125 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc007630 con 0x7efcc8004d50 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efce19d7700 1 -- 172.21.15.46:0/396959125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc8004d50 msgr2=0x7efcc80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efce19d7700 1 --2- 172.21.15.46:0/396959125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc8004d50 0x7efcc80051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7efccc00a7d0 tx=0x7efcdc06e470 comp rx=0 tx=0).stop 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.992+0000 7efcdb7fe700 1 -- 172.21.15.46:0/396959125 reap_dead start 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.993+0000 7efce19d7700 1 -- 172.21.15.46:0/396959125 shutdown_connections 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.993+0000 7efce19d7700 1 -- 172.21.15.46:0/396959125 >> 172.21.15.46:0/396959125 conn(0x7efcdc0ce600 msgr2=0x7efcdc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.993+0000 7efce19d7700 1 -- 172.21.15.46:0/396959125 shutdown_connections 2023-10-07T09:04:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.993+0000 7efce19d7700 1 -- 172.21.15.46:0/396959125 wait complete. 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.994+0000 7efce19d7700 1 Processor -- start 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.994+0000 7efce19d7700 1 -- start start 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8004d50 0x7efcdc169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc13c560 0x7efcdc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc13cec0 con 0x7efcdc13c0f0 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc13d1a0 con 0x7efcc8004d50 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efce19d7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc13d480 con 0x7efcdc13c560 2023-10-07T09:04:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33204/0 (socket says 172.21.15.46:33204) 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 -- 172.21.15.46:0/2169498656 learned_addr learned my addr 172.21.15.46:0/2169498656 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcdaffd700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8004d50 0x7efcdc169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcdb7fe700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc13c560 0x7efcdc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 -- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc13c560 msgr2=0x7efcdc1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc13c560 0x7efcdc1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 -- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8004d50 msgr2=0x7efcdc169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8004d50 0x7efcdc169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 -- 172.21.15.46:0/2169498656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc13d760 con 0x7efcdc13c0f0 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcda7fc700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006ac0 tx=0x7efcc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.995+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400f940 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.996+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400faa0 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.996+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc16a070 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.996+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400fe20 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.996+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc06b090 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.997+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc04c3c0 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.997+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efcc4014650 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.997+0000 7efcd2ffd700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 0x7efcbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.997+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcc4018030 con 0x7efcdc13c0f0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.998+0000 7efcdaffd700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 0x7efcbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:58.998+0000 7efcdaffd700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 0x7efcbc0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efcd4003cb0 tx=0x7efcd4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.002+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcc40522a0 con 0x7efcdc13c0f0 2023-10-07T09:04:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.238+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efcdc15bf30 con 0x7efcdc13c0f0 2023-10-07T09:04:59.240 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:04:59.239+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:04:59.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.242+0000 7efcd2ffd700 1 -- 172.21.15.46:0/2169498656 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7efcc40558c0 con 0x7efcdc13c0f0 2023-10-07T09:04:59.245 INFO:tasks.ceph.mds.c.smithi046.stderr: -770> 2023-10-07T09:04:50.923+0000 7f1d7c6c9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:04:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 msgr2=0x7efcbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 0x7efcbc0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efcd4003cb0 tx=0x7efcd4007d30 comp rx=0 tx=0).stop 2023-10-07T09:04:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 msgr2=0x7efcdc06ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006ac0 tx=0x7efcc40091a0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 shutdown_connections 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efcbc067320 0x7efcbc0697d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcdc13c560 0x7efcdc1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc8004d50 0x7efcdc169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 --2- 172.21.15.46:0/2169498656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcdc13c0f0 0x7efcdc06ab50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.244+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 >> 172.21.15.46:0/2169498656 conn(0x7efcdc0ce600 msgr2=0x7efcdc1591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.245+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 shutdown_connections 2023-10-07T09:04:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.245+0000 7efce19d7700 1 -- 172.21.15.46:0/2169498656 wait complete. 2023-10-07T09:04:59.248 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:04:59.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:04:59.265 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:04:59.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.379+0000 7fd216387700 1 Processor -- start 2023-10-07T09:04:59.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.379+0000 7fd216387700 1 -- start start 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd216387700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd21015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd216387700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd210069560 0x7fd2100699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd216387700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21015a160 con 0x7fd210159c60 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd216387700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd210069f20 con 0x7fd210069560 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd216387700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100d13a0 con 0x7fd210159890 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd214924700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd210069560 0x7fd2100699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd214924700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd210069560 0x7fd2100699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33242/0 (socket says 172.21.15.46:33242) 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd214924700 1 -- 172.21.15.46:0/1153063105 learned_addr learned my addr 172.21.15.46:0/1153063105 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:59.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.380+0000 7fd20ffff700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd21015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd214924700 1 -- 172.21.15.46:0/1153063105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 msgr2=0x7fd21015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd214924700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd21015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd214924700 1 -- 172.21.15.46:0/1153063105 >> v1:172.21.15.133:6789/0 conn(0x7fd210159c60 legacy=0x7fd21015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd214924700 1 -- 172.21.15.46:0/1153063105 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21015e140 con 0x7fd210069560 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd214924700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100699e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd208009f20 tx=0x7fd208009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27abcdab61e8e211 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd20effd700 1 -- 172.21.15.46:0/1153063105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800e070 con 0x7fd210069560 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd20effd700 1 -- 172.21.15.46:0/1153063105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800b9d0 con 0x7fd210069560 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd20effd700 1 -- 172.21.15.46:0/1153063105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080092e0 con 0x7fd210069560 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd216387700 1 -- 172.21.15.46:0/1153063105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 msgr2=0x7fd2100699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.381+0000 7fd216387700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100699e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd208009f20 tx=0x7fd208009840 comp rx=0 tx=0).stop 2023-10-07T09:04:59.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 -- 172.21.15.46:0/1153063105 shutdown_connections 2023-10-07T09:04:59.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100699e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 --2- 172.21.15.46:0/1153063105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd21015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 -- 172.21.15.46:0/1153063105 >> 172.21.15.46:0/1153063105 conn(0x7fd210068e20 msgr2=0x7fd2100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:04:59.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 -- 172.21.15.46:0/1153063105 shutdown_connections 2023-10-07T09:04:59.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.382+0000 7fd216387700 1 -- 172.21.15.46:0/1153063105 wait complete. 2023-10-07T09:04:59.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.383+0000 7fd216387700 1 Processor -- start 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.383+0000 7fd216387700 1 -- start start 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd2100cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd210159c60 0x7fd21014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100ce2d0 con 0x7fd210069560 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101513c0 con 0x7fd210159c60 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100ce050 con 0x7fd210159890 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33256/0 (socket says 172.21.15.46:33256) 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 -- 172.21.15.46:0/1471188728 learned_addr learned my addr 172.21.15.46:0/1471188728 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd214924700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd210159c60 0x7fd21014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20f7fe700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd2100cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 -- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 msgr2=0x7fd2100cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd2100cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 -- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd210159c60 msgr2=0x7fd21014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd210159c60 0x7fd21014f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 -- 172.21.15.46:0/1471188728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208009ae0 con 0x7fd210069560 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd20ffff700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800ecb0 tx=0x7fd1f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800c9d0 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800cb30 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800ced0 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2100c6700 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.384+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2100c6420 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.385+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2101516a0 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.386+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1f8013680 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.386+0000 7fd207fff700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 0x7fd1f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.386+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd1f8085080 con 0x7fd210069560 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.386+0000 7fd20f7fe700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 0x7fd1f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:04:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.387+0000 7fd20f7fe700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 0x7fd1f00697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd2100b2eb0 tx=0x7fd200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:04:59.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.390+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1f8051cc0 con 0x7fd210069560 2023-10-07T09:04:59.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:04:59.632+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd21004c3c0 con 0x7fd210069560 2023-10-07T09:05:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.246+0000 7fd207fff700 1 -- 172.21.15.46:0/1471188728 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1f80552e0 con 0x7fd210069560 2023-10-07T09:05:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 msgr2=0x7fd1f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 0x7fd1f00697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd2100b2eb0 tx=0x7fd200009040 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 msgr2=0x7fd2100cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800ecb0 tx=0x7fd1f80091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 shutdown_connections 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1f0067320 0x7fd1f00697d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd210159c60 0x7fd21014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd210069560 0x7fd2100cf780 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 --2- 172.21.15.46:0/1471188728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd210159890 0x7fd2100cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.248+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 >> 172.21.15.46:0/1471188728 conn(0x7fd210068e20 msgr2=0x7fd210158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.249+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 shutdown_connections 2023-10-07T09:05:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.249+0000 7fd216387700 1 -- 172.21.15.46:0/1471188728 wait complete. 2023-10-07T09:05:00.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:05:00.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.428+0000 7ff991558700 1 Processor -- start 2023-10-07T09:05:00.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.428+0000 7ff991558700 1 -- start start 2023-10-07T09:05:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98c0b03c0 0x7ff98c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c0b0790 0x7ff98c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 0x7ff98c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0cfa00 con 0x7ff98c0b03c0 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0cb580 con 0x7ff98c1591e0 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff991558700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0b2de0 con 0x7ff98c0b0790 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98c0b03c0 0x7ff98c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98c0b03c0 0x7ff98c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47796/0 (socket says 172.21.15.46:47796) 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 -- 172.21.15.46:0/2597741087 learned_addr learned my addr 172.21.15.46:0/2597741087 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98b7fe700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c0b0790 0x7ff98c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff990d57700 1 --2- 172.21.15.46:0/2597741087 >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 0x7ff98c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 -- 172.21.15.46:0/2597741087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c0b0790 msgr2=0x7ff98c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c0b0790 0x7ff98c0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 -- 172.21.15.46:0/2597741087 >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 msgr2=0x7ff98c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 --2- 172.21.15.46:0/2597741087 >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 0x7ff98c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff98bfff700 1 -- 172.21.15.46:0/2597741087 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0cf160 con 0x7ff98c0b03c0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.429+0000 7ff990d57700 1 --2- 172.21.15.46:0/2597741087 >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 0x7ff98c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff98bfff700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c0cea70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0cb4f0 tx=0x7ff97c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b305bf2e3080921e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff98affd700 1 -- 172.21.15.46:0/2597741087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00b860 con 0x7ff98c0b03c0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff98affd700 1 -- 172.21.15.46:0/2597741087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00b9c0 con 0x7ff98c0b03c0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff98affd700 1 -- 172.21.15.46:0/2597741087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00bd60 con 0x7ff98c0b03c0 2023-10-07T09:05:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 -- 172.21.15.46:0/2597741087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 msgr2=0x7ff98c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c0cea70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0cb4f0 tx=0x7ff97c009250 comp rx=0 tx=0).stop 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 -- 172.21.15.46:0/2597741087 shutdown_connections 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 --2- 172.21.15.46:0/2597741087 >> v2:172.21.15.133:3300/0 conn(0x7ff98c1591e0 0x7ff98c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c0cea70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 --2- 172.21.15.46:0/2597741087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c0b0790 0x7ff98c0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 -- 172.21.15.46:0/2597741087 >> 172.21.15.46:0/2597741087 conn(0x7ff98c063230 msgr2=0x7ff98c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 -- 172.21.15.46:0/2597741087 shutdown_connections 2023-10-07T09:05:00.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.430+0000 7ff991558700 1 -- 172.21.15.46:0/2597741087 wait complete. 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.431+0000 7ff991558700 1 Processor -- start 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 -- start start 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 0x7ff98c145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c1591e0 0x7ff98c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c15db40 con 0x7ff98c0b03c0 2023-10-07T09:05:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0c5fe0 con 0x7ff98c0b0790 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff991558700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1456d0 con 0x7ff98c1591e0 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff98bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff98bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47810/0 (socket says 172.21.15.46:47810) 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.432+0000 7ff98bfff700 1 -- 172.21.15.46:0/3672738857 learned_addr learned my addr 172.21.15.46:0/3672738857 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff990d57700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c1591e0 0x7ff98c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98b7fe700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 0x7ff98c145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 -- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c1591e0 msgr2=0x7ff98c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c1591e0 0x7ff98c0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 -- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 msgr2=0x7ff98c145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 0x7ff98c145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 -- 172.21.15.46:0/3672738857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0094f0 con 0x7ff98c0b03c0 2023-10-07T09:05:00.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98b7fe700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 0x7ff98c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff98bfff700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0090b0 tx=0x7ff97c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c01a450 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c01a5b0 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c15d580 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c01a970 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.433+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c0c5c70 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.434+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c04c3c0 con 0x7ff98c0b03c0 2023-10-07T09:05:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.434+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff97c01ad20 con 0x7ff98c0b03c0 2023-10-07T09:05:00.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.435+0000 7ff973fff700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 0x7ff9780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:00.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.435+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff97c086370 con 0x7ff98c0b03c0 2023-10-07T09:05:00.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.435+0000 7ff98b7fe700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 0x7ff9780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:00.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.436+0000 7ff98b7fe700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 0x7ff9780697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0c51d0 tx=0x7ff980008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:00.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.439+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff97c052fb0 con 0x7ff98c0b03c0 2023-10-07T09:05:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:00.633+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff98c0b2770 con 0x7ff98c0b03c0 2023-10-07T09:05:01.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.248+0000 7ff973fff700 1 -- 172.21.15.46:0/3672738857 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff97c0565d0 con 0x7ff98c0b03c0 2023-10-07T09:05:01.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.251+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 msgr2=0x7ff9780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.251+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 0x7ff9780697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0c51d0 tx=0x7ff980008040 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 msgr2=0x7ff98c159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0090b0 tx=0x7ff97c017000 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 shutdown_connections 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff978067320 0x7ff9780697d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff98c1591e0 0x7ff98c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98c0b03c0 0x7ff98c159620 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 --2- 172.21.15.46:0/3672738857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98c0b0790 0x7ff98c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 >> 172.21.15.46:0/3672738857 conn(0x7ff98c063230 msgr2=0x7ff98c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 shutdown_connections 2023-10-07T09:05:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.252+0000 7ff991558700 1 -- 172.21.15.46:0/3672738857 wait complete. 2023-10-07T09:05:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:05:01.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:05:01.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.389+0000 7fa7f44df700 1 Processor -- start 2023-10-07T09:05:01.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.389+0000 7fa7f44df700 1 -- start start 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7ec155360 0x7fa7ec0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 0x7fa7ec0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 0x7fa7ec06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0b4560 con 0x7fa7ec155360 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec15c320 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f44df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0cef90 con 0x7fa7ec0b40f0 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f227b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7ec155360 0x7fa7ec0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f227b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7ec155360 0x7fa7ec0b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47822/0 (socket says 172.21.15.46:47822) 2023-10-07T09:05:01.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.390+0000 7fa7f227b700 1 -- 172.21.15.46:0/2693330262 learned_addr learned my addr 172.21.15.46:0/2693330262 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 -- 172.21.15.46:0/2693330262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 msgr2=0x7fa7ec0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f1a7a700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 0x7fa7ec0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f2a7c700 1 --2- 172.21.15.46:0/2693330262 >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 0x7fa7ec06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 0x7fa7ec0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 -- 172.21.15.46:0/2693330262 >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 msgr2=0x7fa7ec06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 --2- 172.21.15.46:0/2693330262 >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 0x7fa7ec06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 -- 172.21.15.46:0/2693330262 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec15b710 con 0x7fa7ec155360 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f2a7c700 1 --2- 172.21.15.46:0/2693330262 >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 0x7fa7ec06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:01.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f1a7a700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 0x7fa7ec0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f227b700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec155360 0x7fa7ec0b3bb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec070f60 tx=0x7fa7e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5157b1b9634ca628 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f1279700 1 -- 172.21.15.46:0/2693330262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400b860 con 0x7fa7ec155360 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f1279700 1 -- 172.21.15.46:0/2693330262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400b9c0 con 0x7fa7ec155360 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.391+0000 7fa7f1279700 1 -- 172.21.15.46:0/2693330262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400bd60 con 0x7fa7ec155360 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 -- 172.21.15.46:0/2693330262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec155360 msgr2=0x7fa7ec0b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec155360 0x7fa7ec0b3bb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec070f60 tx=0x7fa7e4009250 comp rx=0 tx=0).stop 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 -- 172.21.15.46:0/2693330262 shutdown_connections 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 --2- 172.21.15.46:0/2693330262 >> v2:172.21.15.133:3300/0 conn(0x7fa7ec0ceb60 0x7fa7ec06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec155360 0x7fa7ec0b3bb0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 --2- 172.21.15.46:0/2693330262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec0b40f0 0x7fa7ec0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 -- 172.21.15.46:0/2693330262 >> 172.21.15.46:0/2693330262 conn(0x7fa7ec06baf0 msgr2=0x7fa7ec06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:01.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 -- 172.21.15.46:0/2693330262 shutdown_connections 2023-10-07T09:05:01.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.392+0000 7fa7f44df700 1 -- 172.21.15.46:0/2693330262 wait complete. 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.393+0000 7fa7f44df700 1 Processor -- start 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.393+0000 7fa7f44df700 1 -- start start 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7ec0b40f0 0x7fa7ec0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec155360 0x7fa7ec156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec152540 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec151930 con 0x7fa7ec0b40f0 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec151c10 con 0x7fa7ec155360 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47826/0 (socket says 172.21.15.46:47826) 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 -- 172.21.15.46:0/3903413924 learned_addr learned my addr 172.21.15.46:0/3903413924 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f2a7c700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec155360 0x7fa7ec156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f227b700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7ec0b40f0 0x7fa7ec0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 -- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec155360 msgr2=0x7fa7ec156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec155360 0x7fa7ec156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 -- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7ec0b40f0 msgr2=0x7fa7ec0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7ec0b40f0 0x7fa7ec0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 -- 172.21.15.46:0/3903413924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40094f0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f1a7a700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c880 tx=0x7fa7e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011600 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0011760 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec151ef0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011ae0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.394+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec0c42a0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.395+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec1526b0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.396+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7e0010350 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.396+0000 7fa7ea7fc700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.396+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fa7e0084bd0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.397+0000 7fa7f227b700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:01.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.397+0000 7fa7f227b700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 0x7fa7d80697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec070f60 tx=0x7fa7e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:01.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.401+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7e00518b0 con 0x7fa7ec0ceb60 2023-10-07T09:05:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:01.591+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7ec0718b0 con 0x7fa7ec0ceb60 2023-10-07T09:05:02.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.254+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/3903413924 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa7e001e0d0 con 0x7fa7ec0ceb60 2023-10-07T09:05:02.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.257+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 msgr2=0x7fa7d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.257+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 0x7fa7d80697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec070f60 tx=0x7fa7e4017000 comp rx=0 tx=0).stop 2023-10-07T09:05:02.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.257+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 msgr2=0x7fa7ec14e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.258+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c880 tx=0x7fa7e0008040 comp rx=0 tx=0).stop 2023-10-07T09:05:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 shutdown_connections 2023-10-07T09:05:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7ec155360 0x7fa7ec156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7ec0b40f0 0x7fa7ec0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 --2- 172.21.15.46:0/3903413924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7ec0ceb60 0x7fa7ec14e450 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.259+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 >> 172.21.15.46:0/3903413924 conn(0x7fa7ec06baf0 msgr2=0x7fa7ec15abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.262+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 shutdown_connections 2023-10-07T09:05:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.262+0000 7fa7f44df700 1 -- 172.21.15.46:0/3903413924 wait complete. 2023-10-07T09:05:02.266 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:05:02.284 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:05:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.411+0000 7fe08ae3c700 1 Processor -- start 2023-10-07T09:05:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.411+0000 7fe08ae3c700 1 -- start start 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe08ae3c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe084159890 0x7fe08415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe08ae3c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 0x7fe08415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe08ae3c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08415a160 con 0x7fe08415db10 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe08ae3c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08415df50 con 0x7fe084159890 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe08ae3c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840d13a0 con 0x7fe084159c60 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe084159890 0x7fe08415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe084159890 0x7fe08415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47838/0 (socket says 172.21.15.46:47838) 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 -- 172.21.15.46:0/876642517 learned_addr learned my addr 172.21.15.46:0/876642517 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe083fff700 1 --2- 172.21.15.46:0/876642517 >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 0x7fe08415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 -- 172.21.15.46:0/876642517 >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 msgr2=0x7fe08415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 --2- 172.21.15.46:0/876642517 >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 0x7fe08415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 -- 172.21.15.46:0/876642517 >> v1:172.21.15.133:6789/0 conn(0x7fe08415db10 legacy=0x7fe084069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 -- 172.21.15.46:0/876642517 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08415e140 con 0x7fe084159890 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe083fff700 1 --2- 172.21.15.46:0/876642517 >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 0x7fe08415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe088bd8700 1 --2- 172.21.15.46:0/876642517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe08415abd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe0840b67f0 tx=0x7fe074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca29bfd2cd3d8a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe0837fe700 1 -- 172.21.15.46:0/876642517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400b860 con 0x7fe084159890 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe0837fe700 1 -- 172.21.15.46:0/876642517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07400b9c0 con 0x7fe084159890 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.412+0000 7fe0837fe700 1 -- 172.21.15.46:0/876642517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400bd60 con 0x7fe084159890 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 -- 172.21.15.46:0/876642517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 msgr2=0x7fe08415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/876642517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe08415abd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe0840b67f0 tx=0x7fe074009250 comp rx=0 tx=0).stop 2023-10-07T09:05:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 -- 172.21.15.46:0/876642517 shutdown_connections 2023-10-07T09:05:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/876642517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe08415abd0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/876642517 >> v2:172.21.15.133:3300/0 conn(0x7fe084159c60 0x7fe08415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 -- 172.21.15.46:0/876642517 >> 172.21.15.46:0/876642517 conn(0x7fe084068e20 msgr2=0x7fe0840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 -- 172.21.15.46:0/876642517 shutdown_connections 2023-10-07T09:05:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.413+0000 7fe08ae3c700 1 -- 172.21.15.46:0/876642517 wait complete. 2023-10-07T09:05:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.414+0000 7fe08ae3c700 1 Processor -- start 2023-10-07T09:05:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.414+0000 7fe08ae3c700 1 -- start start 2023-10-07T09:05:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe084159c60 0x7fe084158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe08415db10 0x7fe0840b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840cf9d0 con 0x7fe084159890 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840cf400 con 0x7fe084159c60 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe08ae3c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840ce070 con 0x7fe08415db10 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47852/0 (socket says 172.21.15.46:47852) 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 -- 172.21.15.46:0/679258550 learned_addr learned my addr 172.21.15.46:0/679258550 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe083fff700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe084159c60 0x7fe084158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe0893d9700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe08415db10 0x7fe0840b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 -- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe08415db10 msgr2=0x7fe0840b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe08415db10 0x7fe0840b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 -- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe084159c60 msgr2=0x7fe084158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe084159c60 0x7fe084158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.415+0000 7fe088bd8700 1 -- 172.21.15.46:0/679258550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740094f0 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe088bd8700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe074009290 tx=0x7fe074017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074026480 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07401f070 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0840ce350 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074026850 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.416+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840cf660 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.417+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08404c3c0 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.417+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe07401a430 con 0x7fe084159890 2023-10-07T09:05:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.418+0000 7fe080ff9700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 0x7fe0700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.418+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe074021070 con 0x7fe084159890 2023-10-07T09:05:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.418+0000 7fe083fff700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 0x7fe0700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.418+0000 7fe083fff700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 0x7fe0700697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0840ca710 tx=0x7fe078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.422+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe074053730 con 0x7fe084159890 2023-10-07T09:05:02.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.613+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe08406a5b0 con 0x7fe084159890 2023-10-07T09:05:02.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.617+0000 7fe080ff9700 1 -- 172.21.15.46:0/679258550 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe074056d50 con 0x7fe084159890 2023-10-07T09:05:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.618+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 msgr2=0x7fe0700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.618+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 0x7fe0700697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0840ca710 tx=0x7fe078008040 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.618+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 msgr2=0x7fe0841577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.618+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe074009290 tx=0x7fe074017000 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 shutdown_connections 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe070067320 0x7fe0700697d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe08415db10 0x7fe0840b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe084159890 0x7fe0841577e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 --2- 172.21.15.46:0/679258550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe084159c60 0x7fe084158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 >> 172.21.15.46:0/679258550 conn(0x7fe084068e20 msgr2=0x7fe0841530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 shutdown_connections 2023-10-07T09:05:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.619+0000 7fe08ae3c700 1 -- 172.21.15.46:0/679258550 wait complete. 2023-10-07T09:05:02.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-07T09:05:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.750+0000 7feef8baa700 1 Processor -- start 2023-10-07T09:05:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.750+0000 7feef8baa700 1 -- start start 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef8baa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef8baa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 0x7feef40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef8baa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef415a160 con 0x7feef4159c60 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef8baa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef4069f20 con 0x7feef4069560 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef8baa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40d13a0 con 0x7feef4159890 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 0x7feef40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef1d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feef4159c60 0x7feef415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:37118/0 (socket says 172.21.15.46:37118) 2023-10-07T09:05:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.751+0000 7feef1d9b700 1 -- 172.21.15.46:0/3716645139 learned_addr learned my addr 172.21.15.46:0/3716645139 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef159a700 1 -- 172.21.15.46:0/3716645139 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594633280 0 0) 0x7feef415a160 con 0x7feef4159c60 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef159a700 1 -- 172.21.15.46:0/3716645139 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc003570 con 0x7feef4159c60 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef259c700 1 -- 172.21.15.46:0/3716645139 >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 msgr2=0x7feef40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef259c700 1 --2- 172.21.15.46:0/3716645139 >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 0x7feef40699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef259c700 1 -- 172.21.15.46:0/3716645139 >> v1:172.21.15.133:6789/0 conn(0x7feef4159c60 legacy=0x7feef415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef259c700 1 -- 172.21.15.46:0/3716645139 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef415e140 con 0x7feef4159890 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef2d9d700 1 --2- 172.21.15.46:0/3716645139 >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 0x7feef40699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef259c700 1 --2- 172.21.15.46:0/3716645139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef415abd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feee40098e0 tx=0x7feee40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4cbad455c8e21c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef159a700 1 -- 172.21.15.46:0/3716645139 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4011630 con 0x7feef4159890 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef159a700 1 -- 172.21.15.46:0/3716645139 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4011790 con 0x7feef4159890 2023-10-07T09:05:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.752+0000 7feef159a700 1 -- 172.21.15.46:0/3716645139 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4011b30 con 0x7feef4159890 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 -- 172.21.15.46:0/3716645139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 msgr2=0x7feef415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 --2- 172.21.15.46:0/3716645139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef415abd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feee40098e0 tx=0x7feee40091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 -- 172.21.15.46:0/3716645139 shutdown_connections 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 --2- 172.21.15.46:0/3716645139 >> v2:172.21.15.133:3300/0 conn(0x7feef4069560 0x7feef40699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 --2- 172.21.15.46:0/3716645139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef415abd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 -- 172.21.15.46:0/3716645139 >> 172.21.15.46:0/3716645139 conn(0x7feef4068e20 msgr2=0x7feef40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 -- 172.21.15.46:0/3716645139 shutdown_connections 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.753+0000 7feef8baa700 1 -- 172.21.15.46:0/3716645139 wait complete. 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 Processor -- start 2023-10-07T09:05:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 -- start start 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4069560 0x7feef4143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef4169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef416a620 con 0x7feef4159c60 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40cd510 con 0x7feef4069560 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.754+0000 7feef8baa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef4144100 con 0x7feef4159890 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47856/0 (socket says 172.21.15.46:47856) 2023-10-07T09:05:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 -- 172.21.15.46:0/1490045450 learned_addr learned my addr 172.21.15.46:0/1490045450 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef259c700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4069560 0x7feef4143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef1d9b700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef4169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 -- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 msgr2=0x7feef4169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef4169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 -- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4069560 msgr2=0x7feef4143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4069560 0x7feef4143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 -- 172.21.15.46:0/1490045450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009a20 con 0x7feef4159c60 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef2d9d700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7feeec009f20 tx=0x7feeec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00cb70 con 0x7feef4159c60 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00f040 con 0x7feef4159c60 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee4009420 con 0x7feef4159c60 2023-10-07T09:05:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec014480 con 0x7feef4159c60 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.755+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef40ca5b0 con 0x7feef4159c60 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.756+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef40cd680 con 0x7feef4159c60 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.757+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feeec003020 con 0x7feef4159c60 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.757+0000 7feee27fc700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 0x7feed40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.757+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7feeec085360 con 0x7feef4159c60 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.757+0000 7feef259c700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 0x7feed40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.758+0000 7feef259c700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 0x7feed40697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feee40091e0 tx=0x7feee4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:02.761+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeec0521e0 con 0x7feef4159c60 2023-10-07T09:05:03.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.034+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7feef404c3c0 con 0x7feef4159c60 2023-10-07T09:05:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.255+0000 7feee27fc700 1 -- 172.21.15.46:0/1490045450 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v313) v1 ==== 156+0+0 (secure 0 0 0) 0x7feeec055800 con 0x7feef4159c60 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 msgr2=0x7feed40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 0x7feed40697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feee40091e0 tx=0x7feee4017000 comp rx=0 tx=0).stop 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 msgr2=0x7feef416a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7feeec009f20 tx=0x7feeec00b040 comp rx=0 tx=0).stop 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 shutdown_connections 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feed4067320 0x7feed40697d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef4159c60 0x7feef416a0e0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4069560 0x7feef4143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 --2- 172.21.15.46:0/1490045450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feef4159890 0x7feef4169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 >> 172.21.15.46:0/1490045450 conn(0x7feef4068e20 msgr2=0x7feef4158340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:03.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 shutdown_connections 2023-10-07T09:05:03.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.257+0000 7feef8baa700 1 -- 172.21.15.46:0/1490045450 wait complete. 2023-10-07T09:05:03.271 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-07T09:05:03.271 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-07T09:05:03.271 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:05:03.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-07T09:05:03.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 Processor -- start 2023-10-07T09:05:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 -- start start 2023-10-07T09:05:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 0x7f033015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0330069560 0x7f03300699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033015a160 con 0x7f0330159c60 2023-10-07T09:05:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.389+0000 7f0334c70700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0330069f20 con 0x7f0330069560 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f0334c70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300d13a0 con 0x7f0330159890 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 0x7f033015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0330069560 0x7f03300699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f0325d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0330159c60 0x7f033015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:37130/0 (socket says 172.21.15.46:37130) 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f0325d9b700 1 -- 172.21.15.46:0/2707444722 learned_addr learned my addr 172.21.15.46:0/2707444722 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032ed9d700 1 -- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 msgr2=0x7f033015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032ed9d700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 0x7f033015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032ed9d700 1 -- 172.21.15.46:0/2707444722 >> v1:172.21.15.133:6789/0 conn(0x7f0330159c60 legacy=0x7f033015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032ed9d700 1 -- 172.21.15.46:0/2707444722 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033015e140 con 0x7f0330069560 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032e59c700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 0x7f033015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.390+0000 7f032dd9b700 1 -- 172.21.15.46:0/2707444722 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130359348 0 0) 0x7f033015a160 con 0x7f0330159c60 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f032ed9d700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03300699e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0328009e60 tx=0x7f0328009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=928d983bd1d71737 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f032dd9b700 1 -- 172.21.15.46:0/2707444722 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800e070 con 0x7f0330069560 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f032dd9b700 1 -- 172.21.15.46:0/2707444722 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800bb60 con 0x7f0330069560 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f032dd9b700 1 -- 172.21.15.46:0/2707444722 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328012430 con 0x7f0330069560 2023-10-07T09:05:03.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 -- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 msgr2=0x7f03300699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03300699e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0328009e60 tx=0x7f0328009780 comp rx=0 tx=0).stop 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 -- 172.21.15.46:0/2707444722 shutdown_connections 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03300699e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 --2- 172.21.15.46:0/2707444722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159890 0x7f033015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 -- 172.21.15.46:0/2707444722 >> 172.21.15.46:0/2707444722 conn(0x7f0330068e20 msgr2=0x7f03300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 -- 172.21.15.46:0/2707444722 shutdown_connections 2023-10-07T09:05:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.391+0000 7f0334c70700 1 -- 172.21.15.46:0/2707444722 wait complete. 2023-10-07T09:05:03.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 Processor -- start 2023-10-07T09:05:03.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 -- start start 2023-10-07T09:05:03.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03301492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159c60 0x7f03300d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300b4740 con 0x7f0330159890 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301497e0 con 0x7f0330069560 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0334c70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300b3b30 con 0x7f0330159c60 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0325d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0325d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47870/0 (socket says 172.21.15.46:47870) 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.393+0000 7f0325d9b700 1 -- 172.21.15.46:0/2010042439 learned_addr learned my addr 172.21.15.46:0/2010042439 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f032e59c700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03301492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f032ed9d700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159c60 0x7f03300d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 -- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159c60 msgr2=0x7f03300d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159c60 0x7f03300d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 -- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 msgr2=0x7f03301492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03301492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 -- 172.21.15.46:0/2010042439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320009420 con 0x7f0330159890 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0325d9b700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f031800c810 tx=0x7f0318007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318005c00 con 0x7f0330159890 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0318005d60 con 0x7f0330159890 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0328009a20 con 0x7f0330159890 2023-10-07T09:05:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318007300 con 0x7f0330159890 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.394+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03300b40f0 con 0x7f0330159890 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.395+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03300b48b0 con 0x7f0330159890 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.396+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f031801b3b0 con 0x7f0330159890 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.396+0000 7f0326ffd700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 0x7f03100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.396+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0318083e30 con 0x7f0330159890 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.396+0000 7f032e59c700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 0x7f03100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.397+0000 7f032e59c700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 0x7f03100697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0320009f40 tx=0x7f03200091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.400+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0318050dc0 con 0x7f0330159890 2023-10-07T09:05:03.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:03.672+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f033004c3c0 con 0x7f0330159890 2023-10-07T09:05:04.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.258+0000 7f0326ffd700 1 -- 172.21.15.46:0/2010042439 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v314) v1 ==== 134+0+0 (secure 0 0 0) 0x7f0318017020 con 0x7f0330159890 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 msgr2=0x7f03100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 0x7f03100697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0320009f40 tx=0x7f03200091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 msgr2=0x7f033015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f031800c810 tx=0x7f0318007db0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 shutdown_connections 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0310067320 0x7f03100697d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0330159c60 0x7f03300d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0330069560 0x7f03301492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 --2- 172.21.15.46:0/2010042439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0330159890 0x7f033015cf10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 >> 172.21.15.46:0/2010042439 conn(0x7f0330068e20 msgr2=0x7f03301576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 shutdown_connections 2023-10-07T09:05:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.261+0000 7f0334c70700 1 -- 172.21.15.46:0/2010042439 wait complete. 2023-10-07T09:05:04.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:05:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.401+0000 7f1abd932700 1 Processor -- start 2023-10-07T09:05:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.401+0000 7f1abd932700 1 -- start start 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1abd932700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ab806eb00 0x7f1ab80ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1abd932700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 0x7f1ab81570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1abd932700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab815b730 con 0x7f1ab806e730 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1abd932700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab815b1e0 con 0x7f1ab806eb00 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1abd932700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab81586a0 con 0x7f1ab80ae890 2023-10-07T09:05:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1ab806e730 0x7f1ab815bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44480/0 (socket says 172.21.15.46:44480) 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab6ffd700 1 -- 172.21.15.46:0/3816088904 learned_addr learned my addr 172.21.15.46:0/3816088904 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab67fc700 1 --2- 172.21.15.46:0/3816088904 >> v2:172.21.15.46:3300/0 conn(0x7f1ab806eb00 0x7f1ab80ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab77fe700 1 --2- 172.21.15.46:0/3816088904 >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 0x7f1ab81570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab5ffb700 1 -- 172.21.15.46:0/3816088904 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281302548 0 0) 0x7f1ab815b730 con 0x7f1ab806e730 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab5ffb700 1 -- 172.21.15.46:0/3816088904 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4003570 con 0x7f1ab806e730 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab67fc700 1 -- 172.21.15.46:0/3816088904 >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 msgr2=0x7f1ab81570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab67fc700 1 --2- 172.21.15.46:0/3816088904 >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 0x7f1ab81570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab67fc700 1 -- 172.21.15.46:0/3816088904 >> v1:172.21.15.46:6789/0 conn(0x7f1ab806e730 legacy=0x7f1ab815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab67fc700 1 -- 172.21.15.46:0/3816088904 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8158980 con 0x7f1ab806eb00 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.402+0000 7f1ab77fe700 1 --2- 172.21.15.46:0/3816088904 >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 0x7f1ab81570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1ab67fc700 1 --2- 172.21.15.46:0/3816088904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab806eb00 0x7f1ab80ae350 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80cca20 tx=0x7f1aa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbb7452d8b6ddaa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1ab5ffb700 1 -- 172.21.15.46:0/3816088904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011630 con 0x7f1ab806eb00 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1ab5ffb700 1 -- 172.21.15.46:0/3816088904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0011790 con 0x7f1ab806eb00 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1ab5ffb700 1 -- 172.21.15.46:0/3816088904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011b30 con 0x7f1ab806eb00 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 -- 172.21.15.46:0/3816088904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab806eb00 msgr2=0x7f1ab80ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 --2- 172.21.15.46:0/3816088904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab806eb00 0x7f1ab80ae350 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80cca20 tx=0x7f1aa00091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 -- 172.21.15.46:0/3816088904 shutdown_connections 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 --2- 172.21.15.46:0/3816088904 >> v2:172.21.15.133:3300/0 conn(0x7f1ab80ae890 0x7f1ab81570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 --2- 172.21.15.46:0/3816088904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab806eb00 0x7f1ab80ae350 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 -- 172.21.15.46:0/3816088904 >> 172.21.15.46:0/3816088904 conn(0x7f1ab80c9fb0 msgr2=0x7f1ab806dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 -- 172.21.15.46:0/3816088904 shutdown_connections 2023-10-07T09:05:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.403+0000 7f1abd932700 1 -- 172.21.15.46:0/3816088904 wait complete. 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 Processor -- start 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 -- start start 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab806e730 0x7f1ab80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 0x7f1ab80c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c7550 con 0x7f1ab80ae890 2023-10-07T09:05:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8154f70 con 0x7f1ab806eb00 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1abd932700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c4c60 con 0x7f1ab806e730 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1ab77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1ab77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47890/0 (socket says 172.21.15.46:47890) 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.405+0000 7f1ab77fe700 1 -- 172.21.15.46:0/3789336599 learned_addr learned my addr 172.21.15.46:0/3789336599 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab67fc700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 0x7f1ab80c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab6ffd700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab806e730 0x7f1ab80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 -- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab806e730 msgr2=0x7f1ab80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab806e730 0x7f1ab80c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 -- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 msgr2=0x7f1ab80c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 0x7f1ab80c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 -- 172.21.15.46:0/3789336599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0009420 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab67fc700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 0x7f1ab80c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1ab77fe700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800cf20 tx=0x7f1aa8007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800adf0 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8016420 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80167e0 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab806c0b0 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.406+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80c7a40 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.407+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab806cfd0 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.407+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1aa8016bd0 con 0x7f1ab80ae890 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.408+0000 7f1aaeffd700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 0x7f1a980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.408+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1aa8012070 con 0x7f1ab80ae890 2023-10-07T09:05:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.408+0000 7f1ab6ffd700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 0x7f1a980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.409+0000 7f1ab6ffd700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 0x7f1a980697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00058d0 tx=0x7f1ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.412+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa804e5a0 con 0x7f1ab80ae890 2023-10-07T09:05:04.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.608+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1ab80c4da0 con 0x7f1ab80ae890 2023-10-07T09:05:04.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.612+0000 7f1aaeffd700 1 -- 172.21.15.46:0/3789336599 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1aa8055d30 con 0x7f1ab80ae890 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 msgr2=0x7f1a980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 0x7f1a980697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00058d0 tx=0x7f1ab0009040 comp rx=0 tx=0).stop 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 msgr2=0x7f1ab806bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800cf20 tx=0x7f1aa8007860 comp rx=0 tx=0).stop 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 shutdown_connections 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1a98067320 0x7f1a980697d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab80ae890 0x7f1ab806bb70 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab806e730 0x7f1ab80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 --2- 172.21.15.46:0/3789336599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab806eb00 0x7f1ab80c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 >> 172.21.15.46:0/3789336599 conn(0x7f1ab80c9fb0 msgr2=0x7f1ab80c27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:04.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 shutdown_connections 2023-10-07T09:05:04.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.614+0000 7f1abd932700 1 -- 172.21.15.46:0/3789336599 wait complete. 2023-10-07T09:05:04.627 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:05:04.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:04.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:04.714 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:05:04.714 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:05:04.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.832+0000 7f2d28f41700 1 Processor -- start 2023-10-07T09:05:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.832+0000 7f2d28f41700 1 -- start start 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d28f41700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 0x7f2d240b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d28f41700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d2415d230 0x7f2d2415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d28f41700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2415db70 con 0x7f2d24159420 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d28f41700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240b11d0 con 0x7f2d2415d230 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d28f41700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240b14b0 con 0x7f2d241597f0 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d2415d230 0x7f2d2415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d2415d230 0x7f2d2415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47898/0 (socket says 172.21.15.46:47898) 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 -- 172.21.15.46:0/2110300704 learned_addr learned my addr 172.21.15.46:0/2110300704 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 -- 172.21.15.46:0/2110300704 >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 msgr2=0x7f2d240b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d22ffd700 1 --2- 172.21.15.46:0/2110300704 >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 0x7f2d240b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 --2- 172.21.15.46:0/2110300704 >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 0x7f2d240b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 -- 172.21.15.46:0/2110300704 >> v1:172.21.15.133:6789/0 conn(0x7f2d24159420 legacy=0x7f2d240b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d23fff700 1 -- 172.21.15.46:0/2110300704 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240b1790 con 0x7f2d2415d230 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.833+0000 7f2d22ffd700 1 --2- 172.21.15.46:0/2110300704 >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 0x7f2d240b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d23fff700 1 --2- 172.21.15.46:0/2110300704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d2415d230 0x7f2d2415d630 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2d24089750 tx=0x7f2d1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113d0bbc38a6ebad server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d227fc700 1 -- 172.21.15.46:0/2110300704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00e070 con 0x7f2d2415d230 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d227fc700 1 -- 172.21.15.46:0/2110300704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c00ba10 con 0x7f2d2415d230 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d227fc700 1 -- 172.21.15.46:0/2110300704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0092e0 con 0x7f2d2415d230 2023-10-07T09:05:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 -- 172.21.15.46:0/2110300704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d2415d230 msgr2=0x7f2d2415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 --2- 172.21.15.46:0/2110300704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d2415d230 0x7f2d2415d630 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2d24089750 tx=0x7f2d1c009840 comp rx=0 tx=0).stop 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 -- 172.21.15.46:0/2110300704 shutdown_connections 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 --2- 172.21.15.46:0/2110300704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d2415d230 0x7f2d2415d630 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 --2- 172.21.15.46:0/2110300704 >> v2:172.21.15.133:3300/0 conn(0x7f2d241597f0 0x7f2d240b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 -- 172.21.15.46:0/2110300704 >> 172.21.15.46:0/2110300704 conn(0x7f2d240d0660 msgr2=0x7f2d240d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 -- 172.21.15.46:0/2110300704 shutdown_connections 2023-10-07T09:05:04.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.834+0000 7f2d28f41700 1 -- 172.21.15.46:0/2110300704 wait complete. 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.835+0000 7f2d28f41700 1 Processor -- start 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 -- start start 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d241597f0 0x7f2d240c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 0x7f2d240b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415ad70 con 0x7f2d24159420 2023-10-07T09:05:04.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241548a0 con 0x7f2d241597f0 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d28f41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415a1f0 con 0x7f2d2415d230 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47908/0 (socket says 172.21.15.46:47908) 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d237fe700 1 -- 172.21.15.46:0/243742349 learned_addr learned my addr 172.21.15.46:0/243742349 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d22ffd700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d241597f0 0x7f2d240c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.836+0000 7f2d23fff700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 0x7f2d240b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 -- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 msgr2=0x7f2d240b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 0x7f2d240b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 -- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d241597f0 msgr2=0x7f2d240c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d241597f0 0x7f2d240c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 -- 172.21.15.46:0/243742349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c009ae0 con 0x7f2d24159420 2023-10-07T09:05:04.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d23fff700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 0x7f2d240b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d237fe700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c5d0 tx=0x7f2d14007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011590 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14011710 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011ad0 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2415a4d0 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.837+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2415aa90 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.838+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2404c3c0 con 0x7f2d24159420 2023-10-07T09:05:04.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.838+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d1401c460 con 0x7f2d24159420 2023-10-07T09:05:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.839+0000 7f2d0b7fe700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 0x7f2d100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.839+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2d14084660 con 0x7f2d24159420 2023-10-07T09:05:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.839+0000 7f2d22ffd700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 0x7f2d100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.840+0000 7f2d22ffd700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 0x7f2d100697d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2d24159c70 tx=0x7f2d18006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:04.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:04.843+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d140515f0 con 0x7f2d24159420 2023-10-07T09:05:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.084+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d240b1a70 con 0x7f2d24159420 2023-10-07T09:05:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.085+0000 7f2d0b7fe700 1 -- 172.21.15.46:0/243742349 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2d14054c10 con 0x7f2d24159420 2023-10-07T09:05:05.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:05.087 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1195978104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1195978104},{"type":"v1","addr":"172.21.15.133:6837","nonce":1195978104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4191554953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4191554953},{"type":"v1","addr":"172.21.15.133:6836","nonce":4191554953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2460856659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2460856659},{"type":"v1","addr":"172.21.15.46:6834","nonce":2460856659}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3534476045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3534476045},{"type":"v1","addr":"172.21.15.46:6835","nonce":3534476045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 msgr2=0x7f2d100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 0x7f2d100697d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2d24159c70 tx=0x7f2d18006f90 comp rx=0 tx=0).stop 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 msgr2=0x7f2d24154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c5d0 tx=0x7f2d14007f60 comp rx=0 tx=0).stop 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 shutdown_connections 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d10067320 0x7f2d100697d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2415d230 0x7f2d240b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d24159420 0x7f2d24154360 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 --2- 172.21.15.46:0/243742349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d241597f0 0x7f2d240c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 >> 172.21.15.46:0/243742349 conn(0x7f2d240d0660 msgr2=0x7f2d24157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 shutdown_connections 2023-10-07T09:05:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.087+0000 7f2d28f41700 1 -- 172.21.15.46:0/243742349 wait complete. 2023-10-07T09:05:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 68 2023-10-07T09:05:05.101 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:05:05.101 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:05:05.101 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:05:05.101 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:05.102 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:05:05.102 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:05:05.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:05:05.102 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:05.102 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:05:05.103 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:05:05.103 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:05:05.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:05.103 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:05:05.103 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:05:05.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:05:05.104 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:05.114 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:05:05.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:05:05.116 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:05:05.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:05:05.118 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:05:05.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:05:05.119 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:05:05.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:05:05.157 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:05:05.157 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:05.158 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:05:05.158 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:05.160 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:05:05.160 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:05.161 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:05:05.161 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:05.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:05:05.234 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:05:05.235 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:05:05.239 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:05:05.240 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:05:05.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.286+0000 7fec3046a700 1 Processor -- start 2023-10-07T09:05:05.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.286+0000 7fec3046a700 1 -- start start 2023-10-07T09:05:05.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.287+0000 7fec3046a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 0x7fec280caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.287+0000 7fec3046a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 0x7fec2815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.287+0000 7fec3046a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2815d7e0 con 0x7fec2806bcd0 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.287+0000 7fec3046a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2815dac0 con 0x7fec2815df50 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.287+0000 7fec3046a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2815aa30 con 0x7fec2806c0a0 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2e206700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fec2806bcd0 0x7fec2815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44518/0 (socket says 172.21.15.46:44518) 2023-10-07T09:05:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2e206700 1 -- 172.21.15.46:0/1763210156 learned_addr learned my addr 172.21.15.46:0/1763210156 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2ea07700 1 --2- 172.21.15.46:0/1763210156 >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 0x7fec2815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 --2- 172.21.15.46:0/1763210156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 0x7fec280caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211202628 0 0) 0x7fec2815d7e0 con 0x7fec2806bcd0 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec14003570 con 0x7fec2806bcd0 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3866711295 0 0) 0x7fec14003570 con 0x7fec2806bcd0 2023-10-07T09:05:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 -- 172.21.15.46:0/1763210156 >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 msgr2=0x7fec2815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 --2- 172.21.15.46:0/1763210156 >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 0x7fec2815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 -- 172.21.15.46:0/1763210156 >> v1:172.21.15.46:6789/0 conn(0x7fec2806bcd0 legacy=0x7fec2815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 -- 172.21.15.46:0/1763210156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2815ad10 con 0x7fec2806c0a0 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2ea07700 1 --2- 172.21.15.46:0/1763210156 >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 0x7fec2815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2da05700 1 --2- 172.21.15.46:0/1763210156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 0x7fec280caa90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec180098e0 tx=0x7fec180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7089b71b00837a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24001470 con 0x7fec2806c0a0 2023-10-07T09:05:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.288+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18011420 con 0x7fec2806c0a0 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec2d204700 1 -- 172.21.15.46:0/1763210156 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180117c0 con 0x7fec2806c0a0 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 -- 172.21.15.46:0/1763210156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 msgr2=0x7fec280caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 --2- 172.21.15.46:0/1763210156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 0x7fec280caa90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec180098e0 tx=0x7fec180091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 -- 172.21.15.46:0/1763210156 shutdown_connections 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 --2- 172.21.15.46:0/1763210156 >> v2:172.21.15.133:3300/0 conn(0x7fec2815df50 0x7fec2815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 --2- 172.21.15.46:0/1763210156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806c0a0 0x7fec280caa90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 -- 172.21.15.46:0/1763210156 >> 172.21.15.46:0/1763210156 conn(0x7fec280ce600 msgr2=0x7fec280cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 -- 172.21.15.46:0/1763210156 shutdown_connections 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.289+0000 7fec3046a700 1 -- 172.21.15.46:0/1763210156 wait complete. 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.290+0000 7fec3046a700 1 Processor -- start 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.290+0000 7fec3046a700 1 -- start start 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806bcd0 0x7fec28148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec2806c0a0 0x7fec28155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28157be0 con 0x7fec2815df50 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28157750 con 0x7fec2806c0a0 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec3046a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec280b4300 con 0x7fec2806bcd0 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47960/0 (socket says 172.21.15.46:47960) 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 -- 172.21.15.46:0/2275966023 learned_addr learned my addr 172.21.15.46:0/2275966023 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2da05700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec2806c0a0 0x7fec28155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2e206700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806bcd0 0x7fec28148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 -- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806bcd0 msgr2=0x7fec28148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806bcd0 0x7fec28148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 -- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec2806c0a0 msgr2=0x7fec28155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec2806c0a0 0x7fec28155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.291+0000 7fec2ea07700 1 -- 172.21.15.46:0/2275966023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20009a20 con 0x7fec2815df50 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec2ea07700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fec20009fc0 tx=0x7fec2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2000cbd0 con 0x7fec2815df50 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2000f040 con 0x7fec2815df50 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec18009420 con 0x7fec2815df50 2023-10-07T09:05:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20014480 con 0x7fec2815df50 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.292+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec28156e20 con 0x7fec2815df50 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.293+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec281578e0 con 0x7fec2815df50 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.293+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fec20003020 con 0x7fec2815df50 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.294+0000 7fec1e7fc700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 0x7fec0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.294+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec20085380 con 0x7fec2815df50 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.294+0000 7fec2e206700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 0x7fec0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.294+0000 7fec2e206700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 0x7fec0c0697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fec240011e0 tx=0x7fec24001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:05.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.298+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec20052200 con 0x7fec2815df50 2023-10-07T09:05:05.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:05.508+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fec2804c3c0 con 0x7fec2815df50 2023-10-07T09:05:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.273+0000 7fec1e7fc700 1 -- 172.21.15.46:0/2275966023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7fec20055820 con 0x7fec2815df50 2023-10-07T09:05:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 msgr2=0x7fec0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 0x7fec0c0697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fec240011e0 tx=0x7fec24001a00 comp rx=0 tx=0).stop 2023-10-07T09:05:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 msgr2=0x7fec28156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fec20009fc0 tx=0x7fec2000b040 comp rx=0 tx=0).stop 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 shutdown_connections 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fec0c067320 0x7fec0c0697d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2815df50 0x7fec28156510 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec2806bcd0 0x7fec28148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 --2- 172.21.15.46:0/2275966023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec2806c0a0 0x7fec28155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 >> 172.21.15.46:0/2275966023 conn(0x7fec280ce600 msgr2=0x7fec2815b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 shutdown_connections 2023-10-07T09:05:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.276+0000 7fec3046a700 1 -- 172.21.15.46:0/2275966023 wait complete. 2023-10-07T09:05:06.280 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:05:06.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:05:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.416+0000 7f99fce3d700 1 Processor -- start 2023-10-07T09:05:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.416+0000 7f99fce3d700 1 -- start start 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99fce3d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99f80cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99fce3d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80adcf0 con 0x7f99f806bbe0 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99fce3d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80adfb0 con 0x7f99f8156950 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99fce3d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f806cbf0 con 0x7f99f806ec80 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99f7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f99f806bbe0 0x7f99f80ae440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44520/0 (socket says 172.21.15.46:44520) 2023-10-07T09:05:06.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99f7fff700 1 -- 172.21.15.46:0/2983882932 learned_addr learned my addr 172.21.15.46:0/2983882932 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99f6ffd700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99f80cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474659996 0 0) 0x7f99f80adcf0 con 0x7f99f806bbe0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.417+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e0003570 con 0x7f99f806bbe0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595519849 0 0) 0x7f99e0003570 con 0x7f99f806bbe0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 msgr2=0x7f99f80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99f80cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 >> v1:172.21.15.133:6789/0 conn(0x7f99f8156950 legacy=0x7f99f806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8156d20 con 0x7f99f806bbe0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f99f00017f0 con 0x7f99f806bbe0 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 >> v1:172.21.15.46:6789/0 conn(0x7f99f806bbe0 legacy=0x7f99f80ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e0003a90 0x7f99e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e0004d50 0x7f99e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f806cbf0 con 0x7f99e0004d50 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e000bb10 con 0x7f99e0003a90 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e000bcd0 con 0x7f99f806ec80 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e0004d50 0x7f99e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f77fe700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e0003a90 0x7f99e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f6ffd700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 -- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 msgr2=0x7f99e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f806ec80 0x7f99e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 -- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e0003a90 msgr2=0x7f99e0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:06.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e0003a90 0x7f99e0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 -- 172.21.15.46:0/2983882932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0003570 con 0x7f99e0004d50 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f7fff700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e0004d50 0x7f99e00051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f99f000a8d0 tx=0x7f99f0002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a44333a5e2840d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00070d0 con 0x7f99e0004d50 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0007230 con 0x7f99e0004d50 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.418+0000 7f99f67fc700 1 -- 172.21.15.46:0/2983882932 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00075f0 con 0x7f99e0004d50 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 -- 172.21.15.46:0/2983882932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e0004d50 msgr2=0x7f99e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 --2- 172.21.15.46:0/2983882932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e0004d50 0x7f99e00051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f99f000a8d0 tx=0x7f99f0002170 comp rx=0 tx=0).stop 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99f7fff700 1 -- 172.21.15.46:0/2983882932 reap_dead start 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 -- 172.21.15.46:0/2983882932 shutdown_connections 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 -- 172.21.15.46:0/2983882932 >> 172.21.15.46:0/2983882932 conn(0x7f99f806b490 msgr2=0x7f99f80cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 -- 172.21.15.46:0/2983882932 shutdown_connections 2023-10-07T09:05:06.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.419+0000 7f99fce3d700 1 -- 172.21.15.46:0/2983882932 wait complete. 2023-10-07T09:05:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.420+0000 7f99fce3d700 1 Processor -- start 2023-10-07T09:05:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.420+0000 7f99fce3d700 1 -- start start 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f80c4850 0x7f99f8155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 0x7f99f8159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8155c50 con 0x7f99f8152a90 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8157f10 con 0x7f99f81557b0 2023-10-07T09:05:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99fce3d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8152e60 con 0x7f99f80c4850 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47984/0 (socket says 172.21.15.46:47984) 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 -- 172.21.15.46:0/4111275579 learned_addr learned my addr 172.21.15.46:0/4111275579 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f7fff700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 0x7f99f8159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f6ffd700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f80c4850 0x7f99f8155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 -- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f80c4850 msgr2=0x7f99f8155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f80c4850 0x7f99f8155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 -- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 msgr2=0x7f99f8159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 0x7f99f8159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f77fe700 1 -- 172.21.15.46:0/4111275579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8158160 con 0x7f99f8152a90 2023-10-07T09:05:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.421+0000 7f99f7fff700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 0x7f99f8159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99f77fe700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f99e8002a80 tx=0x7f99e8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800f940 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e800faa0 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f8158440 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800fea0 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.422+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8158a00 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.423+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f804c3c0 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.423+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f99e8013600 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.423+0000 7f99df7fe700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 0x7f99e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.424+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f99e8084f70 con 0x7f99f8152a90 2023-10-07T09:05:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.424+0000 7f99f6ffd700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 0x7f99e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.424+0000 7f99f6ffd700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 0x7f99e40697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c9560 tx=0x7f99ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.428+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99e8051f50 con 0x7f99f8152a90 2023-10-07T09:05:06.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.697+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f99f80c9750 con 0x7f99f8152a90 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.698+0000 7f99df7fe700 1 -- 172.21.15.46:0/4111275579 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f99e8055570 con 0x7f99f8152a90 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:05:06.704 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:05:06.707 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.709 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.710 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:06.711 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:06.712 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.713 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:06.714 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:05:06.715 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:05:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 msgr2=0x7f99e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 0x7f99e40697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c9560 tx=0x7f99ec008040 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 msgr2=0x7f99f80c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f99e8002a80 tx=0x7f99e8007d10 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 shutdown_connections 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e4067320 0x7f99e40697d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f81557b0 0x7f99f8159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99f8152a90 0x7f99f80c4310 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 --2- 172.21.15.46:0/4111275579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f80c4850 0x7f99f8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 >> 172.21.15.46:0/4111275579 conn(0x7f99f806b490 msgr2=0x7f99f8154900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 shutdown_connections 2023-10-07T09:05:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.700+0000 7f99fce3d700 1 -- 172.21.15.46:0/4111275579 wait complete. 2023-10-07T09:05:06.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.835+0000 7fb3719e1700 1 Processor -- start 2023-10-07T09:05:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.835+0000 7fb3719e1700 1 -- start start 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3719e1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 0x7fb36c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3719e1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c0b2980 con 0x7fb36c159420 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3719e1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c15dbb0 con 0x7fb36c1597f0 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3719e1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0b11d0 con 0x7fb36c15d230 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3709df700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb36c159420 0x7fb36c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44534/0 (socket says 172.21.15.46:44534) 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3709df700 1 -- 172.21.15.46:0/715394066 learned_addr learned my addr 172.21.15.46:0/715394066 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb3711e0700 1 --2- 172.21.15.46:0/715394066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 0x7fb36c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.836+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240809082 0 0) 0x7fb36c0b2980 con 0x7fb36c159420 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb358003570 con 0x7fb36c159420 2023-10-07T09:05:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946240515 0 0) 0x7fb36c15dbb0 con 0x7fb36c1597f0 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb36c0b2980 con 0x7fb36c1597f0 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125784738 0 0) 0x7fb358003570 con 0x7fb36c159420 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb3711e0700 1 -- 172.21.15.46:0/715394066 >> v1:172.21.15.133:6789/0 conn(0x7fb36c1597f0 legacy=0x7fb36c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb3711e0700 1 -- 172.21.15.46:0/715394066 >> v1:172.21.15.46:6789/0 conn(0x7fb36c159420 legacy=0x7fb36c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb3711e0700 1 -- 172.21.15.46:0/715394066 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0b14b0 con 0x7fb36c15d230 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb3711e0700 1 --2- 172.21.15.46:0/715394066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 0x7fb36c15d670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb354009910 tx=0x7fb3540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1d21035252c237 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640017f0 con 0x7fb36c15d230 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354011420 con 0x7fb36c15d230 2023-10-07T09:05:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.837+0000 7fb36b7fe700 1 -- 172.21.15.46:0/715394066 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3540117c0 con 0x7fb36c15d230 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 -- 172.21.15.46:0/715394066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 msgr2=0x7fb36c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 --2- 172.21.15.46:0/715394066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 0x7fb36c15d670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb354009910 tx=0x7fb3540091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 -- 172.21.15.46:0/715394066 shutdown_connections 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 --2- 172.21.15.46:0/715394066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c15d230 0x7fb36c15d670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 -- 172.21.15.46:0/715394066 >> 172.21.15.46:0/715394066 conn(0x7fb36c0d0660 msgr2=0x7fb36c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 -- 172.21.15.46:0/715394066 shutdown_connections 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.838+0000 7fb3719e1700 1 -- 172.21.15.46:0/715394066 wait complete. 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.839+0000 7fb3719e1700 1 Processor -- start 2023-10-07T09:05:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.839+0000 7fb3719e1700 1 -- start start 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb36c159420 0x7fb36c141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c1597f0 0x7fb36c140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1691c0 con 0x7fb36c15d230 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15b1b0 con 0x7fb36c159420 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15b490 con 0x7fb36c1597f0 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47992/0 (socket says 172.21.15.46:47992) 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 -- 172.21.15.46:0/2534657005 learned_addr learned my addr 172.21.15.46:0/2534657005 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3709df700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb36c159420 0x7fb36c141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb36bfff700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c1597f0 0x7fb36c140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 -- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c1597f0 msgr2=0x7fb36c140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c1597f0 0x7fb36c140c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 -- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb36c159420 msgr2=0x7fb36c141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb36c159420 0x7fb36c141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 -- 172.21.15.46:0/2534657005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009420 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3711e0700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb36c089340 tx=0x7fb354016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35401cda0 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35401a450 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.840+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c15b770 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.841+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35401a810 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.841+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c15bd30 con 0x7fb36c15d230 2023-10-07T09:05:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.841+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c15bf20 con 0x7fb36c15d230 2023-10-07T09:05:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.842+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb35401ab80 con 0x7fb36c15d230 2023-10-07T09:05:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.842+0000 7fb368ff9700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 0x7fb34c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.842+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb3540863b0 con 0x7fb36c15d230 2023-10-07T09:05:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.843+0000 7fb3709df700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 0x7fb34c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.843+0000 7fb3709df700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 0x7fb34c0697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb364001370 tx=0x7fb364000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:06.847+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb354053410 con 0x7fb36c15d230 2023-10-07T09:05:07.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.042+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb36c04c3c0 con 0x7fb36c15d230 2023-10-07T09:05:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.043+0000 7fb368ff9700 1 -- 172.21.15.46:0/2534657005 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+12144 (secure 0 0 0) 0x7fb354056a30 con 0x7fb36c15d230 2023-10-07T09:05:07.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:07.045 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":110,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:06.270618+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 msgr2=0x7fb34c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 0x7fb34c0697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb364001370 tx=0x7fb364000f40 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 msgr2=0x7fb36c16c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb36c089340 tx=0x7fb354016000 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 shutdown_connections 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb34c067320 0x7fb34c0697d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb36c15d230 0x7fb36c16c8d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb36c159420 0x7fb36c141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.045+0000 7fb3719e1700 1 --2- 172.21.15.46:0/2534657005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36c1597f0 0x7fb36c140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.046+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 >> 172.21.15.46:0/2534657005 conn(0x7fb36c0d0660 msgr2=0x7fb36c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.046+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 shutdown_connections 2023-10-07T09:05:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.046+0000 7fb3719e1700 1 -- 172.21.15.46:0/2534657005 wait complete. 2023-10-07T09:05:07.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:05:07.060 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:05:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.180+0000 7f2949fb9700 1 Processor -- start 2023-10-07T09:05:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.180+0000 7f2949fb9700 1 -- start start 2023-10-07T09:05:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2949fb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 0x7f2944159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2949fb9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29440cd1c0 0x7f29440cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2949fb9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440689e0 con 0x7f2944159930 2023-10-07T09:05:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2949fb9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440cdb80 con 0x7f29440cd1c0 2023-10-07T09:05:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2949fb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29440cbcc0 con 0x7f29440cb710 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29440cd1c0 0x7f29440cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29440cd1c0 0x7f29440cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47998/0 (socket says 172.21.15.46:47998) 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 -- 172.21.15.46:0/2717854990 learned_addr learned my addr 172.21.15.46:0/2717854990 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2942ffd700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 0x7f2944159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 -- 172.21.15.46:0/2717854990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 msgr2=0x7f2944159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 0x7f2944159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 -- 172.21.15.46:0/2717854990 >> v1:172.21.15.133:6789/0 conn(0x7f2944159930 legacy=0x7f29440b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 -- 172.21.15.46:0/2717854990 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440cbfa0 con 0x7f29440cd1c0 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2942ffd700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 0x7f2944159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.181+0000 7f2943fff700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f29440cd640 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f293c009f20 tx=0x7f293c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba09fa08e1fa0a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f29427fc700 1 -- 172.21.15.46:0/2717854990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00e070 con 0x7f29440cd1c0 2023-10-07T09:05:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f29427fc700 1 -- 172.21.15.46:0/2717854990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00bb10 con 0x7f29440cd1c0 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f29427fc700 1 -- 172.21.15.46:0/2717854990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0092e0 con 0x7f29440cd1c0 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 -- 172.21.15.46:0/2717854990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 msgr2=0x7f29440cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f29440cd640 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f293c009f20 tx=0x7f293c009840 comp rx=0 tx=0).stop 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 -- 172.21.15.46:0/2717854990 shutdown_connections 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f29440cd640 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 --2- 172.21.15.46:0/2717854990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29440cb710 0x7f2944159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 -- 172.21.15.46:0/2717854990 >> 172.21.15.46:0/2717854990 conn(0x7f29440999d0 msgr2=0x7f29440b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 -- 172.21.15.46:0/2717854990 shutdown_connections 2023-10-07T09:05:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.182+0000 7f2949fb9700 1 -- 172.21.15.46:0/2717854990 wait complete. 2023-10-07T09:05:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.183+0000 7f2949fb9700 1 Processor -- start 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.183+0000 7f2949fb9700 1 -- start start 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29440cb710 0x7f2944157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2944159930 0x7f294409a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294409b1b0 con 0x7f29440cd1c0 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294415cee0 con 0x7f29440cb710 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2949fb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294415d1c0 con 0x7f2944159930 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2942ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2942ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48002/0 (socket says 172.21.15.46:48002) 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2942ffd700 1 -- 172.21.15.46:0/234272335 learned_addr learned my addr 172.21.15.46:0/234272335 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f29437fe700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29440cb710 0x7f2944157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.184+0000 7f2943fff700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2944159930 0x7f294409a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 -- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2944159930 msgr2=0x7f294409a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2944159930 0x7f294409a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 -- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29440cb710 msgr2=0x7f2944157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29440cb710 0x7f2944157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 -- 172.21.15.46:0/234272335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c009ae0 con 0x7f29440cd1c0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2942ffd700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f293800e8d0 tx=0x7f2938008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938013410 con 0x7f29440cd1c0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938013570 con 0x7f29440cd1c0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294415d4a0 con 0x7f29440cd1c0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938013910 con 0x7f29440cd1c0 2023-10-07T09:05:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.185+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294415da60 con 0x7f29440cd1c0 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.186+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294415dc80 con 0x7f29440cd1c0 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.186+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2938013d40 con 0x7f29440cd1c0 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.187+0000 7f292b7fe700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 0x7f29300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.187+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2938084730 con 0x7f29440cd1c0 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.187+0000 7f29437fe700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 0x7f29300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.188+0000 7f29437fe700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 0x7f29300697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2934003a20 tx=0x7f2934007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.191+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2938051600 con 0x7f29440cd1c0 2023-10-07T09:05:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.383+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f294404c3c0 con 0x7f29440cd1c0 2023-10-07T09:05:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.383+0000 7f292b7fe700 1 -- 172.21.15.46:0/234272335 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2938054c20 con 0x7f29440cd1c0 2023-10-07T09:05:07.385 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:05:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 msgr2=0x7f29300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 0x7f29300697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2934003a20 tx=0x7f2934007f10 comp rx=0 tx=0).stop 2023-10-07T09:05:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 msgr2=0x7f294409a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f293800e8d0 tx=0x7f2938008040 comp rx=0 tx=0).stop 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 shutdown_connections 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2930067320 0x7f29300697d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2944159930 0x7f294409a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29440cb710 0x7f2944157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 --2- 172.21.15.46:0/234272335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29440cd1c0 0x7f294409a340 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 >> 172.21.15.46:0/234272335 conn(0x7f29440999d0 msgr2=0x7f2944158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 shutdown_connections 2023-10-07T09:05:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.385+0000 7f2949fb9700 1 -- 172.21.15.46:0/234272335 wait complete. 2023-10-07T09:05:07.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:05:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.516+0000 7eff16a43700 1 Processor -- start 2023-10-07T09:05:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.516+0000 7eff16a43700 1 -- start start 2023-10-07T09:05:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff16a43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff10068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff16a43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff10068bb0 0x7eff1015c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff16a43700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1015c480 con 0x7eff10159c10 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff16a43700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100b2a40 con 0x7eff10068bb0 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff16a43700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015b870 con 0x7eff100b5ea0 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff14fe0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff10068bb0 0x7eff1015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff14fe0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff10068bb0 0x7eff1015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48006/0 (socket says 172.21.15.46:48006) 2023-10-07T09:05:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff14fe0700 1 -- 172.21.15.46:0/3941835641 learned_addr learned my addr 172.21.15.46:0/3941835641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.517+0000 7eff0f7fe700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff10068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff14fe0700 1 -- 172.21.15.46:0/3941835641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 msgr2=0x7eff10068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff14fe0700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff10068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff14fe0700 1 -- 172.21.15.46:0/3941835641 >> v1:172.21.15.133:6789/0 conn(0x7eff10159c10 legacy=0x7eff1015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff14fe0700 1 -- 172.21.15.46:0/3941835641 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1015bb50 con 0x7eff10068bb0 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff14fe0700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10068bb0 0x7eff1015c910 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7eff08009f50 tx=0x7eff08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7665c1384b4e161 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff0effd700 1 -- 172.21.15.46:0/3941835641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800e070 con 0x7eff10068bb0 2023-10-07T09:05:07.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff0effd700 1 -- 172.21.15.46:0/3941835641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800b9c0 con 0x7eff10068bb0 2023-10-07T09:05:07.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.518+0000 7eff0effd700 1 -- 172.21.15.46:0/3941835641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080092e0 con 0x7eff10068bb0 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 -- 172.21.15.46:0/3941835641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10068bb0 msgr2=0x7eff1015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10068bb0 0x7eff1015c910 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7eff08009f50 tx=0x7eff08009840 comp rx=0 tx=0).stop 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 -- 172.21.15.46:0/3941835641 shutdown_connections 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10068bb0 0x7eff1015c910 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 --2- 172.21.15.46:0/3941835641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff10068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 -- 172.21.15.46:0/3941835641 >> 172.21.15.46:0/3941835641 conn(0x7eff10099a20 msgr2=0x7eff100af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 -- 172.21.15.46:0/3941835641 shutdown_connections 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.519+0000 7eff16a43700 1 -- 172.21.15.46:0/3941835641 wait complete. 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.520+0000 7eff16a43700 1 Processor -- start 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.520+0000 7eff16a43700 1 -- start start 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 0x7eff10148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff100b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c77f0 con 0x7eff10159c10 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c7ad0 con 0x7eff10068bb0 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff16a43700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c7db0 con 0x7eff100b5ea0 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48020/0 (socket says 172.21.15.46:48020) 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 -- 172.21.15.46:0/1004990511 learned_addr learned my addr 172.21.15.46:0/1004990511 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff0f7fe700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff100b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff0ffff700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 0x7eff10148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 -- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 msgr2=0x7eff100b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff100b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 -- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 msgr2=0x7eff10148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 0x7eff10148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 -- 172.21.15.46:0/1004990511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009ae0 con 0x7eff10159c10 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff0ffff700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 0x7eff10148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.521+0000 7eff14fe0700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7eff08009880 tx=0x7eff08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08008c30 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08008d90 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff100c8090 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08026670 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100c8890 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.522+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff10089e60 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.523+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff08003040 con 0x7eff10159c10 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.523+0000 7efef7fff700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 0x7efefc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.523+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7eff08086960 con 0x7eff10159c10 2023-10-07T09:05:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.524+0000 7eff0ffff700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 0x7efefc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.524+0000 7eff0ffff700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 0x7efefc0697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff000017a0 tx=0x7eff00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.528+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff08053830 con 0x7eff10159c10 2023-10-07T09:05:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.723+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7eff100b3130 con 0x7eff10159c10 2023-10-07T09:05:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.724+0000 7efef7fff700 1 -- 172.21.15.46:0/1004990511 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) v1 ==== 84+0+65 (secure 0 0 0) 0x7eff08056e50 con 0x7eff10159c10 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:07.726 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:05:07.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.725+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 msgr2=0x7efefc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.725+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 0x7efefc0697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff000017a0 tx=0x7eff00009040 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.725+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 msgr2=0x7eff100b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.725+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7eff08009880 tx=0x7eff08018000 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 shutdown_connections 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efefc067320 0x7efefc0697d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff10159c10 0x7eff100b3a60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff10068bb0 0x7eff10148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 --2- 172.21.15.46:0/1004990511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff100b5ea0 0x7eff100b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 >> 172.21.15.46:0/1004990511 conn(0x7eff10099a20 msgr2=0x7eff1009a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 shutdown_connections 2023-10-07T09:05:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.726+0000 7eff16a43700 1 -- 172.21.15.46:0/1004990511 wait complete. 2023-10-07T09:05:07.739 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:05:07.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:05:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.861+0000 7ffa59941700 1 Processor -- start 2023-10-07T09:05:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.861+0000 7ffa59941700 1 -- start start 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa59941700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 0x7ffa540cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa59941700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa540b6390 0x7ffa540b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa59941700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa54068390 con 0x7ffa540cbae0 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa59941700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa54159d20 con 0x7ffa540b6390 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa59941700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540b3cd0 con 0x7ffa54159950 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa52ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 0x7ffa540cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa527fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa540b6390 0x7ffa540b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.862+0000 7ffa527fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa540b6390 0x7ffa540b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:44834/0 (socket says 172.21.15.46:44834) 2023-10-07T09:05:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 -- 172.21.15.46:0/391170133 learned_addr learned my addr 172.21.15.46:0/391170133 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 -- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 msgr2=0x7ffa540cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 0x7ffa540cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 -- 172.21.15.46:0/391170133 >> v1:172.21.15.133:6789/0 conn(0x7ffa540cbae0 legacy=0x7ffa540ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 -- 172.21.15.46:0/391170133 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540b3f40 con 0x7ffa540b6390 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa52ffd700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 0x7ffa540cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa527fc700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa540b4d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0099b0 tx=0x7ffa3c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739bfb653cbd5aac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa51ffb700 1 -- 172.21.15.46:0/391170133 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c009ea0 con 0x7ffa540b6390 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa51ffb700 1 -- 172.21.15.46:0/391170133 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c00b860 con 0x7ffa540b6390 2023-10-07T09:05:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.863+0000 7ffa51ffb700 1 -- 172.21.15.46:0/391170133 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00bc00 con 0x7ffa540b6390 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 -- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 msgr2=0x7ffa540b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa540b4d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0099b0 tx=0x7ffa3c009250 comp rx=0 tx=0).stop 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 -- 172.21.15.46:0/391170133 shutdown_connections 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa54159950 0x7ffa540cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 --2- 172.21.15.46:0/391170133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa540b4d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 -- 172.21.15.46:0/391170133 >> 172.21.15.46:0/391170133 conn(0x7ffa540998b0 msgr2=0x7ffa540b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 -- 172.21.15.46:0/391170133 shutdown_connections 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.864+0000 7ffa59941700 1 -- 172.21.15.46:0/391170133 wait complete. 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.865+0000 7ffa59941700 1 Processor -- start 2023-10-07T09:05:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.865+0000 7ffa59941700 1 -- start start 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa5409d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa540cbae0 0x7ffa5416ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5409b6f0 con 0x7ffa54159950 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5416cf60 con 0x7ffa540b6390 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa59941700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5409aae0 con 0x7ffa540cbae0 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48032/0 (socket says 172.21.15.46:48032) 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 -- 172.21.15.46:0/1862573470 learned_addr learned my addr 172.21.15.46:0/1862573470 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa52ffd700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa5409d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa527fc700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa540cbae0 0x7ffa5416ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 -- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa540cbae0 msgr2=0x7ffa5416ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa540cbae0 0x7ffa5416ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 -- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 msgr2=0x7ffa5409d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa5409d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 -- 172.21.15.46:0/1862573470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009420 con 0x7ffa54159950 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.866+0000 7ffa537fe700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c8e0 tx=0x7ffa44001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.867+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44012630 con 0x7ffa54159950 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.867+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44012790 con 0x7ffa54159950 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.867+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c0094f0 con 0x7ffa54159950 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.867+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44012b50 con 0x7ffa54159950 2023-10-07T09:05:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.867+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5409b0a0 con 0x7ffa54159950 2023-10-07T09:05:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.868+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5409b860 con 0x7ffa54159950 2023-10-07T09:05:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.868+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa4401a3a0 con 0x7ffa54159950 2023-10-07T09:05:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.869+0000 7ffa4affd700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 0x7ffa340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.869+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffa44084b70 con 0x7ffa54159950 2023-10-07T09:05:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.869+0000 7ffa52ffd700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 0x7ffa340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.869+0000 7ffa52ffd700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 0x7ffa340697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009ea0 tx=0x7ffa4c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:07.873+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa44051b50 con 0x7ffa54159950 2023-10-07T09:05:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.065+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffa5404c3c0 con 0x7ffa54159950 2023-10-07T09:05:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.279+0000 7ffa4affd700 1 -- 172.21.15.46:0/1862573470 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa44055170 con 0x7ffa54159950 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 msgr2=0x7ffa340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 0x7ffa340697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009ea0 tx=0x7ffa4c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 msgr2=0x7ffa5409a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c8e0 tx=0x7ffa44001710 comp rx=0 tx=0).stop 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 shutdown_connections 2023-10-07T09:05:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa34067320 0x7ffa340697d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54159950 0x7ffa5409a220 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa540b6390 0x7ffa5409d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 --2- 172.21.15.46:0/1862573470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa540cbae0 0x7ffa5416ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 >> 172.21.15.46:0/1862573470 conn(0x7ffa540998b0 msgr2=0x7ffa54158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 shutdown_connections 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.284+0000 7ffa59941700 1 -- 172.21.15.46:0/1862573470 wait complete. 2023-10-07T09:05:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:05:08.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:05:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.423+0000 7f2d53ff5700 1 Processor -- start 2023-10-07T09:05:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.423+0000 7f2d53ff5700 1 -- start start 2023-10-07T09:05:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d53ff5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d4c156620 0x7f2d4c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d53ff5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d4c1569f0 0x7f2d4c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d53ff5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0ad3b0 con 0x7f2d4c068390 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d53ff5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c8d30 con 0x7f2d4c156620 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d53ff5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c15a6f0 con 0x7f2d4c1569f0 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d51d91700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d4c156620 0x7f2d4c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d51d91700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d4c156620 0x7f2d4c0c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48036/0 (socket says 172.21.15.46:48036) 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.424+0000 7f2d51d91700 1 -- 172.21.15.46:0/2520959827 learned_addr learned my addr 172.21.15.46:0/2520959827 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51590700 1 --2- 172.21.15.46:0/2520959827 >> v2:172.21.15.133:3300/0 conn(0x7f2d4c1569f0 0x7f2d4c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51d91700 1 -- 172.21.15.46:0/2520959827 >> v2:172.21.15.133:3300/0 conn(0x7f2d4c1569f0 msgr2=0x7f2d4c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51d91700 1 --2- 172.21.15.46:0/2520959827 >> v2:172.21.15.133:3300/0 conn(0x7f2d4c1569f0 0x7f2d4c0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51d91700 1 -- 172.21.15.46:0/2520959827 >> v1:172.21.15.133:6789/0 conn(0x7f2d4c068390 legacy=0x7f2d4c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51d91700 1 -- 172.21.15.46:0/2520959827 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c15a9d0 con 0x7f2d4c156620 2023-10-07T09:05:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d51d91700 1 --2- 172.21.15.46:0/2520959827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c87f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0c6a50 tx=0x7f2d44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127c26125f5ecd76 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d50d8f700 1 -- 172.21.15.46:0/2520959827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400e070 con 0x7f2d4c156620 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d50d8f700 1 -- 172.21.15.46:0/2520959827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400ba50 con 0x7f2d4c156620 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d50d8f700 1 -- 172.21.15.46:0/2520959827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d440092e0 con 0x7f2d4c156620 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.425+0000 7f2d53ff5700 1 -- 172.21.15.46:0/2520959827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 msgr2=0x7f2d4c0c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/2520959827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c87f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0c6a50 tx=0x7f2d44009840 comp rx=0 tx=0).stop 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 -- 172.21.15.46:0/2520959827 shutdown_connections 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/2520959827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c87f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/2520959827 >> v2:172.21.15.133:3300/0 conn(0x7f2d4c1569f0 0x7f2d4c0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 -- 172.21.15.46:0/2520959827 >> 172.21.15.46:0/2520959827 conn(0x7f2d4c0cc540 msgr2=0x7f2d4c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 -- 172.21.15.46:0/2520959827 shutdown_connections 2023-10-07T09:05:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.426+0000 7f2d53ff5700 1 -- 172.21.15.46:0/2520959827 wait complete. 2023-10-07T09:05:08.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.427+0000 7f2d53ff5700 1 Processor -- start 2023-10-07T09:05:08.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.427+0000 7f2d53ff5700 1 -- start start 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.427+0000 7f2d53ff5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d4c068390 0x7f2d4c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 0x7f2d4c14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c0ec0 con 0x7f2d4c156620 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c1f40 con 0x7f2d4c068390 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c1120 con 0x7f2d4c1569f0 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48044/0 (socket says 172.21.15.46:48044) 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 -- 172.21.15.46:0/68360782 learned_addr learned my addr 172.21.15.46:0/68360782 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51d91700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d4c068390 0x7f2d4c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d52592700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 0x7f2d4c14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 -- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 msgr2=0x7f2d4c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 0x7f2d4c14f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 -- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d4c068390 msgr2=0x7f2d4c1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d4c068390 0x7f2d4c1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 -- 172.21.15.46:0/68360782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44009ae0 con 0x7f2d4c156620 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d52592700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 0x7f2d4c14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d51590700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d890 tx=0x7f2d40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400125f0 con 0x7f2d4c156620 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40012750 con 0x7f2d4c156620 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c0c18f0 con 0x7f2d4c156620 2023-10-07T09:05:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.428+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40012ad0 con 0x7f2d4c156620 2023-10-07T09:05:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.429+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c14fbd0 con 0x7f2d4c156620 2023-10-07T09:05:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.429+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c0c20d0 con 0x7f2d4c156620 2023-10-07T09:05:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.430+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d4001e460 con 0x7f2d4c156620 2023-10-07T09:05:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.430+0000 7f2d49ffb700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 0x7f2d380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.431+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2d400850f0 con 0x7f2d4c156620 2023-10-07T09:05:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.431+0000 7f2d51d91700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 0x7f2d380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.431+0000 7f2d51d91700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 0x7f2d380697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009880 tx=0x7f2d44018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:08.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.435+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d40051f60 con 0x7f2d4c156620 2023-10-07T09:05:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:08.629+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d4c0718b0 con 0x7f2d4c156620 2023-10-07T09:05:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.286+0000 7f2d49ffb700 1 -- 172.21.15.46:0/68360782 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2d40055580 con 0x7f2d4c156620 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 msgr2=0x7f2d380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 0x7f2d380697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009880 tx=0x7f2d44018000 comp rx=0 tx=0).stop 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 msgr2=0x7f2d4c0c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d890 tx=0x7f2d40008040 comp rx=0 tx=0).stop 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 shutdown_connections 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d38067320 0x7f2d380697d0 secure :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009880 tx=0x7f2d44018000 comp rx=0 tx=0).stop 2023-10-07T09:05:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d4c1569f0 0x7f2d4c14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d4c068390 0x7f2d4c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 --2- 172.21.15.46:0/68360782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c156620 0x7f2d4c0c0980 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.290+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 >> 172.21.15.46:0/68360782 conn(0x7f2d4c0cc540 msgr2=0x7f2d4c069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.293+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 shutdown_connections 2023-10-07T09:05:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.294+0000 7f2d53ff5700 1 -- 172.21.15.46:0/68360782 wait complete. 2023-10-07T09:05:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:05:09.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:05:09.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.440+0000 7fb567520700 1 Processor -- start 2023-10-07T09:05:09.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.440+0000 7fb567520700 1 -- start start 2023-10-07T09:05:09.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb567520700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb5600b4e70 0x7fb5600ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb567520700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 0x7fb56015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb567520700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600cfb00 con 0x7fb5600b16d0 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb567520700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5600b5c40 con 0x7fb5600b4e70 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb567520700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600b5f20 con 0x7fb5600b1b40 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb56651e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb5600b4e70 0x7fb5600ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb565d1d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb5600b16d0 0x7fb56015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44542/0 (socket says 172.21.15.46:44542) 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb565d1d700 1 -- 172.21.15.46:0/956289567 learned_addr learned my addr 172.21.15.46:0/956289567 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.441+0000 7fb566d1f700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 0x7fb56015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56651e700 1 -- 172.21.15.46:0/956289567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 msgr2=0x7fb56015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56651e700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 0x7fb56015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56651e700 1 -- 172.21.15.46:0/956289567 >> v1:172.21.15.46:6789/0 conn(0x7fb5600b16d0 legacy=0x7fb56015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56651e700 1 -- 172.21.15.46:0/956289567 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600b6200 con 0x7fb5600b4e70 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56551c700 1 -- 172.21.15.46:0/956289567 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975166106 0 0) 0x7fb5600cfb00 con 0x7fb5600b16d0 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb566d1f700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 0x7fb56015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56651e700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb5600ccff0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb5580098e0 tx=0x7fb5580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ff81d9294ff400 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56551c700 1 -- 172.21.15.46:0/956289567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558009e80 con 0x7fb5600b4e70 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56551c700 1 -- 172.21.15.46:0/956289567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800b860 con 0x7fb5600b4e70 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb56551c700 1 -- 172.21.15.46:0/956289567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800bbe0 con 0x7fb5600b4e70 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 -- 172.21.15.46:0/956289567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 msgr2=0x7fb5600ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb5600ccff0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb5580098e0 tx=0x7fb5580091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 -- 172.21.15.46:0/956289567 shutdown_connections 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b1b40 0x7fb56015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 --2- 172.21.15.46:0/956289567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb5600ccff0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 -- 172.21.15.46:0/956289567 >> 172.21.15.46:0/956289567 conn(0x7fb5600d10c0 msgr2=0x7fb5600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.442+0000 7fb567520700 1 -- 172.21.15.46:0/956289567 shutdown_connections 2023-10-07T09:05:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.443+0000 7fb567520700 1 -- 172.21.15.46:0/956289567 wait complete. 2023-10-07T09:05:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 Processor -- start 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 -- start start 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 0x7fb5600c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 0x7fb5600c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c65d0 con 0x7fb5600b4e70 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56016b000 con 0x7fb5600b1b40 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb567520700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c5d30 con 0x7fb5600b16d0 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb566d1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb566d1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48062/0 (socket says 172.21.15.46:48062) 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.444+0000 7fb566d1f700 1 -- 172.21.15.46:0/4023467760 learned_addr learned my addr 172.21.15.46:0/4023467760 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb56651e700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 0x7fb5600c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 -- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 msgr2=0x7fb5600c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 0x7fb5600c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb565d1d700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 0x7fb5600c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 -- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 msgr2=0x7fb5600c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 0x7fb5600c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 -- 172.21.15.46:0/4023467760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009420 con 0x7fb5600b4e70 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb56651e700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 0x7fb5600c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb565d1d700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 0x7fb5600c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb566d1f700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb55000a380 tx=0x7fb550007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000ae10 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000d650 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000da10 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600c6010 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.445+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5600c58d0 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.446+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb560088990 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.447+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb55001e3b0 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.447+0000 7fb55e7fc700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 0x7fb54c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.447+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb550085620 con 0x7fb5600b4e70 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.447+0000 7fb56651e700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 0x7fb54c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.448+0000 7fb56651e700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 0x7fb54c0697d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5600b3e80 tx=0x7fb558017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:09.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.452+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb550052310 con 0x7fb5600b4e70 2023-10-07T09:05:09.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:09.689+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb56004bb80 con 0x7fb5600b4e70 2023-10-07T09:05:10.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.291+0000 7fb55e7fc700 1 -- 172.21.15.46:0/4023467760 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb550055930 con 0x7fb5600b4e70 2023-10-07T09:05:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.295+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 msgr2=0x7fb54c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.295+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 0x7fb54c0697d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5600b3e80 tx=0x7fb558017000 comp rx=0 tx=0).stop 2023-10-07T09:05:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.295+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 msgr2=0x7fb560068ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.295+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb55000a380 tx=0x7fb550007900 comp rx=0 tx=0).stop 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 shutdown_connections 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb54c067320 0x7fb54c0697d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5600b4e70 0x7fb560068ff0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5600b16d0 0x7fb5600c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 --2- 172.21.15.46:0/4023467760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5600b1b40 0x7fb5600c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 >> 172.21.15.46:0/4023467760 conn(0x7fb5600d10c0 msgr2=0x7fb560159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 shutdown_connections 2023-10-07T09:05:10.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.296+0000 7fb567520700 1 -- 172.21.15.46:0/4023467760 wait complete. 2023-10-07T09:05:10.300 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 18 and data pool 19 2023-10-07T09:05:10.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.432+0000 7f74e29b5700 1 Processor -- start 2023-10-07T09:05:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.432+0000 7f74e29b5700 1 -- start start 2023-10-07T09:05:10.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e29b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74dc159890 0x7f74dc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e29b5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc15a160 con 0x7f74dc069560 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e29b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc0d13a0 con 0x7f74dc159c60 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e29b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc15e140 con 0x7f74dc159890 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e0f52700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74dc069560 0x7f74dc0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53474/0 (socket says 172.21.15.46:53474) 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74e0f52700 1 -- 172.21.15.46:0/937695894 learned_addr learned my addr 172.21.15.46:0/937695894 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645590244 0 0) 0x7f74dc15a160 con 0x7f74dc069560 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c8003570 con 0x7f74dc069560 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.433+0000 7f74dbfff700 1 --2- 172.21.15.46:0/937695894 >> v2:172.21.15.133:3300/0 conn(0x7f74dc159890 0x7f74dc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439482943 0 0) 0x7f74c8003570 con 0x7f74dc069560 2023-10-07T09:05:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 >> v2:172.21.15.133:3300/0 conn(0x7f74dc159890 msgr2=0x7f74dc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 --2- 172.21.15.46:0/937695894 >> v2:172.21.15.133:3300/0 conn(0x7f74dc159890 0x7f74dc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 >> v1:172.21.15.133:6789/0 conn(0x7f74dc159c60 legacy=0x7f74dc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc15a3d0 con 0x7f74dc069560 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f74d40017f0 con 0x7f74dc069560 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 >> v1:172.21.15.46:6789/0 conn(0x7f74dc069560 legacy=0x7f74dc0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8004810 0x7f74c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c80051c0 0x7f74c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc15e140 con 0x7f74c8003a60 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c800c0d0 con 0x7f74c8004810 2023-10-07T09:05:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c800c290 con 0x7f74c80051c0 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74db7fe700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8004810 0x7f74c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74e0f52700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c80051c0 0x7f74c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 -- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c80051c0 msgr2=0x7f74c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c80051c0 0x7f74c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 -- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8004810 msgr2=0x7f74c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8004810 0x7f74c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 -- 172.21.15.46:0/937695894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8003570 con 0x7f74c8003a60 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74db7fe700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8004810 0x7f74c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74e0f52700 1 -- 172.21.15.46:0/937695894 reap_dead start 2023-10-07T09:05:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74dbfff700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74c8003e70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009c00 tx=0x7f74c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de14a18ec0b9d1f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400e710 con 0x7f74c8003a60 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400e870 con 0x7f74c8003a60 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.434+0000 7f74daffd700 1 -- 172.21.15.46:0/937695894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400ec30 con 0x7f74c8003a60 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 -- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 msgr2=0x7f74c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74c8003e70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009c00 tx=0x7f74c40091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 -- 172.21.15.46:0/937695894 shutdown_connections 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 --2- 172.21.15.46:0/937695894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74c8003e70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 -- 172.21.15.46:0/937695894 >> 172.21.15.46:0/937695894 conn(0x7f74dc068e20 msgr2=0x7f74dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 -- 172.21.15.46:0/937695894 shutdown_connections 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.435+0000 7f74e29b5700 1 -- 172.21.15.46:0/937695894 wait complete. 2023-10-07T09:05:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.436+0000 7f74e29b5700 1 Processor -- start 2023-10-07T09:05:10.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.436+0000 7f74e29b5700 1 -- start start 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 0x7f74dc0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74dc0b6070 0x7f74dc152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b40d0 con 0x7f74c8003a60 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0cf8a0 con 0x7f74dc0ce180 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e29b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b37a0 con 0x7f74dc0b6070 2023-10-07T09:05:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34814/0 (socket says 172.21.15.46:34814) 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 -- 172.21.15.46:0/3282117843 learned_addr learned my addr 172.21.15.46:0/3282117843 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74e0f52700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74dc0b6070 0x7f74dc152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74db7fe700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 0x7f74dc0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 -- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74dc0b6070 msgr2=0x7f74dc152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74dc0b6070 0x7f74dc152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 -- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 msgr2=0x7f74dc0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 0x7f74dc0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 -- 172.21.15.46:0/3282117843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0b3a80 con 0x7f74c8003a60 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74db7fe700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 0x7f74dc0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.437+0000 7f74dbfff700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c0a0 tx=0x7f74c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.438+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4022070 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.438+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400e9e0 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.438+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc0b3d60 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.438+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c401c450 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.438+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc0b4aa0 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.439+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc04c3c0 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.439+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f74c401c880 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.439+0000 7f74d3fff700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 0x7f74bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.439+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74c4086360 con 0x7f74c8003a60 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.440+0000 7f74db7fe700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 0x7f74bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.440+0000 7f74db7fe700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 0x7f74bc0697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.444+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74c4053060 con 0x7f74c8003a60 2023-10-07T09:05:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.638+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74dc06a5b0 con 0x7f74c8003a60 2023-10-07T09:05:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.639+0000 7f74d3fff700 1 -- 172.21.15.46:0/3282117843 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f74c4006cb0 con 0x7f74c8003a60 2023-10-07T09:05:10.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:10.641 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":113,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:09.691150+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 msgr2=0x7f74bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 0x7f74bc0697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc009040 comp rx=0 tx=0).stop 2023-10-07T09:05:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 msgr2=0x7f74dc14c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c0a0 tx=0x7f74c401a000 comp rx=0 tx=0).stop 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 shutdown_connections 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74bc067320 0x7f74bc0697d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74dc0b6070 0x7f74dc152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c8003a60 0x7f74dc14c3f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 --2- 172.21.15.46:0/3282117843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74dc0ce180 0x7f74dc0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 >> 172.21.15.46:0/3282117843 conn(0x7f74dc068e20 msgr2=0x7f74dc15cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.641+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 shutdown_connections 2023-10-07T09:05:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.642+0000 7f74e29b5700 1 -- 172.21.15.46:0/3282117843 wait complete. 2023-10-07T09:05:10.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:10.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.773+0000 7f14a6547700 1 Processor -- start 2023-10-07T09:05:10.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.773+0000 7f14a6547700 1 -- start start 2023-10-07T09:05:10.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a6547700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a01597f0 0x7f14a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a6547700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14a015d230 0x7f14a015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a6547700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a015dbd0 con 0x7f14a0159420 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a6547700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00b11d0 con 0x7f14a015d230 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a6547700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00b14b0 con 0x7f14a01597f0 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a5d46700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14a015d230 0x7f14a015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a5545700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f14a0159420 0x7f14a00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53482/0 (socket says 172.21.15.46:53482) 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a5545700 1 -- 172.21.15.46:0/2711307878 learned_addr learned my addr 172.21.15.46:0/2711307878 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a4d44700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a01597f0 0x7f14a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a5d46700 1 -- 172.21.15.46:0/2711307878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a01597f0 msgr2=0x7f14a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.774+0000 7f14a5d46700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a01597f0 0x7f14a00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a5d46700 1 -- 172.21.15.46:0/2711307878 >> v1:172.21.15.46:6789/0 conn(0x7f14a0159420 legacy=0x7f14a00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a5d46700 1 -- 172.21.15.46:0/2711307878 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00b1790 con 0x7f14a015d230 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f149ffff700 1 -- 172.21.15.46:0/2711307878 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267923270 0 0) 0x7f1498001110 con 0x7f14a0159420 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a5d46700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a015d230 0x7f14a015d690 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1490009e60 tx=0x7f1490009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a139876f0b049fb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f149ffff700 1 -- 172.21.15.46:0/2711307878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e070 con 0x7f14a015d230 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f149ffff700 1 -- 172.21.15.46:0/2711307878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000bc30 con 0x7f14a015d230 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f149ffff700 1 -- 172.21.15.46:0/2711307878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012430 con 0x7f14a015d230 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 -- 172.21.15.46:0/2711307878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a015d230 msgr2=0x7f14a015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a015d230 0x7f14a015d690 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1490009e60 tx=0x7f1490009780 comp rx=0 tx=0).stop 2023-10-07T09:05:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 -- 172.21.15.46:0/2711307878 shutdown_connections 2023-10-07T09:05:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a015d230 0x7f14a015d690 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 --2- 172.21.15.46:0/2711307878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a01597f0 0x7f14a00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 -- 172.21.15.46:0/2711307878 >> 172.21.15.46:0/2711307878 conn(0x7f14a00d0660 msgr2=0x7f14a00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.775+0000 7f14a6547700 1 -- 172.21.15.46:0/2711307878 shutdown_connections 2023-10-07T09:05:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.776+0000 7f14a6547700 1 -- 172.21.15.46:0/2711307878 wait complete. 2023-10-07T09:05:10.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 Processor -- start 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 -- start start 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 0x7f14a015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a015d230 0x7f14a01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a015bd00 con 0x7f14a01597f0 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0155930 con 0x7f14a0159420 2023-10-07T09:05:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.777+0000 7f14a6547700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a015bf10 con 0x7f14a015d230 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34830/0 (socket says 172.21.15.46:34830) 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 -- 172.21.15.46:0/3133835514 learned_addr learned my addr 172.21.15.46:0/3133835514 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 -- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a015d230 msgr2=0x7f14a01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a5d46700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a015d230 0x7f14a01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a5545700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 0x7f14a015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a015d230 0x7f14a01553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 -- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 msgr2=0x7f14a015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 0x7f14a015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 -- 172.21.15.46:0/3133835514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490009a20 con 0x7f14a01597f0 2023-10-07T09:05:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a5545700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 0x7f14a015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a4d44700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f149400d890 tx=0x7f1494008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400b600 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400b760 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a015c1f0 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400bae0 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.778+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a015c7b0 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.779+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a004c3c0 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.780+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f149401e460 con 0x7f14a01597f0 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.780+0000 7f149d7fa700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 0x7f148c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.780+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1494085350 con 0x7f14a01597f0 2023-10-07T09:05:10.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.780+0000 7f14a5545700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 0x7f148c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:10.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.781+0000 7f14a5545700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 0x7f148c0697d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f14980018c0 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:10.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.784+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1494051fe0 con 0x7f14a01597f0 2023-10-07T09:05:10.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.979+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14a00b1a70 con 0x7f14a01597f0 2023-10-07T09:05:10.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.980+0000 7f149d7fa700 1 -- 172.21.15.46:0/3133835514 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1494055600 con 0x7f14a01597f0 2023-10-07T09:05:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:10.982 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:10.923761+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 msgr2=0x7f148c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 0x7f148c0697d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f14980018c0 tx=0x7f1498009040 comp rx=0 tx=0).stop 2023-10-07T09:05:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 msgr2=0x7f14a015b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f149400d890 tx=0x7f1494008040 comp rx=0 tx=0).stop 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 shutdown_connections 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f148c067320 0x7f148c0697d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a015d230 0x7f14a01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a0159420 0x7f14a015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 --2- 172.21.15.46:0/3133835514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14a01597f0 0x7f14a015b7c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 >> 172.21.15.46:0/3133835514 conn(0x7f14a00d0660 msgr2=0x7f14a0155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 shutdown_connections 2023-10-07T09:05:10.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:10.982+0000 7f14a6547700 1 -- 172.21.15.46:0/3133835514 wait complete. 2023-10-07T09:05:10.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:05:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.117+0000 7fa8d9493700 1 Processor -- start 2023-10-07T09:05:11.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.117+0000 7fa8d9493700 1 -- start start 2023-10-07T09:05:11.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d9493700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8d4159c60 0x7fa8d415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d9493700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8d415db10 0x7fa8d4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d9493700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d415a160 con 0x7fa8d4159890 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d9493700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d415df50 con 0x7fa8d415db10 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d9493700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40d13a0 con 0x7fa8d4159c60 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8d415db10 0x7fa8d4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8d415db10 0x7fa8d4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34838/0 (socket says 172.21.15.46:34838) 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 -- 172.21.15.46:0/3981572194 learned_addr learned my addr 172.21.15.46:0/3981572194 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d27fc700 1 --2- 172.21.15.46:0/3981572194 >> v2:172.21.15.133:3300/0 conn(0x7fa8d4159c60 0x7fa8d415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 -- 172.21.15.46:0/3981572194 >> v2:172.21.15.133:3300/0 conn(0x7fa8d4159c60 msgr2=0x7fa8d415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 --2- 172.21.15.46:0/3981572194 >> v2:172.21.15.133:3300/0 conn(0x7fa8d4159c60 0x7fa8d415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 -- 172.21.15.46:0/3981572194 >> v1:172.21.15.133:6789/0 conn(0x7fa8d4159890 legacy=0x7fa8d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 -- 172.21.15.46:0/3981572194 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d415e140 con 0x7fa8d415db10 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d37fe700 1 --2- 172.21.15.46:0/3981572194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d415db10 0x7fa8d4069560 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40b67f0 tx=0x7fa8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e55f402c0bee91 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d1ffb700 1 -- 172.21.15.46:0/3981572194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00b820 con 0x7fa8d415db10 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d1ffb700 1 -- 172.21.15.46:0/3981572194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00b980 con 0x7fa8d415db10 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.118+0000 7fa8d1ffb700 1 -- 172.21.15.46:0/3981572194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00bd20 con 0x7fa8d415db10 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 -- 172.21.15.46:0/3981572194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d415db10 msgr2=0x7fa8d4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3981572194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d415db10 0x7fa8d4069560 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40b67f0 tx=0x7fa8cc009250 comp rx=0 tx=0).stop 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 -- 172.21.15.46:0/3981572194 shutdown_connections 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3981572194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d415db10 0x7fa8d4069560 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3981572194 >> v2:172.21.15.133:3300/0 conn(0x7fa8d4159c60 0x7fa8d415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 -- 172.21.15.46:0/3981572194 >> 172.21.15.46:0/3981572194 conn(0x7fa8d4068e20 msgr2=0x7fa8d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 -- 172.21.15.46:0/3981572194 shutdown_connections 2023-10-07T09:05:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.119+0000 7fa8d9493700 1 -- 172.21.15.46:0/3981572194 wait complete. 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.120+0000 7fa8d9493700 1 Processor -- start 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.120+0000 7fa8d9493700 1 -- start start 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d4159c60 0x7fa8d40cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 0x7fa8d40b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40cd5d0 con 0x7fa8d4159890 2023-10-07T09:05:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40cf770 con 0x7fa8d4159c60 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d9493700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40b4ff0 con 0x7fa8d415db10 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34840/0 (socket says 172.21.15.46:34840) 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 -- 172.21.15.46:0/3055636178 learned_addr learned my addr 172.21.15.46:0/3055636178 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d27fc700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d4159c60 0x7fa8d40cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d37fe700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 0x7fa8d40b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 -- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 msgr2=0x7fa8d40b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 0x7fa8d40b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 -- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d4159c60 msgr2=0x7fa8d40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d4159c60 0x7fa8d40cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d2ffd700 1 -- 172.21.15.46:0/3055636178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0094f0 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.121+0000 7fa8d37fe700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 0x7fa8d40b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8d2ffd700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c950 tx=0x7fa8c4002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4012630 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4012790 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40cfa10 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4012b50 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.122+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40cd260 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.123+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40cd0c0 con 0x7fa8d4159890 2023-10-07T09:05:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.123+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8c400a420 con 0x7fa8d4159890 2023-10-07T09:05:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.124+0000 7fa8caffd700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 0x7fa8b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.124+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8c40850b0 con 0x7fa8d4159890 2023-10-07T09:05:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.124+0000 7fa8d27fc700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 0x7fa8b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.124+0000 7fa8d27fc700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 0x7fa8b40697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006fd0 tx=0x7fa8bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:11.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.128+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8d40cd0c0 con 0x7fa8d4159890 2023-10-07T09:05:11.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:11.366+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8d40cd0c0 con 0x7fa8d4159890 2023-10-07T09:05:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.307+0000 7fa8caffd700 1 -- 172.21.15.46:0/3055636178 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa8d40cd0c0 con 0x7fa8d4159890 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 msgr2=0x7fa8b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 0x7fa8b40697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006fd0 tx=0x7fa8bc008040 comp rx=0 tx=0).stop 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 msgr2=0x7fa8d416a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c950 tx=0x7fa8c4002760 comp rx=0 tx=0).stop 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 shutdown_connections 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8b4067320 0x7fa8b40697d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8d415db10 0x7fa8d40b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8d4159890 0x7fa8d416a610 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 --2- 172.21.15.46:0/3055636178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d4159c60 0x7fa8d40cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 >> 172.21.15.46:0/3055636178 conn(0x7fa8d4068e20 msgr2=0x7fa8d41577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 shutdown_connections 2023-10-07T09:05:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.310+0000 7fa8d9493700 1 -- 172.21.15.46:0/3055636178 wait complete. 2023-10-07T09:05:12.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:05:12.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.453+0000 7f587c4b3700 1 Processor -- start 2023-10-07T09:05:12.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.453+0000 7f587c4b3700 1 -- start start 2023-10-07T09:05:12.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f587c4b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f587c4b3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f587406c0a0 0x7f587415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f587c4b3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587415d7e0 con 0x7f587415df50 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f587c4b3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587415dac0 con 0x7f587406c0a0 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f587c4b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587415aa30 con 0x7f587406bcd0 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.454+0000 7f5879a4e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f587406c0a0 0x7f587415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587aa50700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f587415df50 0x7f58740c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53490/0 (socket says 172.21.15.46:53490) 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587aa50700 1 -- 172.21.15.46:0/3532671836 learned_addr learned my addr 172.21.15.46:0/3532671836 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f587406c0a0 0x7f587415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34852/0 (socket says 172.21.15.46:34852) 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 -- 172.21.15.46:0/3532671836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 msgr2=0x7f58740caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587a24f700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 -- 172.21.15.46:0/3532671836 >> v1:172.21.15.46:6789/0 conn(0x7f587415df50 legacy=0x7f58740c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587924d700 1 -- 172.21.15.46:0/3532671836 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116367175 0 0) 0x7f587415d7e0 con 0x7f587415df50 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 -- 172.21.15.46:0/3532671836 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587415ad10 con 0x7f587406c0a0 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587a24f700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f5879a4e700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f587415a1e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f58680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c627e509b311ac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587924d700 1 -- 172.21.15.46:0/3532671836 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868009e80 con 0x7f587406c0a0 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587924d700 1 -- 172.21.15.46:0/3532671836 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800b860 con 0x7f587406c0a0 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.455+0000 7f587924d700 1 -- 172.21.15.46:0/3532671836 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800bbe0 con 0x7f587406c0a0 2023-10-07T09:05:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 -- 172.21.15.46:0/3532671836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 msgr2=0x7f587415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f587415a1e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f58680091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 -- 172.21.15.46:0/3532671836 shutdown_connections 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 --2- 172.21.15.46:0/3532671836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f587415a1e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 -- 172.21.15.46:0/3532671836 >> 172.21.15.46:0/3532671836 conn(0x7f58740ce600 msgr2=0x7f58740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 -- 172.21.15.46:0/3532671836 shutdown_connections 2023-10-07T09:05:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.456+0000 7f587c4b3700 1 -- 172.21.15.46:0/3532671836 wait complete. 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.457+0000 7f587c4b3700 1 Processor -- start 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.457+0000 7f587c4b3700 1 -- start start 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f587415df50 0x7f58740c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740b31c0 con 0x7f587406c0a0 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740b25b0 con 0x7f587415df50 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740b2890 con 0x7f587406bcd0 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34866/0 (socket says 172.21.15.46:34866) 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 -- 172.21.15.46:0/1156293322 learned_addr learned my addr 172.21.15.46:0/1156293322 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 -- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 msgr2=0x7f58740c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 -- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f587415df50 msgr2=0x7f58740c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587aa50700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f587415df50 0x7f58740c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f587415df50 0x7f58740c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 -- 172.21.15.46:0/1156293322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009420 con 0x7f587406c0a0 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f5879a4e700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f586800b3c0 tx=0x7f5868017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011420 con 0x7f587406c0a0 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680115c0 con 0x7f587406c0a0 2023-10-07T09:05:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58740b2b70 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.458+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011980 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.459+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58740b2260 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.459+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58740b3550 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.460+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f58680253f0 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.460+0000 7f58727fc700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 0x7f58600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.460+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5868086610 con 0x7f587406c0a0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.460+0000 7f587a24f700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 0x7f58600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.461+0000 7f587a24f700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 0x7f58600697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f586c006fd0 tx=0x7f586c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:12.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.464+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58680532a0 con 0x7f587406c0a0 2023-10-07T09:05:12.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:05:12.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:05:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:12.704+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58740b3300 con 0x7f587406c0a0 2023-10-07T09:05:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.308+0000 7f58727fc700 1 -- 172.21.15.46:0/1156293322 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58740b3300 con 0x7f587406c0a0 2023-10-07T09:05:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 msgr2=0x7f58600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 0x7f58600697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f586c006fd0 tx=0x7f586c008040 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 msgr2=0x7f58740c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f586800b3c0 tx=0x7f5868017000 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 shutdown_connections 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5860067320 0x7f58600697d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f587415df50 0x7f58740c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f587406bcd0 0x7f58740c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.310+0000 7f587c4b3700 1 --2- 172.21.15.46:0/1156293322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f587406c0a0 0x7f58740c5870 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.311+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 >> 172.21.15.46:0/1156293322 conn(0x7f58740ce600 msgr2=0x7f5874155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.311+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 shutdown_connections 2023-10-07T09:05:13.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.311+0000 7f587c4b3700 1 -- 172.21.15.46:0/1156293322 wait complete. 2023-10-07T09:05:13.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.450+0000 7f6bd204a700 1 Processor -- start 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.450+0000 7f6bd204a700 1 -- start start 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bcc06bcd0 0x7f6bcc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 0x7f6bcc15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc15d7e0 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc15dac0 con 0x7f6bcc06bcd0 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bd204a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc15aa30 con 0x7f6bcc15df50 2023-10-07T09:05:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bcaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bcaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34878/0 (socket says 172.21.15.46:34878) 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.451+0000 7f6bcaffd700 1 -- 172.21.15.46:0/1161291129 learned_addr learned my addr 172.21.15.46:0/1161291129 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcb7fe700 1 --2- 172.21.15.46:0/1161291129 >> v2:172.21.15.133:3300/0 conn(0x7f6bcc06bcd0 0x7f6bcc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcbfff700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 0x7f6bcc15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 -- 172.21.15.46:0/1161291129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 msgr2=0x7f6bcc15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 0x7f6bcc15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 -- 172.21.15.46:0/1161291129 >> v2:172.21.15.133:3300/0 conn(0x7f6bcc06bcd0 msgr2=0x7f6bcc0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 --2- 172.21.15.46:0/1161291129 >> v2:172.21.15.133:3300/0 conn(0x7f6bcc06bcd0 0x7f6bcc0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 -- 172.21.15.46:0/1161291129 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc15ad10 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcbfff700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 0x7f6bcc15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bcaffd700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0691a0 tx=0x7f6bc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f57bdb81573b9a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bca7fc700 1 -- 172.21.15.46:0/1161291129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0009e70 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bca7fc700 1 -- 172.21.15.46:0/1161291129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000b860 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.452+0000 7f6bca7fc700 1 -- 172.21.15.46:0/1161291129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000bc20 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 -- 172.21.15.46:0/1161291129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc06c0a0 msgr2=0x7f6bcc15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0691a0 tx=0x7f6bc0009250 comp rx=0 tx=0).stop 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 -- 172.21.15.46:0/1161291129 shutdown_connections 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc15df50 0x7f6bcc15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 --2- 172.21.15.46:0/1161291129 >> v2:172.21.15.133:3300/0 conn(0x7f6bcc06bcd0 0x7f6bcc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 --2- 172.21.15.46:0/1161291129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc15a1e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 -- 172.21.15.46:0/1161291129 >> 172.21.15.46:0/1161291129 conn(0x7f6bcc0ce600 msgr2=0x7f6bcc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 -- 172.21.15.46:0/1161291129 shutdown_connections 2023-10-07T09:05:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.453+0000 7f6bd204a700 1 -- 172.21.15.46:0/1161291129 wait complete. 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.454+0000 7f6bd204a700 1 Processor -- start 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.454+0000 7f6bd204a700 1 -- start start 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc06bcd0 0x7f6bcc1471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b3830 con 0x7f6bcc15df50 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b22e0 con 0x7f6bcc06c0a0 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b2f00 con 0x7f6bcc06bcd0 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34884/0 (socket says 172.21.15.46:34884) 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 -- 172.21.15.46:0/2532029793 learned_addr learned my addr 172.21.15.46:0/2532029793 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcaffd700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcb7fe700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc06bcd0 0x7f6bcc1471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 -- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc06bcd0 msgr2=0x7f6bcc1471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc06bcd0 0x7f6bcc1471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 -- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bcc06c0a0 msgr2=0x7f6bcc069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 -- 172.21.15.46:0/2532029793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00094f0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bcbfff700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009fc0 tx=0x7f6bc40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400dbe0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0b31e0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.455+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4015440 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.456+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc1476e0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.457+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc0b39a0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.457+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6bc401e3b0 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.457+0000 7f6bb37fe700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 0x7f6bb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.457+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bc4085160 con 0x7f6bcc15df50 2023-10-07T09:05:13.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.457+0000 7f6bcb7fe700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 0x7f6bb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.458+0000 7f6bcb7fe700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 0x7f6bb80697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009d10 tx=0x7f6bbc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.461+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bc4051ce0 con 0x7f6bcc15df50 2023-10-07T09:05:13.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.698+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bcc04c3c0 con 0x7f6bcc15df50 2023-10-07T09:05:13.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.698+0000 7f6bb37fe700 1 -- 172.21.15.46:0/2532029793 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f6bc4055300 con 0x7f6bcc15df50 2023-10-07T09:05:13.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:13.700 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/842316540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":842316540},{"type":"v1","addr":"172.21.15.133:6837","nonce":842316540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2721491248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2721491248},{"type":"v1","addr":"172.21.15.46:6834","nonce":2721491248}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:13.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 msgr2=0x7f6bb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 0x7f6bb80697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009d10 tx=0x7f6bbc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 msgr2=0x7f6bcc06a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009fc0 tx=0x7f6bc40099b0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 shutdown_connections 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6bb8067320 0x7f6bb80697d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bcc15df50 0x7f6bcc06a060 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bcc06bcd0 0x7f6bcc1471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 --2- 172.21.15.46:0/2532029793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bcc06c0a0 0x7f6bcc069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 >> 172.21.15.46:0/2532029793 conn(0x7f6bcc0ce600 msgr2=0x7f6bcc155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 shutdown_connections 2023-10-07T09:05:13.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.700+0000 7f6bd204a700 1 -- 172.21.15.46:0/2532029793 wait complete. 2023-10-07T09:05:13.704 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 74 2023-10-07T09:05:13.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:13.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.831+0000 7f3de36ea700 1 Processor -- start 2023-10-07T09:05:13.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.831+0000 7f3de36ea700 1 -- start start 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de36ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de36ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de36ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0cc300 con 0x7f3ddc15a270 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de36ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc156bf0 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de36ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0ae950 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de0c85700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de1486700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de1c87700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3ddc15a270 0x7f3ddc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:56808/0 (socket says 172.21.15.46:56808) 2023-10-07T09:05:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de1486700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39128/0 (socket says 172.21.15.46:39128) 2023-10-07T09:05:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de0c85700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:60358/0 (socket says 172.21.15.46:60358) 2023-10-07T09:05:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.832+0000 7f3de1c87700 1 -- 172.21.15.46:0/3146879000 learned_addr learned my addr 172.21.15.46:0/3146879000 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:13.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de0c85700 1 -- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 msgr2=0x7f3ddc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:13.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de0c85700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de0c85700 1 -- 172.21.15.46:0/3146879000 >> v1:172.21.15.133:6789/0 conn(0x7f3ddc15a270 legacy=0x7f3ddc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de0c85700 1 -- 172.21.15.46:0/3146879000 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0ad370 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de1486700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3de0c85700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000bbc0 tx=0x7f3dd000b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd44ebeabaa8e663 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3ddbfff700 1 -- 172.21.15.46:0/3146879000 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000dae0 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3ddbfff700 1 -- 172.21.15.46:0/3146879000 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000dc40 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.833+0000 7f3ddbfff700 1 -- 172.21.15.46:0/3146879000 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0019480 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 -- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 msgr2=0x7f3ddc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000bbc0 tx=0x7f3dd000b430 comp rx=0 tx=0).stop 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 -- 172.21.15.46:0/3146879000 shutdown_connections 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc0cbf30 0x7f3ddc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 --2- 172.21.15.46:0/3146879000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0b0d10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 -- 172.21.15.46:0/3146879000 >> 172.21.15.46:0/3146879000 conn(0x7f3ddc06a320 msgr2=0x7f3ddc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 -- 172.21.15.46:0/3146879000 shutdown_connections 2023-10-07T09:05:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.834+0000 7f3de36ea700 1 -- 172.21.15.46:0/3146879000 wait complete. 2023-10-07T09:05:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.835+0000 7f3de36ea700 1 Processor -- start 2023-10-07T09:05:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.835+0000 7f3de36ea700 1 -- start start 2023-10-07T09:05:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 0x7f3ddc0ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0c71e0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc166bd0 con 0x7f3ddc0ccf90 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc166330 con 0x7f3ddc15a270 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34890/0 (socket says 172.21.15.46:34890) 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 -- 172.21.15.46:0/2512882368 learned_addr learned my addr 172.21.15.46:0/2512882368 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de0c85700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1c87700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 0x7f3ddc0ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 -- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 msgr2=0x7f3ddc0ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 0x7f3ddc0ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 -- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 msgr2=0x7f3ddc0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 -- 172.21.15.46:0/2512882368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4009420 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1c87700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 0x7f3ddc0ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de1486700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400ec80 tx=0x7f3dd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400c8f0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd400ca50 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd000b6d0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.836+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400cdd0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.837+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1668f0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.838+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0c4970 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.838+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3dd4013680 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.838+0000 7f3dd97fa700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 0x7f3dc80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.838+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3dd4084fe0 con 0x7f3ddc0cbf30 2023-10-07T09:05:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.839+0000 7f3de0c85700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 0x7f3dc80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.839+0000 7f3de0c85700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 0x7f3dc80697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000b470 tx=0x7f3dd001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:13.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:13.843+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dd4051c30 con 0x7f3ddc0cbf30 2023-10-07T09:05:14.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.038+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ddc04c3c0 con 0x7f3ddc0cbf30 2023-10-07T09:05:14.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.038+0000 7f3dd97fa700 1 -- 172.21.15.46:0/2512882368 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f3dd4055250 con 0x7f3ddc0cbf30 2023-10-07T09:05:14.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:14.040 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:10.923761+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:14.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 msgr2=0x7f3dc80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 0x7f3dc80697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000b470 tx=0x7f3dd001b000 comp rx=0 tx=0).stop 2023-10-07T09:05:14.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 msgr2=0x7f3ddc165c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400ec80 tx=0x7f3dd40091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 shutdown_connections 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3dc8067320 0x7f3dc80697d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ddc15a270 0x7f3ddc0ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ddc0cbf30 0x7f3ddc165c20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 --2- 172.21.15.46:0/2512882368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ddc0ccf90 0x7f3ddc0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 >> 172.21.15.46:0/2512882368 conn(0x7f3ddc06a320 msgr2=0x7f3ddc156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.040+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 shutdown_connections 2023-10-07T09:05:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.041+0000 7f3de36ea700 1 -- 172.21.15.46:0/2512882368 wait complete. 2023-10-07T09:05:14.054 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:05:14.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:05:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.172+0000 7feba7096700 1 Processor -- start 2023-10-07T09:05:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.172+0000 7feba7096700 1 -- start start 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba7096700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba7096700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feba015db10 0x7feba0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba7096700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba015a160 con 0x7feba0159890 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba7096700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00d13a0 con 0x7feba015db10 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba7096700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba015e140 con 0x7feba0159c60 2023-10-07T09:05:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba4e32700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feba0159890 0x7feba015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53500/0 (socket says 172.21.15.46:53500) 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba4e32700 1 -- 172.21.15.46:0/2863110387 learned_addr learned my addr 172.21.15.46:0/2863110387 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba5633700 1 --2- 172.21.15.46:0/2863110387 >> v2:172.21.15.133:3300/0 conn(0x7feba015db10 0x7feba0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feb9ffff700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750048147 0 0) 0x7feba015a160 con 0x7feba0159890 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90003570 con 0x7feba0159890 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba5633700 1 -- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 msgr2=0x7feba015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba5633700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259385590 0 0) 0x7feb90003570 con 0x7feba0159890 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba5633700 1 -- 172.21.15.46:0/2863110387 >> v1:172.21.15.46:6789/0 conn(0x7feba0159890 legacy=0x7feba015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.173+0000 7feba5633700 1 -- 172.21.15.46:0/2863110387 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba015a3d0 con 0x7feba015db10 2023-10-07T09:05:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba5633700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba0069560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb98009e60 tx=0x7feb98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf9bd6fb8238d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e070 con 0x7feba015db10 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800b7a0 con 0x7feba015db10 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feb9f7fe700 1 -- 172.21.15.46:0/2863110387 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94001470 con 0x7feba015db10 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 -- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 msgr2=0x7feba0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba0069560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb98009e60 tx=0x7feb98009780 comp rx=0 tx=0).stop 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 -- 172.21.15.46:0/2863110387 shutdown_connections 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba0069560 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 --2- 172.21.15.46:0/2863110387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 -- 172.21.15.46:0/2863110387 >> 172.21.15.46:0/2863110387 conn(0x7feba0068e20 msgr2=0x7feba00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 -- 172.21.15.46:0/2863110387 shutdown_connections 2023-10-07T09:05:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.174+0000 7feba7096700 1 -- 172.21.15.46:0/2863110387 wait complete. 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.175+0000 7feba7096700 1 Processor -- start 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 -- start start 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00b3590 con 0x7feba0159890 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00cfe20 con 0x7feba015db10 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba7096700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00cf210 con 0x7feba0159c60 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba4e32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba4e32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34904/0 (socket says 172.21.15.46:34904) 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.176+0000 7feba4e32700 1 -- 172.21.15.46:0/1859028687 learned_addr learned my addr 172.21.15.46:0/1859028687 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba5633700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feb9ffff700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 -- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 msgr2=0x7feba015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 -- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 msgr2=0x7feba015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 -- 172.21.15.46:0/1859028687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009a20 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba4e32700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7feb9400cb90 tx=0x7feb94001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94007360 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb940074e0 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94004830 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00cf4f0 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.177+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba00cfab0 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.178+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba004c3c0 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.179+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb94004ba0 con 0x7feba0159890 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.179+0000 7feb9cff9700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 0x7feb84069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.179+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb94084630 con 0x7feba0159890 2023-10-07T09:05:14.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.179+0000 7feb9ffff700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 0x7feb84069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.180+0000 7feb9ffff700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 0x7feb84069800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feba015a090 tx=0x7feb8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.183+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb940512c0 con 0x7feba0159890 2023-10-07T09:05:14.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.371+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feba006a5b0 con 0x7feb84067350 2023-10-07T09:05:14.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.380+0000 7feb9cff9700 1 -- 172.21.15.46:0/1859028687 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289701 (secure 0 0 0) 0x7feba006a5b0 con 0x7feb84067350 2023-10-07T09:05:14.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 msgr2=0x7feb84069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 0x7feb84069800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feba015a090 tx=0x7feb8c008040 comp rx=0 tx=0).stop 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 msgr2=0x7feba014c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7feb9400cb90 tx=0x7feb94001b50 comp rx=0 tx=0).stop 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 shutdown_connections 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb84067350 0x7feb84069800 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015db10 0x7feba015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feba0159890 0x7feba014c670 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 --2- 172.21.15.46:0/1859028687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159c60 0x7feba015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 >> 172.21.15.46:0/1859028687 conn(0x7feba0068e20 msgr2=0x7feba014d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 shutdown_connections 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.383+0000 7feba7096700 1 -- 172.21.15.46:0/1859028687 wait complete. 2023-10-07T09:05:14.388 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:05:14.397 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-10-07T09:05:13.859025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415128,"kb_used_data":12248,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752559592,"statfs":{"total":773094113280,"available":770621022208,"internally_reserved":0,"allocated":12541952,"data_stored":6062168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578158"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950214+0000","last_change":"2023-10-07T09:05:09.950214+0000","last_active":"2023-10-07T09:05:09.950214+0000","last_peered":"2023-10-07T09:05:09.950214+0000","last_clean":"2023-10-07T09:05:09.950214+0000","last_became_active":"2023-10-07T09:05:09.949907+0000","last_became_peered":"2023-10-07T09:05:09.949907+0000","last_unstale":"2023-10-07T09:05:09.950214+0000","last_undegraded":"2023-10-07T09:05:09.950214+0000","last_fullsized":"2023-10-07T09:05:09.950214+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:54.542870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948651+0000","last_change":"2023-10-07T09:05:09.948651+0000","last_active":"2023-10-07T09:05:09.948651+0000","last_peered":"2023-10-07T09:05:09.948651+0000","last_clean":"2023-10-07T09:05:09.948651+0000","last_became_active":"2023-10-07T09:05:09.948230+0000","last_became_peered":"2023-10-07T09:05:09.948230+0000","last_unstale":"2023-10-07T09:05:09.948651+0000","last_undegraded":"2023-10-07T09:05:09.948651+0000","last_fullsized":"2023-10-07T09:05:09.948651+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:03:24.820715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942318+0000","last_change":"2023-10-07T09:05:09.942318+0000","last_active":"2023-10-07T09:05:09.942318+0000","last_peered":"2023-10-07T09:05:09.942318+0000","last_clean":"2023-10-07T09:05:09.942318+0000","last_became_active":"2023-10-07T09:05:09.942067+0000","last_became_peered":"2023-10-07T09:05:09.942067+0000","last_unstale":"2023-10-07T09:05:09.942318+0000","last_undegraded":"2023-10-07T09:05:09.942318+0000","last_fullsized":"2023-10-07T09:05:09.942318+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:07:38.876445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.939944+0000","last_change":"2023-10-07T09:05:09.939944+0000","last_active":"2023-10-07T09:05:09.939944+0000","last_peered":"2023-10-07T09:05:09.939944+0000","last_clean":"2023-10-07T09:05:09.939944+0000","last_became_active":"2023-10-07T09:05:09.939681+0000","last_became_peered":"2023-10-07T09:05:09.939681+0000","last_unstale":"2023-10-07T09:05:09.939944+0000","last_undegraded":"2023-10-07T09:05:09.939944+0000","last_fullsized":"2023-10-07T09:05:09.939944+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:58:26.083245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945865+0000","last_change":"2023-10-07T09:05:09.945865+0000","last_active":"2023-10-07T09:05:09.945865+0000","last_peered":"2023-10-07T09:05:09.945865+0000","last_clean":"2023-10-07T09:05:09.945865+0000","last_became_active":"2023-10-07T09:05:09.945299+0000","last_became_peered":"2023-10-07T09:05:09.945299+0000","last_unstale":"2023-10-07T09:05:09.945865+0000","last_undegraded":"2023-10-07T09:05:09.945865+0000","last_fullsized":"2023-10-07T09:05:09.945865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:14.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.940339+0000","last_change":"2023-10-07T09:05:09.940339+0000","last_active":"2023-10-07T09:05:09.940339+0000","last_peered":"2023-10-07T09:05:09.940339+0000","last_clean":"2023-10-07T09:05:09.940339+0000","last_became_active":"2023-10-07T09:05:09.940019+0000","last_became_peered":"2023-10-07T09:05:09.940019+0000","last_unstale":"2023-10-07T09:05:09.940339+0000","last_undegraded":"2023-10-07T09:05:09.940339+0000","last_fullsized":"2023-10-07T09:05:09.940339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:06.930956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.944960+0000","last_change":"2023-10-07T09:05:09.944960+0000","last_active":"2023-10-07T09:05:09.944960+0000","last_peered":"2023-10-07T09:05:09.944960+0000","last_clean":"2023-10-07T09:05:09.944960+0000","last_became_active":"2023-10-07T09:05:09.944646+0000","last_became_peered":"2023-10-07T09:05:09.944646+0000","last_unstale":"2023-10-07T09:05:09.944960+0000","last_undegraded":"2023-10-07T09:05:09.944960+0000","last_fullsized":"2023-10-07T09:05:09.944960+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:38.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943844+0000","last_change":"2023-10-07T09:05:09.943844+0000","last_active":"2023-10-07T09:05:09.943844+0000","last_peered":"2023-10-07T09:05:09.943844+0000","last_clean":"2023-10-07T09:05:09.943844+0000","last_became_active":"2023-10-07T09:05:09.943169+0000","last_became_peered":"2023-10-07T09:05:09.943169+0000","last_unstale":"2023-10-07T09:05:09.943844+0000","last_undegraded":"2023-10-07T09:05:09.943844+0000","last_fullsized":"2023-10-07T09:05:09.943844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:49.610681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.949466+0000","last_change":"2023-10-07T09:05:09.949466+0000","last_active":"2023-10-07T09:05:09.949466+0000","last_peered":"2023-10-07T09:05:09.949466+0000","last_clean":"2023-10-07T09:05:09.949466+0000","last_became_active":"2023-10-07T09:05:09.949196+0000","last_became_peered":"2023-10-07T09:05:09.949196+0000","last_unstale":"2023-10-07T09:05:09.949466+0000","last_undegraded":"2023-10-07T09:05:09.949466+0000","last_fullsized":"2023-10-07T09:05:09.949466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948480+0000","last_change":"2023-10-07T09:05:09.948480+0000","last_active":"2023-10-07T09:05:09.948480+0000","last_peered":"2023-10-07T09:05:09.948480+0000","last_clean":"2023-10-07T09:05:09.948480+0000","last_became_active":"2023-10-07T09:05:09.947921+0000","last_became_peered":"2023-10-07T09:05:09.947921+0000","last_unstale":"2023-10-07T09:05:09.948480+0000","last_undegraded":"2023-10-07T09:05:09.948480+0000","last_fullsized":"2023-10-07T09:05:09.948480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:35.410635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.932473+0000","last_change":"2023-10-07T09:05:09.932473+0000","last_active":"2023-10-07T09:05:09.932473+0000","last_peered":"2023-10-07T09:05:09.932473+0000","last_clean":"2023-10-07T09:05:09.932473+0000","last_became_active":"2023-10-07T09:05:09.932226+0000","last_became_peered":"2023-10-07T09:05:09.932226+0000","last_unstale":"2023-10-07T09:05:09.932473+0000","last_undegraded":"2023-10-07T09:05:09.932473+0000","last_fullsized":"2023-10-07T09:05:09.932473+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:48:01.457963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945961+0000","last_change":"2023-10-07T09:05:09.945961+0000","last_active":"2023-10-07T09:05:09.945961+0000","last_peered":"2023-10-07T09:05:09.945961+0000","last_clean":"2023-10-07T09:05:09.945961+0000","last_became_active":"2023-10-07T09:05:09.945544+0000","last_became_peered":"2023-10-07T09:05:09.945544+0000","last_unstale":"2023-10-07T09:05:09.945961+0000","last_undegraded":"2023-10-07T09:05:09.945961+0000","last_fullsized":"2023-10-07T09:05:09.945961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:38.432993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947819+0000","last_change":"2023-10-07T09:05:09.947819+0000","last_active":"2023-10-07T09:05:09.947819+0000","last_peered":"2023-10-07T09:05:09.947819+0000","last_clean":"2023-10-07T09:05:09.947819+0000","last_became_active":"2023-10-07T09:05:09.947493+0000","last_became_peered":"2023-10-07T09:05:09.947493+0000","last_unstale":"2023-10-07T09:05:09.947819+0000","last_undegraded":"2023-10-07T09:05:09.947819+0000","last_fullsized":"2023-10-07T09:05:09.947819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:11.597983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933989+0000","last_change":"2023-10-07T09:05:09.933989+0000","last_active":"2023-10-07T09:05:09.933989+0000","last_peered":"2023-10-07T09:05:09.933989+0000","last_clean":"2023-10-07T09:05:09.933989+0000","last_became_active":"2023-10-07T09:05:09.933748+0000","last_became_peered":"2023-10-07T09:05:09.933748+0000","last_unstale":"2023-10-07T09:05:09.933989+0000","last_undegraded":"2023-10-07T09:05:09.933989+0000","last_fullsized":"2023-10-07T09:05:09.933989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:42.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943588+0000","last_change":"2023-10-07T09:05:09.943588+0000","last_active":"2023-10-07T09:05:09.943588+0000","last_peered":"2023-10-07T09:05:09.943588+0000","last_clean":"2023-10-07T09:05:09.943588+0000","last_became_active":"2023-10-07T09:05:09.943231+0000","last_became_peered":"2023-10-07T09:05:09.943231+0000","last_unstale":"2023-10-07T09:05:09.943588+0000","last_undegraded":"2023-10-07T09:05:09.943588+0000","last_fullsized":"2023-10-07T09:05:09.943588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:52.506759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935681+0000","last_change":"2023-10-07T09:05:09.935681+0000","last_active":"2023-10-07T09:05:09.935681+0000","last_peered":"2023-10-07T09:05:09.935681+0000","last_clean":"2023-10-07T09:05:09.935681+0000","last_became_active":"2023-10-07T09:05:09.935449+0000","last_became_peered":"2023-10-07T09:05:09.935449+0000","last_unstale":"2023-10-07T09:05:09.935681+0000","last_undegraded":"2023-10-07T09:05:09.935681+0000","last_fullsized":"2023-10-07T09:05:09.935681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:34.129398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946633+0000","last_change":"2023-10-07T09:05:09.946633+0000","last_active":"2023-10-07T09:05:09.946633+0000","last_peered":"2023-10-07T09:05:09.946633+0000","last_clean":"2023-10-07T09:05:09.946633+0000","last_became_active":"2023-10-07T09:05:09.946359+0000","last_became_peered":"2023-10-07T09:05:09.946359+0000","last_unstale":"2023-10-07T09:05:09.946633+0000","last_undegraded":"2023-10-07T09:05:09.946633+0000","last_fullsized":"2023-10-07T09:05:09.946633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947491+0000","last_change":"2023-10-07T09:05:09.947491+0000","last_active":"2023-10-07T09:05:09.947491+0000","last_peered":"2023-10-07T09:05:09.947491+0000","last_clean":"2023-10-07T09:05:09.947491+0000","last_became_active":"2023-10-07T09:05:09.947191+0000","last_became_peered":"2023-10-07T09:05:09.947191+0000","last_unstale":"2023-10-07T09:05:09.947491+0000","last_undegraded":"2023-10-07T09:05:09.947491+0000","last_fullsized":"2023-10-07T09:05:09.947491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:04.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.949832+0000","last_change":"2023-10-07T09:05:09.949832+0000","last_active":"2023-10-07T09:05:09.949832+0000","last_peered":"2023-10-07T09:05:09.949832+0000","last_clean":"2023-10-07T09:05:09.949832+0000","last_became_active":"2023-10-07T09:05:09.949582+0000","last_became_peered":"2023-10-07T09:05:09.949582+0000","last_unstale":"2023-10-07T09:05:09.949832+0000","last_undegraded":"2023-10-07T09:05:09.949832+0000","last_fullsized":"2023-10-07T09:05:09.949832+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:33.976186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.936091+0000","last_change":"2023-10-07T09:05:09.936091+0000","last_active":"2023-10-07T09:05:09.936091+0000","last_peered":"2023-10-07T09:05:09.936091+0000","last_clean":"2023-10-07T09:05:09.936091+0000","last_became_active":"2023-10-07T09:05:09.935839+0000","last_became_peered":"2023-10-07T09:05:09.935839+0000","last_unstale":"2023-10-07T09:05:09.936091+0000","last_undegraded":"2023-10-07T09:05:09.936091+0000","last_fullsized":"2023-10-07T09:05:09.936091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:14.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946022+0000","last_change":"2023-10-07T09:05:09.946022+0000","last_active":"2023-10-07T09:05:09.946022+0000","last_peered":"2023-10-07T09:05:09.946022+0000","last_clean":"2023-10-07T09:05:09.946022+0000","last_became_active":"2023-10-07T09:05:09.945625+0000","last_became_peered":"2023-10-07T09:05:09.945625+0000","last_unstale":"2023-10-07T09:05:09.946022+0000","last_undegraded":"2023-10-07T09:05:09.946022+0000","last_fullsized":"2023-10-07T09:05:09.946022+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:48.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933283+0000","last_change":"2023-10-07T09:05:09.933283+0000","last_active":"2023-10-07T09:05:09.933283+0000","last_peered":"2023-10-07T09:05:09.933283+0000","last_clean":"2023-10-07T09:05:09.933283+0000","last_became_active":"2023-10-07T09:05:09.933038+0000","last_became_peered":"2023-10-07T09:05:09.933038+0000","last_unstale":"2023-10-07T09:05:09.933283+0000","last_undegraded":"2023-10-07T09:05:09.933283+0000","last_fullsized":"2023-10-07T09:05:09.933283+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:45.145636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946501+0000","last_change":"2023-10-07T09:05:09.946501+0000","last_active":"2023-10-07T09:05:09.946501+0000","last_peered":"2023-10-07T09:05:09.946501+0000","last_clean":"2023-10-07T09:05:09.946501+0000","last_became_active":"2023-10-07T09:05:09.946243+0000","last_became_peered":"2023-10-07T09:05:09.946243+0000","last_unstale":"2023-10-07T09:05:09.946501+0000","last_undegraded":"2023-10-07T09:05:09.946501+0000","last_fullsized":"2023-10-07T09:05:09.946501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:38.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942439+0000","last_change":"2023-10-07T09:05:09.942439+0000","last_active":"2023-10-07T09:05:09.942439+0000","last_peered":"2023-10-07T09:05:09.942439+0000","last_clean":"2023-10-07T09:05:09.942439+0000","last_became_active":"2023-10-07T09:05:09.942140+0000","last_became_peered":"2023-10-07T09:05:09.942140+0000","last_unstale":"2023-10-07T09:05:09.942439+0000","last_undegraded":"2023-10-07T09:05:09.942439+0000","last_fullsized":"2023-10-07T09:05:09.942439+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:37:18.166872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943267+0000","last_change":"2023-10-07T09:05:09.943267+0000","last_active":"2023-10-07T09:05:09.943267+0000","last_peered":"2023-10-07T09:05:09.943267+0000","last_clean":"2023-10-07T09:05:09.943267+0000","last_became_active":"2023-10-07T09:05:09.942711+0000","last_became_peered":"2023-10-07T09:05:09.942711+0000","last_unstale":"2023-10-07T09:05:09.943267+0000","last_undegraded":"2023-10-07T09:05:09.943267+0000","last_fullsized":"2023-10-07T09:05:09.943267+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:36.882878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935286+0000","last_change":"2023-10-07T09:05:09.935286+0000","last_active":"2023-10-07T09:05:09.935286+0000","last_peered":"2023-10-07T09:05:09.935286+0000","last_clean":"2023-10-07T09:05:09.935286+0000","last_became_active":"2023-10-07T09:05:09.935004+0000","last_became_peered":"2023-10-07T09:05:09.935004+0000","last_unstale":"2023-10-07T09:05:09.935286+0000","last_undegraded":"2023-10-07T09:05:09.935286+0000","last_fullsized":"2023-10-07T09:05:09.935286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:45.871000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950123+0000","last_change":"2023-10-07T09:05:09.950123+0000","last_active":"2023-10-07T09:05:09.950123+0000","last_peered":"2023-10-07T09:05:09.950123+0000","last_clean":"2023-10-07T09:05:09.950123+0000","last_became_active":"2023-10-07T09:05:09.949870+0000","last_became_peered":"2023-10-07T09:05:09.949870+0000","last_unstale":"2023-10-07T09:05:09.950123+0000","last_undegraded":"2023-10-07T09:05:09.950123+0000","last_fullsized":"2023-10-07T09:05:09.950123+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:22.505906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941674+0000","last_change":"2023-10-07T09:05:09.941674+0000","last_active":"2023-10-07T09:05:09.941674+0000","last_peered":"2023-10-07T09:05:09.941674+0000","last_clean":"2023-10-07T09:05:09.941674+0000","last_became_active":"2023-10-07T09:05:09.941283+0000","last_became_peered":"2023-10-07T09:05:09.941283+0000","last_unstale":"2023-10-07T09:05:09.941674+0000","last_undegraded":"2023-10-07T09:05:09.941674+0000","last_fullsized":"2023-10-07T09:05:09.941674+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:52:40.630123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945255+0000","last_change":"2023-10-07T09:05:09.945255+0000","last_active":"2023-10-07T09:05:09.945255+0000","last_peered":"2023-10-07T09:05:09.945255+0000","last_clean":"2023-10-07T09:05:09.945255+0000","last_became_active":"2023-10-07T09:05:09.944633+0000","last_became_peered":"2023-10-07T09:05:09.944633+0000","last_unstale":"2023-10-07T09:05:09.945255+0000","last_undegraded":"2023-10-07T09:05:09.945255+0000","last_fullsized":"2023-10-07T09:05:09.945255+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:25.673932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942423+0000","last_change":"2023-10-07T09:05:09.942423+0000","last_active":"2023-10-07T09:05:09.942423+0000","last_peered":"2023-10-07T09:05:09.942423+0000","last_clean":"2023-10-07T09:05:09.942423+0000","last_became_active":"2023-10-07T09:05:09.942227+0000","last_became_peered":"2023-10-07T09:05:09.942227+0000","last_unstale":"2023-10-07T09:05:09.942423+0000","last_undegraded":"2023-10-07T09:05:09.942423+0000","last_fullsized":"2023-10-07T09:05:09.942423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:09.723396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948043+0000","last_change":"2023-10-07T09:05:09.948043+0000","last_active":"2023-10-07T09:05:09.948043+0000","last_peered":"2023-10-07T09:05:09.948043+0000","last_clean":"2023-10-07T09:05:09.948043+0000","last_became_active":"2023-10-07T09:05:09.947755+0000","last_became_peered":"2023-10-07T09:05:09.947755+0000","last_unstale":"2023-10-07T09:05:09.948043+0000","last_undegraded":"2023-10-07T09:05:09.948043+0000","last_fullsized":"2023-10-07T09:05:09.948043+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:45.871000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.940390+0000","last_change":"2023-10-07T09:05:09.940390+0000","last_active":"2023-10-07T09:05:09.940390+0000","last_peered":"2023-10-07T09:05:09.940390+0000","last_clean":"2023-10-07T09:05:09.940390+0000","last_became_active":"2023-10-07T09:05:09.940121+0000","last_became_peered":"2023-10-07T09:05:09.940121+0000","last_unstale":"2023-10-07T09:05:09.940390+0000","last_undegraded":"2023-10-07T09:05:09.940390+0000","last_fullsized":"2023-10-07T09:05:09.940390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:38.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941596+0000","last_change":"2023-10-07T09:05:09.941596+0000","last_active":"2023-10-07T09:05:09.941596+0000","last_peered":"2023-10-07T09:05:09.941596+0000","last_clean":"2023-10-07T09:05:09.941596+0000","last_became_active":"2023-10-07T09:05:09.941407+0000","last_became_peered":"2023-10-07T09:05:09.941407+0000","last_unstale":"2023-10-07T09:05:09.941596+0000","last_undegraded":"2023-10-07T09:05:09.941596+0000","last_fullsized":"2023-10-07T09:05:09.941596+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:24.135531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301877+0000","last_change":"2023-10-07T09:05:09.305665+0000","last_active":"2023-10-07T09:05:10.301877+0000","last_peered":"2023-10-07T09:05:10.301877+0000","last_clean":"2023-10-07T09:05:10.301877+0000","last_became_active":"2023-10-07T09:05:09.305229+0000","last_became_peered":"2023-10-07T09:05:09.305229+0000","last_unstale":"2023-10-07T09:05:10.301877+0000","last_undegraded":"2023-10-07T09:05:10.301877+0000","last_fullsized":"2023-10-07T09:05:10.301877+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:42.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942384+0000","last_change":"2023-10-07T09:05:09.942384+0000","last_active":"2023-10-07T09:05:09.942384+0000","last_peered":"2023-10-07T09:05:09.942384+0000","last_clean":"2023-10-07T09:05:09.942384+0000","last_became_active":"2023-10-07T09:05:09.942063+0000","last_became_peered":"2023-10-07T09:05:09.942063+0000","last_unstale":"2023-10-07T09:05:09.942384+0000","last_undegraded":"2023-10-07T09:05:09.942384+0000","last_fullsized":"2023-10-07T09:05:09.942384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933913+0000","last_change":"2023-10-07T09:05:09.305954+0000","last_active":"2023-10-07T09:05:09.933913+0000","last_peered":"2023-10-07T09:05:09.933913+0000","last_clean":"2023-10-07T09:05:09.933913+0000","last_became_active":"2023-10-07T09:05:09.305673+0000","last_became_peered":"2023-10-07T09:05:09.305673+0000","last_unstale":"2023-10-07T09:05:09.933913+0000","last_undegraded":"2023-10-07T09:05:09.933913+0000","last_fullsized":"2023-10-07T09:05:09.933913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:51.502195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948187+0000","last_change":"2023-10-07T09:05:09.948187+0000","last_active":"2023-10-07T09:05:09.948187+0000","last_peered":"2023-10-07T09:05:09.948187+0000","last_clean":"2023-10-07T09:05:09.948187+0000","last_became_active":"2023-10-07T09:05:09.947902+0000","last_became_peered":"2023-10-07T09:05:09.947902+0000","last_unstale":"2023-10-07T09:05:09.948187+0000","last_undegraded":"2023-10-07T09:05:09.948187+0000","last_fullsized":"2023-10-07T09:05:09.948187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:17.208471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.300935+0000","last_change":"2023-10-07T09:05:09.304902+0000","last_active":"2023-10-07T09:05:10.300935+0000","last_peered":"2023-10-07T09:05:10.300935+0000","last_clean":"2023-10-07T09:05:10.300935+0000","last_became_active":"2023-10-07T09:05:09.304586+0000","last_became_peered":"2023-10-07T09:05:09.304586+0000","last_unstale":"2023-10-07T09:05:10.300935+0000","last_undegraded":"2023-10-07T09:05:10.300935+0000","last_fullsized":"2023-10-07T09:05:10.300935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:16:02.277882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942722+0000","last_change":"2023-10-07T09:05:09.942722+0000","last_active":"2023-10-07T09:05:09.942722+0000","last_peered":"2023-10-07T09:05:09.942722+0000","last_clean":"2023-10-07T09:05:09.942722+0000","last_became_active":"2023-10-07T09:05:09.942333+0000","last_became_peered":"2023-10-07T09:05:09.942333+0000","last_unstale":"2023-10-07T09:05:09.942722+0000","last_undegraded":"2023-10-07T09:05:09.942722+0000","last_fullsized":"2023-10-07T09:05:09.942722+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:24.113664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301175+0000","last_change":"2023-10-07T09:05:09.303606+0000","last_active":"2023-10-07T09:05:10.301175+0000","last_peered":"2023-10-07T09:05:10.301175+0000","last_clean":"2023-10-07T09:05:10.301175+0000","last_became_active":"2023-10-07T09:05:09.303335+0000","last_became_peered":"2023-10-07T09:05:09.303335+0000","last_unstale":"2023-10-07T09:05:10.301175+0000","last_undegraded":"2023-10-07T09:05:10.301175+0000","last_fullsized":"2023-10-07T09:05:10.301175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:08.159442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947344+0000","last_change":"2023-10-07T09:05:09.947344+0000","last_active":"2023-10-07T09:05:09.947344+0000","last_peered":"2023-10-07T09:05:09.947344+0000","last_clean":"2023-10-07T09:05:09.947344+0000","last_became_active":"2023-10-07T09:05:09.947076+0000","last_became_peered":"2023-10-07T09:05:09.947076+0000","last_unstale":"2023-10-07T09:05:09.947344+0000","last_undegraded":"2023-10-07T09:05:09.947344+0000","last_fullsized":"2023-10-07T09:05:09.947344+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:55.920963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.925467+0000","last_change":"2023-10-07T09:05:09.305346+0000","last_active":"2023-10-07T09:05:09.925467+0000","last_peered":"2023-10-07T09:05:09.925467+0000","last_clean":"2023-10-07T09:05:09.925467+0000","last_became_active":"2023-10-07T09:05:09.304687+0000","last_became_peered":"2023-10-07T09:05:09.304687+0000","last_unstale":"2023-10-07T09:05:09.925467+0000","last_undegraded":"2023-10-07T09:05:09.925467+0000","last_fullsized":"2023-10-07T09:05:09.925467+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:53.538306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946789+0000","last_change":"2023-10-07T09:05:09.946789+0000","last_active":"2023-10-07T09:05:09.946789+0000","last_peered":"2023-10-07T09:05:09.946789+0000","last_clean":"2023-10-07T09:05:09.946789+0000","last_became_active":"2023-10-07T09:05:09.946291+0000","last_became_peered":"2023-10-07T09:05:09.946291+0000","last_unstale":"2023-10-07T09:05:09.946789+0000","last_undegraded":"2023-10-07T09:05:09.946789+0000","last_fullsized":"2023-10-07T09:05:09.946789+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.931520+0000","last_change":"2023-10-07T09:05:09.304524+0000","last_active":"2023-10-07T09:05:09.931520+0000","last_peered":"2023-10-07T09:05:09.931520+0000","last_clean":"2023-10-07T09:05:09.931520+0000","last_became_active":"2023-10-07T09:05:09.304248+0000","last_became_peered":"2023-10-07T09:05:09.304248+0000","last_unstale":"2023-10-07T09:05:09.931520+0000","last_undegraded":"2023-10-07T09:05:09.931520+0000","last_fullsized":"2023-10-07T09:05:09.931520+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:23.109100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943754+0000","last_change":"2023-10-07T09:05:09.943754+0000","last_active":"2023-10-07T09:05:09.943754+0000","last_peered":"2023-10-07T09:05:09.943754+0000","last_clean":"2023-10-07T09:05:09.943754+0000","last_became_active":"2023-10-07T09:05:09.943286+0000","last_became_peered":"2023-10-07T09:05:09.943286+0000","last_unstale":"2023-10-07T09:05:09.943754+0000","last_undegraded":"2023-10-07T09:05:09.943754+0000","last_fullsized":"2023-10-07T09:05:09.943754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:43.273034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.312631+0000","last_change":"2023-10-07T09:05:09.307981+0000","last_active":"2023-10-07T09:05:09.312631+0000","last_peered":"2023-10-07T09:05:09.312631+0000","last_clean":"2023-10-07T09:05:09.312631+0000","last_became_active":"2023-10-07T09:05:09.307718+0000","last_became_peered":"2023-10-07T09:05:09.307718+0000","last_unstale":"2023-10-07T09:05:09.312631+0000","last_undegraded":"2023-10-07T09:05:09.312631+0000","last_fullsized":"2023-10-07T09:05:09.312631+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:27.189541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935530+0000","last_change":"2023-10-07T09:05:09.935530+0000","last_active":"2023-10-07T09:05:09.935530+0000","last_peered":"2023-10-07T09:05:09.935530+0000","last_clean":"2023-10-07T09:05:09.935530+0000","last_became_active":"2023-10-07T09:05:09.935246+0000","last_became_peered":"2023-10-07T09:05:09.935246+0000","last_unstale":"2023-10-07T09:05:09.935530+0000","last_undegraded":"2023-10-07T09:05:09.935530+0000","last_fullsized":"2023-10-07T09:05:09.935530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.307965+0000","last_change":"2023-10-07T09:05:09.307309+0000","last_active":"2023-10-07T09:05:09.307965+0000","last_peered":"2023-10-07T09:05:09.307965+0000","last_clean":"2023-10-07T09:05:09.307965+0000","last_became_active":"2023-10-07T09:05:09.307047+0000","last_became_peered":"2023-10-07T09:05:09.307047+0000","last_unstale":"2023-10-07T09:05:09.307965+0000","last_undegraded":"2023-10-07T09:05:09.307965+0000","last_fullsized":"2023-10-07T09:05:09.307965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:15.291394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.934127+0000","last_change":"2023-10-07T09:05:09.934127+0000","last_active":"2023-10-07T09:05:09.934127+0000","last_peered":"2023-10-07T09:05:09.934127+0000","last_clean":"2023-10-07T09:05:09.934127+0000","last_became_active":"2023-10-07T09:05:09.933878+0000","last_became_peered":"2023-10-07T09:05:09.933878+0000","last_unstale":"2023-10-07T09:05:09.934127+0000","last_undegraded":"2023-10-07T09:05:09.934127+0000","last_fullsized":"2023-10-07T09:05:09.934127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:23:06.935872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.304108+0000","last_change":"2023-10-07T09:05:09.299366+0000","last_active":"2023-10-07T09:05:09.304108+0000","last_peered":"2023-10-07T09:05:09.304108+0000","last_clean":"2023-10-07T09:05:09.304108+0000","last_became_active":"2023-10-07T09:05:09.299065+0000","last_became_peered":"2023-10-07T09:05:09.299065+0000","last_unstale":"2023-10-07T09:05:09.304108+0000","last_undegraded":"2023-10-07T09:05:09.304108+0000","last_fullsized":"2023-10-07T09:05:09.304108+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:56:51.194643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947403+0000","last_change":"2023-10-07T09:05:09.947403+0000","last_active":"2023-10-07T09:05:09.947403+0000","last_peered":"2023-10-07T09:05:09.947403+0000","last_clean":"2023-10-07T09:05:09.947403+0000","last_became_active":"2023-10-07T09:05:09.945109+0000","last_became_peered":"2023-10-07T09:05:09.945109+0000","last_unstale":"2023-10-07T09:05:09.947403+0000","last_undegraded":"2023-10-07T09:05:09.947403+0000","last_fullsized":"2023-10-07T09:05:09.947403+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:22.099524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308045+0000","last_change":"2023-10-07T09:05:09.303680+0000","last_active":"2023-10-07T09:05:09.308045+0000","last_peered":"2023-10-07T09:05:09.308045+0000","last_clean":"2023-10-07T09:05:09.308045+0000","last_became_active":"2023-10-07T09:05:09.303306+0000","last_became_peered":"2023-10-07T09:05:09.303306+0000","last_unstale":"2023-10-07T09:05:09.308045+0000","last_undegraded":"2023-10-07T09:05:09.308045+0000","last_fullsized":"2023-10-07T09:05:09.308045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:06.230004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947401+0000","last_change":"2023-10-07T09:05:09.947401+0000","last_active":"2023-10-07T09:05:09.947401+0000","last_peered":"2023-10-07T09:05:09.947401+0000","last_clean":"2023-10-07T09:05:09.947401+0000","last_became_active":"2023-10-07T09:05:09.947133+0000","last_became_peered":"2023-10-07T09:05:09.947133+0000","last_unstale":"2023-10-07T09:05:09.947401+0000","last_undegraded":"2023-10-07T09:05:09.947401+0000","last_fullsized":"2023-10-07T09:05:09.947401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:46:02.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302551+0000","last_change":"2023-10-07T09:05:09.304544+0000","last_active":"2023-10-07T09:05:10.302551+0000","last_peered":"2023-10-07T09:05:10.302551+0000","last_clean":"2023-10-07T09:05:10.302551+0000","last_became_active":"2023-10-07T09:05:09.304298+0000","last_became_peered":"2023-10-07T09:05:09.304298+0000","last_unstale":"2023-10-07T09:05:10.302551+0000","last_undegraded":"2023-10-07T09:05:10.302551+0000","last_fullsized":"2023-10-07T09:05:10.302551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:53.538306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946760+0000","last_change":"2023-10-07T09:05:09.946760+0000","last_active":"2023-10-07T09:05:09.946760+0000","last_peered":"2023-10-07T09:05:09.946760+0000","last_clean":"2023-10-07T09:05:09.946760+0000","last_became_active":"2023-10-07T09:05:09.946445+0000","last_became_peered":"2023-10-07T09:05:09.946445+0000","last_unstale":"2023-10-07T09:05:09.946760+0000","last_undegraded":"2023-10-07T09:05:09.946760+0000","last_fullsized":"2023-10-07T09:05:09.946760+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:14.859462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.304912+0000","last_change":"2023-10-07T09:05:09.309041+0000","last_active":"2023-10-07T09:05:10.304912+0000","last_peered":"2023-10-07T09:05:10.304912+0000","last_clean":"2023-10-07T09:05:10.304912+0000","last_became_active":"2023-10-07T09:05:09.308789+0000","last_became_peered":"2023-10-07T09:05:09.308789+0000","last_unstale":"2023-10-07T09:05:10.304912+0000","last_undegraded":"2023-10-07T09:05:10.304912+0000","last_fullsized":"2023-10-07T09:05:10.304912+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:21.094959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.932807+0000","last_change":"2023-10-07T09:05:09.932807+0000","last_active":"2023-10-07T09:05:09.932807+0000","last_peered":"2023-10-07T09:05:09.932807+0000","last_clean":"2023-10-07T09:05:09.932807+0000","last_became_active":"2023-10-07T09:05:09.932548+0000","last_became_peered":"2023-10-07T09:05:09.932548+0000","last_unstale":"2023-10-07T09:05:09.932807+0000","last_undegraded":"2023-10-07T09:05:09.932807+0000","last_fullsized":"2023-10-07T09:05:09.932807+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:16.295959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308375+0000","last_change":"2023-10-07T09:05:09.307663+0000","last_active":"2023-10-07T09:05:09.308375+0000","last_peered":"2023-10-07T09:05:09.308375+0000","last_clean":"2023-10-07T09:05:09.308375+0000","last_became_active":"2023-10-07T09:05:09.307394+0000","last_became_peered":"2023-10-07T09:05:09.307394+0000","last_unstale":"2023-10-07T09:05:09.308375+0000","last_undegraded":"2023-10-07T09:05:09.308375+0000","last_fullsized":"2023-10-07T09:05:09.308375+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:26:02.180799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945160+0000","last_change":"2023-10-07T09:05:09.945160+0000","last_active":"2023-10-07T09:05:09.945160+0000","last_peered":"2023-10-07T09:05:09.945160+0000","last_clean":"2023-10-07T09:05:09.945160+0000","last_became_active":"2023-10-07T09:05:09.944910+0000","last_became_peered":"2023-10-07T09:05:09.944910+0000","last_unstale":"2023-10-07T09:05:09.945160+0000","last_undegraded":"2023-10-07T09:05:09.945160+0000","last_fullsized":"2023-10-07T09:05:09.945160+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.306388+0000","last_change":"2023-10-07T09:05:09.304942+0000","last_active":"2023-10-07T09:05:09.306388+0000","last_peered":"2023-10-07T09:05:09.306388+0000","last_clean":"2023-10-07T09:05:09.306388+0000","last_became_active":"2023-10-07T09:05:09.304655+0000","last_became_peered":"2023-10-07T09:05:09.304655+0000","last_unstale":"2023-10-07T09:05:09.306388+0000","last_undegraded":"2023-10-07T09:05:09.306388+0000","last_fullsized":"2023-10-07T09:05:09.306388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:08.718832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947128+0000","last_change":"2023-10-07T09:05:09.947128+0000","last_active":"2023-10-07T09:05:09.947128+0000","last_peered":"2023-10-07T09:05:09.947128+0000","last_clean":"2023-10-07T09:05:09.947128+0000","last_became_active":"2023-10-07T09:05:09.946727+0000","last_became_peered":"2023-10-07T09:05:09.946727+0000","last_unstale":"2023-10-07T09:05:09.947128+0000","last_undegraded":"2023-10-07T09:05:09.947128+0000","last_fullsized":"2023-10-07T09:05:09.947128+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302051+0000","last_change":"2023-10-07T09:05:09.308679+0000","last_active":"2023-10-07T09:05:10.302051+0000","last_peered":"2023-10-07T09:05:10.302051+0000","last_clean":"2023-10-07T09:05:10.302051+0000","last_became_active":"2023-10-07T09:05:09.308402+0000","last_became_peered":"2023-10-07T09:05:09.308402+0000","last_unstale":"2023-10-07T09:05:10.302051+0000","last_undegraded":"2023-10-07T09:05:10.302051+0000","last_fullsized":"2023-10-07T09:05:10.302051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:30.149333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943204+0000","last_change":"2023-10-07T09:05:09.943204+0000","last_active":"2023-10-07T09:05:09.943204+0000","last_peered":"2023-10-07T09:05:09.943204+0000","last_clean":"2023-10-07T09:05:09.943204+0000","last_became_active":"2023-10-07T09:05:09.942907+0000","last_became_peered":"2023-10-07T09:05:09.942907+0000","last_unstale":"2023-10-07T09:05:09.943204+0000","last_undegraded":"2023-10-07T09:05:09.943204+0000","last_fullsized":"2023-10-07T09:05:09.943204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:38.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.934564+0000","last_change":"2023-10-07T09:05:09.308012+0000","last_active":"2023-10-07T09:05:09.934564+0000","last_peered":"2023-10-07T09:05:09.934564+0000","last_clean":"2023-10-07T09:05:09.934564+0000","last_became_active":"2023-10-07T09:05:09.307752+0000","last_became_peered":"2023-10-07T09:05:09.307752+0000","last_unstale":"2023-10-07T09:05:09.934564+0000","last_undegraded":"2023-10-07T09:05:09.934564+0000","last_fullsized":"2023-10-07T09:05:09.934564+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:53:29.498506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947561+0000","last_change":"2023-10-07T09:05:09.947561+0000","last_active":"2023-10-07T09:05:09.947561+0000","last_peered":"2023-10-07T09:05:09.947561+0000","last_clean":"2023-10-07T09:05:09.947561+0000","last_became_active":"2023-10-07T09:05:09.945464+0000","last_became_peered":"2023-10-07T09:05:09.945464+0000","last_unstale":"2023-10-07T09:05:09.947561+0000","last_undegraded":"2023-10-07T09:05:09.947561+0000","last_fullsized":"2023-10-07T09:05:09.947561+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:42.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.298996+0000","last_change":"2023-10-07T09:05:09.310916+0000","last_active":"2023-10-07T09:05:10.298996+0000","last_peered":"2023-10-07T09:05:10.298996+0000","last_clean":"2023-10-07T09:05:10.298996+0000","last_became_active":"2023-10-07T09:05:09.307474+0000","last_became_peered":"2023-10-07T09:05:09.307474+0000","last_unstale":"2023-10-07T09:05:10.298996+0000","last_undegraded":"2023-10-07T09:05:10.298996+0000","last_fullsized":"2023-10-07T09:05:10.298996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:58.529514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.936034+0000","last_change":"2023-10-07T09:05:09.936034+0000","last_active":"2023-10-07T09:05:09.936034+0000","last_peered":"2023-10-07T09:05:09.936034+0000","last_clean":"2023-10-07T09:05:09.936034+0000","last_became_active":"2023-10-07T09:05:09.935166+0000","last_became_peered":"2023-10-07T09:05:09.935166+0000","last_unstale":"2023-10-07T09:05:09.936034+0000","last_undegraded":"2023-10-07T09:05:09.936034+0000","last_fullsized":"2023-10-07T09:05:09.936034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:14.859462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.937559+0000","last_change":"2023-10-07T09:05:09.304544+0000","last_active":"2023-10-07T09:05:09.937559+0000","last_peered":"2023-10-07T09:05:09.937559+0000","last_clean":"2023-10-07T09:05:09.937559+0000","last_became_active":"2023-10-07T09:05:09.304268+0000","last_became_peered":"2023-10-07T09:05:09.304268+0000","last_unstale":"2023-10-07T09:05:09.937559+0000","last_undegraded":"2023-10-07T09:05:09.937559+0000","last_fullsized":"2023-10-07T09:05:09.937559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:02.617047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935496+0000","last_change":"2023-10-07T09:05:09.935496+0000","last_active":"2023-10-07T09:05:09.935496+0000","last_peered":"2023-10-07T09:05:09.935496+0000","last_clean":"2023-10-07T09:05:09.935496+0000","last_became_active":"2023-10-07T09:05:09.935236+0000","last_became_peered":"2023-10-07T09:05:09.935236+0000","last_unstale":"2023-10-07T09:05:09.935496+0000","last_undegraded":"2023-10-07T09:05:09.935496+0000","last_fullsized":"2023-10-07T09:05:09.935496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:06.930956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.309985+0000","last_change":"2023-10-07T09:05:09.306176+0000","last_active":"2023-10-07T09:05:09.309985+0000","last_peered":"2023-10-07T09:05:09.309985+0000","last_clean":"2023-10-07T09:05:09.309985+0000","last_became_active":"2023-10-07T09:05:09.305895+0000","last_became_peered":"2023-10-07T09:05:09.305895+0000","last_unstale":"2023-10-07T09:05:09.309985+0000","last_undegraded":"2023-10-07T09:05:09.309985+0000","last_fullsized":"2023-10-07T09:05:09.309985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:08.718832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947735+0000","last_change":"2023-10-07T09:05:09.947735+0000","last_active":"2023-10-07T09:05:09.947735+0000","last_peered":"2023-10-07T09:05:09.947735+0000","last_clean":"2023-10-07T09:05:09.947735+0000","last_became_active":"2023-10-07T09:05:09.947453+0000","last_became_peered":"2023-10-07T09:05:09.947453+0000","last_unstale":"2023-10-07T09:05:09.947735+0000","last_undegraded":"2023-10-07T09:05:09.947735+0000","last_fullsized":"2023-10-07T09:05:09.947735+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:09.164006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302546+0000","last_change":"2023-10-07T09:05:09.300079+0000","last_active":"2023-10-07T09:05:10.302546+0000","last_peered":"2023-10-07T09:05:10.302546+0000","last_clean":"2023-10-07T09:05:10.302546+0000","last_became_active":"2023-10-07T09:05:09.299817+0000","last_became_peered":"2023-10-07T09:05:09.299817+0000","last_unstale":"2023-10-07T09:05:10.302546+0000","last_undegraded":"2023-10-07T09:05:10.302546+0000","last_fullsized":"2023-10-07T09:05:10.302546+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:24.669368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946579+0000","last_change":"2023-10-07T09:05:09.946579+0000","last_active":"2023-10-07T09:05:09.946579+0000","last_peered":"2023-10-07T09:05:09.946579+0000","last_clean":"2023-10-07T09:05:09.946579+0000","last_became_active":"2023-10-07T09:05:09.945933+0000","last_became_peered":"2023-10-07T09:05:09.945933+0000","last_unstale":"2023-10-07T09:05:09.946579+0000","last_undegraded":"2023-10-07T09:05:09.946579+0000","last_fullsized":"2023-10-07T09:05:09.946579+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:34:04.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308205+0000","last_change":"2023-10-07T09:05:09.306559+0000","last_active":"2023-10-07T09:05:09.308205+0000","last_peered":"2023-10-07T09:05:09.308205+0000","last_clean":"2023-10-07T09:05:09.308205+0000","last_became_active":"2023-10-07T09:05:09.306239+0000","last_became_peered":"2023-10-07T09:05:09.306239+0000","last_unstale":"2023-10-07T09:05:09.308205+0000","last_undegraded":"2023-10-07T09:05:09.308205+0000","last_fullsized":"2023-10-07T09:05:09.308205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:37:42.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933257+0000","last_change":"2023-10-07T09:05:09.933257+0000","last_active":"2023-10-07T09:05:09.933257+0000","last_peered":"2023-10-07T09:05:09.933257+0000","last_clean":"2023-10-07T09:05:09.933257+0000","last_became_active":"2023-10-07T09:05:09.933008+0000","last_became_peered":"2023-10-07T09:05:09.933008+0000","last_unstale":"2023-10-07T09:05:09.933257+0000","last_undegraded":"2023-10-07T09:05:09.933257+0000","last_fullsized":"2023-10-07T09:05:09.933257+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308015+0000","last_change":"2023-10-07T09:05:09.303494+0000","last_active":"2023-10-07T09:05:09.308015+0000","last_peered":"2023-10-07T09:05:09.308015+0000","last_clean":"2023-10-07T09:05:09.308015+0000","last_became_active":"2023-10-07T09:05:09.303227+0000","last_became_peered":"2023-10-07T09:05:09.303227+0000","last_unstale":"2023-10-07T09:05:09.308015+0000","last_undegraded":"2023-10-07T09:05:09.308015+0000","last_fullsized":"2023-10-07T09:05:09.308015+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:11.888357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942522+0000","last_change":"2023-10-07T09:05:09.942522+0000","last_active":"2023-10-07T09:05:09.942522+0000","last_peered":"2023-10-07T09:05:09.942522+0000","last_clean":"2023-10-07T09:05:09.942522+0000","last_became_active":"2023-10-07T09:05:09.942226+0000","last_became_peered":"2023-10-07T09:05:09.942226+0000","last_unstale":"2023-10-07T09:05:09.942522+0000","last_undegraded":"2023-10-07T09:05:09.942522+0000","last_fullsized":"2023-10-07T09:05:09.942522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:30.330250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.311799+0000","last_change":"2023-10-07T09:05:09.311251+0000","last_active":"2023-10-07T09:05:09.311799+0000","last_peered":"2023-10-07T09:05:09.311799+0000","last_clean":"2023-10-07T09:05:09.311799+0000","last_became_active":"2023-10-07T09:05:09.310941+0000","last_became_peered":"2023-10-07T09:05:09.310941+0000","last_unstale":"2023-10-07T09:05:09.311799+0000","last_undegraded":"2023-10-07T09:05:09.311799+0000","last_fullsized":"2023-10-07T09:05:09.311799+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:31.874341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946443+0000","last_change":"2023-10-07T09:05:09.946443+0000","last_active":"2023-10-07T09:05:09.946443+0000","last_peered":"2023-10-07T09:05:09.946443+0000","last_clean":"2023-10-07T09:05:09.946443+0000","last_became_active":"2023-10-07T09:05:09.945960+0000","last_became_peered":"2023-10-07T09:05:09.945960+0000","last_unstale":"2023-10-07T09:05:09.946443+0000","last_undegraded":"2023-10-07T09:05:09.946443+0000","last_fullsized":"2023-10-07T09:05:09.946443+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:35.410635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.299830+0000","last_change":"2023-10-07T09:05:09.303145+0000","last_active":"2023-10-07T09:05:10.299830+0000","last_peered":"2023-10-07T09:05:10.299830+0000","last_clean":"2023-10-07T09:05:10.299830+0000","last_became_active":"2023-10-07T09:05:09.302876+0000","last_became_peered":"2023-10-07T09:05:09.302876+0000","last_unstale":"2023-10-07T09:05:10.299830+0000","last_undegraded":"2023-10-07T09:05:10.299830+0000","last_fullsized":"2023-10-07T09:05:10.299830+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:18:00.586724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.944419+0000","last_change":"2023-10-07T09:05:09.944419+0000","last_active":"2023-10-07T09:05:09.944419+0000","last_peered":"2023-10-07T09:05:09.944419+0000","last_clean":"2023-10-07T09:05:09.944419+0000","last_became_active":"2023-10-07T09:05:09.943745+0000","last_became_peered":"2023-10-07T09:05:09.943745+0000","last_unstale":"2023-10-07T09:05:09.944419+0000","last_undegraded":"2023-10-07T09:05:09.944419+0000","last_fullsized":"2023-10-07T09:05:09.944419+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:56:52.199207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.310001+0000","last_change":"2023-10-07T09:05:09.305556+0000","last_active":"2023-10-07T09:05:09.310001+0000","last_peered":"2023-10-07T09:05:09.310001+0000","last_clean":"2023-10-07T09:05:09.310001+0000","last_became_active":"2023-10-07T09:05:09.305272+0000","last_became_peered":"2023-10-07T09:05:09.305272+0000","last_unstale":"2023-10-07T09:05:09.310001+0000","last_undegraded":"2023-10-07T09:05:09.310001+0000","last_fullsized":"2023-10-07T09:05:09.310001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:37.428429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.939837+0000","last_change":"2023-10-07T09:05:09.939837+0000","last_active":"2023-10-07T09:05:09.939837+0000","last_peered":"2023-10-07T09:05:09.939837+0000","last_clean":"2023-10-07T09:05:09.939837+0000","last_became_active":"2023-10-07T09:05:09.939534+0000","last_became_peered":"2023-10-07T09:05:09.939534+0000","last_unstale":"2023-10-07T09:05:09.939837+0000","last_undegraded":"2023-10-07T09:05:09.939837+0000","last_fullsized":"2023-10-07T09:05:09.939837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:59:00.627830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.302616+0000","last_change":"2023-10-07T09:05:09.302211+0000","last_active":"2023-10-07T09:05:09.302616+0000","last_peered":"2023-10-07T09:05:09.302616+0000","last_clean":"2023-10-07T09:05:09.302616+0000","last_became_active":"2023-10-07T09:05:09.301940+0000","last_became_peered":"2023-10-07T09:05:09.301940+0000","last_unstale":"2023-10-07T09:05:09.302616+0000","last_undegraded":"2023-10-07T09:05:09.302616+0000","last_fullsized":"2023-10-07T09:05:09.302616+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:51.502195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946496+0000","last_change":"2023-10-07T09:05:09.946496+0000","last_active":"2023-10-07T09:05:09.946496+0000","last_peered":"2023-10-07T09:05:09.946496+0000","last_clean":"2023-10-07T09:05:09.946496+0000","last_became_active":"2023-10-07T09:05:09.945930+0000","last_became_peered":"2023-10-07T09:05:09.945930+0000","last_unstale":"2023-10-07T09:05:09.946496+0000","last_undegraded":"2023-10-07T09:05:09.946496+0000","last_fullsized":"2023-10-07T09:05:09.946496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.303659+0000","last_change":"2023-10-07T09:05:09.299689+0000","last_active":"2023-10-07T09:05:09.303659+0000","last_peered":"2023-10-07T09:05:09.303659+0000","last_clean":"2023-10-07T09:05:09.303659+0000","last_became_active":"2023-10-07T09:05:09.299413+0000","last_became_peered":"2023-10-07T09:05:09.299413+0000","last_unstale":"2023-10-07T09:05:09.303659+0000","last_undegraded":"2023-10-07T09:05:09.303659+0000","last_fullsized":"2023-10-07T09:05:09.303659+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:25:22.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950925+0000","last_change":"2023-10-07T09:05:09.950925+0000","last_active":"2023-10-07T09:05:09.950925+0000","last_peered":"2023-10-07T09:05:09.950925+0000","last_clean":"2023-10-07T09:05:09.950925+0000","last_became_active":"2023-10-07T09:05:09.950642+0000","last_became_peered":"2023-10-07T09:05:09.950642+0000","last_unstale":"2023-10-07T09:05:09.950925+0000","last_undegraded":"2023-10-07T09:05:09.950925+0000","last_fullsized":"2023-10-07T09:05:09.950925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:56.942469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.306459+0000","last_change":"2023-10-07T09:05:09.305550+0000","last_active":"2023-10-07T09:05:09.306459+0000","last_peered":"2023-10-07T09:05:09.306459+0000","last_clean":"2023-10-07T09:05:09.306459+0000","last_became_active":"2023-10-07T09:05:09.305068+0000","last_became_peered":"2023-10-07T09:05:09.305068+0000","last_unstale":"2023-10-07T09:05:09.306459+0000","last_undegraded":"2023-10-07T09:05:09.306459+0000","last_fullsized":"2023-10-07T09:05:09.306459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:24.669368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941299+0000","last_change":"2023-10-07T09:05:09.941299+0000","last_active":"2023-10-07T09:05:09.941299+0000","last_peered":"2023-10-07T09:05:09.941299+0000","last_clean":"2023-10-07T09:05:09.941299+0000","last_became_active":"2023-10-07T09:05:09.940995+0000","last_became_peered":"2023-10-07T09:05:09.940995+0000","last_unstale":"2023-10-07T09:05:09.941299+0000","last_undegraded":"2023-10-07T09:05:09.941299+0000","last_fullsized":"2023-10-07T09:05:09.941299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:31.153897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.309782+0000","last_change":"2023-10-07T09:05:09.305014+0000","last_active":"2023-10-07T09:05:09.309782+0000","last_peered":"2023-10-07T09:05:09.309782+0000","last_clean":"2023-10-07T09:05:09.309782+0000","last_became_active":"2023-10-07T09:05:09.304669+0000","last_became_peered":"2023-10-07T09:05:09.304669+0000","last_unstale":"2023-10-07T09:05:09.309782+0000","last_undegraded":"2023-10-07T09:05:09.309782+0000","last_fullsized":"2023-10-07T09:05:09.309782+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:37:35.252496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943781+0000","last_change":"2023-10-07T09:05:09.943781+0000","last_active":"2023-10-07T09:05:09.943781+0000","last_peered":"2023-10-07T09:05:09.943781+0000","last_clean":"2023-10-07T09:05:09.943781+0000","last_became_active":"2023-10-07T09:05:09.943518+0000","last_became_peered":"2023-10-07T09:05:09.943518+0000","last_unstale":"2023-10-07T09:05:09.943781+0000","last_undegraded":"2023-10-07T09:05:09.943781+0000","last_fullsized":"2023-10-07T09:05:09.943781+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:23:19.203362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308035+0000","last_change":"2023-10-07T09:05:09.304145+0000","last_active":"2023-10-07T09:05:09.308035+0000","last_peered":"2023-10-07T09:05:09.308035+0000","last_clean":"2023-10-07T09:05:09.308035+0000","last_became_active":"2023-10-07T09:05:09.303835+0000","last_became_peered":"2023-10-07T09:05:09.303835+0000","last_unstale":"2023-10-07T09:05:09.308035+0000","last_undegraded":"2023-10-07T09:05:09.308035+0000","last_fullsized":"2023-10-07T09:05:09.308035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:45.548892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943009+0000","last_change":"2023-10-07T09:05:09.943009+0000","last_active":"2023-10-07T09:05:09.943009+0000","last_peered":"2023-10-07T09:05:09.943009+0000","last_clean":"2023-10-07T09:05:09.943009+0000","last_became_active":"2023-10-07T09:05:09.942758+0000","last_became_peered":"2023-10-07T09:05:09.942758+0000","last_unstale":"2023-10-07T09:05:09.943009+0000","last_undegraded":"2023-10-07T09:05:09.943009+0000","last_fullsized":"2023-10-07T09:05:09.943009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:30.641053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.311788+0000","last_change":"2023-10-07T09:05:09.311232+0000","last_active":"2023-10-07T09:05:09.311788+0000","last_peered":"2023-10-07T09:05:09.311788+0000","last_clean":"2023-10-07T09:05:09.311788+0000","last_became_active":"2023-10-07T09:05:09.310953+0000","last_became_peered":"2023-10-07T09:05:09.310953+0000","last_unstale":"2023-10-07T09:05:09.311788+0000","last_undegraded":"2023-10-07T09:05:09.311788+0000","last_fullsized":"2023-10-07T09:05:09.311788+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:25.207732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942504+0000","last_change":"2023-10-07T09:05:09.942504+0000","last_active":"2023-10-07T09:05:09.942504+0000","last_peered":"2023-10-07T09:05:09.942504+0000","last_clean":"2023-10-07T09:05:09.942504+0000","last_became_active":"2023-10-07T09:05:09.942185+0000","last_became_peered":"2023-10-07T09:05:09.942185+0000","last_unstale":"2023-10-07T09:05:09.942504+0000","last_undegraded":"2023-10-07T09:05:09.942504+0000","last_fullsized":"2023-10-07T09:05:09.942504+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:55.920963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301668+0000","last_change":"2023-10-07T09:05:09.306172+0000","last_active":"2023-10-07T09:05:10.301668+0000","last_peered":"2023-10-07T09:05:10.301668+0000","last_clean":"2023-10-07T09:05:10.301668+0000","last_became_active":"2023-10-07T09:05:09.305811+0000","last_became_peered":"2023-10-07T09:05:09.305811+0000","last_unstale":"2023-10-07T09:05:10.301668+0000","last_undegraded":"2023-10-07T09:05:10.301668+0000","last_fullsized":"2023-10-07T09:05:10.301668+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:48.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":244,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.294481+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:05:09.294481+0000","last_peered":"2023-10-07T09:05:09.294481+0000","last_clean":"2023-10-07T09:05:09.294481+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:05:09.294481+0000","last_undegraded":"2023-10-07T09:05:09.294481+0000","last_fullsized":"2023-10-07T09:05:09.294481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1202210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.48799999999999999},"min":{"1min":0.437,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69999999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.377},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":611232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439}]},{"osd":2,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":1.29},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54900000000000004,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.878,"15min":4.0880000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.60899999999999999},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.502,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54100000000000004,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.85899999999999999,"15min":0.86199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57299999999999995,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.504}]},{"osd":7,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.91000000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.63},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":1.3859999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.68300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.78900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":0.81799999999999995,"15min":11.32},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.81100000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.79300000000000004,"15min":11.880000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":0.69099999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.72299999999999998},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":4.4850000000000003},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.80800000000000005},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.90000000000000002,"15min":5.3540000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.63400000000000001,"15min":0.82699999999999996},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":5.3920000000000003},"last":0.625}]},{"osd":7,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":4.5209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1200064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47799999999999998,"5min":0.501,"15min":0.54500000000000004},"last":0.251},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.29399999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.58999999999999997,"15min":0.61199999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.38900000000000001},"min":{"1min":0.252,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.56699999999999995,"15min":0.625},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.35399999999999998},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.57899999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.91700000000000004,"15min":0.95399999999999996},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0249999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.89300000000000002,"15min":1},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.66000000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":1.006},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.68000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":1.0389999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.31900000000000001,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":10.214},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.60099999999999998,"15min":0.755},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.67800000000000005},"min":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":10.144},"last":0.29699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.73599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.628,"5min":0.755,"15min":10.071},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.752},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":10.183},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.93500000000000005,"15min":1.1579999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.87,"15min":1.0549999999999999},"last":0.442}]},{"osd":5,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":1.181},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":20.922000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.96399999999999997,"15min":1.0880000000000001},"last":0.36599999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.375},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.624,"15min":1.232},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75,"5min":0.97199999999999998,"15min":20.963999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.373,"15min":0.42699999999999999},"min":{"1min":0.254,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47499999999999998,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.749},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.435,"5min":5.4269999999999996,"15min":12.038},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33900000000000002,"15min":0.435},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.46899999999999997},"min":{"1min":0.26800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44400000000000001,"5min":2.1389999999999998,"15min":2.3380000000000001},"last":0.375}]},{"osd":2,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.376,"15min":0.60399999999999998},"min":{"1min":0.27200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.495,"5min":1.859,"15min":6.1230000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.47099999999999997,"5min":0.64700000000000002,"15min":1.2330000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.92600000000000005},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":1.0189999999999999,"15min":11.933999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58199999999999996,"15min":0.67000000000000004},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.77700000000000002,"5min":1.9059999999999999,"15min":2.081},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78600000000000003,"5min":1.9379999999999999,"15min":2.1099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57799999999999996,"15min":0.66200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.86599999999999999,"15min":2.1960000000000002},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.97999999999999998},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80100000000000005,"5min":0.997,"15min":12.007},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63500000000000001,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.9670000000000001,"15min":2.0459999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61899999999999999,"15min":0.70499999999999996},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.997},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.67400000000000004,"5min":0.96799999999999997,"15min":11.973000000000001},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":609766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.84699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":9.7040000000000006},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.73599999999999999},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":3.024,"15min":5.6319999999999997},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":9.8620000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.93700000000000006},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.976,"15min":9.8439999999999994},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.90500000000000003},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.93400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.78000000000000003,"15min":10.01},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":5.569},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":0.751,"15min":10.131},"last":0.63}]},{"osd":5,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46899999999999997,"15min":0.51400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.83599999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64500000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.5,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.82199999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85499999999999998},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298676,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073164,"statfs":{"total":96636764160,"available":96330919936,"internally_reserved":0,"allocated":1421312,"data_stored":609808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.317},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.76700000000000002,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.65700000000000003,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.7799999999999994,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.3970000000000002,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.61699999999999999,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.5650000000000004,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.438}]},{"osd":3,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.501}]},{"osd":4,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92900000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50600000000000001,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.67100000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.29799999999999999},"max":{"1min":0.95999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:05:14.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:05:14.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.555+0000 7fd793b93700 1 Processor -- start 2023-10-07T09:05:14.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.555+0000 7fd793b93700 1 -- start start 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd793b93700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd78c159890 0x7fd78c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd793b93700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 0x7fd78c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd793b93700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c069ee0 con 0x7fd78c159c60 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd793b93700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c15a160 con 0x7fd78c159890 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd793b93700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0d13a0 con 0x7fd78c069560 2023-10-07T09:05:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd78c159890 0x7fd78c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd78c159890 0x7fd78c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34918/0 (socket says 172.21.15.46:34918) 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 -- 172.21.15.46:0/1010190888 learned_addr learned my addr 172.21.15.46:0/1010190888 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 -- 172.21.15.46:0/1010190888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 msgr2=0x7fd78c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd792130700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 0x7fd78c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 0x7fd78c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 -- 172.21.15.46:0/1010190888 >> v1:172.21.15.133:6789/0 conn(0x7fd78c159c60 legacy=0x7fd78c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 -- 172.21.15.46:0/1010190888 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c15e140 con 0x7fd78c159890 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd792130700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 0x7fd78c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79192f700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c15abd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099b0 tx=0x7fd788009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ee4deee8c47e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.556+0000 7fd79092d700 1 -- 172.21.15.46:0/1010190888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800b820 con 0x7fd78c159890 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd79092d700 1 -- 172.21.15.46:0/1010190888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78800b980 con 0x7fd78c159890 2023-10-07T09:05:14.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd79092d700 1 -- 172.21.15.46:0/1010190888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800bd20 con 0x7fd78c159890 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 -- 172.21.15.46:0/1010190888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 msgr2=0x7fd78c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c15abd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099b0 tx=0x7fd788009250 comp rx=0 tx=0).stop 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 -- 172.21.15.46:0/1010190888 shutdown_connections 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c069560 0x7fd78c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 --2- 172.21.15.46:0/1010190888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c15abd0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 -- 172.21.15.46:0/1010190888 >> 172.21.15.46:0/1010190888 conn(0x7fd78c068e20 msgr2=0x7fd78c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 -- 172.21.15.46:0/1010190888 shutdown_connections 2023-10-07T09:05:14.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.557+0000 7fd793b93700 1 -- 172.21.15.46:0/1010190888 wait complete. 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.558+0000 7fd793b93700 1 Processor -- start 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.558+0000 7fd793b93700 1 -- start start 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd78c069560 0x7fd78c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c159c60 0x7fd78c169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0b6470 con 0x7fd78c159890 2023-10-07T09:05:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c7fa0 con 0x7fd78c069560 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd793b93700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c8280 con 0x7fd78c159c60 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34924/0 (socket says 172.21.15.46:34924) 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 -- 172.21.15.46:0/2349493541 learned_addr learned my addr 172.21.15.46:0/2349493541 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79192f700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd78c069560 0x7fd78c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd792130700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c159c60 0x7fd78c169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 -- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c159c60 msgr2=0x7fd78c169ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c159c60 0x7fd78c169ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 -- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd78c069560 msgr2=0x7fd78c0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd78c069560 0x7fd78c0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.559+0000 7fd79112e700 1 -- 172.21.15.46:0/2349493541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880094f0 con 0x7fd78c159890 2023-10-07T09:05:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd79112e700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c5d0 tx=0x7fd77c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c011590 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c011710 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c011ad0 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c0c8560 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.560+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0b4290 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.561+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c0b44b0 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.561+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd77c01c460 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.561+0000 7fd781ffb700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 0x7fd7700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.562+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd77c084930 con 0x7fd78c159890 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.562+0000 7fd79192f700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 0x7fd7700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.562+0000 7fd79192f700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 0x7fd7700697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099b0 tx=0x7fd788016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.566+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd77c0515c0 con 0x7fd78c159890 2023-10-07T09:05:14.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.753+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd78c04c3c0 con 0x7fd770067320 2023-10-07T09:05:14.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.762+0000 7fd781ffb700 1 -- 172.21.15.46:0/2349493541 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289701 (secure 0 0 0) 0x7fd78c04c3c0 con 0x7fd770067320 2023-10-07T09:05:14.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 msgr2=0x7fd7700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 0x7fd7700697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099b0 tx=0x7fd788016000 comp rx=0 tx=0).stop 2023-10-07T09:05:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 msgr2=0x7fd78c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c5d0 tx=0x7fd77c007f60 comp rx=0 tx=0).stop 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 shutdown_connections 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd770067320 0x7fd7700697d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd78c159c60 0x7fd78c169ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd78c069560 0x7fd78c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 --2- 172.21.15.46:0/2349493541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd78c159890 0x7fd78c158540 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 >> 172.21.15.46:0/2349493541 conn(0x7fd78c068e20 msgr2=0x7fd78c153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 shutdown_connections 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.765+0000 7fd793b93700 1 -- 172.21.15.46:0/2349493541 wait complete. 2023-10-07T09:05:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:05:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-10-07T09:05:13.859025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415128,"kb_used_data":12248,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752559592,"statfs":{"total":773094113280,"available":770621022208,"internally_reserved":0,"allocated":12541952,"data_stored":6062168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578158"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950214+0000","last_change":"2023-10-07T09:05:09.950214+0000","last_active":"2023-10-07T09:05:09.950214+0000","last_peered":"2023-10-07T09:05:09.950214+0000","last_clean":"2023-10-07T09:05:09.950214+0000","last_became_active":"2023-10-07T09:05:09.949907+0000","last_became_peered":"2023-10-07T09:05:09.949907+0000","last_unstale":"2023-10-07T09:05:09.950214+0000","last_undegraded":"2023-10-07T09:05:09.950214+0000","last_fullsized":"2023-10-07T09:05:09.950214+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:54.542870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948651+0000","last_change":"2023-10-07T09:05:09.948651+0000","last_active":"2023-10-07T09:05:09.948651+0000","last_peered":"2023-10-07T09:05:09.948651+0000","last_clean":"2023-10-07T09:05:09.948651+0000","last_became_active":"2023-10-07T09:05:09.948230+0000","last_became_peered":"2023-10-07T09:05:09.948230+0000","last_unstale":"2023-10-07T09:05:09.948651+0000","last_undegraded":"2023-10-07T09:05:09.948651+0000","last_fullsized":"2023-10-07T09:05:09.948651+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:03:24.820715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942318+0000","last_change":"2023-10-07T09:05:09.942318+0000","last_active":"2023-10-07T09:05:09.942318+0000","last_peered":"2023-10-07T09:05:09.942318+0000","last_clean":"2023-10-07T09:05:09.942318+0000","last_became_active":"2023-10-07T09:05:09.942067+0000","last_became_peered":"2023-10-07T09:05:09.942067+0000","last_unstale":"2023-10-07T09:05:09.942318+0000","last_undegraded":"2023-10-07T09:05:09.942318+0000","last_fullsized":"2023-10-07T09:05:09.942318+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:07:38.876445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.939944+0000","last_change":"2023-10-07T09:05:09.939944+0000","last_active":"2023-10-07T09:05:09.939944+0000","last_peered":"2023-10-07T09:05:09.939944+0000","last_clean":"2023-10-07T09:05:09.939944+0000","last_became_active":"2023-10-07T09:05:09.939681+0000","last_became_peered":"2023-10-07T09:05:09.939681+0000","last_unstale":"2023-10-07T09:05:09.939944+0000","last_undegraded":"2023-10-07T09:05:09.939944+0000","last_fullsized":"2023-10-07T09:05:09.939944+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:58:26.083245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945865+0000","last_change":"2023-10-07T09:05:09.945865+0000","last_active":"2023-10-07T09:05:09.945865+0000","last_peered":"2023-10-07T09:05:09.945865+0000","last_clean":"2023-10-07T09:05:09.945865+0000","last_became_active":"2023-10-07T09:05:09.945299+0000","last_became_peered":"2023-10-07T09:05:09.945299+0000","last_unstale":"2023-10-07T09:05:09.945865+0000","last_undegraded":"2023-10-07T09:05:09.945865+0000","last_fullsized":"2023-10-07T09:05:09.945865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:14.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.940339+0000","last_change":"2023-10-07T09:05:09.940339+0000","last_active":"2023-10-07T09:05:09.940339+0000","last_peered":"2023-10-07T09:05:09.940339+0000","last_clean":"2023-10-07T09:05:09.940339+0000","last_became_active":"2023-10-07T09:05:09.940019+0000","last_became_peered":"2023-10-07T09:05:09.940019+0000","last_unstale":"2023-10-07T09:05:09.940339+0000","last_undegraded":"2023-10-07T09:05:09.940339+0000","last_fullsized":"2023-10-07T09:05:09.940339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:06.930956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.944960+0000","last_change":"2023-10-07T09:05:09.944960+0000","last_active":"2023-10-07T09:05:09.944960+0000","last_peered":"2023-10-07T09:05:09.944960+0000","last_clean":"2023-10-07T09:05:09.944960+0000","last_became_active":"2023-10-07T09:05:09.944646+0000","last_became_peered":"2023-10-07T09:05:09.944646+0000","last_unstale":"2023-10-07T09:05:09.944960+0000","last_undegraded":"2023-10-07T09:05:09.944960+0000","last_fullsized":"2023-10-07T09:05:09.944960+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:38.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943844+0000","last_change":"2023-10-07T09:05:09.943844+0000","last_active":"2023-10-07T09:05:09.943844+0000","last_peered":"2023-10-07T09:05:09.943844+0000","last_clean":"2023-10-07T09:05:09.943844+0000","last_became_active":"2023-10-07T09:05:09.943169+0000","last_became_peered":"2023-10-07T09:05:09.943169+0000","last_unstale":"2023-10-07T09:05:09.943844+0000","last_undegraded":"2023-10-07T09:05:09.943844+0000","last_fullsized":"2023-10-07T09:05:09.943844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:49.610681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.949466+0000","last_change":"2023-10-07T09:05:09.949466+0000","last_active":"2023-10-07T09:05:09.949466+0000","last_peered":"2023-10-07T09:05:09.949466+0000","last_clean":"2023-10-07T09:05:09.949466+0000","last_became_active":"2023-10-07T09:05:09.949196+0000","last_became_peered":"2023-10-07T09:05:09.949196+0000","last_unstale":"2023-10-07T09:05:09.949466+0000","last_undegraded":"2023-10-07T09:05:09.949466+0000","last_fullsized":"2023-10-07T09:05:09.949466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948480+0000","last_change":"2023-10-07T09:05:09.948480+0000","last_active":"2023-10-07T09:05:09.948480+0000","last_peered":"2023-10-07T09:05:09.948480+0000","last_clean":"2023-10-07T09:05:09.948480+0000","last_became_active":"2023-10-07T09:05:09.947921+0000","last_became_peered":"2023-10-07T09:05:09.947921+0000","last_unstale":"2023-10-07T09:05:09.948480+0000","last_undegraded":"2023-10-07T09:05:09.948480+0000","last_fullsized":"2023-10-07T09:05:09.948480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:35.410635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.932473+0000","last_change":"2023-10-07T09:05:09.932473+0000","last_active":"2023-10-07T09:05:09.932473+0000","last_peered":"2023-10-07T09:05:09.932473+0000","last_clean":"2023-10-07T09:05:09.932473+0000","last_became_active":"2023-10-07T09:05:09.932226+0000","last_became_peered":"2023-10-07T09:05:09.932226+0000","last_unstale":"2023-10-07T09:05:09.932473+0000","last_undegraded":"2023-10-07T09:05:09.932473+0000","last_fullsized":"2023-10-07T09:05:09.932473+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:48:01.457963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945961+0000","last_change":"2023-10-07T09:05:09.945961+0000","last_active":"2023-10-07T09:05:09.945961+0000","last_peered":"2023-10-07T09:05:09.945961+0000","last_clean":"2023-10-07T09:05:09.945961+0000","last_became_active":"2023-10-07T09:05:09.945544+0000","last_became_peered":"2023-10-07T09:05:09.945544+0000","last_unstale":"2023-10-07T09:05:09.945961+0000","last_undegraded":"2023-10-07T09:05:09.945961+0000","last_fullsized":"2023-10-07T09:05:09.945961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:38.432993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947819+0000","last_change":"2023-10-07T09:05:09.947819+0000","last_active":"2023-10-07T09:05:09.947819+0000","last_peered":"2023-10-07T09:05:09.947819+0000","last_clean":"2023-10-07T09:05:09.947819+0000","last_became_active":"2023-10-07T09:05:09.947493+0000","last_became_peered":"2023-10-07T09:05:09.947493+0000","last_unstale":"2023-10-07T09:05:09.947819+0000","last_undegraded":"2023-10-07T09:05:09.947819+0000","last_fullsized":"2023-10-07T09:05:09.947819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:11.597983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933989+0000","last_change":"2023-10-07T09:05:09.933989+0000","last_active":"2023-10-07T09:05:09.933989+0000","last_peered":"2023-10-07T09:05:09.933989+0000","last_clean":"2023-10-07T09:05:09.933989+0000","last_became_active":"2023-10-07T09:05:09.933748+0000","last_became_peered":"2023-10-07T09:05:09.933748+0000","last_unstale":"2023-10-07T09:05:09.933989+0000","last_undegraded":"2023-10-07T09:05:09.933989+0000","last_fullsized":"2023-10-07T09:05:09.933989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:42.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943588+0000","last_change":"2023-10-07T09:05:09.943588+0000","last_active":"2023-10-07T09:05:09.943588+0000","last_peered":"2023-10-07T09:05:09.943588+0000","last_clean":"2023-10-07T09:05:09.943588+0000","last_became_active":"2023-10-07T09:05:09.943231+0000","last_became_peered":"2023-10-07T09:05:09.943231+0000","last_unstale":"2023-10-07T09:05:09.943588+0000","last_undegraded":"2023-10-07T09:05:09.943588+0000","last_fullsized":"2023-10-07T09:05:09.943588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:52.506759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935681+0000","last_change":"2023-10-07T09:05:09.935681+0000","last_active":"2023-10-07T09:05:09.935681+0000","last_peered":"2023-10-07T09:05:09.935681+0000","last_clean":"2023-10-07T09:05:09.935681+0000","last_became_active":"2023-10-07T09:05:09.935449+0000","last_became_peered":"2023-10-07T09:05:09.935449+0000","last_unstale":"2023-10-07T09:05:09.935681+0000","last_undegraded":"2023-10-07T09:05:09.935681+0000","last_fullsized":"2023-10-07T09:05:09.935681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:34.129398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946633+0000","last_change":"2023-10-07T09:05:09.946633+0000","last_active":"2023-10-07T09:05:09.946633+0000","last_peered":"2023-10-07T09:05:09.946633+0000","last_clean":"2023-10-07T09:05:09.946633+0000","last_became_active":"2023-10-07T09:05:09.946359+0000","last_became_peered":"2023-10-07T09:05:09.946359+0000","last_unstale":"2023-10-07T09:05:09.946633+0000","last_undegraded":"2023-10-07T09:05:09.946633+0000","last_fullsized":"2023-10-07T09:05:09.946633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947491+0000","last_change":"2023-10-07T09:05:09.947491+0000","last_active":"2023-10-07T09:05:09.947491+0000","last_peered":"2023-10-07T09:05:09.947491+0000","last_clean":"2023-10-07T09:05:09.947491+0000","last_became_active":"2023-10-07T09:05:09.947191+0000","last_became_peered":"2023-10-07T09:05:09.947191+0000","last_unstale":"2023-10-07T09:05:09.947491+0000","last_undegraded":"2023-10-07T09:05:09.947491+0000","last_fullsized":"2023-10-07T09:05:09.947491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:04.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.949832+0000","last_change":"2023-10-07T09:05:09.949832+0000","last_active":"2023-10-07T09:05:09.949832+0000","last_peered":"2023-10-07T09:05:09.949832+0000","last_clean":"2023-10-07T09:05:09.949832+0000","last_became_active":"2023-10-07T09:05:09.949582+0000","last_became_peered":"2023-10-07T09:05:09.949582+0000","last_unstale":"2023-10-07T09:05:09.949832+0000","last_undegraded":"2023-10-07T09:05:09.949832+0000","last_fullsized":"2023-10-07T09:05:09.949832+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:33.976186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.936091+0000","last_change":"2023-10-07T09:05:09.936091+0000","last_active":"2023-10-07T09:05:09.936091+0000","last_peered":"2023-10-07T09:05:09.936091+0000","last_clean":"2023-10-07T09:05:09.936091+0000","last_became_active":"2023-10-07T09:05:09.935839+0000","last_became_peered":"2023-10-07T09:05:09.935839+0000","last_unstale":"2023-10-07T09:05:09.936091+0000","last_undegraded":"2023-10-07T09:05:09.936091+0000","last_fullsized":"2023-10-07T09:05:09.936091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:14.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946022+0000","last_change":"2023-10-07T09:05:09.946022+0000","last_active":"2023-10-07T09:05:09.946022+0000","last_peered":"2023-10-07T09:05:09.946022+0000","last_clean":"2023-10-07T09:05:09.946022+0000","last_became_active":"2023-10-07T09:05:09.945625+0000","last_became_peered":"2023-10-07T09:05:09.945625+0000","last_unstale":"2023-10-07T09:05:09.946022+0000","last_undegraded":"2023-10-07T09:05:09.946022+0000","last_fullsized":"2023-10-07T09:05:09.946022+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:48.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933283+0000","last_change":"2023-10-07T09:05:09.933283+0000","last_active":"2023-10-07T09:05:09.933283+0000","last_peered":"2023-10-07T09:05:09.933283+0000","last_clean":"2023-10-07T09:05:09.933283+0000","last_became_active":"2023-10-07T09:05:09.933038+0000","last_became_peered":"2023-10-07T09:05:09.933038+0000","last_unstale":"2023-10-07T09:05:09.933283+0000","last_undegraded":"2023-10-07T09:05:09.933283+0000","last_fullsized":"2023-10-07T09:05:09.933283+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:45.145636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946501+0000","last_change":"2023-10-07T09:05:09.946501+0000","last_active":"2023-10-07T09:05:09.946501+0000","last_peered":"2023-10-07T09:05:09.946501+0000","last_clean":"2023-10-07T09:05:09.946501+0000","last_became_active":"2023-10-07T09:05:09.946243+0000","last_became_peered":"2023-10-07T09:05:09.946243+0000","last_unstale":"2023-10-07T09:05:09.946501+0000","last_undegraded":"2023-10-07T09:05:09.946501+0000","last_fullsized":"2023-10-07T09:05:09.946501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:38.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942439+0000","last_change":"2023-10-07T09:05:09.942439+0000","last_active":"2023-10-07T09:05:09.942439+0000","last_peered":"2023-10-07T09:05:09.942439+0000","last_clean":"2023-10-07T09:05:09.942439+0000","last_became_active":"2023-10-07T09:05:09.942140+0000","last_became_peered":"2023-10-07T09:05:09.942140+0000","last_unstale":"2023-10-07T09:05:09.942439+0000","last_undegraded":"2023-10-07T09:05:09.942439+0000","last_fullsized":"2023-10-07T09:05:09.942439+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:37:18.166872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943267+0000","last_change":"2023-10-07T09:05:09.943267+0000","last_active":"2023-10-07T09:05:09.943267+0000","last_peered":"2023-10-07T09:05:09.943267+0000","last_clean":"2023-10-07T09:05:09.943267+0000","last_became_active":"2023-10-07T09:05:09.942711+0000","last_became_peered":"2023-10-07T09:05:09.942711+0000","last_unstale":"2023-10-07T09:05:09.943267+0000","last_undegraded":"2023-10-07T09:05:09.943267+0000","last_fullsized":"2023-10-07T09:05:09.943267+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:36.882878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935286+0000","last_change":"2023-10-07T09:05:09.935286+0000","last_active":"2023-10-07T09:05:09.935286+0000","last_peered":"2023-10-07T09:05:09.935286+0000","last_clean":"2023-10-07T09:05:09.935286+0000","last_became_active":"2023-10-07T09:05:09.935004+0000","last_became_peered":"2023-10-07T09:05:09.935004+0000","last_unstale":"2023-10-07T09:05:09.935286+0000","last_undegraded":"2023-10-07T09:05:09.935286+0000","last_fullsized":"2023-10-07T09:05:09.935286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:45.871000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950123+0000","last_change":"2023-10-07T09:05:09.950123+0000","last_active":"2023-10-07T09:05:09.950123+0000","last_peered":"2023-10-07T09:05:09.950123+0000","last_clean":"2023-10-07T09:05:09.950123+0000","last_became_active":"2023-10-07T09:05:09.949870+0000","last_became_peered":"2023-10-07T09:05:09.949870+0000","last_unstale":"2023-10-07T09:05:09.950123+0000","last_undegraded":"2023-10-07T09:05:09.950123+0000","last_fullsized":"2023-10-07T09:05:09.950123+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:22.505906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941674+0000","last_change":"2023-10-07T09:05:09.941674+0000","last_active":"2023-10-07T09:05:09.941674+0000","last_peered":"2023-10-07T09:05:09.941674+0000","last_clean":"2023-10-07T09:05:09.941674+0000","last_became_active":"2023-10-07T09:05:09.941283+0000","last_became_peered":"2023-10-07T09:05:09.941283+0000","last_unstale":"2023-10-07T09:05:09.941674+0000","last_undegraded":"2023-10-07T09:05:09.941674+0000","last_fullsized":"2023-10-07T09:05:09.941674+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:52:40.630123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945255+0000","last_change":"2023-10-07T09:05:09.945255+0000","last_active":"2023-10-07T09:05:09.945255+0000","last_peered":"2023-10-07T09:05:09.945255+0000","last_clean":"2023-10-07T09:05:09.945255+0000","last_became_active":"2023-10-07T09:05:09.944633+0000","last_became_peered":"2023-10-07T09:05:09.944633+0000","last_unstale":"2023-10-07T09:05:09.945255+0000","last_undegraded":"2023-10-07T09:05:09.945255+0000","last_fullsized":"2023-10-07T09:05:09.945255+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:25.673932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942423+0000","last_change":"2023-10-07T09:05:09.942423+0000","last_active":"2023-10-07T09:05:09.942423+0000","last_peered":"2023-10-07T09:05:09.942423+0000","last_clean":"2023-10-07T09:05:09.942423+0000","last_became_active":"2023-10-07T09:05:09.942227+0000","last_became_peered":"2023-10-07T09:05:09.942227+0000","last_unstale":"2023-10-07T09:05:09.942423+0000","last_undegraded":"2023-10-07T09:05:09.942423+0000","last_fullsized":"2023-10-07T09:05:09.942423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:09.723396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948043+0000","last_change":"2023-10-07T09:05:09.948043+0000","last_active":"2023-10-07T09:05:09.948043+0000","last_peered":"2023-10-07T09:05:09.948043+0000","last_clean":"2023-10-07T09:05:09.948043+0000","last_became_active":"2023-10-07T09:05:09.947755+0000","last_became_peered":"2023-10-07T09:05:09.947755+0000","last_unstale":"2023-10-07T09:05:09.948043+0000","last_undegraded":"2023-10-07T09:05:09.948043+0000","last_fullsized":"2023-10-07T09:05:09.948043+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:45.871000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.940390+0000","last_change":"2023-10-07T09:05:09.940390+0000","last_active":"2023-10-07T09:05:09.940390+0000","last_peered":"2023-10-07T09:05:09.940390+0000","last_clean":"2023-10-07T09:05:09.940390+0000","last_became_active":"2023-10-07T09:05:09.940121+0000","last_became_peered":"2023-10-07T09:05:09.940121+0000","last_unstale":"2023-10-07T09:05:09.940390+0000","last_undegraded":"2023-10-07T09:05:09.940390+0000","last_fullsized":"2023-10-07T09:05:09.940390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:38.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941596+0000","last_change":"2023-10-07T09:05:09.941596+0000","last_active":"2023-10-07T09:05:09.941596+0000","last_peered":"2023-10-07T09:05:09.941596+0000","last_clean":"2023-10-07T09:05:09.941596+0000","last_became_active":"2023-10-07T09:05:09.941407+0000","last_became_peered":"2023-10-07T09:05:09.941407+0000","last_unstale":"2023-10-07T09:05:09.941596+0000","last_undegraded":"2023-10-07T09:05:09.941596+0000","last_fullsized":"2023-10-07T09:05:09.941596+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:24.135531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301877+0000","last_change":"2023-10-07T09:05:09.305665+0000","last_active":"2023-10-07T09:05:10.301877+0000","last_peered":"2023-10-07T09:05:10.301877+0000","last_clean":"2023-10-07T09:05:10.301877+0000","last_became_active":"2023-10-07T09:05:09.305229+0000","last_became_peered":"2023-10-07T09:05:09.305229+0000","last_unstale":"2023-10-07T09:05:10.301877+0000","last_undegraded":"2023-10-07T09:05:10.301877+0000","last_fullsized":"2023-10-07T09:05:10.301877+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:42.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942384+0000","last_change":"2023-10-07T09:05:09.942384+0000","last_active":"2023-10-07T09:05:09.942384+0000","last_peered":"2023-10-07T09:05:09.942384+0000","last_clean":"2023-10-07T09:05:09.942384+0000","last_became_active":"2023-10-07T09:05:09.942063+0000","last_became_peered":"2023-10-07T09:05:09.942063+0000","last_unstale":"2023-10-07T09:05:09.942384+0000","last_undegraded":"2023-10-07T09:05:09.942384+0000","last_fullsized":"2023-10-07T09:05:09.942384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933913+0000","last_change":"2023-10-07T09:05:09.305954+0000","last_active":"2023-10-07T09:05:09.933913+0000","last_peered":"2023-10-07T09:05:09.933913+0000","last_clean":"2023-10-07T09:05:09.933913+0000","last_became_active":"2023-10-07T09:05:09.305673+0000","last_became_peered":"2023-10-07T09:05:09.305673+0000","last_unstale":"2023-10-07T09:05:09.933913+0000","last_undegraded":"2023-10-07T09:05:09.933913+0000","last_fullsized":"2023-10-07T09:05:09.933913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:51.502195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.948187+0000","last_change":"2023-10-07T09:05:09.948187+0000","last_active":"2023-10-07T09:05:09.948187+0000","last_peered":"2023-10-07T09:05:09.948187+0000","last_clean":"2023-10-07T09:05:09.948187+0000","last_became_active":"2023-10-07T09:05:09.947902+0000","last_became_peered":"2023-10-07T09:05:09.947902+0000","last_unstale":"2023-10-07T09:05:09.948187+0000","last_undegraded":"2023-10-07T09:05:09.948187+0000","last_fullsized":"2023-10-07T09:05:09.948187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:17.208471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.300935+0000","last_change":"2023-10-07T09:05:09.304902+0000","last_active":"2023-10-07T09:05:10.300935+0000","last_peered":"2023-10-07T09:05:10.300935+0000","last_clean":"2023-10-07T09:05:10.300935+0000","last_became_active":"2023-10-07T09:05:09.304586+0000","last_became_peered":"2023-10-07T09:05:09.304586+0000","last_unstale":"2023-10-07T09:05:10.300935+0000","last_undegraded":"2023-10-07T09:05:10.300935+0000","last_fullsized":"2023-10-07T09:05:10.300935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:16:02.277882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942722+0000","last_change":"2023-10-07T09:05:09.942722+0000","last_active":"2023-10-07T09:05:09.942722+0000","last_peered":"2023-10-07T09:05:09.942722+0000","last_clean":"2023-10-07T09:05:09.942722+0000","last_became_active":"2023-10-07T09:05:09.942333+0000","last_became_peered":"2023-10-07T09:05:09.942333+0000","last_unstale":"2023-10-07T09:05:09.942722+0000","last_undegraded":"2023-10-07T09:05:09.942722+0000","last_fullsized":"2023-10-07T09:05:09.942722+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:24.113664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301175+0000","last_change":"2023-10-07T09:05:09.303606+0000","last_active":"2023-10-07T09:05:10.301175+0000","last_peered":"2023-10-07T09:05:10.301175+0000","last_clean":"2023-10-07T09:05:10.301175+0000","last_became_active":"2023-10-07T09:05:09.303335+0000","last_became_peered":"2023-10-07T09:05:09.303335+0000","last_unstale":"2023-10-07T09:05:10.301175+0000","last_undegraded":"2023-10-07T09:05:10.301175+0000","last_fullsized":"2023-10-07T09:05:10.301175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:08.159442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947344+0000","last_change":"2023-10-07T09:05:09.947344+0000","last_active":"2023-10-07T09:05:09.947344+0000","last_peered":"2023-10-07T09:05:09.947344+0000","last_clean":"2023-10-07T09:05:09.947344+0000","last_became_active":"2023-10-07T09:05:09.947076+0000","last_became_peered":"2023-10-07T09:05:09.947076+0000","last_unstale":"2023-10-07T09:05:09.947344+0000","last_undegraded":"2023-10-07T09:05:09.947344+0000","last_fullsized":"2023-10-07T09:05:09.947344+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:55.920963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.925467+0000","last_change":"2023-10-07T09:05:09.305346+0000","last_active":"2023-10-07T09:05:09.925467+0000","last_peered":"2023-10-07T09:05:09.925467+0000","last_clean":"2023-10-07T09:05:09.925467+0000","last_became_active":"2023-10-07T09:05:09.304687+0000","last_became_peered":"2023-10-07T09:05:09.304687+0000","last_unstale":"2023-10-07T09:05:09.925467+0000","last_undegraded":"2023-10-07T09:05:09.925467+0000","last_fullsized":"2023-10-07T09:05:09.925467+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:53.538306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946789+0000","last_change":"2023-10-07T09:05:09.946789+0000","last_active":"2023-10-07T09:05:09.946789+0000","last_peered":"2023-10-07T09:05:09.946789+0000","last_clean":"2023-10-07T09:05:09.946789+0000","last_became_active":"2023-10-07T09:05:09.946291+0000","last_became_peered":"2023-10-07T09:05:09.946291+0000","last_unstale":"2023-10-07T09:05:09.946789+0000","last_undegraded":"2023-10-07T09:05:09.946789+0000","last_fullsized":"2023-10-07T09:05:09.946789+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.931520+0000","last_change":"2023-10-07T09:05:09.304524+0000","last_active":"2023-10-07T09:05:09.931520+0000","last_peered":"2023-10-07T09:05:09.931520+0000","last_clean":"2023-10-07T09:05:09.931520+0000","last_became_active":"2023-10-07T09:05:09.304248+0000","last_became_peered":"2023-10-07T09:05:09.304248+0000","last_unstale":"2023-10-07T09:05:09.931520+0000","last_undegraded":"2023-10-07T09:05:09.931520+0000","last_fullsized":"2023-10-07T09:05:09.931520+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:23.109100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943754+0000","last_change":"2023-10-07T09:05:09.943754+0000","last_active":"2023-10-07T09:05:09.943754+0000","last_peered":"2023-10-07T09:05:09.943754+0000","last_clean":"2023-10-07T09:05:09.943754+0000","last_became_active":"2023-10-07T09:05:09.943286+0000","last_became_peered":"2023-10-07T09:05:09.943286+0000","last_unstale":"2023-10-07T09:05:09.943754+0000","last_undegraded":"2023-10-07T09:05:09.943754+0000","last_fullsized":"2023-10-07T09:05:09.943754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:26:43.273034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.312631+0000","last_change":"2023-10-07T09:05:09.307981+0000","last_active":"2023-10-07T09:05:09.312631+0000","last_peered":"2023-10-07T09:05:09.312631+0000","last_clean":"2023-10-07T09:05:09.312631+0000","last_became_active":"2023-10-07T09:05:09.307718+0000","last_became_peered":"2023-10-07T09:05:09.307718+0000","last_unstale":"2023-10-07T09:05:09.312631+0000","last_undegraded":"2023-10-07T09:05:09.312631+0000","last_fullsized":"2023-10-07T09:05:09.312631+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:27.189541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935530+0000","last_change":"2023-10-07T09:05:09.935530+0000","last_active":"2023-10-07T09:05:09.935530+0000","last_peered":"2023-10-07T09:05:09.935530+0000","last_clean":"2023-10-07T09:05:09.935530+0000","last_became_active":"2023-10-07T09:05:09.935246+0000","last_became_peered":"2023-10-07T09:05:09.935246+0000","last_unstale":"2023-10-07T09:05:09.935530+0000","last_undegraded":"2023-10-07T09:05:09.935530+0000","last_fullsized":"2023-10-07T09:05:09.935530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:50.341466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.307965+0000","last_change":"2023-10-07T09:05:09.307309+0000","last_active":"2023-10-07T09:05:09.307965+0000","last_peered":"2023-10-07T09:05:09.307965+0000","last_clean":"2023-10-07T09:05:09.307965+0000","last_became_active":"2023-10-07T09:05:09.307047+0000","last_became_peered":"2023-10-07T09:05:09.307047+0000","last_unstale":"2023-10-07T09:05:09.307965+0000","last_undegraded":"2023-10-07T09:05:09.307965+0000","last_fullsized":"2023-10-07T09:05:09.307965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:15.291394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.934127+0000","last_change":"2023-10-07T09:05:09.934127+0000","last_active":"2023-10-07T09:05:09.934127+0000","last_peered":"2023-10-07T09:05:09.934127+0000","last_clean":"2023-10-07T09:05:09.934127+0000","last_became_active":"2023-10-07T09:05:09.933878+0000","last_became_peered":"2023-10-07T09:05:09.933878+0000","last_unstale":"2023-10-07T09:05:09.934127+0000","last_undegraded":"2023-10-07T09:05:09.934127+0000","last_fullsized":"2023-10-07T09:05:09.934127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:23:06.935872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.304108+0000","last_change":"2023-10-07T09:05:09.299366+0000","last_active":"2023-10-07T09:05:09.304108+0000","last_peered":"2023-10-07T09:05:09.304108+0000","last_clean":"2023-10-07T09:05:09.304108+0000","last_became_active":"2023-10-07T09:05:09.299065+0000","last_became_peered":"2023-10-07T09:05:09.299065+0000","last_unstale":"2023-10-07T09:05:09.304108+0000","last_undegraded":"2023-10-07T09:05:09.304108+0000","last_fullsized":"2023-10-07T09:05:09.304108+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:56:51.194643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947403+0000","last_change":"2023-10-07T09:05:09.947403+0000","last_active":"2023-10-07T09:05:09.947403+0000","last_peered":"2023-10-07T09:05:09.947403+0000","last_clean":"2023-10-07T09:05:09.947403+0000","last_became_active":"2023-10-07T09:05:09.945109+0000","last_became_peered":"2023-10-07T09:05:09.945109+0000","last_unstale":"2023-10-07T09:05:09.947403+0000","last_undegraded":"2023-10-07T09:05:09.947403+0000","last_fullsized":"2023-10-07T09:05:09.947403+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:22.099524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308045+0000","last_change":"2023-10-07T09:05:09.303680+0000","last_active":"2023-10-07T09:05:09.308045+0000","last_peered":"2023-10-07T09:05:09.308045+0000","last_clean":"2023-10-07T09:05:09.308045+0000","last_became_active":"2023-10-07T09:05:09.303306+0000","last_became_peered":"2023-10-07T09:05:09.303306+0000","last_unstale":"2023-10-07T09:05:09.308045+0000","last_undegraded":"2023-10-07T09:05:09.308045+0000","last_fullsized":"2023-10-07T09:05:09.308045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:06.230004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947401+0000","last_change":"2023-10-07T09:05:09.947401+0000","last_active":"2023-10-07T09:05:09.947401+0000","last_peered":"2023-10-07T09:05:09.947401+0000","last_clean":"2023-10-07T09:05:09.947401+0000","last_became_active":"2023-10-07T09:05:09.947133+0000","last_became_peered":"2023-10-07T09:05:09.947133+0000","last_unstale":"2023-10-07T09:05:09.947401+0000","last_undegraded":"2023-10-07T09:05:09.947401+0000","last_fullsized":"2023-10-07T09:05:09.947401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:46:02.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302551+0000","last_change":"2023-10-07T09:05:09.304544+0000","last_active":"2023-10-07T09:05:10.302551+0000","last_peered":"2023-10-07T09:05:10.302551+0000","last_clean":"2023-10-07T09:05:10.302551+0000","last_became_active":"2023-10-07T09:05:09.304298+0000","last_became_peered":"2023-10-07T09:05:09.304298+0000","last_unstale":"2023-10-07T09:05:10.302551+0000","last_undegraded":"2023-10-07T09:05:10.302551+0000","last_fullsized":"2023-10-07T09:05:10.302551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:53.538306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946760+0000","last_change":"2023-10-07T09:05:09.946760+0000","last_active":"2023-10-07T09:05:09.946760+0000","last_peered":"2023-10-07T09:05:09.946760+0000","last_clean":"2023-10-07T09:05:09.946760+0000","last_became_active":"2023-10-07T09:05:09.946445+0000","last_became_peered":"2023-10-07T09:05:09.946445+0000","last_unstale":"2023-10-07T09:05:09.946760+0000","last_undegraded":"2023-10-07T09:05:09.946760+0000","last_fullsized":"2023-10-07T09:05:09.946760+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:14.859462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.304912+0000","last_change":"2023-10-07T09:05:09.309041+0000","last_active":"2023-10-07T09:05:10.304912+0000","last_peered":"2023-10-07T09:05:10.304912+0000","last_clean":"2023-10-07T09:05:10.304912+0000","last_became_active":"2023-10-07T09:05:09.308789+0000","last_became_peered":"2023-10-07T09:05:09.308789+0000","last_unstale":"2023-10-07T09:05:10.304912+0000","last_undegraded":"2023-10-07T09:05:10.304912+0000","last_fullsized":"2023-10-07T09:05:10.304912+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:08:21.094959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.932807+0000","last_change":"2023-10-07T09:05:09.932807+0000","last_active":"2023-10-07T09:05:09.932807+0000","last_peered":"2023-10-07T09:05:09.932807+0000","last_clean":"2023-10-07T09:05:09.932807+0000","last_became_active":"2023-10-07T09:05:09.932548+0000","last_became_peered":"2023-10-07T09:05:09.932548+0000","last_unstale":"2023-10-07T09:05:09.932807+0000","last_undegraded":"2023-10-07T09:05:09.932807+0000","last_fullsized":"2023-10-07T09:05:09.932807+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:16.295959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308375+0000","last_change":"2023-10-07T09:05:09.307663+0000","last_active":"2023-10-07T09:05:09.308375+0000","last_peered":"2023-10-07T09:05:09.308375+0000","last_clean":"2023-10-07T09:05:09.308375+0000","last_became_active":"2023-10-07T09:05:09.307394+0000","last_became_peered":"2023-10-07T09:05:09.307394+0000","last_unstale":"2023-10-07T09:05:09.308375+0000","last_undegraded":"2023-10-07T09:05:09.308375+0000","last_fullsized":"2023-10-07T09:05:09.308375+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:26:02.180799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.945160+0000","last_change":"2023-10-07T09:05:09.945160+0000","last_active":"2023-10-07T09:05:09.945160+0000","last_peered":"2023-10-07T09:05:09.945160+0000","last_clean":"2023-10-07T09:05:09.945160+0000","last_became_active":"2023-10-07T09:05:09.944910+0000","last_became_peered":"2023-10-07T09:05:09.944910+0000","last_unstale":"2023-10-07T09:05:09.945160+0000","last_undegraded":"2023-10-07T09:05:09.945160+0000","last_fullsized":"2023-10-07T09:05:09.945160+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.306388+0000","last_change":"2023-10-07T09:05:09.304942+0000","last_active":"2023-10-07T09:05:09.306388+0000","last_peered":"2023-10-07T09:05:09.306388+0000","last_clean":"2023-10-07T09:05:09.306388+0000","last_became_active":"2023-10-07T09:05:09.304655+0000","last_became_peered":"2023-10-07T09:05:09.304655+0000","last_unstale":"2023-10-07T09:05:09.306388+0000","last_undegraded":"2023-10-07T09:05:09.306388+0000","last_fullsized":"2023-10-07T09:05:09.306388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:08.718832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947128+0000","last_change":"2023-10-07T09:05:09.947128+0000","last_active":"2023-10-07T09:05:09.947128+0000","last_peered":"2023-10-07T09:05:09.947128+0000","last_clean":"2023-10-07T09:05:09.947128+0000","last_became_active":"2023-10-07T09:05:09.946727+0000","last_became_peered":"2023-10-07T09:05:09.946727+0000","last_unstale":"2023-10-07T09:05:09.947128+0000","last_undegraded":"2023-10-07T09:05:09.947128+0000","last_fullsized":"2023-10-07T09:05:09.947128+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302051+0000","last_change":"2023-10-07T09:05:09.308679+0000","last_active":"2023-10-07T09:05:10.302051+0000","last_peered":"2023-10-07T09:05:10.302051+0000","last_clean":"2023-10-07T09:05:10.302051+0000","last_became_active":"2023-10-07T09:05:09.308402+0000","last_became_peered":"2023-10-07T09:05:09.308402+0000","last_unstale":"2023-10-07T09:05:10.302051+0000","last_undegraded":"2023-10-07T09:05:10.302051+0000","last_fullsized":"2023-10-07T09:05:10.302051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:30.149333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943204+0000","last_change":"2023-10-07T09:05:09.943204+0000","last_active":"2023-10-07T09:05:09.943204+0000","last_peered":"2023-10-07T09:05:09.943204+0000","last_clean":"2023-10-07T09:05:09.943204+0000","last_became_active":"2023-10-07T09:05:09.942907+0000","last_became_peered":"2023-10-07T09:05:09.942907+0000","last_unstale":"2023-10-07T09:05:09.943204+0000","last_undegraded":"2023-10-07T09:05:09.943204+0000","last_fullsized":"2023-10-07T09:05:09.943204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:38.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.934564+0000","last_change":"2023-10-07T09:05:09.308012+0000","last_active":"2023-10-07T09:05:09.934564+0000","last_peered":"2023-10-07T09:05:09.934564+0000","last_clean":"2023-10-07T09:05:09.934564+0000","last_became_active":"2023-10-07T09:05:09.307752+0000","last_became_peered":"2023-10-07T09:05:09.307752+0000","last_unstale":"2023-10-07T09:05:09.934564+0000","last_undegraded":"2023-10-07T09:05:09.934564+0000","last_fullsized":"2023-10-07T09:05:09.934564+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:53:29.498506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947561+0000","last_change":"2023-10-07T09:05:09.947561+0000","last_active":"2023-10-07T09:05:09.947561+0000","last_peered":"2023-10-07T09:05:09.947561+0000","last_clean":"2023-10-07T09:05:09.947561+0000","last_became_active":"2023-10-07T09:05:09.945464+0000","last_became_peered":"2023-10-07T09:05:09.945464+0000","last_unstale":"2023-10-07T09:05:09.947561+0000","last_undegraded":"2023-10-07T09:05:09.947561+0000","last_fullsized":"2023-10-07T09:05:09.947561+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:42.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.298996+0000","last_change":"2023-10-07T09:05:09.310916+0000","last_active":"2023-10-07T09:05:10.298996+0000","last_peered":"2023-10-07T09:05:10.298996+0000","last_clean":"2023-10-07T09:05:10.298996+0000","last_became_active":"2023-10-07T09:05:09.307474+0000","last_became_peered":"2023-10-07T09:05:09.307474+0000","last_unstale":"2023-10-07T09:05:10.298996+0000","last_undegraded":"2023-10-07T09:05:10.298996+0000","last_fullsized":"2023-10-07T09:05:10.298996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:58.529514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.936034+0000","last_change":"2023-10-07T09:05:09.936034+0000","last_active":"2023-10-07T09:05:09.936034+0000","last_peered":"2023-10-07T09:05:09.936034+0000","last_clean":"2023-10-07T09:05:09.936034+0000","last_became_active":"2023-10-07T09:05:09.935166+0000","last_became_peered":"2023-10-07T09:05:09.935166+0000","last_unstale":"2023-10-07T09:05:09.936034+0000","last_undegraded":"2023-10-07T09:05:09.936034+0000","last_fullsized":"2023-10-07T09:05:09.936034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:14.859462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.937559+0000","last_change":"2023-10-07T09:05:09.304544+0000","last_active":"2023-10-07T09:05:09.937559+0000","last_peered":"2023-10-07T09:05:09.937559+0000","last_clean":"2023-10-07T09:05:09.937559+0000","last_became_active":"2023-10-07T09:05:09.304268+0000","last_became_peered":"2023-10-07T09:05:09.304268+0000","last_unstale":"2023-10-07T09:05:09.937559+0000","last_undegraded":"2023-10-07T09:05:09.937559+0000","last_fullsized":"2023-10-07T09:05:09.937559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:02.617047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.935496+0000","last_change":"2023-10-07T09:05:09.935496+0000","last_active":"2023-10-07T09:05:09.935496+0000","last_peered":"2023-10-07T09:05:09.935496+0000","last_clean":"2023-10-07T09:05:09.935496+0000","last_became_active":"2023-10-07T09:05:09.935236+0000","last_became_peered":"2023-10-07T09:05:09.935236+0000","last_unstale":"2023-10-07T09:05:09.935496+0000","last_undegraded":"2023-10-07T09:05:09.935496+0000","last_fullsized":"2023-10-07T09:05:09.935496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:06.930956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.309985+0000","last_change":"2023-10-07T09:05:09.306176+0000","last_active":"2023-10-07T09:05:09.309985+0000","last_peered":"2023-10-07T09:05:09.309985+0000","last_clean":"2023-10-07T09:05:09.309985+0000","last_became_active":"2023-10-07T09:05:09.305895+0000","last_became_peered":"2023-10-07T09:05:09.305895+0000","last_unstale":"2023-10-07T09:05:09.309985+0000","last_undegraded":"2023-10-07T09:05:09.309985+0000","last_fullsized":"2023-10-07T09:05:09.309985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:48:08.718832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.947735+0000","last_change":"2023-10-07T09:05:09.947735+0000","last_active":"2023-10-07T09:05:09.947735+0000","last_peered":"2023-10-07T09:05:09.947735+0000","last_clean":"2023-10-07T09:05:09.947735+0000","last_became_active":"2023-10-07T09:05:09.947453+0000","last_became_peered":"2023-10-07T09:05:09.947453+0000","last_unstale":"2023-10-07T09:05:09.947735+0000","last_undegraded":"2023-10-07T09:05:09.947735+0000","last_fullsized":"2023-10-07T09:05:09.947735+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:09.164006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.302546+0000","last_change":"2023-10-07T09:05:09.300079+0000","last_active":"2023-10-07T09:05:10.302546+0000","last_peered":"2023-10-07T09:05:10.302546+0000","last_clean":"2023-10-07T09:05:10.302546+0000","last_became_active":"2023-10-07T09:05:09.299817+0000","last_became_peered":"2023-10-07T09:05:09.299817+0000","last_unstale":"2023-10-07T09:05:10.302546+0000","last_undegraded":"2023-10-07T09:05:10.302546+0000","last_fullsized":"2023-10-07T09:05:10.302546+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:24.669368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946579+0000","last_change":"2023-10-07T09:05:09.946579+0000","last_active":"2023-10-07T09:05:09.946579+0000","last_peered":"2023-10-07T09:05:09.946579+0000","last_clean":"2023-10-07T09:05:09.946579+0000","last_became_active":"2023-10-07T09:05:09.945933+0000","last_became_peered":"2023-10-07T09:05:09.945933+0000","last_unstale":"2023-10-07T09:05:09.946579+0000","last_undegraded":"2023-10-07T09:05:09.946579+0000","last_fullsized":"2023-10-07T09:05:09.946579+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:34:04.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308205+0000","last_change":"2023-10-07T09:05:09.306559+0000","last_active":"2023-10-07T09:05:09.308205+0000","last_peered":"2023-10-07T09:05:09.308205+0000","last_clean":"2023-10-07T09:05:09.308205+0000","last_became_active":"2023-10-07T09:05:09.306239+0000","last_became_peered":"2023-10-07T09:05:09.306239+0000","last_unstale":"2023-10-07T09:05:09.308205+0000","last_undegraded":"2023-10-07T09:05:09.308205+0000","last_fullsized":"2023-10-07T09:05:09.308205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:37:42.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.933257+0000","last_change":"2023-10-07T09:05:09.933257+0000","last_active":"2023-10-07T09:05:09.933257+0000","last_peered":"2023-10-07T09:05:09.933257+0000","last_clean":"2023-10-07T09:05:09.933257+0000","last_became_active":"2023-10-07T09:05:09.933008+0000","last_became_peered":"2023-10-07T09:05:09.933008+0000","last_unstale":"2023-10-07T09:05:09.933257+0000","last_undegraded":"2023-10-07T09:05:09.933257+0000","last_fullsized":"2023-10-07T09:05:09.933257+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:40:47.544516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308015+0000","last_change":"2023-10-07T09:05:09.303494+0000","last_active":"2023-10-07T09:05:09.308015+0000","last_peered":"2023-10-07T09:05:09.308015+0000","last_clean":"2023-10-07T09:05:09.308015+0000","last_became_active":"2023-10-07T09:05:09.303227+0000","last_became_peered":"2023-10-07T09:05:09.303227+0000","last_unstale":"2023-10-07T09:05:09.308015+0000","last_undegraded":"2023-10-07T09:05:09.308015+0000","last_fullsized":"2023-10-07T09:05:09.308015+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:11.888357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942522+0000","last_change":"2023-10-07T09:05:09.942522+0000","last_active":"2023-10-07T09:05:09.942522+0000","last_peered":"2023-10-07T09:05:09.942522+0000","last_clean":"2023-10-07T09:05:09.942522+0000","last_became_active":"2023-10-07T09:05:09.942226+0000","last_became_peered":"2023-10-07T09:05:09.942226+0000","last_unstale":"2023-10-07T09:05:09.942522+0000","last_undegraded":"2023-10-07T09:05:09.942522+0000","last_fullsized":"2023-10-07T09:05:09.942522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:30.330250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.311799+0000","last_change":"2023-10-07T09:05:09.311251+0000","last_active":"2023-10-07T09:05:09.311799+0000","last_peered":"2023-10-07T09:05:09.311799+0000","last_clean":"2023-10-07T09:05:09.311799+0000","last_became_active":"2023-10-07T09:05:09.310941+0000","last_became_peered":"2023-10-07T09:05:09.310941+0000","last_unstale":"2023-10-07T09:05:09.311799+0000","last_undegraded":"2023-10-07T09:05:09.311799+0000","last_fullsized":"2023-10-07T09:05:09.311799+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:31.874341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946443+0000","last_change":"2023-10-07T09:05:09.946443+0000","last_active":"2023-10-07T09:05:09.946443+0000","last_peered":"2023-10-07T09:05:09.946443+0000","last_clean":"2023-10-07T09:05:09.946443+0000","last_became_active":"2023-10-07T09:05:09.945960+0000","last_became_peered":"2023-10-07T09:05:09.945960+0000","last_unstale":"2023-10-07T09:05:09.946443+0000","last_undegraded":"2023-10-07T09:05:09.946443+0000","last_fullsized":"2023-10-07T09:05:09.946443+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:35.410635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.299830+0000","last_change":"2023-10-07T09:05:09.303145+0000","last_active":"2023-10-07T09:05:10.299830+0000","last_peered":"2023-10-07T09:05:10.299830+0000","last_clean":"2023-10-07T09:05:10.299830+0000","last_became_active":"2023-10-07T09:05:09.302876+0000","last_became_peered":"2023-10-07T09:05:09.302876+0000","last_unstale":"2023-10-07T09:05:10.299830+0000","last_undegraded":"2023-10-07T09:05:10.299830+0000","last_fullsized":"2023-10-07T09:05:10.299830+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:18:00.586724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.944419+0000","last_change":"2023-10-07T09:05:09.944419+0000","last_active":"2023-10-07T09:05:09.944419+0000","last_peered":"2023-10-07T09:05:09.944419+0000","last_clean":"2023-10-07T09:05:09.944419+0000","last_became_active":"2023-10-07T09:05:09.943745+0000","last_became_peered":"2023-10-07T09:05:09.943745+0000","last_unstale":"2023-10-07T09:05:09.944419+0000","last_undegraded":"2023-10-07T09:05:09.944419+0000","last_fullsized":"2023-10-07T09:05:09.944419+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:56:52.199207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.310001+0000","last_change":"2023-10-07T09:05:09.305556+0000","last_active":"2023-10-07T09:05:09.310001+0000","last_peered":"2023-10-07T09:05:09.310001+0000","last_clean":"2023-10-07T09:05:09.310001+0000","last_became_active":"2023-10-07T09:05:09.305272+0000","last_became_peered":"2023-10-07T09:05:09.305272+0000","last_unstale":"2023-10-07T09:05:09.310001+0000","last_undegraded":"2023-10-07T09:05:09.310001+0000","last_fullsized":"2023-10-07T09:05:09.310001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:37.428429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.939837+0000","last_change":"2023-10-07T09:05:09.939837+0000","last_active":"2023-10-07T09:05:09.939837+0000","last_peered":"2023-10-07T09:05:09.939837+0000","last_clean":"2023-10-07T09:05:09.939837+0000","last_became_active":"2023-10-07T09:05:09.939534+0000","last_became_peered":"2023-10-07T09:05:09.939534+0000","last_unstale":"2023-10-07T09:05:09.939837+0000","last_undegraded":"2023-10-07T09:05:09.939837+0000","last_fullsized":"2023-10-07T09:05:09.939837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:59:00.627830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.302616+0000","last_change":"2023-10-07T09:05:09.302211+0000","last_active":"2023-10-07T09:05:09.302616+0000","last_peered":"2023-10-07T09:05:09.302616+0000","last_clean":"2023-10-07T09:05:09.302616+0000","last_became_active":"2023-10-07T09:05:09.301940+0000","last_became_peered":"2023-10-07T09:05:09.301940+0000","last_unstale":"2023-10-07T09:05:09.302616+0000","last_undegraded":"2023-10-07T09:05:09.302616+0000","last_fullsized":"2023-10-07T09:05:09.302616+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:51.502195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.946496+0000","last_change":"2023-10-07T09:05:09.946496+0000","last_active":"2023-10-07T09:05:09.946496+0000","last_peered":"2023-10-07T09:05:09.946496+0000","last_clean":"2023-10-07T09:05:09.946496+0000","last_became_active":"2023-10-07T09:05:09.945930+0000","last_became_peered":"2023-10-07T09:05:09.945930+0000","last_unstale":"2023-10-07T09:05:09.946496+0000","last_undegraded":"2023-10-07T09:05:09.946496+0000","last_fullsized":"2023-10-07T09:05:09.946496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:59.719391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.303659+0000","last_change":"2023-10-07T09:05:09.299689+0000","last_active":"2023-10-07T09:05:09.303659+0000","last_peered":"2023-10-07T09:05:09.303659+0000","last_clean":"2023-10-07T09:05:09.303659+0000","last_became_active":"2023-10-07T09:05:09.299413+0000","last_became_peered":"2023-10-07T09:05:09.299413+0000","last_unstale":"2023-10-07T09:05:09.303659+0000","last_undegraded":"2023-10-07T09:05:09.303659+0000","last_fullsized":"2023-10-07T09:05:09.303659+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:25:22.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.950925+0000","last_change":"2023-10-07T09:05:09.950925+0000","last_active":"2023-10-07T09:05:09.950925+0000","last_peered":"2023-10-07T09:05:09.950925+0000","last_clean":"2023-10-07T09:05:09.950925+0000","last_became_active":"2023-10-07T09:05:09.950642+0000","last_became_peered":"2023-10-07T09:05:09.950642+0000","last_unstale":"2023-10-07T09:05:09.950925+0000","last_undegraded":"2023-10-07T09:05:09.950925+0000","last_fullsized":"2023-10-07T09:05:09.950925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:56.942469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.306459+0000","last_change":"2023-10-07T09:05:09.305550+0000","last_active":"2023-10-07T09:05:09.306459+0000","last_peered":"2023-10-07T09:05:09.306459+0000","last_clean":"2023-10-07T09:05:09.306459+0000","last_became_active":"2023-10-07T09:05:09.305068+0000","last_became_peered":"2023-10-07T09:05:09.305068+0000","last_unstale":"2023-10-07T09:05:09.306459+0000","last_undegraded":"2023-10-07T09:05:09.306459+0000","last_fullsized":"2023-10-07T09:05:09.306459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:24.669368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.941299+0000","last_change":"2023-10-07T09:05:09.941299+0000","last_active":"2023-10-07T09:05:09.941299+0000","last_peered":"2023-10-07T09:05:09.941299+0000","last_clean":"2023-10-07T09:05:09.941299+0000","last_became_active":"2023-10-07T09:05:09.940995+0000","last_became_peered":"2023-10-07T09:05:09.940995+0000","last_unstale":"2023-10-07T09:05:09.941299+0000","last_undegraded":"2023-10-07T09:05:09.941299+0000","last_fullsized":"2023-10-07T09:05:09.941299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:31.153897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.309782+0000","last_change":"2023-10-07T09:05:09.305014+0000","last_active":"2023-10-07T09:05:09.309782+0000","last_peered":"2023-10-07T09:05:09.309782+0000","last_clean":"2023-10-07T09:05:09.309782+0000","last_became_active":"2023-10-07T09:05:09.304669+0000","last_became_peered":"2023-10-07T09:05:09.304669+0000","last_unstale":"2023-10-07T09:05:09.309782+0000","last_undegraded":"2023-10-07T09:05:09.309782+0000","last_fullsized":"2023-10-07T09:05:09.309782+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:37:35.252496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943781+0000","last_change":"2023-10-07T09:05:09.943781+0000","last_active":"2023-10-07T09:05:09.943781+0000","last_peered":"2023-10-07T09:05:09.943781+0000","last_clean":"2023-10-07T09:05:09.943781+0000","last_became_active":"2023-10-07T09:05:09.943518+0000","last_became_peered":"2023-10-07T09:05:09.943518+0000","last_unstale":"2023-10-07T09:05:09.943781+0000","last_undegraded":"2023-10-07T09:05:09.943781+0000","last_fullsized":"2023-10-07T09:05:09.943781+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:23:19.203362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.308035+0000","last_change":"2023-10-07T09:05:09.304145+0000","last_active":"2023-10-07T09:05:09.308035+0000","last_peered":"2023-10-07T09:05:09.308035+0000","last_clean":"2023-10-07T09:05:09.308035+0000","last_became_active":"2023-10-07T09:05:09.303835+0000","last_became_peered":"2023-10-07T09:05:09.303835+0000","last_unstale":"2023-10-07T09:05:09.308035+0000","last_undegraded":"2023-10-07T09:05:09.308035+0000","last_fullsized":"2023-10-07T09:05:09.308035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:45.548892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.943009+0000","last_change":"2023-10-07T09:05:09.943009+0000","last_active":"2023-10-07T09:05:09.943009+0000","last_peered":"2023-10-07T09:05:09.943009+0000","last_clean":"2023-10-07T09:05:09.943009+0000","last_became_active":"2023-10-07T09:05:09.942758+0000","last_became_peered":"2023-10-07T09:05:09.942758+0000","last_unstale":"2023-10-07T09:05:09.943009+0000","last_undegraded":"2023-10-07T09:05:09.943009+0000","last_fullsized":"2023-10-07T09:05:09.943009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:30.641053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.311788+0000","last_change":"2023-10-07T09:05:09.311232+0000","last_active":"2023-10-07T09:05:09.311788+0000","last_peered":"2023-10-07T09:05:09.311788+0000","last_clean":"2023-10-07T09:05:09.311788+0000","last_became_active":"2023-10-07T09:05:09.310953+0000","last_became_peered":"2023-10-07T09:05:09.310953+0000","last_unstale":"2023-10-07T09:05:09.311788+0000","last_undegraded":"2023-10-07T09:05:09.311788+0000","last_fullsized":"2023-10-07T09:05:09.311788+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:25.207732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.942504+0000","last_change":"2023-10-07T09:05:09.942504+0000","last_active":"2023-10-07T09:05:09.942504+0000","last_peered":"2023-10-07T09:05:09.942504+0000","last_clean":"2023-10-07T09:05:09.942504+0000","last_became_active":"2023-10-07T09:05:09.942185+0000","last_became_peered":"2023-10-07T09:05:09.942185+0000","last_unstale":"2023-10-07T09:05:09.942504+0000","last_undegraded":"2023-10-07T09:05:09.942504+0000","last_fullsized":"2023-10-07T09:05:09.942504+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:09.279965+0000","last_clean_scrub_stamp":"2023-10-07T09:05:09.279965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:05:55.920963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-07T09:05:10.301668+0000","last_change":"2023-10-07T09:05:09.306172+0000","last_active":"2023-10-07T09:05:10.301668+0000","last_peered":"2023-10-07T09:05:10.301668+0000","last_clean":"2023-10-07T09:05:10.301668+0000","last_became_active":"2023-10-07T09:05:09.305811+0000","last_became_peered":"2023-10-07T09:05:09.305811+0000","last_unstale":"2023-10-07T09:05:10.301668+0000","last_undegraded":"2023-10-07T09:05:10.301668+0000","last_fullsized":"2023-10-07T09:05:10.301668+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:08.275401+0000","last_clean_scrub_stamp":"2023-10-07T09:05:08.275401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:48.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":244,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-07T09:05:09.294481+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:05:09.294481+0000","last_peered":"2023-10-07T09:05:09.294481+0000","last_clean":"2023-10-07T09:05:09.294481+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:05:09.294481+0000","last_undegraded":"2023-10-07T09:05:09.294481+0000","last_fullsized":"2023-10-07T09:05:09.294481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1202210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.48799999999999999},"min":{"1min":0.437,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69999999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.377},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":611232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439}]},{"osd":2,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":1.29},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54900000000000004,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.878,"15min":4.0880000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.60899999999999999},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.502,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54100000000000004,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.85899999999999999,"15min":0.86199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57299999999999995,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.504}]},{"osd":7,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.91000000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.33500000000000002},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.63},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":1.3859999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.68300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.78900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":0.81799999999999995,"15min":11.32},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.81100000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.79300000000000004,"15min":11.880000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":0.69099999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.72299999999999998},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":4.4850000000000003},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.80800000000000005},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.90000000000000002,"15min":5.3540000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.63400000000000001,"15min":0.82699999999999996},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":5.3920000000000003},"last":0.625}]},{"osd":7,"last update":"Sat Oct 7 09:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":4.5209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1200064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47799999999999998,"5min":0.501,"15min":0.54500000000000004},"last":0.251},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.29399999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.58999999999999997,"15min":0.61199999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.38900000000000001},"min":{"1min":0.252,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.56699999999999995,"15min":0.625},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.35399999999999998},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.57899999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.91700000000000004,"15min":0.95399999999999996},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0249999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.89300000000000002,"15min":1},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.66000000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":1.006},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.68000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80000000000000004,"5min":0.879,"15min":1.0389999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.31900000000000001,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":10.214},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.60099999999999998,"15min":0.755},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.67800000000000005},"min":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":10.144},"last":0.29699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.73599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.628,"5min":0.755,"15min":10.071},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.752},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":10.183},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.93500000000000005,"15min":1.1579999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.87,"15min":1.0549999999999999},"last":0.442}]},{"osd":5,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":1.181},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":20.922000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.96399999999999997,"15min":1.0880000000000001},"last":0.36599999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.375},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.624,"15min":1.232},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75,"5min":0.97199999999999998,"15min":20.963999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.373,"15min":0.42699999999999999},"min":{"1min":0.254,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47499999999999998,"5min":5.5709999999999997,"15min":5.5709999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.749},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.435,"5min":5.4269999999999996,"15min":12.038},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33900000000000002,"15min":0.435},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.46899999999999997},"min":{"1min":0.26800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44400000000000001,"5min":2.1389999999999998,"15min":2.3380000000000001},"last":0.375}]},{"osd":2,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.376,"15min":0.60399999999999998},"min":{"1min":0.27200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.495,"5min":1.859,"15min":6.1230000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.47099999999999997,"5min":0.64700000000000002,"15min":1.2330000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.92600000000000005},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":1.0189999999999999,"15min":11.933999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58199999999999996,"15min":0.67000000000000004},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.77700000000000002,"5min":1.9059999999999999,"15min":2.081},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78600000000000003,"5min":1.9379999999999999,"15min":2.1099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57799999999999996,"15min":0.66200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.86599999999999999,"15min":2.1960000000000002},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.97999999999999998},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80100000000000005,"5min":0.997,"15min":12.007},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63500000000000001,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.9670000000000001,"15min":2.0459999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61899999999999999,"15min":0.70499999999999996},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.997},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.67400000000000004,"5min":0.96799999999999997,"15min":11.973000000000001},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":609766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.84699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":9.7040000000000006},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.73599999999999999},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":3.024,"15min":5.6319999999999997},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":9.8620000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.93700000000000006},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.976,"15min":9.8439999999999994},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.90500000000000003},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.93400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.78000000000000003,"15min":10.01},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":5.569},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":0.751,"15min":10.131},"last":0.63}]},{"osd":5,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46899999999999997,"15min":0.51400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.83599999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64500000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.5,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.82199999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85499999999999998},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298676,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073164,"statfs":{"total":96636764160,"available":96330919936,"internally_reserved":0,"allocated":1421312,"data_stored":609808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.317},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.76700000000000002,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.65700000000000003,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.7799999999999994,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.3970000000000002,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.61699999999999999,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.5650000000000004,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.438}]},{"osd":3,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.501}]},{"osd":4,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92900000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50600000000000001,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.67100000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.29799999999999999},"max":{"1min":0.95999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:05:14.785 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:05:14.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:05:14.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.945+0000 7fd6c623c700 1 Processor -- start 2023-10-07T09:05:14.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.945+0000 7fd6c623c700 1 -- start start 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6c623c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6c623c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6c00af320 0x7fd6c0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6c623c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00ce380 con 0x7fd6c0069aa0 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6c623c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c0069f20 con 0x7fd6c00af320 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6c623c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00cec20 con 0x7fd6c0159950 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6c00af320 0x7fd6c0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6bffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6c0069aa0 0x7fd6c015d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53512/0 (socket says 172.21.15.46:53512) 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6bffff700 1 -- 172.21.15.46:0/1168994148 learned_addr learned my addr 172.21.15.46:0/1168994148 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6bf7fe700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 -- 172.21.15.46:0/1168994148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 msgr2=0x7fd6c00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 -- 172.21.15.46:0/1168994148 >> v1:172.21.15.46:6789/0 conn(0x7fd6c0069aa0 legacy=0x7fd6c015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6beffd700 1 -- 172.21.15.46:0/1168994148 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063655514 0 0) 0x7fd6c00ce380 con 0x7fd6c0069aa0 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 -- 172.21.15.46:0/1168994148 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00afa90 con 0x7fd6c00af320 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.946+0000 7fd6b7fff700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c0069560 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80098e0 tx=0x7fd6a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8c7d48aebc686 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6beffd700 1 -- 172.21.15.46:0/1168994148 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800b640 con 0x7fd6c00af320 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6beffd700 1 -- 172.21.15.46:0/1168994148 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800b7a0 con 0x7fd6c00af320 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6beffd700 1 -- 172.21.15.46:0/1168994148 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800bb40 con 0x7fd6c00af320 2023-10-07T09:05:14.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 -- 172.21.15.46:0/1168994148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 msgr2=0x7fd6c0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c0069560 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80098e0 tx=0x7fd6a80091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 -- 172.21.15.46:0/1168994148 shutdown_connections 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 --2- 172.21.15.46:0/1168994148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c0069560 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 -- 172.21.15.46:0/1168994148 >> 172.21.15.46:0/1168994148 conn(0x7fd6c0068e00 msgr2=0x7fd6c00d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 -- 172.21.15.46:0/1168994148 shutdown_connections 2023-10-07T09:05:14.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.947+0000 7fd6c623c700 1 -- 172.21.15.46:0/1168994148 wait complete. 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.948+0000 7fd6c623c700 1 Processor -- start 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.948+0000 7fd6c623c700 1 -- start start 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0069aa0 0x7fd6c016afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c0151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0152330 con 0x7fd6c00af320 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00b4520 con 0x7fd6c0069aa0 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6c623c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0152520 con 0x7fd6c0159950 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34942/0 (socket says 172.21.15.46:34942) 2023-10-07T09:05:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6b7fff700 1 -- 172.21.15.46:0/617605851 learned_addr learned my addr 172.21.15.46:0/617605851 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6bffff700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c0151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.949+0000 7fd6bf7fe700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0069aa0 0x7fd6c016afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 -- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 msgr2=0x7fd6c0151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c0151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 -- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0069aa0 msgr2=0x7fd6c016afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0069aa0 0x7fd6c016afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 -- 172.21.15.46:0/617605851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a8009420 con 0x7fd6c00af320 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b7fff700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80093f0 tx=0x7fd6a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800bb20 con 0x7fd6c00af320 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8000c90 con 0x7fd6c00af320 2023-10-07T09:05:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c00b4770 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011650 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.950+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c00b4d30 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.951+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c00718b0 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.951+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd6a8011a40 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.952+0000 7fd6b77fe700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 0x7fd6a0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.952+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6a8086090 con 0x7fd6c00af320 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.952+0000 7fd6bf7fe700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 0x7fd6a0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.952+0000 7fd6bf7fe700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 0x7fd6a0069800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0148520 tx=0x7fd6b00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:14.956+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6a8052d20 con 0x7fd6c00af320 2023-10-07T09:05:15.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.227+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd6c00ce5d0 con 0x7fd6c00af320 2023-10-07T09:05:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.230+0000 7fd6b77fe700 1 -- 172.21.15.46:0/617605851 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd6a8056340 con 0x7fd6c00af320 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 msgr2=0x7fd6a0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 0x7fd6a0069800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0148520 tx=0x7fd6b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 msgr2=0x7fd6c016a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80093f0 tx=0x7fd6a8017000 comp rx=0 tx=0).stop 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 shutdown_connections 2023-10-07T09:05:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6a0067350 0x7fd6a0069800 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6c0159950 0x7fd6c0151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0069aa0 0x7fd6c016afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 --2- 172.21.15.46:0/617605851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c00af320 0x7fd6c016a920 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 >> 172.21.15.46:0/617605851 conn(0x7fd6c0068e00 msgr2=0x7fd6c00c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 shutdown_connections 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.232+0000 7fd6c623c700 1 -- 172.21.15.46:0/617605851 wait complete. 2023-10-07T09:05:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:05:15.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:15.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.362+0000 7fa7dc1de700 1 Processor -- start 2023-10-07T09:05:15.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.363+0000 7fa7dc1de700 1 -- start start 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.363+0000 7fa7dc1de700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7d40caa90 0x7fa7d40c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.363+0000 7fa7dc1de700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d415d7e0 con 0x7fa7d406c0a0 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.363+0000 7fa7dc1de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d415dac0 con 0x7fa7d406bcd0 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.363+0000 7fa7dc1de700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40caef0 con 0x7fa7d40caa90 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7d40caa90 0x7fa7d40c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d9779700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7d406c0a0 0x7fa7d415df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53516/0 (socket says 172.21.15.46:53516) 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d9779700 1 -- 172.21.15.46:0/2894424920 learned_addr learned my addr 172.21.15.46:0/2894424920 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:15.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7d40caa90 0x7fa7d40c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34958/0 (socket says 172.21.15.46:34958) 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 -- 172.21.15.46:0/2894424920 >> v1:172.21.15.133:6789/0 conn(0x7fa7d406bcd0 legacy=0x7fa7d415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 -- 172.21.15.46:0/2894424920 >> v1:172.21.15.46:6789/0 conn(0x7fa7d406c0a0 legacy=0x7fa7d415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 -- 172.21.15.46:0/2894424920 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d415aa30 con 0x7fa7d40caa90 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d8f78700 1 -- 172.21.15.46:0/2894424920 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594532628 0 0) 0x7fa7d415d7e0 con 0x7fa7d406c0a0 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7da77b700 1 --2- 172.21.15.46:0/2894424920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d40c8c40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009e60 tx=0x7fa7c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10359d6a1f0d10eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d8f78700 1 -- 172.21.15.46:0/2894424920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400e070 con 0x7fa7d40caa90 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d8f78700 1 -- 172.21.15.46:0/2894424920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c400bc30 con 0x7fa7d40caa90 2023-10-07T09:05:15.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.364+0000 7fa7d8f78700 1 -- 172.21.15.46:0/2894424920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4012430 con 0x7fa7d40caa90 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 -- 172.21.15.46:0/2894424920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 msgr2=0x7fa7d40c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/2894424920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d40c8c40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009e60 tx=0x7fa7c4009780 comp rx=0 tx=0).stop 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 -- 172.21.15.46:0/2894424920 shutdown_connections 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/2894424920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d40c8c40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 -- 172.21.15.46:0/2894424920 >> 172.21.15.46:0/2894424920 conn(0x7fa7d40ce600 msgr2=0x7fa7d40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 -- 172.21.15.46:0/2894424920 shutdown_connections 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.365+0000 7fa7dc1de700 1 -- 172.21.15.46:0/2894424920 wait complete. 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.366+0000 7fa7dc1de700 1 Processor -- start 2023-10-07T09:05:15.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.366+0000 7fa7dc1de700 1 -- start start 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 0x7fa7d415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 0x7fa7d40c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b3370 con 0x7fa7d40caa90 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b3020 con 0x7fa7d406bcd0 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c69e0 con 0x7fa7d406c0a0 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:15.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34972/0 (socket says 172.21.15.46:34972) 2023-10-07T09:05:15.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 -- 172.21.15.46:0/4201972708 learned_addr learned my addr 172.21.15.46:0/4201972708 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:15.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d9779700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 0x7fa7d40c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:15.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d9f7a700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 0x7fa7d415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 -- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 msgr2=0x7fa7d40c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 0x7fa7d40c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 -- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 msgr2=0x7fa7d415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 0x7fa7d415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 -- 172.21.15.46:0/4201972708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4009a20 con 0x7fa7d40caa90 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d9f7a700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 0x7fa7d415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d9779700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 0x7fa7d40c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7da77b700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40099f0 tx=0x7fa7c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:15.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4012e80 con 0x7fa7d40caa90 2023-10-07T09:05:15.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c40032f0 con 0x7fa7d40caa90 2023-10-07T09:05:15.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d40c6cc0 con 0x7fa7d40caa90 2023-10-07T09:05:15.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.367+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c401b830 con 0x7fa7d40caa90 2023-10-07T09:05:15.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.368+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d415e390 con 0x7fa7d40caa90 2023-10-07T09:05:15.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.369+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d40b34e0 con 0x7fa7d40caa90 2023-10-07T09:05:15.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.369+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7c401bc20 con 0x7fa7d40caa90 2023-10-07T09:05:15.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.369+0000 7fa7d1ffb700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 0x7fa7c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:15.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.369+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7c4086b00 con 0x7fa7d40caa90 2023-10-07T09:05:15.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.370+0000 7fa7d9f7a700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 0x7fa7c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:15.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.370+0000 7fa7d9f7a700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 0x7fa7c00697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007fd0 tx=0x7fa7cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:15.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.374+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7c4088e60 con 0x7fa7d40caa90 2023-10-07T09:05:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.610+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d404c3c0 con 0x7fa7d40caa90 2023-10-07T09:05:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.610+0000 7fa7d1ffb700 1 -- 172.21.15.46:0/4201972708 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa7c4053680 con 0x7fa7d40caa90 2023-10-07T09:05:15.612 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:15.612 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/842316540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":842316540},{"type":"v1","addr":"172.21.15.133:6837","nonce":842316540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2721491248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2721491248},{"type":"v1","addr":"172.21.15.46:6834","nonce":2721491248}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 msgr2=0x7fa7c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 0x7fa7c00697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007fd0 tx=0x7fa7cc009040 comp rx=0 tx=0).stop 2023-10-07T09:05:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 msgr2=0x7fa7d4155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40099f0 tx=0x7fa7c4019000 comp rx=0 tx=0).stop 2023-10-07T09:05:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 shutdown_connections 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c0067320 0x7fa7c00697d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7d40caa90 0x7fa7d4155180 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d406bcd0 0x7fa7d415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 --2- 172.21.15.46:0/4201972708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7d406c0a0 0x7fa7d40c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 >> 172.21.15.46:0/4201972708 conn(0x7fa7d40ce600 msgr2=0x7fa7d415c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 shutdown_connections 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:15.612+0000 7fa7dc1de700 1 -- 172.21.15.46:0/4201972708 wait complete. 2023-10-07T09:05:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 74 2023-10-07T09:05:15.930 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-10-07T09:05:15.928+0000 7f4bf3a72700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:05:16.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:05:09.691451+0000', 'modified': '2023-10-07T09:05:13.307329+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7134}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7134': {'gid': 7134, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/2778859366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6833', 'nonce': 2778859366}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 2778859366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:05:16.029 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:05:16.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T09:05:16.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.151+0000 7f5c88420700 1 Processor -- start 2023-10-07T09:05:16.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.151+0000 7f5c88420700 1 -- start start 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c88420700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5c801566c0 0x7f5c80157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c88420700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c80156a90 0x7f5c8006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c88420700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c80157600 con 0x7f5c8006c4e0 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c88420700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8015a780 con 0x7f5c801566c0 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c88420700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8006c900 con 0x7f5c80156a90 2023-10-07T09:05:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5c801566c0 0x7f5c80157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c869bd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5c8006c4e0 0x7f5c800c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53518/0 (socket says 172.21.15.46:53518) 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c869bd700 1 -- 172.21.15.46:0/93950999 learned_addr learned my addr 172.21.15.46:0/93950999 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c859bb700 1 --2- 172.21.15.46:0/93950999 >> v2:172.21.15.133:3300/0 conn(0x7f5c80156a90 0x7f5c8006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c851ba700 1 -- 172.21.15.46:0/93950999 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073114729 0 0) 0x7f5c80157600 con 0x7f5c8006c4e0 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c851ba700 1 -- 172.21.15.46:0/93950999 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c68003570 con 0x7f5c8006c4e0 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 -- 172.21.15.46:0/93950999 >> v2:172.21.15.133:3300/0 conn(0x7f5c80156a90 msgr2=0x7f5c8006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 --2- 172.21.15.46:0/93950999 >> v2:172.21.15.133:3300/0 conn(0x7f5c80156a90 0x7f5c8006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 -- 172.21.15.46:0/93950999 >> v1:172.21.15.46:6789/0 conn(0x7f5c8006c4e0 legacy=0x7f5c800c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 -- 172.21.15.46:0/93950999 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800c9b10 con 0x7f5c801566c0 2023-10-07T09:05:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c861bc700 1 --2- 172.21.15.46:0/93950999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c80157a90 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5c800acdc0 tx=0x7f5c700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b19f09f1bac4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c851ba700 1 -- 172.21.15.46:0/93950999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011630 con 0x7f5c801566c0 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c851ba700 1 -- 172.21.15.46:0/93950999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70011790 con 0x7f5c801566c0 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.152+0000 7f5c851ba700 1 -- 172.21.15.46:0/93950999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011b30 con 0x7f5c801566c0 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 -- 172.21.15.46:0/93950999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 msgr2=0x7f5c80157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 --2- 172.21.15.46:0/93950999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c80157a90 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5c800acdc0 tx=0x7f5c700091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 -- 172.21.15.46:0/93950999 shutdown_connections 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 --2- 172.21.15.46:0/93950999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c80157a90 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 --2- 172.21.15.46:0/93950999 >> v2:172.21.15.133:3300/0 conn(0x7f5c80156a90 0x7f5c8006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 -- 172.21.15.46:0/93950999 >> 172.21.15.46:0/93950999 conn(0x7f5c8006b450 msgr2=0x7f5c800cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 -- 172.21.15.46:0/93950999 shutdown_connections 2023-10-07T09:05:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.153+0000 7f5c88420700 1 -- 172.21.15.46:0/93950999 wait complete. 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.154+0000 7f5c88420700 1 Processor -- start 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.154+0000 7f5c88420700 1 -- start start 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 0x7f5c80150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 0x7f5c80154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800ad470 con 0x7f5c801566c0 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800ad750 con 0x7f5c80156a90 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c88420700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800ada30 con 0x7f5c8006c4e0 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35000/0 (socket says 172.21.15.46:35000) 2023-10-07T09:05:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 -- 172.21.15.46:0/2821550903 learned_addr learned my addr 172.21.15.46:0/2821550903 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c869bd700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 0x7f5c80154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 0x7f5c80150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 -- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 msgr2=0x7f5c80150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 0x7f5c80150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 -- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 msgr2=0x7f5c80154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 0x7f5c80154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c859bb700 1 -- 172.21.15.46:0/2821550903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70009420 con 0x7f5c801566c0 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 0x7f5c80150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.155+0000 7f5c869bd700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 0x7f5c80154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c859bb700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5c74006b00 tx=0x7f5c74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c7e7fc700 1 -- 172.21.15.46:0/2821550903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740125f0 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c7e7fc700 1 -- 172.21.15.46:0/2821550903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74012770 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c7e7fc700 1 -- 172.21.15.46:0/2821550903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74012b30 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800add10 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.156+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c80150f60 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.158+0000 7f5c7e7fc700 1 -- 172.21.15.46:0/2821550903 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5c7401e460 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.158+0000 7f5c7e7fc700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 0x7f5c6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.158+0000 7f5c7e7fc700 1 -- 172.21.15.46:0/2821550903 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c740852b0 con 0x7f5c801566c0 2023-10-07T09:05:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.158+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 0x7f5c6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.159+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 0x7f5c6c0697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5c70003080 tx=0x7f5c70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 Processor -- start 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 -- start start 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3200e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3229a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.160+0000 7f5c91718b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3157a70 con 0x5604e3229f60 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3155270 con 0x5604e3200a50 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e3151060 con 0x5604e324ad00 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35008/0 (socket says 172.21.15.46:35008) 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 -- 172.21.15.46:0/3345364315 learned_addr learned my addr 172.21.15.46:0/3345364315 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c861bc700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3200e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c859bb700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3229a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 -- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 msgr2=0x5604e3229a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3229a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 -- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 msgr2=0x5604e3200e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3200e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 -- 172.21.15.46:0/3345364315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e2feb270 con 0x5604e3229f60 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c859bb700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3229a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c869bd700 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5c78002180 tx=0x7f5c78009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe24330c7c99fdef server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c677fe700 1 -- 172.21.15.46:0/3345364315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800b070 con 0x5604e3229f60 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c677fe700 1 -- 172.21.15.46:0/3345364315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800dd10 con 0x5604e3229f60 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.161+0000 7f5c677fe700 1 -- 172.21.15.46:0/3345364315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78013680 con 0x5604e3229f60 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 -- 172.21.15.46:0/3345364315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 msgr2=0x5604e31fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5c78002180 tx=0x7f5c78009040 comp rx=0 tx=0).stop 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 -- 172.21.15.46:0/3345364315 shutdown_connections 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e31fccf0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3200e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 --2- 172.21.15.46:0/3345364315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3229a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 -- 172.21.15.46:0/3345364315 >> 172.21.15.46:0/3345364315 conn(0x5604e3202370 msgr2=0x5604e3202740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 -- 172.21.15.46:0/3345364315 shutdown_connections 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.162+0000 7f5c91718b80 1 -- 172.21.15.46:0/3345364315 wait complete. 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.163+0000 7f5c91718b80 1 -- start start 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.163+0000 7f5c91718b80 1 Processor -- start 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3243540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3249a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e30fc890 con 0x5604e3229f60 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3117ea0 con 0x5604e3200a50 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e2fd3e30 con 0x5604e324ad00 2023-10-07T09:05:16.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 10 client.0 _ll_register_callbacks cb 0x5604e31c4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35010/0 (socket says 172.21.15.46:35010) 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 -- 172.21.15.46:0/1158113040 learned_addr learned my addr 172.21.15.46:0/1158113040 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3243540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c869bd700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3249a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 -- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 msgr2=0x5604e3249a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3249a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 -- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 msgr2=0x5604e3243540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3243540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 -- 172.21.15.46:0/1158113040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c68003570 con 0x5604e3229f60 2023-10-07T09:05:16.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5c74006e40 tx=0x7f5c74055a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82700788883f584c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74058e10 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604e31f5b70 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c7405cb60 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c74055e20 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 10 client.7278 fetch_fsmap learned FSMap version 74 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.164+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5604e2f8dfe0 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74081070 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c740550b0 con 0x5604e3229f60 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 10 client.7278 fetch_fsmap finished waiting for FSMap version 74 2023-10-07T09:05:16.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 10 client.7278 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 20 client.7278 populate_metadata read hostname 'smithi046' 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e31fbc50 0x5604e31fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 4 client.7278 mds_command: new command op to 7134 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 --> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604e31d2aa0 con 0x5604e31fbc50 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e31fbc50 0x5604e31fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c64ff9700 10 client.7278 ms_handle_connect on v2:172.21.15.46:6833/2778859366 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.165+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e31fbc50 0x5604e31fc020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b96b4f6f82c0888 server_cookie=f662dd754feaf355 in_seq=0 out_seq=0 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1158113040 <== mds.0 v2:172.21.15.46:6833/2778859366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5604e31d2aa0 con 0x5604e31fbc50 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c64ff9700 10 client.7278 handle_command_reply: tid=0 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 client.7278 shutdown 2023-10-07T09:05:16.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 msgr2=0x5604e3226060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5c74006e40 tx=0x7f5c74055a20 comp rx=0 tx=0).stop 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 shutdown_connections 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e31fbc50 0x5604e31fc020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e3249a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3200a50 0x5604e3243540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1158113040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3229f60 0x5604e3226060 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c64ff9700 0 client.7278 ms_handle_reset on v2:172.21.15.46:6833/2778859366 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 >> 172.21.15.46:0/1158113040 conn(0x5604e3202370 msgr2=0x5604e3201350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 shutdown_connections 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 1 -- 172.21.15.46:0/1158113040 wait complete. 2023-10-07T09:05:16.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.166+0000 7f5c91718b80 20 client.7278 trim_cache size 0 max 16384 2023-10-07T09:05:16.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.183+0000 7f5c91718b80 1 Processor -- start 2023-10-07T09:05:16.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.183+0000 7f5c91718b80 1 -- start start 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 0x5604e3242c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 0x5604e31fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3243d80 con 0x5604e3200a50 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3245c10 con 0x5604e324ad00 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e31f9560 con 0x5604e3229f60 2023-10-07T09:05:16.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35024/0 (socket says 172.21.15.46:35024) 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 -- 172.21.15.46:0/2563746456 learned_addr learned my addr 172.21.15.46:0/2563746456 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c869bd700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 0x5604e31fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c859bb700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 0x5604e3242c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 -- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 msgr2=0x5604e3242c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 0x5604e3242c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 -- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 msgr2=0x5604e31fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 0x5604e31fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c861bc700 1 -- 172.21.15.46:0/2563746456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e311f780 con 0x5604e3200a50 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c869bd700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 0x5604e31fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:16.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.184+0000 7f5c859bb700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 0x5604e3242c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c861bc700 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006eb0 tx=0x7f5c7002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3c705e4afa9023 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c67fff700 1 -- 172.21.15.46:0/2563746456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031070 con 0x5604e3200a50 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c67fff700 1 -- 172.21.15.46:0/2563746456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70032040 con 0x5604e3200a50 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c67fff700 1 -- 172.21.15.46:0/2563746456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70023070 con 0x5604e3200a50 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 -- 172.21.15.46:0/2563746456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 msgr2=0x5604e3241270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006eb0 tx=0x7f5c7002e040 comp rx=0 tx=0).stop 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 -- 172.21.15.46:0/2563746456 shutdown_connections 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e324ad00 0x5604e31fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e3241270 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 --2- 172.21.15.46:0/2563746456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e3229f60 0x5604e3242c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 -- 172.21.15.46:0/2563746456 >> 172.21.15.46:0/2563746456 conn(0x5604e3202370 msgr2=0x5604e3229450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 -- 172.21.15.46:0/2563746456 shutdown_connections 2023-10-07T09:05:16.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.185+0000 7f5c91718b80 1 -- 172.21.15.46:0/2563746456 wait complete. 2023-10-07T09:05:16.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.186+0000 7f5c91718b80 1 -- start start 2023-10-07T09:05:16.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.186+0000 7f5c91718b80 1 Processor -- start 2023-10-07T09:05:16.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3229f60 0x5604e328a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e31fd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e323d560 con 0x5604e3200a50 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e3259c20 con 0x5604e3229f60 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e323d760 con 0x5604e324ad00 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c91718b80 10 client.0 _ll_register_callbacks cb 0x5604e31c4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35036/0 (socket says 172.21.15.46:35036) 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 -- 172.21.15.46:0/1289770162 learned_addr learned my addr 172.21.15.46:0/1289770162 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3229f60 0x5604e328a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c869bd700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e31fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 -- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 msgr2=0x5604e31fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e31fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 -- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3229f60 msgr2=0x5604e328a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3229f60 0x5604e328a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 -- 172.21.15.46:0/1289770162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800c9b10 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c861bc700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5c700091e0 tx=0x7f5c70037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed53859657846694 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031070 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.187+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c70038a60 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c7800dd10 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c70023040 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 10 client.7284 fetch_fsmap learned FSMap version 74 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5604e3106470 con 0x5604e3200a50 2023-10-07T09:05:16.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800dd10 con 0x5604e3200a50 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c70041430 con 0x5604e3200a50 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 10 client.7284 fetch_fsmap finished waiting for FSMap version 74 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 10 client.7284 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 20 client.7284 populate_metadata read hostname 'smithi046' 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e3258d00 0x5604e32590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 4 client.7284 mds_command: new command op to 7134 tid=0[{"prefix": "status"}] 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 --> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604e30f3e00 con 0x5604e3258d00 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e3258d00 0x5604e32590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 10 client.7284 ms_handle_connect on v2:172.21.15.46:6833/2778859366 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c859bb700 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e3258d00 0x5604e32590d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5daba7a16a677fdd server_cookie=73b5156c9c5075cb in_seq=0 out_seq=0 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 1 -- 172.21.15.46:0/1289770162 <== mds.0 v2:172.21.15.46:6833/2778859366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5604e30f3e00 con 0x5604e3258d00 2023-10-07T09:05:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c64ff9700 10 client.7284 handle_command_reply: tid=0 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.188+0000 7f5c91718b80 1 client.7284 shutdown 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 msgr2=0x5604e32430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5c700091e0 tx=0x7f5c70037000 comp rx=0 tx=0).stop 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 shutdown_connections 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:6833/2778859366,v1:172.21.15.46:6835/2778859366] conn(0x5604e3258d00 0x5604e32590d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5604e324ad00 0x5604e31fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604e3200a50 0x5604e32430c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c64ff9700 0 client.7284 ms_handle_reset on v2:172.21.15.46:6833/2778859366 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 --2- 172.21.15.46:0/1289770162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604e3229f60 0x5604e328a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 >> 172.21.15.46:0/1289770162 conn(0x5604e3202370 msgr2=0x5604e3229450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 shutdown_connections 2023-10-07T09:05:16.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 1 -- 172.21.15.46:0/1289770162 wait complete. 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c91718b80 20 client.7284 trim_cache size 0 max 16384 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 7134, 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:05:16.200 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.8992358180000002, 2023-10-07T09:05:16.201 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 74, 2023-10-07T09:05:16.201 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 114, 2023-10-07T09:05:16.201 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 114, 2023-10-07T09:05:16.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.954240175000001 2023-10-07T09:05:16.201 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 msgr2=0x7f5c6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 0x7f5c6c0697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5c70003080 tx=0x7f5c70017000 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 msgr2=0x7f5c800af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5c74006b00 tx=0x7f5c74008040 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 shutdown_connections 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5c6c067320 0x7f5c6c0697d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c80156a90 0x7f5c80154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c8006c4e0 0x7f5c80150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 --2- 172.21.15.46:0/2821550903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c801566c0 0x7f5c800af4a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 >> 172.21.15.46:0/2821550903 conn(0x7f5c8006b450 msgr2=0x7f5c80158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 shutdown_connections 2023-10-07T09:05:16.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.189+0000 7f5c88420700 1 -- 172.21.15.46:0/2821550903 wait complete. 2023-10-07T09:05:16.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:05:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.321+0000 7fe8b759e700 1 Processor -- start 2023-10-07T09:05:16.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.321+0000 7fe8b759e700 1 -- start start 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 0x7fe8b80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8b81597f0 0x7fe8b80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80b11d0 con 0x7fe8b815d230 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80b14b0 con 0x7fe8b81597f0 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80b1790 con 0x7fe8b8159420 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8b81597f0 0x7fe8b80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8b81597f0 0x7fe8b80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35052/0 (socket says 172.21.15.46:35052) 2023-10-07T09:05:16.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 -- 172.21.15.46:0/2061425650 learned_addr learned my addr 172.21.15.46:0/2061425650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b659c700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 0x7fe8b80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 -- 172.21.15.46:0/2061425650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 msgr2=0x7fe8b80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 0x7fe8b80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 -- 172.21.15.46:0/2061425650 >> v1:172.21.15.133:6789/0 conn(0x7fe8b815d230 legacy=0x7fe8b80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b5d9b700 1 -- 172.21.15.46:0/2061425650 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80b1a70 con 0x7fe8b81597f0 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.322+0000 7fe8b659c700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 0x7fe8b80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b5d9b700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b81597f0 0x7fe8b80b2270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00099b0 tx=0x7fe8a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5e375cc992b1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b559a700 1 -- 172.21.15.46:0/2061425650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000b860 con 0x7fe8b81597f0 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b559a700 1 -- 172.21.15.46:0/2061425650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000b9c0 con 0x7fe8b81597f0 2023-10-07T09:05:16.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b559a700 1 -- 172.21.15.46:0/2061425650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000bd60 con 0x7fe8b81597f0 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 -- 172.21.15.46:0/2061425650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b81597f0 msgr2=0x7fe8b80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b81597f0 0x7fe8b80b2270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00099b0 tx=0x7fe8a0009250 comp rx=0 tx=0).stop 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 -- 172.21.15.46:0/2061425650 shutdown_connections 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b8159420 0x7fe8b80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2061425650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b81597f0 0x7fe8b80b2270 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 -- 172.21.15.46:0/2061425650 >> 172.21.15.46:0/2061425650 conn(0x7fe8b80d0660 msgr2=0x7fe8b80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 -- 172.21.15.46:0/2061425650 shutdown_connections 2023-10-07T09:05:16.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.323+0000 7fe8b759e700 1 -- 172.21.15.46:0/2061425650 wait complete. 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.324+0000 7fe8b759e700 1 Processor -- start 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 -- start start 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b8159420 0x7fe8b815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 0x7fe8b814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80b5240 con 0x7fe8b815d230 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b815ae90 con 0x7fe8b8159420 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b815a560 con 0x7fe8b81597f0 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35058/0 (socket says 172.21.15.46:35058) 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.325+0000 7fe8b6d9d700 1 -- 172.21.15.46:0/2443186252 learned_addr learned my addr 172.21.15.46:0/2443186252 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:16.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b659c700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b8159420 0x7fe8b815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b5d9b700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 0x7fe8b814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 -- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 msgr2=0x7fe8b814f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 0x7fe8b814f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 -- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b8159420 msgr2=0x7fe8b815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b8159420 0x7fe8b815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 -- 172.21.15.46:0/2443186252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00094f0 con 0x7fe8b815d230 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b5d9b700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 0x7fe8b814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b6d9d700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c840 tx=0x7fe8a8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8012630 con 0x7fe8b815d230 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80127b0 con 0x7fe8b815d230 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b815a840 con 0x7fe8b815d230 2023-10-07T09:05:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8012b70 con 0x7fe8b815d230 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.326+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b814f6b0 con 0x7fe8b815d230 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.327+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b815b000 con 0x7fe8b815d230 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.327+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe8a8003030 con 0x7fe8b815d230 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.328+0000 7fe8ae7fc700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 0x7fe8980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.328+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8a8084b80 con 0x7fe8b815d230 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.328+0000 7fe8b659c700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 0x7fe8980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.329+0000 7fe8b659c700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 0x7fe8980697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8158da0 tx=0x7fe8b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.332+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8a8051810 con 0x7fe8b815d230 2023-10-07T09:05:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.568+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe8b804c3c0 con 0x7fe8b815d230 2023-10-07T09:05:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.568+0000 7fe8ae7fc700 1 -- 172.21.15.46:0/2443186252 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe8a8084e60 con 0x7fe8b815d230 2023-10-07T09:05:16.570 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:05:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 msgr2=0x7fe8980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 0x7fe8980697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8158da0 tx=0x7fe8b0008040 comp rx=0 tx=0).stop 2023-10-07T09:05:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 msgr2=0x7fe8b80b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c840 tx=0x7fe8a8001670 comp rx=0 tx=0).stop 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 shutdown_connections 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe898067320 0x7fe8980697d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8b815d230 0x7fe8b80b4810 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b8159420 0x7fe8b815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 --2- 172.21.15.46:0/2443186252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b81597f0 0x7fe8b814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 >> 172.21.15.46:0/2443186252 conn(0x7fe8b80d0660 msgr2=0x7fe8b80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 shutdown_connections 2023-10-07T09:05:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:16.570+0000 7fe8b759e700 1 -- 172.21.15.46:0/2443186252 wait complete. 2023-10-07T09:05:16.584 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:05:16.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:16.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.585 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.601 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42097sec preferred_lft 42097sec 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:05:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:05:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:16.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.604 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:05:16.665 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:05:16.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.667 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:05:16.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:05:16.725 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:05:16.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.827 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:05:16.841 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:05:16.841 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:05:16.842 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:16.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:16.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:05:16.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:16.907 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:16.963 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:16.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:16.963 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:17.018 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:05:17.019 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:05:17.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:17.099 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:17.099 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:17.118 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:17.118 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:17.118 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:17.118 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:17.118 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:17.119 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:17.119 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:17.119 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:17.140 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:17.141 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:05:17.141 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:05:17.141 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:05:17.142 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:05:17.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:17.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:05:17.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.367+0000 7feed210a700 1 Processor -- start 2023-10-07T09:05:17.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.367+0000 7feed210a700 1 -- start start 2023-10-07T09:05:17.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed210a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feecc0ad870 0x7feecc06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed210a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc0b40f0 con 0x7feecc142ea0 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed210a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc069640 con 0x7feecc06bf20 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed210a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc06c3a0 con 0x7feecc0ad870 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed0907700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feecc0ad870 0x7feecc06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed1108700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feecc142ea0 0x7feecc0b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53534/0 (socket says 172.21.15.46:53534) 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed1108700 1 -- 172.21.15.46:0/1339940972 learned_addr learned my addr 172.21.15.46:0/1339940972 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed0907700 1 -- 172.21.15.46:0/1339940972 >> v1:172.21.15.133:6789/0 conn(0x7feecc06bf20 legacy=0x7feecc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed0907700 1 -- 172.21.15.46:0/1339940972 >> v1:172.21.15.46:6789/0 conn(0x7feecc142ea0 legacy=0x7feecc0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feed0907700 1 -- 172.21.15.46:0/1339940972 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc069920 con 0x7feecc0ad870 2023-10-07T09:05:17.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.368+0000 7feecbfff700 1 -- 172.21.15.46:0/1339940972 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053244747 0 0) 0x7feecc0b40f0 con 0x7feecc142ea0 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed0907700 1 --2- 172.21.15.46:0/1339940972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc0ad870 0x7feecc06b9e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7feec00098e0 tx=0x7feec00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cbe0cafef83d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feecbfff700 1 -- 172.21.15.46:0/1339940972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0009e80 con 0x7feecc0ad870 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feecbfff700 1 -- 172.21.15.46:0/1339940972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000b820 con 0x7feecc0ad870 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feecbfff700 1 -- 172.21.15.46:0/1339940972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000bba0 con 0x7feecc0ad870 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 -- 172.21.15.46:0/1339940972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc0ad870 msgr2=0x7feecc06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 --2- 172.21.15.46:0/1339940972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc0ad870 0x7feecc06b9e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7feec00098e0 tx=0x7feec00091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 -- 172.21.15.46:0/1339940972 shutdown_connections 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 --2- 172.21.15.46:0/1339940972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc0ad870 0x7feecc06b9e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 -- 172.21.15.46:0/1339940972 >> 172.21.15.46:0/1339940972 conn(0x7feecc0ce430 msgr2=0x7feecc0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 -- 172.21.15.46:0/1339940972 shutdown_connections 2023-10-07T09:05:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.369+0000 7feed210a700 1 -- 172.21.15.46:0/1339940972 wait complete. 2023-10-07T09:05:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.370+0000 7feed210a700 1 Processor -- start 2023-10-07T09:05:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 -- start start 2023-10-07T09:05:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feecc06bf20 0x7feecc15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc142ea0 0x7feecc15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:17.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc169d30 con 0x7feecc158b00 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc16a010 con 0x7feecc142ea0 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed210a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc16a2f0 con 0x7feecc06bf20 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.371+0000 7feed1909700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35082/0 (socket says 172.21.15.46:35082) 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 -- 172.21.15.46:0/1248007430 learned_addr learned my addr 172.21.15.46:0/1248007430 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed0907700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc142ea0 0x7feecc15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1108700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feecc06bf20 0x7feecc15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 -- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feecc06bf20 msgr2=0x7feecc15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feecc06bf20 0x7feecc15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 -- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc142ea0 msgr2=0x7feecc15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc142ea0 0x7feecc15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 -- 172.21.15.46:0/1248007430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009420 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed1909700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feec400bbb0 tx=0x7feec4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40092e0 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400c7a0 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc16a5d0 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400cb40 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.372+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc15f080 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.373+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc04c3c0 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.374+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feec4012070 con 0x7feecc158b00 2023-10-07T09:05:17.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.374+0000 7feec97fa700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:17.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.374+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feec40849b0 con 0x7feecc158b00 2023-10-07T09:05:17.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.374+0000 7feed1108700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:17.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.375+0000 7feed1108700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 0x7feeb80697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feecc15b0a0 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:17.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.378+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feec4051640 con 0x7feecc158b00 2023-10-07T09:05:17.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.614+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feecc069c00 con 0x7feecc158b00 2023-10-07T09:05:17.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.615+0000 7feec97fa700 1 -- 172.21.15.46:0/1248007430 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7feec4054c60 con 0x7feecc158b00 2023-10-07T09:05:17.617 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:05:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 msgr2=0x7feeb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 0x7feeb80697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feecc15b0a0 tx=0x7feebc009040 comp rx=0 tx=0).stop 2023-10-07T09:05:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 msgr2=0x7feecc15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feec400bbb0 tx=0x7feec4009840 comp rx=0 tx=0).stop 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 shutdown_connections 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feecc158b00 0x7feecc15a2c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feecc06bf20 0x7feecc15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 --2- 172.21.15.46:0/1248007430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc142ea0 0x7feecc15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:17.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 >> 172.21.15.46:0/1248007430 conn(0x7feecc0ce430 msgr2=0x7feecc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:17.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 shutdown_connections 2023-10-07T09:05:17.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:17.617+0000 7feed210a700 1 -- 172.21.15.46:0/1248007430 wait complete. 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:05:17.631 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:17.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.632 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:05:17.650 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:05:17.650 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:17.651 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42088sec preferred_lft 42088sec 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:05:17.652 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:17.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.653 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:05:17.718 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:05:17.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.720 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:05:17.778 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:05:17.778 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:05:17.779 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:05:17.779 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:05:17.779 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:05:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.779 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:05:17.779 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:05:17.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:05:17.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:05:17.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:05:17.780 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:05:17.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.886 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:05:17.901 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:05:17.901 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:05:17.901 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:17.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:17.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:05:17.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:17.967 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:18.022 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:18.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:18.022 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:18.076 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:05:18.076 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:05:18.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:18.157 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:18.157 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:18.199 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:05:18.200 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:05:18.200 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:05:18.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:05:18.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:18.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:18.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:05:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.391+0000 7fa4e6efb700 1 Processor -- start 2023-10-07T09:05:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e6efb700 1 -- start start 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e6efb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4e00b55a0 0x7fa4e0164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e6efb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e00cfa60 con 0x7fa4e0159ec0 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e6efb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e00b5b00 con 0x7fa4e00cd910 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e6efb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00b5da0 con 0x7fa4e00b55a0 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e4c97700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa4e0159ec0 0x7fa4e00b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53536/0 (socket says 172.21.15.46:53536) 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.392+0000 7fa4e4c97700 1 -- 172.21.15.46:0/2133953259 learned_addr learned my addr 172.21.15.46:0/2133953259 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4e5498700 1 --2- 172.21.15.46:0/2133953259 >> v2:172.21.15.133:3300/0 conn(0x7fa4e00b55a0 0x7fa4e0164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196093823 0 0) 0x7fa4e00cfa60 con 0x7fa4e0159ec0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc003570 con 0x7fa4e0159ec0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821658972 0 0) 0x7fa4e00b5b00 con 0x7fa4e00cd910 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e00cfa60 con 0x7fa4e00cd910 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4e5498700 1 -- 172.21.15.46:0/2133953259 >> v1:172.21.15.133:6789/0 conn(0x7fa4e00cd910 legacy=0x7fa4e00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4e5498700 1 -- 172.21.15.46:0/2133953259 >> v1:172.21.15.46:6789/0 conn(0x7fa4e0159ec0 legacy=0x7fa4e00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4e5498700 1 -- 172.21.15.46:0/2133953259 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00b6080 con 0x7fa4e00b55a0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4e5498700 1 --2- 172.21.15.46:0/2133953259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0164400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639e733c60c6b1c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011630 con 0x7fa4e00b55a0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8011790 con 0x7fa4e00b55a0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.393+0000 7fa4df7fe700 1 -- 172.21.15.46:0/2133953259 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011b30 con 0x7fa4e00b55a0 2023-10-07T09:05:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 -- 172.21.15.46:0/2133953259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e00b55a0 msgr2=0x7fa4e0164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/2133953259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0164400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c80091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 -- 172.21.15.46:0/2133953259 shutdown_connections 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/2133953259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0164400 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 -- 172.21.15.46:0/2133953259 >> 172.21.15.46:0/2133953259 conn(0x7fa4e00999f0 msgr2=0x7fa4e00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 -- 172.21.15.46:0/2133953259 shutdown_connections 2023-10-07T09:05:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.394+0000 7fa4e6efb700 1 -- 172.21.15.46:0/2133953259 wait complete. 2023-10-07T09:05:18.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.395+0000 7fa4e6efb700 1 Processor -- start 2023-10-07T09:05:18.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.395+0000 7fa4e6efb700 1 -- start start 2023-10-07T09:05:18.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e0159ec0 0x7fa4e0152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 0x7fa4e00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00ce6d0 con 0x7fa4e00b55a0 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e016d5e0 con 0x7fa4e0159ec0 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e6efb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e016dba0 con 0x7fa4e00cdcf0 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:18.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35084/0 (socket says 172.21.15.46:35084) 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 -- 172.21.15.46:0/3326495599 learned_addr learned my addr 172.21.15.46:0/3326495599 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4dffff700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e0159ec0 0x7fa4e0152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e5498700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 0x7fa4e00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 -- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 msgr2=0x7fa4e00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 0x7fa4e00ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 -- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e0159ec0 msgr2=0x7fa4e0152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e0159ec0 0x7fa4e0152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 -- 172.21.15.46:0/3326495599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009420 con 0x7fa4e00b55a0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e5498700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 0x7fa4e00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.396+0000 7fa4e4c97700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800cb10 tx=0x7fa4d8002870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.397+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8005d80 con 0x7fa4e00b55a0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.397+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800a590 con 0x7fa4e00b55a0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.397+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e0151510 con 0x7fa4e00b55a0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.397+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800a950 con 0x7fa4e00b55a0 2023-10-07T09:05:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.397+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e009db90 con 0x7fa4e00b55a0 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.398+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0063c90 con 0x7fa4e00b55a0 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.398+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa4d800ad40 con 0x7fa4e00b55a0 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.398+0000 7fa4dcff9700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 0x7fa4c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.398+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4d8084a10 con 0x7fa4e00b55a0 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.399+0000 7fa4dffff700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 0x7fa4c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.399+0000 7fa4dffff700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 0x7fa4c00697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4e009d8b0 tx=0x7fa4d0007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:18.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.403+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4d8051720 con 0x7fa4e00b55a0 2023-10-07T09:05:18.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.642+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa4e00718b0 con 0x7fa4e00b55a0 2023-10-07T09:05:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.933+0000 7fa4dcff9700 1 -- 172.21.15.46:0/3326495599 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v75) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa4d8054d40 con 0x7fa4e00b55a0 2023-10-07T09:05:18.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.935+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 msgr2=0x7fa4c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.935+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 0x7fa4c00697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4e009d8b0 tx=0x7fa4d0007d50 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.935+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 msgr2=0x7fa4e0150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.935+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800cb10 tx=0x7fa4d8002870 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 shutdown_connections 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa4c0067320 0x7fa4c00697d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4e00cdcf0 0x7fa4e00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e00b55a0 0x7fa4e0150fd0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 --2- 172.21.15.46:0/3326495599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4e0159ec0 0x7fa4e0152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 >> 172.21.15.46:0/3326495599 conn(0x7fa4e00999f0 msgr2=0x7fa4e00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 shutdown_connections 2023-10-07T09:05:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:18.936+0000 7fa4e6efb700 1 -- 172.21.15.46:0/3326495599 wait complete. 2023-10-07T09:05:18.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:05:19.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 Processor -- start 2023-10-07T09:05:19.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 -- start start 2023-10-07T09:05:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f803015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f803015db10 0x7f8030069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803015a160 con 0x7f8030159890 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300d13a0 con 0x7f803015db10 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.069+0000 7f8035ade700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803015e140 con 0x7f8030159c60 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8030159890 0x7f803015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53538/0 (socket says 172.21.15.46:53538) 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802f7fe700 1 -- 172.21.15.46:0/1678806183 learned_addr learned my addr 172.21.15.46:0/1678806183 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802effd700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f803015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802ffff700 1 --2- 172.21.15.46:0/1678806183 >> v2:172.21.15.133:3300/0 conn(0x7f803015db10 0x7f8030069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487829313 0 0) 0x7f803015a160 con 0x7f8030159890 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8018003570 con 0x7f8030159890 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2058955144 0 0) 0x7f8018003570 con 0x7f8030159890 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 msgr2=0x7f803015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f803015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 >> v2:172.21.15.133:3300/0 conn(0x7f803015db10 msgr2=0x7f8030069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 --2- 172.21.15.46:0/1678806183 >> v2:172.21.15.133:3300/0 conn(0x7f803015db10 0x7f8030069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803015a3d0 con 0x7f8030159890 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f8020001470 con 0x7f8030159890 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 >> v1:172.21.15.46:6789/0 conn(0x7f8030159890 legacy=0x7f803015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8018003a60 0x7f8018003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8018004810 0x7f8018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f80180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300d13a0 con 0x7f8018003a60 2023-10-07T09:05:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803015e140 con 0x7f8018004810 2023-10-07T09:05:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801800ba60 con 0x7f8030159c60 2023-10-07T09:05:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802f7fe700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8018003a60 0x7f8018003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802effd700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8018004810 0x7f8018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.070+0000 7f802ffff700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f80180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 -- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 msgr2=0x7f80180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8030159c60 0x7f80180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 -- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8018004810 msgr2=0x7f8018004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8018004810 0x7f8018004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 -- 172.21.15.46:0/1678806183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018003570 con 0x7f8018003a60 2023-10-07T09:05:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802f7fe700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8018003a60 0x7f8018003e70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f802000c3f0 tx=0x7f8020001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d48d3189b2e4e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000cc80 con 0x7f8018003a60 2023-10-07T09:05:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000ce00 con 0x7f8018003a60 2023-10-07T09:05:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802e7fc700 1 -- 172.21.15.46:0/1678806183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020005b70 con 0x7f8018003a60 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 -- 172.21.15.46:0/1678806183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8018003a60 msgr2=0x7f8018003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 --2- 172.21.15.46:0/1678806183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8018003a60 0x7f8018003e70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f802000c3f0 tx=0x7f8020001e90 comp rx=0 tx=0).stop 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f802ffff700 1 -- 172.21.15.46:0/1678806183 reap_dead start 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 -- 172.21.15.46:0/1678806183 shutdown_connections 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 -- 172.21.15.46:0/1678806183 >> 172.21.15.46:0/1678806183 conn(0x7f8030068e20 msgr2=0x7f80300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 -- 172.21.15.46:0/1678806183 shutdown_connections 2023-10-07T09:05:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.071+0000 7f8035ade700 1 -- 172.21.15.46:0/1678806183 wait complete. 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 Processor -- start 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 -- start start 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 0x7f8030143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80300b16d0 0x7f80300c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b4930 con 0x7f80300b1b40 2023-10-07T09:05:19.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300ca0b0 con 0x7f80300b16d0 2023-10-07T09:05:19.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.073+0000 7f8035ade700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b3d20 con 0x7f8018003a60 2023-10-07T09:05:19.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35110/0 (socket says 172.21.15.46:35110) 2023-10-07T09:05:19.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 -- 172.21.15.46:0/2738249929 learned_addr learned my addr 172.21.15.46:0/2738249929 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:19.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802f7fe700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 0x7f8030143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802effd700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80300b16d0 0x7f80300c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 -- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 msgr2=0x7f8030143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 0x7f8030143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 -- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80300b16d0 msgr2=0x7f80300c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80300b16d0 0x7f80300c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 -- 172.21.15.46:0/2738249929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300b4000 con 0x7f80300b1b40 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802f7fe700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 0x7f8030143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f802ffff700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f80300d03b0 tx=0x7f802800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800e040 con 0x7f80300b1b40 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800f040 con 0x7f80300b1b40 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80300b42e0 con 0x7f80300b1b40 2023-10-07T09:05:19.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800fe20 con 0x7f80300b1b40 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.074+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8030144330 con 0x7f80300b1b40 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.075+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803004c3c0 con 0x7f80300b1b40 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.076+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8028015640 con 0x7f80300b1b40 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.076+0000 7f80177fe700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 0x7f801c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.076+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8028085560 con 0x7f80300b1b40 2023-10-07T09:05:19.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.076+0000 7f802f7fe700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 0x7f801c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.077+0000 7f802f7fe700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 0x7f801c0697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8020001ed0 tx=0x7f8020015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.081+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80280520e0 con 0x7f80300b1b40 2023-10-07T09:05:19.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.298+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f803006a5b0 con 0x7f801c067320 2023-10-07T09:05:19.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.300+0000 7f80177fe700 1 -- 172.21.15.46:0/2738249929 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f803006a5b0 con 0x7f801c067320 2023-10-07T09:05:19.301 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:05:19.301 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:19.301 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:05:19.302 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:19.302 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 msgr2=0x7f801c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 0x7f801c0697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8020001ed0 tx=0x7f8020015000 comp rx=0 tx=0).stop 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 msgr2=0x7f80300c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f80300d03b0 tx=0x7f802800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 shutdown_connections 2023-10-07T09:05:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f801c067320 0x7f801c0697d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80300b1b40 0x7f80300c9b70 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8018003a60 0x7f8030143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 --2- 172.21.15.46:0/2738249929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80300b16d0 0x7f80300c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 >> 172.21.15.46:0/2738249929 conn(0x7f8030068e20 msgr2=0x7f80301587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 shutdown_connections 2023-10-07T09:05:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.302+0000 7f8035ade700 1 -- 172.21.15.46:0/2738249929 wait complete. 2023-10-07T09:05:19.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:05:19.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.436+0000 7f9a16fbb700 1 Processor -- start 2023-10-07T09:05:19.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.436+0000 7f9a16fbb700 1 -- start start 2023-10-07T09:05:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.436+0000 7f9a16fbb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a1006c0a0 0x7f9a100caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a16fbb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a1015df50 0x7f9a1015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a16fbb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1015d7e0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a16fbb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015dac0 con 0x7f9a1006c0a0 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a16fbb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015aa30 con 0x7f9a1015df50 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a1006c0a0 0x7f9a100caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a14d57700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a1006bcd0 0x7f9a1015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53542/0 (socket says 172.21.15.46:53542) 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a14d57700 1 -- 172.21.15.46:0/4051131011 learned_addr learned my addr 172.21.15.46:0/4051131011 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a15558700 1 --2- 172.21.15.46:0/4051131011 >> v2:172.21.15.133:3300/0 conn(0x7f9a1015df50 0x7f9a1015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 -- 172.21.15.46:0/4051131011 >> v2:172.21.15.133:3300/0 conn(0x7f9a1015df50 msgr2=0x7f9a1015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 --2- 172.21.15.46:0/4051131011 >> v2:172.21.15.133:3300/0 conn(0x7f9a1015df50 0x7f9a1015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 -- 172.21.15.46:0/4051131011 >> v1:172.21.15.46:6789/0 conn(0x7f9a1006bcd0 legacy=0x7f9a1015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 -- 172.21.15.46:0/4051131011 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1015ad10 con 0x7f9a1006c0a0 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0f7fe700 1 -- 172.21.15.46:0/4051131011 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699971091 0 0) 0x7f9a1015d7e0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0ffff700 1 --2- 172.21.15.46:0/4051131011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006c0a0 0x7f9a100caa90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9a1015d720 tx=0x7f9a040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99756c3bf256664c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0f7fe700 1 -- 172.21.15.46:0/4051131011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011630 con 0x7f9a1006c0a0 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0f7fe700 1 -- 172.21.15.46:0/4051131011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04011790 con 0x7f9a1006c0a0 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.437+0000 7f9a0f7fe700 1 -- 172.21.15.46:0/4051131011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011b30 con 0x7f9a1006c0a0 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 -- 172.21.15.46:0/4051131011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006c0a0 msgr2=0x7f9a100caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/4051131011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006c0a0 0x7f9a100caa90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9a1015d720 tx=0x7f9a040091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 -- 172.21.15.46:0/4051131011 shutdown_connections 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/4051131011 >> v2:172.21.15.133:3300/0 conn(0x7f9a1015df50 0x7f9a1015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/4051131011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006c0a0 0x7f9a100caa90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 -- 172.21.15.46:0/4051131011 >> 172.21.15.46:0/4051131011 conn(0x7f9a100ce600 msgr2=0x7f9a100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 -- 172.21.15.46:0/4051131011 shutdown_connections 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.438+0000 7f9a16fbb700 1 -- 172.21.15.46:0/4051131011 wait complete. 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.439+0000 7f9a16fbb700 1 Processor -- start 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.439+0000 7f9a16fbb700 1 -- start start 2023-10-07T09:05:19.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a1006c0a0 0x7f9a100c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a1015df50 0x7f9a100c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1016b440 con 0x7f9a1006bcd0 2023-10-07T09:05:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100c76a0 con 0x7f9a1015df50 2023-10-07T09:05:19.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a16fbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1014b840 con 0x7f9a1006c0a0 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35132/0 (socket says 172.21.15.46:35132) 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 -- 172.21.15.46:0/1618519408 learned_addr learned my addr 172.21.15.46:0/1618519408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a15558700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a1015df50 0x7f9a100c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a0ffff700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a1006c0a0 0x7f9a100c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 -- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a1006c0a0 msgr2=0x7f9a100c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a1006c0a0 0x7f9a100c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 -- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a1015df50 msgr2=0x7f9a100c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a1015df50 0x7f9a100c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 -- 172.21.15.46:0/1618519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009420 con 0x7f9a1006bcd0 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.440+0000 7f9a14d57700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c5e0 tx=0x7f9a00001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.441+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00005b30 con 0x7f9a1006bcd0 2023-10-07T09:05:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.441+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00005c90 con 0x7f9a1006bcd0 2023-10-07T09:05:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.441+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100c6d70 con 0x7f9a1006bcd0 2023-10-07T09:05:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.441+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00007300 con 0x7f9a1006bcd0 2023-10-07T09:05:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.441+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100c7330 con 0x7f9a1006bcd0 2023-10-07T09:05:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.442+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1004c3c0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.442+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9a0001b3b0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.442+0000 7f9a0cff9700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 0x7f99fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.443+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a00084080 con 0x7f9a1006bcd0 2023-10-07T09:05:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.443+0000 7f9a0ffff700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 0x7f99fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.443+0000 7f9a0ffff700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 0x7f99fc0697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9a040093f0 tx=0x7f9a04017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.448+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a00050d10 con 0x7f9a1006bcd0 2023-10-07T09:05:19.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.642+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9a1015aff0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.642+0000 7f9a0cff9700 1 -- 172.21.15.46:0/1618519408 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a000170c0 con 0x7f9a1006bcd0 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 msgr2=0x7f99fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 0x7f99fc0697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9a040093f0 tx=0x7f9a04017000 comp rx=0 tx=0).stop 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 msgr2=0x7f9a1014b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c5e0 tx=0x7f9a00001070 comp rx=0 tx=0).stop 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 shutdown_connections 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99fc067320 0x7f99fc0697d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a1015df50 0x7f9a100c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a1006bcd0 0x7f9a1014b300 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 --2- 172.21.15.46:0/1618519408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a1006c0a0 0x7f9a100c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 >> 172.21.15.46:0/1618519408 conn(0x7f9a100ce600 msgr2=0x7f9a1015a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 shutdown_connections 2023-10-07T09:05:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.644+0000 7f9a16fbb700 1 -- 172.21.15.46:0/1618519408 wait complete. 2023-10-07T09:05:19.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:05:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.776+0000 7f7dcc969700 1 Processor -- start 2023-10-07T09:05:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.776+0000 7f7dcc969700 1 -- start start 2023-10-07T09:05:19.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc8143050 0x7f7dc8159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dc806b9e0 0x7f7dc806be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7dc80b3810 0x7f7dc80b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc806c390 con 0x7f7dc806b9e0 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc8143420 con 0x7f7dc80b3810 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dcc969700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc806a1e0 con 0x7f7dc8143050 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dc659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dc806b9e0 0x7f7dc806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dc659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dc806b9e0 0x7f7dc806be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52186/0 (socket says 172.21.15.46:52186) 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dc659c700 1 -- 172.21.15.46:0/3600703499 learned_addr learned my addr 172.21.15.46:0/3600703499 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dc6d9d700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc8143050 0x7f7dc8159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.777+0000 7f7dc759e700 1 --2- 172.21.15.46:0/3600703499 >> v2:172.21.15.133:3300/0 conn(0x7f7dc80b3810 0x7f7dc80b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 -- 172.21.15.46:0/3600703499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc8143050 msgr2=0x7f7dc8159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc8143050 0x7f7dc8159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 -- 172.21.15.46:0/3600703499 >> v2:172.21.15.133:3300/0 conn(0x7f7dc80b3810 msgr2=0x7f7dc80b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 --2- 172.21.15.46:0/3600703499 >> v2:172.21.15.133:3300/0 conn(0x7f7dc80b3810 0x7f7dc80b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 -- 172.21.15.46:0/3600703499 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80695d0 con 0x7f7dc806b9e0 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc659c700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc806b9e0 0x7f7dc806be50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806c760 tx=0x7f7dbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97be09241bd516c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc5d9b700 1 -- 172.21.15.46:0/3600703499 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00b640 con 0x7f7dc806b9e0 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc5d9b700 1 -- 172.21.15.46:0/3600703499 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc00b7a0 con 0x7f7dc806b9e0 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.778+0000 7f7dc5d9b700 1 -- 172.21.15.46:0/3600703499 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00bb40 con 0x7f7dc806b9e0 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 -- 172.21.15.46:0/3600703499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc806b9e0 msgr2=0x7f7dc806be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc806b9e0 0x7f7dc806be50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806c760 tx=0x7f7dbc009250 comp rx=0 tx=0).stop 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 -- 172.21.15.46:0/3600703499 shutdown_connections 2023-10-07T09:05:19.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 --2- 172.21.15.46:0/3600703499 >> v2:172.21.15.133:3300/0 conn(0x7f7dc80b3810 0x7f7dc80b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc8143050 0x7f7dc8159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 --2- 172.21.15.46:0/3600703499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc806b9e0 0x7f7dc806be50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 -- 172.21.15.46:0/3600703499 >> 172.21.15.46:0/3600703499 conn(0x7f7dc80ce430 msgr2=0x7f7dc80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:19.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 -- 172.21.15.46:0/3600703499 shutdown_connections 2023-10-07T09:05:19.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.779+0000 7f7dcc969700 1 -- 172.21.15.46:0/3600703499 wait complete. 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.780+0000 7f7dcc969700 1 Processor -- start 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.780+0000 7f7dcc969700 1 -- start start 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc806b9e0 0x7f7dc81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc80b3810 0x7f7dc80c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80cd460 con 0x7f7dc8143050 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815d0c0 con 0x7f7dc806b9e0 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8159620 con 0x7f7dc80b3810 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52196/0 (socket says 172.21.15.46:52196) 2023-10-07T09:05:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 -- 172.21.15.46:0/2628224786 learned_addr learned my addr 172.21.15.46:0/2628224786 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc6d9d700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc806b9e0 0x7f7dc81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc659c700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc80b3810 0x7f7dc80c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 -- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc80b3810 msgr2=0x7f7dc80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc80b3810 0x7f7dc80c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 -- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc806b9e0 msgr2=0x7f7dc81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc806b9e0 0x7f7dc81590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 -- 172.21.15.46:0/2628224786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0094f0 con 0x7f7dc8143050 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dc759e700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009ec0 tx=0x7f7dc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000cc20 con 0x7f7dc8143050 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000f040 con 0x7f7dc8143050 2023-10-07T09:05:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80ccbc0 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.781+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0014480 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.782+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80cd180 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.782+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80b2a30 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.783+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7dc0014830 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.783+0000 7f7daeffd700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 0x7f7db40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.783+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dc0085620 con 0x7f7dc8143050 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.783+0000 7f7dc6d9d700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 0x7f7db40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.784+0000 7f7dc6d9d700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 0x7f7db40697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8069e80 tx=0x7f7db8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:19.787+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc00522a0 con 0x7f7dc8143050 2023-10-07T09:05:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.011+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dc804c3c0 con 0x7f7db4067320 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.013+0000 7f7daeffd700 1 -- 172.21.15.46:0/2628224786 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7dc804c3c0 con 0x7f7db4067320 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:05:20.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.014+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 msgr2=0x7f7db40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.014+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 0x7f7db40697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8069e80 tx=0x7f7db8008040 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.014+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 msgr2=0x7f7dc80ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.014+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009ec0 tx=0x7f7dc000b040 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 shutdown_connections 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7db4067320 0x7f7db40697d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc8143050 0x7f7dc80ca200 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc806b9e0 0x7f7dc81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 --2- 172.21.15.46:0/2628224786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dc80b3810 0x7f7dc80c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 >> 172.21.15.46:0/2628224786 conn(0x7f7dc80ce430 msgr2=0x7f7dc80adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 shutdown_connections 2023-10-07T09:05:20.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.015+0000 7f7dcc969700 1 -- 172.21.15.46:0/2628224786 wait complete. 2023-10-07T09:05:20.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000905168 2023-10-07T09:05:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.147+0000 7fde05e39700 1 Processor -- start 2023-10-07T09:05:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.147+0000 7fde05e39700 1 -- start start 2023-10-07T09:05:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05e39700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde000b16d0 0x7fde000b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05e39700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fde000b33b0 0x7fde000b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05e39700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000b2080 con 0x7fde000b4e70 2023-10-07T09:05:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05e39700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000cfb00 con 0x7fde000b16d0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05e39700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000b5c40 con 0x7fde000b33b0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fddfffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde000b16d0 0x7fde000b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fddfffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde000b16d0 0x7fde000b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52206/0 (socket says 172.21.15.46:52206) 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fddfffff700 1 -- 172.21.15.46:0/376790149 learned_addr learned my addr 172.21.15.46:0/376790149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.148+0000 7fde05638700 1 --2- 172.21.15.46:0/376790149 >> v2:172.21.15.133:3300/0 conn(0x7fde000b33b0 0x7fde000b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddfffff700 1 -- 172.21.15.46:0/376790149 >> v2:172.21.15.133:3300/0 conn(0x7fde000b33b0 msgr2=0x7fde000b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddfffff700 1 --2- 172.21.15.46:0/376790149 >> v2:172.21.15.133:3300/0 conn(0x7fde000b33b0 0x7fde000b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddfffff700 1 -- 172.21.15.46:0/376790149 >> v1:172.21.15.133:6789/0 conn(0x7fde000b4e70 legacy=0x7fde000ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddfffff700 1 -- 172.21.15.46:0/376790149 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000b5f20 con 0x7fde000b16d0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddfffff700 1 --2- 172.21.15.46:0/376790149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b16d0 0x7fde000b1b40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fde00071380 tx=0x7fddec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93815adad4e4b727 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddff7fe700 1 -- 172.21.15.46:0/376790149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec009e70 con 0x7fde000b16d0 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddff7fe700 1 -- 172.21.15.46:0/376790149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec00b860 con 0x7fde000b16d0 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fddff7fe700 1 -- 172.21.15.46:0/376790149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00bc20 con 0x7fde000b16d0 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 -- 172.21.15.46:0/376790149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b16d0 msgr2=0x7fde000b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 --2- 172.21.15.46:0/376790149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b16d0 0x7fde000b1b40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fde00071380 tx=0x7fddec009250 comp rx=0 tx=0).stop 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 -- 172.21.15.46:0/376790149 shutdown_connections 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 --2- 172.21.15.46:0/376790149 >> v2:172.21.15.133:3300/0 conn(0x7fde000b33b0 0x7fde000b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 --2- 172.21.15.46:0/376790149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b16d0 0x7fde000b1b40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.149+0000 7fde05e39700 1 -- 172.21.15.46:0/376790149 >> 172.21.15.46:0/376790149 conn(0x7fde000d10c0 msgr2=0x7fde000affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.150+0000 7fde05e39700 1 -- 172.21.15.46:0/376790149 shutdown_connections 2023-10-07T09:05:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.150+0000 7fde05e39700 1 -- 172.21.15.46:0/376790149 wait complete. 2023-10-07T09:05:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 Processor -- start 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 -- start start 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 0x7fde000cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde000b33b0 0x7fde00158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000cc680 con 0x7fde000b4e70 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde00169d70 con 0x7fde000b16d0 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.151+0000 7fde05e39700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde00169fc0 con 0x7fde000b33b0 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52210/0 (socket says 172.21.15.46:52210) 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 -- 172.21.15.46:0/1805766460 learned_addr learned my addr 172.21.15.46:0/1805766460 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde04e37700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 0x7fde000cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fddfffff700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde000b33b0 0x7fde00158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 -- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde000b33b0 msgr2=0x7fde00158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde000b33b0 0x7fde00158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 -- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 msgr2=0x7fde000cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 0x7fde000cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 -- 172.21.15.46:0/1805766460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0094f0 con 0x7fde000b4e70 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde04e37700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 0x7fde000cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05638700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e90 tx=0x7fddf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800cc20 con 0x7fde000b4e70 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800f040 con 0x7fde000b4e70 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde000cbb10 con 0x7fde000b4e70 2023-10-07T09:05:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8014480 con 0x7fde000b4e70 2023-10-07T09:05:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.152+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde000cbe90 con 0x7fde000b4e70 2023-10-07T09:05:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.153+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde00088990 con 0x7fde000b4e70 2023-10-07T09:05:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.154+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fddf80147f0 con 0x7fde000b4e70 2023-10-07T09:05:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.154+0000 7fddfcff9700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.154+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddf8085a50 con 0x7fde000b4e70 2023-10-07T09:05:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.154+0000 7fde04e37700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.155+0000 7fde04e37700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 0x7fdde40697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007fd0 tx=0x7fddf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.159+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddf80525d0 con 0x7fde000b4e70 2023-10-07T09:05:20.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:20.380+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000905168", "target": ["mon-mgr", ""]}) v1 -- 0x7fde000cc460 con 0x7fdde4067320 2023-10-07T09:05:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.967+0000 7fddfcff9700 1 -- 172.21.15.46:0/1805766460 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fde000cc460 con 0x7fdde4067320 2023-10-07T09:05:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.972+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 msgr2=0x7fdde40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.972+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 0x7fdde40697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007fd0 tx=0x7fddf4009040 comp rx=0 tx=0).stop 2023-10-07T09:05:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.972+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 msgr2=0x7fde0015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.972+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e90 tx=0x7fddf800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 shutdown_connections 2023-10-07T09:05:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde000b4e70 0x7fde0015d1f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde000b16d0 0x7fde000cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 --2- 172.21.15.46:0/1805766460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde000b33b0 0x7fde00158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.973+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 >> 172.21.15.46:0/1805766460 conn(0x7fde000d10c0 msgr2=0x7fde000c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:22.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.975+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 shutdown_connections 2023-10-07T09:05:22.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:22.975+0000 7fde05e39700 1 -- 172.21.15.46:0/1805766460 wait complete. 2023-10-07T09:05:22.979 INFO:teuthology.orchestra.run.smithi046.stderr:Volume created successfully (no MDS daemons created) 2023-10-07T09:05:22.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000905169 2023-10-07T09:05:23.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.120+0000 7fea3f11b700 1 Processor -- start 2023-10-07T09:05:23.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.120+0000 7fea3f11b700 1 -- start start 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3f11b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 0x7fea3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3f11b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea3815db10 0x7fea38069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3f11b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3815a160 con 0x7fea38159890 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3f11b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3815df50 con 0x7fea3815db10 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3f11b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea380d13a0 con 0x7fea38159c60 2023-10-07T09:05:23.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea3815db10 0x7fea38069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3ceb7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fea38159890 0x7fea3815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35072/0 (socket says 172.21.15.46:35072) 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3ceb7700 1 -- 172.21.15.46:0/521866803 learned_addr learned my addr 172.21.15.46:0/521866803 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea37fff700 1 --2- 172.21.15.46:0/521866803 >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 0x7fea3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea377fe700 1 -- 172.21.15.46:0/521866803 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674194765 0 0) 0x7fea3815a160 con 0x7fea38159890 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea377fe700 1 -- 172.21.15.46:0/521866803 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003570 con 0x7fea38159890 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 -- 172.21.15.46:0/521866803 >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 msgr2=0x7fea3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 --2- 172.21.15.46:0/521866803 >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 0x7fea3815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 -- 172.21.15.46:0/521866803 >> v1:172.21.15.46:6789/0 conn(0x7fea38159890 legacy=0x7fea3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 -- 172.21.15.46:0/521866803 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3815e140 con 0x7fea3815db10 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea37fff700 1 --2- 172.21.15.46:0/521866803 >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 0x7fea3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.121+0000 7fea3d6b8700 1 --2- 172.21.15.46:0/521866803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea3815db10 0x7fea38069560 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fea380b67f0 tx=0x7fea30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f19315821b3a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:23.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea377fe700 1 -- 172.21.15.46:0/521866803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000e070 con 0x7fea3815db10 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea377fe700 1 -- 172.21.15.46:0/521866803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000bb60 con 0x7fea3815db10 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea377fe700 1 -- 172.21.15.46:0/521866803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30012430 con 0x7fea3815db10 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 -- 172.21.15.46:0/521866803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea3815db10 msgr2=0x7fea38069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 --2- 172.21.15.46:0/521866803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea3815db10 0x7fea38069560 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fea380b67f0 tx=0x7fea30009780 comp rx=0 tx=0).stop 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 -- 172.21.15.46:0/521866803 shutdown_connections 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 --2- 172.21.15.46:0/521866803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea3815db10 0x7fea38069560 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 --2- 172.21.15.46:0/521866803 >> v2:172.21.15.133:3300/0 conn(0x7fea38159c60 0x7fea3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 -- 172.21.15.46:0/521866803 >> 172.21.15.46:0/521866803 conn(0x7fea38068e20 msgr2=0x7fea380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 -- 172.21.15.46:0/521866803 shutdown_connections 2023-10-07T09:05:23.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.122+0000 7fea3f11b700 1 -- 172.21.15.46:0/521866803 wait complete. 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.123+0000 7fea3f11b700 1 Processor -- start 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 -- start start 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea38159c60 0x7fea381548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea3815db10 0x7fea38154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3816dd80 con 0x7fea38159890 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38155350 con 0x7fea3815db10 2023-10-07T09:05:23.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3f11b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3816d100 con 0x7fea38159c60 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3ceb7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3ceb7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52214/0 (socket says 172.21.15.46:52214) 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3ceb7700 1 -- 172.21.15.46:0/2149282696 learned_addr learned my addr 172.21.15.46:0/2149282696 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea3d6b8700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea3815db10 0x7fea38154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.124+0000 7fea37fff700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea38159c60 0x7fea381548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 -- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea38159c60 msgr2=0x7fea381548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea38159c60 0x7fea381548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 -- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea3815db10 msgr2=0x7fea38154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea3815db10 0x7fea38154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 -- 172.21.15.46:0/2149282696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009a20 con 0x7fea38159890 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3ceb7700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c7c0 tx=0x7fea20007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:23.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20005b30 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20005c90 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3816d3e0 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20007320 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.125+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3816d9a0 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.126+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3804c3c0 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.127+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fea2001b400 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.127+0000 7fea34ff9700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 0x7fea180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.127+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fea200849f0 con 0x7fea38159890 2023-10-07T09:05:23.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.127+0000 7fea37fff700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 0x7fea180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:23.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.128+0000 7fea37fff700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 0x7fea180697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fea3815dae0 tx=0x7fea28006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:23.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.132+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea20086e60 con 0x7fea38159890 2023-10-07T09:05:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:23.356+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000905169", "target": ["mon-mgr", ""]}) v1 -- 0x7fea3806a5b0 con 0x7fea18067320 2023-10-07T09:05:25.929 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-10-07T09:05:25.929+0000 7efde9c83700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:05:25.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:25.995+0000 7fea34ff9700 1 -- 172.21.15.46:0/2149282696 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fea3806a5b0 con 0x7fea18067320 2023-10-07T09:05:26.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 msgr2=0x7fea180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 0x7fea180697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fea3815dae0 tx=0x7fea28006f90 comp rx=0 tx=0).stop 2023-10-07T09:05:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 msgr2=0x7fea38141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c7c0 tx=0x7fea20007e00 comp rx=0 tx=0).stop 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 shutdown_connections 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea18067320 0x7fea180697d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea3815db10 0x7fea38154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea38159890 0x7fea38141080 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 --2- 172.21.15.46:0/2149282696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea38159c60 0x7fea381548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.001+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 >> 172.21.15.46:0/2149282696 conn(0x7fea38068e20 msgr2=0x7fea38152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.002+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 shutdown_connections 2023-10-07T09:05:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.002+0000 7fea3f11b700 1 -- 172.21.15.46:0/2149282696 wait complete. 2023-10-07T09:05:26.004 INFO:teuthology.orchestra.run.smithi046.stderr:Volume created successfully (no MDS daemons created) 2023-10-07T09:05:26.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:05:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 Processor -- start 2023-10-07T09:05:26.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 -- start start 2023-10-07T09:05:26.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f236c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c15a160 con 0x7f236c159890 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c0d13a0 con 0x7f236c15db10 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.147+0000 7f2371350700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c15e140 con 0x7f236c159c60 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f236c159890 0x7f236c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35084/0 (socket says 172.21.15.46:35084) 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236affd700 1 -- 172.21.15.46:0/2512576687 learned_addr learned my addr 172.21.15.46:0/2512576687 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236a7fc700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f236c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406603550 0 0) 0x7f236c15a160 con 0x7f236c159890 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2358003570 con 0x7f236c159890 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187919310 0 0) 0x7f2358003570 con 0x7f236c159890 2023-10-07T09:05:26.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 msgr2=0x7f236c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f236c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 >> v1:172.21.15.133:6789/0 conn(0x7f236c15db10 legacy=0x7f236c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c15a3d0 con 0x7f236c159890 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f235c001470 con 0x7f236c159890 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 >> v1:172.21.15.46:6789/0 conn(0x7f236c159890 legacy=0x7f236c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f2358003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2358004010 0x7f2358004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f23580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c15e140 con 0x7f2358004d50 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235800bbf0 con 0x7f2358004010 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235800bdb0 con 0x7f236c159c60 2023-10-07T09:05:26.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236b7fe700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f23580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236affd700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f2358003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.148+0000 7f236a7fc700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2358004010 0x7f2358004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 -- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 msgr2=0x7f2358003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c159c60 0x7f2358003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 -- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2358004010 msgr2=0x7f2358004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2358004010 0x7f2358004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 -- 172.21.15.46:0/2512576687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358003570 con 0x7f2358004d50 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236a7fc700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2358004010 0x7f2358004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f236b7fe700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f23580051c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2364001f90 tx=0x7f2364001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b024bf0b38649c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364001950 con 0x7f2358004d50 2023-10-07T09:05:26.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236400c8b0 con 0x7f2358004d50 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.149+0000 7f2369ffb700 1 -- 172.21.15.46:0/2512576687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400cc70 con 0x7f2358004d50 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 -- 172.21.15.46:0/2512576687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 msgr2=0x7f23580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 --2- 172.21.15.46:0/2512576687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f23580051c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2364001f90 tx=0x7f2364001640 comp rx=0 tx=0).stop 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f236b7fe700 1 -- 172.21.15.46:0/2512576687 reap_dead start 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 -- 172.21.15.46:0/2512576687 shutdown_connections 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 -- 172.21.15.46:0/2512576687 >> 172.21.15.46:0/2512576687 conn(0x7f236c068e20 msgr2=0x7f236c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 -- 172.21.15.46:0/2512576687 shutdown_connections 2023-10-07T09:05:26.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.150+0000 7f2371350700 1 -- 172.21.15.46:0/2512576687 wait complete. 2023-10-07T09:05:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.151+0000 7f2371350700 1 Processor -- start 2023-10-07T09:05:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.151+0000 7f2371350700 1 -- start start 2023-10-07T09:05:26.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 0x7f236c15c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 0x7f236c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c6ec0 con 0x7f2358004d50 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c58e0 con 0x7f236c0cd380 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c5bc0 con 0x7f236c15c550 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52232/0 (socket says 172.21.15.46:52232) 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 -- 172.21.15.46:0/1784831437 learned_addr learned my addr 172.21.15.46:0/1784831437 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236b7fe700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 0x7f236c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236a7fc700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 0x7f236c15c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 -- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 msgr2=0x7f236c15c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 0x7f236c15c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 -- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 msgr2=0x7f236c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 0x7f236c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 -- 172.21.15.46:0/1784831437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0c5ea0 con 0x7f2358004d50 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236b7fe700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 0x7f236c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236a7fc700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 0x7f236c15c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f236affd700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f235c007390 tx=0x7f235c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c018030 con 0x7f2358004d50 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00f870 con 0x7f2358004d50 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c0c6180 con 0x7f2358004d50 2023-10-07T09:05:26.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.152+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00fc30 con 0x7f2358004d50 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.153+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c0c5590 con 0x7f2358004d50 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.153+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c0c66a0 con 0x7f2358004d50 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.154+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f235c01b070 con 0x7f2358004d50 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.154+0000 7f2362ffd700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 0x7f234c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.155+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f235c019070 con 0x7f2358004d50 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.155+0000 7f236a7fc700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 0x7f234c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.155+0000 7f236a7fc700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 0x7f234c0697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f23540093f0 tx=0x7f2354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.159+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f236c0c66a0 con 0x7f2358004d50 2023-10-07T09:05:26.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.379+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f236c0c66a0 con 0x7f234c067320 2023-10-07T09:05:26.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.380+0000 7f2362ffd700 1 -- 172.21.15.46:0/1784831437 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f236c0c66a0 con 0x7f234c067320 2023-10-07T09:05:26.381 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:05:26.381 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:26.381 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:05:26.381 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000905168" 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000905169" 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:26.382 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:05:26.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 msgr2=0x7f234c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 0x7f234c0697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f23540093f0 tx=0x7f2354008040 comp rx=0 tx=0).stop 2023-10-07T09:05:26.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 msgr2=0x7f236c0c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f235c007390 tx=0x7f235c001e50 comp rx=0 tx=0).stop 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 shutdown_connections 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f234c067320 0x7f234c0697d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f236c0cd380 0x7f236c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2358004d50 0x7f236c0c6980 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 --2- 172.21.15.46:0/1784831437 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f236c15c550 0x7f236c15c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 >> 172.21.15.46:0/1784831437 conn(0x7f236c068e20 msgr2=0x7f236c14d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 shutdown_connections 2023-10-07T09:05:26.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.382+0000 7f2371350700 1 -- 172.21.15.46:0/1784831437 wait complete. 2023-10-07T09:05:26.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000905168 --yes-i-really-mean-it 2023-10-07T09:05:26.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 Processor -- start 2023-10-07T09:05:26.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 -- start start 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fb406bcd0 0x7f4fb40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb415d7e0 con 0x7f4fb415df50 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb415dac0 con 0x7f4fb406c0a0 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.518+0000 7f4fbb039700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb415aa30 con 0x7f4fb406bcd0 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb95d6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4fb415df50 0x7f4fb40c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35094/0 (socket says 172.21.15.46:35094) 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb95d6700 1 -- 172.21.15.46:0/2400262848 learned_addr learned my addr 172.21.15.46:0/2400262848 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb8dd5700 1 --2- 172.21.15.46:0/2400262848 >> v2:172.21.15.133:3300/0 conn(0x7f4fb406bcd0 0x7f4fb40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160127492 0 0) 0x7f4fb415d7e0 con 0x7f4fb415df50 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f9c003570 con 0x7f4fb415df50 2023-10-07T09:05:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399159066 0 0) 0x7f4f9c003570 con 0x7f4fb415df50 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 >> v2:172.21.15.133:3300/0 conn(0x7f4fb406bcd0 msgr2=0x7f4fb40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 --2- 172.21.15.46:0/2400262848 >> v2:172.21.15.133:3300/0 conn(0x7f4fb406bcd0 0x7f4fb40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 >> v1:172.21.15.133:6789/0 conn(0x7f4fb406c0a0 legacy=0x7f4fb415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb415ad10 con 0x7f4fb415df50 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4fa4001470 con 0x7f4fb415df50 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 >> v1:172.21.15.46:6789/0 conn(0x7f4fb415df50 legacy=0x7f4fb40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f9c003a60 0x7f4f9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4f9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c0052e0 0x7f4f9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb415aa30 con 0x7f4f9c004810 2023-10-07T09:05:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00c2a0 con 0x7f4f9c0052e0 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00c460 con 0x7f4f9c003a60 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4f9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.519+0000 7f4fb8dd5700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f9c003a60 0x7f4f9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb95d6700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c0052e0 0x7f4f9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 -- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f9c003a60 msgr2=0x7f4f9c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f9c003a60 0x7f4f9c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 -- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c0052e0 msgr2=0x7f4f9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c0052e0 0x7f4f9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 -- 172.21.15.46:0/2400262848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c003570 con 0x7f4f9c004810 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb95d6700 1 -- 172.21.15.46:0/2400262848 reap_dead start 2023-10-07T09:05:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4f9c004c80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af886dff8de0741 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8012420 con 0x7f4f9c004810 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80125a0 con 0x7f4f9c004810 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.520+0000 7f4fb37fe700 1 -- 172.21.15.46:0/2400262848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8012960 con 0x7f4f9c004810 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 -- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 msgr2=0x7f4f9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4f9c004c80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8007d30 comp rx=0 tx=0).stop 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 -- 172.21.15.46:0/2400262848 shutdown_connections 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 --2- 172.21.15.46:0/2400262848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4f9c004c80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 -- 172.21.15.46:0/2400262848 >> 172.21.15.46:0/2400262848 conn(0x7f4fb40ce600 msgr2=0x7f4fb40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 -- 172.21.15.46:0/2400262848 shutdown_connections 2023-10-07T09:05:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.521+0000 7f4fbb039700 1 -- 172.21.15.46:0/2400262848 wait complete. 2023-10-07T09:05:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.522+0000 7f4fbb039700 1 Processor -- start 2023-10-07T09:05:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.522+0000 7f4fbb039700 1 -- start start 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 0x7f4fb40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 0x7f4fb4158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb40c6060 con 0x7f4f9c004810 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4159200 con 0x7f4fb40c56b0 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41594e0 con 0x7f4fb41584f0 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52240/0 (socket says 172.21.15.46:52240) 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 -- 172.21.15.46:0/224621264 learned_addr learned my addr 172.21.15.46:0/224621264 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 0x7f4fb40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb95d6700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 0x7f4fb4158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 -- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 msgr2=0x7f4fb4158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 0x7f4fb4158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 -- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 msgr2=0x7f4fb40c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 0x7f4fb40c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 -- 172.21.15.46:0/224621264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb41597c0 con 0x7f4f9c004810 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 0x7f4fb40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb95d6700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 0x7f4fb4158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb8dd5700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4fac011f80 tx=0x7f4fac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00e040 con 0x7f4f9c004810 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x7f4f9c004810 2023-10-07T09:05:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb4159aa0 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.523+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac015430 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.524+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb4158eb0 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.524+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb4159f40 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.525+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4fac0157e0 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.525+0000 7f4fb0ff9700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 0x7f4fa00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.525+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f4fac086230 con 0x7f4f9c004810 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.525+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 0x7f4fa00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.526+0000 7f4fb3fff700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 0x7f4fa00697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.530+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fac056140 con 0x7f4f9c004810 2023-10-07T09:05:26.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:26.749+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000905168", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fb404c3c0 con 0x7f4fa0067320 2023-10-07T09:05:26.754 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:05:26.753+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:05:26.758 INFO:tasks.ceph.mds.a.smithi046.stderr: -37> 2023-10-07T09:05:25.929+0000 7efde9c83700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:05:26.778 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:05:29.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.776+0000 7f4fb0ff9700 1 -- 172.21.15.46:0/224621264 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f4fb404c3c0 con 0x7f4fa0067320 2023-10-07T09:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout:metadata pool: cephfs.volume_0000000000905168.meta data pool: ['cephfs.volume_0000000000905168.data'] removed 2023-10-07T09:05:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 msgr2=0x7f4fa00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 0x7f4fa00697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8015000 comp rx=0 tx=0).stop 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 msgr2=0x7f4fb4143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4fac011f80 tx=0x7f4fac00b040 comp rx=0 tx=0).stop 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 shutdown_connections 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4fa0067320 0x7f4fa00697d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fb41584f0 0x7f4fb4158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f9c004810 0x7f4fb4143150 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:30.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 --2- 172.21.15.46:0/224621264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb40c56b0 0x7f4fb40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:30.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 >> 172.21.15.46:0/224621264 conn(0x7f4fb40ce600 msgr2=0x7f4fb41553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:30.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 shutdown_connections 2023-10-07T09:05:30.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:29.780+0000 7f4fbb039700 1 -- 172.21.15.46:0/224621264 wait complete. 2023-10-07T09:05:30.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000905169 --yes-i-really-mean-it 2023-10-07T09:05:30.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.990+0000 7f4d8f1ca700 1 Processor -- start 2023-10-07T09:05:31.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.990+0000 7f4d8f1ca700 1 -- start start 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.990+0000 7f4d8f1ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 0x7f4d880caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.990+0000 7f4d8f1ca700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d8806c0a0 0x7f4d8815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8f1ca700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8815d7e0 con 0x7f4d8815df50 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8f1ca700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8815dac0 con 0x7f4d8806c0a0 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8f1ca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8815aa30 con 0x7f4d8806bcd0 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d8806c0a0 0x7f4d8815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8d767700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4d8815df50 0x7f4d880c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44564/0 (socket says 172.21.15.46:44564) 2023-10-07T09:05:31.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8d767700 1 -- 172.21.15.46:0/3922620457 learned_addr learned my addr 172.21.15.46:0/3922620457 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8cf66700 1 --2- 172.21.15.46:0/3922620457 >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 0x7f4d880caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 -- 172.21.15.46:0/3922620457 >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 msgr2=0x7f4d880caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 --2- 172.21.15.46:0/3922620457 >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 0x7f4d880caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 -- 172.21.15.46:0/3922620457 >> v1:172.21.15.46:6789/0 conn(0x7f4d8815df50 legacy=0x7f4d880c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 -- 172.21.15.46:0/3922620457 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8815ad10 con 0x7f4d8806c0a0 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d877fe700 1 -- 172.21.15.46:0/3922620457 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910999186 0 0) 0x7f4d8815d7e0 con 0x7f4d8815df50 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d8cf66700 1 --2- 172.21.15.46:0/3922620457 >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 0x7f4d880caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d87fff700 1 --2- 172.21.15.46:0/3922620457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8806c0a0 0x7f4d8815a1e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4d880691a0 tx=0x7f4d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeee3240f4a6bf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d877fe700 1 -- 172.21.15.46:0/3922620457 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800b6b0 con 0x7f4d8806c0a0 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d877fe700 1 -- 172.21.15.46:0/3922620457 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800b810 con 0x7f4d8806c0a0 2023-10-07T09:05:31.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.991+0000 7f4d877fe700 1 -- 172.21.15.46:0/3922620457 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800bbb0 con 0x7f4d8806c0a0 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/3922620457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8806c0a0 msgr2=0x7f4d8815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/3922620457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8806c0a0 0x7f4d8815a1e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4d880691a0 tx=0x7f4d780091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/3922620457 shutdown_connections 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/3922620457 >> v2:172.21.15.133:3300/0 conn(0x7f4d8806bcd0 0x7f4d880caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/3922620457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8806c0a0 0x7f4d8815a1e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/3922620457 >> 172.21.15.46:0/3922620457 conn(0x7f4d880ce600 msgr2=0x7f4d880cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/3922620457 shutdown_connections 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.992+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/3922620457 wait complete. 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.993+0000 7f4d8f1ca700 1 Processor -- start 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.993+0000 7f4d8f1ca700 1 -- start start 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d8806bcd0 0x7f4d880b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 0x7f4d880c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b42d0 con 0x7f4d8815df50 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d88146b80 con 0x7f4d8806bcd0 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8f1ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880c8060 con 0x7f4d8806c0a0 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56280/0 (socket says 172.21.15.46:56280) 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 -- 172.21.15.46:0/2562054539 learned_addr learned my addr 172.21.15.46:0/2562054539 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8cf66700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d8806bcd0 0x7f4d880b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d87fff700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 0x7f4d880c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 -- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 msgr2=0x7f4d880c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:31.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 0x7f4d880c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 -- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d8806bcd0 msgr2=0x7f4d880b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d8806bcd0 0x7f4d880b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d8d767700 1 -- 172.21.15.46:0/2562054539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009420 con 0x7f4d8815df50 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.994+0000 7f4d87fff700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 0x7f4d880c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d8d767700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000cc90 tx=0x7f4d80001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000a960 con 0x7f4d8815df50 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000aac0 con 0x7f4d8815df50 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d880c4c00 con 0x7f4d8815df50 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000ae80 con 0x7f4d8815df50 2023-10-07T09:05:31.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.995+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d880c7d70 con 0x7f4d8815df50 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.996+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d880b2340 con 0x7f4d8815df50 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.996+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4d80007300 con 0x7f4d8815df50 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.997+0000 7f4d84ff9700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 0x7f4d680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.997+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f4d80085430 con 0x7f4d8815df50 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.997+0000 7f4d8cf66700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 0x7f4d680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:30.997+0000 7f4d8cf66700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 0x7f4d680697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4d70006f00 tx=0x7f4d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:31.001+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d80051d60 con 0x7f4d8815df50 2023-10-07T09:05:31.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:31.222+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000905169", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d880c81a0 con 0x7f4d68067320 2023-10-07T09:05:31.315 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:05:31.315 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:05:31.227+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:05:34.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.245+0000 7f4d84ff9700 1 -- 172.21.15.46:0/2562054539 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f4d880c81a0 con 0x7f4d68067320 2023-10-07T09:05:34.247 INFO:teuthology.orchestra.run.smithi046.stdout:metadata pool: cephfs.volume_0000000000905169.meta data pool: ['cephfs.volume_0000000000905169.data'] removed 2023-10-07T09:05:34.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 msgr2=0x7f4d680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 0x7f4d680697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4d70006f00 tx=0x7f4d70008040 comp rx=0 tx=0).stop 2023-10-07T09:05:34.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 msgr2=0x7f4d880c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000cc90 tx=0x7f4d80001a80 comp rx=0 tx=0).stop 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 shutdown_connections 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4d68067320 0x7f4d680697d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d8815df50 0x7f4d880c5bf0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d8806bcd0 0x7f4d880b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 --2- 172.21.15.46:0/2562054539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8806c0a0 0x7f4d880c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 >> 172.21.15.46:0/2562054539 conn(0x7f4d880ce600 msgr2=0x7f4d88156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.248+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 shutdown_connections 2023-10-07T09:05:34.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.249+0000 7f4d8f1ca700 1 -- 172.21.15.46:0/2562054539 wait complete. 2023-10-07T09:05:34.264 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:05:34.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:34.307 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:34.351 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:05:34.351 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:05:34.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:05:34.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:34.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:05:34.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:34.395 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:05:34.451 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:05:34.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:05:34.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:34.492 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:05:34.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:34.492 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:05:34.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.674+0000 7fd8622ba700 1 Processor -- start 2023-10-07T09:05:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.674+0000 7fd8622ba700 1 -- start start 2023-10-07T09:05:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd8622ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd85c159420 0x7fd85c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd8622ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0b2980 con 0x7fd85c1597f0 2023-10-07T09:05:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd8622ba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0b11d0 con 0x7fd85c15d230 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd8622ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c0b14b0 con 0x7fd85c159420 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd860ab7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd85c1597f0 0x7fd85c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44572/0 (socket says 172.21.15.46:44572) 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd860ab7700 1 -- 172.21.15.46:0/4111366021 learned_addr learned my addr 172.21.15.46:0/4111366021 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900630408 0 0) 0x7fd85c0b2980 con 0x7fd85c1597f0 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd8612b8700 1 --2- 172.21.15.46:0/4111366021 >> v2:172.21.15.133:3300/0 conn(0x7fd85c159420 0x7fd85c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.675+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003570 con 0x7fd85c1597f0 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20416336 0 0) 0x7fd844003570 con 0x7fd85c1597f0 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 >> v2:172.21.15.133:3300/0 conn(0x7fd85c159420 msgr2=0x7fd85c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 --2- 172.21.15.46:0/4111366021 >> v2:172.21.15.133:3300/0 conn(0x7fd85c159420 0x7fd85c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 >> v1:172.21.15.133:6789/0 conn(0x7fd85c15d230 legacy=0x7fd85c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0b1790 con 0x7fd85c1597f0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd850001470 con 0x7fd85c1597f0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 >> v1:172.21.15.46:6789/0 conn(0x7fd85c1597f0 legacy=0x7fd85c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b14b0 con 0x7fd8440051c0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c0d0 con 0x7fd844004810 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c290 con 0x7fd844003a60 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd8612b8700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd860ab7700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 -- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd844003a60 msgr2=0x7fd844003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 -- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd844004810 msgr2=0x7fd844004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 -- 172.21.15.46:0/4111366021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003570 con 0x7fd8440051c0 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 -- 172.21.15.46:0/4111366021 reap_dead start 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.676+0000 7fd861ab9700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001f90 tx=0x7fd84c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7159621782a679 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c001950 con 0x7fd8440051c0 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00c8b0 con 0x7fd8440051c0 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd85bfff700 1 -- 172.21.15.46:0/4111366021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00cc50 con 0x7fd8440051c0 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 -- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 msgr2=0x7fd84400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001f90 tx=0x7fd84c001640 comp rx=0 tx=0).stop 2023-10-07T09:05:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 -- 172.21.15.46:0/4111366021 shutdown_connections 2023-10-07T09:05:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 --2- 172.21.15.46:0/4111366021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 -- 172.21.15.46:0/4111366021 >> 172.21.15.46:0/4111366021 conn(0x7fd85c0d0660 msgr2=0x7fd85c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 -- 172.21.15.46:0/4111366021 shutdown_connections 2023-10-07T09:05:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.677+0000 7fd8622ba700 1 -- 172.21.15.46:0/4111366021 wait complete. 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.678+0000 7fd8622ba700 1 Processor -- start 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.678+0000 7fd8622ba700 1 -- start start 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8440051c0 0x7fd85c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd85c0b5e70 0x7fd85c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b62f0 con 0x7fd85c0cc050 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c169db0 con 0x7fd8440051c0 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8622ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1523d0 con 0x7fd85c0b5e70 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd860ab7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd860ab7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56310/0 (socket says 172.21.15.46:56310) 2023-10-07T09:05:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd860ab7700 1 -- 172.21.15.46:0/1299712205 learned_addr learned my addr 172.21.15.46:0/1299712205 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.679+0000 7fd8612b8700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8440051c0 0x7fd85c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd861ab9700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd85c0b5e70 0x7fd85c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 -- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd85c0b5e70 msgr2=0x7fd85c1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd85c0b5e70 0x7fd85c1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 -- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8440051c0 msgr2=0x7fd85c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8440051c0 0x7fd85c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 -- 172.21.15.46:0/1299712205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c1526b0 con 0x7fd85c0cc050 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd860ab7700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd850007390 tx=0x7fd850001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011590 con 0x7fd85c0cc050 2023-10-07T09:05:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8500116f0 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c152990 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011a90 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.680+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c151be0 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.681+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c169f40 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.682+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd85001d460 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.682+0000 7fd8597fa700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 0x7fd8480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.682+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fd850084da0 con 0x7fd85c0cc050 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.682+0000 7fd8612b8700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 0x7fd8480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.683+0000 7fd8612b8700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 0x7fd8480697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd854006f00 tx=0x7fd8540091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.686+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd850051980 con 0x7fd85c0cc050 2023-10-07T09:05:34.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.922+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd85c04c3c0 con 0x7fd85c0cc050 2023-10-07T09:05:34.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.923+0000 7fd8597fa700 1 -- 172.21.15.46:0/1299712205 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd850054fa0 con 0x7fd85c0cc050 2023-10-07T09:05:34.924 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:34.924 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1467440491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1467440491},{"type":"v1","addr":"172.21.15.133:6837","nonce":1467440491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2310694783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2310694783},{"type":"v1","addr":"172.21.15.46:6834","nonce":2310694783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 msgr2=0x7fd8480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 0x7fd8480697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd854006f00 tx=0x7fd8540091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 msgr2=0x7fd85c0b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd850007390 tx=0x7fd850001e50 comp rx=0 tx=0).stop 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 shutdown_connections 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd848067320 0x7fd8480697d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd85c0b5e70 0x7fd85c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8440051c0 0x7fd85c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 --2- 172.21.15.46:0/1299712205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd85c0cc050 0x7fd85c0b5930 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 >> 172.21.15.46:0/1299712205 conn(0x7fd85c0d0660 msgr2=0x7fd85c1577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 shutdown_connections 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:34.925+0000 7fd8622ba700 1 -- 172.21.15.46:0/1299712205 wait complete. 2023-10-07T09:05:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 84 2023-10-07T09:05:34.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.056+0000 7f4bf2433700 1 Processor -- start 2023-10-07T09:05:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.056+0000 7f4bf2433700 1 -- start start 2023-10-07T09:05:35.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf2433700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4bec06bcd0 0x7f4bec140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf2433700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bec0c9510 0x7f4bec141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf2433700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec15c2a0 con 0x7f4bec06c0a0 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf2433700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0c9900 con 0x7f4bec0c9510 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf2433700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec15b690 con 0x7f4bec06bcd0 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf09d0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bec0c9510 0x7f4bec141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf09d0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bec0c9510 0x7f4bec141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56324/0 (socket says 172.21.15.46:56324) 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.057+0000 7f4bf09d0700 1 -- 172.21.15.46:0/4018941815 learned_addr learned my addr 172.21.15.46:0/4018941815 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bebfff700 1 --2- 172.21.15.46:0/4018941815 >> v2:172.21.15.133:3300/0 conn(0x7f4bec06bcd0 0x7f4bec140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bf09d0700 1 -- 172.21.15.46:0/4018941815 >> v2:172.21.15.133:3300/0 conn(0x7f4bec06bcd0 msgr2=0x7f4bec140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bf09d0700 1 --2- 172.21.15.46:0/4018941815 >> v2:172.21.15.133:3300/0 conn(0x7f4bec06bcd0 0x7f4bec140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bf09d0700 1 -- 172.21.15.46:0/4018941815 >> v1:172.21.15.133:6789/0 conn(0x7f4bec06c0a0 legacy=0x7f4bec0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bf09d0700 1 -- 172.21.15.46:0/4018941815 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec15b970 con 0x7f4bec0c9510 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4bf09d0700 1 --2- 172.21.15.46:0/4018941815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec141330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0cafd0 tx=0x7f4be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6114846d0fb3ba55 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4beaffd700 1 -- 172.21.15.46:0/4018941815 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be400e070 con 0x7f4bec0c9510 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4beaffd700 1 -- 172.21.15.46:0/4018941815 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be400ba50 con 0x7f4bec0c9510 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.058+0000 7f4beaffd700 1 -- 172.21.15.46:0/4018941815 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40092e0 con 0x7f4bec0c9510 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 -- 172.21.15.46:0/4018941815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 msgr2=0x7f4bec141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 --2- 172.21.15.46:0/4018941815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec141330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0cafd0 tx=0x7f4be4009840 comp rx=0 tx=0).stop 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 -- 172.21.15.46:0/4018941815 shutdown_connections 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 --2- 172.21.15.46:0/4018941815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec141330 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 --2- 172.21.15.46:0/4018941815 >> v2:172.21.15.133:3300/0 conn(0x7f4bec06bcd0 0x7f4bec140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 -- 172.21.15.46:0/4018941815 >> 172.21.15.46:0/4018941815 conn(0x7f4bec0ce600 msgr2=0x7f4bec0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 -- 172.21.15.46:0/4018941815 shutdown_connections 2023-10-07T09:05:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.059+0000 7f4bf2433700 1 -- 172.21.15.46:0/4018941815 wait complete. 2023-10-07T09:05:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.060+0000 7f4bf2433700 1 Processor -- start 2023-10-07T09:05:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.060+0000 7f4bf2433700 1 -- start start 2023-10-07T09:05:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bec06bcd0 0x7f4bec06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 0x7f4bec15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0699c0 con 0x7f4bec0c9510 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec069bf0 con 0x7f4bec06c0a0 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec069ed0 con 0x7f4bec06bcd0 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56328/0 (socket says 172.21.15.46:56328) 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 -- 172.21.15.46:0/2016278329 learned_addr learned my addr 172.21.15.46:0/2016278329 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bebfff700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bec06bcd0 0x7f4bec06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4beb7fe700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 0x7f4bec15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 -- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bec06bcd0 msgr2=0x7f4bec06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bec06bcd0 0x7f4bec06ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 -- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 msgr2=0x7f4bec15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 0x7f4bec15a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 -- 172.21.15.46:0/2016278329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009ae0 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4beb7fe700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 0x7f4bec15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf09d0700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4bec069220 tx=0x7f4be4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4008e40 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4025460 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec06a1b0 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4025820 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.061+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec06a770 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.062+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec04c3c0 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.063+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4be4003040 con 0x7f4bec0c9510 2023-10-07T09:05:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.063+0000 7f4bd3fff700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 0x7f4bd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.063+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f4be4086b80 con 0x7f4bec0c9510 2023-10-07T09:05:35.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.063+0000 7f4bebfff700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 0x7f4bd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.064+0000 7f4bebfff700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 0x7f4bd80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.067+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4be4053650 con 0x7f4bec0c9510 2023-10-07T09:05:35.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.265+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bec06c9d0 con 0x7f4bec0c9510 2023-10-07T09:05:35.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.266+0000 7f4bd3fff700 1 -- 172.21.15.46:0/2016278329 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15623 (secure 0 0 0) 0x7f4be4056c70 con 0x7f4bec0c9510 2023-10-07T09:05:35.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:35.267 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:34.232259+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.133:6835/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.46:6834/2721491248":"2023-10-08T09:05:26.754183+0000","172.21.15.46:6832/2721491248":"2023-10-08T09:05:26.754183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 msgr2=0x7f4bd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 0x7f4bd80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc008040 comp rx=0 tx=0).stop 2023-10-07T09:05:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 msgr2=0x7f4bec069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4bec069220 tx=0x7f4be4018000 comp rx=0 tx=0).stop 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 shutdown_connections 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4bd8067320 0x7f4bd80697d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bec0c9510 0x7f4bec069480 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bec06bcd0 0x7f4bec06ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 --2- 172.21.15.46:0/2016278329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bec06c0a0 0x7f4bec15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 >> 172.21.15.46:0/2016278329 conn(0x7f4bec0ce600 msgr2=0x7f4bec0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 shutdown_connections 2023-10-07T09:05:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.268+0000 7f4bf2433700 1 -- 172.21.15.46:0/2016278329 wait complete. 2023-10-07T09:05:35.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:05:08.097714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:05:08.661193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:05:35.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:05:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.403+0000 7f662aedc700 1 Processor -- start 2023-10-07T09:05:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.403+0000 7f662aedc700 1 -- start start 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f662aedc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6624069560 0x7f66240699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f662aedc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6624069ee0 con 0x7f6624159c60 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f662aedc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662415a160 con 0x7f6624159890 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f662aedc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66240d13a0 con 0x7f6624069560 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6629479700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6624069560 0x7f66240699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6623fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6624159c60 0x7f662415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44580/0 (socket says 172.21.15.46:44580) 2023-10-07T09:05:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6623fff700 1 -- 172.21.15.46:0/1636804754 learned_addr learned my addr 172.21.15.46:0/1636804754 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6629479700 1 -- 172.21.15.46:0/1636804754 >> v1:172.21.15.133:6789/0 conn(0x7f6624159890 legacy=0x7f662415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6629479700 1 -- 172.21.15.46:0/1636804754 >> v1:172.21.15.46:6789/0 conn(0x7f6624159c60 legacy=0x7f662415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f66237fe700 1 -- 172.21.15.46:0/1636804754 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837915873 0 0) 0x7f6624069ee0 con 0x7f6624159c60 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6629479700 1 -- 172.21.15.46:0/1636804754 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662415e140 con 0x7f6624069560 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f6629479700 1 --2- 172.21.15.46:0/1636804754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624069560 0x7f66240699a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f661c009e60 tx=0x7f661c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89a5835f7c47fde server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f66237fe700 1 -- 172.21.15.46:0/1636804754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00e070 con 0x7f6624069560 2023-10-07T09:05:35.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f66237fe700 1 -- 172.21.15.46:0/1636804754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00bbf0 con 0x7f6624069560 2023-10-07T09:05:35.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.404+0000 7f66237fe700 1 -- 172.21.15.46:0/1636804754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c012430 con 0x7f6624069560 2023-10-07T09:05:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 -- 172.21.15.46:0/1636804754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624069560 msgr2=0x7f66240699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 --2- 172.21.15.46:0/1636804754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624069560 0x7f66240699a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f661c009e60 tx=0x7f661c009780 comp rx=0 tx=0).stop 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 -- 172.21.15.46:0/1636804754 shutdown_connections 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 --2- 172.21.15.46:0/1636804754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624069560 0x7f66240699a0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 -- 172.21.15.46:0/1636804754 >> 172.21.15.46:0/1636804754 conn(0x7f6624068e20 msgr2=0x7f66240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 -- 172.21.15.46:0/1636804754 shutdown_connections 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.405+0000 7f662aedc700 1 -- 172.21.15.46:0/1636804754 wait complete. 2023-10-07T09:05:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.406+0000 7f662aedc700 1 Processor -- start 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.406+0000 7f662aedc700 1 -- start start 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 0x7f6624152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6624159890 0x7f662416d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662416a0b0 con 0x7f6624159c60 2023-10-07T09:05:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66241532b0 con 0x7f6624069560 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f662aedc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6624152720 con 0x7f6624159890 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56356/0 (socket says 172.21.15.46:56356) 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 -- 172.21.15.46:0/391813273 learned_addr learned my addr 172.21.15.46:0/391813273 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6623fff700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6624159890 0x7f662416d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6628c78700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 0x7f6624152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 -- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6624159890 msgr2=0x7f662416d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6624159890 0x7f662416d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.407+0000 7f6629479700 1 -- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 msgr2=0x7f6624152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6629479700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 0x7f6624152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6629479700 1 -- 172.21.15.46:0/391813273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c009a20 con 0x7f6624159c60 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6628c78700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 0x7f6624152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6629479700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f662406a070 tx=0x7f661c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c01e710 con 0x7f6624159c60 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c01e870 con 0x7f6624159c60 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6624151520 con 0x7f6624159c60 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c01ec30 con 0x7f6624159c60 2023-10-07T09:05:35.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.408+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6624151ae0 con 0x7f6624159c60 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.409+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662416a2e0 con 0x7f6624159c60 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.409+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f661c024070 con 0x7f6624159c60 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.410+0000 7f6620ff9700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 0x7f66100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.410+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f661c087900 con 0x7f6624159c60 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.410+0000 7f6628c78700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 0x7f66100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.411+0000 7f6628c78700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 0x7f66100697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6614007fd0 tx=0x7f6614009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.414+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f662416a2e0 con 0x7f6624159c60 2023-10-07T09:05:35.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.606+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f662416a2e0 con 0x7f6624159c60 2023-10-07T09:05:35.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.606+0000 7f6620ff9700 1 -- 172.21.15.46:0/391813273 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f661c02c020 con 0x7f6624159c60 2023-10-07T09:05:35.607 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:05:35.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 msgr2=0x7f66100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 0x7f66100697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6614007fd0 tx=0x7f6614009040 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 msgr2=0x7f66240c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f662406a070 tx=0x7f661c018000 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 shutdown_connections 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6610067320 0x7f66100697d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6624159c60 0x7f66240c5cd0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624069560 0x7f6624152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 --2- 172.21.15.46:0/391813273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6624159890 0x7f662416d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.608+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 >> 172.21.15.46:0/391813273 conn(0x7f6624068e20 msgr2=0x7f6624069930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.609+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 shutdown_connections 2023-10-07T09:05:35.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.609+0000 7f662aedc700 1 -- 172.21.15.46:0/391813273 wait complete. 2023-10-07T09:05:35.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:05:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.742+0000 7fca87fbe700 1 Processor -- start 2023-10-07T09:05:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.742+0000 7fca87fbe700 1 -- start start 2023-10-07T09:05:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.743+0000 7fca87fbe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca80159d60 0x7fca800b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.743+0000 7fca87fbe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 0x7fca8006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.743+0000 7fca87fbe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca800b4240 con 0x7fca80159990 2023-10-07T09:05:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.743+0000 7fca87fbe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800b4520 con 0x7fca80159d60 2023-10-07T09:05:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.743+0000 7fca87fbe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800b1540 con 0x7fca8015ac80 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca80159d60 0x7fca800b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca8655b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 0x7fca8006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca80159d60 0x7fca800b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:46948/0 (socket says 172.21.15.46:46948) 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca8655b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 0x7fca8006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:42814/0 (socket says 172.21.15.46:42814) 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 -- 172.21.15.46:0/3208443863 learned_addr learned my addr 172.21.15.46:0/3208443863 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85d5a700 1 --1- 172.21.15.46:0/3208443863 >> v1:172.21.15.133:6789/0 conn(0x7fca80159990 0x7fca800b2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:34668/0 (socket says 172.21.15.46:34668) 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 -- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 msgr2=0x7fca8006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 --2- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 0x7fca8006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 -- 172.21.15.46:0/3208443863 >> v1:172.21.15.133:6789/0 conn(0x7fca80159990 legacy=0x7fca800b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 -- 172.21.15.46:0/3208443863 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800b1820 con 0x7fca80159d60 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.744+0000 7fca85559700 1 --2- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159d60 0x7fca800b3c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca700099b0 tx=0x7fca70009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67bee3202b68b9e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca84d58700 1 -- 172.21.15.46:0/3208443863 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70009ea0 con 0x7fca80159d60 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca84d58700 1 -- 172.21.15.46:0/3208443863 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000b860 con 0x7fca80159d60 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca84d58700 1 -- 172.21.15.46:0/3208443863 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000bc00 con 0x7fca80159d60 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 -- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159d60 msgr2=0x7fca800b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 --2- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159d60 0x7fca800b3c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca700099b0 tx=0x7fca70009250 comp rx=0 tx=0).stop 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 -- 172.21.15.46:0/3208443863 shutdown_connections 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 --2- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca8015ac80 0x7fca8006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 --2- 172.21.15.46:0/3208443863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159d60 0x7fca800b3c40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 -- 172.21.15.46:0/3208443863 >> 172.21.15.46:0/3208443863 conn(0x7fca8006bb50 msgr2=0x7fca8006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 -- 172.21.15.46:0/3208443863 shutdown_connections 2023-10-07T09:05:35.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.745+0000 7fca87fbe700 1 -- 172.21.15.46:0/3208443863 wait complete. 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.746+0000 7fca87fbe700 1 Processor -- start 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.746+0000 7fca87fbe700 1 -- start start 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159990 0x7fca80155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca80159d60 0x7fca801460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800adfa0 con 0x7fca8015ac80 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800aee00 con 0x7fca80159990 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca87fbe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800ae1f0 con 0x7fca80159d60 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca8655b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca85d5a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159990 0x7fca80155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca8655b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56364/0 (socket says 172.21.15.46:56364) 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca8655b700 1 -- 172.21.15.46:0/2191293264 learned_addr learned my addr 172.21.15.46:0/2191293264 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.747+0000 7fca85559700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca80159d60 0x7fca801460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 -- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca80159d60 msgr2=0x7fca801460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca80159d60 0x7fca801460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 -- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159990 msgr2=0x7fca80155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159990 0x7fca80155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 -- 172.21.15.46:0/2191293264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700094f0 con 0x7fca8015ac80 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca8655b700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fca78009e90 tx=0x7fca7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800cb70 con 0x7fca8015ac80 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800f040 con 0x7fca8015ac80 2023-10-07T09:05:35.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca800ae4d0 con 0x7fca8015ac80 2023-10-07T09:05:35.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78014480 con 0x7fca8015ac80 2023-10-07T09:05:35.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.748+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca800aea90 con 0x7fca8015ac80 2023-10-07T09:05:35.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.749+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca800aef70 con 0x7fca8015ac80 2023-10-07T09:05:35.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.750+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fca78014830 con 0x7fca8015ac80 2023-10-07T09:05:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.750+0000 7fca75ffb700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.750+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fca78085700 con 0x7fca8015ac80 2023-10-07T09:05:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.750+0000 7fca85d5a700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.751+0000 7fca85d5a700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fca7c004fd0 tx=0x7fca7c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:35.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.754+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca780522d0 con 0x7fca8015ac80 2023-10-07T09:05:35.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.946+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca8004c3c0 con 0x7fca8015ac80 2023-10-07T09:05:35.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.947+0000 7fca75ffb700 1 -- 172.21.15.46:0/2191293264 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca780558f0 con 0x7fca8015ac80 2023-10-07T09:05:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 msgr2=0x7fca640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fca7c004fd0 tx=0x7fca7c007eb0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 msgr2=0x7fca8015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fca78009e90 tx=0x7fca7800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 shutdown_connections 2023-10-07T09:05:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca8015ac80 0x7fca8015e5d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80159990 0x7fca80155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 --2- 172.21.15.46:0/2191293264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca80159d60 0x7fca801460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 >> 172.21.15.46:0/2191293264 conn(0x7fca8006bb50 msgr2=0x7fca80154230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 shutdown_connections 2023-10-07T09:05:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:35.949+0000 7fca87fbe700 1 -- 172.21.15.46:0/2191293264 wait complete. 2023-10-07T09:05:35.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:05:36.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.082+0000 7f0074ec9700 1 Processor -- start 2023-10-07T09:05:36.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.082+0000 7f0074ec9700 1 -- start start 2023-10-07T09:05:36.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f0074ec9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0070141500 0x7f00700c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f0074ec9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007015c2a0 con 0x7f007006bcd0 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f0074ec9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007015b690 con 0x7f007006c0a0 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f0074ec9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007015b970 con 0x7f0070141500 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f006dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0070141500 0x7f00700c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0070141500 0x7f00700c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56378/0 (socket says 172.21.15.46:56378) 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.083+0000 7f006e59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f007006bcd0 0x7f0070140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44588/0 (socket says 172.21.15.46:44588) 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 -- 172.21.15.46:0/2858936832 learned_addr learned my addr 172.21.15.46:0/2858936832 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 -- 172.21.15.46:0/2858936832 >> v1:172.21.15.133:6789/0 conn(0x7f007006c0a0 legacy=0x7f00700c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 -- 172.21.15.46:0/2858936832 >> v1:172.21.15.46:6789/0 conn(0x7f007006bcd0 legacy=0x7f0070140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 -- 172.21.15.46:0/2858936832 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007015bc50 con 0x7f0070141500 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006dd9b700 1 --2- 172.21.15.46:0/2858936832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f00700c8e00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bb631cd3e4636 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006d59a700 1 -- 172.21.15.46:0/2858936832 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800b820 con 0x7f0070141500 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006d59a700 1 -- 172.21.15.46:0/2858936832 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800b980 con 0x7f0070141500 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.084+0000 7f006d59a700 1 -- 172.21.15.46:0/2858936832 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800bd20 con 0x7f0070141500 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 -- 172.21.15.46:0/2858936832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 msgr2=0x7f00700c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 --2- 172.21.15.46:0/2858936832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f00700c8e00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058009250 comp rx=0 tx=0).stop 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 -- 172.21.15.46:0/2858936832 shutdown_connections 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 --2- 172.21.15.46:0/2858936832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f00700c8e00 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 -- 172.21.15.46:0/2858936832 >> 172.21.15.46:0/2858936832 conn(0x7f00700ce600 msgr2=0x7f00700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 -- 172.21.15.46:0/2858936832 shutdown_connections 2023-10-07T09:05:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.085+0000 7f0074ec9700 1 -- 172.21.15.46:0/2858936832 wait complete. 2023-10-07T09:05:36.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.086+0000 7f0074ec9700 1 Processor -- start 2023-10-07T09:05:36.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.086+0000 7f0074ec9700 1 -- start start 2023-10-07T09:05:36.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f007006bcd0 0x7f007016a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f007006c0a0 0x7f0070159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007016a620 con 0x7f0070141500 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00700696b0 con 0x7f007006c0a0 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f0074ec9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070069990 con 0x7f007006bcd0 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56394/0 (socket says 172.21.15.46:56394) 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 -- 172.21.15.46:0/1695159875 learned_addr learned my addr 172.21.15.46:0/1695159875 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 -- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f007006bcd0 msgr2=0x7f007016a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006e59c700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f007006bcd0 0x7f007016a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006dd9b700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f007006c0a0 0x7f0070159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f007006bcd0 0x7f007016a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 -- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f007006c0a0 msgr2=0x7f0070159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f007006c0a0 0x7f0070159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 -- 172.21.15.46:0/1695159875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580094f0 con 0x7f0070141500 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f006ed9d700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f006000bbb0 tx=0x7f0060009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.087+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600092e0 con 0x7f0070141500 2023-10-07T09:05:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.088+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006000c7a0 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.088+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070069c70 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.088+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000cb40 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.088+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007006a230 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.088+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007004c3c0 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.089+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0060012070 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.089+0000 7f00667fc700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 0x7f00500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.089+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f0060084a60 con 0x7f0070141500 2023-10-07T09:05:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.090+0000 7f006e59c700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 0x7f00500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.090+0000 7f006e59c700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 0x7f00500697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0068000c00 tx=0x7f0068009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.093+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0060051640 con 0x7f0070141500 2023-10-07T09:05:36.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.287+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f007015bf30 con 0x7f0070141500 2023-10-07T09:05:36.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.287+0000 7f00667fc700 1 -- 172.21.15.46:0/1695159875 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0060054c60 con 0x7f0070141500 2023-10-07T09:05:36.288 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:05:36.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 msgr2=0x7f00500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 0x7f00500697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0068000c00 tx=0x7f0068009040 comp rx=0 tx=0).stop 2023-10-07T09:05:36.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 msgr2=0x7f007015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f006000bbb0 tx=0x7f0060009840 comp rx=0 tx=0).stop 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 shutdown_connections 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0050067320 0x7f00500697d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0070141500 0x7f007015a1a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f007006bcd0 0x7f007016a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 --2- 172.21.15.46:0/1695159875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f007006c0a0 0x7f0070159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 >> 172.21.15.46:0/1695159875 conn(0x7f00700ce600 msgr2=0x7f0070140df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 shutdown_connections 2023-10-07T09:05:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.289+0000 7f0074ec9700 1 -- 172.21.15.46:0/1695159875 wait complete. 2023-10-07T09:05:36.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:36.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.420+0000 7f4e0f9a8700 1 Processor -- start 2023-10-07T09:05:36.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0f9a8700 1 -- start start 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0f9a8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e08141500 0x7f4e080c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0f9a8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0815c2a0 con 0x7f4e0806c0a0 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0f9a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0815b690 con 0x7f4e0806bcd0 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0f9a8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0815b970 con 0x7f4e08141500 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0cf43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e08141500 0x7f4e080c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.421+0000 7f4e0df45700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e0806c0a0 0x7f4e080c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44604/0 (socket says 172.21.15.46:44604) 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0cf43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e08141500 0x7f4e080c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56406/0 (socket says 172.21.15.46:56406) 2023-10-07T09:05:36.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0df45700 1 -- 172.21.15.46:0/1214054556 learned_addr learned my addr 172.21.15.46:0/1214054556 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0cf43700 1 -- 172.21.15.46:0/1214054556 >> v1:172.21.15.133:6789/0 conn(0x7f4e0806bcd0 legacy=0x7f4e08140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0cf43700 1 -- 172.21.15.46:0/1214054556 >> v1:172.21.15.46:6789/0 conn(0x7f4e0806c0a0 legacy=0x7f4e080c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0cf43700 1 -- 172.21.15.46:0/1214054556 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0815bc50 con 0x7f4e08141500 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e0cf43700 1 --2- 172.21.15.46:0/1214054556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e080c8e00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098e0 tx=0x7f4dfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9107b7dddf54207b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e07fff700 1 -- 172.21.15.46:0/1214054556 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc009e80 con 0x7f4e08141500 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e07fff700 1 -- 172.21.15.46:0/1214054556 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc00b820 con 0x7f4e08141500 2023-10-07T09:05:36.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.422+0000 7f4e07fff700 1 -- 172.21.15.46:0/1214054556 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00bba0 con 0x7f4e08141500 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/1214054556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 msgr2=0x7f4e080c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/1214054556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e080c8e00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098e0 tx=0x7f4dfc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/1214054556 shutdown_connections 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/1214054556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e080c8e00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/1214054556 >> 172.21.15.46:0/1214054556 conn(0x7f4e080ce600 msgr2=0x7f4e080cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/1214054556 shutdown_connections 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.423+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/1214054556 wait complete. 2023-10-07T09:05:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.424+0000 7f4e0f9a8700 1 Processor -- start 2023-10-07T09:05:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.424+0000 7f4e0f9a8700 1 -- start start 2023-10-07T09:05:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e0806bcd0 0x7f4e080c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e0806c0a0 0x7f4e080b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080b33a0 con 0x7f4e08141500 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e081557d0 con 0x7f4e0806c0a0 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0f9a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080c6370 con 0x7f4e0806bcd0 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56408/0 (socket says 172.21.15.46:56408) 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 -- 172.21.15.46:0/2417763423 learned_addr learned my addr 172.21.15.46:0/2417763423 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 -- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e0806bcd0 msgr2=0x7f4e080c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e0806bcd0 0x7f4e080c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 -- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e0806c0a0 msgr2=0x7f4e080b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0cf43700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e0806c0a0 0x7f4e080b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e0806c0a0 0x7f4e080b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.425+0000 7f4e0df45700 1 -- 172.21.15.46:0/2417763423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009420 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e0df45700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4df800c590 tx=0x7f4df8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8005b30 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8005cb0 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e080c6610 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8007320 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.426+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e080b3650 con 0x7f4e08141500 2023-10-07T09:05:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.427+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0804c3c0 con 0x7f4e08141500 2023-10-07T09:05:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.427+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4df801b3b0 con 0x7f4e08141500 2023-10-07T09:05:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.428+0000 7f4e057fa700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 0x7f4df40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.428+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f4df8084250 con 0x7f4e08141500 2023-10-07T09:05:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.428+0000 7f4e0d744700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 0x7f4df40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.429+0000 7f4e0d744700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 0x7f4df40697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e00002d90 tx=0x7f4e00007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.432+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df8050e30 con 0x7f4e08141500 2023-10-07T09:05:36.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.667+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e0815bf30 con 0x7f4e08141500 2023-10-07T09:05:36.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.668+0000 7f4e057fa700 1 -- 172.21.15.46:0/2417763423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4df8017090 con 0x7f4e08141500 2023-10-07T09:05:36.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:36.669 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1467440491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1467440491},{"type":"v1","addr":"172.21.15.133:6837","nonce":1467440491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2310694783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2310694783},{"type":"v1","addr":"172.21.15.46:6834","nonce":2310694783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:36.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 msgr2=0x7f4df40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 0x7f4df40697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e00002d90 tx=0x7f4e00007ea0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 msgr2=0x7f4e08155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4df800c590 tx=0x7f4df8007ef0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 shutdown_connections 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4df4067320 0x7f4df40697d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e08141500 0x7f4e08155290 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e0806bcd0 0x7f4e080c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 --2- 172.21.15.46:0/2417763423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e0806c0a0 0x7f4e080b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 >> 172.21.15.46:0/2417763423 conn(0x7f4e080ce600 msgr2=0x7f4e080c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 shutdown_connections 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.670+0000 7f4e0f9a8700 1 -- 172.21.15.46:0/2417763423 wait complete. 2023-10-07T09:05:36.672 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 84 2023-10-07T09:05:36.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:36.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.800+0000 7f883c97a700 1 Processor -- start 2023-10-07T09:05:36.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.800+0000 7f883c97a700 1 -- start start 2023-10-07T09:05:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.801+0000 7f883c97a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8838068920 0x7f883806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.801+0000 7f883c97a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883806ec70 con 0x7f883806f640 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.801+0000 7f883c97a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380b2e70 con 0x7f8838068550 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.801+0000 7f883c97a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8838068d90 con 0x7f8838068920 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f8836d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f883806f640 0x7f8838159510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44614/0 (socket says 172.21.15.46:44614) 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f8836d9d700 1 -- 172.21.15.46:0/4164541248 learned_addr learned my addr 172.21.15.46:0/4164541248 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f8835d9b700 1 --2- 172.21.15.46:0/4164541248 >> v2:172.21.15.133:3300/0 conn(0x7f8838068920 0x7f883806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247937504 0 0) 0x7f883806ec70 con 0x7f883806f640 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003570 con 0x7f883806f640 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242439372 0 0) 0x7f88380b2e70 con 0x7f8838068550 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883806ec70 con 0x7f8838068550 2023-10-07T09:05:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26591831 0 0) 0x7f8824003570 con 0x7f883806f640 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 >> v2:172.21.15.133:3300/0 conn(0x7f8838068920 msgr2=0x7f883806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 --2- 172.21.15.46:0/4164541248 >> v2:172.21.15.133:3300/0 conn(0x7f8838068920 0x7f883806f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 >> v1:172.21.15.133:6789/0 conn(0x7f8838068550 legacy=0x7f883815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380b3150 con 0x7f883806f640 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f8830001470 con 0x7f883806f640 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 >> v1:172.21.15.46:6789/0 conn(0x7f883806f640 legacy=0x7f8838159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8824003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88240051c0 0x7f882400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838068d90 con 0x7f8824003bf0 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882400c160 con 0x7f8824004810 2023-10-07T09:05:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824014b30 con 0x7f88240051c0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f883659c700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8824003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f8835d9b700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.802+0000 7f8836d9d700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88240051c0 0x7f882400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 -- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88240051c0 msgr2=0x7f882400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88240051c0 0x7f882400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 -- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8824004810 msgr2=0x7f8824004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 -- 172.21.15.46:0/4164541248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824003570 con 0x7f8824003bf0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f8836d9d700 1 -- 172.21.15.46:0/4164541248 reap_dead start 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f8835d9b700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883659c700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8824003fe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f88280020f0 tx=0x7f88280017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d370c334d27ff5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828001ab0 con 0x7f8824003bf0 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828006ba0 con 0x7f8824003bf0 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883559a700 1 -- 172.21.15.46:0/4164541248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800c870 con 0x7f8824003bf0 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883c97a700 1 -- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 msgr2=0x7f8824003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.803+0000 7f883c97a700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8824003fe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f88280020f0 tx=0x7f88280017a0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.804+0000 7f883c97a700 1 -- 172.21.15.46:0/4164541248 shutdown_connections 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.804+0000 7f883c97a700 1 --2- 172.21.15.46:0/4164541248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8824003fe0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.804+0000 7f883c97a700 1 -- 172.21.15.46:0/4164541248 >> 172.21.15.46:0/4164541248 conn(0x7f88380cd480 msgr2=0x7f88380cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.804+0000 7f883c97a700 1 -- 172.21.15.46:0/4164541248 shutdown_connections 2023-10-07T09:05:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.804+0000 7f883c97a700 1 -- 172.21.15.46:0/4164541248 wait complete. 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 Processor -- start 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 -- start start 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 0x7f883814ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 0x7f883814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838136930 con 0x7f8824003bf0 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381581c0 con 0x7f883814b1c0 2023-10-07T09:05:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.805+0000 7f883c97a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883814bb60 con 0x7f8838157750 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56424/0 (socket says 172.21.15.46:56424) 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 -- 172.21.15.46:0/2529493569 learned_addr learned my addr 172.21.15.46:0/2529493569 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f8835d9b700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 0x7f883814ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f8836d9d700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 0x7f883814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 -- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 msgr2=0x7f883814ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 0x7f883814ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 -- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 msgr2=0x7f883814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 0x7f883814b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 -- 172.21.15.46:0/2529493569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883815a7e0 con 0x7f8824003bf0 2023-10-07T09:05:36.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f8835d9b700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 0x7f883814ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f8836d9d700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 0x7f883814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883659c700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f882400c130 tx=0x7f8828015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800c870 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828012c20 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8838157ee0 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882801e450 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.806+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883815acf0 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.807+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883804c3c0 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.808+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f882801e7c0 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.808+0000 7f882e7fc700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 0x7f88180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.808+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f8828087190 con 0x7f8824003bf0 2023-10-07T09:05:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.808+0000 7f8835d9b700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 0x7f88180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.809+0000 7f8835d9b700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 0x7f88180697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8838066360 tx=0x7f8820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:36.812+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8828053d70 con 0x7f8824003bf0 2023-10-07T09:05:37.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.005+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88380af500 con 0x7f8824003bf0 2023-10-07T09:05:37.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.006+0000 7f882e7fc700 1 -- 172.21.15.46:0/2529493569 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15623 (secure 0 0 0) 0x7f8828057390 con 0x7f8824003bf0 2023-10-07T09:05:37.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:37.007 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:34.232259+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.133:6835/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.46:6834/2721491248":"2023-10-08T09:05:26.754183+0000","172.21.15.46:6832/2721491248":"2023-10-08T09:05:26.754183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:37.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.008+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 msgr2=0x7f88180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 0x7f88180697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8838066360 tx=0x7f8820008040 comp rx=0 tx=0).stop 2023-10-07T09:05:37.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 msgr2=0x7f8838157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f882400c130 tx=0x7f8828015000 comp rx=0 tx=0).stop 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 shutdown_connections 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8818067320 0x7f88180697d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883814b1c0 0x7f883814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8824003bf0 0x7f8838157210 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 --2- 172.21.15.46:0/2529493569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838157750 0x7f883814ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 >> 172.21.15.46:0/2529493569 conn(0x7f88380cd480 msgr2=0x7f88380af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 shutdown_connections 2023-10-07T09:05:37.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.009+0000 7f883c97a700 1 -- 172.21.15.46:0/2529493569 wait complete. 2023-10-07T09:05:37.022 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:05:37.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:37.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.140+0000 7f3125c25700 1 Processor -- start 2023-10-07T09:05:37.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.140+0000 7f3125c25700 1 -- start start 2023-10-07T09:05:37.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f3125c25700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f312006bcd0 0x7f31200caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f3125c25700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f312015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f3125c25700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312015d7e0 con 0x7f312006c0a0 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f3125c25700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312015dac0 con 0x7f312006bcd0 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f3125c25700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312015aa30 con 0x7f312015df50 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f311f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f312006bcd0 0x7f31200caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f311f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f312006bcd0 0x7f31200caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56438/0 (socket says 172.21.15.46:56438) 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.141+0000 7f311f7fe700 1 -- 172.21.15.46:0/4288073381 learned_addr learned my addr 172.21.15.46:0/4288073381 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311ffff700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f312015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311f7fe700 1 -- 172.21.15.46:0/4288073381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 msgr2=0x7f312015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311f7fe700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f312015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311f7fe700 1 -- 172.21.15.46:0/4288073381 >> v1:172.21.15.133:6789/0 conn(0x7f312006c0a0 legacy=0x7f312015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311f7fe700 1 -- 172.21.15.46:0/4288073381 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312015ad10 con 0x7f312006bcd0 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311ffff700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f312015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:37.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311f7fe700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200caa90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f31100099b0 tx=0x7f3110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0220fd6f7f6ad12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311e7fc700 1 -- 172.21.15.46:0/4288073381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000b820 con 0x7f312006bcd0 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311e7fc700 1 -- 172.21.15.46:0/4288073381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311000b980 con 0x7f312006bcd0 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f311e7fc700 1 -- 172.21.15.46:0/4288073381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000bd40 con 0x7f312006bcd0 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f3125c25700 1 -- 172.21.15.46:0/4288073381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 msgr2=0x7f31200caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.142+0000 7f3125c25700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200caa90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f31100099b0 tx=0x7f3110009250 comp rx=0 tx=0).stop 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 -- 172.21.15.46:0/4288073381 shutdown_connections 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f312015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 --2- 172.21.15.46:0/4288073381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200caa90 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 -- 172.21.15.46:0/4288073381 >> 172.21.15.46:0/4288073381 conn(0x7f31200ce600 msgr2=0x7f31200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 -- 172.21.15.46:0/4288073381 shutdown_connections 2023-10-07T09:05:37.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.143+0000 7f3125c25700 1 -- 172.21.15.46:0/4288073381 wait complete. 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.144+0000 7f3125c25700 1 Processor -- start 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.144+0000 7f3125c25700 1 -- start start 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f312006c0a0 0x7f31200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f31200c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200b4230 con 0x7f312006bcd0 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200b39f0 con 0x7f312006c0a0 2023-10-07T09:05:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f3125c25700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31200b3c70 con 0x7f312015df50 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56448/0 (socket says 172.21.15.46:56448) 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 -- 172.21.15.46:0/3439426764 learned_addr learned my addr 172.21.15.46:0/3439426764 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 -- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 msgr2=0x7f31200c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311ffff700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f31200c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f31200c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 -- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f312006c0a0 msgr2=0x7f31200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311effd700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f312006c0a0 0x7f31200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f312006c0a0 0x7f31200b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 -- 172.21.15.46:0/3439426764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100094f0 con 0x7f312006bcd0 2023-10-07T09:05:37.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311ffff700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f31200c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f311f7fe700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.145+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110011c40 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.146+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110020070 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.146+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311001b450 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.146+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31200b3f50 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.146+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31200c6a40 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.147+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31200c9de0 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.147+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3110022030 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.147+0000 7f31077fe700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 0x7f310c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.147+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f3110086a50 con 0x7f312006bcd0 2023-10-07T09:05:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.147+0000 7f311effd700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 0x7f310c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.148+0000 7f311effd700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 0x7f310c0697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f31200ccb10 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.151+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3110053740 con 0x7f312006bcd0 2023-10-07T09:05:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.391+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31200c9de0 con 0x7f312006bcd0 2023-10-07T09:05:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.391+0000 7f31077fe700 1 -- 172.21.15.46:0/3439426764 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f3110056d60 con 0x7f312006bcd0 2023-10-07T09:05:37.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:37.392 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1467440491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1467440491},{"type":"v1","addr":"172.21.15.133:6837","nonce":1467440491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2310694783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2310694783},{"type":"v1","addr":"172.21.15.46:6834","nonce":2310694783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.393+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 msgr2=0x7f310c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.393+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 0x7f310c0697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f31200ccb10 tx=0x7f3114008040 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.393+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 msgr2=0x7f31200c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.393+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110016000 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 shutdown_connections 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f310c067320 0x7f310c0697d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f312015df50 0x7f31200c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f312006bcd0 0x7f31200c4840 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 --2- 172.21.15.46:0/3439426764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f312006c0a0 0x7f31200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 >> 172.21.15.46:0/3439426764 conn(0x7f31200ce600 msgr2=0x7f31200c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 shutdown_connections 2023-10-07T09:05:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.394+0000 7f3125c25700 1 -- 172.21.15.46:0/3439426764 wait complete. 2023-10-07T09:05:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 84 2023-10-07T09:05:37.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.525+0000 7f51163ea700 1 Processor -- start 2023-10-07T09:05:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.525+0000 7f51163ea700 1 -- start start 2023-10-07T09:05:37.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51163ea700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51101597f0 0x7f51100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51163ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511015d230 0x7f511015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51163ea700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511015dbb0 con 0x7f5110159420 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51163ea700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b11d0 con 0x7f51101597f0 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51163ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b14b0 con 0x7f511015d230 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5114be7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51101597f0 0x7f51100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51153e8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5110159420 0x7f51100b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44626/0 (socket says 172.21.15.46:44626) 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f51153e8700 1 -- 172.21.15.46:0/3353353066 learned_addr learned my addr 172.21.15.46:0/3353353066 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5115be9700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511015d230 0x7f511015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5114be7700 1 -- 172.21.15.46:0/3353353066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511015d230 msgr2=0x7f511015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5114be7700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511015d230 0x7f511015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5114be7700 1 -- 172.21.15.46:0/3353353066 >> v1:172.21.15.46:6789/0 conn(0x7f5110159420 legacy=0x7f51100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f5114be7700 1 -- 172.21.15.46:0/3353353066 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100b1790 con 0x7f51101597f0 2023-10-07T09:05:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.526+0000 7f510ffff700 1 -- 172.21.15.46:0/3353353066 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127227849 0 0) 0x7f511015dbb0 con 0x7f5110159420 2023-10-07T09:05:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f5114be7700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51101597f0 0x7f51100b2270 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f51040098e0 tx=0x7f51040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504aa6af68f61bc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f510ffff700 1 -- 172.21.15.46:0/3353353066 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104009e80 con 0x7f51101597f0 2023-10-07T09:05:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f510ffff700 1 -- 172.21.15.46:0/3353353066 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400b860 con 0x7f51101597f0 2023-10-07T09:05:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f510ffff700 1 -- 172.21.15.46:0/3353353066 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400bbe0 con 0x7f51101597f0 2023-10-07T09:05:37.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 -- 172.21.15.46:0/3353353066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51101597f0 msgr2=0x7f51100b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51101597f0 0x7f51100b2270 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f51040098e0 tx=0x7f51040091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 -- 172.21.15.46:0/3353353066 shutdown_connections 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511015d230 0x7f511015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 --2- 172.21.15.46:0/3353353066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51101597f0 0x7f51100b2270 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 -- 172.21.15.46:0/3353353066 >> 172.21.15.46:0/3353353066 conn(0x7f51100d0660 msgr2=0x7f51100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 -- 172.21.15.46:0/3353353066 shutdown_connections 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.527+0000 7f51163ea700 1 -- 172.21.15.46:0/3353353066 wait complete. 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 Processor -- start 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 -- start start 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 0x7f51100c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51101597f0 0x7f51100c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100c7070 con 0x7f511015d230 2023-10-07T09:05:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511015ac70 con 0x7f51101597f0 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.529+0000 7f51163ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511015b230 con 0x7f5110159420 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56458/0 (socket says 172.21.15.46:56458) 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 -- 172.21.15.46:0/1244241868 learned_addr learned my addr 172.21.15.46:0/1244241868 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f51153e8700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 0x7f51100c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5114be7700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51101597f0 0x7f51100c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 -- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 msgr2=0x7f51100c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 0x7f51100c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 -- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51101597f0 msgr2=0x7f51100c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51101597f0 0x7f51100c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 -- 172.21.15.46:0/1244241868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104009420 con 0x7f511015d230 2023-10-07T09:05:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f51153e8700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 0x7f51100c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f5115be9700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f510800d860 tx=0x7f5108008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080125f0 con 0x7f511015d230 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108012750 con 0x7f511015d230 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108012b10 con 0x7f511015d230 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100c7280 con 0x7f511015d230 2023-10-07T09:05:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.530+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511015aec0 con 0x7f511015d230 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.531+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511015b3a0 con 0x7f511015d230 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.532+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f510801e460 con 0x7f511015d230 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.532+0000 7f510d7fa700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 0x7f50fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.532+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f5108085380 con 0x7f511015d230 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.532+0000 7f51153e8700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 0x7f50fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.533+0000 7f51153e8700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 0x7f50fc0697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f510000d270 tx=0x7f5100009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.536+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51080559f0 con 0x7f511015d230 2023-10-07T09:05:37.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.772+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f511004c3c0 con 0x7f511015d230 2023-10-07T09:05:37.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.773+0000 7f510d7fa700 1 -- 172.21.15.46:0/1244241868 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f5108055580 con 0x7f511015d230 2023-10-07T09:05:37.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:37.774 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1467440491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1467440491},{"type":"v1","addr":"172.21.15.133:6837","nonce":1467440491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2310694783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2310694783},{"type":"v1","addr":"172.21.15.46:6834","nonce":2310694783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:09.691451+0000","modified":"2023-10-07T09:05:13.307329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7134":{"gid":7134,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/2778859366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":2778859366},{"type":"v1","addr":"172.21.15.46:6835","nonce":2778859366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T09:05:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 msgr2=0x7f50fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 0x7f50fc0697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f510000d270 tx=0x7f5100009040 comp rx=0 tx=0).stop 2023-10-07T09:05:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 msgr2=0x7f5110154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f510800d860 tx=0x7f5108008040 comp rx=0 tx=0).stop 2023-10-07T09:05:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 shutdown_connections 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50fc067320 0x7f50fc0697d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f511015d230 0x7f5110154240 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5110159420 0x7f51100c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 --2- 172.21.15.46:0/1244241868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51101597f0 0x7f51100c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 >> 172.21.15.46:0/1244241868 conn(0x7f51100d0660 msgr2=0x7f51100b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 shutdown_connections 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.775+0000 7f51163ea700 1 -- 172.21.15.46:0/1244241868 wait complete. 2023-10-07T09:05:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 84 2023-10-07T09:05:37.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.907+0000 7f1cc8881700 1 Processor -- start 2023-10-07T09:05:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.907+0000 7f1cc8881700 1 -- start start 2023-10-07T09:05:37.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc8881700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1cc41597f0 0x7f1cc40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc8881700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc8881700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc415dbb0 con 0x7f1cc4159420 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc8881700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40b11d0 con 0x7f1cc41597f0 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc8881700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40b14b0 con 0x7f1cc415d230 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1cc41597f0 0x7f1cc40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1cc4159420 0x7f1cc40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44634/0 (socket says 172.21.15.46:44634) 2023-10-07T09:05:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc37fe700 1 -- 172.21.15.46:0/94206474 learned_addr learned my addr 172.21.15.46:0/94206474 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1cc41597f0 0x7f1cc40b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56474/0 (socket says 172.21.15.46:56474) 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc3fff700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/94206474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 msgr2=0x7f1cc415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/94206474 >> v1:172.21.15.46:6789/0 conn(0x7f1cc4159420 legacy=0x7f1cc40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc27fc700 1 -- 172.21.15.46:0/94206474 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934546176 0 0) 0x7f1cc415dbb0 con 0x7f1cc4159420 2023-10-07T09:05:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.908+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/94206474 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40b1790 con 0x7f1cc41597f0 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc2ffd700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40b2270 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80098e0 tx=0x7f1cb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f81eefe9918bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc27fc700 1 -- 172.21.15.46:0/94206474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8009e80 con 0x7f1cc41597f0 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc27fc700 1 -- 172.21.15.46:0/94206474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800b860 con 0x7f1cc41597f0 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc27fc700 1 -- 172.21.15.46:0/94206474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800bbe0 con 0x7f1cc41597f0 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 -- 172.21.15.46:0/94206474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 msgr2=0x7f1cc40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40b2270 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80098e0 tx=0x7f1cb80091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 -- 172.21.15.46:0/94206474 shutdown_connections 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 --2- 172.21.15.46:0/94206474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40b2270 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 -- 172.21.15.46:0/94206474 >> 172.21.15.46:0/94206474 conn(0x7f1cc40d0660 msgr2=0x7f1cc40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 -- 172.21.15.46:0/94206474 shutdown_connections 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.909+0000 7f1cc8881700 1 -- 172.21.15.46:0/94206474 wait complete. 2023-10-07T09:05:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 Processor -- start 2023-10-07T09:05:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 -- start start 2023-10-07T09:05:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 0x7f1cc40c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc4154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40c7070 con 0x7f1cc41597f0 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc415ac70 con 0x7f1cc4159420 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.911+0000 7f1cc8881700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc415b230 con 0x7f1cc415d230 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56476/0 (socket says 172.21.15.46:56476) 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/3400700996 learned_addr learned my addr 172.21.15.46:0/3400700996 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc3fff700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc4154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc37fe700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 0x7f1cc40c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 msgr2=0x7f1cc4154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc4154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 msgr2=0x7f1cc40c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 0x7f1cc40c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 -- 172.21.15.46:0/3400700996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009420 con 0x7f1cc41597f0 2023-10-07T09:05:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc3fff700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc4154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc37fe700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 0x7f1cc40c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc2ffd700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8013000 tx=0x7f1cb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800bbe0 con 0x7f1cc41597f0 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8011420 con 0x7f1cc41597f0 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40c7280 con 0x7f1cc41597f0 2023-10-07T09:05:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80117e0 con 0x7f1cc41597f0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.912+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc415aec0 con 0x7f1cc41597f0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.913+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc415b3a0 con 0x7f1cc41597f0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.914+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1cb8011bd0 con 0x7f1cc41597f0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.914+0000 7f1cab7fe700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.914+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f1cb8086760 con 0x7f1cc41597f0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.914+0000 7f1cc37fe700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.915+0000 7f1cc37fe700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 0x7f1cb00697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40018d0 tx=0x7f1cb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:37.918+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb8053340 con 0x7f1cc41597f0 2023-10-07T09:05:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.111+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc404c3c0 con 0x7f1cc41597f0 2023-10-07T09:05:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.111+0000 7f1cab7fe700 1 -- 172.21.15.46:0/3400700996 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15623 (secure 0 0 0) 0x7f1cb8056960 con 0x7f1cc41597f0 2023-10-07T09:05:38.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:38.112 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:34.232259+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:08.097714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:08.661193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.133:6835/842316540":"2023-10-08T09:05:31.227504+0000","172.21.15.46:6834/2721491248":"2023-10-08T09:05:26.754183+0000","172.21.15.46:6832/2721491248":"2023-10-08T09:05:26.754183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.113+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 msgr2=0x7f1cb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.113+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 0x7f1cb00697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40018d0 tx=0x7f1cb4009040 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 msgr2=0x7f1cc40c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8013000 tx=0x7f1cb8017000 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 shutdown_connections 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cc415d230 0x7f1cc4154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cc4159420 0x7f1cc40c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 --2- 172.21.15.46:0/3400700996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1cc41597f0 0x7f1cc40c6b30 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 >> 172.21.15.46:0/3400700996 conn(0x7f1cc40d0660 msgr2=0x7f1cc40b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 shutdown_connections 2023-10-07T09:05:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.114+0000 7f1cc8881700 1 -- 172.21.15.46:0/3400700996 wait complete. 2023-10-07T09:05:38.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:05:38.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.246+0000 7fc29b50b700 1 Processor -- start 2023-10-07T09:05:38.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.246+0000 7fc29b50b700 1 -- start start 2023-10-07T09:05:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc294159890 0x7fc29415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc294159c60 0x7fc29415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc29415db10 0x7fc294069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29415df50 con 0x7fc294159890 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29415a160 con 0x7fc294159c60 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc29b50b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940d13a0 con 0x7fc29415db10 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc294159890 0x7fc29415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc294159890 0x7fc29415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56480/0 (socket says 172.21.15.46:56480) 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 -- 172.21.15.46:0/3216770259 learned_addr learned my addr 172.21.15.46:0/3216770259 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc298aa6700 1 --2- 172.21.15.46:0/3216770259 >> v2:172.21.15.133:3300/0 conn(0x7fc294159c60 0x7fc29415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc299aa8700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc29415db10 0x7fc294069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 -- 172.21.15.46:0/3216770259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc29415db10 msgr2=0x7fc294069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc29415db10 0x7fc294069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 -- 172.21.15.46:0/3216770259 >> v2:172.21.15.133:3300/0 conn(0x7fc294159c60 msgr2=0x7fc29415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 --2- 172.21.15.46:0/3216770259 >> v2:172.21.15.133:3300/0 conn(0x7fc294159c60 0x7fc29415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.247+0000 7fc2992a7700 1 -- 172.21.15.46:0/3216770259 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29415e140 con 0x7fc294159890 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc2992a7700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159890 0x7fc29415abd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc2940b67f0 tx=0x7fc290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32351ea5b20a4323 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc28bfff700 1 -- 172.21.15.46:0/3216770259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000b640 con 0x7fc294159890 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc28bfff700 1 -- 172.21.15.46:0/3216770259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000b7a0 con 0x7fc294159890 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc28bfff700 1 -- 172.21.15.46:0/3216770259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000bb60 con 0x7fc294159890 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 -- 172.21.15.46:0/3216770259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159890 msgr2=0x7fc29415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159890 0x7fc29415abd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc2940b67f0 tx=0x7fc290009250 comp rx=0 tx=0).stop 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 -- 172.21.15.46:0/3216770259 shutdown_connections 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc29415db10 0x7fc294069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 --2- 172.21.15.46:0/3216770259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159890 0x7fc29415abd0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 --2- 172.21.15.46:0/3216770259 >> v2:172.21.15.133:3300/0 conn(0x7fc294159c60 0x7fc29415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.248+0000 7fc29b50b700 1 -- 172.21.15.46:0/3216770259 >> 172.21.15.46:0/3216770259 conn(0x7fc294068e20 msgr2=0x7fc2940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.249+0000 7fc29b50b700 1 -- 172.21.15.46:0/3216770259 shutdown_connections 2023-10-07T09:05:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.249+0000 7fc29b50b700 1 -- 172.21.15.46:0/3216770259 wait complete. 2023-10-07T09:05:38.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.250+0000 7fc29b50b700 1 Processor -- start 2023-10-07T09:05:38.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.250+0000 7fc29b50b700 1 -- start start 2023-10-07T09:05:38.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.250+0000 7fc29b50b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc294159890 0x7fc294154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc29415db10 0x7fc294156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940ca940 con 0x7fc294159c60 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b3590 con 0x7fc29415db10 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b4110 con 0x7fc294159890 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56486/0 (socket says 172.21.15.46:56486) 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 -- 172.21.15.46:0/2760696559 learned_addr learned my addr 172.21.15.46:0/2760696559 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc2992a7700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc294159890 0x7fc294154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc299aa8700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc29415db10 0x7fc294156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 -- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc294159890 msgr2=0x7fc294154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc294159890 0x7fc294154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 -- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc29415db10 msgr2=0x7fc294156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc29415db10 0x7fc294156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 -- 172.21.15.46:0/2760696559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900094f0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc298aa6700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc28400ecb0 tx=0x7fc2840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400c9d0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28400cb30 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2940b37e0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400ced0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.251+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940b3da0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.252+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29404c3c0 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.253+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc284013680 con 0x7fc294159c60 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.253+0000 7fc2897fa700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 0x7fc2780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.253+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fc284085080 con 0x7fc294159c60 2023-10-07T09:05:38.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.253+0000 7fc2992a7700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 0x7fc2780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.254+0000 7fc2992a7700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 0x7fc2780697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc2940b67f0 tx=0x7fc290017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.258+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc284051c60 con 0x7fc294159c60 2023-10-07T09:05:38.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.494+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc2940b4250 con 0x7fc294159c60 2023-10-07T09:05:38.495 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:05:38.495+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:05:38.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.500+0000 7fc2897fa700 1 -- 172.21.15.46:0/2760696559 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc284055280 con 0x7fc294159c60 2023-10-07T09:05:38.500 INFO:tasks.ceph.mds.c.smithi046.stderr: -1414> 2023-10-07T09:05:15.928+0000 7f4bf3a72700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 msgr2=0x7fc2780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 0x7fc2780697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc2940b67f0 tx=0x7fc290017000 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 msgr2=0x7fc2940c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc28400ecb0 tx=0x7fc2840091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 shutdown_connections 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc278067320 0x7fc2780697d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc29415db10 0x7fc294156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc294159890 0x7fc294154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 --2- 172.21.15.46:0/2760696559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc294159c60 0x7fc2940c8720 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 >> 172.21.15.46:0/2760696559 conn(0x7fc294068e20 msgr2=0x7fc2940cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:38.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 shutdown_connections 2023-10-07T09:05:38.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.502+0000 7fc29b50b700 1 -- 172.21.15.46:0/2760696559 wait complete. 2023-10-07T09:05:38.504 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:05:38.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:05:38.522 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:05:38.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.637+0000 7f6089838700 1 Processor -- start 2023-10-07T09:05:38.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.637+0000 7f6089838700 1 -- start start 2023-10-07T09:05:38.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6089838700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f608406bcd0 0x7f6084140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6089838700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 0x7f6084141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6089838700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608415c2a0 con 0x7f60840c8e00 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6089838700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840c9900 con 0x7f608406bcd0 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6089838700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608415b690 con 0x7f608406c0a0 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6082ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f608406bcd0 0x7f6084140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6082ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f608406bcd0 0x7f6084140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56510/0 (socket says 172.21.15.46:56510) 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f6082ffd700 1 -- 172.21.15.46:0/2490080449 learned_addr learned my addr 172.21.15.46:0/2490080449 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.638+0000 7f60827fc700 1 --2- 172.21.15.46:0/2490080449 >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 0x7f6084141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6082ffd700 1 -- 172.21.15.46:0/2490080449 >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 msgr2=0x7f6084141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6082ffd700 1 --2- 172.21.15.46:0/2490080449 >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 0x7f6084141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6082ffd700 1 -- 172.21.15.46:0/2490080449 >> v1:172.21.15.133:6789/0 conn(0x7f60840c8e00 legacy=0x7f60840c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6082ffd700 1 -- 172.21.15.46:0/2490080449 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608415b970 con 0x7f608406bcd0 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f60827fc700 1 --2- 172.21.15.46:0/2490080449 >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 0x7f6084141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6082ffd700 1 --2- 172.21.15.46:0/2490080449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f6084140df0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f608406c6e0 tx=0x7f6074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ffad426594dcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6081ffb700 1 -- 172.21.15.46:0/2490080449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400b860 con 0x7f608406bcd0 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6081ffb700 1 -- 172.21.15.46:0/2490080449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607400b9c0 con 0x7f608406bcd0 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6081ffb700 1 -- 172.21.15.46:0/2490080449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400bd60 con 0x7f608406bcd0 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6089838700 1 -- 172.21.15.46:0/2490080449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 msgr2=0x7f6084140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6089838700 1 --2- 172.21.15.46:0/2490080449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f6084140df0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f608406c6e0 tx=0x7f6074009250 comp rx=0 tx=0).stop 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6089838700 1 -- 172.21.15.46:0/2490080449 shutdown_connections 2023-10-07T09:05:38.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6089838700 1 --2- 172.21.15.46:0/2490080449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f6084140df0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.639+0000 7f6089838700 1 --2- 172.21.15.46:0/2490080449 >> v2:172.21.15.133:3300/0 conn(0x7f608406c0a0 0x7f6084141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.640+0000 7f6089838700 1 -- 172.21.15.46:0/2490080449 >> 172.21.15.46:0/2490080449 conn(0x7f60840ce600 msgr2=0x7f60840cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:38.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.640+0000 7f6089838700 1 -- 172.21.15.46:0/2490080449 shutdown_connections 2023-10-07T09:05:38.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.640+0000 7f6089838700 1 -- 172.21.15.46:0/2490080449 wait complete. 2023-10-07T09:05:38.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.641+0000 7f6089838700 1 Processor -- start 2023-10-07T09:05:38.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.641+0000 7f6089838700 1 -- start start 2023-10-07T09:05:38.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f608406c0a0 0x7f60840c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60840c8e00 0x7f608413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840697d0 con 0x7f608406bcd0 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840c7620 con 0x7f60840c8e00 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60840c7190 con 0x7f608406c0a0 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56514/0 (socket says 172.21.15.46:56514) 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 -- 172.21.15.46:0/3535916567 learned_addr learned my addr 172.21.15.46:0/3535916567 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 -- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f608406c0a0 msgr2=0x7f60840c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f608406c0a0 0x7f60840c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 -- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60840c8e00 msgr2=0x7f608413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60840c8e00 0x7f608413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 -- 172.21.15.46:0/3535916567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740094f0 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6082ffd700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6084069220 tx=0x7f6074017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074026480 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607401f070 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074026850 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6084157900 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.642+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60840c6630 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.643+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608404c3c0 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.644+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f607401a430 con 0x7f608406bcd0 2023-10-07T09:05:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.644+0000 7f607affd700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 0x7f60640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:38.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.644+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6074021070 con 0x7f608406bcd0 2023-10-07T09:05:38.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.644+0000 7f60827fc700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 0x7f60640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:38.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.645+0000 7f60827fc700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 0x7f60640697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f606c006fd0 tx=0x7f606c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:38.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.649+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f607408a030 con 0x7f608406bcd0 2023-10-07T09:05:38.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:38.889+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f608406c9d0 con 0x7f608406bcd0 2023-10-07T09:05:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.499+0000 7f607affd700 1 -- 172.21.15.46:0/3535916567 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7f60740150a0 con 0x7f608406bcd0 2023-10-07T09:05:39.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.502+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 msgr2=0x7f60640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 0x7f60640697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f606c006fd0 tx=0x7f606c008040 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 msgr2=0x7f60841573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6084069220 tx=0x7f6074017000 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 shutdown_connections 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6064067320 0x7f60640697d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60840c8e00 0x7f608413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608406bcd0 0x7f60841573c0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 --2- 172.21.15.46:0/3535916567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f608406c0a0 0x7f60840c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 >> 172.21.15.46:0/3535916567 conn(0x7f60840ce600 msgr2=0x7f608415a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 shutdown_connections 2023-10-07T09:05:39.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.503+0000 7f6089838700 1 -- 172.21.15.46:0/3535916567 wait complete. 2023-10-07T09:05:39.519 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:05:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.692+0000 7f6c1938a700 1 Processor -- start 2023-10-07T09:05:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.692+0000 7f6c1938a700 1 -- start start 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c1938a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c14159950 0x7f6c140cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c1938a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c14068390 con 0x7f6c140b6390 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c1938a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c14159d20 con 0x7f6c140b5490 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c1938a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140b3cd0 con 0x7f6c14159950 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c12ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c14159950 0x7f6c140cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c127fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6c140b6390 0x7f6c140b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37486/0 (socket says 172.21.15.46:37486) 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c127fc700 1 -- 172.21.15.46:0/904512057 learned_addr learned my addr 172.21.15.46:0/904512057 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c11ffb700 1 -- 172.21.15.46:0/904512057 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913556918 0 0) 0x7f6c14068390 con 0x7f6c140b6390 2023-10-07T09:05:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c11ffb700 1 -- 172.21.15.46:0/904512057 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bfc003570 con 0x7f6c140b6390 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c12ffd700 1 -- 172.21.15.46:0/904512057 >> v1:172.21.15.133:6789/0 conn(0x7f6c140b5490 legacy=0x7f6c14068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c12ffd700 1 -- 172.21.15.46:0/904512057 >> v1:172.21.15.46:6789/0 conn(0x7f6c140b6390 legacy=0x7f6c140b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c12ffd700 1 -- 172.21.15.46:0/904512057 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140b3f40 con 0x7f6c14159950 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c12ffd700 1 --2- 172.21.15.46:0/904512057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c14159950 0x7f6c140cb5a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098e0 tx=0x7f6c040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec1abdf3ef0d75f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c11ffb700 1 -- 172.21.15.46:0/904512057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400b640 con 0x7f6c14159950 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c11ffb700 1 -- 172.21.15.46:0/904512057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0400b7a0 con 0x7f6c14159950 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.693+0000 7f6c11ffb700 1 -- 172.21.15.46:0/904512057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400bb40 con 0x7f6c14159950 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 -- 172.21.15.46:0/904512057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c14159950 msgr2=0x7f6c140cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 --2- 172.21.15.46:0/904512057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c14159950 0x7f6c140cb5a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098e0 tx=0x7f6c040091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 -- 172.21.15.46:0/904512057 shutdown_connections 2023-10-07T09:05:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 --2- 172.21.15.46:0/904512057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c14159950 0x7f6c140cb5a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 -- 172.21.15.46:0/904512057 >> 172.21.15.46:0/904512057 conn(0x7f6c140998b0 msgr2=0x7f6c140b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 -- 172.21.15.46:0/904512057 shutdown_connections 2023-10-07T09:05:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.694+0000 7f6c1938a700 1 -- 172.21.15.46:0/904512057 wait complete. 2023-10-07T09:05:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.695+0000 7f6c1938a700 1 Processor -- start 2023-10-07T09:05:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.695+0000 7f6c1938a700 1 -- start start 2023-10-07T09:05:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140b6390 0x7f6c14156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 0x7f6c14157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c8430 con 0x7f6c140b5490 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c14152370 con 0x7f6c140b6390 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c1938a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c7820 con 0x7f6c14159950 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38708/0 (socket says 172.21.15.46:38708) 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 -- 172.21.15.46:0/3608422682 learned_addr learned my addr 172.21.15.46:0/3608422682 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c127fc700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140b6390 0x7f6c14156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c137fe700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 0x7f6c14157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 -- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 msgr2=0x7f6c14157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 0x7f6c14157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 -- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140b6390 msgr2=0x7f6c14156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.696+0000 7f6c12ffd700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140b6390 0x7f6c14156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6c12ffd700 1 -- 172.21.15.46:0/3608422682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04009420 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6c137fe700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 0x7f6c14157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6c12ffd700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6c14159eb0 tx=0x7f6c04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400bb20 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04011420 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140c7b00 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04011800 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.697+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c140c80c0 con 0x7f6c140b5490 2023-10-07T09:05:39.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.698+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c140d1520 con 0x7f6c140b5490 2023-10-07T09:05:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.698+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6c04011c30 con 0x7f6c140b5490 2023-10-07T09:05:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.699+0000 7f6bfaffd700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 0x7f6c000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.699+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6c040862a0 con 0x7f6c140b5490 2023-10-07T09:05:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.699+0000 7f6c127fc700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 0x7f6c000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.699+0000 7f6c127fc700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 0x7f6c000697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6c14155620 tx=0x7f6c08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.703+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c04052eb0 con 0x7f6c140b5490 2023-10-07T09:05:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:39.895+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c1404c3c0 con 0x7f6c140b5490 2023-10-07T09:05:40.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.505+0000 7f6bfaffd700 1 -- 172.21.15.46:0/3608422682 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c04056490 con 0x7f6c140b5490 2023-10-07T09:05:40.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 msgr2=0x7f6c000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 0x7f6c000697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6c14155620 tx=0x7f6c08009040 comp rx=0 tx=0).stop 2023-10-07T09:05:40.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 msgr2=0x7f6c14151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6c14159eb0 tx=0x7f6c04017000 comp rx=0 tx=0).stop 2023-10-07T09:05:40.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 shutdown_connections 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c00067320 0x7f6c000697d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14159950 0x7f6c14157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c140b5490 0x7f6c14151e30 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 --2- 172.21.15.46:0/3608422682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140b6390 0x7f6c14156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 >> 172.21.15.46:0/3608422682 conn(0x7f6c140998b0 msgr2=0x7f6c14069120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 shutdown_connections 2023-10-07T09:05:40.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.508+0000 7f6c1938a700 1 -- 172.21.15.46:0/3608422682 wait complete. 2023-10-07T09:05:40.511 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:05:40.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:05:40.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.651+0000 7f4ea6d61700 1 Processor -- start 2023-10-07T09:05:40.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.651+0000 7f4ea6d61700 1 -- start start 2023-10-07T09:05:40.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea6d61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea0159ec0 0x7f4ea00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea6d61700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ea00b53d0 0x7f4ea00cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea6d61700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea00b5b00 con 0x7f4ea00cce40 2023-10-07T09:05:40.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea6d61700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea00b5da0 con 0x7f4ea00b53d0 2023-10-07T09:05:40.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea6d61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea00b6080 con 0x7f4ea0159ec0 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ea00b53d0 0x7f4ea00cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ea00b53d0 0x7f4ea00cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38712/0 (socket says 172.21.15.46:38712) 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 -- 172.21.15.46:0/66594677 learned_addr learned my addr 172.21.15.46:0/66594677 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4ea4afd700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea0159ec0 0x7f4ea00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 -- 172.21.15.46:0/66594677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea0159ec0 msgr2=0x7f4ea00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea0159ec0 0x7f4ea00b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 -- 172.21.15.46:0/66594677 >> v1:172.21.15.133:6789/0 conn(0x7f4ea00cce40 legacy=0x7f4ea00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 -- 172.21.15.46:0/66594677 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00cc100 con 0x7f4ea00b53d0 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9ffff700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea00b53d0 0x7f4ea00cc900 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4e900099b0 tx=0x7f4e90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa7dbc439fb81b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9f7fe700 1 -- 172.21.15.46:0/66594677 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90009ea0 con 0x7f4ea00b53d0 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.652+0000 7f4e9f7fe700 1 -- 172.21.15.46:0/66594677 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000b860 con 0x7f4ea00b53d0 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4e9f7fe700 1 -- 172.21.15.46:0/66594677 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000bc00 con 0x7f4ea00b53d0 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 -- 172.21.15.46:0/66594677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea00b53d0 msgr2=0x7f4ea00cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea00b53d0 0x7f4ea00cc900 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4e900099b0 tx=0x7f4e90009250 comp rx=0 tx=0).stop 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 -- 172.21.15.46:0/66594677 shutdown_connections 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea0159ec0 0x7f4ea00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/66594677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea00b53d0 0x7f4ea00cc900 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 -- 172.21.15.46:0/66594677 >> 172.21.15.46:0/66594677 conn(0x7f4ea00999f0 msgr2=0x7f4ea00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 -- 172.21.15.46:0/66594677 shutdown_connections 2023-10-07T09:05:40.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.653+0000 7f4ea6d61700 1 -- 172.21.15.46:0/66594677 wait complete. 2023-10-07T09:05:40.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.654+0000 7f4ea6d61700 1 Processor -- start 2023-10-07T09:05:40.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.654+0000 7f4ea6d61700 1 -- start start 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea00b53d0 0x7f4ea009c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea00cce40 0x7f4ea01515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009ca00 con 0x7f4ea0159ec0 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009cce0 con 0x7f4ea00b53d0 2023-10-07T09:05:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea6d61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea009cfc0 con 0x7f4ea00cce40 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea52fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4e9ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea00cce40 0x7f4ea01515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea52fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38714/0 (socket says 172.21.15.46:38714) 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea52fe700 1 -- 172.21.15.46:0/3945844945 learned_addr learned my addr 172.21.15.46:0/3945844945 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.655+0000 7f4ea4afd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea00b53d0 0x7f4ea009c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 -- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea00cce40 msgr2=0x7f4ea01515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea00cce40 0x7f4ea01515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 -- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea00b53d0 msgr2=0x7f4ea009c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea00b53d0 0x7f4ea009c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 -- 172.21.15.46:0/3945844945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900094f0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea52fe700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c560 tx=0x7f4e88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011590 con 0x7f4ea0159ec0 2023-10-07T09:05:40.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e880116f0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea009d2a0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011ab0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.656+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea009c640 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.657+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea00c9fd0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.657+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e8801b3b0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.658+0000 7f4e9cff9700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 0x7f4e800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:40.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.658+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5525+0+0 (secure 0 0 0) 0x7f4e88083f80 con 0x7f4ea0159ec0 2023-10-07T09:05:40.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.658+0000 7f4ea4afd700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 0x7f4e800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:40.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.659+0000 7f4ea4afd700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 0x7f4e800697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800f510 tx=0x7f4e9800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:40.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.662+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e88050cc0 con 0x7f4ea0159ec0 2023-10-07T09:05:40.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:40.853+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ea0063c90 con 0x7f4ea0159ec0 2023-10-07T09:05:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.507+0000 7f4e9cff9700 1 -- 172.21.15.46:0/3945844945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4e88017070 con 0x7f4ea0159ec0 2023-10-07T09:05:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.512+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 msgr2=0x7f4e800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.512+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 0x7f4e800697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800f510 tx=0x7f4e9800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.512+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 msgr2=0x7f4ea00c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.512+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c560 tx=0x7f4e88007ef0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 shutdown_connections 2023-10-07T09:05:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e80067320 0x7f4e800697d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ea0159ec0 0x7f4ea00c67e0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea00b53d0 0x7f4ea009c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 --2- 172.21.15.46:0/3945844945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ea00cce40 0x7f4ea01515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 >> 172.21.15.46:0/3945844945 conn(0x7f4ea00999f0 msgr2=0x7f4ea00c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 shutdown_connections 2023-10-07T09:05:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.514+0000 7f4ea6d61700 1 -- 172.21.15.46:0/3945844945 wait complete. 2023-10-07T09:05:41.518 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:05:41.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:05:41.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.657+0000 7f353f0d0700 1 Processor -- start 2023-10-07T09:05:41.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.657+0000 7f353f0d0700 1 -- start start 2023-10-07T09:05:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353f0d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353f0d0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f353806b4d0 0x7f3538068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353f0d0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353806b030 con 0x7f353806b940 2023-10-07T09:05:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353f0d0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35380ac760 con 0x7f353806b4d0 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353f0d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380af830 con 0x7f3538157960 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f3537fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f353806b4d0 0x7f3538068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353d66d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f353806b940 0x7f353815b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37488/0 (socket says 172.21.15.46:37488) 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353d66d700 1 -- 172.21.15.46:0/3126555881 learned_addr learned my addr 172.21.15.46:0/3126555881 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f353ce6c700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f3537fff700 1 -- 172.21.15.46:0/3126555881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 msgr2=0x7f35380af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f3537fff700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f3537fff700 1 -- 172.21.15.46:0/3126555881 >> v1:172.21.15.46:6789/0 conn(0x7f353806b940 legacy=0x7f353815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f3537fff700 1 -- 172.21.15.46:0/3126555881 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380c7f60 con 0x7f353806b4d0 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.658+0000 7f35377fe700 1 -- 172.21.15.46:0/3126555881 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378369617 0 0) 0x7f353806b030 con 0x7f353806b940 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f3537fff700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b4d0 0x7f3538068390 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f35240098e0 tx=0x7f35240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05d4491350fcd9a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f35377fe700 1 -- 172.21.15.46:0/3126555881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524009e80 con 0x7f353806b4d0 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f35377fe700 1 -- 172.21.15.46:0/3126555881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400b860 con 0x7f353806b4d0 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f35377fe700 1 -- 172.21.15.46:0/3126555881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400bbe0 con 0x7f353806b4d0 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 -- 172.21.15.46:0/3126555881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b4d0 msgr2=0x7f3538068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b4d0 0x7f3538068390 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f35240098e0 tx=0x7f35240091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 -- 172.21.15.46:0/3126555881 shutdown_connections 2023-10-07T09:05:41.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 --2- 172.21.15.46:0/3126555881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b4d0 0x7f3538068390 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 -- 172.21.15.46:0/3126555881 >> 172.21.15.46:0/3126555881 conn(0x7f35380c9870 msgr2=0x7f35380c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:41.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 -- 172.21.15.46:0/3126555881 shutdown_connections 2023-10-07T09:05:41.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.659+0000 7f353f0d0700 1 -- 172.21.15.46:0/3126555881 wait complete. 2023-10-07T09:05:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.660+0000 7f353f0d0700 1 Processor -- start 2023-10-07T09:05:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 -- start start 2023-10-07T09:05:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 0x7f3538155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353814e4e0 con 0x7f353806b940 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380cb5a0 con 0x7f353806b4d0 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353f0d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380a9e10 con 0x7f3538157960 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f3537fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f3537fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38728/0 (socket says 172.21.15.46:38728) 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f3537fff700 1 -- 172.21.15.46:0/2770573952 learned_addr learned my addr 172.21.15.46:0/2770573952 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.661+0000 7f353ce6c700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 0x7f3538155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f353d66d700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 -- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 msgr2=0x7f35380c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 -- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 msgr2=0x7f3538155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 0x7f3538155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 -- 172.21.15.46:0/2770573952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009420 con 0x7f353806b940 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f353ce6c700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 0x7f3538155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3537fff700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f353806cac0 tx=0x7f3524017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400bbe0 con 0x7f353806b940 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524011420 con 0x7f353806b940 2023-10-07T09:05:41.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380aa200 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240117c0 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.662+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380aa730 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.663+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380cb750 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.663+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3524011bb0 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.664+0000 7f3534ff9700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 0x7f351c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.664+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f3524086370 con 0x7f353806b940 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.664+0000 7f353ce6c700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 0x7f351c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.665+0000 7f353ce6c700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 0x7f351c0697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f352c006fd0 tx=0x7f352c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.668+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3524053250 con 0x7f353806b940 2023-10-07T09:05:41.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.863+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f353804c3c0 con 0x7f353806b940 2023-10-07T09:05:41.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.867+0000 7f3534ff9700 1 -- 172.21.15.46:0/2770573952 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3524011e60 con 0x7f353806b940 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 msgr2=0x7f351c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 0x7f351c0697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f352c006fd0 tx=0x7f352c008040 comp rx=0 tx=0).stop 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 msgr2=0x7f35380a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f353806cac0 tx=0x7f3524017000 comp rx=0 tx=0).stop 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 shutdown_connections 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f351c067320 0x7f351c0697d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3538157960 0x7f35380c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f353806b4d0 0x7f3538155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 --2- 172.21.15.46:0/2770573952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f353806b940 0x7f35380a98d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:41.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 >> 172.21.15.46:0/2770573952 conn(0x7f35380c9870 msgr2=0x7f35380c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:41.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 shutdown_connections 2023-10-07T09:05:41.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:41.869+0000 7f353f0d0700 1 -- 172.21.15.46:0/2770573952 wait complete. 2023-10-07T09:05:41.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-07T09:05:42.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.001+0000 7f3c533f8700 1 Processor -- start 2023-10-07T09:05:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.001+0000 7f3c533f8700 1 -- start start 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c533f8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 0x7f3c4c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c533f8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c4c15df50 0x7f3c4c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c533f8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c15d7e0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c533f8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c15dac0 con 0x7f3c4c15df50 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c533f8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15aa30 con 0x7f3c4c06c0a0 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c4c15df50 0x7f3c4c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51194700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3c4c06bcd0 0x7f3c4c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37504/0 (socket says 172.21.15.46:37504) 2023-10-07T09:05:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51194700 1 -- 172.21.15.46:0/2950650543 learned_addr learned my addr 172.21.15.46:0/2950650543 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c50993700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 0x7f3c4c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 -- 172.21.15.46:0/2950650543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 msgr2=0x7f3c4c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 0x7f3c4c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 -- 172.21.15.46:0/2950650543 >> v1:172.21.15.46:6789/0 conn(0x7f3c4c06bcd0 legacy=0x7f3c4c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c4bfff700 1 -- 172.21.15.46:0/2950650543 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452120488 0 0) 0x7f3c4c15d7e0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 -- 172.21.15.46:0/2950650543 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c15ad10 con 0x7f3c4c15df50 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c50993700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 0x7f3c4c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.002+0000 7f3c51995700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c15df50 0x7f3c4c15e3c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009e60 tx=0x7f3c44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b789b5b385cc29d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c4bfff700 1 -- 172.21.15.46:0/2950650543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400e070 con 0x7f3c4c15df50 2023-10-07T09:05:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c4bfff700 1 -- 172.21.15.46:0/2950650543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400bc30 con 0x7f3c4c15df50 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c4bfff700 1 -- 172.21.15.46:0/2950650543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44012430 con 0x7f3c4c15df50 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 -- 172.21.15.46:0/2950650543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c15df50 msgr2=0x7f3c4c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c15df50 0x7f3c4c15e3c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009e60 tx=0x7f3c44009780 comp rx=0 tx=0).stop 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 -- 172.21.15.46:0/2950650543 shutdown_connections 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c15df50 0x7f3c4c15e3c0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 --2- 172.21.15.46:0/2950650543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c06c0a0 0x7f3c4c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 -- 172.21.15.46:0/2950650543 >> 172.21.15.46:0/2950650543 conn(0x7f3c4c0ce600 msgr2=0x7f3c4c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 -- 172.21.15.46:0/2950650543 shutdown_connections 2023-10-07T09:05:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.003+0000 7f3c533f8700 1 -- 172.21.15.46:0/2950650543 wait complete. 2023-10-07T09:05:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.004+0000 7f3c533f8700 1 Processor -- start 2023-10-07T09:05:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.004+0000 7f3c533f8700 1 -- start start 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c4c06c0a0 0x7f3c4c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c15df50 0x7f3c4c15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c169ab0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1600a0 con 0x7f3c4c06c0a0 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c533f8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c153ff0 con 0x7f3c4c15df50 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c51194700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c51194700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38754/0 (socket says 172.21.15.46:38754) 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.005+0000 7f3c51194700 1 -- 172.21.15.46:0/1968826336 learned_addr learned my addr 172.21.15.46:0/1968826336 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51995700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c15df50 0x7f3c4c15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 -- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c15df50 msgr2=0x7f3c4c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c15df50 0x7f3c4c15ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 -- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c4c06c0a0 msgr2=0x7f3c4c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c4c06c0a0 0x7f3c4c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 -- 172.21.15.46:0/1968826336 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009a20 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c51194700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c5b0 tx=0x7f3c3c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005b30 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c005c90 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c15f490 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c007320 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.006+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c15fa50 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.007+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c04c3c0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.007+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c3c01b400 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.008+0000 7f3c497fa700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.008+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f3c3c0844c0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.008+0000 7f3c50993700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.009+0000 7f3c50993700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 0x7f3c380697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006fd0 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.012+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c3c0514a0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.283+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f3c4c15aff0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.516+0000 7f3c497fa700 1 -- 172.21.15.46:0/1968826336 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v350) v1 ==== 131+0+0 (secure 0 0 0) 0x7f3c3c054ac0 con 0x7f3c4c06bcd0 2023-10-07T09:05:42.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 msgr2=0x7f3c380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 0x7f3c380697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006fd0 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2023-10-07T09:05:42.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 msgr2=0x7f3c4c153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c5b0 tx=0x7f3c3c001070 comp rx=0 tx=0).stop 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 shutdown_connections 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c4c15df50 0x7f3c4c15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c4c06bcd0 0x7f3c4c153ab0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 --2- 172.21.15.46:0/1968826336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c4c06c0a0 0x7f3c4c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 >> 172.21.15.46:0/1968826336 conn(0x7f3c4c0ce600 msgr2=0x7f3c4c06a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 shutdown_connections 2023-10-07T09:05:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.518+0000 7f3c533f8700 1 -- 172.21.15.46:0/1968826336 wait complete. 2023-10-07T09:05:42.531 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-07T09:05:42.531 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-07T09:05:42.532 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:05:42.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-07T09:05:42.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:05:42.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:05:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.652+0000 7fb752335700 1 Processor -- start 2023-10-07T09:05:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.652+0000 7fb752335700 1 -- start start 2023-10-07T09:05:42.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb752335700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 0x7fb74c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb752335700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb74c159c60 0x7fb74c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb752335700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74c15a160 con 0x7fb74c15db10 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb752335700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74c0d13a0 con 0x7fb74c159c60 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb752335700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c15e140 con 0x7fb74c159890 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb74c159c60 0x7fb74c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb74c159c60 0x7fb74c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38756/0 (socket says 172.21.15.46:38756) 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2217383600 learned_addr learned my addr 172.21.15.46:0/2217383600 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb7508d2700 1 --1- 172.21.15.46:0/2217383600 >> v1:172.21.15.46:6789/0 conn(0x7fb74c15db10 0x7fb74c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37512/0 (socket says 172.21.15.46:37512) 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74bfff700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 0x7fb74c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2217383600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 msgr2=0x7fb74c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 0x7fb74c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2217383600 >> v1:172.21.15.46:6789/0 conn(0x7fb74c15db10 legacy=0x7fb74c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2217383600 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c15a3d0 con 0x7fb74c159c60 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74affd700 1 -- 172.21.15.46:0/2217383600 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528172048 0 0) 0x7fb74c15a160 con 0x7fb74c15db10 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74bfff700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 0x7fb74c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.653+0000 7fb74b7fe700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c15d5d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0099b0 tx=0x7fb73c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6df95388608ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb74affd700 1 -- 172.21.15.46:0/2217383600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00b860 con 0x7fb74c159c60 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb74affd700 1 -- 172.21.15.46:0/2217383600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00b9c0 con 0x7fb74c159c60 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb74affd700 1 -- 172.21.15.46:0/2217383600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00bd60 con 0x7fb74c159c60 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 -- 172.21.15.46:0/2217383600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 msgr2=0x7fb74c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c15d5d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0099b0 tx=0x7fb73c009250 comp rx=0 tx=0).stop 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 -- 172.21.15.46:0/2217383600 shutdown_connections 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c159890 0x7fb74c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 --2- 172.21.15.46:0/2217383600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c15d5d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 -- 172.21.15.46:0/2217383600 >> 172.21.15.46:0/2217383600 conn(0x7fb74c068e20 msgr2=0x7fb74c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:42.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 -- 172.21.15.46:0/2217383600 shutdown_connections 2023-10-07T09:05:42.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.654+0000 7fb752335700 1 -- 172.21.15.46:0/2217383600 wait complete. 2023-10-07T09:05:42.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.655+0000 7fb752335700 1 Processor -- start 2023-10-07T09:05:42.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.655+0000 7fb752335700 1 -- start start 2023-10-07T09:05:42.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c159890 0x7fb74c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c15db10 0x7fb74c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c151400 con 0x7fb74c159c60 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0cf740 con 0x7fb74c159890 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb752335700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0cfa20 con 0x7fb74c15db10 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb74b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb74b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38764/0 (socket says 172.21.15.46:38764) 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2140551651 learned_addr learned my addr 172.21.15.46:0/2140551651 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb7508d2700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c15db10 0x7fb74c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.656+0000 7fb74bfff700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c159890 0x7fb74c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c15db10 msgr2=0x7fb74c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c15db10 0x7fb74c0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c159890 msgr2=0x7fb74c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c159890 0x7fb74c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 -- 172.21.15.46:0/2140551651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c0094f0 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb74b7fe700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0899c0 tx=0x7fb73c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011e40 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c01a420 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c0cfd00 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01a7e0 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.657+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c14c680 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.658+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c04c3c0 con 0x7fb74c159c60 2023-10-07T09:05:42.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.658+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb73c01ab90 con 0x7fb74c159c60 2023-10-07T09:05:42.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.659+0000 7fb743fff700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 0x7fb72c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:42.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.659+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fb73c086440 con 0x7fb74c159c60 2023-10-07T09:05:42.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.659+0000 7fb74bfff700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 0x7fb72c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:42.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.659+0000 7fb74bfff700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 0x7fb72c0697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb73400adc0 tx=0x7fb734006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:42.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.663+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb73c053320 con 0x7fb74c159c60 2023-10-07T09:05:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:42.935+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7fb74c06a5b0 con 0x7fb74c159c60 2023-10-07T09:05:43.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.517+0000 7fb743fff700 1 -- 172.21.15.46:0/2140551651 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v351) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb73c056940 con 0x7fb74c159c60 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 msgr2=0x7fb72c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 0x7fb72c0697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb73400adc0 tx=0x7fb734006f90 comp rx=0 tx=0).stop 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 msgr2=0x7fb74c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0899c0 tx=0x7fb73c017000 comp rx=0 tx=0).stop 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 shutdown_connections 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb72c067320 0x7fb72c0697d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb74c15db10 0x7fb74c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c159890 0x7fb74c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 --2- 172.21.15.46:0/2140551651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb74c159c60 0x7fb74c0b2120 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 >> 172.21.15.46:0/2140551651 conn(0x7fb74c068e20 msgr2=0x7fb74c155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 shutdown_connections 2023-10-07T09:05:43.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.520+0000 7fb752335700 1 -- 172.21.15.46:0/2140551651 wait complete. 2023-10-07T09:05:43.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:05:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.700+0000 7ff56ce1a700 1 Processor -- start 2023-10-07T09:05:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.701+0000 7ff56ce1a700 1 -- start start 2023-10-07T09:05:43.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.701+0000 7ff56ce1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff5680699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:43.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.701+0000 7ff56ce1a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568069ee0 con 0x7ff568159c60 2023-10-07T09:05:43.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.701+0000 7ff56ce1a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56815a160 con 0x7ff568159890 2023-10-07T09:05:43.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.701+0000 7ff56ce1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680d13a0 con 0x7ff568069560 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff565d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff568159c60 0x7ff56815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37526/0 (socket says 172.21.15.46:37526) 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff565d9b700 1 -- 172.21.15.46:0/892086046 learned_addr learned my addr 172.21.15.46:0/892086046 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff566d9d700 1 --2- 172.21.15.46:0/892086046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff5680699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237888703 0 0) 0x7ff568069ee0 con 0x7ff568159c60 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554003570 con 0x7ff568159c60 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40367116 0 0) 0x7ff56815a160 con 0x7ff568159890 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff568069ee0 con 0x7ff568159890 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff566d9d700 1 -- 172.21.15.46:0/892086046 >> v1:172.21.15.133:6789/0 conn(0x7ff568159890 legacy=0x7ff56815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff566d9d700 1 -- 172.21.15.46:0/892086046 >> v1:172.21.15.46:6789/0 conn(0x7ff568159c60 legacy=0x7ff56815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829962274 0 0) 0x7ff554003570 con 0x7ff568159c60 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff566d9d700 1 -- 172.21.15.46:0/892086046 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56815e140 con 0x7ff568069560 2023-10-07T09:05:43.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.702+0000 7ff566d9d700 1 --2- 172.21.15.46:0/892086046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff5680699a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff560009e90 tx=0x7ff560009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a88ba0f02bdcefb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:43.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000e070 con 0x7ff568069560 2023-10-07T09:05:43.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000b870 con 0x7ff568069560 2023-10-07T09:05:43.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56559a700 1 -- 172.21.15.46:0/892086046 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550001470 con 0x7ff568069560 2023-10-07T09:05:43.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 -- 172.21.15.46:0/892086046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 msgr2=0x7ff5680699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/892086046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff5680699a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff560009e90 tx=0x7ff560009780 comp rx=0 tx=0).stop 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 -- 172.21.15.46:0/892086046 shutdown_connections 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/892086046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff5680699a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 -- 172.21.15.46:0/892086046 >> 172.21.15.46:0/892086046 conn(0x7ff568068e20 msgr2=0x7ff5680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 -- 172.21.15.46:0/892086046 shutdown_connections 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.703+0000 7ff56ce1a700 1 -- 172.21.15.46:0/892086046 wait complete. 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.704+0000 7ff56ce1a700 1 Processor -- start 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.704+0000 7ff56ce1a700 1 -- start start 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff56814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff568159c60 0x7ff5680cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680cfde0 con 0x7ff568159890 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b5880 con 0x7ff568159c60 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56ce1a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b6400 con 0x7ff568069560 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38780/0 (socket says 172.21.15.46:38780) 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 -- 172.21.15.46:0/4180522031 learned_addr learned my addr 172.21.15.46:0/4180522031 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff566d9d700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff568159c60 0x7ff5680cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56659c700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff56814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 -- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 msgr2=0x7ff56814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff56814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 -- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff568159c60 msgr2=0x7ff5680cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff568159c60 0x7ff5680cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff565d9b700 1 -- 172.21.15.46:0/4180522031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009a20 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.705+0000 7ff56659c700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff56814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff565d9b700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff55000cba0 tx=0x7ff550001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550001d20 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550007360 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550004830 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680b5ad0 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.706+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680b6090 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.707+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56804c3c0 con 0x7ff568159890 2023-10-07T09:05:43.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.707+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff550004ba0 con 0x7ff568159890 2023-10-07T09:05:43.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.707+0000 7ff55e7fc700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 0x7ff5480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:43.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.708+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7ff550083d00 con 0x7ff568159890 2023-10-07T09:05:43.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.708+0000 7ff56659c700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 0x7ff5480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:43.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.708+0000 7ff56659c700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 0x7ff5480697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff56806a070 tx=0x7ff558009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:43.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.712+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff550050c60 con 0x7ff568159890 2023-10-07T09:05:43.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.906+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff568156f30 con 0x7ff568159890 2023-10-07T09:05:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.909+0000 7ff55e7fc700 1 -- 172.21.15.46:0/4180522031 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff550018020 con 0x7ff568159890 2023-10-07T09:05:43.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 msgr2=0x7ff5480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 0x7ff5480697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff56806a070 tx=0x7ff558009040 comp rx=0 tx=0).stop 2023-10-07T09:05:43.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 msgr2=0x7ff568140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff55000cba0 tx=0x7ff550001ab0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 shutdown_connections 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff548067320 0x7ff5480697d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff568159c60 0x7ff5680cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff568069560 0x7ff56814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 --2- 172.21.15.46:0/4180522031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff568159890 0x7ff568140330 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 >> 172.21.15.46:0/4180522031 conn(0x7ff568068e20 msgr2=0x7ff568155320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 shutdown_connections 2023-10-07T09:05:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:43.911+0000 7ff56ce1a700 1 -- 172.21.15.46:0/4180522031 wait complete. 2023-10-07T09:05:43.924 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:05:43.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:43.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:05:44.003 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:05:44.003 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:05:44.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.121+0000 7fe842731700 1 Processor -- start 2023-10-07T09:05:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 -- start start 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe83c159890 0x7fe83c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c15a160 con 0x7fe83c15db10 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0d13a0 con 0x7fe83c159890 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe842731700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c15e140 con 0x7fe83c159c60 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.122+0000 7fe83bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe83c159890 0x7fe83c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe840cce700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe83c15db10 0x7fe83c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37538/0 (socket says 172.21.15.46:37538) 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe840cce700 1 -- 172.21.15.46:0/2154957274 learned_addr learned my addr 172.21.15.46:0/2154957274 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83b7fe700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83bfff700 1 -- 172.21.15.46:0/2154957274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 msgr2=0x7fe83c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83bfff700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83bfff700 1 -- 172.21.15.46:0/2154957274 >> v1:172.21.15.46:6789/0 conn(0x7fe83c15db10 legacy=0x7fe83c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83bfff700 1 -- 172.21.15.46:0/2154957274 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c15a3d0 con 0x7fe83c159890 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83b7fe700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83bfff700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c159890 0x7fe83c15abd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0098e0 tx=0x7fe82c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89f1a96289b2b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83affd700 1 -- 172.21.15.46:0/2154957274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c009e80 con 0x7fe83c159890 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83affd700 1 -- 172.21.15.46:0/2154957274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00b860 con 0x7fe83c159890 2023-10-07T09:05:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.123+0000 7fe83affd700 1 -- 172.21.15.46:0/2154957274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00bbe0 con 0x7fe83c159890 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 -- 172.21.15.46:0/2154957274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c159890 msgr2=0x7fe83c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c159890 0x7fe83c15abd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0098e0 tx=0x7fe82c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 -- 172.21.15.46:0/2154957274 shutdown_connections 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c159890 0x7fe83c15abd0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 --2- 172.21.15.46:0/2154957274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 -- 172.21.15.46:0/2154957274 >> 172.21.15.46:0/2154957274 conn(0x7fe83c068e20 msgr2=0x7fe83c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 -- 172.21.15.46:0/2154957274 shutdown_connections 2023-10-07T09:05:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.124+0000 7fe842731700 1 -- 172.21.15.46:0/2154957274 wait complete. 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.125+0000 7fe842731700 1 Processor -- start 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.125+0000 7fe842731700 1 -- start start 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83c159890 0x7fe83c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c16ae10 con 0x7fe83c15db10 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c16a200 con 0x7fe83c159890 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c16a4e0 con 0x7fe83c159c60 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38800/0 (socket says 172.21.15.46:38800) 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 -- 172.21.15.46:0/103215041 learned_addr learned my addr 172.21.15.46:0/103215041 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe83b7fe700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe83bfff700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83c159890 0x7fe83c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 -- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 msgr2=0x7fe83c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 -- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83c159890 msgr2=0x7fe83c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83c159890 0x7fe83c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 -- 172.21.15.46:0/103215041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c009420 con 0x7fe83c15db10 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe840cce700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe83400cbc0 tx=0x7fe8340019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400a940 con 0x7fe83c15db10 2023-10-07T09:05:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83400aaa0 con 0x7fe83c15db10 2023-10-07T09:05:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400ae20 con 0x7fe83c15db10 2023-10-07T09:05:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.126+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c16a7c0 con 0x7fe83c15db10 2023-10-07T09:05:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.127+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c169f00 con 0x7fe83c15db10 2023-10-07T09:05:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.128+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c04c3c0 con 0x7fe83c15db10 2023-10-07T09:05:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.128+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe834007300 con 0x7fe83c15db10 2023-10-07T09:05:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.128+0000 7fe823fff700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 0x7fe8280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.128+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fe834084e00 con 0x7fe83c15db10 2023-10-07T09:05:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.128+0000 7fe83bfff700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 0x7fe8280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.129+0000 7fe83bfff700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 0x7fe8280697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0091e0 tx=0x7fe82c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.132+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe834051cd0 con 0x7fe83c15db10 2023-10-07T09:05:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.367+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe83c16af50 con 0x7fe83c15db10 2023-10-07T09:05:44.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.368+0000 7fe823fff700 1 -- 172.21.15.46:0/103215041 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe83c16af50 con 0x7fe83c15db10 2023-10-07T09:05:44.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:44.369 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1467440491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1467440491},{"type":"v1","addr":"172.21.15.133:6837","nonce":1467440491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":6622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2222014355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2222014355},{"type":"v1","addr":"172.21.15.133:6836","nonce":2222014355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/2310694783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2310694783},{"type":"v1","addr":"172.21.15.46:6834","nonce":2310694783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":7470,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3533738998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3533738998},{"type":"v1","addr":"172.21.15.46:6835","nonce":3533738998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[]} 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 msgr2=0x7fe8280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 0x7fe8280697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0091e0 tx=0x7fe82c017000 comp rx=0 tx=0).stop 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 msgr2=0x7fe83c156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe83400cbc0 tx=0x7fe8340019c0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 shutdown_connections 2023-10-07T09:05:44.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe828067320 0x7fe8280697d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c15db10 0x7fe83c156650 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83c159890 0x7fe83c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 --2- 172.21.15.46:0/103215041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe83c159c60 0x7fe83c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 >> 172.21.15.46:0/103215041 conn(0x7fe83c068e20 msgr2=0x7fe83c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 shutdown_connections 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.370+0000 7fe842731700 1 -- 172.21.15.46:0/103215041 wait complete. 2023-10-07T09:05:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 86 2023-10-07T09:05:44.383 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:05:44.383 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:05:44.384 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:05:44.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:44.384 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:05:44.384 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:05:44.384 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:05:44.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:44.384 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:05:44.385 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:05:44.385 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:05:44.385 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:44.385 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:05:44.385 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:05:44.385 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:05:44.385 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:05:44.394 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:05:44.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:05:44.395 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:05:44.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:05:44.396 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:05:44.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:05:44.397 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:05:44.397 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:05:44.436 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:05:44.437 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:44.437 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:05:44.437 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:44.439 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:05:44.439 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:44.440 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:05:44.440 DEBUG:teuthology.parallel:result is None 2023-10-07T09:05:44.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:05:44.512 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:05:44.512 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:05:44.531 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:05:44.531 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:05:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.564+0000 7f5fc1c95700 1 Processor -- start 2023-10-07T09:05:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.564+0000 7f5fc1c95700 1 -- start start 2023-10-07T09:05:44.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fc1c95700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5fbc15d730 0x7f5fbc15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fc1c95700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fc1c95700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc0c74b0 con 0x7f5fbc159b10 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fc1c95700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c8700 con 0x7f5fbc15d730 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fc1c95700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c9070 con 0x7f5fbc06a410 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5fbc15d730 0x7f5fbc15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbb7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5fbc159b10 0x7f5fbc0cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37544/0 (socket says 172.21.15.46:37544) 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbb7fe700 1 -- 172.21.15.46:0/1719645546 learned_addr learned my addr 172.21.15.46:0/1719645546 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbbfff700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbaffd700 1 -- 172.21.15.46:0/1719645546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 msgr2=0x7f5fbc06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbaffd700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc06a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbaffd700 1 -- 172.21.15.46:0/1719645546 >> v1:172.21.15.46:6789/0 conn(0x7f5fbc159b10 legacy=0x7f5fbc0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fba7fc700 1 -- 172.21.15.46:0/1719645546 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589640392 0 0) 0x7f5fbc0c74b0 con 0x7f5fbc159b10 2023-10-07T09:05:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.565+0000 7f5fbaffd700 1 -- 172.21.15.46:0/1719645546 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc15e0e0 con 0x7f5fbc15d730 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fbaffd700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc15d730 0x7f5fbc15dba0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40098e0 tx=0x7f5fa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9729291bc4a227 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fba7fc700 1 -- 172.21.15.46:0/1719645546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400b6d0 con 0x7f5fbc15d730 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fba7fc700 1 -- 172.21.15.46:0/1719645546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400b830 con 0x7f5fbc15d730 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fba7fc700 1 -- 172.21.15.46:0/1719645546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400bbd0 con 0x7f5fbc15d730 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 -- 172.21.15.46:0/1719645546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc15d730 msgr2=0x7f5fbc15dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc15d730 0x7f5fbc15dba0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40098e0 tx=0x7f5fa40091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 -- 172.21.15.46:0/1719645546 shutdown_connections 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc06a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/1719645546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc15d730 0x7f5fbc15dba0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 -- 172.21.15.46:0/1719645546 >> 172.21.15.46:0/1719645546 conn(0x7f5fbc0c9870 msgr2=0x7f5fbc0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 -- 172.21.15.46:0/1719645546 shutdown_connections 2023-10-07T09:05:44.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.566+0000 7f5fc1c95700 1 -- 172.21.15.46:0/1719645546 wait complete. 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 Processor -- start 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 -- start start 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fbc15d730 0x7f5fbc16d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c7dc0 con 0x7f5fbc159b10 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c2600 con 0x7f5fbc15d730 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fc1c95700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c7ae0 con 0x7f5fbc06a410 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38836/0 (socket says 172.21.15.46:38836) 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.568+0000 7f5fbaffd700 1 -- 172.21.15.46:0/2718873829 learned_addr learned my addr 172.21.15.46:0/2718873829 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbb7fe700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbbfff700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fbc15d730 0x7f5fbc16d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 -- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 msgr2=0x7f5fbc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 -- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fbc15d730 msgr2=0x7f5fbc16d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fbc15d730 0x7f5fbc16d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:44.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 -- 172.21.15.46:0/2718873829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009420 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fbaffd700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009f80 tx=0x7f5fa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400bbb0 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4011420 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0c1fb0 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40117a0 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.569+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc0c4960 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.570+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc0c2790 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.571+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5fa4011b50 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.571+0000 7f5fb37fe700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 0x7f5f9c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.571+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f5fa4085fe0 con 0x7f5fbc159b10 2023-10-07T09:05:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.571+0000 7f5fbb7fe700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 0x7f5f9c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.572+0000 7f5fbb7fe700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 0x7f5f9c0697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0c4350 tx=0x7f5fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.575+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fa4052ec0 con 0x7f5fbc159b10 2023-10-07T09:05:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:44.782+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5fbc04c3c0 con 0x7f5fbc159b10 2023-10-07T09:05:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.948+0000 7f5fb37fe700 1 -- 172.21.15.46:0/2718873829 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fa4015080 con 0x7f5fbc159b10 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 msgr2=0x7f5f9c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 0x7f5f9c0697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0c4350 tx=0x7f5fb4009040 comp rx=0 tx=0).stop 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 msgr2=0x7f5fbc0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009f80 tx=0x7f5fa4017000 comp rx=0 tx=0).stop 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 shutdown_connections 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5f9c067320 0x7f5f9c0697d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fbc15d730 0x7f5fbc16d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fbc06a410 0x7f5fbc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 --2- 172.21.15.46:0/2718873829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fbc159b10 0x7f5fbc0c6fd0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 >> 172.21.15.46:0/2718873829 conn(0x7f5fbc0c9870 msgr2=0x7f5fbc1555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 shutdown_connections 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:45.951+0000 7f5fc1c95700 1 -- 172.21.15.46:0/2718873829 wait complete. 2023-10-07T09:05:45.958 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:05:45.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:05:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.098+0000 7f216bab8700 1 Processor -- start 2023-10-07T09:05:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.098+0000 7f216bab8700 1 -- start start 2023-10-07T09:05:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216bab8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159b10 0x7f21640cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216bab8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f216415d730 0x7f216415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216bab8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21640c74b0 con 0x7f2164159ee0 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216bab8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21640c8700 con 0x7f216415d730 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216bab8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c9070 con 0x7f2164159b10 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f2169053700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f216415d730 0x7f216415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216a055700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2164159ee0 0x7f216415a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37556/0 (socket says 172.21.15.46:37556) 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.099+0000 7f216a055700 1 -- 172.21.15.46:0/2703649855 learned_addr learned my addr 172.21.15.46:0/2703649855 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169854700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159b10 0x7f21640cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2168852700 1 -- 172.21.15.46:0/2703649855 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421292821 0 0) 0x7f21640c74b0 con 0x7f2164159ee0 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2168852700 1 -- 172.21.15.46:0/2703649855 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003570 con 0x7f2164159ee0 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169053700 1 -- 172.21.15.46:0/2703649855 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159b10 msgr2=0x7f21640cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169053700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159b10 0x7f21640cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169053700 1 -- 172.21.15.46:0/2703649855 >> v1:172.21.15.46:6789/0 conn(0x7f2164159ee0 legacy=0x7f216415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169053700 1 -- 172.21.15.46:0/2703649855 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216415e0e0 con 0x7f216415d730 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2169053700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f216415d730 0x7f216415dba0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f21580098e0 tx=0x7f21580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69626ef1553b1901 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2168852700 1 -- 172.21.15.46:0/2703649855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158011630 con 0x7f216415d730 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2168852700 1 -- 172.21.15.46:0/2703649855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158011790 con 0x7f216415d730 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.100+0000 7f2168852700 1 -- 172.21.15.46:0/2703649855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158011b30 con 0x7f216415d730 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 -- 172.21.15.46:0/2703649855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f216415d730 msgr2=0x7f216415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f216415d730 0x7f216415dba0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f21580098e0 tx=0x7f21580091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 -- 172.21.15.46:0/2703649855 shutdown_connections 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159b10 0x7f21640cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 --2- 172.21.15.46:0/2703649855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f216415d730 0x7f216415dba0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 -- 172.21.15.46:0/2703649855 >> 172.21.15.46:0/2703649855 conn(0x7f21640c9870 msgr2=0x7f21640c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 -- 172.21.15.46:0/2703649855 shutdown_connections 2023-10-07T09:05:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.101+0000 7f216bab8700 1 -- 172.21.15.46:0/2703649855 wait complete. 2023-10-07T09:05:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.102+0000 7f216bab8700 1 Processor -- start 2023-10-07T09:05:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.102+0000 7f216bab8700 1 -- start start 2023-10-07T09:05:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 0x7f21640c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f216415d730 0x7f2164149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640afba0 con 0x7f2164159b10 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640b0160 con 0x7f216415d730 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c79b0 con 0x7f2164159ee0 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38846/0 (socket says 172.21.15.46:38846) 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 -- 172.21.15.46:0/453882171 learned_addr learned my addr 172.21.15.46:0/453882171 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169053700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 0x7f21640c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 -- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 msgr2=0x7f21640c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 0x7f21640c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 -- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f216415d730 msgr2=0x7f2164149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f216415d730 0x7f2164149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 -- 172.21.15.46:0/453882171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009420 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169053700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 0x7f21640c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2169854700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f215c00ecb0 tx=0x7f215c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00c9d0 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c00cb30 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21640c7c90 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.103+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00ced0 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.104+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21640c76b0 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.105+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21640b0440 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.105+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f215c013680 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.105+0000 7f2161ffb700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 0x7f21500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.106+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f215c084ce0 con 0x7f2164159b10 2023-10-07T09:05:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.106+0000 7f2169053700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 0x7f21500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.106+0000 7f2169053700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 0x7f21500697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2164156d10 tx=0x7f2158017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.110+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f215c051cc0 con 0x7f2164159b10 2023-10-07T09:05:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.382+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f216404c3c0 con 0x7f2164159b10 2023-10-07T09:05:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.382+0000 7f2161ffb700 1 -- 172.21.15.46:0/453882171 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f215c0552e0 con 0x7f2164159b10 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:46.384 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.386 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.387 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.388 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.389 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:05:46.391 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.392 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.393 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.394 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:05:46.395 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:05:46.396 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:46.397 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.398 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:05:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:05:46.400 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:05:46.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:46.400 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:05:46.400 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:05:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 msgr2=0x7f21500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 0x7f21500697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2164156d10 tx=0x7f2158017000 comp rx=0 tx=0).stop 2023-10-07T09:05:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 msgr2=0x7f2164068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f215c00ecb0 tx=0x7f215c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 shutdown_connections 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2150067320 0x7f21500697d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f216415d730 0x7f2164149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2164159b10 0x7f2164068c60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 --2- 172.21.15.46:0/453882171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2164159ee0 0x7f21640c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 >> 172.21.15.46:0/453882171 conn(0x7f21640c9870 msgr2=0x7f21641581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 shutdown_connections 2023-10-07T09:05:46.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.384+0000 7f216bab8700 1 -- 172.21.15.46:0/453882171 wait complete. 2023-10-07T09:05:46.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:46.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.523+0000 7f0a7f1c1700 1 Processor -- start 2023-10-07T09:05:46.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.523+0000 7f0a7f1c1700 1 -- start start 2023-10-07T09:05:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7f1c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a781597f0 0x7f0a780b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7f1c1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a780b11d0 con 0x7f0a7815d230 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7f1c1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a780b14b0 con 0x7f0a78159420 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7f1c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a780b1790 con 0x7f0a781597f0 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7e9c0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0a7815d230 0x7f0a7815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37564/0 (socket says 172.21.15.46:37564) 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7e9c0700 1 -- 172.21.15.46:0/925553161 learned_addr learned my addr 172.21.15.46:0/925553161 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> v2:172.21.15.133:3300/0 conn(0x7f0a781597f0 0x7f0a780b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407077298 0 0) 0x7f0a780b11d0 con 0x7f0a7815d230 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a64003570 con 0x7f0a7815d230 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387333603 0 0) 0x7f0a64003570 con 0x7f0a7815d230 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 >> v2:172.21.15.133:3300/0 conn(0x7f0a781597f0 msgr2=0x7f0a780b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.524+0000 7f0a7d1bd700 1 --2- 172.21.15.46:0/925553161 >> v2:172.21.15.133:3300/0 conn(0x7f0a781597f0 0x7f0a780b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 >> v1:172.21.15.133:6789/0 conn(0x7f0a78159420 legacy=0x7f0a780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780b1a70 con 0x7f0a7815d230 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f0a700017f0 con 0x7f0a7815d230 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 >> v1:172.21.15.46:6789/0 conn(0x7f0a7815d230 legacy=0x7f0a7815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a64003a60 0x7f0a64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 0x7f0a64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a640051c0 0x7f0a6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a780b1790 con 0x7f0a64004810 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6400c0d0 con 0x7f0a640051c0 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6400c290 con 0x7f0a64003a60 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> v2:172.21.15.133:3300/0 conn(0x7f0a781597f0 0x7f0a780b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 0x7f0a64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7e1bf700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a64003a60 0x7f0a64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7e9c0700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a640051c0 0x7f0a6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 -- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a64003a60 msgr2=0x7f0a64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a64003a60 0x7f0a64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 -- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a640051c0 msgr2=0x7f0a6400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a640051c0 0x7f0a6400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 -- 172.21.15.46:0/925553161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64003570 con 0x7f0a64004810 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7e9c0700 1 -- 172.21.15.46:0/925553161 reap_dead start 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 0x7f0a64004c80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0a78159c70 tx=0x7f0a680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a478736b2f4a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68009740 con 0x7f0a64004810 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800e920 con 0x7f0a64004810 2023-10-07T09:05:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.525+0000 7f0a7d1bd700 1 -- 172.21.15.46:0/925553161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800ecc0 con 0x7f0a64004810 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 msgr2=0x7f0a64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 0x7f0a64004c80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0a78159c70 tx=0x7f0a680091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/925553161 shutdown_connections 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/925553161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a64004810 0x7f0a64004c80 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/925553161 >> 172.21.15.46:0/925553161 conn(0x7f0a780d0660 msgr2=0x7f0a780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/925553161 shutdown_connections 2023-10-07T09:05:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.526+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/925553161 wait complete. 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.527+0000 7f0a7f1c1700 1 Processor -- start 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.527+0000 7f0a7f1c1700 1 -- start start 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a64004810 0x7f0a7815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a7816cd90 0x7f0a780c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815b6a0 con 0x7f0a7815a660 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7816d230 con 0x7f0a64004810 2023-10-07T09:05:46.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7f1c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815ae00 con 0x7f0a7816cd90 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7d9be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7d9be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38874/0 (socket says 172.21.15.46:38874) 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7d9be700 1 -- 172.21.15.46:0/3490924869 learned_addr learned my addr 172.21.15.46:0/3490924869 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7e1bf700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a64004810 0x7f0a7815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.528+0000 7f0a7e9c0700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a7816cd90 0x7f0a780c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 -- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a7816cd90 msgr2=0x7f0a780c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a7816cd90 0x7f0a780c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 -- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a64004810 msgr2=0x7f0a7815cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a64004810 0x7f0a7815cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 -- 172.21.15.46:0/3490924869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7815b0e0 con 0x7f0a7815a660 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.529+0000 7f0a7d9be700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e790 tx=0x7f0a68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.531+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68009740 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.531+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7815b3c0 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.531+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7815aad0 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.531+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68021040 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.531+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68005a00 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.532+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a6801b810 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.532+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7816a360 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.532+0000 7f0a6e7fc700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 0x7f0a5c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.532+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0a680867f0 con 0x7f0a7815a660 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.532+0000 7f0a7e1bf700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 0x7f0a5c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.533+0000 7f0a7e1bf700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 0x7f0a5c0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0a78066e40 tx=0x7f0a74007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.537+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a680537d0 con 0x7f0a7815a660 2023-10-07T09:05:46.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.728+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a7815b600 con 0x7f0a7815a660 2023-10-07T09:05:46.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.729+0000 7f0a6e7fc700 1 -- 172.21.15.46:0/3490924869 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f0a68056df0 con 0x7f0a7815a660 2023-10-07T09:05:46.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:46.730 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":134,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:45.944856+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 msgr2=0x7f0a5c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 0x7f0a5c0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0a78066e40 tx=0x7f0a74007d30 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 msgr2=0x7f0a7816c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e790 tx=0x7f0a68019000 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 shutdown_connections 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a5c067320 0x7f0a5c0697d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a7816cd90 0x7f0a780c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a64004810 0x7f0a7815cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 --2- 172.21.15.46:0/3490924869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7815a660 0x7f0a7816c850 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 >> 172.21.15.46:0/3490924869 conn(0x7f0a780d0660 msgr2=0x7f0a780699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 shutdown_connections 2023-10-07T09:05:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.731+0000 7f0a7f1c1700 1 -- 172.21.15.46:0/3490924869 wait complete. 2023-10-07T09:05:46.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:05:46.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:05:46.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.865+0000 7f392c013700 1 Processor -- start 2023-10-07T09:05:46.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.865+0000 7f392c013700 1 -- start start 2023-10-07T09:05:46.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f392c013700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3924159c60 0x7f392415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f392c013700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392415a160 con 0x7f3924159890 2023-10-07T09:05:46.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f392c013700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39240d13a0 con 0x7f392415db10 2023-10-07T09:05:46.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f392c013700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392415df50 con 0x7f3924159c60 2023-10-07T09:05:46.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f3929daf700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3924159890 0x7f392415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37566/0 (socket says 172.21.15.46:37566) 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f3929daf700 1 -- 172.21.15.46:0/730617489 learned_addr learned my addr 172.21.15.46:0/730617489 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f39295ae700 1 --2- 172.21.15.46:0/730617489 >> v2:172.21.15.133:3300/0 conn(0x7f3924159c60 0x7f392415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687555458 0 0) 0x7f392415a160 con 0x7f3924159890 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.866+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3910003570 con 0x7f3924159890 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126422369 0 0) 0x7f3910003570 con 0x7f3924159890 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 >> v2:172.21.15.133:3300/0 conn(0x7f3924159c60 msgr2=0x7f392415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 --2- 172.21.15.46:0/730617489 >> v2:172.21.15.133:3300/0 conn(0x7f3924159c60 0x7f392415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 >> v1:172.21.15.133:6789/0 conn(0x7f392415db10 legacy=0x7f3924069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392415e140 con 0x7f3924159890 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f3920001470 con 0x7f3924159890 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 >> v1:172.21.15.46:6789/0 conn(0x7f3924159890 legacy=0x7f392415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910003a60 0x7f3910003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 0x7f3910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39100051c0 0x7f391000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391000c0a0 con 0x7f3910004810 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391000c210 con 0x7f3910003a60 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391000c3d0 con 0x7f39100051c0 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 0x7f3910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3929daf700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910003a60 0x7f3910003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f392a5b0700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39100051c0 0x7f391000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 -- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39100051c0 msgr2=0x7f391000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39100051c0 0x7f391000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 -- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910003a60 msgr2=0x7f3910003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910003a60 0x7f3910003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 -- 172.21.15.46:0/730617489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910003570 con 0x7f3910004810 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f392a5b0700 1 -- 172.21.15.46:0/730617489 reap_dead start 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f39295ae700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 0x7f3910004c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3914009c00 tx=0x7f39140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5536000743cb86b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400e710 con 0x7f3910004810 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400e870 con 0x7f3910004810 2023-10-07T09:05:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.867+0000 7f3928dad700 1 -- 172.21.15.46:0/730617489 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400ec30 con 0x7f3910004810 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 -- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 msgr2=0x7f3910004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 0x7f3910004c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3914009c00 tx=0x7f39140091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 -- 172.21.15.46:0/730617489 shutdown_connections 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 --2- 172.21.15.46:0/730617489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3910004810 0x7f3910004c80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 -- 172.21.15.46:0/730617489 >> 172.21.15.46:0/730617489 conn(0x7f3924068e20 msgr2=0x7f39240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 -- 172.21.15.46:0/730617489 shutdown_connections 2023-10-07T09:05:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.868+0000 7f392c013700 1 -- 172.21.15.46:0/730617489 wait complete. 2023-10-07T09:05:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.869+0000 7f392c013700 1 Processor -- start 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.869+0000 7f392c013700 1 -- start start 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910004810 0x7f3924141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39240c7f80 0x7f392415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240cea10 con 0x7f39240c7b10 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240cefd0 con 0x7f3910004810 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392c013700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240b41c0 con 0x7f39240c7f80 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f39295ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f39295ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38892/0 (socket says 172.21.15.46:38892) 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f39295ae700 1 -- 172.21.15.46:0/2956490665 learned_addr learned my addr 172.21.15.46:0/2956490665 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f392a5b0700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39240c7f80 0x7f392415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.870+0000 7f3929daf700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910004810 0x7f3924141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 -- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39240c7f80 msgr2=0x7f392415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39240c7f80 0x7f392415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 -- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910004810 msgr2=0x7f3924141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910004810 0x7f3924141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 -- 172.21.15.46:0/2956490665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240b44a0 con 0x7f39240c7b10 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f39295ae700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f391400e4b0 tx=0x7f391401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914022070 con 0x7f39240c7b10 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400e9e0 con 0x7f39240c7b10 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39240cec60 con 0x7f39240c7b10 2023-10-07T09:05:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400e710 con 0x7f39240c7b10 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.871+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39240b3590 con 0x7f39240c7b10 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.872+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392404c3c0 con 0x7f39240c7b10 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.873+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f391401c450 con 0x7f39240c7b10 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.873+0000 7f3919ffb700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 0x7f39080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.873+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f39140864c0 con 0x7f39240c7b10 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.874+0000 7f3929daf700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 0x7f39080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.874+0000 7f3929daf700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 0x7f39080697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3920001620 tx=0x7f3920001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:46.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:46.878+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3914053460 con 0x7f39240c7b10 2023-10-07T09:05:47.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.067+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39240cf110 con 0x7f39240c7b10 2023-10-07T09:05:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.068+0000 7f3919ffb700 1 -- 172.21.15.46:0/2956490665 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3914056a80 con 0x7f39240c7b10 2023-10-07T09:05:47.165 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:05:47.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 msgr2=0x7f39080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 0x7f39080697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3920001620 tx=0x7f3920001e50 comp rx=0 tx=0).stop 2023-10-07T09:05:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 msgr2=0x7f392415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f391400e4b0 tx=0x7f391401a000 comp rx=0 tx=0).stop 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 shutdown_connections 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3908067320 0x7f39080697d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39240c7f80 0x7f392415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3910004810 0x7f3924141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 --2- 172.21.15.46:0/2956490665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39240c7b10 0x7f392415c650 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 >> 172.21.15.46:0/2956490665 conn(0x7f3924068e20 msgr2=0x7f39240c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 shutdown_connections 2023-10-07T09:05:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.070+0000 7f392c013700 1 -- 172.21.15.46:0/2956490665 wait complete. 2023-10-07T09:05:47.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:05:47.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.316+0000 7f63f16d0700 1 Processor -- start 2023-10-07T09:05:47.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.316+0000 7f63f16d0700 1 -- start start 2023-10-07T09:05:47.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63f16d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63f16d0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f63ec159fb0 0x7f63ec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63f16d0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0d01f0 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63f16d0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0cf5e0 con 0x7f63ec159fb0 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63f16d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0cf8c0 con 0x7f63ec1594d0 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63eb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f63ec159fb0 0x7f63ec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63ea7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f63ec0b5fb0 0x7f63ec1598a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37576/0 (socket says 172.21.15.46:37576) 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.317+0000 7f63ea7fc700 1 -- 172.21.15.46:0/1499979941 learned_addr learned my addr 172.21.15.46:0/1499979941 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eaffd700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eb7fe700 1 -- 172.21.15.46:0/1499979941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 msgr2=0x7f63ec0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eb7fe700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eb7fe700 1 -- 172.21.15.46:0/1499979941 >> v1:172.21.15.46:6789/0 conn(0x7f63ec0b5fb0 legacy=0x7f63ec1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63e9ffb700 1 -- 172.21.15.46:0/1499979941 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665093463 0 0) 0x7f63ec0d01f0 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eb7fe700 1 -- 172.21.15.46:0/1499979941 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0cfba0 con 0x7f63ec159fb0 2023-10-07T09:05:47.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63eb7fe700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159fb0 0x7f63ec0b1050 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009e60 tx=0x7f63e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bddc5e98a66adf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63e9ffb700 1 -- 172.21.15.46:0/1499979941 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400e070 con 0x7f63ec159fb0 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63e9ffb700 1 -- 172.21.15.46:0/1499979941 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400bb60 con 0x7f63ec159fb0 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.318+0000 7f63e9ffb700 1 -- 172.21.15.46:0/1499979941 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4012430 con 0x7f63ec159fb0 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 -- 172.21.15.46:0/1499979941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159fb0 msgr2=0x7f63ec0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159fb0 0x7f63ec0b1050 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009e60 tx=0x7f63e4009780 comp rx=0 tx=0).stop 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 -- 172.21.15.46:0/1499979941 shutdown_connections 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec159fb0 0x7f63ec0b1050 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 --2- 172.21.15.46:0/1499979941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 -- 172.21.15.46:0/1499979941 >> 172.21.15.46:0/1499979941 conn(0x7f63ec0d05f0 msgr2=0x7f63ec0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 -- 172.21.15.46:0/1499979941 shutdown_connections 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.319+0000 7f63f16d0700 1 -- 172.21.15.46:0/1499979941 wait complete. 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.320+0000 7f63f16d0700 1 Processor -- start 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.320+0000 7f63f16d0700 1 -- start start 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec159fb0 0x7f63ec0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c7a90 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15b850 con 0x7f63ec159fb0 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15af20 con 0x7f63ec1594d0 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38904/0 (socket says 172.21.15.46:38904) 2023-10-07T09:05:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 -- 172.21.15.46:0/105954084 learned_addr learned my addr 172.21.15.46:0/105954084 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eb7fe700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec159fb0 0x7f63ec0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63ea7fc700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 -- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 msgr2=0x7f63ec0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 -- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec159fb0 msgr2=0x7f63ec0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec159fb0 0x7f63ec0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 -- 172.21.15.46:0/105954084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009a20 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63eaffd700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00ec80 tx=0x7f63dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00c9d0 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc00cb30 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec15b200 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc013470 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.321+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14a440 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.322+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0ccff0 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.323+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f63dc013820 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.323+0000 7f63e2ffd700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 0x7f63cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.323+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f63dc084c20 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.323+0000 7f63ea7fc700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 0x7f63cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.324+0000 7f63ea7fc700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 0x7f63cc0697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63d40011e0 tx=0x7f63d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.327+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63dc051c00 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.521+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63ec04c3c0 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.521+0000 7f63e2ffd700 1 -- 172.21.15.46:0/105954084 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7f63dc055220 con 0x7f63ec0b5fb0 2023-10-07T09:05:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:05:47.523 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 msgr2=0x7f63cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 0x7f63cc0697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63d40011e0 tx=0x7f63d4009040 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 msgr2=0x7f63ec149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00ec80 tx=0x7f63dc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 shutdown_connections 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f63cc067320 0x7f63cc0697d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec159fb0 0x7f63ec0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63ec0b5fb0 0x7f63ec149f00 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 --2- 172.21.15.46:0/105954084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec1594d0 0x7f63ec0ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 >> 172.21.15.46:0/105954084 conn(0x7f63ec0d05f0 msgr2=0x7f63ec158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 shutdown_connections 2023-10-07T09:05:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.523+0000 7f63f16d0700 1 -- 172.21.15.46:0/105954084 wait complete. 2023-10-07T09:05:47.536 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:05:47.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:05:47.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.658+0000 7ff191148700 1 Processor -- start 2023-10-07T09:05:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.658+0000 7ff191148700 1 -- start start 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.659+0000 7ff191148700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff191148700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff191148700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0b5b00 con 0x7ff18c159ec0 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff191148700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0b5da0 con 0x7ff18c0cd910 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff191148700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b6080 con 0x7ff18c0b55a0 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:58428/0 (socket says 172.21.15.46:58428) 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:45748/0 (socket says 172.21.15.46:45748) 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff18c159ec0 0x7ff18c0b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:55088/0 (socket says 172.21.15.46:55088) 2023-10-07T09:05:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18a59c700 1 -- 172.21.15.46:0/1580717849 learned_addr learned my addr 172.21.15.46:0/1580717849 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 -- 172.21.15.46:0/1580717849 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 msgr2=0x7ff18c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 --2- 172.21.15.46:0/1580717849 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 -- 172.21.15.46:0/1580717849 >> v1:172.21.15.133:6789/0 conn(0x7ff18c159ec0 legacy=0x7ff18c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff189d9b700 1 -- 172.21.15.46:0/1580717849 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740494796 0 0) 0x7ff18c0b5b00 con 0x7ff18c159ec0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18b59e700 1 -- 172.21.15.46:0/1580717849 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0cc100 con 0x7ff18c0b55a0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.660+0000 7ff18a59c700 1 --2- 172.21.15.46:0/1580717849 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff18b59e700 1 --2- 172.21.15.46:0/1580717849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff184009e90 tx=0x7ff184009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2700468e6a5c593 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff189d9b700 1 -- 172.21.15.46:0/1580717849 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400e070 con 0x7ff18c0b55a0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff189d9b700 1 -- 172.21.15.46:0/1580717849 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18400bbf0 con 0x7ff18c0b55a0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff189d9b700 1 -- 172.21.15.46:0/1580717849 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184012430 con 0x7ff18c0b55a0 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 -- 172.21.15.46:0/1580717849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 msgr2=0x7ff18c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 --2- 172.21.15.46:0/1580717849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff184009e90 tx=0x7ff184009780 comp rx=0 tx=0).stop 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 -- 172.21.15.46:0/1580717849 shutdown_connections 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 --2- 172.21.15.46:0/1580717849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b55a0 0x7ff18c0ce880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 --2- 172.21.15.46:0/1580717849 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0cd910 0x7ff18c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 -- 172.21.15.46:0/1580717849 >> 172.21.15.46:0/1580717849 conn(0x7ff18c0999f0 msgr2=0x7ff18c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 -- 172.21.15.46:0/1580717849 shutdown_connections 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.661+0000 7ff191148700 1 -- 172.21.15.46:0/1580717849 wait complete. 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.662+0000 7ff191148700 1 Processor -- start 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 -- start start 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c159ec0 0x7ff18c1694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c16d6a0 0x7ff18c16c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c1546f0 con 0x7ff18c0b55a0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c169d50 con 0x7ff18c16d6a0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff191148700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c16a030 con 0x7ff18c159ec0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38912/0 (socket says 172.21.15.46:38912) 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.663+0000 7ff18ad9d700 1 -- 172.21.15.46:0/652507813 learned_addr learned my addr 172.21.15.46:0/652507813 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18a59c700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c159ec0 0x7ff18c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18b59e700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c16d6a0 0x7ff18c16c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 -- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c159ec0 msgr2=0x7ff18c1694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c159ec0 0x7ff18c1694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 -- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c16d6a0 msgr2=0x7ff18c16c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c16d6a0 0x7ff18c16c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 -- 172.21.15.46:0/652507813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740094f0 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff18ad9d700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c810 tx=0x7ff17c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005b90 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c005d10 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff184009a20 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007320 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.664+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c154310 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.665+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c063c90 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.666+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff17c01b3b0 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.666+0000 7ff182ffd700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 0x7ff16c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.666+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff17c083d90 con 0x7ff18c0b55a0 2023-10-07T09:05:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.666+0000 7ff18a59c700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 0x7ff16c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.667+0000 7ff18a59c700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 0x7ff16c0697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff18c146db0 tx=0x7ff174009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.670+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff17c050d70 con 0x7ff18c0b55a0 2023-10-07T09:05:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:47.863+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff18c0718b0 con 0x7ff18c0b55a0 2023-10-07T09:05:48.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.541+0000 7ff182ffd700 1 -- 172.21.15.46:0/652507813 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff17c017020 con 0x7ff18c0b55a0 2023-10-07T09:05:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.545+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 msgr2=0x7ff16c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.545+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 0x7ff16c0697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff18c146db0 tx=0x7ff174009250 comp rx=0 tx=0).stop 2023-10-07T09:05:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.545+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 msgr2=0x7ff18c16a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.545+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c810 tx=0x7ff17c007de0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 shutdown_connections 2023-10-07T09:05:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff16c067320 0x7ff16c0697d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c16d6a0 0x7ff18c16c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0b55a0 0x7ff18c16a680 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 --2- 172.21.15.46:0/652507813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c159ec0 0x7ff18c1694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 >> 172.21.15.46:0/652507813 conn(0x7ff18c0999f0 msgr2=0x7ff18c0ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:48.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.546+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 shutdown_connections 2023-10-07T09:05:48.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.547+0000 7ff191148700 1 -- 172.21.15.46:0/652507813 wait complete. 2023-10-07T09:05:48.571 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:05:48.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:05:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.704+0000 7f1ea41a1700 1 Processor -- start 2023-10-07T09:05:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.704+0000 7f1ea41a1700 1 -- start start 2023-10-07T09:05:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e9c158d40 0x7f1e9c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 0x7f1e9c1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c15b790 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c15ba70 con 0x7f1e9c158d40 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea41a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c15bd50 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38916/0 (socket says 172.21.15.46:38916) 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 -- 172.21.15.46:0/2782535782 learned_addr learned my addr 172.21.15.46:0/2782535782 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea273e700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 0x7f1e9c1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea173c700 1 --2- 172.21.15.46:0/2782535782 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c158d40 0x7f1e9c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 -- 172.21.15.46:0/2782535782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 msgr2=0x7f1e9c1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 0x7f1e9c1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 -- 172.21.15.46:0/2782535782 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c158d40 msgr2=0x7f1e9c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/2782535782 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c158d40 0x7f1e9c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea1f3d700 1 -- 172.21.15.46:0/2782535782 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c15c030 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.705+0000 7f1ea273e700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 0x7f1e9c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0cc140 tx=0x7f1e8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebb7a55b1ce81c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea0f3b700 1 -- 172.21.15.46:0/2782535782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00e070 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea0f3b700 1 -- 172.21.15.46:0/2782535782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00ba50 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea0f3b700 1 -- 172.21.15.46:0/2782535782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0092e0 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 -- 172.21.15.46:0/2782535782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06bcd0 msgr2=0x7f1e9c0c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0cc140 tx=0x7f1e8c009840 comp rx=0 tx=0).stop 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 -- 172.21.15.46:0/2782535782 shutdown_connections 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06c0a0 0x7f1e9c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/2782535782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c0c9230 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/2782535782 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c158d40 0x7f1e9c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 -- 172.21.15.46:0/2782535782 >> 172.21.15.46:0/2782535782 conn(0x7f1e9c0ce5c0 msgr2=0x7f1e9c0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 -- 172.21.15.46:0/2782535782 shutdown_connections 2023-10-07T09:05:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.706+0000 7f1ea41a1700 1 -- 172.21.15.46:0/2782535782 wait complete. 2023-10-07T09:05:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 Processor -- start 2023-10-07T09:05:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 -- start start 2023-10-07T09:05:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c158d40 0x7f1e9c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c159140 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c159420 con 0x7f1e9c06bcd0 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea41a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c159700 con 0x7f1e9c158d40 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea173c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea173c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38928/0 (socket says 172.21.15.46:38928) 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.708+0000 7f1ea173c700 1 -- 172.21.15.46:0/1740541457 learned_addr learned my addr 172.21.15.46:0/1740541457 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea273e700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c158d40 0x7f1e9c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 -- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c158d40 msgr2=0x7f1e9c0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:48.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c158d40 0x7f1e9c0b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 -- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c06bcd0 msgr2=0x7f1e9c137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 -- 172.21.15.46:0/1740541457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c009ae0 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea173c700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000d860 tx=0x7f1e90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900125f0 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90012750 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c1599e0 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90012b10 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.709+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c151020 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.710+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c0718b0 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.711+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e9001e460 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.711+0000 7f1e99ffb700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 0x7f1e880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.711+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1e90084fc0 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.711+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 0x7f1e880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:48.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.712+0000 7f1ea1f3d700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 0x7f1e880697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009880 tx=0x7f1e8c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:48.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.716+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e90051e30 con 0x7f1e9c06c0a0 2023-10-07T09:05:48.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:48.909+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1e9c0cf1f0 con 0x7f1e9c06c0a0 2023-10-07T09:05:49.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.544+0000 7f1e99ffb700 1 -- 172.21.15.46:0/1740541457 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1e90055450 con 0x7f1e9c06c0a0 2023-10-07T09:05:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 msgr2=0x7f1e880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 0x7f1e880697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009880 tx=0x7f1e8c018000 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 msgr2=0x7f1e9c154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000d860 tx=0x7f1e90008040 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 shutdown_connections 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1e88067320 0x7f1e880697d0 secure :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009880 tx=0x7f1e8c018000 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c158d40 0x7f1e9c0b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c06bcd0 0x7f1e9c137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 --2- 172.21.15.46:0/1740541457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e9c06c0a0 0x7f1e9c154350 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 >> 172.21.15.46:0/1740541457 conn(0x7f1e9c0ce5c0 msgr2=0x7f1e9c0c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.550+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 shutdown_connections 2023-10-07T09:05:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.555+0000 7f1ea41a1700 1 -- 172.21.15.46:0/1740541457 wait complete. 2023-10-07T09:05:49.700 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:05:49.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:05:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.831+0000 7f66b5a9a700 1 Processor -- start 2023-10-07T09:05:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.831+0000 7f66b5a9a700 1 -- start start 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66b5a9a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b0159c60 0x7f66b015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66b5a9a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b015db10 0x7f66b0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66b5a9a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b015a160 con 0x7f66b0159890 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66b5a9a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b015df50 con 0x7f66b0159c60 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66b5a9a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00d13a0 con 0x7f66b015db10 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66aeffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b0159c60 0x7f66b015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66aeffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b0159c60 0x7f66b015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49494/0 (socket says 172.21.15.46:49494) 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.832+0000 7f66aeffd700 1 -- 172.21.15.46:0/3222416681 learned_addr learned my addr 172.21.15.46:0/3222416681 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66affff700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b015db10 0x7f66b0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66aeffd700 1 -- 172.21.15.46:0/3222416681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b015db10 msgr2=0x7f66b0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66aeffd700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b015db10 0x7f66b0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66aeffd700 1 -- 172.21.15.46:0/3222416681 >> v1:172.21.15.133:6789/0 conn(0x7f66b0159890 legacy=0x7f66b015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66aeffd700 1 -- 172.21.15.46:0/3222416681 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b015e140 con 0x7f66b0159c60 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66aeffd700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159c60 0x7f66b015d5d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f66a40099b0 tx=0x7f66a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf80e122ee9a358 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66ae7fc700 1 -- 172.21.15.46:0/3222416681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400b860 con 0x7f66b0159c60 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66ae7fc700 1 -- 172.21.15.46:0/3222416681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400b9c0 con 0x7f66b0159c60 2023-10-07T09:05:49.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.833+0000 7f66ae7fc700 1 -- 172.21.15.46:0/3222416681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400bd60 con 0x7f66b0159c60 2023-10-07T09:05:49.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 -- 172.21.15.46:0/3222416681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159c60 msgr2=0x7f66b015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159c60 0x7f66b015d5d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f66a40099b0 tx=0x7f66a4009250 comp rx=0 tx=0).stop 2023-10-07T09:05:49.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 -- 172.21.15.46:0/3222416681 shutdown_connections 2023-10-07T09:05:49.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b015db10 0x7f66b0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/3222416681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159c60 0x7f66b015d5d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 -- 172.21.15.46:0/3222416681 >> 172.21.15.46:0/3222416681 conn(0x7f66b0068e20 msgr2=0x7f66b00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 -- 172.21.15.46:0/3222416681 shutdown_connections 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.834+0000 7f66b5a9a700 1 -- 172.21.15.46:0/3222416681 wait complete. 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.835+0000 7f66b5a9a700 1 Processor -- start 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.835+0000 7f66b5a9a700 1 -- start start 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 0x7f66b00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 0x7f66b00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0150730 con 0x7f66b0159890 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00cfe90 con 0x7f66b015db10 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66b5a9a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00b16c0 con 0x7f66b0159c60 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49504/0 (socket says 172.21.15.46:49504) 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 -- 172.21.15.46:0/1011965858 learned_addr learned my addr 172.21.15.46:0/1011965858 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66aeffd700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 0x7f66b00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66affff700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 0x7f66b00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 -- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 msgr2=0x7f66b00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 0x7f66b00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 -- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 msgr2=0x7f66b00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 0x7f66b00cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 -- 172.21.15.46:0/1011965858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40094f0 con 0x7f66b0159890 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66aeffd700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 0x7f66b00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66affff700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 0x7f66b00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.836+0000 7f66af7fe700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c590 tx=0x7f66a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:49.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011590 con 0x7f66b0159890 2023-10-07T09:05:49.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00116f0 con 0x7f66b0159890 2023-10-07T09:05:49.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011ab0 con 0x7f66b0159890 2023-10-07T09:05:49.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b00b19a0 con 0x7f66b0159890 2023-10-07T09:05:49.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b00b1f60 con 0x7f66b0159890 2023-10-07T09:05:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.837+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b004c3c0 con 0x7f66b0159890 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.838+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f66a001b3b0 con 0x7f66b0159890 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.839+0000 7f66977fe700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 0x7f669c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.839+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f66a00841c0 con 0x7f66b0159890 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.839+0000 7f66aeffd700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 0x7f669c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.839+0000 7f66aeffd700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 0x7f669c0697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66a40099b0 tx=0x7f66a4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:49.843+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66a0050eb0 con 0x7f66b0159890 2023-10-07T09:05:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.083+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66b006a5b0 con 0x7f66b0159890 2023-10-07T09:05:50.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.933+0000 7f66977fe700 1 -- 172.21.15.46:0/1011965858 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7f66a00544d0 con 0x7f66b0159890 2023-10-07T09:05:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.941+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 msgr2=0x7f669c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:50.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.941+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 0x7f669c0697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66a40099b0 tx=0x7f66a4017000 comp rx=0 tx=0).stop 2023-10-07T09:05:50.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.941+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 msgr2=0x7f66b00b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:50.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.941+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c590 tx=0x7f66a000c950 comp rx=0 tx=0).stop 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 shutdown_connections 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f669c067320 0x7f669c0697d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66b015db10 0x7f66b00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b0159890 0x7f66b00b1090 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 --2- 172.21.15.46:0/1011965858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66b0159c60 0x7f66b00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 >> 172.21.15.46:0/1011965858 conn(0x7f66b0068e20 msgr2=0x7f66b0153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 shutdown_connections 2023-10-07T09:05:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:50.942+0000 7f66b5a9a700 1 -- 172.21.15.46:0/1011965858 wait complete. 2023-10-07T09:05:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 24 and data pool 25 2023-10-07T09:05:50.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.081+0000 7f790045d700 1 Processor -- start 2023-10-07T09:05:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.081+0000 7f790045d700 1 -- start start 2023-10-07T09:05:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f790045d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78f8069560 0x7f78f80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f790045d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f8069ee0 con 0x7f78f8159890 2023-10-07T09:05:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f790045d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f815a160 con 0x7f78f8159c60 2023-10-07T09:05:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f790045d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80d13a0 con 0x7f78f8069560 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f78fe1f9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f78f8159890 0x7f78f815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46192/0 (socket says 172.21.15.46:46192) 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.082+0000 7f78fe1f9700 1 -- 172.21.15.46:0/3900255635 learned_addr learned my addr 172.21.15.46:0/3900255635 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fe9fa700 1 --2- 172.21.15.46:0/3900255635 >> v2:172.21.15.133:3300/0 conn(0x7f78f8069560 0x7f78f80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968740221 0 0) 0x7f78f8069ee0 con 0x7f78f8159890 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e0003570 con 0x7f78f8159890 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229099092 0 0) 0x7f78e0003570 con 0x7f78f8159890 2023-10-07T09:05:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 >> v2:172.21.15.133:3300/0 conn(0x7f78f8069560 msgr2=0x7f78f80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 --2- 172.21.15.46:0/3900255635 >> v2:172.21.15.133:3300/0 conn(0x7f78f8069560 0x7f78f80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 >> v1:172.21.15.133:6789/0 conn(0x7f78f8159c60 legacy=0x7f78f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f815e140 con 0x7f78f8159890 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f78e80017f0 con 0x7f78f8159890 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 >> v1:172.21.15.46:6789/0 conn(0x7f78f8159890 legacy=0x7f78f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0003a60 0x7f78e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 0x7f78e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e00051c0 0x7f78e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80d13a0 con 0x7f78e0004810 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e000c0d0 con 0x7f78e00051c0 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e000c290 con 0x7f78e0003a60 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 0x7f78e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fe9fa700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e00051c0 0x7f78e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fe1f9700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0003a60 0x7f78e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0003a60 msgr2=0x7f78e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0003a60 0x7f78e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e00051c0 msgr2=0x7f78e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.083+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e00051c0 0x7f78e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3900255635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0003570 con 0x7f78e0004810 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fe9fa700 1 -- 172.21.15.46:0/3900255635 reap_dead start 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 0x7f78e0004c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0018b0 tx=0x7f78ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756e595e69a2f184 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec012420 con 0x7f78e0004810 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0125a0 con 0x7f78e0004810 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f78fd1f7700 1 -- 172.21.15.46:0/3900255635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec012960 con 0x7f78e0004810 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f790045d700 1 -- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 msgr2=0x7f78e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.084+0000 7f790045d700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 0x7f78e0004c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0018b0 tx=0x7f78ec007d30 comp rx=0 tx=0).stop 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.085+0000 7f790045d700 1 -- 172.21.15.46:0/3900255635 shutdown_connections 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.085+0000 7f790045d700 1 --2- 172.21.15.46:0/3900255635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e0004810 0x7f78e0004c80 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.085+0000 7f790045d700 1 -- 172.21.15.46:0/3900255635 >> 172.21.15.46:0/3900255635 conn(0x7f78f8068e20 msgr2=0x7f78f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:51.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.085+0000 7f790045d700 1 -- 172.21.15.46:0/3900255635 shutdown_connections 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.085+0000 7f790045d700 1 -- 172.21.15.46:0/3900255635 wait complete. 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 Processor -- start 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 -- start start 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 0x7f78f80c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f814a7b0 0x7f78f815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80c60d0 con 0x7f78f814d1f0 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80c63b0 con 0x7f78f814a7b0 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f790045d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80c6690 con 0x7f78e0004810 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.086+0000 7f78fd9f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49526/0 (socket says 172.21.15.46:49526) 2023-10-07T09:05:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3612768298 learned_addr learned my addr 172.21.15.46:0/3612768298 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fe9fa700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f814a7b0 0x7f78f815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fe1f9700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 0x7f78f80c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 msgr2=0x7f78f80c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 0x7f78f80c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f814a7b0 msgr2=0x7f78f815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f814a7b0 0x7f78f815f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 -- 172.21.15.46:0/3612768298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80c6970 con 0x7f78f814d1f0 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fe1f9700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 0x7f78f80c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78fd9f8700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c0a0 tx=0x7f78ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec01f6f0 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec01f850 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80c6c50 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec01fbd0 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.087+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f80c7170 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.088+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f80c6e90 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.089+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f78ec00c420 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.089+0000 7f78f67fc700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 0x7f78e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.089+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78ec086450 con 0x7f78f814d1f0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.089+0000 7f78fe1f9700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 0x7f78e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.090+0000 7f78fe1f9700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 0x7f78e40697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f78e8002060 tx=0x7f78e8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.094+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78f80c6e90 con 0x7f78f814d1f0 2023-10-07T09:05:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.288+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78f80c6e40 con 0x7f78f814d1f0 2023-10-07T09:05:51.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.289+0000 7f78f67fc700 1 -- 172.21.15.46:0/3612768298 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f78ec0530e0 con 0x7f78f814d1f0 2023-10-07T09:05:51.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:51.328 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":137,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:50.084229+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:48.940668+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 msgr2=0x7f78e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 0x7f78e40697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f78e8002060 tx=0x7f78e8006040 comp rx=0 tx=0).stop 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 msgr2=0x7f78f814a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c0a0 tx=0x7f78ec015000 comp rx=0 tx=0).stop 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 shutdown_connections 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f78e4067320 0x7f78e40697d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f814a7b0 0x7f78f815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78e0004810 0x7f78f80c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 --2- 172.21.15.46:0/3612768298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f814d1f0 0x7f78f814a270 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 >> 172.21.15.46:0/3612768298 conn(0x7f78f8068e20 msgr2=0x7f78f8158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 shutdown_connections 2023-10-07T09:05:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.291+0000 7f790045d700 1 -- 172.21.15.46:0/3612768298 wait complete. 2023-10-07T09:05:51.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:51.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.450+0000 7fb36b36d700 1 Processor -- start 2023-10-07T09:05:51.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.450+0000 7fb36b36d700 1 -- start start 2023-10-07T09:05:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36b36d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb364159890 0x7fb36415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36b36d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb364159c60 0x7fb36415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36b36d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36415a160 con 0x7fb36415db10 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36b36d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3640d13a0 con 0x7fb364159c60 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36b36d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36415e140 con 0x7fb364159890 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb364159c60 0x7fb36415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36990a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb36415db10 0x7fb364069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46208/0 (socket says 172.21.15.46:46208) 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb36990a700 1 -- 172.21.15.46:0/2273587964 learned_addr learned my addr 172.21.15.46:0/2273587964 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb369109700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb364159890 0x7fb36415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 -- 172.21.15.46:0/2273587964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb364159890 msgr2=0x7fb36415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:51.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb364159890 0x7fb36415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 -- 172.21.15.46:0/2273587964 >> v1:172.21.15.46:6789/0 conn(0x7fb36415db10 legacy=0x7fb364069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 -- 172.21.15.46:0/2273587964 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36415a3d0 con 0x7fb364159c60 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb363fff700 1 -- 172.21.15.46:0/2273587964 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024150817 0 0) 0x7fb36415a160 con 0x7fb36415db10 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.451+0000 7fb368908700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb36415d5d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb3580098e0 tx=0x7fb3580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af23f07204719e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb363fff700 1 -- 172.21.15.46:0/2273587964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358009e80 con 0x7fb364159c60 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb363fff700 1 -- 172.21.15.46:0/2273587964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35800b860 con 0x7fb364159c60 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb363fff700 1 -- 172.21.15.46:0/2273587964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35800bbe0 con 0x7fb364159c60 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 -- 172.21.15.46:0/2273587964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 msgr2=0x7fb36415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb36415d5d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb3580098e0 tx=0x7fb3580091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 -- 172.21.15.46:0/2273587964 shutdown_connections 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb364159890 0x7fb36415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 --2- 172.21.15.46:0/2273587964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb36415d5d0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 -- 172.21.15.46:0/2273587964 >> 172.21.15.46:0/2273587964 conn(0x7fb364068e20 msgr2=0x7fb3640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 -- 172.21.15.46:0/2273587964 shutdown_connections 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.452+0000 7fb36b36d700 1 -- 172.21.15.46:0/2273587964 wait complete. 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.453+0000 7fb36b36d700 1 Processor -- start 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.453+0000 7fb36b36d700 1 -- start start 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 0x7fb3640c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36415db10 0x7fb3640c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640ce7a0 con 0x7fb364159c60 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640cea40 con 0x7fb364159890 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36b36d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640ced20 con 0x7fb36415db10 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb368908700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb368908700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49540/0 (socket says 172.21.15.46:49540) 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb368908700 1 -- 172.21.15.46:0/3742827289 learned_addr learned my addr 172.21.15.46:0/3742827289 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb369109700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 0x7fb3640c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.454+0000 7fb36990a700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36415db10 0x7fb3640c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 -- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36415db10 msgr2=0x7fb3640c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36415db10 0x7fb3640c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 -- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 msgr2=0x7fb3640c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 0x7fb3640c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 -- 172.21.15.46:0/3742827289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009420 con 0x7fb364159c60 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb369109700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 0x7fb3640c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb368908700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb358013000 tx=0x7fb358017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35800bbe0 con 0x7fb364159c60 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358011420 con 0x7fb364159c60 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3640cf000 con 0x7fb364159c60 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580117e0 con 0x7fb364159c60 2023-10-07T09:05:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.455+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb364147730 con 0x7fb364159c60 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.456+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3640cf240 con 0x7fb364159c60 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.456+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb358011bd0 con 0x7fb364159c60 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.457+0000 7fb3617fa700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 0x7fb3500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.457+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3580866b0 con 0x7fb364159c60 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.457+0000 7fb369109700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 0x7fb3500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.457+0000 7fb369109700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 0x7fb3500697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb3540075e0 tx=0x7fb3540097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.461+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3640cf240 con 0x7fb364159c60 2023-10-07T09:05:51.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.656+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3640cf240 con 0x7fb364159c60 2023-10-07T09:05:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.657+0000 7fb3617fa700 1 -- 172.21.15.46:0/3742827289 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fb3640cf240 con 0x7fb364159c60 2023-10-07T09:05:51.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:51.791 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":138,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:51.551977+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 msgr2=0x7fb3500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 0x7fb3500697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb3540075e0 tx=0x7fb3540097e0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 msgr2=0x7fb3641471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb358013000 tx=0x7fb358017000 comp rx=0 tx=0).stop 2023-10-07T09:05:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 shutdown_connections 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb350067320 0x7fb3500697d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb36415db10 0x7fb3640c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb364159890 0x7fb3640c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 --2- 172.21.15.46:0/3742827289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb364159c60 0x7fb3641471f0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 >> 172.21.15.46:0/3742827289 conn(0x7fb364068e20 msgr2=0x7fb364152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 shutdown_connections 2023-10-07T09:05:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.659+0000 7fb36b36d700 1 -- 172.21.15.46:0/3742827289 wait complete. 2023-10-07T09:05:51.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:05:51.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.951+0000 7fa8c729f700 1 Processor -- start 2023-10-07T09:05:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 -- start start 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8c00c8040 0x7fa8c006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c015d610 con 0x7fa8c00c8410 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c015ae60 con 0x7fa8c00c8040 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.952+0000 7fa8c729f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c015d860 con 0x7fa8c015a0f0 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:49286/0 (socket says 172.21.15.46:49286) 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 -- 172.21.15.46:0/769518624 learned_addr learned my addr 172.21.15.46:0/769518624 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c503b700 1 --2- 172.21.15.46:0/769518624 >> v2:172.21.15.133:3300/0 conn(0x7fa8c00c8040 0x7fa8c006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 -- 172.21.15.46:0/769518624 >> v2:172.21.15.133:3300/0 conn(0x7fa8c00c8040 msgr2=0x7fa8c006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 --2- 172.21.15.46:0/769518624 >> v2:172.21.15.133:3300/0 conn(0x7fa8c00c8040 0x7fa8c006ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 -- 172.21.15.46:0/769518624 >> v1:172.21.15.133:6789/0 conn(0x7fa8c00c8410 legacy=0x7fa8c006b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 -- 172.21.15.46:0/769518624 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c015db40 con 0x7fa8c015a0f0 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.953+0000 7fa8c583c700 1 --2- 172.21.15.46:0/769518624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00099b0 tx=0x7fa8b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96b663a2e5b79c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8bffff700 1 -- 172.21.15.46:0/769518624 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0009ea0 con 0x7fa8c015a0f0 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8bffff700 1 -- 172.21.15.46:0/769518624 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000b860 con 0x7fa8c015a0f0 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8bffff700 1 -- 172.21.15.46:0/769518624 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000bc00 con 0x7fa8c015a0f0 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 -- 172.21.15.46:0/769518624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 msgr2=0x7fa8c015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 --2- 172.21.15.46:0/769518624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00099b0 tx=0x7fa8b0009250 comp rx=0 tx=0).stop 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 -- 172.21.15.46:0/769518624 shutdown_connections 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 --2- 172.21.15.46:0/769518624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c015a0f0 0x7fa8c015a590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 --2- 172.21.15.46:0/769518624 >> v2:172.21.15.133:3300/0 conn(0x7fa8c00c8040 0x7fa8c006ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 -- 172.21.15.46:0/769518624 >> 172.21.15.46:0/769518624 conn(0x7fa8c00cd640 msgr2=0x7fa8c00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 -- 172.21.15.46:0/769518624 shutdown_connections 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.954+0000 7fa8c729f700 1 -- 172.21.15.46:0/769518624 wait complete. 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.955+0000 7fa8c729f700 1 Processor -- start 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.955+0000 7fa8c729f700 1 -- start start 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8c00c8040 0x7fa8c00c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 0x7fa8c01536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0154150 con 0x7fa8c015a0f0 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c5d10 con 0x7fa8c00c8040 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c729f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c5100 con 0x7fa8c00c8410 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c583c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c583c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49546/0 (socket says 172.21.15.46:49546) 2023-10-07T09:05:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c583c700 1 -- 172.21.15.46:0/2671736213 learned_addr learned my addr 172.21.15.46:0/2671736213 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c483a700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 0x7fa8c01536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.956+0000 7fa8c503b700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8c00c8040 0x7fa8c00c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 -- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 msgr2=0x7fa8c01536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 0x7fa8c01536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 -- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8c00c8040 msgr2=0x7fa8c00c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8c00c8040 0x7fa8c00c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 -- 172.21.15.46:0/2671736213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00094f0 con 0x7fa8c015a0f0 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c483a700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 0x7fa8c01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c583c700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa8c015d9a0 tx=0x7fa8b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0027450 con 0x7fa8c015a0f0 2023-10-07T09:05:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b00275b0 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00c53e0 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0027970 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.957+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c00c59a0 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.958+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c00c5e80 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.959+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8b001a430 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.959+0000 7fa8bd7fa700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 0x7fa8ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.959+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8b0087000 con 0x7fa8c015a0f0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.959+0000 7fa8c503b700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 0x7fa8ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.960+0000 7fa8c503b700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 0x7fa8ac0697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800f570 tx=0x7fa8b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:51.964+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b0053d10 con 0x7fa8c015a0f0 2023-10-07T09:05:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.207+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8c015de20 con 0x7fa8c015a0f0 2023-10-07T09:05:52.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.940+0000 7fa8bd7fa700 1 -- 172.21.15.46:0/2671736213 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa8b0057330 con 0x7fa8c015a0f0 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 msgr2=0x7fa8ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 0x7fa8ac0697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800f570 tx=0x7fa8b800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 msgr2=0x7fa8c0153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa8c015d9a0 tx=0x7fa8b0017000 comp rx=0 tx=0).stop 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 shutdown_connections 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8ac067320 0x7fa8ac0697d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8c015a0f0 0x7fa8c0153c10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8c00c8040 0x7fa8c00c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:52.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 --2- 172.21.15.46:0/2671736213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8c00c8410 0x7fa8c01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:52.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 >> 172.21.15.46:0/2671736213 conn(0x7fa8c00cd640 msgr2=0x7fa8c00cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:52.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 shutdown_connections 2023-10-07T09:05:52.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:52.943+0000 7fa8c729f700 1 -- 172.21.15.46:0/2671736213 wait complete. 2023-10-07T09:05:52.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:05:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.087+0000 7f388200d700 1 Processor -- start 2023-10-07T09:05:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.087+0000 7f388200d700 1 -- start start 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f388200d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f387c159890 0x7f387c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f388200d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f388200d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c15a160 con 0x7f387c15db10 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f388200d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0d13a0 con 0x7f387c159890 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f388200d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c15e140 con 0x7f387c159c60 2023-10-07T09:05:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f387c159890 0x7f387c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f387c15db10 0x7f387c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46222/0 (socket says 172.21.15.46:46222) 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387bfff700 1 -- 172.21.15.46:0/167389705 learned_addr learned my addr 172.21.15.46:0/167389705 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387affd700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 -- 172.21.15.46:0/167389705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 msgr2=0x7f387c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 -- 172.21.15.46:0/167389705 >> v1:172.21.15.46:6789/0 conn(0x7f387c15db10 legacy=0x7f387c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 -- 172.21.15.46:0/167389705 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c15a3d0 con 0x7f387c159890 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387a7fc700 1 -- 172.21.15.46:0/167389705 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037068272 0 0) 0x7f387c15a160 con 0x7f387c15db10 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387b7fe700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c159890 0x7f387c15abd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e60 tx=0x7f386c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c32096da14b16e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387a7fc700 1 -- 172.21.15.46:0/167389705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00e070 con 0x7f387c159890 2023-10-07T09:05:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387a7fc700 1 -- 172.21.15.46:0/167389705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c00bb60 con 0x7f387c159890 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.088+0000 7f387a7fc700 1 -- 172.21.15.46:0/167389705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c012430 con 0x7f387c159890 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 -- 172.21.15.46:0/167389705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c159890 msgr2=0x7f387c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c159890 0x7f387c15abd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e60 tx=0x7f386c009780 comp rx=0 tx=0).stop 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 -- 172.21.15.46:0/167389705 shutdown_connections 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c159890 0x7f387c15abd0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 --2- 172.21.15.46:0/167389705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 -- 172.21.15.46:0/167389705 >> 172.21.15.46:0/167389705 conn(0x7f387c068e20 msgr2=0x7f387c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 -- 172.21.15.46:0/167389705 shutdown_connections 2023-10-07T09:05:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.089+0000 7f388200d700 1 -- 172.21.15.46:0/167389705 wait complete. 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.090+0000 7f388200d700 1 Processor -- start 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.090+0000 7f388200d700 1 -- start start 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f387c159890 0x7f387c14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c6bf0 con 0x7f387c15db10 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c5fe0 con 0x7f387c159890 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f388200d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c62c0 con 0x7f387c159c60 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49568/0 (socket says 172.21.15.46:49568) 2023-10-07T09:05:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 -- 172.21.15.46:0/382700195 learned_addr learned my addr 172.21.15.46:0/382700195 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387affd700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387b7fe700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f387c159890 0x7f387c14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 -- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 msgr2=0x7f387c0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c0c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 -- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f387c159890 msgr2=0x7f387c14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f387c159890 0x7f387c14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.091+0000 7f387bfff700 1 -- 172.21.15.46:0/382700195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c009a20 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f387bfff700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f387400c530 tx=0x7f3874007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874005b30 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874005c90 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0c65a0 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874007320 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.092+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c15c740 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.093+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c04c3c0 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.093+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f387401b3b0 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.094+0000 7f38737fe700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 0x7f385c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.094+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3874083ff0 con 0x7f387c15db10 2023-10-07T09:05:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.094+0000 7f387b7fe700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 0x7f385c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:53.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.095+0000 7f387b7fe700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 0x7f385c0697d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f386c0097c0 tx=0x7f386c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:53.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.098+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3874050c80 con 0x7f387c15db10 2023-10-07T09:05:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.336+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f387c0c6d30 con 0x7f387c15db10 2023-10-07T09:05:53.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.941+0000 7f38737fe700 1 -- 172.21.15.46:0/382700195 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38740170c0 con 0x7f387c15db10 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 msgr2=0x7f385c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 0x7f385c0697d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f386c0097c0 tx=0x7f386c019000 comp rx=0 tx=0).stop 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 msgr2=0x7f387c0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f387400c530 tx=0x7f3874007f90 comp rx=0 tx=0).stop 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 shutdown_connections 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f385c067320 0x7f385c0697d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f387c15db10 0x7f387c0ce410 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f387c159890 0x7f387c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 --2- 172.21.15.46:0/382700195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f387c159c60 0x7f387c0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:53.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 >> 172.21.15.46:0/382700195 conn(0x7f387c068e20 msgr2=0x7f387c14d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:53.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 shutdown_connections 2023-10-07T09:05:53.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:53.943+0000 7f388200d700 1 -- 172.21.15.46:0/382700195 wait complete. 2023-10-07T09:05:53.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:54.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.081+0000 7feb9a2ba700 1 Processor -- start 2023-10-07T09:05:54.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.081+0000 7feb9a2ba700 1 -- start start 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb9a2ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb94159420 0x7feb940b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb9a2ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940b2980 con 0x7feb9415d230 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb9a2ba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940b11d0 con 0x7feb941597f0 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb9a2ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940b14b0 con 0x7feb94159420 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb99ab9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feb9415d230 0x7feb9415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46234/0 (socket says 172.21.15.46:46234) 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb99ab9700 1 -- 172.21.15.46:0/1877912294 learned_addr learned my addr 172.21.15.46:0/1877912294 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb992b8700 1 --2- 172.21.15.46:0/1877912294 >> v2:172.21.15.133:3300/0 conn(0x7feb94159420 0x7feb940b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680183804 0 0) 0x7feb940b2980 con 0x7feb9415d230 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.082+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb7c003570 con 0x7feb9415d230 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836677092 0 0) 0x7feb7c003570 con 0x7feb9415d230 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 >> v2:172.21.15.133:3300/0 conn(0x7feb94159420 msgr2=0x7feb940b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 --2- 172.21.15.46:0/1877912294 >> v2:172.21.15.133:3300/0 conn(0x7feb94159420 0x7feb940b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 >> v1:172.21.15.133:6789/0 conn(0x7feb941597f0 legacy=0x7feb940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940b1790 con 0x7feb9415d230 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7feb840017f0 con 0x7feb9415d230 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 >> v1:172.21.15.46:6789/0 conn(0x7feb9415d230 legacy=0x7feb9415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7c003a60 0x7feb7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7c004810 0x7feb7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940b14b0 con 0x7feb7c0051c0 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c00c0d0 con 0x7feb7c003a60 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c00c290 con 0x7feb7c004810 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb992b8700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7c003a60 0x7feb7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb98ab7700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7c004810 0x7feb7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 -- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7c004810 msgr2=0x7feb7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb7c004810 0x7feb7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 -- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7c003a60 msgr2=0x7feb7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7c003a60 0x7feb7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 -- 172.21.15.46:0/1877912294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c003570 con 0x7feb7c0051c0 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 -- 172.21.15.46:0/1877912294 reap_dead start 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb99ab9700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb7c00ba60 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feb8400a900 tx=0x7feb840021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409de3b0792829c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.083+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840070d0 con 0x7feb7c0051c0 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84007230 con 0x7feb7c0051c0 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb93fff700 1 -- 172.21.15.46:0/1877912294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840075d0 con 0x7feb7c0051c0 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 msgr2=0x7feb7c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb7c00ba60 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feb8400a900 tx=0x7feb840021d0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1877912294 shutdown_connections 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1877912294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb7c00ba60 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1877912294 >> 172.21.15.46:0/1877912294 conn(0x7feb940d0660 msgr2=0x7feb940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1877912294 shutdown_connections 2023-10-07T09:05:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.084+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1877912294 wait complete. 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.085+0000 7feb9a2ba700 1 Processor -- start 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.085+0000 7feb9a2ba700 1 -- start start 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb9414f310 0x7feb94157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb94157b40 0x7feb94169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94157fb0 con 0x7feb7c0051c0 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9416b650 con 0x7feb94157b40 2023-10-07T09:05:54.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb9a2ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb94159ca0 con 0x7feb9414f310 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb992b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb992b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49588/0 (socket says 172.21.15.46:49588) 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb992b8700 1 -- 172.21.15.46:0/1675307624 learned_addr learned my addr 172.21.15.46:0/1675307624 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb99ab9700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb94157b40 0x7feb94169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.086+0000 7feb98ab7700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb9414f310 0x7feb94157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 -- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb9414f310 msgr2=0x7feb94157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb9414f310 0x7feb94157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 -- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb94157b40 msgr2=0x7feb94169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb94157b40 0x7feb94169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 -- 172.21.15.46:0/1675307624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9416aa30 con 0x7feb7c0051c0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb992b8700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feb8c006ac0 tx=0x7feb8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011ec0 con 0x7feb7c0051c0 2023-10-07T09:05:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00f940 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00fcc0 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9416ad10 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.087+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9415a240 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.088+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9415a430 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.088+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb8c014650 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.089+0000 7feb917fa700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 0x7feb80069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.089+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb8c018030 con 0x7feb7c0051c0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.089+0000 7feb98ab7700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 0x7feb80069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.089+0000 7feb98ab7700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 0x7feb80069800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feb9416d170 tx=0x7feb88007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.093+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb8c055c50 con 0x7feb7c0051c0 2023-10-07T09:05:54.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.332+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb9404c3c0 con 0x7feb7c0051c0 2023-10-07T09:05:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.333+0000 7feb917fa700 1 -- 172.21.15.46:0/1675307624 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7feb8c0557e0 con 0x7feb7c0051c0 2023-10-07T09:05:54.357 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:54.357 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:05:53.938702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:05:54.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.334+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 msgr2=0x7feb80069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.334+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 0x7feb80069800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feb9416d170 tx=0x7feb88007d30 comp rx=0 tx=0).stop 2023-10-07T09:05:54.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.334+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 msgr2=0x7feb9416b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.334+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feb8c006ac0 tx=0x7feb8c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 shutdown_connections 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feb80067350 0x7feb80069800 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb94157b40 0x7feb94169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb7c0051c0 0x7feb9416b110 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 --2- 172.21.15.46:0/1675307624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb9414f310 0x7feb94157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 >> 172.21.15.46:0/1675307624 conn(0x7feb940d0660 msgr2=0x7feb94069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 shutdown_connections 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.335+0000 7feb9a2ba700 1 -- 172.21.15.46:0/1675307624 wait complete. 2023-10-07T09:05:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 92 2023-10-07T09:05:54.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:05:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.478+0000 7fddfbf7d700 1 Processor -- start 2023-10-07T09:05:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.478+0000 7fddfbf7d700 1 -- start start 2023-10-07T09:05:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfbf7d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddf406bcd0 0x7fddf4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfbf7d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf415c2a0 con 0x7fddf40c9510 2023-10-07T09:05:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfbf7d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf415b690 con 0x7fddf406c0a0 2023-10-07T09:05:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfbf7d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf40c9900 con 0x7fddf406bcd0 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddf9d19700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddf406bcd0 0x7fddf4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfa51a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fddf40c9510 0x7fddf40cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46238/0 (socket says 172.21.15.46:46238) 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.479+0000 7fddfa51a700 1 -- 172.21.15.46:0/770660043 learned_addr learned my addr 172.21.15.46:0/770660043 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf8d17700 1 -- 172.21.15.46:0/770660043 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815524293 0 0) 0x7fddf415c2a0 con 0x7fddf40c9510 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf8d17700 1 -- 172.21.15.46:0/770660043 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc003570 con 0x7fddf40c9510 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf9d19700 1 -- 172.21.15.46:0/770660043 >> v1:172.21.15.133:6789/0 conn(0x7fddf406c0a0 legacy=0x7fddf40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf9d19700 1 -- 172.21.15.46:0/770660043 >> v1:172.21.15.46:6789/0 conn(0x7fddf40c9510 legacy=0x7fddf40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf9d19700 1 -- 172.21.15.46:0/770660043 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf415b970 con 0x7fddf406bcd0 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf9d19700 1 --2- 172.21.15.46:0/770660043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf4140df0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098e0 tx=0x7fddec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb830b0dc28c2994 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf8d17700 1 -- 172.21.15.46:0/770660043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00b640 con 0x7fddf406bcd0 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf8d17700 1 -- 172.21.15.46:0/770660043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec00b7a0 con 0x7fddf406bcd0 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.480+0000 7fddf8d17700 1 -- 172.21.15.46:0/770660043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00bb40 con 0x7fddf406bcd0 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 -- 172.21.15.46:0/770660043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 msgr2=0x7fddf4140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/770660043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf4140df0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098e0 tx=0x7fddec0091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 -- 172.21.15.46:0/770660043 shutdown_connections 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/770660043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf4140df0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 -- 172.21.15.46:0/770660043 >> 172.21.15.46:0/770660043 conn(0x7fddf40ce600 msgr2=0x7fddf40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 -- 172.21.15.46:0/770660043 shutdown_connections 2023-10-07T09:05:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.481+0000 7fddfbf7d700 1 -- 172.21.15.46:0/770660043 wait complete. 2023-10-07T09:05:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.482+0000 7fddfbf7d700 1 Processor -- start 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.482+0000 7fddfbf7d700 1 -- start start 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 0x7fddf40b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 0x7fddf40b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40b2c80 con 0x7fddf406bcd0 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c8740 con 0x7fddf406c0a0 2023-10-07T09:05:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40b2000 con 0x7fddf40c9510 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49602/0 (socket says 172.21.15.46:49602) 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 -- 172.21.15.46:0/1251215286 learned_addr learned my addr 172.21.15.46:0/1251215286 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfa51a700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 0x7fddf40b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9518700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 0x7fddf40b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 -- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 msgr2=0x7fddf40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 0x7fddf40b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 -- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 msgr2=0x7fddf40b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 0x7fddf40b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 -- 172.21.15.46:0/1251215286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009420 con 0x7fddf406bcd0 2023-10-07T09:05:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfa51a700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 0x7fddf40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9518700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 0x7fddf40b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf9d19700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fddec009f80 tx=0x7fddec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00bb20 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec011420 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf40b22e0 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.483+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0117a0 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.484+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf40b28a0 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.485+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf404c3c0 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.485+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fddec011b10 con 0x7fddf406bcd0 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.485+0000 7fddf1ffb700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 0x7fdde00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.485+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddec086400 con 0x7fddf406bcd0 2023-10-07T09:05:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.486+0000 7fddf9518700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 0x7fdde00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.486+0000 7fddf9518700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 0x7fdde00697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fddf416b540 tx=0x7fdde8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.490+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddec053090 con 0x7fddf406bcd0 2023-10-07T09:05:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.683+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddf415bc50 con 0x7fddf406bcd0 2023-10-07T09:05:54.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.684+0000 7fddf1ffb700 1 -- 172.21.15.46:0/1251215286 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fddec0566b0 con 0x7fddf406bcd0 2023-10-07T09:05:54.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:54.871 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":138,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:05:51.551977+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:05:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 msgr2=0x7fdde00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 0x7fdde00697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fddf416b540 tx=0x7fdde8009040 comp rx=0 tx=0).stop 2023-10-07T09:05:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 msgr2=0x7fddf413f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fddec009f80 tx=0x7fddec017000 comp rx=0 tx=0).stop 2023-10-07T09:05:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 shutdown_connections 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdde0067320 0x7fdde00697d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.685+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddf40c9510 0x7fddf40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.686+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf406bcd0 0x7fddf413f8d0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.686+0000 7fddfbf7d700 1 --2- 172.21.15.46:0/1251215286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf406c0a0 0x7fddf40b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.686+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 >> 172.21.15.46:0/1251215286 conn(0x7fddf40ce600 msgr2=0x7fddf4155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.686+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 shutdown_connections 2023-10-07T09:05:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:54.686+0000 7fddfbf7d700 1 -- 172.21.15.46:0/1251215286 wait complete. 2023-10-07T09:05:54.900 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:05:54.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:05:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.018+0000 7f644cc46700 1 Processor -- start 2023-10-07T09:05:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.018+0000 7f644cc46700 1 -- start start 2023-10-07T09:05:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.019+0000 7f644cc46700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6448159890 0x7f644815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.019+0000 7f644cc46700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6448159c60 0x7f644815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.019+0000 7f644cc46700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644815a160 con 0x7f644815db10 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.019+0000 7f644cc46700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480d13a0 con 0x7f6448159890 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.019+0000 7f644cc46700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644815e140 con 0x7f6448159c60 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6448159890 0x7f644815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6448159890 0x7f644815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49604/0 (socket says 172.21.15.46:49604) 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 -- 172.21.15.46:0/4160971967 learned_addr learned my addr 172.21.15.46:0/4160971967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f6445d9b700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6448159c60 0x7f644815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 -- 172.21.15.46:0/4160971967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6448159c60 msgr2=0x7f644815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6448159c60 0x7f644815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 -- 172.21.15.46:0/4160971967 >> v1:172.21.15.133:6789/0 conn(0x7f644815db10 legacy=0x7f6448069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 -- 172.21.15.46:0/4160971967 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644815a3d0 con 0x7f6448159890 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644659c700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f644815abd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6440009f20 tx=0x7f6440009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7535739c3bd0011 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644559a700 1 -- 172.21.15.46:0/4160971967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000e070 con 0x7f6448159890 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644559a700 1 -- 172.21.15.46:0/4160971967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000ba40 con 0x7f6448159890 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.020+0000 7f644559a700 1 -- 172.21.15.46:0/4160971967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400092e0 con 0x7f6448159890 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 -- 172.21.15.46:0/4160971967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 msgr2=0x7f644815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f644815abd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6440009f20 tx=0x7f6440009840 comp rx=0 tx=0).stop 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 -- 172.21.15.46:0/4160971967 shutdown_connections 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f644815abd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 --2- 172.21.15.46:0/4160971967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6448159c60 0x7f644815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 -- 172.21.15.46:0/4160971967 >> 172.21.15.46:0/4160971967 conn(0x7f6448068e20 msgr2=0x7f64480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 -- 172.21.15.46:0/4160971967 shutdown_connections 2023-10-07T09:05:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.021+0000 7f644cc46700 1 -- 172.21.15.46:0/4160971967 wait complete. 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.022+0000 7f644cc46700 1 Processor -- start 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.022+0000 7f644cc46700 1 -- start start 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159c60 0x7f644816aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f644815db10 0x7f64481533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644816af60 con 0x7f6448159890 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c81d0 con 0x7f6448159c60 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644cc46700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480b5550 con 0x7f644815db10 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49616/0 (socket says 172.21.15.46:49616) 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 -- 172.21.15.46:0/935135366 learned_addr learned my addr 172.21.15.46:0/935135366 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f6445d9b700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159c60 0x7f644816aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f6446d9d700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f644815db10 0x7f64481533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 -- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f644815db10 msgr2=0x7f64481533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f644815db10 0x7f64481533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 -- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159c60 msgr2=0x7f644816aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159c60 0x7f644816aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 -- 172.21.15.46:0/935135366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440009ae0 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.023+0000 7f644659c700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f64480899c0 tx=0x7f6440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012950 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440012ad0 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64480c78a0 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012e90 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64480c7e60 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.024+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480c96e0 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.025+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f644001d630 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.025+0000 7f643e7fc700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 0x7f64280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.025+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6440086550 con 0x7f6448159890 2023-10-07T09:05:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.026+0000 7f6445d9b700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 0x7f64280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.026+0000 7f6445d9b700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 0x7f64280697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f64480b0330 tx=0x7f6430008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.030+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64400530d0 con 0x7f6448159890 2023-10-07T09:05:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.216+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64480c8310 con 0x7f6428067320 2023-10-07T09:05:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.225+0000 7f643e7fc700 1 -- 172.21.15.46:0/935135366 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289628 (secure 0 0 0) 0x7f643000f6e0 con 0x7f6428067320 2023-10-07T09:05:55.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 msgr2=0x7f64280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 0x7f64280697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f64480b0330 tx=0x7f6430008040 comp rx=0 tx=0).stop 2023-10-07T09:05:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 msgr2=0x7f64480b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f64480899c0 tx=0x7f6440017000 comp rx=0 tx=0).stop 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 shutdown_connections 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6428067320 0x7f64280697d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f644815db10 0x7f64481533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6448159890 0x7f64480b4e70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 --2- 172.21.15.46:0/935135366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159c60 0x7f644816aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 >> 172.21.15.46:0/935135366 conn(0x7f6448068e20 msgr2=0x7f644815b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 shutdown_connections 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.228+0000 7f644cc46700 1 -- 172.21.15.46:0/935135366 wait complete. 2023-10-07T09:05:55.233 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:05:55.241 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2023-10-07T09:05:53.868311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425732,"kb_used_data":14660,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548988,"statfs":{"total":773094113280,"available":770610163712,"internally_reserved":0,"allocated":15011840,"data_stored":7320919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.325861"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566505+0000","last_change":"2023-10-07T09:05:50.566505+0000","last_active":"2023-10-07T09:05:50.566505+0000","last_peered":"2023-10-07T09:05:50.566505+0000","last_clean":"2023-10-07T09:05:50.566505+0000","last_became_active":"2023-10-07T09:05:50.566201+0000","last_became_peered":"2023-10-07T09:05:50.566201+0000","last_unstale":"2023-10-07T09:05:50.566505+0000","last_undegraded":"2023-10-07T09:05:50.566505+0000","last_fullsized":"2023-10-07T09:05:50.566505+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:22.858727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572771+0000","last_change":"2023-10-07T09:05:50.572771+0000","last_active":"2023-10-07T09:05:50.572771+0000","last_peered":"2023-10-07T09:05:50.572771+0000","last_clean":"2023-10-07T09:05:50.572771+0000","last_became_active":"2023-10-07T09:05:50.572138+0000","last_became_peered":"2023-10-07T09:05:50.572138+0000","last_unstale":"2023-10-07T09:05:50.572771+0000","last_undegraded":"2023-10-07T09:05:50.572771+0000","last_fullsized":"2023-10-07T09:05:50.572771+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:19.171907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572756+0000","last_change":"2023-10-07T09:05:50.572756+0000","last_active":"2023-10-07T09:05:50.572756+0000","last_peered":"2023-10-07T09:05:50.572756+0000","last_clean":"2023-10-07T09:05:50.572756+0000","last_became_active":"2023-10-07T09:05:50.572519+0000","last_became_peered":"2023-10-07T09:05:50.572519+0000","last_unstale":"2023-10-07T09:05:50.572756+0000","last_undegraded":"2023-10-07T09:05:50.572756+0000","last_fullsized":"2023-10-07T09:05:50.572756+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:46.184526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573665+0000","last_change":"2023-10-07T09:05:50.573665+0000","last_active":"2023-10-07T09:05:50.573665+0000","last_peered":"2023-10-07T09:05:50.573665+0000","last_clean":"2023-10-07T09:05:50.573665+0000","last_became_active":"2023-10-07T09:05:50.573364+0000","last_became_peered":"2023-10-07T09:05:50.573364+0000","last_unstale":"2023-10-07T09:05:50.573665+0000","last_undegraded":"2023-10-07T09:05:50.573665+0000","last_fullsized":"2023-10-07T09:05:50.573665+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:14.960010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570096+0000","last_change":"2023-10-07T09:05:50.570096+0000","last_active":"2023-10-07T09:05:50.570096+0000","last_peered":"2023-10-07T09:05:50.570096+0000","last_clean":"2023-10-07T09:05:50.570096+0000","last_became_active":"2023-10-07T09:05:50.569826+0000","last_became_peered":"2023-10-07T09:05:50.569826+0000","last_unstale":"2023-10-07T09:05:50.570096+0000","last_undegraded":"2023-10-07T09:05:50.570096+0000","last_fullsized":"2023-10-07T09:05:50.570096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:17:37.819246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568148+0000","last_change":"2023-10-07T09:05:50.568148+0000","last_active":"2023-10-07T09:05:50.568148+0000","last_peered":"2023-10-07T09:05:50.568148+0000","last_clean":"2023-10-07T09:05:50.568148+0000","last_became_active":"2023-10-07T09:05:50.567886+0000","last_became_peered":"2023-10-07T09:05:50.567886+0000","last_unstale":"2023-10-07T09:05:50.568148+0000","last_undegraded":"2023-10-07T09:05:50.568148+0000","last_fullsized":"2023-10-07T09:05:50.568148+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:18.000217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566896+0000","last_change":"2023-10-07T09:05:50.566896+0000","last_active":"2023-10-07T09:05:50.566896+0000","last_peered":"2023-10-07T09:05:50.566896+0000","last_clean":"2023-10-07T09:05:50.566896+0000","last_became_active":"2023-10-07T09:05:50.566626+0000","last_became_peered":"2023-10-07T09:05:50.566626+0000","last_unstale":"2023-10-07T09:05:50.566896+0000","last_undegraded":"2023-10-07T09:05:50.566896+0000","last_fullsized":"2023-10-07T09:05:50.566896+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:54.896334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.561311+0000","last_change":"2023-10-07T09:05:50.561311+0000","last_active":"2023-10-07T09:05:50.561311+0000","last_peered":"2023-10-07T09:05:50.561311+0000","last_clean":"2023-10-07T09:05:50.561311+0000","last_became_active":"2023-10-07T09:05:50.561101+0000","last_became_peered":"2023-10-07T09:05:50.561101+0000","last_unstale":"2023-10-07T09:05:50.561311+0000","last_undegraded":"2023-10-07T09:05:50.561311+0000","last_fullsized":"2023-10-07T09:05:50.561311+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:08.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.575478+0000","last_change":"2023-10-07T09:05:50.575478+0000","last_active":"2023-10-07T09:05:50.575478+0000","last_peered":"2023-10-07T09:05:50.575478+0000","last_clean":"2023-10-07T09:05:50.575478+0000","last_became_active":"2023-10-07T09:05:50.575225+0000","last_became_peered":"2023-10-07T09:05:50.575225+0000","last_unstale":"2023-10-07T09:05:50.575478+0000","last_undegraded":"2023-10-07T09:05:50.575478+0000","last_fullsized":"2023-10-07T09:05:50.575478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:31.500656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564552+0000","last_change":"2023-10-07T09:05:50.564552+0000","last_active":"2023-10-07T09:05:50.564552+0000","last_peered":"2023-10-07T09:05:50.564552+0000","last_clean":"2023-10-07T09:05:50.564552+0000","last_became_active":"2023-10-07T09:05:50.564284+0000","last_became_peered":"2023-10-07T09:05:50.564284+0000","last_unstale":"2023-10-07T09:05:50.564552+0000","last_undegraded":"2023-10-07T09:05:50.564552+0000","last_fullsized":"2023-10-07T09:05:50.564552+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:34.141295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566968+0000","last_change":"2023-10-07T09:05:50.566968+0000","last_active":"2023-10-07T09:05:50.566968+0000","last_peered":"2023-10-07T09:05:50.566968+0000","last_clean":"2023-10-07T09:05:50.566968+0000","last_became_active":"2023-10-07T09:05:50.566724+0000","last_became_peered":"2023-10-07T09:05:50.566724+0000","last_unstale":"2023-10-07T09:05:50.566968+0000","last_undegraded":"2023-10-07T09:05:50.566968+0000","last_fullsized":"2023-10-07T09:05:50.566968+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:31.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573146+0000","last_change":"2023-10-07T09:05:50.573146+0000","last_active":"2023-10-07T09:05:50.573146+0000","last_peered":"2023-10-07T09:05:50.573146+0000","last_clean":"2023-10-07T09:05:50.573146+0000","last_became_active":"2023-10-07T09:05:50.572805+0000","last_became_peered":"2023-10-07T09:05:50.572805+0000","last_unstale":"2023-10-07T09:05:50.573146+0000","last_undegraded":"2023-10-07T09:05:50.573146+0000","last_fullsized":"2023-10-07T09:05:50.573146+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571981+0000","last_change":"2023-10-07T09:05:50.571981+0000","last_active":"2023-10-07T09:05:50.571981+0000","last_peered":"2023-10-07T09:05:50.571981+0000","last_clean":"2023-10-07T09:05:50.571981+0000","last_became_active":"2023-10-07T09:05:50.570616+0000","last_became_peered":"2023-10-07T09:05:50.570616+0000","last_unstale":"2023-10-07T09:05:50.571981+0000","last_undegraded":"2023-10-07T09:05:50.571981+0000","last_fullsized":"2023-10-07T09:05:50.571981+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:30.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571751+0000","last_change":"2023-10-07T09:05:50.571751+0000","last_active":"2023-10-07T09:05:50.571751+0000","last_peered":"2023-10-07T09:05:50.571751+0000","last_clean":"2023-10-07T09:05:50.571751+0000","last_became_active":"2023-10-07T09:05:50.570864+0000","last_became_peered":"2023-10-07T09:05:50.570864+0000","last_unstale":"2023-10-07T09:05:50.571751+0000","last_undegraded":"2023-10-07T09:05:50.571751+0000","last_fullsized":"2023-10-07T09:05:50.571751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572969+0000","last_change":"2023-10-07T09:05:50.572969+0000","last_active":"2023-10-07T09:05:50.572969+0000","last_peered":"2023-10-07T09:05:50.572969+0000","last_clean":"2023-10-07T09:05:50.572969+0000","last_became_active":"2023-10-07T09:05:50.572654+0000","last_became_peered":"2023-10-07T09:05:50.572654+0000","last_unstale":"2023-10-07T09:05:50.572969+0000","last_undegraded":"2023-10-07T09:05:50.572969+0000","last_fullsized":"2023-10-07T09:05:50.572969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:11.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572359+0000","last_change":"2023-10-07T09:05:50.572359+0000","last_active":"2023-10-07T09:05:50.572359+0000","last_peered":"2023-10-07T09:05:50.572359+0000","last_clean":"2023-10-07T09:05:50.572359+0000","last_became_active":"2023-10-07T09:05:50.572097+0000","last_became_peered":"2023-10-07T09:05:50.572097+0000","last_unstale":"2023-10-07T09:05:50.572359+0000","last_undegraded":"2023-10-07T09:05:50.572359+0000","last_fullsized":"2023-10-07T09:05:50.572359+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:37.012189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574307+0000","last_change":"2023-10-07T09:05:50.574307+0000","last_active":"2023-10-07T09:05:50.574307+0000","last_peered":"2023-10-07T09:05:50.574307+0000","last_clean":"2023-10-07T09:05:50.574307+0000","last_became_active":"2023-10-07T09:05:50.574035+0000","last_became_peered":"2023-10-07T09:05:50.574035+0000","last_unstale":"2023-10-07T09:05:50.574307+0000","last_undegraded":"2023-10-07T09:05:50.574307+0000","last_fullsized":"2023-10-07T09:05:50.574307+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:31.500656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572009+0000","last_change":"2023-10-07T09:05:50.572009+0000","last_active":"2023-10-07T09:05:50.572009+0000","last_peered":"2023-10-07T09:05:50.572009+0000","last_clean":"2023-10-07T09:05:50.572009+0000","last_became_active":"2023-10-07T09:05:50.571731+0000","last_became_peered":"2023-10-07T09:05:50.571731+0000","last_unstale":"2023-10-07T09:05:50.572009+0000","last_undegraded":"2023-10-07T09:05:50.572009+0000","last_fullsized":"2023-10-07T09:05:50.572009+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:55.545359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572194+0000","last_change":"2023-10-07T09:05:50.572194+0000","last_active":"2023-10-07T09:05:50.572194+0000","last_peered":"2023-10-07T09:05:50.572194+0000","last_clean":"2023-10-07T09:05:50.572194+0000","last_became_active":"2023-10-07T09:05:50.571707+0000","last_became_peered":"2023-10-07T09:05:50.571707+0000","last_unstale":"2023-10-07T09:05:50.572194+0000","last_undegraded":"2023-10-07T09:05:50.572194+0000","last_fullsized":"2023-10-07T09:05:50.572194+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:10.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574492+0000","last_change":"2023-10-07T09:05:50.574492+0000","last_active":"2023-10-07T09:05:50.574492+0000","last_peered":"2023-10-07T09:05:50.574492+0000","last_clean":"2023-10-07T09:05:50.574492+0000","last_became_active":"2023-10-07T09:05:50.574113+0000","last_became_peered":"2023-10-07T09:05:50.574113+0000","last_unstale":"2023-10-07T09:05:50.574492+0000","last_undegraded":"2023-10-07T09:05:50.574492+0000","last_fullsized":"2023-10-07T09:05:50.574492+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568581+0000","last_change":"2023-10-07T09:05:50.568581+0000","last_active":"2023-10-07T09:05:50.568581+0000","last_peered":"2023-10-07T09:05:50.568581+0000","last_clean":"2023-10-07T09:05:50.568581+0000","last_became_active":"2023-10-07T09:05:50.568301+0000","last_became_peered":"2023-10-07T09:05:50.568301+0000","last_unstale":"2023-10-07T09:05:50.568581+0000","last_undegraded":"2023-10-07T09:05:50.568581+0000","last_fullsized":"2023-10-07T09:05:50.568581+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:27.506669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569649+0000","last_change":"2023-10-07T09:05:50.569649+0000","last_active":"2023-10-07T09:05:50.569649+0000","last_peered":"2023-10-07T09:05:50.569649+0000","last_clean":"2023-10-07T09:05:50.569649+0000","last_became_active":"2023-10-07T09:05:50.568832+0000","last_became_peered":"2023-10-07T09:05:50.568832+0000","last_unstale":"2023-10-07T09:05:50.569649+0000","last_undegraded":"2023-10-07T09:05:50.569649+0000","last_fullsized":"2023-10-07T09:05:50.569649+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:23.987643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567176+0000","last_change":"2023-10-07T09:05:50.567176+0000","last_active":"2023-10-07T09:05:50.567176+0000","last_peered":"2023-10-07T09:05:50.567176+0000","last_clean":"2023-10-07T09:05:50.567176+0000","last_became_active":"2023-10-07T09:05:50.566911+0000","last_became_peered":"2023-10-07T09:05:50.566911+0000","last_unstale":"2023-10-07T09:05:50.567176+0000","last_undegraded":"2023-10-07T09:05:50.567176+0000","last_fullsized":"2023-10-07T09:05:50.567176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:17.708335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563548+0000","last_change":"2023-10-07T09:05:50.563548+0000","last_active":"2023-10-07T09:05:50.563548+0000","last_peered":"2023-10-07T09:05:50.563548+0000","last_clean":"2023-10-07T09:05:50.563548+0000","last_became_active":"2023-10-07T09:05:50.563284+0000","last_became_peered":"2023-10-07T09:05:50.563284+0000","last_unstale":"2023-10-07T09:05:50.563548+0000","last_undegraded":"2023-10-07T09:05:50.563548+0000","last_fullsized":"2023-10-07T09:05:50.563548+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:00.732871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571864+0000","last_change":"2023-10-07T09:05:50.571864+0000","last_active":"2023-10-07T09:05:50.571864+0000","last_peered":"2023-10-07T09:05:50.571864+0000","last_clean":"2023-10-07T09:05:50.571864+0000","last_became_active":"2023-10-07T09:05:50.571471+0000","last_became_peered":"2023-10-07T09:05:50.571471+0000","last_unstale":"2023-10-07T09:05:50.571864+0000","last_undegraded":"2023-10-07T09:05:50.571864+0000","last_fullsized":"2023-10-07T09:05:50.571864+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563799+0000","last_change":"2023-10-07T09:05:50.563799+0000","last_active":"2023-10-07T09:05:50.563799+0000","last_peered":"2023-10-07T09:05:50.563799+0000","last_clean":"2023-10-07T09:05:50.563799+0000","last_became_active":"2023-10-07T09:05:50.563543+0000","last_became_peered":"2023-10-07T09:05:50.563543+0000","last_unstale":"2023-10-07T09:05:50.563799+0000","last_undegraded":"2023-10-07T09:05:50.563799+0000","last_fullsized":"2023-10-07T09:05:50.563799+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:14.960010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568118+0000","last_change":"2023-10-07T09:05:50.568118+0000","last_active":"2023-10-07T09:05:50.568118+0000","last_peered":"2023-10-07T09:05:50.568118+0000","last_clean":"2023-10-07T09:05:50.568118+0000","last_became_active":"2023-10-07T09:05:50.567864+0000","last_became_peered":"2023-10-07T09:05:50.567864+0000","last_unstale":"2023-10-07T09:05:50.568118+0000","last_undegraded":"2023-10-07T09:05:50.568118+0000","last_fullsized":"2023-10-07T09:05:50.568118+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:41.305114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564280+0000","last_change":"2023-10-07T09:05:50.564280+0000","last_active":"2023-10-07T09:05:50.564280+0000","last_peered":"2023-10-07T09:05:50.564280+0000","last_clean":"2023-10-07T09:05:50.564280+0000","last_became_active":"2023-10-07T09:05:50.564005+0000","last_became_peered":"2023-10-07T09:05:50.564005+0000","last_unstale":"2023-10-07T09:05:50.564280+0000","last_undegraded":"2023-10-07T09:05:50.564280+0000","last_fullsized":"2023-10-07T09:05:50.564280+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.478926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571397+0000","last_change":"2023-10-07T09:05:50.571397+0000","last_active":"2023-10-07T09:05:50.571397+0000","last_peered":"2023-10-07T09:05:50.571397+0000","last_clean":"2023-10-07T09:05:50.571397+0000","last_became_active":"2023-10-07T09:05:50.571122+0000","last_became_peered":"2023-10-07T09:05:50.571122+0000","last_unstale":"2023-10-07T09:05:50.571397+0000","last_undegraded":"2023-10-07T09:05:50.571397+0000","last_fullsized":"2023-10-07T09:05:50.571397+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:20.547887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574577+0000","last_change":"2023-10-07T09:05:50.574577+0000","last_active":"2023-10-07T09:05:50.574577+0000","last_peered":"2023-10-07T09:05:50.574577+0000","last_clean":"2023-10-07T09:05:50.574577+0000","last_became_active":"2023-10-07T09:05:50.571575+0000","last_became_peered":"2023-10-07T09:05:50.571575+0000","last_unstale":"2023-10-07T09:05:50.574577+0000","last_undegraded":"2023-10-07T09:05:50.574577+0000","last_fullsized":"2023-10-07T09:05:50.574577+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:17.335967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574921+0000","last_change":"2023-10-07T09:05:50.574921+0000","last_active":"2023-10-07T09:05:50.574921+0000","last_peered":"2023-10-07T09:05:50.574921+0000","last_clean":"2023-10-07T09:05:50.574921+0000","last_became_active":"2023-10-07T09:05:50.574649+0000","last_became_peered":"2023-10-07T09:05:50.574649+0000","last_unstale":"2023-10-07T09:05:50.574921+0000","last_undegraded":"2023-10-07T09:05:50.574921+0000","last_fullsized":"2023-10-07T09:05:50.574921+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:52:31.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.558698+0000","last_change":"2023-10-07T09:05:50.558698+0000","last_active":"2023-10-07T09:05:50.558698+0000","last_peered":"2023-10-07T09:05:50.558698+0000","last_clean":"2023-10-07T09:05:50.558698+0000","last_became_active":"2023-10-07T09:05:50.558487+0000","last_became_peered":"2023-10-07T09:05:50.558487+0000","last_unstale":"2023-10-07T09:05:50.558698+0000","last_undegraded":"2023-10-07T09:05:50.558698+0000","last_fullsized":"2023-10-07T09:05:50.558698+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:49.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570096+0000","last_change":"2023-10-07T09:05:50.570096+0000","last_active":"2023-10-07T09:05:50.570096+0000","last_peered":"2023-10-07T09:05:50.570096+0000","last_clean":"2023-10-07T09:05:50.570096+0000","last_became_active":"2023-10-07T09:05:50.569835+0000","last_became_peered":"2023-10-07T09:05:50.569835+0000","last_unstale":"2023-10-07T09:05:50.570096+0000","last_undegraded":"2023-10-07T09:05:50.570096+0000","last_fullsized":"2023-10-07T09:05:50.570096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:12.052690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564956+0000","last_change":"2023-10-07T09:05:49.562136+0000","last_active":"2023-10-07T09:05:49.564956+0000","last_peered":"2023-10-07T09:05:49.564956+0000","last_clean":"2023-10-07T09:05:49.564956+0000","last_became_active":"2023-10-07T09:05:49.561918+0000","last_became_peered":"2023-10-07T09:05:49.561918+0000","last_unstale":"2023-10-07T09:05:49.564956+0000","last_undegraded":"2023-10-07T09:05:49.564956+0000","last_fullsized":"2023-10-07T09:05:49.564956+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:26.668981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568237+0000","last_change":"2023-10-07T09:05:50.568237+0000","last_active":"2023-10-07T09:05:50.568237+0000","last_peered":"2023-10-07T09:05:50.568237+0000","last_clean":"2023-10-07T09:05:50.568237+0000","last_became_active":"2023-10-07T09:05:50.567775+0000","last_became_peered":"2023-10-07T09:05:50.567775+0000","last_unstale":"2023-10-07T09:05:50.568237+0000","last_undegraded":"2023-10-07T09:05:50.568237+0000","last_fullsized":"2023-10-07T09:05:50.568237+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:44.069576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.560826+0000","last_change":"2023-10-07T09:05:49.556834+0000","last_active":"2023-10-07T09:05:49.560826+0000","last_peered":"2023-10-07T09:05:49.560826+0000","last_clean":"2023-10-07T09:05:49.560826+0000","last_became_active":"2023-10-07T09:05:49.556571+0000","last_became_peered":"2023-10-07T09:05:49.556571+0000","last_unstale":"2023-10-07T09:05:49.560826+0000","last_undegraded":"2023-10-07T09:05:49.560826+0000","last_fullsized":"2023-10-07T09:05:49.560826+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:53.577181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.559235+0000","last_change":"2023-10-07T09:05:50.559235+0000","last_active":"2023-10-07T09:05:50.559235+0000","last_peered":"2023-10-07T09:05:50.559235+0000","last_clean":"2023-10-07T09:05:50.559235+0000","last_became_active":"2023-10-07T09:05:50.558961+0000","last_became_peered":"2023-10-07T09:05:50.558961+0000","last_unstale":"2023-10-07T09:05:50.559235+0000","last_undegraded":"2023-10-07T09:05:50.559235+0000","last_fullsized":"2023-10-07T09:05:50.559235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:50.085751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564328+0000","last_change":"2023-10-07T09:05:49.563160+0000","last_active":"2023-10-07T09:05:49.564328+0000","last_peered":"2023-10-07T09:05:49.564328+0000","last_clean":"2023-10-07T09:05:49.564328+0000","last_became_active":"2023-10-07T09:05:49.562893+0000","last_became_peered":"2023-10-07T09:05:49.562893+0000","last_unstale":"2023-10-07T09:05:49.564328+0000","last_undegraded":"2023-10-07T09:05:49.564328+0000","last_fullsized":"2023-10-07T09:05:49.564328+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:10.940243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.576349+0000","last_change":"2023-10-07T09:05:50.576349+0000","last_active":"2023-10-07T09:05:50.576349+0000","last_peered":"2023-10-07T09:05:50.576349+0000","last_clean":"2023-10-07T09:05:50.576349+0000","last_became_active":"2023-10-07T09:05:50.576049+0000","last_became_peered":"2023-10-07T09:05:50.576049+0000","last_unstale":"2023-10-07T09:05:50.576349+0000","last_undegraded":"2023-10-07T09:05:50.576349+0000","last_fullsized":"2023-10-07T09:05:50.576349+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.938628+0000","last_change":"2023-10-07T09:05:49.558467+0000","last_active":"2023-10-07T09:05:50.938628+0000","last_peered":"2023-10-07T09:05:50.938628+0000","last_clean":"2023-10-07T09:05:50.938628+0000","last_became_active":"2023-10-07T09:05:49.558201+0000","last_became_peered":"2023-10-07T09:05:49.558201+0000","last_unstale":"2023-10-07T09:05:50.938628+0000","last_undegraded":"2023-10-07T09:05:50.938628+0000","last_fullsized":"2023-10-07T09:05:50.938628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:02.507084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567643+0000","last_change":"2023-10-07T09:05:50.567643+0000","last_active":"2023-10-07T09:05:50.567643+0000","last_peered":"2023-10-07T09:05:50.567643+0000","last_clean":"2023-10-07T09:05:50.567643+0000","last_became_active":"2023-10-07T09:05:50.567016+0000","last_became_peered":"2023-10-07T09:05:50.567016+0000","last_unstale":"2023-10-07T09:05:50.567643+0000","last_undegraded":"2023-10-07T09:05:50.567643+0000","last_fullsized":"2023-10-07T09:05:50.567643+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:00.223665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565656+0000","last_change":"2023-10-07T09:05:49.564628+0000","last_active":"2023-10-07T09:05:49.565656+0000","last_peered":"2023-10-07T09:05:49.565656+0000","last_clean":"2023-10-07T09:05:49.565656+0000","last_became_active":"2023-10-07T09:05:49.564354+0000","last_became_peered":"2023-10-07T09:05:49.564354+0000","last_unstale":"2023-10-07T09:05:49.565656+0000","last_undegraded":"2023-10-07T09:05:49.565656+0000","last_fullsized":"2023-10-07T09:05:49.565656+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:16:11.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570798+0000","last_change":"2023-10-07T09:05:50.570798+0000","last_active":"2023-10-07T09:05:50.570798+0000","last_peered":"2023-10-07T09:05:50.570798+0000","last_clean":"2023-10-07T09:05:50.570798+0000","last_became_active":"2023-10-07T09:05:50.570535+0000","last_became_peered":"2023-10-07T09:05:50.570535+0000","last_unstale":"2023-10-07T09:05:50.570798+0000","last_undegraded":"2023-10-07T09:05:50.570798+0000","last_fullsized":"2023-10-07T09:05:50.570798+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:55.762447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564553+0000","last_change":"2023-10-07T09:05:49.563613+0000","last_active":"2023-10-07T09:05:49.564553+0000","last_peered":"2023-10-07T09:05:49.564553+0000","last_clean":"2023-10-07T09:05:49.564553+0000","last_became_active":"2023-10-07T09:05:49.563315+0000","last_became_peered":"2023-10-07T09:05:49.563315+0000","last_unstale":"2023-10-07T09:05:49.564553+0000","last_undegraded":"2023-10-07T09:05:49.564553+0000","last_fullsized":"2023-10-07T09:05:49.564553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:35.539161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568060+0000","last_change":"2023-10-07T09:05:50.568060+0000","last_active":"2023-10-07T09:05:50.568060+0000","last_peered":"2023-10-07T09:05:50.568060+0000","last_clean":"2023-10-07T09:05:50.568060+0000","last_became_active":"2023-10-07T09:05:50.567772+0000","last_became_peered":"2023-10-07T09:05:50.567772+0000","last_unstale":"2023-10-07T09:05:50.568060+0000","last_undegraded":"2023-10-07T09:05:50.568060+0000","last_fullsized":"2023-10-07T09:05:50.568060+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:11.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.569349+0000","last_change":"2023-10-07T09:05:49.565585+0000","last_active":"2023-10-07T09:05:49.569349+0000","last_peered":"2023-10-07T09:05:49.569349+0000","last_clean":"2023-10-07T09:05:49.569349+0000","last_became_active":"2023-10-07T09:05:49.565356+0000","last_became_peered":"2023-10-07T09:05:49.565356+0000","last_unstale":"2023-10-07T09:05:49.569349+0000","last_undegraded":"2023-10-07T09:05:49.569349+0000","last_fullsized":"2023-10-07T09:05:49.569349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:30.662482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573667+0000","last_change":"2023-10-07T09:05:50.573667+0000","last_active":"2023-10-07T09:05:50.573667+0000","last_peered":"2023-10-07T09:05:50.573667+0000","last_clean":"2023-10-07T09:05:50.573667+0000","last_became_active":"2023-10-07T09:05:50.568917+0000","last_became_peered":"2023-10-07T09:05:50.568917+0000","last_unstale":"2023-10-07T09:05:50.573667+0000","last_undegraded":"2023-10-07T09:05:50.573667+0000","last_fullsized":"2023-10-07T09:05:50.573667+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:15:55.280991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.560592+0000","last_change":"2023-10-07T09:05:49.554252+0000","last_active":"2023-10-07T09:05:49.560592+0000","last_peered":"2023-10-07T09:05:49.560592+0000","last_clean":"2023-10-07T09:05:49.560592+0000","last_became_active":"2023-10-07T09:05:49.553893+0000","last_became_peered":"2023-10-07T09:05:49.553893+0000","last_unstale":"2023-10-07T09:05:49.560592+0000","last_undegraded":"2023-10-07T09:05:49.560592+0000","last_fullsized":"2023-10-07T09:05:49.560592+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:37.540888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564012+0000","last_change":"2023-10-07T09:05:50.564012+0000","last_active":"2023-10-07T09:05:50.564012+0000","last_peered":"2023-10-07T09:05:50.564012+0000","last_clean":"2023-10-07T09:05:50.564012+0000","last_became_active":"2023-10-07T09:05:50.563757+0000","last_became_peered":"2023-10-07T09:05:50.563757+0000","last_unstale":"2023-10-07T09:05:50.564012+0000","last_undegraded":"2023-10-07T09:05:50.564012+0000","last_fullsized":"2023-10-07T09:05:50.564012+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:52.010020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564736+0000","last_change":"2023-10-07T09:05:49.562598+0000","last_active":"2023-10-07T09:05:49.564736+0000","last_peered":"2023-10-07T09:05:49.564736+0000","last_clean":"2023-10-07T09:05:49.564736+0000","last_became_active":"2023-10-07T09:05:49.562336+0000","last_became_peered":"2023-10-07T09:05:49.562336+0000","last_unstale":"2023-10-07T09:05:49.564736+0000","last_undegraded":"2023-10-07T09:05:49.564736+0000","last_fullsized":"2023-10-07T09:05:49.564736+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:34.029196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571886+0000","last_change":"2023-10-07T09:05:50.571886+0000","last_active":"2023-10-07T09:05:50.571886+0000","last_peered":"2023-10-07T09:05:50.571886+0000","last_clean":"2023-10-07T09:05:50.571886+0000","last_became_active":"2023-10-07T09:05:50.571630+0000","last_became_peered":"2023-10-07T09:05:50.571630+0000","last_unstale":"2023-10-07T09:05:50.571886+0000","last_undegraded":"2023-10-07T09:05:50.571886+0000","last_fullsized":"2023-10-07T09:05:50.571886+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.462020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565672+0000","last_change":"2023-10-07T09:05:49.564935+0000","last_active":"2023-10-07T09:05:49.565672+0000","last_peered":"2023-10-07T09:05:49.565672+0000","last_clean":"2023-10-07T09:05:49.565672+0000","last_became_active":"2023-10-07T09:05:49.564667+0000","last_became_peered":"2023-10-07T09:05:49.564667+0000","last_unstale":"2023-10-07T09:05:49.565672+0000","last_undegraded":"2023-10-07T09:05:49.565672+0000","last_fullsized":"2023-10-07T09:05:49.565672+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:42.916103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566257+0000","last_change":"2023-10-07T09:05:50.566257+0000","last_active":"2023-10-07T09:05:50.566257+0000","last_peered":"2023-10-07T09:05:50.566257+0000","last_clean":"2023-10-07T09:05:50.566257+0000","last_became_active":"2023-10-07T09:05:50.565945+0000","last_became_peered":"2023-10-07T09:05:50.565945+0000","last_unstale":"2023-10-07T09:05:50.566257+0000","last_undegraded":"2023-10-07T09:05:50.566257+0000","last_fullsized":"2023-10-07T09:05:50.566257+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:18:32.108910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.556483+0000","last_change":"2023-10-07T09:05:49.551852+0000","last_active":"2023-10-07T09:05:49.556483+0000","last_peered":"2023-10-07T09:05:49.556483+0000","last_clean":"2023-10-07T09:05:49.556483+0000","last_became_active":"2023-10-07T09:05:49.551577+0000","last_became_peered":"2023-10-07T09:05:49.551577+0000","last_unstale":"2023-10-07T09:05:49.556483+0000","last_undegraded":"2023-10-07T09:05:49.556483+0000","last_fullsized":"2023-10-07T09:05:49.556483+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:53.888600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564301+0000","last_change":"2023-10-07T09:05:50.564301+0000","last_active":"2023-10-07T09:05:50.564301+0000","last_peered":"2023-10-07T09:05:50.564301+0000","last_clean":"2023-10-07T09:05:50.564301+0000","last_became_active":"2023-10-07T09:05:50.563986+0000","last_became_peered":"2023-10-07T09:05:50.563986+0000","last_unstale":"2023-10-07T09:05:50.564301+0000","last_undegraded":"2023-10-07T09:05:50.564301+0000","last_fullsized":"2023-10-07T09:05:50.564301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:42.238276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564048+0000","last_change":"2023-10-07T09:05:49.560315+0000","last_active":"2023-10-07T09:05:49.564048+0000","last_peered":"2023-10-07T09:05:49.564048+0000","last_clean":"2023-10-07T09:05:49.564048+0000","last_became_active":"2023-10-07T09:05:49.560033+0000","last_became_peered":"2023-10-07T09:05:49.560033+0000","last_unstale":"2023-10-07T09:05:49.564048+0000","last_undegraded":"2023-10-07T09:05:49.564048+0000","last_fullsized":"2023-10-07T09:05:49.564048+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:56.397062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567072+0000","last_change":"2023-10-07T09:05:50.567072+0000","last_active":"2023-10-07T09:05:50.567072+0000","last_peered":"2023-10-07T09:05:50.567072+0000","last_clean":"2023-10-07T09:05:50.567072+0000","last_became_active":"2023-10-07T09:05:50.566790+0000","last_became_peered":"2023-10-07T09:05:50.566790+0000","last_unstale":"2023-10-07T09:05:50.567072+0000","last_undegraded":"2023-10-07T09:05:50.567072+0000","last_fullsized":"2023-10-07T09:05:50.567072+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:20.547887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.562930+0000","last_change":"2023-10-07T09:05:49.559830+0000","last_active":"2023-10-07T09:05:49.562930+0000","last_peered":"2023-10-07T09:05:49.562930+0000","last_clean":"2023-10-07T09:05:49.562930+0000","last_became_active":"2023-10-07T09:05:49.559316+0000","last_became_peered":"2023-10-07T09:05:49.559316+0000","last_unstale":"2023-10-07T09:05:49.562930+0000","last_undegraded":"2023-10-07T09:05:49.562930+0000","last_fullsized":"2023-10-07T09:05:49.562930+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:47.272061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571753+0000","last_change":"2023-10-07T09:05:50.571753+0000","last_active":"2023-10-07T09:05:50.571753+0000","last_peered":"2023-10-07T09:05:50.571753+0000","last_clean":"2023-10-07T09:05:50.571753+0000","last_became_active":"2023-10-07T09:05:50.570810+0000","last_became_peered":"2023-10-07T09:05:50.570810+0000","last_unstale":"2023-10-07T09:05:50.571753+0000","last_undegraded":"2023-10-07T09:05:50.571753+0000","last_fullsized":"2023-10-07T09:05:50.571753+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.924846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564496+0000","last_change":"2023-10-07T09:05:49.562677+0000","last_active":"2023-10-07T09:05:49.564496+0000","last_peered":"2023-10-07T09:05:49.564496+0000","last_clean":"2023-10-07T09:05:49.564496+0000","last_became_active":"2023-10-07T09:05:49.562236+0000","last_became_peered":"2023-10-07T09:05:49.562236+0000","last_unstale":"2023-10-07T09:05:49.564496+0000","last_undegraded":"2023-10-07T09:05:49.564496+0000","last_fullsized":"2023-10-07T09:05:49.564496+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:47.272061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569267+0000","last_change":"2023-10-07T09:05:50.569267+0000","last_active":"2023-10-07T09:05:50.569267+0000","last_peered":"2023-10-07T09:05:50.569267+0000","last_clean":"2023-10-07T09:05:50.569267+0000","last_became_active":"2023-10-07T09:05:50.568977+0000","last_became_peered":"2023-10-07T09:05:50.568977+0000","last_unstale":"2023-10-07T09:05:50.569267+0000","last_undegraded":"2023-10-07T09:05:50.569267+0000","last_fullsized":"2023-10-07T09:05:50.569267+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:12.052690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563999+0000","last_change":"2023-10-07T09:05:49.560330+0000","last_active":"2023-10-07T09:05:49.563999+0000","last_peered":"2023-10-07T09:05:49.563999+0000","last_clean":"2023-10-07T09:05:49.563999+0000","last_became_active":"2023-10-07T09:05:49.560107+0000","last_became_peered":"2023-10-07T09:05:49.560107+0000","last_unstale":"2023-10-07T09:05:49.563999+0000","last_undegraded":"2023-10-07T09:05:49.563999+0000","last_fullsized":"2023-10-07T09:05:49.563999+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:33.457097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569182+0000","last_change":"2023-10-07T09:05:50.569182+0000","last_active":"2023-10-07T09:05:50.569182+0000","last_peered":"2023-10-07T09:05:50.569182+0000","last_clean":"2023-10-07T09:05:50.569182+0000","last_became_active":"2023-10-07T09:05:50.568914+0000","last_became_peered":"2023-10-07T09:05:50.568914+0000","last_unstale":"2023-10-07T09:05:50.569182+0000","last_undegraded":"2023-10-07T09:05:50.569182+0000","last_fullsized":"2023-10-07T09:05:50.569182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:37.012189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565662+0000","last_change":"2023-10-07T09:05:49.564847+0000","last_active":"2023-10-07T09:05:49.565662+0000","last_peered":"2023-10-07T09:05:49.565662+0000","last_clean":"2023-10-07T09:05:49.565662+0000","last_became_active":"2023-10-07T09:05:49.564376+0000","last_became_peered":"2023-10-07T09:05:49.564376+0000","last_unstale":"2023-10-07T09:05:49.565662+0000","last_undegraded":"2023-10-07T09:05:49.565662+0000","last_fullsized":"2023-10-07T09:05:49.565662+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:17.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571037+0000","last_change":"2023-10-07T09:05:50.571037+0000","last_active":"2023-10-07T09:05:50.571037+0000","last_peered":"2023-10-07T09:05:50.571037+0000","last_clean":"2023-10-07T09:05:50.571037+0000","last_became_active":"2023-10-07T09:05:50.570688+0000","last_became_peered":"2023-10-07T09:05:50.570688+0000","last_unstale":"2023-10-07T09:05:50.571037+0000","last_undegraded":"2023-10-07T09:05:50.571037+0000","last_fullsized":"2023-10-07T09:05:50.571037+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:31.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.568134+0000","last_change":"2023-10-07T09:05:49.567286+0000","last_active":"2023-10-07T09:05:49.568134+0000","last_peered":"2023-10-07T09:05:49.568134+0000","last_clean":"2023-10-07T09:05:49.568134+0000","last_became_active":"2023-10-07T09:05:49.566942+0000","last_became_peered":"2023-10-07T09:05:49.566942+0000","last_unstale":"2023-10-07T09:05:49.568134+0000","last_undegraded":"2023-10-07T09:05:49.568134+0000","last_fullsized":"2023-10-07T09:05:49.568134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:55.084415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.575740+0000","last_change":"2023-10-07T09:05:50.575740+0000","last_active":"2023-10-07T09:05:50.575740+0000","last_peered":"2023-10-07T09:05:50.575740+0000","last_clean":"2023-10-07T09:05:50.575740+0000","last_became_active":"2023-10-07T09:05:50.571617+0000","last_became_peered":"2023-10-07T09:05:50.571617+0000","last_unstale":"2023-10-07T09:05:50.575740+0000","last_undegraded":"2023-10-07T09:05:50.575740+0000","last_fullsized":"2023-10-07T09:05:50.575740+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.478926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.569327+0000","last_change":"2023-10-07T09:05:49.564000+0000","last_active":"2023-10-07T09:05:49.569327+0000","last_peered":"2023-10-07T09:05:49.569327+0000","last_clean":"2023-10-07T09:05:49.569327+0000","last_became_active":"2023-10-07T09:05:49.563612+0000","last_became_peered":"2023-10-07T09:05:49.563612+0000","last_unstale":"2023-10-07T09:05:49.569327+0000","last_undegraded":"2023-10-07T09:05:49.569327+0000","last_fullsized":"2023-10-07T09:05:49.569327+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:29.780969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574254+0000","last_change":"2023-10-07T09:05:50.574254+0000","last_active":"2023-10-07T09:05:50.574254+0000","last_peered":"2023-10-07T09:05:50.574254+0000","last_clean":"2023-10-07T09:05:50.574254+0000","last_became_active":"2023-10-07T09:05:50.573992+0000","last_became_peered":"2023-10-07T09:05:50.573992+0000","last_unstale":"2023-10-07T09:05:50.574254+0000","last_undegraded":"2023-10-07T09:05:50.574254+0000","last_fullsized":"2023-10-07T09:05:50.574254+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:04:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566415+0000","last_change":"2023-10-07T09:05:49.563545+0000","last_active":"2023-10-07T09:05:49.566415+0000","last_peered":"2023-10-07T09:05:49.566415+0000","last_clean":"2023-10-07T09:05:49.566415+0000","last_became_active":"2023-10-07T09:05:49.563240+0000","last_became_peered":"2023-10-07T09:05:49.563240+0000","last_unstale":"2023-10-07T09:05:49.566415+0000","last_undegraded":"2023-10-07T09:05:49.566415+0000","last_fullsized":"2023-10-07T09:05:49.566415+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:17.007398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567819+0000","last_change":"2023-10-07T09:05:50.567819+0000","last_active":"2023-10-07T09:05:50.567819+0000","last_peered":"2023-10-07T09:05:50.567819+0000","last_clean":"2023-10-07T09:05:50.567819+0000","last_became_active":"2023-10-07T09:05:50.567390+0000","last_became_peered":"2023-10-07T09:05:50.567390+0000","last_unstale":"2023-10-07T09:05:50.567819+0000","last_undegraded":"2023-10-07T09:05:50.567819+0000","last_fullsized":"2023-10-07T09:05:50.567819+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:08.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561725+0000","last_change":"2023-10-07T09:05:49.558039+0000","last_active":"2023-10-07T09:05:49.561725+0000","last_peered":"2023-10-07T09:05:49.561725+0000","last_clean":"2023-10-07T09:05:49.561725+0000","last_became_active":"2023-10-07T09:05:49.557817+0000","last_became_peered":"2023-10-07T09:05:49.557817+0000","last_unstale":"2023-10-07T09:05:49.561725+0000","last_undegraded":"2023-10-07T09:05:49.561725+0000","last_fullsized":"2023-10-07T09:05:49.561725+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:19.540153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.557824+0000","last_change":"2023-10-07T09:05:50.557824+0000","last_active":"2023-10-07T09:05:50.557824+0000","last_peered":"2023-10-07T09:05:50.557824+0000","last_clean":"2023-10-07T09:05:50.557824+0000","last_became_active":"2023-10-07T09:05:50.557553+0000","last_became_peered":"2023-10-07T09:05:50.557553+0000","last_unstale":"2023-10-07T09:05:50.557824+0000","last_undegraded":"2023-10-07T09:05:50.557824+0000","last_fullsized":"2023-10-07T09:05:50.557824+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:04:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564153+0000","last_change":"2023-10-07T09:05:49.559832+0000","last_active":"2023-10-07T09:05:49.564153+0000","last_peered":"2023-10-07T09:05:49.564153+0000","last_clean":"2023-10-07T09:05:49.564153+0000","last_became_active":"2023-10-07T09:05:49.559549+0000","last_became_peered":"2023-10-07T09:05:49.559549+0000","last_unstale":"2023-10-07T09:05:49.564153+0000","last_undegraded":"2023-10-07T09:05:49.564153+0000","last_fullsized":"2023-10-07T09:05:49.564153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:35.772141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571174+0000","last_change":"2023-10-07T09:05:50.571174+0000","last_active":"2023-10-07T09:05:50.571174+0000","last_peered":"2023-10-07T09:05:50.571174+0000","last_clean":"2023-10-07T09:05:50.571174+0000","last_became_active":"2023-10-07T09:05:50.570741+0000","last_became_peered":"2023-10-07T09:05:50.570741+0000","last_unstale":"2023-10-07T09:05:50.571174+0000","last_undegraded":"2023-10-07T09:05:50.571174+0000","last_fullsized":"2023-10-07T09:05:50.571174+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:50.085751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563305+0000","last_change":"2023-10-07T09:05:49.558922+0000","last_active":"2023-10-07T09:05:49.563305+0000","last_peered":"2023-10-07T09:05:49.563305+0000","last_clean":"2023-10-07T09:05:49.563305+0000","last_became_active":"2023-10-07T09:05:49.558663+0000","last_became_peered":"2023-10-07T09:05:49.558663+0000","last_unstale":"2023-10-07T09:05:49.563305+0000","last_undegraded":"2023-10-07T09:05:49.563305+0000","last_fullsized":"2023-10-07T09:05:49.563305+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:30.891419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.565141+0000","last_change":"2023-10-07T09:05:50.565141+0000","last_active":"2023-10-07T09:05:50.565141+0000","last_peered":"2023-10-07T09:05:50.565141+0000","last_clean":"2023-10-07T09:05:50.565141+0000","last_became_active":"2023-10-07T09:05:50.564878+0000","last_became_peered":"2023-10-07T09:05:50.564878+0000","last_unstale":"2023-10-07T09:05:50.565141+0000","last_undegraded":"2023-10-07T09:05:50.565141+0000","last_fullsized":"2023-10-07T09:05:50.565141+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:17.335967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566556+0000","last_change":"2023-10-07T09:05:49.561953+0000","last_active":"2023-10-07T09:05:49.566556+0000","last_peered":"2023-10-07T09:05:49.566556+0000","last_clean":"2023-10-07T09:05:49.566556+0000","last_became_active":"2023-10-07T09:05:49.561664+0000","last_became_peered":"2023-10-07T09:05:49.561664+0000","last_unstale":"2023-10-07T09:05:49.566556+0000","last_undegraded":"2023-10-07T09:05:49.566556+0000","last_fullsized":"2023-10-07T09:05:49.566556+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.631525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.565514+0000","last_change":"2023-10-07T09:05:50.565514+0000","last_active":"2023-10-07T09:05:50.565514+0000","last_peered":"2023-10-07T09:05:50.565514+0000","last_clean":"2023-10-07T09:05:50.565514+0000","last_became_active":"2023-10-07T09:05:50.565250+0000","last_became_peered":"2023-10-07T09:05:50.565250+0000","last_unstale":"2023-10-07T09:05:50.565514+0000","last_undegraded":"2023-10-07T09:05:50.565514+0000","last_fullsized":"2023-10-07T09:05:50.565514+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:03.514818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561096+0000","last_change":"2023-10-07T09:05:49.559233+0000","last_active":"2023-10-07T09:05:49.561096+0000","last_peered":"2023-10-07T09:05:49.561096+0000","last_clean":"2023-10-07T09:05:49.561096+0000","last_became_active":"2023-10-07T09:05:49.558921+0000","last_became_peered":"2023-10-07T09:05:49.558921+0000","last_unstale":"2023-10-07T09:05:49.561096+0000","last_undegraded":"2023-10-07T09:05:49.561096+0000","last_fullsized":"2023-10-07T09:05:49.561096+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:58.459508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570290+0000","last_change":"2023-10-07T09:05:50.570290+0000","last_active":"2023-10-07T09:05:50.570290+0000","last_peered":"2023-10-07T09:05:50.570290+0000","last_clean":"2023-10-07T09:05:50.570290+0000","last_became_active":"2023-10-07T09:05:50.569380+0000","last_became_peered":"2023-10-07T09:05:50.569380+0000","last_unstale":"2023-10-07T09:05:50.570290+0000","last_undegraded":"2023-10-07T09:05:50.570290+0000","last_fullsized":"2023-10-07T09:05:50.570290+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:43.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563741+0000","last_change":"2023-10-07T09:05:49.561754+0000","last_active":"2023-10-07T09:05:49.563741+0000","last_peered":"2023-10-07T09:05:49.563741+0000","last_clean":"2023-10-07T09:05:49.563741+0000","last_became_active":"2023-10-07T09:05:49.561477+0000","last_became_peered":"2023-10-07T09:05:49.561477+0000","last_unstale":"2023-10-07T09:05:49.563741+0000","last_undegraded":"2023-10-07T09:05:49.563741+0000","last_fullsized":"2023-10-07T09:05:49.563741+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:55.084415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563488+0000","last_change":"2023-10-07T09:05:50.563488+0000","last_active":"2023-10-07T09:05:50.563488+0000","last_peered":"2023-10-07T09:05:50.563488+0000","last_clean":"2023-10-07T09:05:50.563488+0000","last_became_active":"2023-10-07T09:05:50.563184+0000","last_became_peered":"2023-10-07T09:05:50.563184+0000","last_unstale":"2023-10-07T09:05:50.563488+0000","last_undegraded":"2023-10-07T09:05:50.563488+0000","last_fullsized":"2023-10-07T09:05:50.563488+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:17.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.562991+0000","last_change":"2023-10-07T09:05:49.556930+0000","last_active":"2023-10-07T09:05:49.562991+0000","last_peered":"2023-10-07T09:05:49.562991+0000","last_clean":"2023-10-07T09:05:49.562991+0000","last_became_active":"2023-10-07T09:05:49.555992+0000","last_became_peered":"2023-10-07T09:05:49.555992+0000","last_unstale":"2023-10-07T09:05:49.562991+0000","last_undegraded":"2023-10-07T09:05:49.562991+0000","last_fullsized":"2023-10-07T09:05:49.562991+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:35.539161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569987+0000","last_change":"2023-10-07T09:05:50.569987+0000","last_active":"2023-10-07T09:05:50.569987+0000","last_peered":"2023-10-07T09:05:50.569987+0000","last_clean":"2023-10-07T09:05:50.569987+0000","last_became_active":"2023-10-07T09:05:50.569690+0000","last_became_peered":"2023-10-07T09:05:50.569690+0000","last_unstale":"2023-10-07T09:05:50.569987+0000","last_undegraded":"2023-10-07T09:05:50.569987+0000","last_fullsized":"2023-10-07T09:05:50.569987+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:34.141295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.568140+0000","last_change":"2023-10-07T09:05:49.567290+0000","last_active":"2023-10-07T09:05:49.568140+0000","last_peered":"2023-10-07T09:05:49.568140+0000","last_clean":"2023-10-07T09:05:49.568140+0000","last_became_active":"2023-10-07T09:05:49.566960+0000","last_became_peered":"2023-10-07T09:05:49.566960+0000","last_unstale":"2023-10-07T09:05:49.568140+0000","last_undegraded":"2023-10-07T09:05:49.568140+0000","last_fullsized":"2023-10-07T09:05:49.568140+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:23:24.717360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573952+0000","last_change":"2023-10-07T09:05:50.573952+0000","last_active":"2023-10-07T09:05:50.573952+0000","last_peered":"2023-10-07T09:05:50.573952+0000","last_clean":"2023-10-07T09:05:50.573952+0000","last_became_active":"2023-10-07T09:05:50.569556+0000","last_became_peered":"2023-10-07T09:05:50.569556+0000","last_unstale":"2023-10-07T09:05:50.573952+0000","last_undegraded":"2023-10-07T09:05:50.573952+0000","last_fullsized":"2023-10-07T09:05:50.573952+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:56.092149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566594+0000","last_change":"2023-10-07T09:05:49.563563+0000","last_active":"2023-10-07T09:05:49.566594+0000","last_peered":"2023-10-07T09:05:49.566594+0000","last_clean":"2023-10-07T09:05:49.566594+0000","last_became_active":"2023-10-07T09:05:49.563232+0000","last_became_peered":"2023-10-07T09:05:49.563232+0000","last_unstale":"2023-10-07T09:05:49.566594+0000","last_undegraded":"2023-10-07T09:05:49.566594+0000","last_fullsized":"2023-10-07T09:05:49.566594+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:33.794319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568976+0000","last_change":"2023-10-07T09:05:50.568976+0000","last_active":"2023-10-07T09:05:50.568976+0000","last_peered":"2023-10-07T09:05:50.568976+0000","last_clean":"2023-10-07T09:05:50.568976+0000","last_became_active":"2023-10-07T09:05:50.568484+0000","last_became_peered":"2023-10-07T09:05:50.568484+0000","last_unstale":"2023-10-07T09:05:50.568976+0000","last_undegraded":"2023-10-07T09:05:50.568976+0000","last_fullsized":"2023-10-07T09:05:50.568976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:18.296996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566478+0000","last_change":"2023-10-07T09:05:49.561241+0000","last_active":"2023-10-07T09:05:49.566478+0000","last_peered":"2023-10-07T09:05:49.566478+0000","last_clean":"2023-10-07T09:05:49.566478+0000","last_became_active":"2023-10-07T09:05:49.560963+0000","last_became_peered":"2023-10-07T09:05:49.560963+0000","last_unstale":"2023-10-07T09:05:49.566478+0000","last_undegraded":"2023-10-07T09:05:49.566478+0000","last_fullsized":"2023-10-07T09:05:49.566478+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:43.656272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574373+0000","last_change":"2023-10-07T09:05:50.574373+0000","last_active":"2023-10-07T09:05:50.574373+0000","last_peered":"2023-10-07T09:05:50.574373+0000","last_clean":"2023-10-07T09:05:50.574373+0000","last_became_active":"2023-10-07T09:05:50.574091+0000","last_became_peered":"2023-10-07T09:05:50.574091+0000","last_unstale":"2023-10-07T09:05:50.574373+0000","last_undegraded":"2023-10-07T09:05:50.574373+0000","last_fullsized":"2023-10-07T09:05:50.574373+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.462020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566520+0000","last_change":"2023-10-07T09:05:49.561690+0000","last_active":"2023-10-07T09:05:49.566520+0000","last_peered":"2023-10-07T09:05:49.566520+0000","last_clean":"2023-10-07T09:05:49.566520+0000","last_became_active":"2023-10-07T09:05:49.561402+0000","last_became_peered":"2023-10-07T09:05:49.561402+0000","last_unstale":"2023-10-07T09:05:49.566520+0000","last_undegraded":"2023-10-07T09:05:49.566520+0000","last_fullsized":"2023-10-07T09:05:49.566520+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:17.007398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574369+0000","last_change":"2023-10-07T09:05:50.574369+0000","last_active":"2023-10-07T09:05:50.574369+0000","last_peered":"2023-10-07T09:05:50.574369+0000","last_clean":"2023-10-07T09:05:50.574369+0000","last_became_active":"2023-10-07T09:05:50.574066+0000","last_became_peered":"2023-10-07T09:05:50.574066+0000","last_unstale":"2023-10-07T09:05:50.574369+0000","last_undegraded":"2023-10-07T09:05:50.574369+0000","last_fullsized":"2023-10-07T09:05:50.574369+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561792+0000","last_change":"2023-10-07T09:05:49.557730+0000","last_active":"2023-10-07T09:05:49.561792+0000","last_peered":"2023-10-07T09:05:49.561792+0000","last_clean":"2023-10-07T09:05:49.561792+0000","last_became_active":"2023-10-07T09:05:49.557409+0000","last_became_peered":"2023-10-07T09:05:49.557409+0000","last_unstale":"2023-10-07T09:05:49.561792+0000","last_undegraded":"2023-10-07T09:05:49.561792+0000","last_fullsized":"2023-10-07T09:05:49.561792+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:08.917112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571705+0000","last_change":"2023-10-07T09:05:50.571705+0000","last_active":"2023-10-07T09:05:50.571705+0000","last_peered":"2023-10-07T09:05:50.571705+0000","last_clean":"2023-10-07T09:05:50.571705+0000","last_became_active":"2023-10-07T09:05:50.571402+0000","last_became_peered":"2023-10-07T09:05:50.571402+0000","last_unstale":"2023-10-07T09:05:50.571705+0000","last_undegraded":"2023-10-07T09:05:50.571705+0000","last_fullsized":"2023-10-07T09:05:50.571705+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:21.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566554+0000","last_change":"2023-10-07T09:05:49.562581+0000","last_active":"2023-10-07T09:05:49.566554+0000","last_peered":"2023-10-07T09:05:49.566554+0000","last_clean":"2023-10-07T09:05:49.566554+0000","last_became_active":"2023-10-07T09:05:49.562280+0000","last_became_peered":"2023-10-07T09:05:49.562280+0000","last_unstale":"2023-10-07T09:05:49.566554+0000","last_undegraded":"2023-10-07T09:05:49.566554+0000","last_fullsized":"2023-10-07T09:05:49.566554+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:11.742683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.550008+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:05:49.550008+0000","last_peered":"2023-10-07T09:05:49.550008+0000","last_clean":"2023-10-07T09:05:49.550008+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:05:49.550008+0000","last_undegraded":"2023-10-07T09:05:49.550008+0000","last_fullsized":"2023-10-07T09:05:49.550008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1360427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.48799999999999999},"min":{"1min":0.437,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.621}]},{"osd":4,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69999999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.37},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":1.29},"last":0.626}]},{"osd":3,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54900000000000004,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.878,"15min":4.0880000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.60899999999999999},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.80900000000000005}]},{"osd":4,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.502,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54100000000000004,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.85899999999999999,"15min":0.86199999999999999},"last":0.751},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57299999999999995,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.84199999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.91000000000000003},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.37}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1353664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.432,"5min":0.501,"15min":0.54500000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.38800000000000001},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.625},"last":0.441}]},{"osd":3,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.35299999999999998},"min":{"1min":0.26600000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.433,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.42699999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.627},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57999999999999996,"15min":0.61799999999999999},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.95399999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82399999999999995,"5min":0.83299999999999996,"15min":0.86399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.66000000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83899999999999997,"5min":0.84099999999999997,"15min":1},"last":0.63},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60999999999999999,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41399999999999998},"max":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":1.006},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.879,"15min":1.0389999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60399999999999998,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.79900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":763296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.58899999999999997},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":10.214},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.48999999999999999,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.22},"max":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.755},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.65000000000000002},"min":{"1min":0.29699999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54300000000000004,"5min":0.67000000000000004,"15min":10.144},"last":0.38700000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.70399999999999996},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":10.071},"last":0.372},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.71999999999999997},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.65000000000000002,"5min":0.71199999999999997,"15min":10.183},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55000000000000004,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":1.0549999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":1.1240000000000001},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.0880000000000001},"last":0.5}]},{"osd":6,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.875,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83399999999999996,"5min":4.391,"15min":4.391},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.33600000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.433},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.46700000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":763296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.81399999999999995},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":9.7040000000000006},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67900000000000005,"5min":0.73199999999999998,"15min":5.6319999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.90100000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":9.8439999999999994},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.871},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.89900000000000002},"min":{"1min":0.499,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":10.01},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.70999999999999996},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":5.569},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.872},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":10.131},"last":0.46700000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40100000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.32600000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36699999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:05:55.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:05:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.400+0000 7fd4a475a700 1 Processor -- start 2023-10-07T09:05:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.400+0000 7fd4a475a700 1 -- start start 2023-10-07T09:05:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a475a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd49c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a475a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c15a160 con 0x7fd49c069560 2023-10-07T09:05:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a475a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0d13a0 con 0x7fd49c159c60 2023-10-07T09:05:55.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a475a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15e140 con 0x7fd49c159890 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a2cf7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd49c069560 0x7fd49c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46242/0 (socket says 172.21.15.46:46242) 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/618633536 learned_addr learned my addr 172.21.15.46:0/618633536 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.401+0000 7fd4a24f6700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd49c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495680875 0 0) 0x7fd49c15a160 con 0x7fd49c069560 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd484003570 con 0x7fd49c069560 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852563797 0 0) 0x7fd484003570 con 0x7fd49c069560 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 msgr2=0x7fd49c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd49c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 >> v1:172.21.15.133:6789/0 conn(0x7fd49c159c60 legacy=0x7fd49c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c15a3d0 con 0x7fd49c069560 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd494001470 con 0x7fd49c069560 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 >> v1:172.21.15.46:6789/0 conn(0x7fd49c069560 legacy=0x7fd49c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd484003a90 0x7fd484003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd484004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd484004d50 0x7fd4840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15e140 con 0x7fd484004d50 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48400bb10 con 0x7fd484003a90 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48400bcd0 con 0x7fd49c159890 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd484004d50 0x7fd4840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a24f6700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd484003a90 0x7fd484003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a1cf5700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd484004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 msgr2=0x7fd484004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49c159890 0x7fd484004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd484003a90 msgr2=0x7fd484003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd484003a90 0x7fd484003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.402+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/618633536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484003570 con 0x7fd484004d50 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd484004d50 0x7fd4840051c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c2d0 tx=0x7fd494001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b45dfb323adef34 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400cb60 con 0x7fd484004d50 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400ccc0 con 0x7fd484004d50 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a14f4700 1 -- 172.21.15.46:0/618633536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494005b50 con 0x7fd484004d50 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 -- 172.21.15.46:0/618633536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd484004d50 msgr2=0x7fd4840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 --2- 172.21.15.46:0/618633536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd484004d50 0x7fd4840051c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c2d0 tx=0x7fd494001df0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/618633536 reap_dead start 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 -- 172.21.15.46:0/618633536 shutdown_connections 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 -- 172.21.15.46:0/618633536 >> 172.21.15.46:0/618633536 conn(0x7fd49c068e20 msgr2=0x7fd49c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 -- 172.21.15.46:0/618633536 shutdown_connections 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.403+0000 7fd4a475a700 1 -- 172.21.15.46:0/618633536 wait complete. 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.404+0000 7fd4a475a700 1 Processor -- start 2023-10-07T09:05:55.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 -- start start 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd484004d50 0x7fd49c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 0x7fd49c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15ce00 con 0x7fd49c0cd600 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15c1f0 con 0x7fd49c14b720 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a475a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15c4d0 con 0x7fd484004d50 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a2cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a2cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49626/0 (socket says 172.21.15.46:49626) 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/3771627156 learned_addr learned my addr 172.21.15.46:0/3771627156 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a24f6700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd484004d50 0x7fd49c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.405+0000 7fd4a1cf5700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 0x7fd49c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd484004d50 msgr2=0x7fd49c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd484004d50 0x7fd49c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 msgr2=0x7fd49c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 0x7fd49c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 -- 172.21.15.46:0/3771627156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c15c7b0 con 0x7fd49c0cd600 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a1cf5700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 0x7fd49c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a2cf7700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd484004770 tx=0x7fd494015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940072e0 con 0x7fd49c0cd600 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494007460 con 0x7fd49c0cd600 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c15ca90 con 0x7fd49c0cd600 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494007820 con 0x7fd49c0cd600 2023-10-07T09:05:55.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.406+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c15be80 con 0x7fd49c0cd600 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.407+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c04c3c0 con 0x7fd49c0cd600 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.407+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd494019030 con 0x7fd49c0cd600 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.408+0000 7fd49a7fc700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.408+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4940861a0 con 0x7fd49c0cd600 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.408+0000 7fd4a24f6700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.408+0000 7fd4a24f6700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 0x7fd4880697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd49c14ff90 tx=0x7fd48c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.412+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd494052e30 con 0x7fd49c0cd600 2023-10-07T09:05:55.531 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-10-07T09:05:55.530+0000 7f464618c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:05:55.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.602+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd49c15cf40 con 0x7fd488067320 2023-10-07T09:05:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.611+0000 7fd49a7fc700 1 -- 172.21.15.46:0/3771627156 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289628 (secure 0 0 0) 0x7fd49c15cf40 con 0x7fd488067320 2023-10-07T09:05:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.614+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 msgr2=0x7fd4880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.614+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 0x7fd4880697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd49c14ff90 tx=0x7fd48c00b040 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.614+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 msgr2=0x7fd49c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.614+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd484004770 tx=0x7fd494015000 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 shutdown_connections 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd49c0cd600 0x7fd49c15d290 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd484004d50 0x7fd49c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 --2- 172.21.15.46:0/3771627156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49c14b720 0x7fd49c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 >> 172.21.15.46:0/3771627156 conn(0x7fd49c068e20 msgr2=0x7fd49c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 shutdown_connections 2023-10-07T09:05:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.615+0000 7fd4a475a700 1 -- 172.21.15.46:0/3771627156 wait complete. 2023-10-07T09:05:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:05:55.627 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2023-10-07T09:05:53.868311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425732,"kb_used_data":14660,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548988,"statfs":{"total":773094113280,"available":770610163712,"internally_reserved":0,"allocated":15011840,"data_stored":7320919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.325861"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566505+0000","last_change":"2023-10-07T09:05:50.566505+0000","last_active":"2023-10-07T09:05:50.566505+0000","last_peered":"2023-10-07T09:05:50.566505+0000","last_clean":"2023-10-07T09:05:50.566505+0000","last_became_active":"2023-10-07T09:05:50.566201+0000","last_became_peered":"2023-10-07T09:05:50.566201+0000","last_unstale":"2023-10-07T09:05:50.566505+0000","last_undegraded":"2023-10-07T09:05:50.566505+0000","last_fullsized":"2023-10-07T09:05:50.566505+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:22.858727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572771+0000","last_change":"2023-10-07T09:05:50.572771+0000","last_active":"2023-10-07T09:05:50.572771+0000","last_peered":"2023-10-07T09:05:50.572771+0000","last_clean":"2023-10-07T09:05:50.572771+0000","last_became_active":"2023-10-07T09:05:50.572138+0000","last_became_peered":"2023-10-07T09:05:50.572138+0000","last_unstale":"2023-10-07T09:05:50.572771+0000","last_undegraded":"2023-10-07T09:05:50.572771+0000","last_fullsized":"2023-10-07T09:05:50.572771+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:19.171907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572756+0000","last_change":"2023-10-07T09:05:50.572756+0000","last_active":"2023-10-07T09:05:50.572756+0000","last_peered":"2023-10-07T09:05:50.572756+0000","last_clean":"2023-10-07T09:05:50.572756+0000","last_became_active":"2023-10-07T09:05:50.572519+0000","last_became_peered":"2023-10-07T09:05:50.572519+0000","last_unstale":"2023-10-07T09:05:50.572756+0000","last_undegraded":"2023-10-07T09:05:50.572756+0000","last_fullsized":"2023-10-07T09:05:50.572756+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:46.184526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573665+0000","last_change":"2023-10-07T09:05:50.573665+0000","last_active":"2023-10-07T09:05:50.573665+0000","last_peered":"2023-10-07T09:05:50.573665+0000","last_clean":"2023-10-07T09:05:50.573665+0000","last_became_active":"2023-10-07T09:05:50.573364+0000","last_became_peered":"2023-10-07T09:05:50.573364+0000","last_unstale":"2023-10-07T09:05:50.573665+0000","last_undegraded":"2023-10-07T09:05:50.573665+0000","last_fullsized":"2023-10-07T09:05:50.573665+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:14.960010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570096+0000","last_change":"2023-10-07T09:05:50.570096+0000","last_active":"2023-10-07T09:05:50.570096+0000","last_peered":"2023-10-07T09:05:50.570096+0000","last_clean":"2023-10-07T09:05:50.570096+0000","last_became_active":"2023-10-07T09:05:50.569826+0000","last_became_peered":"2023-10-07T09:05:50.569826+0000","last_unstale":"2023-10-07T09:05:50.570096+0000","last_undegraded":"2023-10-07T09:05:50.570096+0000","last_fullsized":"2023-10-07T09:05:50.570096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:17:37.819246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568148+0000","last_change":"2023-10-07T09:05:50.568148+0000","last_active":"2023-10-07T09:05:50.568148+0000","last_peered":"2023-10-07T09:05:50.568148+0000","last_clean":"2023-10-07T09:05:50.568148+0000","last_became_active":"2023-10-07T09:05:50.567886+0000","last_became_peered":"2023-10-07T09:05:50.567886+0000","last_unstale":"2023-10-07T09:05:50.568148+0000","last_undegraded":"2023-10-07T09:05:50.568148+0000","last_fullsized":"2023-10-07T09:05:50.568148+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:18.000217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566896+0000","last_change":"2023-10-07T09:05:50.566896+0000","last_active":"2023-10-07T09:05:50.566896+0000","last_peered":"2023-10-07T09:05:50.566896+0000","last_clean":"2023-10-07T09:05:50.566896+0000","last_became_active":"2023-10-07T09:05:50.566626+0000","last_became_peered":"2023-10-07T09:05:50.566626+0000","last_unstale":"2023-10-07T09:05:50.566896+0000","last_undegraded":"2023-10-07T09:05:50.566896+0000","last_fullsized":"2023-10-07T09:05:50.566896+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:54.896334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.561311+0000","last_change":"2023-10-07T09:05:50.561311+0000","last_active":"2023-10-07T09:05:50.561311+0000","last_peered":"2023-10-07T09:05:50.561311+0000","last_clean":"2023-10-07T09:05:50.561311+0000","last_became_active":"2023-10-07T09:05:50.561101+0000","last_became_peered":"2023-10-07T09:05:50.561101+0000","last_unstale":"2023-10-07T09:05:50.561311+0000","last_undegraded":"2023-10-07T09:05:50.561311+0000","last_fullsized":"2023-10-07T09:05:50.561311+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:08.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.575478+0000","last_change":"2023-10-07T09:05:50.575478+0000","last_active":"2023-10-07T09:05:50.575478+0000","last_peered":"2023-10-07T09:05:50.575478+0000","last_clean":"2023-10-07T09:05:50.575478+0000","last_became_active":"2023-10-07T09:05:50.575225+0000","last_became_peered":"2023-10-07T09:05:50.575225+0000","last_unstale":"2023-10-07T09:05:50.575478+0000","last_undegraded":"2023-10-07T09:05:50.575478+0000","last_fullsized":"2023-10-07T09:05:50.575478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:31.500656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564552+0000","last_change":"2023-10-07T09:05:50.564552+0000","last_active":"2023-10-07T09:05:50.564552+0000","last_peered":"2023-10-07T09:05:50.564552+0000","last_clean":"2023-10-07T09:05:50.564552+0000","last_became_active":"2023-10-07T09:05:50.564284+0000","last_became_peered":"2023-10-07T09:05:50.564284+0000","last_unstale":"2023-10-07T09:05:50.564552+0000","last_undegraded":"2023-10-07T09:05:50.564552+0000","last_fullsized":"2023-10-07T09:05:50.564552+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:34.141295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566968+0000","last_change":"2023-10-07T09:05:50.566968+0000","last_active":"2023-10-07T09:05:50.566968+0000","last_peered":"2023-10-07T09:05:50.566968+0000","last_clean":"2023-10-07T09:05:50.566968+0000","last_became_active":"2023-10-07T09:05:50.566724+0000","last_became_peered":"2023-10-07T09:05:50.566724+0000","last_unstale":"2023-10-07T09:05:50.566968+0000","last_undegraded":"2023-10-07T09:05:50.566968+0000","last_fullsized":"2023-10-07T09:05:50.566968+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:31.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573146+0000","last_change":"2023-10-07T09:05:50.573146+0000","last_active":"2023-10-07T09:05:50.573146+0000","last_peered":"2023-10-07T09:05:50.573146+0000","last_clean":"2023-10-07T09:05:50.573146+0000","last_became_active":"2023-10-07T09:05:50.572805+0000","last_became_peered":"2023-10-07T09:05:50.572805+0000","last_unstale":"2023-10-07T09:05:50.573146+0000","last_undegraded":"2023-10-07T09:05:50.573146+0000","last_fullsized":"2023-10-07T09:05:50.573146+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571981+0000","last_change":"2023-10-07T09:05:50.571981+0000","last_active":"2023-10-07T09:05:50.571981+0000","last_peered":"2023-10-07T09:05:50.571981+0000","last_clean":"2023-10-07T09:05:50.571981+0000","last_became_active":"2023-10-07T09:05:50.570616+0000","last_became_peered":"2023-10-07T09:05:50.570616+0000","last_unstale":"2023-10-07T09:05:50.571981+0000","last_undegraded":"2023-10-07T09:05:50.571981+0000","last_fullsized":"2023-10-07T09:05:50.571981+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:30.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571751+0000","last_change":"2023-10-07T09:05:50.571751+0000","last_active":"2023-10-07T09:05:50.571751+0000","last_peered":"2023-10-07T09:05:50.571751+0000","last_clean":"2023-10-07T09:05:50.571751+0000","last_became_active":"2023-10-07T09:05:50.570864+0000","last_became_peered":"2023-10-07T09:05:50.570864+0000","last_unstale":"2023-10-07T09:05:50.571751+0000","last_undegraded":"2023-10-07T09:05:50.571751+0000","last_fullsized":"2023-10-07T09:05:50.571751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572969+0000","last_change":"2023-10-07T09:05:50.572969+0000","last_active":"2023-10-07T09:05:50.572969+0000","last_peered":"2023-10-07T09:05:50.572969+0000","last_clean":"2023-10-07T09:05:50.572969+0000","last_became_active":"2023-10-07T09:05:50.572654+0000","last_became_peered":"2023-10-07T09:05:50.572654+0000","last_unstale":"2023-10-07T09:05:50.572969+0000","last_undegraded":"2023-10-07T09:05:50.572969+0000","last_fullsized":"2023-10-07T09:05:50.572969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:11.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572359+0000","last_change":"2023-10-07T09:05:50.572359+0000","last_active":"2023-10-07T09:05:50.572359+0000","last_peered":"2023-10-07T09:05:50.572359+0000","last_clean":"2023-10-07T09:05:50.572359+0000","last_became_active":"2023-10-07T09:05:50.572097+0000","last_became_peered":"2023-10-07T09:05:50.572097+0000","last_unstale":"2023-10-07T09:05:50.572359+0000","last_undegraded":"2023-10-07T09:05:50.572359+0000","last_fullsized":"2023-10-07T09:05:50.572359+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:37.012189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574307+0000","last_change":"2023-10-07T09:05:50.574307+0000","last_active":"2023-10-07T09:05:50.574307+0000","last_peered":"2023-10-07T09:05:50.574307+0000","last_clean":"2023-10-07T09:05:50.574307+0000","last_became_active":"2023-10-07T09:05:50.574035+0000","last_became_peered":"2023-10-07T09:05:50.574035+0000","last_unstale":"2023-10-07T09:05:50.574307+0000","last_undegraded":"2023-10-07T09:05:50.574307+0000","last_fullsized":"2023-10-07T09:05:50.574307+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:31.500656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572009+0000","last_change":"2023-10-07T09:05:50.572009+0000","last_active":"2023-10-07T09:05:50.572009+0000","last_peered":"2023-10-07T09:05:50.572009+0000","last_clean":"2023-10-07T09:05:50.572009+0000","last_became_active":"2023-10-07T09:05:50.571731+0000","last_became_peered":"2023-10-07T09:05:50.571731+0000","last_unstale":"2023-10-07T09:05:50.572009+0000","last_undegraded":"2023-10-07T09:05:50.572009+0000","last_fullsized":"2023-10-07T09:05:50.572009+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:55.545359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.572194+0000","last_change":"2023-10-07T09:05:50.572194+0000","last_active":"2023-10-07T09:05:50.572194+0000","last_peered":"2023-10-07T09:05:50.572194+0000","last_clean":"2023-10-07T09:05:50.572194+0000","last_became_active":"2023-10-07T09:05:50.571707+0000","last_became_peered":"2023-10-07T09:05:50.571707+0000","last_unstale":"2023-10-07T09:05:50.572194+0000","last_undegraded":"2023-10-07T09:05:50.572194+0000","last_fullsized":"2023-10-07T09:05:50.572194+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:10:10.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574492+0000","last_change":"2023-10-07T09:05:50.574492+0000","last_active":"2023-10-07T09:05:50.574492+0000","last_peered":"2023-10-07T09:05:50.574492+0000","last_clean":"2023-10-07T09:05:50.574492+0000","last_became_active":"2023-10-07T09:05:50.574113+0000","last_became_peered":"2023-10-07T09:05:50.574113+0000","last_unstale":"2023-10-07T09:05:50.574492+0000","last_undegraded":"2023-10-07T09:05:50.574492+0000","last_fullsized":"2023-10-07T09:05:50.574492+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568581+0000","last_change":"2023-10-07T09:05:50.568581+0000","last_active":"2023-10-07T09:05:50.568581+0000","last_peered":"2023-10-07T09:05:50.568581+0000","last_clean":"2023-10-07T09:05:50.568581+0000","last_became_active":"2023-10-07T09:05:50.568301+0000","last_became_peered":"2023-10-07T09:05:50.568301+0000","last_unstale":"2023-10-07T09:05:50.568581+0000","last_undegraded":"2023-10-07T09:05:50.568581+0000","last_fullsized":"2023-10-07T09:05:50.568581+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:27.506669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569649+0000","last_change":"2023-10-07T09:05:50.569649+0000","last_active":"2023-10-07T09:05:50.569649+0000","last_peered":"2023-10-07T09:05:50.569649+0000","last_clean":"2023-10-07T09:05:50.569649+0000","last_became_active":"2023-10-07T09:05:50.568832+0000","last_became_peered":"2023-10-07T09:05:50.568832+0000","last_unstale":"2023-10-07T09:05:50.569649+0000","last_undegraded":"2023-10-07T09:05:50.569649+0000","last_fullsized":"2023-10-07T09:05:50.569649+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:23.987643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567176+0000","last_change":"2023-10-07T09:05:50.567176+0000","last_active":"2023-10-07T09:05:50.567176+0000","last_peered":"2023-10-07T09:05:50.567176+0000","last_clean":"2023-10-07T09:05:50.567176+0000","last_became_active":"2023-10-07T09:05:50.566911+0000","last_became_peered":"2023-10-07T09:05:50.566911+0000","last_unstale":"2023-10-07T09:05:50.567176+0000","last_undegraded":"2023-10-07T09:05:50.567176+0000","last_fullsized":"2023-10-07T09:05:50.567176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:17.708335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563548+0000","last_change":"2023-10-07T09:05:50.563548+0000","last_active":"2023-10-07T09:05:50.563548+0000","last_peered":"2023-10-07T09:05:50.563548+0000","last_clean":"2023-10-07T09:05:50.563548+0000","last_became_active":"2023-10-07T09:05:50.563284+0000","last_became_peered":"2023-10-07T09:05:50.563284+0000","last_unstale":"2023-10-07T09:05:50.563548+0000","last_undegraded":"2023-10-07T09:05:50.563548+0000","last_fullsized":"2023-10-07T09:05:50.563548+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:00.732871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571864+0000","last_change":"2023-10-07T09:05:50.571864+0000","last_active":"2023-10-07T09:05:50.571864+0000","last_peered":"2023-10-07T09:05:50.571864+0000","last_clean":"2023-10-07T09:05:50.571864+0000","last_became_active":"2023-10-07T09:05:50.571471+0000","last_became_peered":"2023-10-07T09:05:50.571471+0000","last_unstale":"2023-10-07T09:05:50.571864+0000","last_undegraded":"2023-10-07T09:05:50.571864+0000","last_fullsized":"2023-10-07T09:05:50.571864+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563799+0000","last_change":"2023-10-07T09:05:50.563799+0000","last_active":"2023-10-07T09:05:50.563799+0000","last_peered":"2023-10-07T09:05:50.563799+0000","last_clean":"2023-10-07T09:05:50.563799+0000","last_became_active":"2023-10-07T09:05:50.563543+0000","last_became_peered":"2023-10-07T09:05:50.563543+0000","last_unstale":"2023-10-07T09:05:50.563799+0000","last_undegraded":"2023-10-07T09:05:50.563799+0000","last_fullsized":"2023-10-07T09:05:50.563799+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:14.960010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568118+0000","last_change":"2023-10-07T09:05:50.568118+0000","last_active":"2023-10-07T09:05:50.568118+0000","last_peered":"2023-10-07T09:05:50.568118+0000","last_clean":"2023-10-07T09:05:50.568118+0000","last_became_active":"2023-10-07T09:05:50.567864+0000","last_became_peered":"2023-10-07T09:05:50.567864+0000","last_unstale":"2023-10-07T09:05:50.568118+0000","last_undegraded":"2023-10-07T09:05:50.568118+0000","last_fullsized":"2023-10-07T09:05:50.568118+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:33:41.305114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564280+0000","last_change":"2023-10-07T09:05:50.564280+0000","last_active":"2023-10-07T09:05:50.564280+0000","last_peered":"2023-10-07T09:05:50.564280+0000","last_clean":"2023-10-07T09:05:50.564280+0000","last_became_active":"2023-10-07T09:05:50.564005+0000","last_became_peered":"2023-10-07T09:05:50.564005+0000","last_unstale":"2023-10-07T09:05:50.564280+0000","last_undegraded":"2023-10-07T09:05:50.564280+0000","last_fullsized":"2023-10-07T09:05:50.564280+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.478926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571397+0000","last_change":"2023-10-07T09:05:50.571397+0000","last_active":"2023-10-07T09:05:50.571397+0000","last_peered":"2023-10-07T09:05:50.571397+0000","last_clean":"2023-10-07T09:05:50.571397+0000","last_became_active":"2023-10-07T09:05:50.571122+0000","last_became_peered":"2023-10-07T09:05:50.571122+0000","last_unstale":"2023-10-07T09:05:50.571397+0000","last_undegraded":"2023-10-07T09:05:50.571397+0000","last_fullsized":"2023-10-07T09:05:50.571397+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:20.547887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574577+0000","last_change":"2023-10-07T09:05:50.574577+0000","last_active":"2023-10-07T09:05:50.574577+0000","last_peered":"2023-10-07T09:05:50.574577+0000","last_clean":"2023-10-07T09:05:50.574577+0000","last_became_active":"2023-10-07T09:05:50.571575+0000","last_became_peered":"2023-10-07T09:05:50.571575+0000","last_unstale":"2023-10-07T09:05:50.574577+0000","last_undegraded":"2023-10-07T09:05:50.574577+0000","last_fullsized":"2023-10-07T09:05:50.574577+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:17.335967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574921+0000","last_change":"2023-10-07T09:05:50.574921+0000","last_active":"2023-10-07T09:05:50.574921+0000","last_peered":"2023-10-07T09:05:50.574921+0000","last_clean":"2023-10-07T09:05:50.574921+0000","last_became_active":"2023-10-07T09:05:50.574649+0000","last_became_peered":"2023-10-07T09:05:50.574649+0000","last_unstale":"2023-10-07T09:05:50.574921+0000","last_undegraded":"2023-10-07T09:05:50.574921+0000","last_fullsized":"2023-10-07T09:05:50.574921+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:52:31.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.558698+0000","last_change":"2023-10-07T09:05:50.558698+0000","last_active":"2023-10-07T09:05:50.558698+0000","last_peered":"2023-10-07T09:05:50.558698+0000","last_clean":"2023-10-07T09:05:50.558698+0000","last_became_active":"2023-10-07T09:05:50.558487+0000","last_became_peered":"2023-10-07T09:05:50.558487+0000","last_unstale":"2023-10-07T09:05:50.558698+0000","last_undegraded":"2023-10-07T09:05:50.558698+0000","last_fullsized":"2023-10-07T09:05:50.558698+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:41:49.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570096+0000","last_change":"2023-10-07T09:05:50.570096+0000","last_active":"2023-10-07T09:05:50.570096+0000","last_peered":"2023-10-07T09:05:50.570096+0000","last_clean":"2023-10-07T09:05:50.570096+0000","last_became_active":"2023-10-07T09:05:50.569835+0000","last_became_peered":"2023-10-07T09:05:50.569835+0000","last_unstale":"2023-10-07T09:05:50.570096+0000","last_undegraded":"2023-10-07T09:05:50.570096+0000","last_fullsized":"2023-10-07T09:05:50.570096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:12.052690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564956+0000","last_change":"2023-10-07T09:05:49.562136+0000","last_active":"2023-10-07T09:05:49.564956+0000","last_peered":"2023-10-07T09:05:49.564956+0000","last_clean":"2023-10-07T09:05:49.564956+0000","last_became_active":"2023-10-07T09:05:49.561918+0000","last_became_peered":"2023-10-07T09:05:49.561918+0000","last_unstale":"2023-10-07T09:05:49.564956+0000","last_undegraded":"2023-10-07T09:05:49.564956+0000","last_fullsized":"2023-10-07T09:05:49.564956+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:26.668981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568237+0000","last_change":"2023-10-07T09:05:50.568237+0000","last_active":"2023-10-07T09:05:50.568237+0000","last_peered":"2023-10-07T09:05:50.568237+0000","last_clean":"2023-10-07T09:05:50.568237+0000","last_became_active":"2023-10-07T09:05:50.567775+0000","last_became_peered":"2023-10-07T09:05:50.567775+0000","last_unstale":"2023-10-07T09:05:50.568237+0000","last_undegraded":"2023-10-07T09:05:50.568237+0000","last_fullsized":"2023-10-07T09:05:50.568237+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:27:44.069576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.560826+0000","last_change":"2023-10-07T09:05:49.556834+0000","last_active":"2023-10-07T09:05:49.560826+0000","last_peered":"2023-10-07T09:05:49.560826+0000","last_clean":"2023-10-07T09:05:49.560826+0000","last_became_active":"2023-10-07T09:05:49.556571+0000","last_became_peered":"2023-10-07T09:05:49.556571+0000","last_unstale":"2023-10-07T09:05:49.560826+0000","last_undegraded":"2023-10-07T09:05:49.560826+0000","last_fullsized":"2023-10-07T09:05:49.560826+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:53.577181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.559235+0000","last_change":"2023-10-07T09:05:50.559235+0000","last_active":"2023-10-07T09:05:50.559235+0000","last_peered":"2023-10-07T09:05:50.559235+0000","last_clean":"2023-10-07T09:05:50.559235+0000","last_became_active":"2023-10-07T09:05:50.558961+0000","last_became_peered":"2023-10-07T09:05:50.558961+0000","last_unstale":"2023-10-07T09:05:50.559235+0000","last_undegraded":"2023-10-07T09:05:50.559235+0000","last_fullsized":"2023-10-07T09:05:50.559235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:50.085751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564328+0000","last_change":"2023-10-07T09:05:49.563160+0000","last_active":"2023-10-07T09:05:49.564328+0000","last_peered":"2023-10-07T09:05:49.564328+0000","last_clean":"2023-10-07T09:05:49.564328+0000","last_became_active":"2023-10-07T09:05:49.562893+0000","last_became_peered":"2023-10-07T09:05:49.562893+0000","last_unstale":"2023-10-07T09:05:49.564328+0000","last_undegraded":"2023-10-07T09:05:49.564328+0000","last_fullsized":"2023-10-07T09:05:49.564328+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:10.940243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.576349+0000","last_change":"2023-10-07T09:05:50.576349+0000","last_active":"2023-10-07T09:05:50.576349+0000","last_peered":"2023-10-07T09:05:50.576349+0000","last_clean":"2023-10-07T09:05:50.576349+0000","last_became_active":"2023-10-07T09:05:50.576049+0000","last_became_peered":"2023-10-07T09:05:50.576049+0000","last_unstale":"2023-10-07T09:05:50.576349+0000","last_undegraded":"2023-10-07T09:05:50.576349+0000","last_fullsized":"2023-10-07T09:05:50.576349+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:57.061983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.938628+0000","last_change":"2023-10-07T09:05:49.558467+0000","last_active":"2023-10-07T09:05:50.938628+0000","last_peered":"2023-10-07T09:05:50.938628+0000","last_clean":"2023-10-07T09:05:50.938628+0000","last_became_active":"2023-10-07T09:05:49.558201+0000","last_became_peered":"2023-10-07T09:05:49.558201+0000","last_unstale":"2023-10-07T09:05:50.938628+0000","last_undegraded":"2023-10-07T09:05:50.938628+0000","last_fullsized":"2023-10-07T09:05:50.938628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:02.507084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567643+0000","last_change":"2023-10-07T09:05:50.567643+0000","last_active":"2023-10-07T09:05:50.567643+0000","last_peered":"2023-10-07T09:05:50.567643+0000","last_clean":"2023-10-07T09:05:50.567643+0000","last_became_active":"2023-10-07T09:05:50.567016+0000","last_became_peered":"2023-10-07T09:05:50.567016+0000","last_unstale":"2023-10-07T09:05:50.567643+0000","last_undegraded":"2023-10-07T09:05:50.567643+0000","last_fullsized":"2023-10-07T09:05:50.567643+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:00.223665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565656+0000","last_change":"2023-10-07T09:05:49.564628+0000","last_active":"2023-10-07T09:05:49.565656+0000","last_peered":"2023-10-07T09:05:49.565656+0000","last_clean":"2023-10-07T09:05:49.565656+0000","last_became_active":"2023-10-07T09:05:49.564354+0000","last_became_peered":"2023-10-07T09:05:49.564354+0000","last_unstale":"2023-10-07T09:05:49.565656+0000","last_undegraded":"2023-10-07T09:05:49.565656+0000","last_fullsized":"2023-10-07T09:05:49.565656+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:16:11.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570798+0000","last_change":"2023-10-07T09:05:50.570798+0000","last_active":"2023-10-07T09:05:50.570798+0000","last_peered":"2023-10-07T09:05:50.570798+0000","last_clean":"2023-10-07T09:05:50.570798+0000","last_became_active":"2023-10-07T09:05:50.570535+0000","last_became_peered":"2023-10-07T09:05:50.570535+0000","last_unstale":"2023-10-07T09:05:50.570798+0000","last_undegraded":"2023-10-07T09:05:50.570798+0000","last_fullsized":"2023-10-07T09:05:50.570798+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:55.762447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564553+0000","last_change":"2023-10-07T09:05:49.563613+0000","last_active":"2023-10-07T09:05:49.564553+0000","last_peered":"2023-10-07T09:05:49.564553+0000","last_clean":"2023-10-07T09:05:49.564553+0000","last_became_active":"2023-10-07T09:05:49.563315+0000","last_became_peered":"2023-10-07T09:05:49.563315+0000","last_unstale":"2023-10-07T09:05:49.564553+0000","last_undegraded":"2023-10-07T09:05:49.564553+0000","last_fullsized":"2023-10-07T09:05:49.564553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:35.539161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568060+0000","last_change":"2023-10-07T09:05:50.568060+0000","last_active":"2023-10-07T09:05:50.568060+0000","last_peered":"2023-10-07T09:05:50.568060+0000","last_clean":"2023-10-07T09:05:50.568060+0000","last_became_active":"2023-10-07T09:05:50.567772+0000","last_became_peered":"2023-10-07T09:05:50.567772+0000","last_unstale":"2023-10-07T09:05:50.568060+0000","last_undegraded":"2023-10-07T09:05:50.568060+0000","last_fullsized":"2023-10-07T09:05:50.568060+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:11.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.569349+0000","last_change":"2023-10-07T09:05:49.565585+0000","last_active":"2023-10-07T09:05:49.569349+0000","last_peered":"2023-10-07T09:05:49.569349+0000","last_clean":"2023-10-07T09:05:49.569349+0000","last_became_active":"2023-10-07T09:05:49.565356+0000","last_became_peered":"2023-10-07T09:05:49.565356+0000","last_unstale":"2023-10-07T09:05:49.569349+0000","last_undegraded":"2023-10-07T09:05:49.569349+0000","last_fullsized":"2023-10-07T09:05:49.569349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:30.662482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573667+0000","last_change":"2023-10-07T09:05:50.573667+0000","last_active":"2023-10-07T09:05:50.573667+0000","last_peered":"2023-10-07T09:05:50.573667+0000","last_clean":"2023-10-07T09:05:50.573667+0000","last_became_active":"2023-10-07T09:05:50.568917+0000","last_became_peered":"2023-10-07T09:05:50.568917+0000","last_unstale":"2023-10-07T09:05:50.573667+0000","last_undegraded":"2023-10-07T09:05:50.573667+0000","last_fullsized":"2023-10-07T09:05:50.573667+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:15:55.280991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.560592+0000","last_change":"2023-10-07T09:05:49.554252+0000","last_active":"2023-10-07T09:05:49.560592+0000","last_peered":"2023-10-07T09:05:49.560592+0000","last_clean":"2023-10-07T09:05:49.560592+0000","last_became_active":"2023-10-07T09:05:49.553893+0000","last_became_peered":"2023-10-07T09:05:49.553893+0000","last_unstale":"2023-10-07T09:05:49.560592+0000","last_undegraded":"2023-10-07T09:05:49.560592+0000","last_fullsized":"2023-10-07T09:05:49.560592+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:37.540888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564012+0000","last_change":"2023-10-07T09:05:50.564012+0000","last_active":"2023-10-07T09:05:50.564012+0000","last_peered":"2023-10-07T09:05:50.564012+0000","last_clean":"2023-10-07T09:05:50.564012+0000","last_became_active":"2023-10-07T09:05:50.563757+0000","last_became_peered":"2023-10-07T09:05:50.563757+0000","last_unstale":"2023-10-07T09:05:50.564012+0000","last_undegraded":"2023-10-07T09:05:50.564012+0000","last_fullsized":"2023-10-07T09:05:50.564012+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:52.010020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564736+0000","last_change":"2023-10-07T09:05:49.562598+0000","last_active":"2023-10-07T09:05:49.564736+0000","last_peered":"2023-10-07T09:05:49.564736+0000","last_clean":"2023-10-07T09:05:49.564736+0000","last_became_active":"2023-10-07T09:05:49.562336+0000","last_became_peered":"2023-10-07T09:05:49.562336+0000","last_unstale":"2023-10-07T09:05:49.564736+0000","last_undegraded":"2023-10-07T09:05:49.564736+0000","last_fullsized":"2023-10-07T09:05:49.564736+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:34.029196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571886+0000","last_change":"2023-10-07T09:05:50.571886+0000","last_active":"2023-10-07T09:05:50.571886+0000","last_peered":"2023-10-07T09:05:50.571886+0000","last_clean":"2023-10-07T09:05:50.571886+0000","last_became_active":"2023-10-07T09:05:50.571630+0000","last_became_peered":"2023-10-07T09:05:50.571630+0000","last_unstale":"2023-10-07T09:05:50.571886+0000","last_undegraded":"2023-10-07T09:05:50.571886+0000","last_fullsized":"2023-10-07T09:05:50.571886+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.462020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565672+0000","last_change":"2023-10-07T09:05:49.564935+0000","last_active":"2023-10-07T09:05:49.565672+0000","last_peered":"2023-10-07T09:05:49.565672+0000","last_clean":"2023-10-07T09:05:49.565672+0000","last_became_active":"2023-10-07T09:05:49.564667+0000","last_became_peered":"2023-10-07T09:05:49.564667+0000","last_unstale":"2023-10-07T09:05:49.565672+0000","last_undegraded":"2023-10-07T09:05:49.565672+0000","last_fullsized":"2023-10-07T09:05:49.565672+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:42.916103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.566257+0000","last_change":"2023-10-07T09:05:50.566257+0000","last_active":"2023-10-07T09:05:50.566257+0000","last_peered":"2023-10-07T09:05:50.566257+0000","last_clean":"2023-10-07T09:05:50.566257+0000","last_became_active":"2023-10-07T09:05:50.565945+0000","last_became_peered":"2023-10-07T09:05:50.565945+0000","last_unstale":"2023-10-07T09:05:50.566257+0000","last_undegraded":"2023-10-07T09:05:50.566257+0000","last_fullsized":"2023-10-07T09:05:50.566257+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:18:32.108910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.556483+0000","last_change":"2023-10-07T09:05:49.551852+0000","last_active":"2023-10-07T09:05:49.556483+0000","last_peered":"2023-10-07T09:05:49.556483+0000","last_clean":"2023-10-07T09:05:49.556483+0000","last_became_active":"2023-10-07T09:05:49.551577+0000","last_became_peered":"2023-10-07T09:05:49.551577+0000","last_unstale":"2023-10-07T09:05:49.556483+0000","last_undegraded":"2023-10-07T09:05:49.556483+0000","last_fullsized":"2023-10-07T09:05:49.556483+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:54:53.888600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.564301+0000","last_change":"2023-10-07T09:05:50.564301+0000","last_active":"2023-10-07T09:05:50.564301+0000","last_peered":"2023-10-07T09:05:50.564301+0000","last_clean":"2023-10-07T09:05:50.564301+0000","last_became_active":"2023-10-07T09:05:50.563986+0000","last_became_peered":"2023-10-07T09:05:50.563986+0000","last_unstale":"2023-10-07T09:05:50.564301+0000","last_undegraded":"2023-10-07T09:05:50.564301+0000","last_fullsized":"2023-10-07T09:05:50.564301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:42.238276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564048+0000","last_change":"2023-10-07T09:05:49.560315+0000","last_active":"2023-10-07T09:05:49.564048+0000","last_peered":"2023-10-07T09:05:49.564048+0000","last_clean":"2023-10-07T09:05:49.564048+0000","last_became_active":"2023-10-07T09:05:49.560033+0000","last_became_peered":"2023-10-07T09:05:49.560033+0000","last_unstale":"2023-10-07T09:05:49.564048+0000","last_undegraded":"2023-10-07T09:05:49.564048+0000","last_fullsized":"2023-10-07T09:05:49.564048+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:56.397062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567072+0000","last_change":"2023-10-07T09:05:50.567072+0000","last_active":"2023-10-07T09:05:50.567072+0000","last_peered":"2023-10-07T09:05:50.567072+0000","last_clean":"2023-10-07T09:05:50.567072+0000","last_became_active":"2023-10-07T09:05:50.566790+0000","last_became_peered":"2023-10-07T09:05:50.566790+0000","last_unstale":"2023-10-07T09:05:50.567072+0000","last_undegraded":"2023-10-07T09:05:50.567072+0000","last_fullsized":"2023-10-07T09:05:50.567072+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:20.547887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.562930+0000","last_change":"2023-10-07T09:05:49.559830+0000","last_active":"2023-10-07T09:05:49.562930+0000","last_peered":"2023-10-07T09:05:49.562930+0000","last_clean":"2023-10-07T09:05:49.562930+0000","last_became_active":"2023-10-07T09:05:49.559316+0000","last_became_peered":"2023-10-07T09:05:49.559316+0000","last_unstale":"2023-10-07T09:05:49.562930+0000","last_undegraded":"2023-10-07T09:05:49.562930+0000","last_fullsized":"2023-10-07T09:05:49.562930+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:47.272061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571753+0000","last_change":"2023-10-07T09:05:50.571753+0000","last_active":"2023-10-07T09:05:50.571753+0000","last_peered":"2023-10-07T09:05:50.571753+0000","last_clean":"2023-10-07T09:05:50.571753+0000","last_became_active":"2023-10-07T09:05:50.570810+0000","last_became_peered":"2023-10-07T09:05:50.570810+0000","last_unstale":"2023-10-07T09:05:50.571753+0000","last_undegraded":"2023-10-07T09:05:50.571753+0000","last_fullsized":"2023-10-07T09:05:50.571753+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.924846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564496+0000","last_change":"2023-10-07T09:05:49.562677+0000","last_active":"2023-10-07T09:05:49.564496+0000","last_peered":"2023-10-07T09:05:49.564496+0000","last_clean":"2023-10-07T09:05:49.564496+0000","last_became_active":"2023-10-07T09:05:49.562236+0000","last_became_peered":"2023-10-07T09:05:49.562236+0000","last_unstale":"2023-10-07T09:05:49.564496+0000","last_undegraded":"2023-10-07T09:05:49.564496+0000","last_fullsized":"2023-10-07T09:05:49.564496+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:47.272061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569267+0000","last_change":"2023-10-07T09:05:50.569267+0000","last_active":"2023-10-07T09:05:50.569267+0000","last_peered":"2023-10-07T09:05:50.569267+0000","last_clean":"2023-10-07T09:05:50.569267+0000","last_became_active":"2023-10-07T09:05:50.568977+0000","last_became_peered":"2023-10-07T09:05:50.568977+0000","last_unstale":"2023-10-07T09:05:50.569267+0000","last_undegraded":"2023-10-07T09:05:50.569267+0000","last_fullsized":"2023-10-07T09:05:50.569267+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:12.052690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563999+0000","last_change":"2023-10-07T09:05:49.560330+0000","last_active":"2023-10-07T09:05:49.563999+0000","last_peered":"2023-10-07T09:05:49.563999+0000","last_clean":"2023-10-07T09:05:49.563999+0000","last_became_active":"2023-10-07T09:05:49.560107+0000","last_became_peered":"2023-10-07T09:05:49.560107+0000","last_unstale":"2023-10-07T09:05:49.563999+0000","last_undegraded":"2023-10-07T09:05:49.563999+0000","last_fullsized":"2023-10-07T09:05:49.563999+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:33.457097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569182+0000","last_change":"2023-10-07T09:05:50.569182+0000","last_active":"2023-10-07T09:05:50.569182+0000","last_peered":"2023-10-07T09:05:50.569182+0000","last_clean":"2023-10-07T09:05:50.569182+0000","last_became_active":"2023-10-07T09:05:50.568914+0000","last_became_peered":"2023-10-07T09:05:50.568914+0000","last_unstale":"2023-10-07T09:05:50.569182+0000","last_undegraded":"2023-10-07T09:05:50.569182+0000","last_fullsized":"2023-10-07T09:05:50.569182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:37.012189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.565662+0000","last_change":"2023-10-07T09:05:49.564847+0000","last_active":"2023-10-07T09:05:49.565662+0000","last_peered":"2023-10-07T09:05:49.565662+0000","last_clean":"2023-10-07T09:05:49.565662+0000","last_became_active":"2023-10-07T09:05:49.564376+0000","last_became_peered":"2023-10-07T09:05:49.564376+0000","last_unstale":"2023-10-07T09:05:49.565662+0000","last_undegraded":"2023-10-07T09:05:49.565662+0000","last_fullsized":"2023-10-07T09:05:49.565662+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:17.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571037+0000","last_change":"2023-10-07T09:05:50.571037+0000","last_active":"2023-10-07T09:05:50.571037+0000","last_peered":"2023-10-07T09:05:50.571037+0000","last_clean":"2023-10-07T09:05:50.571037+0000","last_became_active":"2023-10-07T09:05:50.570688+0000","last_became_peered":"2023-10-07T09:05:50.570688+0000","last_unstale":"2023-10-07T09:05:50.571037+0000","last_undegraded":"2023-10-07T09:05:50.571037+0000","last_fullsized":"2023-10-07T09:05:50.571037+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:31.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.568134+0000","last_change":"2023-10-07T09:05:49.567286+0000","last_active":"2023-10-07T09:05:49.568134+0000","last_peered":"2023-10-07T09:05:49.568134+0000","last_clean":"2023-10-07T09:05:49.568134+0000","last_became_active":"2023-10-07T09:05:49.566942+0000","last_became_peered":"2023-10-07T09:05:49.566942+0000","last_unstale":"2023-10-07T09:05:49.568134+0000","last_undegraded":"2023-10-07T09:05:49.568134+0000","last_fullsized":"2023-10-07T09:05:49.568134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:55.084415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.575740+0000","last_change":"2023-10-07T09:05:50.575740+0000","last_active":"2023-10-07T09:05:50.575740+0000","last_peered":"2023-10-07T09:05:50.575740+0000","last_clean":"2023-10-07T09:05:50.575740+0000","last_became_active":"2023-10-07T09:05:50.571617+0000","last_became_peered":"2023-10-07T09:05:50.571617+0000","last_unstale":"2023-10-07T09:05:50.575740+0000","last_undegraded":"2023-10-07T09:05:50.575740+0000","last_fullsized":"2023-10-07T09:05:50.575740+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:12.478926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.569327+0000","last_change":"2023-10-07T09:05:49.564000+0000","last_active":"2023-10-07T09:05:49.569327+0000","last_peered":"2023-10-07T09:05:49.569327+0000","last_clean":"2023-10-07T09:05:49.569327+0000","last_became_active":"2023-10-07T09:05:49.563612+0000","last_became_peered":"2023-10-07T09:05:49.563612+0000","last_unstale":"2023-10-07T09:05:49.569327+0000","last_undegraded":"2023-10-07T09:05:49.569327+0000","last_fullsized":"2023-10-07T09:05:49.569327+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:29.780969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574254+0000","last_change":"2023-10-07T09:05:50.574254+0000","last_active":"2023-10-07T09:05:50.574254+0000","last_peered":"2023-10-07T09:05:50.574254+0000","last_clean":"2023-10-07T09:05:50.574254+0000","last_became_active":"2023-10-07T09:05:50.573992+0000","last_became_peered":"2023-10-07T09:05:50.573992+0000","last_unstale":"2023-10-07T09:05:50.574254+0000","last_undegraded":"2023-10-07T09:05:50.574254+0000","last_fullsized":"2023-10-07T09:05:50.574254+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:04:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566415+0000","last_change":"2023-10-07T09:05:49.563545+0000","last_active":"2023-10-07T09:05:49.566415+0000","last_peered":"2023-10-07T09:05:49.566415+0000","last_clean":"2023-10-07T09:05:49.566415+0000","last_became_active":"2023-10-07T09:05:49.563240+0000","last_became_peered":"2023-10-07T09:05:49.563240+0000","last_unstale":"2023-10-07T09:05:49.566415+0000","last_undegraded":"2023-10-07T09:05:49.566415+0000","last_fullsized":"2023-10-07T09:05:49.566415+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:17.007398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.567819+0000","last_change":"2023-10-07T09:05:50.567819+0000","last_active":"2023-10-07T09:05:50.567819+0000","last_peered":"2023-10-07T09:05:50.567819+0000","last_clean":"2023-10-07T09:05:50.567819+0000","last_became_active":"2023-10-07T09:05:50.567390+0000","last_became_peered":"2023-10-07T09:05:50.567390+0000","last_unstale":"2023-10-07T09:05:50.567819+0000","last_undegraded":"2023-10-07T09:05:50.567819+0000","last_fullsized":"2023-10-07T09:05:50.567819+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:08.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561725+0000","last_change":"2023-10-07T09:05:49.558039+0000","last_active":"2023-10-07T09:05:49.561725+0000","last_peered":"2023-10-07T09:05:49.561725+0000","last_clean":"2023-10-07T09:05:49.561725+0000","last_became_active":"2023-10-07T09:05:49.557817+0000","last_became_peered":"2023-10-07T09:05:49.557817+0000","last_unstale":"2023-10-07T09:05:49.561725+0000","last_undegraded":"2023-10-07T09:05:49.561725+0000","last_fullsized":"2023-10-07T09:05:49.561725+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:34:19.540153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.557824+0000","last_change":"2023-10-07T09:05:50.557824+0000","last_active":"2023-10-07T09:05:50.557824+0000","last_peered":"2023-10-07T09:05:50.557824+0000","last_clean":"2023-10-07T09:05:50.557824+0000","last_became_active":"2023-10-07T09:05:50.557553+0000","last_became_peered":"2023-10-07T09:05:50.557553+0000","last_unstale":"2023-10-07T09:05:50.557824+0000","last_undegraded":"2023-10-07T09:05:50.557824+0000","last_fullsized":"2023-10-07T09:05:50.557824+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:04:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.564153+0000","last_change":"2023-10-07T09:05:49.559832+0000","last_active":"2023-10-07T09:05:49.564153+0000","last_peered":"2023-10-07T09:05:49.564153+0000","last_clean":"2023-10-07T09:05:49.564153+0000","last_became_active":"2023-10-07T09:05:49.559549+0000","last_became_peered":"2023-10-07T09:05:49.559549+0000","last_unstale":"2023-10-07T09:05:49.564153+0000","last_undegraded":"2023-10-07T09:05:49.564153+0000","last_fullsized":"2023-10-07T09:05:49.564153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:35.772141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571174+0000","last_change":"2023-10-07T09:05:50.571174+0000","last_active":"2023-10-07T09:05:50.571174+0000","last_peered":"2023-10-07T09:05:50.571174+0000","last_clean":"2023-10-07T09:05:50.571174+0000","last_became_active":"2023-10-07T09:05:50.570741+0000","last_became_peered":"2023-10-07T09:05:50.570741+0000","last_unstale":"2023-10-07T09:05:50.571174+0000","last_undegraded":"2023-10-07T09:05:50.571174+0000","last_fullsized":"2023-10-07T09:05:50.571174+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:50.085751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563305+0000","last_change":"2023-10-07T09:05:49.558922+0000","last_active":"2023-10-07T09:05:49.563305+0000","last_peered":"2023-10-07T09:05:49.563305+0000","last_clean":"2023-10-07T09:05:49.563305+0000","last_became_active":"2023-10-07T09:05:49.558663+0000","last_became_peered":"2023-10-07T09:05:49.558663+0000","last_unstale":"2023-10-07T09:05:49.563305+0000","last_undegraded":"2023-10-07T09:05:49.563305+0000","last_fullsized":"2023-10-07T09:05:49.563305+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:17:30.891419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.565141+0000","last_change":"2023-10-07T09:05:50.565141+0000","last_active":"2023-10-07T09:05:50.565141+0000","last_peered":"2023-10-07T09:05:50.565141+0000","last_clean":"2023-10-07T09:05:50.565141+0000","last_became_active":"2023-10-07T09:05:50.564878+0000","last_became_peered":"2023-10-07T09:05:50.564878+0000","last_unstale":"2023-10-07T09:05:50.565141+0000","last_undegraded":"2023-10-07T09:05:50.565141+0000","last_fullsized":"2023-10-07T09:05:50.565141+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:17.335967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566556+0000","last_change":"2023-10-07T09:05:49.561953+0000","last_active":"2023-10-07T09:05:49.566556+0000","last_peered":"2023-10-07T09:05:49.566556+0000","last_clean":"2023-10-07T09:05:49.566556+0000","last_became_active":"2023-10-07T09:05:49.561664+0000","last_became_peered":"2023-10-07T09:05:49.561664+0000","last_unstale":"2023-10-07T09:05:49.566556+0000","last_undegraded":"2023-10-07T09:05:49.566556+0000","last_fullsized":"2023-10-07T09:05:49.566556+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.631525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.565514+0000","last_change":"2023-10-07T09:05:50.565514+0000","last_active":"2023-10-07T09:05:50.565514+0000","last_peered":"2023-10-07T09:05:50.565514+0000","last_clean":"2023-10-07T09:05:50.565514+0000","last_became_active":"2023-10-07T09:05:50.565250+0000","last_became_peered":"2023-10-07T09:05:50.565250+0000","last_unstale":"2023-10-07T09:05:50.565514+0000","last_undegraded":"2023-10-07T09:05:50.565514+0000","last_fullsized":"2023-10-07T09:05:50.565514+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:03.514818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561096+0000","last_change":"2023-10-07T09:05:49.559233+0000","last_active":"2023-10-07T09:05:49.561096+0000","last_peered":"2023-10-07T09:05:49.561096+0000","last_clean":"2023-10-07T09:05:49.561096+0000","last_became_active":"2023-10-07T09:05:49.558921+0000","last_became_peered":"2023-10-07T09:05:49.558921+0000","last_unstale":"2023-10-07T09:05:49.561096+0000","last_undegraded":"2023-10-07T09:05:49.561096+0000","last_fullsized":"2023-10-07T09:05:49.561096+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:58.459508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.570290+0000","last_change":"2023-10-07T09:05:50.570290+0000","last_active":"2023-10-07T09:05:50.570290+0000","last_peered":"2023-10-07T09:05:50.570290+0000","last_clean":"2023-10-07T09:05:50.570290+0000","last_became_active":"2023-10-07T09:05:50.569380+0000","last_became_peered":"2023-10-07T09:05:50.569380+0000","last_unstale":"2023-10-07T09:05:50.570290+0000","last_undegraded":"2023-10-07T09:05:50.570290+0000","last_fullsized":"2023-10-07T09:05:50.570290+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:31:43.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.563741+0000","last_change":"2023-10-07T09:05:49.561754+0000","last_active":"2023-10-07T09:05:49.563741+0000","last_peered":"2023-10-07T09:05:49.563741+0000","last_clean":"2023-10-07T09:05:49.563741+0000","last_became_active":"2023-10-07T09:05:49.561477+0000","last_became_peered":"2023-10-07T09:05:49.561477+0000","last_unstale":"2023-10-07T09:05:49.563741+0000","last_undegraded":"2023-10-07T09:05:49.563741+0000","last_fullsized":"2023-10-07T09:05:49.563741+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:55.084415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.563488+0000","last_change":"2023-10-07T09:05:50.563488+0000","last_active":"2023-10-07T09:05:50.563488+0000","last_peered":"2023-10-07T09:05:50.563488+0000","last_clean":"2023-10-07T09:05:50.563488+0000","last_became_active":"2023-10-07T09:05:50.563184+0000","last_became_peered":"2023-10-07T09:05:50.563184+0000","last_unstale":"2023-10-07T09:05:50.563488+0000","last_undegraded":"2023-10-07T09:05:50.563488+0000","last_fullsized":"2023-10-07T09:05:50.563488+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:17.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.562991+0000","last_change":"2023-10-07T09:05:49.556930+0000","last_active":"2023-10-07T09:05:49.562991+0000","last_peered":"2023-10-07T09:05:49.562991+0000","last_clean":"2023-10-07T09:05:49.562991+0000","last_became_active":"2023-10-07T09:05:49.555992+0000","last_became_peered":"2023-10-07T09:05:49.555992+0000","last_unstale":"2023-10-07T09:05:49.562991+0000","last_undegraded":"2023-10-07T09:05:49.562991+0000","last_fullsized":"2023-10-07T09:05:49.562991+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:35.539161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.569987+0000","last_change":"2023-10-07T09:05:50.569987+0000","last_active":"2023-10-07T09:05:50.569987+0000","last_peered":"2023-10-07T09:05:50.569987+0000","last_clean":"2023-10-07T09:05:50.569987+0000","last_became_active":"2023-10-07T09:05:50.569690+0000","last_became_peered":"2023-10-07T09:05:50.569690+0000","last_unstale":"2023-10-07T09:05:50.569987+0000","last_undegraded":"2023-10-07T09:05:50.569987+0000","last_fullsized":"2023-10-07T09:05:50.569987+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:34.141295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.568140+0000","last_change":"2023-10-07T09:05:49.567290+0000","last_active":"2023-10-07T09:05:49.568140+0000","last_peered":"2023-10-07T09:05:49.568140+0000","last_clean":"2023-10-07T09:05:49.568140+0000","last_became_active":"2023-10-07T09:05:49.566960+0000","last_became_peered":"2023-10-07T09:05:49.566960+0000","last_unstale":"2023-10-07T09:05:49.568140+0000","last_undegraded":"2023-10-07T09:05:49.568140+0000","last_fullsized":"2023-10-07T09:05:49.568140+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:23:24.717360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.573952+0000","last_change":"2023-10-07T09:05:50.573952+0000","last_active":"2023-10-07T09:05:50.573952+0000","last_peered":"2023-10-07T09:05:50.573952+0000","last_clean":"2023-10-07T09:05:50.573952+0000","last_became_active":"2023-10-07T09:05:50.569556+0000","last_became_peered":"2023-10-07T09:05:50.569556+0000","last_unstale":"2023-10-07T09:05:50.573952+0000","last_undegraded":"2023-10-07T09:05:50.573952+0000","last_fullsized":"2023-10-07T09:05:50.573952+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:42:56.092149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566594+0000","last_change":"2023-10-07T09:05:49.563563+0000","last_active":"2023-10-07T09:05:49.566594+0000","last_peered":"2023-10-07T09:05:49.566594+0000","last_clean":"2023-10-07T09:05:49.566594+0000","last_became_active":"2023-10-07T09:05:49.563232+0000","last_became_peered":"2023-10-07T09:05:49.563232+0000","last_unstale":"2023-10-07T09:05:49.566594+0000","last_undegraded":"2023-10-07T09:05:49.566594+0000","last_fullsized":"2023-10-07T09:05:49.566594+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:33.794319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.568976+0000","last_change":"2023-10-07T09:05:50.568976+0000","last_active":"2023-10-07T09:05:50.568976+0000","last_peered":"2023-10-07T09:05:50.568976+0000","last_clean":"2023-10-07T09:05:50.568976+0000","last_became_active":"2023-10-07T09:05:50.568484+0000","last_became_peered":"2023-10-07T09:05:50.568484+0000","last_unstale":"2023-10-07T09:05:50.568976+0000","last_undegraded":"2023-10-07T09:05:50.568976+0000","last_fullsized":"2023-10-07T09:05:50.568976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:18.296996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566478+0000","last_change":"2023-10-07T09:05:49.561241+0000","last_active":"2023-10-07T09:05:49.566478+0000","last_peered":"2023-10-07T09:05:49.566478+0000","last_clean":"2023-10-07T09:05:49.566478+0000","last_became_active":"2023-10-07T09:05:49.560963+0000","last_became_peered":"2023-10-07T09:05:49.560963+0000","last_unstale":"2023-10-07T09:05:49.566478+0000","last_undegraded":"2023-10-07T09:05:49.566478+0000","last_fullsized":"2023-10-07T09:05:49.566478+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:43.656272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574373+0000","last_change":"2023-10-07T09:05:50.574373+0000","last_active":"2023-10-07T09:05:50.574373+0000","last_peered":"2023-10-07T09:05:50.574373+0000","last_clean":"2023-10-07T09:05:50.574373+0000","last_became_active":"2023-10-07T09:05:50.574091+0000","last_became_peered":"2023-10-07T09:05:50.574091+0000","last_unstale":"2023-10-07T09:05:50.574373+0000","last_undegraded":"2023-10-07T09:05:50.574373+0000","last_fullsized":"2023-10-07T09:05:50.574373+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.462020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566520+0000","last_change":"2023-10-07T09:05:49.561690+0000","last_active":"2023-10-07T09:05:49.566520+0000","last_peered":"2023-10-07T09:05:49.566520+0000","last_clean":"2023-10-07T09:05:49.566520+0000","last_became_active":"2023-10-07T09:05:49.561402+0000","last_became_peered":"2023-10-07T09:05:49.561402+0000","last_unstale":"2023-10-07T09:05:49.566520+0000","last_undegraded":"2023-10-07T09:05:49.566520+0000","last_fullsized":"2023-10-07T09:05:49.566520+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:17.007398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.574369+0000","last_change":"2023-10-07T09:05:50.574369+0000","last_active":"2023-10-07T09:05:50.574369+0000","last_peered":"2023-10-07T09:05:50.574369+0000","last_clean":"2023-10-07T09:05:50.574369+0000","last_became_active":"2023-10-07T09:05:50.574066+0000","last_became_peered":"2023-10-07T09:05:50.574066+0000","last_unstale":"2023-10-07T09:05:50.574369+0000","last_undegraded":"2023-10-07T09:05:50.574369+0000","last_fullsized":"2023-10-07T09:05:50.574369+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:27.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.561792+0000","last_change":"2023-10-07T09:05:49.557730+0000","last_active":"2023-10-07T09:05:49.561792+0000","last_peered":"2023-10-07T09:05:49.561792+0000","last_clean":"2023-10-07T09:05:49.561792+0000","last_became_active":"2023-10-07T09:05:49.557409+0000","last_became_peered":"2023-10-07T09:05:49.557409+0000","last_unstale":"2023-10-07T09:05:49.561792+0000","last_undegraded":"2023-10-07T09:05:49.561792+0000","last_fullsized":"2023-10-07T09:05:49.561792+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:08.917112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T09:05:50.571705+0000","last_change":"2023-10-07T09:05:50.571705+0000","last_active":"2023-10-07T09:05:50.571705+0000","last_peered":"2023-10-07T09:05:50.571705+0000","last_clean":"2023-10-07T09:05:50.571705+0000","last_became_active":"2023-10-07T09:05:50.571402+0000","last_became_peered":"2023-10-07T09:05:50.571402+0000","last_unstale":"2023-10-07T09:05:50.571705+0000","last_undegraded":"2023-10-07T09:05:50.571705+0000","last_fullsized":"2023-10-07T09:05:50.571705+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:49.538941+0000","last_clean_scrub_stamp":"2023-10-07T09:05:49.538941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:21.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.566554+0000","last_change":"2023-10-07T09:05:49.562581+0000","last_active":"2023-10-07T09:05:49.566554+0000","last_peered":"2023-10-07T09:05:49.566554+0000","last_clean":"2023-10-07T09:05:49.566554+0000","last_became_active":"2023-10-07T09:05:49.562280+0000","last_became_peered":"2023-10-07T09:05:49.562280+0000","last_unstale":"2023-10-07T09:05:49.566554+0000","last_undegraded":"2023-10-07T09:05:49.566554+0000","last_fullsized":"2023-10-07T09:05:49.566554+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:05:48.531207+0000","last_clean_scrub_stamp":"2023-10-07T09:05:48.531207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:11.742683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T09:05:49.550008+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:05:49.550008+0000","last_peered":"2023-10-07T09:05:49.550008+0000","last_clean":"2023-10-07T09:05:49.550008+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:05:49.550008+0000","last_undegraded":"2023-10-07T09:05:49.550008+0000","last_fullsized":"2023-10-07T09:05:49.550008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1360427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.48799999999999999},"min":{"1min":0.437,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.621}]},{"osd":4,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69999999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.37},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":1.29},"last":0.626}]},{"osd":3,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54900000000000004,"15min":0.70499999999999996},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.878,"15min":4.0880000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.60899999999999999},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.80900000000000005}]},{"osd":4,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.502,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54100000000000004,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.85899999999999999,"15min":0.86199999999999999},"last":0.751},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57299999999999995,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.84199999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.91000000000000003},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.37}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1353664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.432,"5min":0.501,"15min":0.54500000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.38800000000000001},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.625},"last":0.441}]},{"osd":3,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.35299999999999998},"min":{"1min":0.26600000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.433,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.42699999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.627},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57999999999999996,"15min":0.61799999999999999},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.95399999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82399999999999995,"5min":0.83299999999999996,"15min":0.86399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.66000000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83899999999999997,"5min":0.84099999999999997,"15min":1},"last":0.63},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60999999999999999,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41399999999999998},"max":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":1.006},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.879,"15min":1.0389999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60399999999999998,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.79900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":763296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.58899999999999997},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":10.214},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.48999999999999999,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.22},"max":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.755},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.65000000000000002},"min":{"1min":0.29699999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54300000000000004,"5min":0.67000000000000004,"15min":10.144},"last":0.38700000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.70399999999999996},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":10.071},"last":0.372},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.71999999999999997},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.65000000000000002,"5min":0.71199999999999997,"15min":10.183},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55000000000000004,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":1.0549999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":1.1240000000000001},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.0880000000000001},"last":0.5}]},{"osd":6,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.875,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83399999999999996,"5min":4.391,"15min":4.391},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.33600000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.433},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.46700000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":763296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.81399999999999995},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":9.7040000000000006},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67900000000000005,"5min":0.73199999999999998,"15min":5.6319999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.90100000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":9.8439999999999994},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.871},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.89900000000000002},"min":{"1min":0.499,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":10.01},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.70999999999999996},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":5.569},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.872},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":10.131},"last":0.46700000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40100000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.32600000000000001}]},{"osd":7,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":770059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36699999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:05:55.633 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:05:55.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:05:55.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.793+0000 7f8f32747700 1 Processor -- start 2023-10-07T09:05:55.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.793+0000 7f8f32747700 1 -- start start 2023-10-07T09:05:55.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f32747700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0cf480 0x7f8f2c15d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f32747700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f2c15d760 0x7f8f2c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f32747700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0b10f0 con 0x7f8f2c1595d0 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f32747700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c15db80 con 0x7f8f2c0cf480 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f32747700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c15e000 con 0x7f8f2c15d760 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f30f44700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0cf480 0x7f8f2c15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f30f44700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0cf480 0x7f8f2c15d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49640/0 (socket says 172.21.15.46:49640) 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f30f44700 1 -- 172.21.15.46:0/2266591885 learned_addr learned my addr 172.21.15.46:0/2266591885 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.794+0000 7f8f31f46700 1 --2- 172.21.15.46:0/2266591885 >> v2:172.21.15.133:3300/0 conn(0x7f8f2c15d760 0x7f8f2c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f30f44700 1 -- 172.21.15.46:0/2266591885 >> v2:172.21.15.133:3300/0 conn(0x7f8f2c15d760 msgr2=0x7f8f2c0b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f30f44700 1 --2- 172.21.15.46:0/2266591885 >> v2:172.21.15.133:3300/0 conn(0x7f8f2c15d760 0x7f8f2c0b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f30f44700 1 -- 172.21.15.46:0/2266591885 >> v1:172.21.15.133:6789/0 conn(0x7f8f2c1595d0 legacy=0x7f8f2c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f30f44700 1 -- 172.21.15.46:0/2266591885 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0cf990 con 0x7f8f2c0cf480 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f30f44700 1 --2- 172.21.15.46:0/2266591885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c15d220 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b3110 tx=0x7f8f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff349a89304ce029 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f2bfff700 1 -- 172.21.15.46:0/2266591885 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000b860 con 0x7f8f2c0cf480 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f2bfff700 1 -- 172.21.15.46:0/2266591885 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000b9c0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f2bfff700 1 -- 172.21.15.46:0/2266591885 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000bd60 con 0x7f8f2c0cf480 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f32747700 1 -- 172.21.15.46:0/2266591885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 msgr2=0x7f8f2c15d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.795+0000 7f8f32747700 1 --2- 172.21.15.46:0/2266591885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c15d220 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b3110 tx=0x7f8f20009250 comp rx=0 tx=0).stop 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 -- 172.21.15.46:0/2266591885 shutdown_connections 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 --2- 172.21.15.46:0/2266591885 >> v2:172.21.15.133:3300/0 conn(0x7f8f2c15d760 0x7f8f2c0b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 --2- 172.21.15.46:0/2266591885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c15d220 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 -- 172.21.15.46:0/2266591885 >> 172.21.15.46:0/2266591885 conn(0x7f8f2c0d05f0 msgr2=0x7f8f2c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 -- 172.21.15.46:0/2266591885 shutdown_connections 2023-10-07T09:05:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.796+0000 7f8f32747700 1 -- 172.21.15.46:0/2266591885 wait complete. 2023-10-07T09:05:55.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.797+0000 7f8f32747700 1 Processor -- start 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.797+0000 7f8f32747700 1 -- start start 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f2c1595d0 0x7f8f2c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c15d760 0x7f8f2c158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14ddf0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14ec10 con 0x7f8f2c15d760 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14e000 con 0x7f8f2c1595d0 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49646/0 (socket says 172.21.15.46:49646) 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 -- 172.21.15.46:0/3232457080 learned_addr learned my addr 172.21.15.46:0/3232457080 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 -- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f2c1595d0 msgr2=0x7f8f2c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f2c1595d0 0x7f8f2c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 -- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c15d760 msgr2=0x7f8f2c158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c15d760 0x7f8f2c158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 -- 172.21.15.46:0/3232457080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200094f0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f31745700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00cdb0 tx=0x7f8f1c001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00ab70 con 0x7f8f2c0cf480 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00acf0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c14e2e0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c012670 con 0x7f8f2c0cf480 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.798+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c14e8a0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.799+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c04c3c0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.800+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f1c012a20 con 0x7f8f2c0cf480 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.800+0000 7f8f297fa700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.800+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f1c0854f0 con 0x7f8f2c0cf480 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.800+0000 7f8f30f44700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:55.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.801+0000 7f8f30f44700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 0x7f8f180697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b3110 tx=0x7f8f20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:55.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:55.805+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f1c052140 con 0x7f8f2c0cf480 2023-10-07T09:05:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.077+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8f2c0cf260 con 0x7f8f2c0cf480 2023-10-07T09:05:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.081+0000 7f8f297fa700 1 -- 172.21.15.46:0/3232457080 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8f1c00ae60 con 0x7f8f2c0cf480 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 msgr2=0x7f8f180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 0x7f8f180697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b3110 tx=0x7f8f20017000 comp rx=0 tx=0).stop 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 msgr2=0x7f8f2c16d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00cdb0 tx=0x7f8f1c001be0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 shutdown_connections 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c15d760 0x7f8f2c158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0cf480 0x7f8f2c16d770 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 --2- 172.21.15.46:0/3232457080 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f2c1595d0 0x7f8f2c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 >> 172.21.15.46:0/3232457080 conn(0x7f8f2c0d05f0 msgr2=0x7f8f2c069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 shutdown_connections 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.083+0000 7f8f32747700 1 -- 172.21.15.46:0/3232457080 wait complete. 2023-10-07T09:05:56.085 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:05:56.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:05:56.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 Processor -- start 2023-10-07T09:05:56.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 -- start start 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a30159c60 0x7f5a3015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3015a160 con 0x7f5a3015db10 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300d13a0 con 0x7f5a30159890 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.215+0000 7f5a36257700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3015df50 con 0x7f5a30159c60 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5a3015db10 0x7f5a30069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46244/0 (socket says 172.21.15.46:46244) 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2ffff700 1 -- 172.21.15.46:0/3728963167 learned_addr learned my addr 172.21.15.46:0/3728963167 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2effd700 1 --2- 172.21.15.46:0/3728963167 >> v2:172.21.15.46:3300/0 conn(0x7f5a30159c60 0x7f5a3015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:56.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2e7fc700 1 -- 172.21.15.46:0/3728963167 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618358723 0 0) 0x7f5a3015a160 con 0x7f5a3015db10 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2e7fc700 1 -- 172.21.15.46:0/3728963167 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a18003570 con 0x7f5a3015db10 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2effd700 1 -- 172.21.15.46:0/3728963167 >> v1:172.21.15.133:6789/0 conn(0x7f5a30159890 legacy=0x7f5a3015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2effd700 1 -- 172.21.15.46:0/3728963167 >> v1:172.21.15.46:6789/0 conn(0x7f5a3015db10 legacy=0x7f5a30069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2effd700 1 -- 172.21.15.46:0/3728963167 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3015e140 con 0x7f5a30159c60 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2effd700 1 --2- 172.21.15.46:0/3728963167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a3015d5d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5a240098e0 tx=0x7f5a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360a3b765b638e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2e7fc700 1 -- 172.21.15.46:0/3728963167 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24011630 con 0x7f5a30159c60 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2e7fc700 1 -- 172.21.15.46:0/3728963167 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24011790 con 0x7f5a30159c60 2023-10-07T09:05:56.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.216+0000 7f5a2e7fc700 1 -- 172.21.15.46:0/3728963167 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24011b30 con 0x7f5a30159c60 2023-10-07T09:05:56.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 -- 172.21.15.46:0/3728963167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 msgr2=0x7f5a3015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 --2- 172.21.15.46:0/3728963167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a3015d5d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5a240098e0 tx=0x7f5a240091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 -- 172.21.15.46:0/3728963167 shutdown_connections 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 --2- 172.21.15.46:0/3728963167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a3015d5d0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 -- 172.21.15.46:0/3728963167 >> 172.21.15.46:0/3728963167 conn(0x7f5a30068e20 msgr2=0x7f5a300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 -- 172.21.15.46:0/3728963167 shutdown_connections 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.217+0000 7f5a36257700 1 -- 172.21.15.46:0/3728963167 wait complete. 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.218+0000 7f5a36257700 1 Processor -- start 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.218+0000 7f5a36257700 1 -- start start 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 0x7f5a30149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3015db10 0x7f5a300b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:56.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b4200 con 0x7f5a30159c60 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b3630 con 0x7f5a30159890 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a36257700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b38d0 con 0x7f5a3015db10 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49662/0 (socket says 172.21.15.46:49662) 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 -- 172.21.15.46:0/2024621712 learned_addr learned my addr 172.21.15.46:0/2024621712 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2ffff700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3015db10 0x7f5a300b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2f7fe700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 0x7f5a30149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 -- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3015db10 msgr2=0x7f5a300b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3015db10 0x7f5a300b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 -- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 msgr2=0x7f5a30149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 0x7f5a30149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 -- 172.21.15.46:0/2024621712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24009420 con 0x7f5a30159c60 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2f7fe700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 0x7f5a30149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.219+0000 7f5a2effd700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5a240030c0 tx=0x7f5a24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.220+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24000d10 con 0x7f5a30159c60 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.220+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24020070 con 0x7f5a30159c60 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.220+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300b3bb0 con 0x7f5a30159c60 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.220+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240276d0 con 0x7f5a30159c60 2023-10-07T09:05:56.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.220+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300b4690 con 0x7f5a30159c60 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.221+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004c3c0 con 0x7f5a30159c60 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.221+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5a24027b00 con 0x7f5a30159c60 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.221+0000 7f5a177fe700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 0x7f5a1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.222+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a24022070 con 0x7f5a30159c60 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.222+0000 7f5a2f7fe700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 0x7f5a1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:56.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.222+0000 7f5a2f7fe700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 0x7f5a1c0697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:56.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.226+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a24053a10 con 0x7f5a30159c60 2023-10-07T09:05:56.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.464+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a300b0120 con 0x7f5a30159c60 2023-10-07T09:05:56.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.464+0000 7f5a177fe700 1 -- 172.21.15.46:0/2024621712 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f5a24057030 con 0x7f5a30159c60 2023-10-07T09:05:56.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:05:56.465 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:05:53.938702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:05:56.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 msgr2=0x7f5a1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 0x7f5a1c0697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20009040 comp rx=0 tx=0).stop 2023-10-07T09:05:56.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 msgr2=0x7f5a300b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:56.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5a240030c0 tx=0x7f5a24016000 comp rx=0 tx=0).stop 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 shutdown_connections 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5a1c067320 0x7f5a1c0697d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a3015db10 0x7f5a300b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a30159890 0x7f5a30149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 --2- 172.21.15.46:0/2024621712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a30159c60 0x7f5a300b1590 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 >> 172.21.15.46:0/2024621712 conn(0x7f5a30068e20 msgr2=0x7f5a300cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 shutdown_connections 2023-10-07T09:05:56.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:56.466+0000 7f5a36257700 1 -- 172.21.15.46:0/2024621712 wait complete. 2023-10-07T09:05:56.469 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 92 2023-10-07T09:05:56.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:05:50.084540+0000', 'modified': '2023-10-07T09:05:53.938702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7542}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7542': {'gid': 7542, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6834/3882508029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 3882508029}, {'type': 'v1', 'addr': '172.21.15.46:6834', 'nonce': 3882508029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:05:56.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:05:56.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T09:05:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.007+0000 7f2aefdde700 1 Processor -- start 2023-10-07T09:05:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.007+0000 7f2aefdde700 1 -- start start 2023-10-07T09:05:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aefdde700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ae8159890 0x7f2ae815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aefdde700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae815a160 con 0x7f2ae8159c60 2023-10-07T09:05:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aefdde700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae80d13a0 con 0x7f2ae8069560 2023-10-07T09:05:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aefdde700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae815e140 con 0x7f2ae8159890 2023-10-07T09:05:57.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aed379700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2ae8159c60 0x7f2ae815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46252/0 (socket says 172.21.15.46:46252) 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aed379700 1 -- 172.21.15.46:0/1776279262 learned_addr learned my addr 172.21.15.46:0/1776279262 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/1776279262 >> v2:172.21.15.133:3300/0 conn(0x7f2ae8159890 0x7f2ae815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.008+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992973713 0 0) 0x7f2ae815a160 con 0x7f2ae8159c60 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad0003570 con 0x7f2ae8159c60 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788770983 0 0) 0x7f2ad0003570 con 0x7f2ae8159c60 2023-10-07T09:05:57.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 >> v2:172.21.15.133:3300/0 conn(0x7f2ae8159890 msgr2=0x7f2ae815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 --2- 172.21.15.46:0/1776279262 >> v2:172.21.15.133:3300/0 conn(0x7f2ae8159890 0x7f2ae815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 >> v1:172.21.15.133:6789/0 conn(0x7f2ae8069560 legacy=0x7f2ae80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae815a3d0 con 0x7f2ae8159c60 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f2adc001470 con 0x7f2ae8159c60 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 >> v1:172.21.15.46:6789/0 conn(0x7f2ae8159c60 legacy=0x7f2ae815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad0003a60 0x7f2ad0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad0004810 0x7f2ad0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 0x7f2ad000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae815e140 con 0x7f2ad00051c0 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad000c0d0 con 0x7f2ad0003a60 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad000c290 con 0x7f2ad0004810 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 0x7f2ad000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aed379700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad0004810 0x7f2ad0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad0003a60 0x7f2ad0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 -- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad0004810 msgr2=0x7f2ad0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad0004810 0x7f2ad0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 -- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad0003a60 msgr2=0x7f2ad0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad0003a60 0x7f2ad0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 -- 172.21.15.46:0/1776279262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0003570 con 0x7f2ad00051c0 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aed379700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad0004810 0x7f2ad0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad0003a60 0x7f2ad0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 -- 172.21.15.46:0/1776279262 reap_dead start 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.009+0000 7f2aee37b700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 0x7f2ad000ba60 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00018b0 tx=0x7f2ae0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6a8447d87dd2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0012420 con 0x7f2ad00051c0 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00125a0 con 0x7f2ad00051c0 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aecb78700 1 -- 172.21.15.46:0/1776279262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0012960 con 0x7f2ad00051c0 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 -- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 msgr2=0x7f2ad000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 0x7f2ad000ba60 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00018b0 tx=0x7f2ae0007d30 comp rx=0 tx=0).stop 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 -- 172.21.15.46:0/1776279262 shutdown_connections 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 --2- 172.21.15.46:0/1776279262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ad00051c0 0x7f2ad000ba60 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 -- 172.21.15.46:0/1776279262 >> 172.21.15.46:0/1776279262 conn(0x7f2ae8068e20 msgr2=0x7f2ae80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 -- 172.21.15.46:0/1776279262 shutdown_connections 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.010+0000 7f2aefdde700 1 -- 172.21.15.46:0/1776279262 wait complete. 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.011+0000 7f2aefdde700 1 Processor -- start 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.011+0000 7f2aefdde700 1 -- start start 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 0x7f2ae80cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ae80b5f80 0x7f2ae8151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80cfdb0 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80c7cb0 con 0x7f2ad00051c0 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aefdde700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81522b0 con 0x7f2ae80b5f80 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aee37b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aee37b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49682/0 (socket says 172.21.15.46:49682) 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aee37b700 1 -- 172.21.15.46:0/631014951 learned_addr learned my addr 172.21.15.46:0/631014951 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aed379700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ae80b5f80 0x7f2ae8151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.012+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 0x7f2ae80cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 -- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ae80b5f80 msgr2=0x7f2ae8151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ae80b5f80 0x7f2ae8151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 -- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 msgr2=0x7f2ae80cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 0x7f2ae80cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 -- 172.21.15.46:0/631014951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80b63f0 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 0x7f2ae80cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aee37b700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000c3f0 tx=0x7f2ae0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2ae5ffb700 1 -- 172.21.15.46:0/631014951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0012420 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2ae5ffb700 1 -- 172.21.15.46:0/631014951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0001200 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae80ce790 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2ae5ffb700 1 -- 172.21.15.46:0/631014951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000cdd0 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.013+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae80ce4b0 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.015+0000 7f2ae5ffb700 1 -- 172.21.15.46:0/631014951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2ae0019070 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.015+0000 7f2ae5ffb700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.015+0000 7f2ae5ffb700 1 -- 172.21.15.46:0/631014951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ae0085f30 con 0x7f2ae80cf3f0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.015+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.016+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 0x7f2ad40697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009fd0 tx=0x7f2ad800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.017+0000 7f2af90d6b80 1 Processor -- start 2023-10-07T09:05:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.017+0000 7f2af90d6b80 1 -- start start 2023-10-07T09:05:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x5556412ada20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412adf60 0x555641280cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556411dba70 con 0x555641284a50 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556411d9270 con 0x5556412adf60 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556411d5060 con 0x5556412ced00 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49686/0 (socket says 172.21.15.46:49686) 2023-10-07T09:05:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 -- 172.21.15.46:0/9594138 learned_addr learned my addr 172.21.15.46:0/9594138 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aed379700 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x5556412ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aee37b700 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412adf60 0x555641280cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 -- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 msgr2=0x5556412ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x5556412ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 -- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412adf60 msgr2=0x555641280cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412adf60 0x555641280cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 -- 172.21.15.46:0/9594138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55564106f270 con 0x555641284a50 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8018840 tx=0x7f2ad8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8713318c5de94c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aceffd700 1 -- 172.21.15.46:0/9594138 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8027070 con 0x555641284a50 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aceffd700 1 -- 172.21.15.46:0/9594138 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad801c070 con 0x555641284a50 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.018+0000 7f2aceffd700 1 -- 172.21.15.46:0/9594138 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800e040 con 0x555641284a50 2023-10-07T09:05:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 -- 172.21.15.46:0/9594138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 msgr2=0x555641284e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8018840 tx=0x7f2ad8019000 comp rx=0 tx=0).stop 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 -- 172.21.15.46:0/9594138 shutdown_connections 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412adf60 0x555641280cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641284e20 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/9594138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x5556412ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 -- 172.21.15.46:0/9594138 >> 172.21.15.46:0/9594138 conn(0x555641286370 msgr2=0x555641286740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 -- 172.21.15.46:0/9594138 shutdown_connections 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.019+0000 7f2af90d6b80 1 -- 172.21.15.46:0/9594138 wait complete. 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.020+0000 7f2af90d6b80 1 -- start start 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.020+0000 7f2af90d6b80 1 Processor -- start 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.020+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.020+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555641180890 con 0x5556412ced00 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564119bea0 con 0x555641284a50 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x555641057e30 con 0x5556412adf60 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 10 client.0 _ll_register_callbacks cb 0x555641248110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49700/0 (socket says 172.21.15.46:49700) 2023-10-07T09:05:57.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 -- 172.21.15.46:0/479883082 learned_addr learned my addr 172.21.15.46:0/479883082 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aed379700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 -- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 msgr2=0x5556412c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 -- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 msgr2=0x5556412b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 -- 172.21.15.46:0/479883082 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad8018470 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2aee37b700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0056810 tx=0x7f2ae0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6db6a2fa2f05aa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2ac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae006b070 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ae0056880 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555641279b70 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ae0059ad0 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 10 client.7698 fetch_fsmap learned FSMap version 92 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.021+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x555641011fe0 con 0x5556412ced00 2023-10-07T09:05:57.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0082080 con 0x5556412ced00 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2ae0055d70 con 0x5556412ced00 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 10 client.7698 fetch_fsmap finished waiting for FSMap version 92 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 10 client.7698 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 20 client.7698 populate_metadata read hostname 'smithi046' 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412a99b0 0x5556412a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 4 client.7698 mds_command: new command op to 7542 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:05:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 --> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555641256aa0 con 0x5556412a99b0 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412a99b0 0x5556412a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2ac7fff700 10 client.7698 ms_handle_connect on v2:172.21.15.46:6832/3882508029 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.022+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412a99b0 0x5556412a9d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa81675aa15423c server_cookie=fe411661cd487544 in_seq=0 out_seq=0 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2ac7fff700 1 -- 172.21.15.46:0/479883082 <== mds.0 v2:172.21.15.46:6832/3882508029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555641256aa0 con 0x5556412a99b0 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2ac7fff700 10 client.7698 handle_command_reply: tid=0 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 client.7698 shutdown 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 msgr2=0x5556412ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0056810 tx=0x7f2ae0009040 comp rx=0 tx=0).stop 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 shutdown_connections 2023-10-07T09:05:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412a99b0 0x5556412a9d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412ced00 0x5556412ce120 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2ac7fff700 0 client.7698 ms_handle_reset on v2:172.21.15.46:6832/3882508029 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/479883082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 >> 172.21.15.46:0/479883082 conn(0x555641286370 msgr2=0x555641281780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 shutdown_connections 2023-10-07T09:05:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 1 -- 172.21.15.46:0/479883082 wait complete. 2023-10-07T09:05:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.023+0000 7f2af90d6b80 20 client.7698 trim_cache size 0 max 16384 2023-10-07T09:05:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.040+0000 7f2af90d6b80 1 Processor -- start 2023-10-07T09:05:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.040+0000 7f2af90d6b80 1 -- start start 2023-10-07T09:05:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x555641281640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556412c4550 con 0x5556412adf60 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556412b4e20 con 0x555641284a50 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556412ceb50 con 0x5556412ced00 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49716/0 (socket says 172.21.15.46:49716) 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 -- 172.21.15.46:0/2602924217 learned_addr learned my addr 172.21.15.46:0/2602924217 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aee37b700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x555641281640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 -- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 msgr2=0x555641281640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x555641281640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 -- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 msgr2=0x5556412c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aed379700 1 -- 172.21.15.46:0/2602924217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556412828b0 con 0x5556412adf60 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.041+0000 7f2aee37b700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x555641281640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2aed379700 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2adc005c80 tx=0x7f2adc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6aa4891d08bcc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2acf7fe700 1 -- 172.21.15.46:0/2602924217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0169b0 con 0x5556412adf60 2023-10-07T09:05:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2acf7fe700 1 -- 172.21.15.46:0/2602924217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc010040 con 0x5556412adf60 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2acf7fe700 1 -- 172.21.15.46:0/2602924217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc016d20 con 0x5556412adf60 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2602924217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 msgr2=0x5556412c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2adc005c80 tx=0x7f2adc009040 comp rx=0 tx=0).stop 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2602924217 shutdown_connections 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412ced00 0x555641281640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555641284a50 0x5556412c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2602924217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5556412adf60 0x5556412c6dc0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2602924217 >> 172.21.15.46:0/2602924217 conn(0x555641286370 msgr2=0x555641285070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2602924217 shutdown_connections 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.042+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2602924217 wait complete. 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.043+0000 7f2af90d6b80 1 -- start start 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.043+0000 7f2af90d6b80 1 Processor -- start 2023-10-07T09:05:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412ced00 0x5556413307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555641331580 con 0x555641284a50 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556412cd7d0 con 0x5556412ced00 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556412b17a0 con 0x5556412adf60 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2af90d6b80 10 client.0 _ll_register_callbacks cb 0x555641248110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:05:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49728/0 (socket says 172.21.15.46:49728) 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 -- 172.21.15.46:0/2335861461 learned_addr learned my addr 172.21.15.46:0/2335861461 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 -- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 msgr2=0x5556412cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 -- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412ced00 msgr2=0x5556413307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412ced00 0x5556413307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 -- 172.21.15.46:0/2335861461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae815a3d0 con 0x555641284a50 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2aedb7a700 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2ad801a010 tx=0x7f2ad8035250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6227ec77cd8d2df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2ac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.044+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8033050 con 0x555641284a50 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ad8038460 con 0x555641284a50 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ad801c070 con 0x555641284a50 2023-10-07T09:05:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad800e040 con 0x555641284a50 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 10 client.7704 fetch_fsmap learned FSMap version 92 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x5556411a3780 con 0x555641284a50 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad801c070 con 0x555641284a50 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2ad8038830 con 0x555641284a50 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 10 client.7704 fetch_fsmap finished waiting for FSMap version 92 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 10 client.7704 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T09:05:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 20 client.7704 populate_metadata read hostname 'smithi046' 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412c47e0 0x5556412c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 4 client.7704 mds_command: new command op to 7542 tid=0[{"prefix": "status"}] 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 --> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555641177e00 con 0x5556412c47e0 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2aed379700 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412c47e0 0x5556412c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2ac7fff700 10 client.7704 ms_handle_connect on v2:172.21.15.46:6832/3882508029 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.045+0000 7f2aed379700 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412c47e0 0x5556412c4bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffc46efb73c758f server_cookie=d453b0e833bb86fe in_seq=0 out_seq=0 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2ac7fff700 1 -- 172.21.15.46:0/2335861461 <== mds.0 v2:172.21.15.46:6832/3882508029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x555641177e00 con 0x5556412c47e0 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2ac7fff700 10 client.7704 handle_command_reply: tid=0 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 client.7704 shutdown 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 msgr2=0x555641319a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2ad801a010 tx=0x7f2ad8035250 comp rx=0 tx=0).stop 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 shutdown_connections 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:6832/3882508029,v1:172.21.15.46:6834/3882508029] conn(0x5556412c47e0 0x5556412c4bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556412ced00 0x5556413307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555641284a50 0x555641319a50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 --2- 172.21.15.46:0/2335861461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5556412adf60 0x5556412cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2ac7fff700 0 client.7704 ms_handle_reset on v2:172.21.15.46:6832/3882508029 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 >> 172.21.15.46:0/2335861461 conn(0x555641286370 msgr2=0x555641281540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 shutdown_connections 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 1 -- 172.21.15.46:0/2335861461 wait complete. 2023-10-07T09:05:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.046+0000 7f2af90d6b80 20 client.7704 trim_cache size 0 max 16384 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 7542, 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 6.114293151, 2023-10-07T09:05:57.063 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 92, 2023-10-07T09:05:57.064 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 138, 2023-10-07T09:05:57.064 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 138, 2023-10-07T09:05:57.064 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 12.533125813 2023-10-07T09:05:57.064 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:05:57.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 msgr2=0x7f2ad40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 0x7f2ad40697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009fd0 tx=0x7f2ad800b040 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 msgr2=0x7f2ae80cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000c3f0 tx=0x7f2ae0015000 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 shutdown_connections 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ae80cf3f0 0x7f2ae80cf870 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00051c0 0x7f2ae80cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 --2- 172.21.15.46:0/631014951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ae80b5f80 0x7f2ae8151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 >> 172.21.15.46:0/631014951 conn(0x7f2ae8068e20 msgr2=0x7f2ae8152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 shutdown_connections 2023-10-07T09:05:57.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.047+0000 7f2aefdde700 1 -- 172.21.15.46:0/631014951 wait complete. 2023-10-07T09:05:57.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:05:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.186+0000 7fa7ed385700 1 Processor -- start 2023-10-07T09:05:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.186+0000 7fa7ed385700 1 -- start start 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7ed385700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7e8159c60 0x7fa7e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7ed385700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e815a160 con 0x7fa7e8159890 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7ed385700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80d13a0 con 0x7fa7e815db10 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7ed385700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e815df50 con 0x7fa7e8159c60 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7e6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7e8159890 0x7fa7e815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46254/0 (socket says 172.21.15.46:46254) 2023-10-07T09:05:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7e6ffd700 1 -- 172.21.15.46:0/1243493350 learned_addr learned my addr 172.21.15.46:0/1243493350 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/1243493350 >> v2:172.21.15.133:3300/0 conn(0x7fa7e8159c60 0x7fa7e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.187+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275126013 0 0) 0x7fa7e815a160 con 0x7fa7e8159890 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d4003570 con 0x7fa7e8159890 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349096487 0 0) 0x7fa7e80d13a0 con 0x7fa7e815db10 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e815a160 con 0x7fa7e815db10 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e67fc700 1 -- 172.21.15.46:0/1243493350 >> v1:172.21.15.133:6789/0 conn(0x7fa7e815db10 legacy=0x7fa7e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e67fc700 1 -- 172.21.15.46:0/1243493350 >> v1:172.21.15.46:6789/0 conn(0x7fa7e8159890 legacy=0x7fa7e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1861815166 0 0) 0x7fa7d4003570 con 0x7fa7e8159890 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e67fc700 1 -- 172.21.15.46:0/1243493350 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e815e140 con 0x7fa7e8159c60 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/1243493350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e8159c60 0x7fa7e815d5d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00098e0 tx=0x7fa7d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc23be8cecdaae0e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0011630 con 0x7fa7e8159c60 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0011790 con 0x7fa7e8159c60 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.188+0000 7fa7e5ffb700 1 -- 172.21.15.46:0/1243493350 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0011b30 con 0x7fa7e8159c60 2023-10-07T09:05:57.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 -- 172.21.15.46:0/1243493350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e8159c60 msgr2=0x7fa7e815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 --2- 172.21.15.46:0/1243493350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e8159c60 0x7fa7e815d5d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00098e0 tx=0x7fa7d00091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 -- 172.21.15.46:0/1243493350 shutdown_connections 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 --2- 172.21.15.46:0/1243493350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e8159c60 0x7fa7e815d5d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 -- 172.21.15.46:0/1243493350 >> 172.21.15.46:0/1243493350 conn(0x7fa7e8068e20 msgr2=0x7fa7e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 -- 172.21.15.46:0/1243493350 shutdown_connections 2023-10-07T09:05:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.189+0000 7fa7ed385700 1 -- 172.21.15.46:0/1243493350 wait complete. 2023-10-07T09:05:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.190+0000 7fa7ed385700 1 Processor -- start 2023-10-07T09:05:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.190+0000 7fa7ed385700 1 -- start start 2023-10-07T09:05:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 0x7fa7e80cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 0x7fa7e81491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c78a0 con 0x7fa7e8159890 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80ce050 con 0x7fa7e815db10 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c7af0 con 0x7fa7e8159c60 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49742/0 (socket says 172.21.15.46:49742) 2023-10-07T09:05:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 -- 172.21.15.46:0/3379459209 learned_addr learned my addr 172.21.15.46:0/3379459209 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 0x7fa7e80cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e77fe700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 0x7fa7e81491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 -- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 msgr2=0x7fa7e80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 0x7fa7e80cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 -- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 msgr2=0x7fa7e81491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 0x7fa7e81491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 -- 172.21.15.46:0/3379459209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0009420 con 0x7fa7e8159890 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 0x7fa7e80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e77fe700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 0x7fa7e81491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7e6ffd700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c7f0 tx=0x7fa7e0007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0007360 con 0x7fa7e8159890 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0007500 con 0x7fa7e8159890 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80c7dd0 con 0x7fa7e8159890 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.191+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0004a80 con 0x7fa7e8159890 2023-10-07T09:05:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.192+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80c8390 con 0x7fa7e8159890 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.192+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e804c3c0 con 0x7fa7e8159890 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.193+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7e001c3b0 con 0x7fa7e8159890 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.193+0000 7fa7deffd700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 0x7fa7c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.193+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7e0084120 con 0x7fa7e8159890 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.193+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 0x7fa7c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.194+0000 7fa7e67fc700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 0x7fa7c80697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa7e815bde0 tx=0x7fa7d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.198+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7e004c5a0 con 0x7fa7e8159890 2023-10-07T09:05:57.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.439+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7e806a5b0 con 0x7fa7e8159890 2023-10-07T09:05:57.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.439+0000 7fa7deffd700 1 -- 172.21.15.46:0/3379459209 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa7e0054970 con 0x7fa7e8159890 2023-10-07T09:05:57.440 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 msgr2=0x7fa7c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 0x7fa7c80697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa7e815bde0 tx=0x7fa7d0017000 comp rx=0 tx=0).stop 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 msgr2=0x7fa7e8157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c7f0 tx=0x7fa7e0007b90 comp rx=0 tx=0).stop 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 shutdown_connections 2023-10-07T09:05:57.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7c8067320 0x7fa7c80697d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e815db10 0x7fa7e81491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e8159890 0x7fa7e8157600 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 --2- 172.21.15.46:0/3379459209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7e8159c60 0x7fa7e80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 >> 172.21.15.46:0/3379459209 conn(0x7fa7e8068e20 msgr2=0x7fa7e8155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 shutdown_connections 2023-10-07T09:05:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:57.441+0000 7fa7ed385700 1 -- 172.21.15.46:0/3379459209 wait complete. 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:05:57.454 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:57.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.455 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:05:57.471 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:05:57.471 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:05:57.471 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:05:57.471 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.471 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:57.472 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:05:57.473 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:57.474 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:57.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.475 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:05:57.535 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:05:57.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.537 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:05:57.593 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:05:57.593 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:05:57.593 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:05:57.593 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:05:57.593 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:05:57.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.594 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:05:57.594 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:05:57.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:05:57.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:05:57.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:05:57.595 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:05:57.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.696 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:05:57.711 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:05:57.711 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:05:57.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:57.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:57.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:05:57.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:57.777 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:57.833 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:05:57.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:57.833 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:57.888 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:05:57.888 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:05:57.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:57.970 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:57.970 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:57.990 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:05:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:05:58.013 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:05:58.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:05:58.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:05:58.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.237+0000 7f597111b700 1 Processor -- start 2023-10-07T09:05:58.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.237+0000 7f597111b700 1 -- start start 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f597111b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f596c0b1420 0x7f596c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f597111b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c0cc300 con 0x7f596c0ccf90 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f597111b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c0ad370 con 0x7f596c0cbf30 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f597111b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c156bf0 con 0x7f596c0b1420 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f596b59e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f596c0ccf90 0x7f596c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46268/0 (socket says 172.21.15.46:46268) 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.238+0000 7f596b59e700 1 -- 172.21.15.46:0/472164408 learned_addr learned my addr 172.21.15.46:0/472164408 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:58.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 --2- 172.21.15.46:0/472164408 >> v2:172.21.15.133:3300/0 conn(0x7f596c0b1420 0x7f596c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292504698 0 0) 0x7f596c0cc300 con 0x7f596c0ccf90 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5958003570 con 0x7f596c0ccf90 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674355238 0 0) 0x7f5958003570 con 0x7f596c0ccf90 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 >> v2:172.21.15.133:3300/0 conn(0x7f596c0b1420 msgr2=0x7f596c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 --2- 172.21.15.46:0/472164408 >> v2:172.21.15.133:3300/0 conn(0x7f596c0b1420 0x7f596c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 >> v1:172.21.15.133:6789/0 conn(0x7f596c0cbf30 legacy=0x7f596c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0ad650 con 0x7f596c0ccf90 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5964001470 con 0x7f596c0ccf90 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 >> v1:172.21.15.46:6789/0 conn(0x7f596c0ccf90 legacy=0x7f596c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5958003a60 0x7f5958003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 0x7f5958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580051c0 0x7f595800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c156bf0 con 0x7f5958004810 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595800c0d0 con 0x7f59580051c0 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595800c290 con 0x7f5958003a60 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 0x7f5958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596ad9d700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5958003a60 0x7f5958003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596b59e700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580051c0 0x7f595800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 -- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5958003a60 msgr2=0x7f5958003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5958003a60 0x7f5958003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 -- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580051c0 msgr2=0x7f595800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580051c0 0x7f595800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596a59c700 1 -- 172.21.15.46:0/472164408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958003570 con 0x7f5958004810 2023-10-07T09:05:58.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.239+0000 7f596b59e700 1 -- 172.21.15.46:0/472164408 reap_dead start 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f596a59c700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 0x7f5958004c80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f596c0aecd0 tx=0x7f59540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c933d56aaf348f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400e6e0 con 0x7f5958004810 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400e840 con 0x7f5958004810 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f5969d9b700 1 -- 172.21.15.46:0/472164408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400ec00 con 0x7f5958004810 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 -- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 msgr2=0x7f5958004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 0x7f5958004c80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f596c0aecd0 tx=0x7f59540091a0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 -- 172.21.15.46:0/472164408 shutdown_connections 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 --2- 172.21.15.46:0/472164408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5958004810 0x7f5958004c80 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 -- 172.21.15.46:0/472164408 >> 172.21.15.46:0/472164408 conn(0x7f596c06a320 msgr2=0x7f596c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 -- 172.21.15.46:0/472164408 shutdown_connections 2023-10-07T09:05:58.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.240+0000 7f597111b700 1 -- 172.21.15.46:0/472164408 wait complete. 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.242+0000 7f597111b700 1 Processor -- start 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.242+0000 7f597111b700 1 -- start start 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958004810 0x7f596c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f596c16b0b0 0x7f596c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0c5770 con 0x7f596c169e80 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c16a4c0 con 0x7f5958004810 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c16a7a0 con 0x7f596c16b0b0 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49762/0 (socket says 172.21.15.46:49762) 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 -- 172.21.15.46:0/648083287 learned_addr learned my addr 172.21.15.46:0/648083287 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596ad9d700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958004810 0x7f596c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596b59e700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f596c16b0b0 0x7f596c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 -- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f596c16b0b0 msgr2=0x7f596c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f596c16b0b0 0x7f596c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 -- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958004810 msgr2=0x7f596c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958004810 0x7f596c0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 -- 172.21.15.46:0/648083287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c16aa80 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f596a59c700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f595800c0a0 tx=0x7f595401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954022070 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400e9b0 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c16ad60 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595401c450 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.243+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c0c8050 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.244+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c064d80 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.245+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f595401c8a0 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.245+0000 7f5962ffd700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 0x7f594c0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.245+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5954086480 con 0x7f596c169e80 2023-10-07T09:05:58.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.245+0000 7f596ad9d700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 0x7f594c0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:58.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.246+0000 7f596ad9d700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 0x7f594c0697c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f596c15a820 tx=0x7f595c001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:58.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.249+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5954053110 con 0x7f596c169e80 2023-10-07T09:05:58.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.488+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f596c04c3c0 con 0x7f596c169e80 2023-10-07T09:05:58.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.488+0000 7f5962ffd700 1 -- 172.21.15.46:0/648083287 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5954056730 con 0x7f596c169e80 2023-10-07T09:05:58.489 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:05:58.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 msgr2=0x7f594c0697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 0x7f594c0697c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f596c15a820 tx=0x7f595c001640 comp rx=0 tx=0).stop 2023-10-07T09:05:58.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 msgr2=0x7f596c14a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:58.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f595800c0a0 tx=0x7f595401a000 comp rx=0 tx=0).stop 2023-10-07T09:05:58.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 shutdown_connections 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f594c067310 0x7f594c0697c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f596c16b0b0 0x7f596c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958004810 0x7f596c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 --2- 172.21.15.46:0/648083287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596c169e80 0x7f596c14a110 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 >> 172.21.15.46:0/648083287 conn(0x7f596c06a320 msgr2=0x7f596c0cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 shutdown_connections 2023-10-07T09:05:58.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:58.490+0000 7f597111b700 1 -- 172.21.15.46:0/648083287 wait complete. 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:05:58.503 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:58.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.504 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:05:58.522 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:05:58.522 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:05:58.522 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:58.523 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42047sec preferred_lft 42047sec 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.524 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:05:58.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.525 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:05:58.590 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:05:58.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.591 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:05:58.650 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:05:58.650 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:05:58.650 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:05:58.650 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:05:58.650 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:05:58.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:05:58.651 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:05:58.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.756 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:05:58.771 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:05:58.771 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:05:58.771 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:58.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:58.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:05:58.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:58.837 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:58.892 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:05:58.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:05:58.893 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:58.947 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:05:58.948 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:05:58.948 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:59.028 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:59.029 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:59.047 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:59.047 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:59.047 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:59.047 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:59.047 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:59.048 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:59.048 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:59.048 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:59.069 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:05:59.069 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:05:59.069 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:05:59.069 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:05:59.069 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:05:59.070 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:05:59.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:05:59.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:05:59.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:05:59.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:05:59.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.265+0000 7f14b22ff700 1 Processor -- start 2023-10-07T09:05:59.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.265+0000 7f14b22ff700 1 -- start start 2023-10-07T09:05:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b22ff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f14ac0b55a0 0x7f14ac164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b22ff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0cfa60 con 0x7f14ac0cd910 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b22ff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0b5b00 con 0x7f14ac159ec0 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b22ff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0b5da0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14ab7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f14ac0cd910 0x7f14ac0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46270/0 (socket says 172.21.15.46:46270) 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14ab7fe700 1 -- 172.21.15.46:0/232983988 learned_addr learned my addr 172.21.15.46:0/232983988 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b089c700 1 --2- 172.21.15.46:0/232983988 >> v2:172.21.15.133:3300/0 conn(0x7f14ac0b55a0 0x7f14ac164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111534080 0 0) 0x7f14ac0cfa60 con 0x7f14ac0cd910 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1494003570 con 0x7f14ac0cd910 2023-10-07T09:05:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147480853 0 0) 0x7f14ac0b5b00 con 0x7f14ac159ec0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ac0cfa60 con 0x7f14ac159ec0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b089c700 1 -- 172.21.15.46:0/232983988 >> v1:172.21.15.133:6789/0 conn(0x7f14ac159ec0 legacy=0x7f14ac0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.266+0000 7f14b089c700 1 -- 172.21.15.46:0/232983988 >> v1:172.21.15.46:6789/0 conn(0x7f14ac0cd910 legacy=0x7f14ac0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b089c700 1 -- 172.21.15.46:0/232983988 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0b6080 con 0x7f14ac0b55a0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b089c700 1 --2- 172.21.15.46:0/232983988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac0b55a0 0x7f14ac164400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e90 tx=0x7f14a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d369ffec5aa4da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400e070 con 0x7f14ac0b55a0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400bb90 con 0x7f14ac0b55a0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14aaffd700 1 -- 172.21.15.46:0/232983988 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4012430 con 0x7f14ac0b55a0 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b22ff700 1 -- 172.21.15.46:0/232983988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac0b55a0 msgr2=0x7f14ac164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b22ff700 1 --2- 172.21.15.46:0/232983988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac0b55a0 0x7f14ac164400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e90 tx=0x7f14a4009780 comp rx=0 tx=0).stop 2023-10-07T09:05:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b22ff700 1 -- 172.21.15.46:0/232983988 shutdown_connections 2023-10-07T09:05:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b22ff700 1 --2- 172.21.15.46:0/232983988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac0b55a0 0x7f14ac164400 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.267+0000 7f14b22ff700 1 -- 172.21.15.46:0/232983988 >> 172.21.15.46:0/232983988 conn(0x7f14ac0999f0 msgr2=0x7f14ac0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.268+0000 7f14b22ff700 1 -- 172.21.15.46:0/232983988 shutdown_connections 2023-10-07T09:05:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.268+0000 7f14b22ff700 1 -- 172.21.15.46:0/232983988 wait complete. 2023-10-07T09:05:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.269+0000 7f14b22ff700 1 Processor -- start 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.269+0000 7f14b22ff700 1 -- start start 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.269+0000 7f14b22ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 0x7f14ac156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 0x7f14ac1421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac152700 con 0x7f14ac0b55a0 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac069450 con 0x7f14ac141d20 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0d1250 con 0x7f14ac159ec0 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49768/0 (socket says 172.21.15.46:49768) 2023-10-07T09:05:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 -- 172.21.15.46:0/1209931885 learned_addr learned my addr 172.21.15.46:0/1209931885 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 0x7f14ac156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b089c700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 0x7f14ac1421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 -- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 msgr2=0x7f14ac156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 0x7f14ac156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 -- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 msgr2=0x7f14ac1421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 0x7f14ac1421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 -- 172.21.15.46:0/1209931885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009a20 con 0x7f14ac0b55a0 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 0x7f14ac156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b089c700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 0x7f14ac1421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14abfff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c7c0 tx=0x7f14a0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011680 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac142700 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a00117e0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011ba0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.270+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac0690e0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.271+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac063c90 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.272+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f14a0012440 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.272+0000 7f1493fff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 0x7f14980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.272+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a0084c30 con 0x7f14ac0b55a0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.272+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 0x7f14980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:05:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.273+0000 7f14ab7fe700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 0x7f14980697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f149c0058d0 tx=0x7f149c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:05:59.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.277+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a00518c0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.514+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14ac0718b0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.958+0000 7f1493fff700 1 -- 172.21.15.46:0/1209931885 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 136+0+0 (secure 0 0 0) 0x7f14a0054ee0 con 0x7f14ac0b55a0 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.960+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 msgr2=0x7f14980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.960+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 0x7f14980697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f149c0058d0 tx=0x7f149c009040 comp rx=0 tx=0).stop 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.960+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 msgr2=0x7f14ac1521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.960+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c7c0 tx=0x7f14a0007e00 comp rx=0 tx=0).stop 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 shutdown_connections 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1498067320 0x7f14980697d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ac141d20 0x7f14ac1421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14ac0b55a0 0x7f14ac1521c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 --2- 172.21.15.46:0/1209931885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14ac159ec0 0x7f14ac156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:05:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 >> 172.21.15.46:0/1209931885 conn(0x7f14ac0999f0 msgr2=0x7f14ac0c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:05:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 shutdown_connections 2023-10-07T09:05:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:05:59.961+0000 7f14b22ff700 1 -- 172.21.15.46:0/1209931885 wait complete. 2023-10-07T09:05:59.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:06:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.094+0000 7f652d144700 1 Processor -- start 2023-10-07T09:06:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.094+0000 7f652d144700 1 -- start start 2023-10-07T09:06:00.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652d144700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652d144700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652d144700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65280b40f0 con 0x7f6528142ea0 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652d144700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652806c3a0 con 0x7f65280ad870 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652d144700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6528069640 con 0x7f652806bf20 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f65277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652c943700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652c943700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:37366/0 (socket says 172.21.15.46:37366) 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f65277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39098/0 (socket says 172.21.15.46:39098) 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f6527fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6528142ea0 0x7f65280b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:51704/0 (socket says 172.21.15.46:51704) 2023-10-07T09:06:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.095+0000 7f652c943700 1 -- 172.21.15.46:0/1461363633 learned_addr learned my addr 172.21.15.46:0/1461363633 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652c943700 1 -- 172.21.15.46:0/1461363633 >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 msgr2=0x7f652806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652c943700 1 --2- 172.21.15.46:0/1461363633 >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652c943700 1 -- 172.21.15.46:0/1461363633 >> v1:172.21.15.133:6789/0 conn(0x7f6528142ea0 legacy=0x7f65280b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f6526ffd700 1 -- 172.21.15.46:0/1461363633 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097826151 0 0) 0x7f65280b40f0 con 0x7f6528142ea0 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652c943700 1 -- 172.21.15.46:0/1461363633 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528069920 con 0x7f652806bf20 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f65277fe700 1 --2- 172.21.15.46:0/1461363633 >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652c943700 1 --2- 172.21.15.46:0/1461363633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6520009f20 tx=0x7f6520009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3f4fdf242fe991 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f6526ffd700 1 -- 172.21.15.46:0/1461363633 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000e070 con 0x7f652806bf20 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f6526ffd700 1 -- 172.21.15.46:0/1461363633 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652000b9d0 con 0x7f652806bf20 2023-10-07T09:06:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f6526ffd700 1 -- 172.21.15.46:0/1461363633 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200092e0 con 0x7f652806bf20 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652d144700 1 -- 172.21.15.46:0/1461363633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 msgr2=0x7f652806a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.096+0000 7f652d144700 1 --2- 172.21.15.46:0/1461363633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6520009f20 tx=0x7f6520009840 comp rx=0 tx=0).stop 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 -- 172.21.15.46:0/1461363633 shutdown_connections 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 --2- 172.21.15.46:0/1461363633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652806a120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 --2- 172.21.15.46:0/1461363633 >> v2:172.21.15.133:3300/0 conn(0x7f65280ad870 0x7f652806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 -- 172.21.15.46:0/1461363633 >> 172.21.15.46:0/1461363633 conn(0x7f65280ce430 msgr2=0x7f65280ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 -- 172.21.15.46:0/1461363633 shutdown_connections 2023-10-07T09:06:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.097+0000 7f652d144700 1 -- 172.21.15.46:0/1461363633 wait complete. 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.098+0000 7f652d144700 1 Processor -- start 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.098+0000 7f652d144700 1 -- start start 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652813cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 0x7f65280af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652813c7b0 con 0x7f6528142ea0 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652813d4c0 con 0x7f6528136a40 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65281591d0 con 0x7f652806bf20 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52688/0 (socket says 172.21.15.46:52688) 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 -- 172.21.15.46:0/527977425 learned_addr learned my addr 172.21.15.46:0/527977425 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652c943700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 0x7f65280af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f6527fff700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652813cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 -- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 msgr2=0x7f652813cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652813cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 -- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 msgr2=0x7f65280af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 0x7f65280af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 -- 172.21.15.46:0/527977425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518009420 con 0x7f6528142ea0 2023-10-07T09:06:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652c943700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 0x7f65280af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f65277fe700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f651800ec50 tx=0x7f65180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800c9d0 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800cb30 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520009ae0 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518013470 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.099+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652813dc60 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.100+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65280c7670 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.101+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f65180137e0 con 0x7f6528142ea0 2023-10-07T09:06:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.101+0000 7f651ffff700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 0x7f65080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.101+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6518085020 con 0x7f6528142ea0 2023-10-07T09:06:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.101+0000 7f6527fff700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 0x7f65080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.102+0000 7f6527fff700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 0x7f65080697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6510007fd0 tx=0x7f6510007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.105+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65280c7670 con 0x7f6528142ea0 2023-10-07T09:06:00.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.326+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f65280c7670 con 0x7f6508067320 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.328+0000 7f651ffff700 1 -- 172.21.15.46:0/527977425 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f65280c7670 con 0x7f6508067320 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:00.328 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 msgr2=0x7f65080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 0x7f65080697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6510007fd0 tx=0x7f6510007e10 comp rx=0 tx=0).stop 2023-10-07T09:06:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 msgr2=0x7f6528136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f651800ec50 tx=0x7f65180091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 shutdown_connections 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6508067320 0x7f65080697d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6528136a40 0x7f65280af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652806bf20 0x7f652813cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 --2- 172.21.15.46:0/527977425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6528142ea0 0x7f6528136500 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.329+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 >> 172.21.15.46:0/527977425 conn(0x7f65280ce430 msgr2=0x7f6528141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.330+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 shutdown_connections 2023-10-07T09:06:00.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.330+0000 7f652d144700 1 -- 172.21.15.46:0/527977425 wait complete. 2023-10-07T09:06:00.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:06:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.464+0000 7f01471fe700 1 Processor -- start 2023-10-07T09:06:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.464+0000 7f01471fe700 1 -- start start 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f01471fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f014006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f01471fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f01400c83c0 0x7f01400cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f01471fe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014006bdb0 con 0x7f0140069d60 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f01471fe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400cb370 con 0x7f01400c83c0 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f01471fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140159f60 con 0x7f01400aca80 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f01400c83c0 0x7f01400cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f013ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0140069d60 0x7f01400c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54534/0 (socket says 172.21.15.46:54534) 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f013ffff700 1 -- 172.21.15.46:0/1328867067 learned_addr learned my addr 172.21.15.46:0/1328867067 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f0144f9a700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f014006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 -- 172.21.15.46:0/1328867067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 msgr2=0x7f014006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f014006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 -- 172.21.15.46:0/1328867067 >> v1:172.21.15.46:6789/0 conn(0x7f0140069d60 legacy=0x7f01400c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 -- 172.21.15.46:0/1328867067 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014006b510 con 0x7f01400c83c0 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f013f7fe700 1 -- 172.21.15.46:0/1328867067 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927296079 0 0) 0x7f014006bdb0 con 0x7f0140069d60 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.465+0000 7f014579b700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400cb800 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f0138009e60 tx=0x7f0138009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d313686d720fa127 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f013f7fe700 1 -- 172.21.15.46:0/1328867067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800e070 con 0x7f01400c83c0 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f013f7fe700 1 -- 172.21.15.46:0/1328867067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800bc30 con 0x7f01400c83c0 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f013f7fe700 1 -- 172.21.15.46:0/1328867067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138012430 con 0x7f01400c83c0 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 -- 172.21.15.46:0/1328867067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 msgr2=0x7f01400cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400cb800 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f0138009e60 tx=0x7f0138009780 comp rx=0 tx=0).stop 2023-10-07T09:06:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 -- 172.21.15.46:0/1328867067 shutdown_connections 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400cb800 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 --2- 172.21.15.46:0/1328867067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f014006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 -- 172.21.15.46:0/1328867067 >> 172.21.15.46:0/1328867067 conn(0x7f01400cd670 msgr2=0x7f01400cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 -- 172.21.15.46:0/1328867067 shutdown_connections 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.466+0000 7f01471fe700 1 -- 172.21.15.46:0/1328867067 wait complete. 2023-10-07T09:06:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.467+0000 7f01471fe700 1 Processor -- start 2023-10-07T09:06:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 -- start start 2023-10-07T09:06:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140069d60 0x7f01400ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f0140157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400aeeb0 con 0x7f01400c83c0 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400ae0e0 con 0x7f0140069d60 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f01471fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400ad4d0 con 0x7f01400aca80 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f014579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f014579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52710/0 (socket says 172.21.15.46:52710) 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.468+0000 7f014579b700 1 -- 172.21.15.46:0/3101463151 learned_addr learned my addr 172.21.15.46:0/3101463151 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 -- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 msgr2=0x7f0140157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f0144f9a700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140069d60 0x7f01400ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f013ffff700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f0140157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f0140157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 -- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140069d60 msgr2=0x7f01400ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140069d60 0x7f01400ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 -- 172.21.15.46:0/3101463151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138009a20 con 0x7f01400c83c0 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f014579b700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f01380097c0 tx=0x7f0138019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138012e50 con 0x7f01400c83c0 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013801d630 con 0x7f01400c83c0 2023-10-07T09:06:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01400ad7b0 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013801d9f0 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.469+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400add70 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.470+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014004c3c0 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.470+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0138024070 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.471+0000 7f013cff9700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.471+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0138087590 con 0x7f01400c83c0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.471+0000 7f0144f9a700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.471+0000 7f0144f9a700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 0x7f012c0697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0130009970 tx=0x7f0130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.475+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0138054220 con 0x7f01400c83c0 2023-10-07T09:06:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.666+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f01400ae220 con 0x7f01400c83c0 2023-10-07T09:06:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.666+0000 7f013cff9700 1 -- 172.21.15.46:0/3101463151 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0138057840 con 0x7f01400c83c0 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.668+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 msgr2=0x7f012c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.668+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 0x7f012c0697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0130009970 tx=0x7f0130008040 comp rx=0 tx=0).stop 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.668+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 msgr2=0x7f01400c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.668+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f01380097c0 tx=0x7f0138019000 comp rx=0 tx=0).stop 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 shutdown_connections 2023-10-07T09:06:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01400c83c0 0x7f01400c3510 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140069d60 0x7f01400ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 --2- 172.21.15.46:0/3101463151 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01400aca80 0x7f0140157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 >> 172.21.15.46:0/3101463151 conn(0x7f01400cd670 msgr2=0x7f0140158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 shutdown_connections 2023-10-07T09:06:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:00.669+0000 7f01471fe700 1 -- 172.21.15.46:0/3101463151 wait complete. 2023-10-07T09:06:00.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:06:00.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:00.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:00.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:06:00.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:00.840 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:06:00.855 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:06:00.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:00.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:00.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:06:00.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:00.896 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:06:00.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:06:00.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:00.953 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T09:06:00.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:06:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-07T09:06:00.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:06:00.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:00.969 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T09:06:01.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:06:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-07T09:06:01.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000195165 --yes-i-really-mean-it 2023-10-07T09:06:01.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.133+0000 7f1f3c6bd700 1 Processor -- start 2023-10-07T09:06:01.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.133+0000 7f1f3c6bd700 1 -- start start 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3c6bd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f34159ec0 0x7f1f340b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3c6bd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340b5b00 con 0x7f1f340b53d0 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3c6bd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340b5850 con 0x7f1f340cf350 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3c6bd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f340b5da0 con 0x7f1f34159ec0 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3a459700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f34159ec0 0x7f1f340b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f39c58700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1f340b53d0 0x7f1f340cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54538/0 (socket says 172.21.15.46:54538) 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f39c58700 1 -- 172.21.15.46:0/1162040678 learned_addr learned my addr 172.21.15.46:0/1162040678 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3a459700 1 -- 172.21.15.46:0/1162040678 >> v1:172.21.15.133:6789/0 conn(0x7f1f340cf350 legacy=0x7f1f340cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3a459700 1 -- 172.21.15.46:0/1162040678 >> v1:172.21.15.46:6789/0 conn(0x7f1f340b53d0 legacy=0x7f1f340cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3a459700 1 -- 172.21.15.46:0/1162040678 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340b6080 con 0x7f1f34159ec0 2023-10-07T09:06:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f3a459700 1 --2- 172.21.15.46:0/1162040678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f34159ec0 0x7f1f340b4e90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009eb0 tx=0x7f1f24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e2e40eee4bfea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f39457700 1 -- 172.21.15.46:0/1162040678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400e070 con 0x7f1f34159ec0 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f39457700 1 -- 172.21.15.46:0/1162040678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400bc30 con 0x7f1f34159ec0 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.134+0000 7f1f39457700 1 -- 172.21.15.46:0/1162040678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24012430 con 0x7f1f34159ec0 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/1162040678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f34159ec0 msgr2=0x7f1f340b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/1162040678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f34159ec0 0x7f1f340b4e90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009eb0 tx=0x7f1f24009780 comp rx=0 tx=0).stop 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/1162040678 shutdown_connections 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/1162040678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f34159ec0 0x7f1f340b4e90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/1162040678 >> 172.21.15.46:0/1162040678 conn(0x7f1f340999f0 msgr2=0x7f1f340b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/1162040678 shutdown_connections 2023-10-07T09:06:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.135+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/1162040678 wait complete. 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.136+0000 7f1f3c6bd700 1 Processor -- start 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.136+0000 7f1f3c6bd700 1 -- start start 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f340b53d0 0x7f1f3416acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f34159ec0 0x7f1f34069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3415e300 con 0x7f1f340cf350 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3415ee80 con 0x7f1f340b53d0 2023-10-07T09:06:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3c6bd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3415c960 con 0x7f1f34159ec0 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52726/0 (socket says 172.21.15.46:52726) 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 -- 172.21.15.46:0/2534723011 learned_addr learned my addr 172.21.15.46:0/2534723011 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3a459700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f340b53d0 0x7f1f3416acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f3ac5a700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f34159ec0 0x7f1f34069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 -- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f34159ec0 msgr2=0x7f1f34069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f34159ec0 0x7f1f34069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 -- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f340b53d0 msgr2=0x7f1f3416acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f340b53d0 0x7f1f3416acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 -- 172.21.15.46:0/2534723011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009a20 con 0x7f1f340cf350 2023-10-07T09:06:01.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.137+0000 7f1f39c58700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c590 tx=0x7f1f28001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28005b30 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28005cb0 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3415e550 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28007320 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3415eb10 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.138+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3415eca0 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.139+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f2801b3b0 con 0x7f1f340cf350 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.139+0000 7f1f327fc700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 0x7f1f200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.139+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f280841b0 con 0x7f1f340cf350 2023-10-07T09:06:01.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.140+0000 7f1f3a459700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 0x7f1f200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:01.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.140+0000 7f1f3a459700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 0x7f1f200697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009eb0 tx=0x7f1f24017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:01.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.144+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f28050e00 con 0x7f1f340cf350 2023-10-07T09:06:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:01.366+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000195165", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1f3415efc0 con 0x7f1f20067320 2023-10-07T09:06:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.989+0000 7f1f327fc700 1 -- 172.21.15.46:0/2534723011 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f1f24012810 con 0x7f1f20067320 2023-10-07T09:06:03.990 INFO:teuthology.orchestra.run.smithi046.stdout:FS volume 'cephfs' renamed to 'volume_0000000000195165' 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 msgr2=0x7f1f200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 0x7f1f200697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009eb0 tx=0x7f1f24017000 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 msgr2=0x7f1f3415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c590 tx=0x7f1f28001020 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 shutdown_connections 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1f20067320 0x7f1f200697d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f34159ec0 0x7f1f34069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f340b53d0 0x7f1f3416acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 --2- 172.21.15.46:0/2534723011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f340cf350 0x7f1f3415c420 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 >> 172.21.15.46:0/2534723011 conn(0x7f1f340999f0 msgr2=0x7f1f340c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 shutdown_connections 2023-10-07T09:06:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:03.992+0000 7f1f3c6bd700 1 -- 172.21.15.46:0/2534723011 wait complete. 2023-10-07T09:06:04.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:06:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.134+0000 7f7890a69700 1 Processor -- start 2023-10-07T09:06:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.134+0000 7f7890a69700 1 -- start start 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f7890a69700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f788c0b1850 0x7f788c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f7890a69700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0cb300 con 0x7f788c1579f0 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f7890a69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0cb5e0 con 0x7f788c0ae680 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f7890a69700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c06fc30 con 0x7f788c0b1850 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f788a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f788c0b1850 0x7f788c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f788ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f788c1579f0 0x7f788c0abf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54544/0 (socket says 172.21.15.46:54544) 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.135+0000 7f788ad9d700 1 -- 172.21.15.46:0/2515701908 learned_addr learned my addr 172.21.15.46:0/2515701908 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f788a59c700 1 -- 172.21.15.46:0/2515701908 >> v1:172.21.15.133:6789/0 conn(0x7f788c0ae680 legacy=0x7f788c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f788a59c700 1 -- 172.21.15.46:0/2515701908 >> v1:172.21.15.46:6789/0 conn(0x7f788c1579f0 legacy=0x7f788c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f788a59c700 1 -- 172.21.15.46:0/2515701908 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0cb8c0 con 0x7f788c0b1850 2023-10-07T09:06:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f7889d9b700 1 -- 172.21.15.46:0/2515701908 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709334595 0 0) 0x7f788c0cb300 con 0x7f788c1579f0 2023-10-07T09:06:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f788a59c700 1 --2- 172.21.15.46:0/2515701908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c0b1c20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f787c0098e0 tx=0x7f787c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bbac7b5d8581b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f7889d9b700 1 -- 172.21.15.46:0/2515701908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c009e80 con 0x7f788c0b1850 2023-10-07T09:06:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f7889d9b700 1 -- 172.21.15.46:0/2515701908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c00b860 con 0x7f788c0b1850 2023-10-07T09:06:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.136+0000 7f7889d9b700 1 -- 172.21.15.46:0/2515701908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00bbe0 con 0x7f788c0b1850 2023-10-07T09:06:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 -- 172.21.15.46:0/2515701908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 msgr2=0x7f788c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 --2- 172.21.15.46:0/2515701908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c0b1c20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f787c0098e0 tx=0x7f787c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 -- 172.21.15.46:0/2515701908 shutdown_connections 2023-10-07T09:06:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 --2- 172.21.15.46:0/2515701908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c0b1c20 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 -- 172.21.15.46:0/2515701908 >> 172.21.15.46:0/2515701908 conn(0x7f788c06a320 msgr2=0x7f788c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 -- 172.21.15.46:0/2515701908 shutdown_connections 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.137+0000 7f7890a69700 1 -- 172.21.15.46:0/2515701908 wait complete. 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 Processor -- start 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 -- start start 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f788c0ae680 0x7f788c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f788c1579f0 0x7f788c14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0cc260 con 0x7f788c0b1850 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c158c90 con 0x7f788c0ae680 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.138+0000 7f7890a69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c153360 con 0x7f788c1579f0 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52748/0 (socket says 172.21.15.46:52748) 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 -- 172.21.15.46:0/1473548595 learned_addr learned my addr 172.21.15.46:0/1473548595 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f788ad9d700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f788c1579f0 0x7f788c14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f788a59c700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f788c0ae680 0x7f788c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 -- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f788c1579f0 msgr2=0x7f788c14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f788c1579f0 0x7f788c14dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 -- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f788c0ae680 msgr2=0x7f788c14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f788c0ae680 0x7f788c14a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 -- 172.21.15.46:0/1473548595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c009420 con 0x7f788c0b1850 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7883fff700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f787400c5d0 tx=0x7f7874007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874011590 con 0x7f788c0b1850 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7874011710 con 0x7f788c0b1850 2023-10-07T09:06:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c158360 con 0x7f788c0b1850 2023-10-07T09:06:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874011ad0 con 0x7f788c0b1850 2023-10-07T09:06:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.139+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c158920 con 0x7f788c0b1850 2023-10-07T09:06:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.140+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c04c3c0 con 0x7f788c0b1850 2023-10-07T09:06:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.141+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f787401c460 con 0x7f788c0b1850 2023-10-07T09:06:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.141+0000 7f78827fc700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 0x7f786c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.141+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f7874084a60 con 0x7f788c0b1850 2023-10-07T09:06:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.141+0000 7f788a59c700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 0x7f786c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.142+0000 7f788a59c700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 0x7f786c0697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f787c0091e0 tx=0x7f787c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.145+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78740516a0 con 0x7f788c0b1850 2023-10-07T09:06:04.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.367+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f788c0cbba0 con 0x7f786c067320 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.368+0000 7f78827fc700 1 -- 172.21.15.46:0/1473548595 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f788c0cbba0 con 0x7f786c067320 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000195165" 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:04.369 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.370+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 msgr2=0x7f786c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.370+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 0x7f786c0697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f787c0091e0 tx=0x7f787c016000 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.370+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 msgr2=0x7f788c14d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f787400c5d0 tx=0x7f7874007f60 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 shutdown_connections 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f786c067320 0x7f786c0697d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f788c1579f0 0x7f788c14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f788c0ae680 0x7f788c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 --2- 172.21.15.46:0/1473548595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f788c0b1850 0x7f788c14d580 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 >> 172.21.15.46:0/1473548595 conn(0x7f788c06a320 msgr2=0x7f788c1570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 shutdown_connections 2023-10-07T09:06:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.371+0000 7f7890a69700 1 -- 172.21.15.46:0/1473548595 wait complete. 2023-10-07T09:06:04.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.503+0000 7f0c4afd6700 1 Processor -- start 2023-10-07T09:06:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.503+0000 7f0c4afd6700 1 -- start start 2023-10-07T09:06:04.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.504+0000 7f0c4afd6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c44159890 0x7f0c4415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.504+0000 7f0c4afd6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c440699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.504+0000 7f0c4afd6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c44069ee0 con 0x7f0c44159c60 2023-10-07T09:06:04.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.504+0000 7f0c4afd6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4415a160 con 0x7f0c44159890 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.504+0000 7f0c4afd6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440d13a0 con 0x7f0c44069560 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c44159890 0x7f0c4415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c49573700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c440699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c44159890 0x7f0c4415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39134/0 (socket says 172.21.15.46:39134) 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 -- 172.21.15.46:0/2043726678 learned_addr learned my addr 172.21.15.46:0/2043726678 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 -- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 msgr2=0x7f0c440699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c440699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 -- 172.21.15.46:0/2043726678 >> v1:172.21.15.133:6789/0 conn(0x7f0c44159c60 legacy=0x7f0c4415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 -- 172.21.15.46:0/2043726678 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4415e140 con 0x7f0c44159890 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c49573700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c440699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c48d72700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159890 0x7f0c4415abd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0099b0 tx=0x7f0c2c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13dbf7efcd75d166 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.505+0000 7f0c437fe700 1 -- 172.21.15.46:0/2043726678 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c009ea0 con 0x7f0c44159890 2023-10-07T09:06:04.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c437fe700 1 -- 172.21.15.46:0/2043726678 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c00b860 con 0x7f0c44159890 2023-10-07T09:06:04.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c437fe700 1 -- 172.21.15.46:0/2043726678 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c00bc00 con 0x7f0c44159890 2023-10-07T09:06:04.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 -- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159890 msgr2=0x7f0c4415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159890 0x7f0c4415abd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0099b0 tx=0x7f0c2c009250 comp rx=0 tx=0).stop 2023-10-07T09:06:04.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 -- 172.21.15.46:0/2043726678 shutdown_connections 2023-10-07T09:06:04.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c440699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/2043726678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159890 0x7f0c4415abd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 -- 172.21.15.46:0/2043726678 >> 172.21.15.46:0/2043726678 conn(0x7f0c44068e20 msgr2=0x7f0c440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 -- 172.21.15.46:0/2043726678 shutdown_connections 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.506+0000 7f0c4afd6700 1 -- 172.21.15.46:0/2043726678 wait complete. 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.507+0000 7f0c4afd6700 1 Processor -- start 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.507+0000 7f0c4afd6700 1 -- start start 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c441699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159c60 0x7f0c440b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440b4970 con 0x7f0c44159890 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440b3d60 con 0x7f0c44159c60 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c4afd6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440b4040 con 0x7f0c44069560 2023-10-07T09:06:04.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52760/0 (socket says 172.21.15.46:52760) 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c43fff700 1 -- 172.21.15.46:0/3167845465 learned_addr learned my addr 172.21.15.46:0/3167845465 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c48d72700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c441699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.508+0000 7f0c49573700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159c60 0x7f0c440b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 -- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 msgr2=0x7f0c441699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c441699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 -- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159c60 msgr2=0x7f0c440b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159c60 0x7f0c440b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 -- 172.21.15.46:0/3167845465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c009420 con 0x7f0c44159890 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c43fff700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cb10 tx=0x7f0c340017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340020c0 con 0x7f0c44159890 2023-10-07T09:06:04.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400a7e0 con 0x7f0c44159890 2023-10-07T09:06:04.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400ab80 con 0x7f0c44159890 2023-10-07T09:06:04.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c0094f0 con 0x7f0c44159890 2023-10-07T09:06:04.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.509+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c440b4600 con 0x7f0c44159890 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.510+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c440b4b20 con 0x7f0c44159890 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.510+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0c34003030 con 0x7f0c44159890 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.511+0000 7f0c40ff9700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 0x7f0c240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.511+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f0c34084c70 con 0x7f0c44159890 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.511+0000 7f0c48d72700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 0x7f0c240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.512+0000 7f0c48d72700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 0x7f0c240697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0099b0 tx=0x7f0c2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.515+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c440b4b20 con 0x7f0c44159890 2023-10-07T09:06:04.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.751+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c4404c3c0 con 0x7f0c44159890 2023-10-07T09:06:04.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.752+0000 7f0c40ff9700 1 -- 172.21.15.46:0/3167845465 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f0c34051970 con 0x7f0c44159890 2023-10-07T09:06:04.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:04.753 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:06:01.959233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000195165","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 msgr2=0x7f0c240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 0x7f0c240697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0099b0 tx=0x7f0c2c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 msgr2=0x7f0c440ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cb10 tx=0x7f0c340017b0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 shutdown_connections 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0c24067320 0x7f0c240697d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c44159c60 0x7f0c440b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c44069560 0x7f0c441699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 --2- 172.21.15.46:0/3167845465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c44159890 0x7f0c440ca0b0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 >> 172.21.15.46:0/3167845465 conn(0x7f0c44068e20 msgr2=0x7f0c440b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 shutdown_connections 2023-10-07T09:06:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.754+0000 7f0c4afd6700 1 -- 172.21.15.46:0/3167845465 wait complete. 2023-10-07T09:06:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 94 2023-10-07T09:06:04.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:04.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.884+0000 7f9b8988b700 1 Processor -- start 2023-10-07T09:06:04.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.884+0000 7f9b8988b700 1 -- start start 2023-10-07T09:06:04.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b8988b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 0x7f9b84068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b8988b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b8415e010 0x7f9b8406f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b8988b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8406ec70 con 0x7f9b8406f640 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b8988b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840b3430 con 0x7f9b8415e010 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b8988b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b2e70 con 0x7f9b84068550 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b837fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9b8406f640 0x7f9b8406a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54546/0 (socket says 172.21.15.46:54546) 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b837fe700 1 -- 172.21.15.46:0/3731355744 learned_addr learned my addr 172.21.15.46:0/3731355744 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b82ffd700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 0x7f9b84068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.885+0000 7f9b827fc700 1 --2- 172.21.15.46:0/3731355744 >> v2:172.21.15.133:3300/0 conn(0x7f9b8415e010 0x7f9b8406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b81ffb700 1 -- 172.21.15.46:0/3731355744 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940733173 0 0) 0x7f9b8406ec70 con 0x7f9b8406f640 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b81ffb700 1 -- 172.21.15.46:0/3731355744 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70003570 con 0x7f9b8406f640 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b827fc700 1 -- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 msgr2=0x7f9b84068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:04.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b827fc700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 0x7f9b84068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b827fc700 1 -- 172.21.15.46:0/3731355744 >> v1:172.21.15.46:6789/0 conn(0x7f9b8406f640 legacy=0x7f9b8406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b827fc700 1 -- 172.21.15.46:0/3731355744 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840b3150 con 0x7f9b8415e010 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b82ffd700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 0x7f9b84068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b827fc700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8415e010 0x7f9b8406f100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098e0 tx=0x7f9b6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3106c9e62547c412 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b81ffb700 1 -- 172.21.15.46:0/3731355744 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011630 con 0x7f9b8415e010 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b81ffb700 1 -- 172.21.15.46:0/3731355744 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c011790 con 0x7f9b8415e010 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.886+0000 7f9b81ffb700 1 -- 172.21.15.46:0/3731355744 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011b30 con 0x7f9b8415e010 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 -- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8415e010 msgr2=0x7f9b8406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8415e010 0x7f9b8406f100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098e0 tx=0x7f9b6c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 -- 172.21.15.46:0/3731355744 shutdown_connections 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b84068550 0x7f9b84068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 --2- 172.21.15.46:0/3731355744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8415e010 0x7f9b8406f100 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 -- 172.21.15.46:0/3731355744 >> 172.21.15.46:0/3731355744 conn(0x7f9b840cd480 msgr2=0x7f9b840cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:04.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 -- 172.21.15.46:0/3731355744 shutdown_connections 2023-10-07T09:06:04.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.887+0000 7f9b8988b700 1 -- 172.21.15.46:0/3731355744 wait complete. 2023-10-07T09:06:04.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.888+0000 7f9b8988b700 1 Processor -- start 2023-10-07T09:06:04.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.888+0000 7f9b8988b700 1 -- start start 2023-10-07T09:06:04.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b84068550 0x7f9b8414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b8415e010 0x7f9b8414a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414c950 con 0x7f9b8406f640 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414b370 con 0x7f9b84068550 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b8988b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414b650 con 0x7f9b8415e010 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52766/0 (socket says 172.21.15.46:52766) 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 -- 172.21.15.46:0/315651390 learned_addr learned my addr 172.21.15.46:0/315651390 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b82ffd700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b84068550 0x7f9b8414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b837fe700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b8415e010 0x7f9b8414a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 -- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b8415e010 msgr2=0x7f9b8414a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b8415e010 0x7f9b8414a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 -- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b84068550 msgr2=0x7f9b8414a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:04.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b84068550 0x7f9b8414a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 -- 172.21.15.46:0/315651390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c009a20 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.889+0000 7f9b827fc700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ce220 tx=0x7f9b6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.890+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011b10 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.890+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c0253f0 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.890+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c009420 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.890+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0257b0 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.890+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8414bc10 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.891+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8406f100 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.891+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9b6c025ba0 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.891+0000 7f9b7affd700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 0x7f9b640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.891+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f9b6c086520 con 0x7f9b8406f640 2023-10-07T09:06:04.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.892+0000 7f9b82ffd700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 0x7f9b640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:04.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.892+0000 7f9b82ffd700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 0x7f9b640697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0099f0 tx=0x7f9b7c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:04.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:04.896+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b6c053160 con 0x7f9b8406f640 2023-10-07T09:06:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.090+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b8404c3c0 con 0x7f9b8406f640 2023-10-07T09:06:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.090+0000 7f9b7affd700 1 -- 172.21.15.46:0/315651390 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f9b6c056780 con 0x7f9b8406f640 2023-10-07T09:06:05.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:05.091 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":141,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:03.974460+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000195165.meta","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000195165"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000195165.data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000195165"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 msgr2=0x7f9b640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 0x7f9b640697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0099f0 tx=0x7f9b7c00b040 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 msgr2=0x7f9b8414c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ce220 tx=0x7f9b6c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 shutdown_connections 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9b64067320 0x7f9b640697d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b8415e010 0x7f9b8414a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b84068550 0x7f9b8414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 --2- 172.21.15.46:0/315651390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b8406f640 0x7f9b8414c410 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 >> 172.21.15.46:0/315651390 conn(0x7f9b840cd480 msgr2=0x7f9b840b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 shutdown_connections 2023-10-07T09:06:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.092+0000 7f9b8988b700 1 -- 172.21.15.46:0/315651390 wait complete. 2023-10-07T09:06:05.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:06:05.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:05.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:05.197 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:06:05.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.316+0000 7f925a0cc700 1 Processor -- start 2023-10-07T09:06:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.316+0000 7f925a0cc700 1 -- start start 2023-10-07T09:06:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f925a0cc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9254159890 0x7f925415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f925a0cc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f925a0cc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9254069ee0 con 0x7f9254159c60 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f925a0cc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925415a160 con 0x7f9254159890 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f925a0cc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540d13a0 con 0x7f9254069560 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f92537fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9254159890 0x7f925415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f92537fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9254159890 0x7f925415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52780/0 (socket says 172.21.15.46:52780) 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.317+0000 7f92537fe700 1 -- 172.21.15.46:0/1536408129 learned_addr learned my addr 172.21.15.46:0/1536408129 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f9253fff700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92537fe700 1 -- 172.21.15.46:0/1536408129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 msgr2=0x7f92540699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92537fe700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92537fe700 1 -- 172.21.15.46:0/1536408129 >> v1:172.21.15.133:6789/0 conn(0x7f9254159c60 legacy=0x7f925415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92537fe700 1 -- 172.21.15.46:0/1536408129 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925415e140 con 0x7f9254159890 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f9253fff700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92537fe700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159890 0x7f925415abd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f92440099b0 tx=0x7f9244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76932e0297185618 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92527fc700 1 -- 172.21.15.46:0/1536408129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400b820 con 0x7f9254159890 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92527fc700 1 -- 172.21.15.46:0/1536408129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400b980 con 0x7f9254159890 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.318+0000 7f92527fc700 1 -- 172.21.15.46:0/1536408129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400bd20 con 0x7f9254159890 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 -- 172.21.15.46:0/1536408129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159890 msgr2=0x7f925415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159890 0x7f925415abd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f92440099b0 tx=0x7f9244009250 comp rx=0 tx=0).stop 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 -- 172.21.15.46:0/1536408129 shutdown_connections 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 --2- 172.21.15.46:0/1536408129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159890 0x7f925415abd0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 -- 172.21.15.46:0/1536408129 >> 172.21.15.46:0/1536408129 conn(0x7f9254068e20 msgr2=0x7f92540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 -- 172.21.15.46:0/1536408129 shutdown_connections 2023-10-07T09:06:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.319+0000 7f925a0cc700 1 -- 172.21.15.46:0/1536408129 wait complete. 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.320+0000 7f925a0cc700 1 Processor -- start 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.320+0000 7f925a0cc700 1 -- start start 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9254159890 0x7f9254158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540b6470 con 0x7f9254159c60 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c7fa0 con 0x7f9254159890 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c8280 con 0x7f9254069560 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52788/0 (socket says 172.21.15.46:52788) 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 -- 172.21.15.46:0/2637810631 learned_addr learned my addr 172.21.15.46:0/2637810631 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f92537fe700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9252ffd700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9254159890 0x7f9254158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 -- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 msgr2=0x7f92540c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 -- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9254159890 msgr2=0x7f9254158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9254159890 0x7f9254158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 -- 172.21.15.46:0/2637810631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92440094f0 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f9253fff700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f924c00cef0 tx=0x7f924c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00ad20 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c016420 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.321+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540c8560 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.322+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00aea0 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.322+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540b4290 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.323+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925404c3c0 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.323+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f924c016a70 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.323+0000 7f923b7fe700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 0x7f92400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.323+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f924c012070 con 0x7f9254159c60 2023-10-07T09:06:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.324+0000 7f92537fe700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 0x7f92400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.324+0000 7f92537fe700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 0x7f92400697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f92440099b0 tx=0x7f9244016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.328+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f924c04e5a0 con 0x7f9254159c60 2023-10-07T09:06:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.565+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f925406a5b0 con 0x7f9254159c60 2023-10-07T09:06:05.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.565+0000 7f923b7fe700 1 -- 172.21.15.46:0/2637810631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f924c052120 con 0x7f9254159c60 2023-10-07T09:06:05.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:05.566 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:06:01.959233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000195165","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:06:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 msgr2=0x7f92400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 0x7f92400697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f92440099b0 tx=0x7f9244016000 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 msgr2=0x7f9254169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f924c00cef0 tx=0x7f924c007860 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 shutdown_connections 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9240067320 0x7f92400697d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9254159c60 0x7f9254169ab0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9254069560 0x7f92540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 --2- 172.21.15.46:0/2637810631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9254159890 0x7f9254158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 >> 172.21.15.46:0/2637810631 conn(0x7f9254068e20 msgr2=0x7f9254153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.567+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 shutdown_connections 2023-10-07T09:06:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.568+0000 7f925a0cc700 1 -- 172.21.15.46:0/2637810631 wait complete. 2023-10-07T09:06:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 94 2023-10-07T09:06:05.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.698+0000 7f9a0cf0b700 1 Processor -- start 2023-10-07T09:06:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.698+0000 7f9a0cf0b700 1 -- start start 2023-10-07T09:06:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.699+0000 7f9a0cf0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a08159890 0x7f9a0815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.699+0000 7f9a0cf0b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0815a160 con 0x7f9a08069560 2023-10-07T09:06:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.699+0000 7f9a0cf0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080d13a0 con 0x7f9a08159c60 2023-10-07T09:06:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.699+0000 7f9a0cf0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0815e140 con 0x7f9a08159890 2023-10-07T09:06:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a06d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a08069560 0x7f9a080ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54548/0 (socket says 172.21.15.46:54548) 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a06d9d700 1 -- 172.21.15.46:0/865345379 learned_addr learned my addr 172.21.15.46:0/865345379 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0659c700 1 --2- 172.21.15.46:0/865345379 >> v2:172.21.15.133:3300/0 conn(0x7f9a08159890 0x7f9a0815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357303925 0 0) 0x7f9a0815a160 con 0x7f9a08069560 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003570 con 0x7f9a08069560 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0659c700 1 -- 172.21.15.46:0/865345379 >> v1:172.21.15.133:6789/0 conn(0x7f9a08159c60 legacy=0x7f9a0815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0659c700 1 -- 172.21.15.46:0/865345379 >> v1:172.21.15.46:6789/0 conn(0x7f9a08069560 legacy=0x7f9a080ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886559800 0 0) 0x7f99f4003570 con 0x7f9a08069560 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0659c700 1 -- 172.21.15.46:0/865345379 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0815a3d0 con 0x7f9a08159890 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.700+0000 7f9a0659c700 1 --2- 172.21.15.46:0/865345379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159890 0x7f9a0815abd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098e0 tx=0x7f99f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d8f1934255569b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000017f0 con 0x7f9a08159890 2023-10-07T09:06:05.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8011420 con 0x7f9a08159890 2023-10-07T09:06:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0559a700 1 -- 172.21.15.46:0/865345379 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80117a0 con 0x7f9a08159890 2023-10-07T09:06:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/865345379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159890 msgr2=0x7f9a0815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/865345379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159890 0x7f9a0815abd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098e0 tx=0x7f99f80091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/865345379 shutdown_connections 2023-10-07T09:06:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/865345379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159890 0x7f9a0815abd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/865345379 >> 172.21.15.46:0/865345379 conn(0x7f9a08068e20 msgr2=0x7f9a080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/865345379 shutdown_connections 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.701+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/865345379 wait complete. 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.702+0000 7f9a0cf0b700 1 Processor -- start 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.702+0000 7f9a0cf0b700 1 -- start start 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a08159890 0x7f9a081524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159c60 0x7f9a080b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0816e320 con 0x7f9a08069560 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0816d750 con 0x7f9a08159c60 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0cf0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0816d9f0 con 0x7f9a08159890 2023-10-07T09:06:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52790/0 (socket says 172.21.15.46:52790) 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 -- 172.21.15.46:0/2906028393 learned_addr learned my addr 172.21.15.46:0/2906028393 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a06d9d700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159c60 0x7f9a080b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a05d9b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a08159890 0x7f9a081524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 -- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a08159890 msgr2=0x7f9a081524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a08159890 0x7f9a081524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 -- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159c60 msgr2=0x7f9a080b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159c60 0x7f9a080b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.703+0000 7f9a0659c700 1 -- 172.21.15.46:0/2906028393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009420 con 0x7f9a08069560 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f9a0659c700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009fd0 tx=0x7f99f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f801cb80 con 0x7f9a08069560 2023-10-07T09:06:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f801cce0 con 0x7f9a08069560 2023-10-07T09:06:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0816dcd0 con 0x7f9a08069560 2023-10-07T09:06:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f801a6a0 con 0x7f9a08069560 2023-10-07T09:06:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.704+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08158b20 con 0x7f9a08069560 2023-10-07T09:06:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.705+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0804c3c0 con 0x7f9a08069560 2023-10-07T09:06:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.705+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f99f801aad0 con 0x7f9a08069560 2023-10-07T09:06:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.706+0000 7f99fe7fc700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.706+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f99f8086630 con 0x7f9a08069560 2023-10-07T09:06:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.706+0000 7f9a05d9b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.706+0000 7f9a05d9b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 0x7f99e80697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b6630 tx=0x7f99f0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.710+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f8053270 con 0x7f9a08069560 2023-10-07T09:06:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.904+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a080b1320 con 0x7f9a08069560 2023-10-07T09:06:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.905+0000 7f99fe7fc700 1 -- 172.21.15.46:0/2906028393 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f99f8056890 con 0x7f9a08069560 2023-10-07T09:06:05.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":141,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:03.974460+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000195165.meta","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000195165"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000195165.data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000195165"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 msgr2=0x7f99e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 0x7f99e80697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b6630 tx=0x7f99f0007ec0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 msgr2=0x7f9a081585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009fd0 tx=0x7f99f8016000 comp rx=0 tx=0).stop 2023-10-07T09:06:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 shutdown_connections 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08159c60 0x7f9a080b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a08069560 0x7f9a081585e0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 --2- 172.21.15.46:0/2906028393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a08159890 0x7f9a081524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 >> 172.21.15.46:0/2906028393 conn(0x7f9a08068e20 msgr2=0x7f9a08152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 shutdown_connections 2023-10-07T09:06:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:05.907+0000 7f9a0cf0b700 1 -- 172.21.15.46:0/2906028393 wait complete. 2023-10-07T09:06:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs.volume_0000000000195165.meta', 'create_time': '2023-10-07T09:05:47.894772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000195165'}}}, {'pool': 25, 'pool_name': 'cephfs.volume_0000000000195165.data', 'create_time': '2023-10-07T09:05:48.940668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000195165'}}}] 2023-10-07T09:06:05.921 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:06:06.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.043+0000 7fb166cc9700 1 Processor -- start 2023-10-07T09:06:06.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.043+0000 7fb166cc9700 1 -- start start 2023-10-07T09:06:06.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb166cc9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb1600b16d0 0x7fb1600b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb166cc9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b33b0 0x7fb1600b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb166cc9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600b2080 con 0x7fb1600b4e70 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb166cc9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1600cfb00 con 0x7fb1600b16d0 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb166cc9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600b5c40 con 0x7fb1600b33b0 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb1654c6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb1600b16d0 0x7fb1600b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb165cc7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb1600b4e70 0x7fb1600ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54558/0 (socket says 172.21.15.46:54558) 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb165cc7700 1 -- 172.21.15.46:0/3047217436 learned_addr learned my addr 172.21.15.46:0/3047217436 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb1664c8700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b33b0 0x7fb1600b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb1654c6700 1 -- 172.21.15.46:0/3047217436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b33b0 msgr2=0x7fb1600b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb1654c6700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b33b0 0x7fb1600b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb1654c6700 1 -- 172.21.15.46:0/3047217436 >> v1:172.21.15.46:6789/0 conn(0x7fb1600b4e70 legacy=0x7fb1600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb1654c6700 1 -- 172.21.15.46:0/3047217436 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600b5f20 con 0x7fb1600b16d0 2023-10-07T09:06:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.044+0000 7fb164cc5700 1 -- 172.21.15.46:0/3047217436 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373240788 0 0) 0x7fb1600b2080 con 0x7fb1600b4e70 2023-10-07T09:06:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb1654c6700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b16d0 0x7fb1600b1b40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb1540098e0 tx=0x7fb1540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1a5eef32346043 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb164cc5700 1 -- 172.21.15.46:0/3047217436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154009e80 con 0x7fb1600b16d0 2023-10-07T09:06:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb164cc5700 1 -- 172.21.15.46:0/3047217436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15400b860 con 0x7fb1600b16d0 2023-10-07T09:06:06.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb164cc5700 1 -- 172.21.15.46:0/3047217436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400bbe0 con 0x7fb1600b16d0 2023-10-07T09:06:06.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 -- 172.21.15.46:0/3047217436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b16d0 msgr2=0x7fb1600b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b16d0 0x7fb1600b1b40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb1540098e0 tx=0x7fb1540091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 -- 172.21.15.46:0/3047217436 shutdown_connections 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b33b0 0x7fb1600b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 --2- 172.21.15.46:0/3047217436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b16d0 0x7fb1600b1b40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 -- 172.21.15.46:0/3047217436 >> 172.21.15.46:0/3047217436 conn(0x7fb1600d10c0 msgr2=0x7fb1600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.045+0000 7fb166cc9700 1 -- 172.21.15.46:0/3047217436 shutdown_connections 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.046+0000 7fb166cc9700 1 -- 172.21.15.46:0/3047217436 wait complete. 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 Processor -- start 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 -- start start 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b16d0 0x7fb16014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b4e70 0x7fb160169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16016cec0 con 0x7fb1600b33b0 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16016a100 con 0x7fb1600b16d0 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb166cc9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16016a3e0 con 0x7fb1600b4e70 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.047+0000 7fb1654c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52810/0 (socket says 172.21.15.46:52810) 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 -- 172.21.15.46:0/414514191 learned_addr learned my addr 172.21.15.46:0/414514191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb165cc7700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b16d0 0x7fb16014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1664c8700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b4e70 0x7fb160169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 -- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b4e70 msgr2=0x7fb160169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b4e70 0x7fb160169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 -- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b16d0 msgr2=0x7fb16014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b16d0 0x7fb16014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 -- 172.21.15.46:0/414514191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009420 con 0x7fb1600b33b0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb1654c6700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fb15400b3c0 tx=0x7fb154017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400bbe0 con 0x7fb1600b33b0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154011420 con 0x7fb1600b33b0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540117c0 con 0x7fb1600b33b0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16016a6c0 con 0x7fb1600b33b0 2023-10-07T09:06:06.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.048+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160169db0 con 0x7fb1600b33b0 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.049+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16016d310 con 0x7fb1600b33b0 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.050+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb154011bf0 con 0x7fb1600b33b0 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.050+0000 7fb15dffb700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 0x7fb14c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.050+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb154086620 con 0x7fb1600b33b0 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.050+0000 7fb165cc7700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 0x7fb14c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.051+0000 7fb165cc7700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 0x7fb14c0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1600b0c70 tx=0x7fb158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.054+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb16016d310 con 0x7fb1600b33b0 2023-10-07T09:06:06.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.249+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb16016d310 con 0x7fb1600b33b0 2023-10-07T09:06:06.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.249+0000 7fb15dffb700 1 -- 172.21.15.46:0/414514191 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb16016d310 con 0x7fb1600b33b0 2023-10-07T09:06:06.250 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:06:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.251+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 msgr2=0x7fb14c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.251+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 0x7fb14c0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1600b0c70 tx=0x7fb158009040 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.251+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 msgr2=0x7fb1600c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.251+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fb15400b3c0 tx=0x7fb154017000 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 shutdown_connections 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb14c067320 0x7fb14c0697d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1600b4e70 0x7fb160169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b16d0 0x7fb16014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 --2- 172.21.15.46:0/414514191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1600b33b0 0x7fb1600c8d10 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 >> 172.21.15.46:0/414514191 conn(0x7fb1600d10c0 msgr2=0x7fb16015c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 shutdown_connections 2023-10-07T09:06:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.252+0000 7fb166cc9700 1 -- 172.21.15.46:0/414514191 wait complete. 2023-10-07T09:06:06.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000195165.meta pg_num 2023-10-07T09:06:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.386+0000 7f1b20bbd700 1 Processor -- start 2023-10-07T09:06:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.386+0000 7f1b20bbd700 1 -- start start 2023-10-07T09:06:06.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b20bbd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b1c159c60 0x7f1b1c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b20bbd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b1c15db10 0x7f1b1c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b20bbd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c15a160 con 0x7f1b1c159890 2023-10-07T09:06:06.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b20bbd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c15df50 con 0x7f1b1c159c60 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b20bbd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c0d13a0 con 0x7f1b1c15db10 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1a59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b1c159890 0x7f1b1c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54568/0 (socket says 172.21.15.46:54568) 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1a59c700 1 -- 172.21.15.46:0/2466007845 learned_addr learned my addr 172.21.15.46:0/2466007845 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/2466007845 >> v2:172.21.15.46:3300/0 conn(0x7f1b1c159c60 0x7f1b1c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1959a700 1 -- 172.21.15.46:0/2466007845 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460036376 0 0) 0x7f1b1c15a160 con 0x7f1b1c159890 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1959a700 1 -- 172.21.15.46:0/2466007845 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b08003570 con 0x7f1b1c159890 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1ad9d700 1 --2- 172.21.15.46:0/2466007845 >> v2:172.21.15.133:3300/0 conn(0x7f1b1c15db10 0x7f1b1c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 -- 172.21.15.46:0/2466007845 >> v2:172.21.15.133:3300/0 conn(0x7f1b1c15db10 msgr2=0x7f1b1c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/2466007845 >> v2:172.21.15.133:3300/0 conn(0x7f1b1c15db10 0x7f1b1c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 -- 172.21.15.46:0/2466007845 >> v1:172.21.15.46:6789/0 conn(0x7f1b1c159890 legacy=0x7f1b1c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 -- 172.21.15.46:0/2466007845 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c15e140 con 0x7f1b1c159c60 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/2466007845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c15d5d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06a890 tx=0x7f1b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99362fc7041f0d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.387+0000 7f1b1959a700 1 -- 172.21.15.46:0/2466007845 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011630 con 0x7f1b1c159c60 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b1959a700 1 -- 172.21.15.46:0/2466007845 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04011790 con 0x7f1b1c159c60 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b1959a700 1 -- 172.21.15.46:0/2466007845 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011b30 con 0x7f1b1c159c60 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 -- 172.21.15.46:0/2466007845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 msgr2=0x7f1b1c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/2466007845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c15d5d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06a890 tx=0x7f1b040091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 -- 172.21.15.46:0/2466007845 shutdown_connections 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/2466007845 >> v2:172.21.15.133:3300/0 conn(0x7f1b1c15db10 0x7f1b1c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/2466007845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c15d5d0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 -- 172.21.15.46:0/2466007845 >> 172.21.15.46:0/2466007845 conn(0x7f1b1c068e20 msgr2=0x7f1b1c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 -- 172.21.15.46:0/2466007845 shutdown_connections 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.388+0000 7f1b20bbd700 1 -- 172.21.15.46:0/2466007845 wait complete. 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.389+0000 7f1b20bbd700 1 Processor -- start 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.389+0000 7f1b20bbd700 1 -- start start 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b1c159890 0x7f1b1c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b1c15db10 0x7f1b1c0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0c9ca0 con 0x7f1b1c159c60 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0c9090 con 0x7f1b1c159890 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b20bbd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0c9370 con 0x7f1b1c15db10 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52822/0 (socket says 172.21.15.46:52822) 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 -- 172.21.15.46:0/3652120937 learned_addr learned my addr 172.21.15.46:0/3652120937 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b1a59c700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b1c159890 0x7f1b1c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b1ad9d700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b1c15db10 0x7f1b1c0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 -- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b1c15db10 msgr2=0x7f1b1c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b1c15db10 0x7f1b1c0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 -- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b1c159890 msgr2=0x7f1b1c0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b1c159890 0x7f1b1c0ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.390+0000 7f1b19d9b700 1 -- 172.21.15.46:0/3652120937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04009420 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b19d9b700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c070e20 tx=0x7f1b04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04000d10 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04011b10 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c0c9650 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04025640 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.391+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c0ca670 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.392+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c0c9e10 con 0x7f1b1c159c60 2023-10-07T09:06:06.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.392+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b04025a30 con 0x7f1b1c159c60 2023-10-07T09:06:06.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.393+0000 7f1b127fc700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.393+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f1b04086470 con 0x7f1b1c159c60 2023-10-07T09:06:06.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.393+0000 7f1b1a59c700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.393+0000 7f1b1a59c700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.397+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b040530b0 con 0x7f1b1c159c60 2023-10-07T09:06:06.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.592+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000195165.meta", "var": "pg_num"} v 0) v1 -- 0x7f1b1c04c3c0 con 0x7f1b1c159c60 2023-10-07T09:06:06.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.593+0000 7f1b127fc700 1 -- 172.21.15.46:0/3652120937 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000195165.meta", "var": "pg_num"}]=0 v141) v1 ==== 124+0+11 (secure 0 0 0) 0x7f1b040566d0 con 0x7f1b1c159c60 2023-10-07T09:06:06.593 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 msgr2=0x7f1afc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c009040 comp rx=0 tx=0).stop 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 msgr2=0x7f1b1c140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c070e20 tx=0x7f1b04017000 comp rx=0 tx=0).stop 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 shutdown_connections 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b1c15db10 0x7f1b1c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b1c159890 0x7f1b1c0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 --2- 172.21.15.46:0/3652120937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b1c159c60 0x7f1b1c140700 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 >> 172.21.15.46:0/3652120937 conn(0x7f1b1c068e20 msgr2=0x7f1b1c152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 shutdown_connections 2023-10-07T09:06:06.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.595+0000 7f1b20bbd700 1 -- 172.21.15.46:0/3652120937 wait complete. 2023-10-07T09:06:06.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000195165.data pg_num 2023-10-07T09:06:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.729+0000 7f25073bb700 1 Processor -- start 2023-10-07T09:06:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.729+0000 7f25073bb700 1 -- start start 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f25073bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f250006bcd0 0x7f25000caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f25073bb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f250006c0a0 0x7f250015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f25073bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250015d7e0 con 0x7f250015df50 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f25073bb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250015dac0 con 0x7f250006c0a0 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f25073bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250015aa30 con 0x7f250006bcd0 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f2505958700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f250015df50 0x7f25000c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54582/0 (socket says 172.21.15.46:54582) 2023-10-07T09:06:06.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f2505958700 1 -- 172.21.15.46:0/1517022150 learned_addr learned my addr 172.21.15.46:0/1517022150 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f250006bcd0 0x7f25000caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f2504956700 1 --2- 172.21.15.46:0/1517022150 >> v2:172.21.15.133:3300/0 conn(0x7f250006c0a0 0x7f250015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120137200 0 0) 0x7f250015d7e0 con 0x7f250015df50 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ec003570 con 0x7f250015df50 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413430801 0 0) 0x7f24ec003570 con 0x7f250015df50 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f250006bcd0 msgr2=0x7f25000caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f250006bcd0 0x7f25000caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 >> v2:172.21.15.133:3300/0 conn(0x7f250006c0a0 msgr2=0x7f250015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 --2- 172.21.15.46:0/1517022150 >> v2:172.21.15.133:3300/0 conn(0x7f250006c0a0 0x7f250015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250015ad10 con 0x7f250015df50 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.730+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f24f80017f0 con 0x7f250015df50 2023-10-07T09:06:06.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 >> v1:172.21.15.46:6789/0 conn(0x7f250015df50 legacy=0x7f25000c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ec003a60 0x7f24ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec004810 0x7f24ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0051c0 0x7f24ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250015dac0 con 0x7f24ec003a60 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250015aa30 con 0x7f24ec0051c0 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec00c020 con 0x7f24ec004810 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f250006bcd0 0x7f25000caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ec003a60 0x7f24ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505958700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0051c0 0x7f24ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2504956700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec004810 0x7f24ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 -- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec004810 msgr2=0x7f24ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec004810 0x7f24ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 -- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0051c0 msgr2=0x7f24ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0051c0 0x7f24ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 -- 172.21.15.46:0/1517022150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec003570 con 0x7f24ec003a60 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f2505157700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ec003a60 0x7f24ec003e70 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25000cc150 tx=0x7f24fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf080eb1b809385 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00e710 con 0x7f24ec003a60 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00e870 con 0x7f24ec003a60 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.731+0000 7f24f7fff700 1 -- 172.21.15.46:0/1517022150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00ec10 con 0x7f24ec003a60 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 -- 172.21.15.46:0/1517022150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ec003a60 msgr2=0x7f24ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 --2- 172.21.15.46:0/1517022150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ec003a60 0x7f24ec003e70 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25000cc150 tx=0x7f24fc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f2505958700 1 -- 172.21.15.46:0/1517022150 reap_dead start 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 -- 172.21.15.46:0/1517022150 shutdown_connections 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 -- 172.21.15.46:0/1517022150 >> 172.21.15.46:0/1517022150 conn(0x7f25000ce600 msgr2=0x7f25000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 -- 172.21.15.46:0/1517022150 shutdown_connections 2023-10-07T09:06:06.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.732+0000 7f25073bb700 1 -- 172.21.15.46:0/1517022150 wait complete. 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.733+0000 7f25073bb700 1 Processor -- start 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.733+0000 7f25073bb700 1 -- start start 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec003a60 0x7f25000b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2500153b20 0x7f2500153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500158070 con 0x7f25000b2180 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25001544b0 con 0x7f2500153b20 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f25073bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c8740 con 0x7f24ec003a60 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52838/0 (socket says 172.21.15.46:52838) 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 -- 172.21.15.46:0/1614834613 learned_addr learned my addr 172.21.15.46:0/1614834613 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2505157700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec003a60 0x7f25000b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2505958700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2500153b20 0x7f2500153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 -- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec003a60 msgr2=0x7f25000b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec003a60 0x7f25000b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 -- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2500153b20 msgr2=0x7f2500153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2500153b20 0x7f2500153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.734+0000 7f2504956700 1 -- 172.21.15.46:0/1614834613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500154690 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f2504956700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f24f0011da0 tx=0x7f24f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000fa10 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000fb70 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2500154970 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0014440 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.735+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2500154f30 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.736+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25001581b0 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.736+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24f0014870 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.737+0000 7f24f57fa700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.737+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f24f0018030 con 0x7f25000b2180 2023-10-07T09:06:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.737+0000 7f2505157700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.737+0000 7f2505157700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0091e0 tx=0x7f24fc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.741+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25001581b0 con 0x7f25000b2180 2023-10-07T09:06:06.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.933+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000195165.data", "var": "pg_num"} v 0) v1 -- 0x7f25001581b0 con 0x7f25000b2180 2023-10-07T09:06:06.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.933+0000 7f24f57fa700 1 -- 172.21.15.46:0/1614834613 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000195165.data", "var": "pg_num"}]=0 v141) v1 ==== 124+0+11 (secure 0 0 0) 0x7f25001581b0 con 0x7f25000b2180 2023-10-07T09:06:06.934 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 msgr2=0x7f24e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0091e0 tx=0x7f24fc019000 comp rx=0 tx=0).stop 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 msgr2=0x7f25001535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f24f0011da0 tx=0x7f24f00091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 shutdown_connections 2023-10-07T09:06:06.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2500153b20 0x7f2500153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24ec003a60 0x7f25000b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 --2- 172.21.15.46:0/1614834613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25000b2180 0x7f25001535e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 >> 172.21.15.46:0/1614834613 conn(0x7f25000ce600 msgr2=0x7f250015b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 shutdown_connections 2023-10-07T09:06:06.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:06.935+0000 7f25073bb700 1 -- 172.21.15.46:0/1614834613 wait complete. 2023-10-07T09:06:06.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.067+0000 7f6e5d54d700 1 Processor -- start 2023-10-07T09:06:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.067+0000 7f6e5d54d700 1 -- start start 2023-10-07T09:06:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e5d54d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e581599e0 0x7f6e58069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e5d54d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e5d54d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580c96a0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e5d54d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580cb9e0 con 0x7f6e581599e0 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e5d54d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580cab60 con 0x7f6e58159db0 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e567fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e581599e0 0x7f6e58069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e581599e0 0x7f6e58069ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39234/0 (socket says 172.21.15.46:39234) 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e567fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:37520/0 (socket says 172.21.15.46:37520) 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3577619951 learned_addr learned my addr 172.21.15.46:0/3577619951 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e577fe700 1 --1- 172.21.15.46:0/3577619951 >> v1:172.21.15.133:6789/0 conn(0x7f6e5806a2b0 0x7f6e5806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:51770/0 (socket says 172.21.15.46:51770) 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 msgr2=0x7f6e58069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3577619951 >> v1:172.21.15.133:6789/0 conn(0x7f6e5806a2b0 legacy=0x7f6e5806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3577619951 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580cb420 con 0x7f6e581599e0 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.068+0000 7f6e567fc700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e56ffd700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e58069ac0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f20 tx=0x7f6e48009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735f5fe3a7a4e0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e55ffb700 1 -- 172.21.15.46:0/3577619951 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800e070 con 0x7f6e581599e0 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e55ffb700 1 -- 172.21.15.46:0/3577619951 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800b9d0 con 0x7f6e581599e0 2023-10-07T09:06:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e55ffb700 1 -- 172.21.15.46:0/3577619951 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480092e0 con 0x7f6e581599e0 2023-10-07T09:06:07.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 msgr2=0x7f6e58069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e58069ac0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f20 tx=0x7f6e48009840 comp rx=0 tx=0).stop 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3577619951 shutdown_connections 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e58069ac0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3577619951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e58069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.069+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3577619951 >> 172.21.15.46:0/3577619951 conn(0x7f6e580c9860 msgr2=0x7f6e580c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.070+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3577619951 shutdown_connections 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.070+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3577619951 wait complete. 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.071+0000 7f6e5d54d700 1 Processor -- start 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.071+0000 7f6e5d54d700 1 -- start start 2023-10-07T09:06:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e580c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e580c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580c69c0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5815c230 con 0x7f6e581599e0 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58147e00 con 0x7f6e58159db0 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52842/0 (socket says 172.21.15.46:52842) 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3076601370 learned_addr learned my addr 172.21.15.46:0/3076601370 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e577fe700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e580c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e567fc700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e580c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 msgr2=0x7f6e580c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e580c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 msgr2=0x7f6e580c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e580c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 -- 172.21.15.46:0/3076601370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009420 con 0x7f6e5806a2b0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e56ffd700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6e48003440 tx=0x7f6e48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48008a80 con 0x7f6e5806a2b0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48008be0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e48009ae0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48026460 con 0x7f6e5806a2b0 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.072+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5815b900 con 0x7f6e5806a2b0 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.073+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5804c3c0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.074+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6e48003040 con 0x7f6e5806a2b0 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.074+0000 7f6e4effd700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 0x7f6e380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.074+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6e480865e0 con 0x7f6e5806a2b0 2023-10-07T09:06:07.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.074+0000 7f6e567fc700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 0x7f6e380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.075+0000 7f6e567fc700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 0x7f6e380697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6e400093f0 tx=0x7f6e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.079+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e48053110 con 0x7f6e5806a2b0 2023-10-07T09:06:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.316+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e580cb700 con 0x7f6e5806a2b0 2023-10-07T09:06:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.317+0000 7f6e4effd700 1 -- 172.21.15.46:0/3076601370 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f6e48056730 con 0x7f6e5806a2b0 2023-10-07T09:06:07.318 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:07.318 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:06:01.959233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000195165","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 msgr2=0x7f6e380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 0x7f6e380697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6e400093f0 tx=0x7f6e40008040 comp rx=0 tx=0).stop 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 msgr2=0x7f6e581478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6e48003440 tx=0x7f6e48018000 comp rx=0 tx=0).stop 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 shutdown_connections 2023-10-07T09:06:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6e38067320 0x7f6e380697d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e58159db0 0x7f6e580c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e5806a2b0 0x7f6e581478c0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 --2- 172.21.15.46:0/3076601370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e581599e0 0x7f6e580c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 >> 172.21.15.46:0/3076601370 conn(0x7f6e580c9860 msgr2=0x7f6e5806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 shutdown_connections 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.319+0000 7f6e5d54d700 1 -- 172.21.15.46:0/3076601370 wait complete. 2023-10-07T09:06:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 94 2023-10-07T09:06:07.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:07.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.450+0000 7f579b9f9700 1 Processor -- start 2023-10-07T09:06:07.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.450+0000 7f579b9f9700 1 -- start start 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.450+0000 7f579b9f9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5794159890 0x7f579415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.450+0000 7f579b9f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159c60 0x7f579415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f579b9f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f579415db10 0x7f5794069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f579b9f9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579415a160 con 0x7f5794159890 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f579b9f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940d13a0 con 0x7f579415db10 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f579b9f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579415e140 con 0x7f5794159c60 2023-10-07T09:06:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5794159890 0x7f579415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5794159890 0x7f579415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52854/0 (socket says 172.21.15.46:52854) 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 -- 172.21.15.46:0/4236357157 learned_addr learned my addr 172.21.15.46:0/4236357157 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799f96700 1 --2- 172.21.15.46:0/4236357157 >> v2:172.21.15.133:3300/0 conn(0x7f579415db10 0x7f5794069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5798f94700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159c60 0x7f579415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 -- 172.21.15.46:0/4236357157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159c60 msgr2=0x7f579415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159c60 0x7f579415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 -- 172.21.15.46:0/4236357157 >> v2:172.21.15.133:3300/0 conn(0x7f579415db10 msgr2=0x7f5794069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 --2- 172.21.15.46:0/4236357157 >> v2:172.21.15.133:3300/0 conn(0x7f579415db10 0x7f5794069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 -- 172.21.15.46:0/4236357157 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579415a3d0 con 0x7f5794159890 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5799795700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159890 0x7f579415abd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5794089b50 tx=0x7f5784009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261b4dcf7cb656de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5793fff700 1 -- 172.21.15.46:0/4236357157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400e070 con 0x7f5794159890 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5793fff700 1 -- 172.21.15.46:0/4236357157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400ba50 con 0x7f5794159890 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.451+0000 7f5793fff700 1 -- 172.21.15.46:0/4236357157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840092e0 con 0x7f5794159890 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 -- 172.21.15.46:0/4236357157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159890 msgr2=0x7f579415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159890 0x7f579415abd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5794089b50 tx=0x7f5784009840 comp rx=0 tx=0).stop 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 -- 172.21.15.46:0/4236357157 shutdown_connections 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 --2- 172.21.15.46:0/4236357157 >> v2:172.21.15.133:3300/0 conn(0x7f579415db10 0x7f5794069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159890 0x7f579415abd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 --2- 172.21.15.46:0/4236357157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159c60 0x7f579415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 -- 172.21.15.46:0/4236357157 >> 172.21.15.46:0/4236357157 conn(0x7f5794068e20 msgr2=0x7f57940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 -- 172.21.15.46:0/4236357157 shutdown_connections 2023-10-07T09:06:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.452+0000 7f579b9f9700 1 -- 172.21.15.46:0/4236357157 wait complete. 2023-10-07T09:06:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.453+0000 7f579b9f9700 1 Processor -- start 2023-10-07T09:06:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.453+0000 7f579b9f9700 1 -- start start 2023-10-07T09:06:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159890 0x7f57941526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579415db10 0x7f579415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940ca8d0 con 0x7f5794159c60 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579416de80 con 0x7f579415db10 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f579b9f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5794159040 con 0x7f5794159890 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52858/0 (socket says 172.21.15.46:52858) 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 -- 172.21.15.46:0/2751794131 learned_addr learned my addr 172.21.15.46:0/2751794131 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5799f96700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579415db10 0x7f579415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5799795700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159890 0x7f57941526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 -- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159890 msgr2=0x7f57941526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159890 0x7f57941526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 -- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579415db10 msgr2=0x7f579415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579415db10 0x7f579415d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.454+0000 7f5798f94700 1 -- 172.21.15.46:0/2751794131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009ae0 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f5798f94700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f578800d860 tx=0x7f5788008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57880125f0 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788012750 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57940cb430 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788012af0 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.455+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57940cade0 con 0x7f5794159c60 2023-10-07T09:06:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.456+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579404c3c0 con 0x7f5794159c60 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.456+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5788013480 con 0x7f5794159c60 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.457+0000 7f57917fa700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 0x7f57800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.457+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f5788085040 con 0x7f5794159c60 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.457+0000 7f5799795700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 0x7f57800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.457+0000 7f5799795700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 0x7f57800697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5784009880 tx=0x7f5784018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.461+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5788055710 con 0x7f5794159c60 2023-10-07T09:06:07.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.654+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f579406a5b0 con 0x7f5794159c60 2023-10-07T09:06:07.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.654+0000 7f57917fa700 1 -- 172.21.15.46:0/2751794131 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f57880552a0 con 0x7f5794159c60 2023-10-07T09:06:07.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:07.655 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":141,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:03.974460+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000195165.meta","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000195165"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000195165.data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000195165"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:07.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 msgr2=0x7f57800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 0x7f57800697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5784009880 tx=0x7f5784018000 comp rx=0 tx=0).stop 2023-10-07T09:06:07.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 msgr2=0x7f5794158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f578800d860 tx=0x7f5788008040 comp rx=0 tx=0).stop 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 shutdown_connections 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5780067320 0x7f57800697d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579415db10 0x7f579415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5794159890 0x7f57941526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 --2- 172.21.15.46:0/2751794131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5794159c60 0x7f5794158940 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 >> 172.21.15.46:0/2751794131 conn(0x7f5794068e20 msgr2=0x7f5794069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 shutdown_connections 2023-10-07T09:06:07.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.656+0000 7f579b9f9700 1 -- 172.21.15.46:0/2751794131 wait complete. 2023-10-07T09:06:07.669 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000195165 and related pools 2023-10-07T09:06:07.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.788+0000 7f3b657c6700 1 Processor -- start 2023-10-07T09:06:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.788+0000 7f3b657c6700 1 -- start start 2023-10-07T09:06:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b657c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b60159890 0x7f3b6015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b657c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b6015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b657c6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6015a160 con 0x7f3b6015db10 2023-10-07T09:06:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b657c6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b600d13a0 con 0x7f3b60159890 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b657c6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6015e140 con 0x7f3b60159c60 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b5f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3b6015db10 0x7f3b60069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54588/0 (socket says 172.21.15.46:54588) 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b5f7fe700 1 -- 172.21.15.46:0/3358824890 learned_addr learned my addr 172.21.15.46:0/3358824890 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b5effd700 1 --2- 172.21.15.46:0/3358824890 >> v2:172.21.15.133:3300/0 conn(0x7f3b60159890 0x7f3b6015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b5e7fc700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b6015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.789+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602862730 0 0) 0x7f3b6015a160 con 0x7f3b6015db10 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b4c003570 con 0x7f3b6015db10 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874983593 0 0) 0x7f3b4c003570 con 0x7f3b6015db10 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 msgr2=0x7f3b6015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b6015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 >> v2:172.21.15.133:3300/0 conn(0x7f3b60159890 msgr2=0x7f3b6015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 --2- 172.21.15.46:0/3358824890 >> v2:172.21.15.133:3300/0 conn(0x7f3b60159890 0x7f3b6015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6015a3d0 con 0x7f3b6015db10 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f3b580017f0 con 0x7f3b6015db10 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 >> v1:172.21.15.46:6789/0 conn(0x7f3b6015db10 legacy=0x7f3b60069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c003a60 0x7f3b4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c004810 0x7f3b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600d13a0 con 0x7f3b4c003a60 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6015e140 con 0x7f3b4c004810 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c00ba60 con 0x7f3b60159c60 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c003a60 0x7f3b4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5e7fc700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c004810 0x7f3b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5f7fe700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 -- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 msgr2=0x7f3b4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 -- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c004810 msgr2=0x7f3b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c004810 0x7f3b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 -- 172.21.15.46:0/3358824890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c003570 con 0x7f3b4c003a60 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5f7fe700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b60159c60 0x7f3b4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.790+0000 7f3b5effd700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c003a60 0x7f3b4c003e70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009c30 tx=0x7f3b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d5a7e804d43b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000e710 con 0x7f3b4c003a60 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000e870 con 0x7f3b4c003a60 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b5dffb700 1 -- 172.21.15.46:0/3358824890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000ec30 con 0x7f3b4c003a60 2023-10-07T09:06:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 -- 172.21.15.46:0/3358824890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c003a60 msgr2=0x7f3b4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 --2- 172.21.15.46:0/3358824890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c003a60 0x7f3b4c003e70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009c30 tx=0x7f3b500091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b5f7fe700 1 -- 172.21.15.46:0/3358824890 reap_dead start 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 -- 172.21.15.46:0/3358824890 shutdown_connections 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 -- 172.21.15.46:0/3358824890 >> 172.21.15.46:0/3358824890 conn(0x7f3b60068e20 msgr2=0x7f3b600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 -- 172.21.15.46:0/3358824890 shutdown_connections 2023-10-07T09:06:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.791+0000 7f3b657c6700 1 -- 172.21.15.46:0/3358824890 wait complete. 2023-10-07T09:06:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.792+0000 7f3b657c6700 1 Processor -- start 2023-10-07T09:06:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 -- start start 2023-10-07T09:06:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c003a60 0x7f3b600cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b6016a310 0x7f3b6016a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6016acf0 con 0x7f3b600cfce0 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60158a60 con 0x7f3b4c003a60 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b657c6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60157f20 con 0x7f3b6016a310 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b5e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b5e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52874/0 (socket says 172.21.15.46:52874) 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.793+0000 7f3b5e7fc700 1 -- 172.21.15.46:0/4066235584 learned_addr learned my addr 172.21.15.46:0/4066235584 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5f7fe700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b6016a310 0x7f3b6016a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5effd700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c003a60 0x7f3b600cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 -- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b6016a310 msgr2=0x7f3b6016a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b6016a310 0x7f3b6016a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 -- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c003a60 msgr2=0x7f3b600cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c003a60 0x7f3b600cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 -- 172.21.15.46:0/4066235584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b601581c0 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b5e7fc700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f3b48011b70 tx=0x7f3b480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800fa70 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800fbd0 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b601584a0 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014440 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.794+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b600ced80 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.795+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6004c3c0 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.795+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b48014870 con 0x7f3b600cfce0 2023-10-07T09:06:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.796+0000 7f3b56ffd700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 0x7f3b400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.796+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f3b48018030 con 0x7f3b600cfce0 2023-10-07T09:06:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.796+0000 7f3b5effd700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 0x7f3b400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.796+0000 7f3b5effd700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 0x7f3b400697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b500091e0 tx=0x7f3b5001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:07.800+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b48052460 con 0x7f3b600cfce0 2023-10-07T09:06:08.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.040+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b600caba0 con 0x7f3b600cfce0 2023-10-07T09:06:08.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.041+0000 7f3b56ffd700 1 -- 172.21.15.46:0/4066235584 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f3b48055a80 con 0x7f3b600cfce0 2023-10-07T09:06:08.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:08.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:06:01.959233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000195165","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:06:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.042+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 msgr2=0x7f3b400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.042+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 0x7f3b400697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b500091e0 tx=0x7f3b5001a000 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.042+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 msgr2=0x7f3b60169dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.042+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f3b48011b70 tx=0x7f3b480091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 shutdown_connections 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3b40067320 0x7f3b400697d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b6016a310 0x7f3b6016a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b4c003a60 0x7f3b600cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 --2- 172.21.15.46:0/4066235584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b600cfce0 0x7f3b60169dd0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 >> 172.21.15.46:0/4066235584 conn(0x7f3b60068e20 msgr2=0x7f3b6015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 shutdown_connections 2023-10-07T09:06:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.043+0000 7f3b657c6700 1 -- 172.21.15.46:0/4066235584 wait complete. 2023-10-07T09:06:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 94 2023-10-07T09:06:08.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.173+0000 7ff7050ea700 1 Processor -- start 2023-10-07T09:06:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.173+0000 7ff7050ea700 1 -- start start 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff7050ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff700159890 0x7ff70015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff7050ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff7050ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70015a160 con 0x7ff70015db10 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff7050ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000d13a0 con 0x7ff700159890 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff7050ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015e140 con 0x7ff700159c60 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff700159890 0x7ff70015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6ff59e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff70015db10 0x7ff700069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:51772/0 (socket says 172.21.15.46:51772) 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:37588/0 (socket says 172.21.15.46:37588) 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff700159890 0x7ff70015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39300/0 (socket says 172.21.15.46:39300) 2023-10-07T09:06:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.174+0000 7ff6fe59c700 1 -- 172.21.15.46:0/1056220062 learned_addr learned my addr 172.21.15.46:0/1056220062 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fed9d700 1 -- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 msgr2=0x7ff70015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fed9d700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fed9d700 1 -- 172.21.15.46:0/1056220062 >> v1:172.21.15.133:6789/0 conn(0x7ff70015db10 legacy=0x7ff700069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fed9d700 1 -- 172.21.15.46:0/1056220062 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70015a3d0 con 0x7ff700159890 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fe59c700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fed9d700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff700159890 0x7ff70015abd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009e60 tx=0x7ff6f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22bc7f5dffaa921a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fdd9b700 1 -- 172.21.15.46:0/1056220062 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000e070 con 0x7ff700159890 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fdd9b700 1 -- 172.21.15.46:0/1056220062 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000bb60 con 0x7ff700159890 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.175+0000 7ff6fdd9b700 1 -- 172.21.15.46:0/1056220062 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0012430 con 0x7ff700159890 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 -- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff700159890 msgr2=0x7ff70015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff700159890 0x7ff70015abd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009e60 tx=0x7ff6f0009780 comp rx=0 tx=0).stop 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 -- 172.21.15.46:0/1056220062 shutdown_connections 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff700159890 0x7ff70015abd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1056220062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159c60 0x7ff70015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 -- 172.21.15.46:0/1056220062 >> 172.21.15.46:0/1056220062 conn(0x7ff700068e20 msgr2=0x7ff7000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 -- 172.21.15.46:0/1056220062 shutdown_connections 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.176+0000 7ff7050ea700 1 -- 172.21.15.46:0/1056220062 wait complete. 2023-10-07T09:06:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.177+0000 7ff7050ea700 1 Processor -- start 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.177+0000 7ff7050ea700 1 -- start start 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159890 0x7ff70016a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff70015db10 0x7ff700069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70016abe0 con 0x7ff700159c60 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7001551a0 con 0x7ff70015db10 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff7050ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7001574c0 con 0x7ff700159890 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52884/0 (socket says 172.21.15.46:52884) 2023-10-07T09:06:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 -- 172.21.15.46:0/1075379610 learned_addr learned my addr 172.21.15.46:0/1075379610 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fed9d700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159890 0x7ff70016a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6ff59e700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff70015db10 0x7ff700069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 -- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159890 msgr2=0x7ff70016a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159890 0x7ff70016a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 -- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff70015db10 msgr2=0x7ff700069530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff70015db10 0x7ff700069530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 -- 172.21.15.46:0/1075379610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80094f0 con 0x7ff700159c60 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.178+0000 7ff6fe59c700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800ec80 tx=0x7ff6e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.179+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800c9d0 con 0x7ff700159c60 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.179+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800cb30 con 0x7ff700159c60 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.179+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f0009a20 con 0x7ff700159c60 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.179+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8013470 con 0x7ff700159c60 2023-10-07T09:06:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.179+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff700157a80 con 0x7ff700159c60 2023-10-07T09:06:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.180+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70004c3c0 con 0x7ff700159c60 2023-10-07T09:06:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.180+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff6e8013820 con 0x7ff700159c60 2023-10-07T09:06:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.181+0000 7ff6f6ffd700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.181+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7ff6e80851a0 con 0x7ff700159c60 2023-10-07T09:06:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.181+0000 7ff6fed9d700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.181+0000 7ff6fed9d700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 0x7ff6e00697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00097c0 tx=0x7ff6f0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.185+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6e8051de0 con 0x7ff700159c60 2023-10-07T09:06:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.424+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff70006a5b0 con 0x7ff700159c60 2023-10-07T09:06:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.424+0000 7ff6f6ffd700 1 -- 172.21.15.46:0/1075379610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4621 (secure 0 0 0) 0x7ff6e8055400 con 0x7ff700159c60 2023-10-07T09:06:08.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:08.425 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:05:50.084540+0000","modified":"2023-10-07T09:06:01.959233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/3882508029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3882508029},{"type":"v1","addr":"172.21.15.46:6834","nonce":3882508029}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000195165","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 msgr2=0x7ff6e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 0x7ff6e00697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00097c0 tx=0x7ff6f0019000 comp rx=0 tx=0).stop 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 msgr2=0x7ff7001502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800ec80 tx=0x7ff6e8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 shutdown_connections 2023-10-07T09:06:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff70015db10 0x7ff700069530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff700159890 0x7ff70016a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 --2- 172.21.15.46:0/1075379610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff700159c60 0x7ff7001502f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 >> 172.21.15.46:0/1075379610 conn(0x7ff700068e20 msgr2=0x7ff700150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 shutdown_connections 2023-10-07T09:06:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.426+0000 7ff7050ea700 1 -- 172.21.15.46:0/1075379610 wait complete. 2023-10-07T09:06:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 94 2023-10-07T09:06:08.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:08.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.557+0000 7febfaf67700 1 Processor -- start 2023-10-07T09:06:08.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.557+0000 7febfaf67700 1 -- start start 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febfaf67700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febf406c1e0 0x7febf40cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febfaf67700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febfaf67700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf406c750 con 0x7febf4157940 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febfaf67700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf406ca30 con 0x7febf406c1e0 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febfaf67700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf406cd10 con 0x7febf40cbc10 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febf8d03700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7febf4157940 0x7febf406f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54600/0 (socket says 172.21.15.46:54600) 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.558+0000 7febf8d03700 1 -- 172.21.15.46:0/3874561736 learned_addr learned my addr 172.21.15.46:0/3874561736 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 --2- 172.21.15.46:0/3874561736 >> v2:172.21.15.133:3300/0 conn(0x7febf406c1e0 0x7febf40cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf9504700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474771246 0 0) 0x7febf406c750 con 0x7febf4157940 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe0003570 con 0x7febf4157940 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 932759882 0 0) 0x7febe0003570 con 0x7febf4157940 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 -- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 msgr2=0x7febf415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 -- 172.21.15.46:0/3874561736 >> v1:172.21.15.46:6789/0 conn(0x7febf4157940 legacy=0x7febf406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 -- 172.21.15.46:0/3874561736 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf406cff0 con 0x7febf406c1e0 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf9504700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf3fff700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf40cb6d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7febe40098e0 tx=0x7febe40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550141a7b6f7505b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc001470 con 0x7febf406c1e0 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4011420 con 0x7febf406c1e0 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.559+0000 7febf37fe700 1 -- 172.21.15.46:0/3874561736 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40117c0 con 0x7febf406c1e0 2023-10-07T09:06:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 -- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 msgr2=0x7febf40cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf40cb6d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7febe40098e0 tx=0x7febe40091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 -- 172.21.15.46:0/3874561736 shutdown_connections 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 --2- 172.21.15.46:0/3874561736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf40cb6d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 -- 172.21.15.46:0/3874561736 >> 172.21.15.46:0/3874561736 conn(0x7febf40cd480 msgr2=0x7febf40cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 -- 172.21.15.46:0/3874561736 shutdown_connections 2023-10-07T09:06:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.560+0000 7febfaf67700 1 -- 172.21.15.46:0/3874561736 wait complete. 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.561+0000 7febfaf67700 1 Processor -- start 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.561+0000 7febfaf67700 1 -- start start 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4151ae0 con 0x7febf4157940 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4151d50 con 0x7febf406c1e0 2023-10-07T09:06:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febfaf67700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf4152030 con 0x7febf40cbc10 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52892/0 (socket says 172.21.15.46:52892) 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 -- 172.21.15.46:0/4020961243 learned_addr learned my addr 172.21.15.46:0/4020961243 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf8d03700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf3fff700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 -- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 msgr2=0x7febf4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 -- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 msgr2=0x7febf4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.562+0000 7febf9504700 1 -- 172.21.15.46:0/4020961243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009a20 con 0x7febf4157940 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febf9504700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7febec009fc0 tx=0x7febec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00cbd0 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00f040 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4009420 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec014480 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.563+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf41525f0 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.564+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf414f650 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.564+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7febec003020 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.565+0000 7febf0ff9700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 0x7febd40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.565+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7febec0856f0 con 0x7febf4157940 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.565+0000 7febf8d03700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 0x7febd40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.565+0000 7febf8d03700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 0x7febd40697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febdc0011e0 tx=0x7febdc001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.569+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febf414f650 con 0x7febf4157940 2023-10-07T09:06:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.761+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febf414f650 con 0x7febf4157940 2023-10-07T09:06:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.762+0000 7febf0ff9700 1 -- 172.21.15.46:0/4020961243 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15442 (secure 0 0 0) 0x7febf414f650 con 0x7febf4157940 2023-10-07T09:06:08.763 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:08.763 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":141,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:03.974460+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000195165.meta","create_time":"2023-10-07T09:05:47.894772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000195165"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000195165.data","create_time":"2023-10-07T09:05:48.940668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000195165"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 msgr2=0x7febd40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 0x7febd40697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febdc0011e0 tx=0x7febdc001a00 comp rx=0 tx=0).stop 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 msgr2=0x7febf40c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7febec009fc0 tx=0x7febec00b040 comp rx=0 tx=0).stop 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 shutdown_connections 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7febd4067320 0x7febd40697d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febf4157940 0x7febf40c76e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf406c1e0 0x7febf4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 --2- 172.21.15.46:0/4020961243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf40cbc10 0x7febf4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 >> 172.21.15.46:0/4020961243 conn(0x7febf40cd480 msgr2=0x7febf4153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 shutdown_connections 2023-10-07T09:06:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.764+0000 7febfaf67700 1 -- 172.21.15.46:0/4020961243 wait complete. 2023-10-07T09:06:08.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000195165 2023-10-07T09:06:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.896+0000 7efce55d9700 1 Processor -- start 2023-10-07T09:06:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.896+0000 7efce55d9700 1 -- start start 2023-10-07T09:06:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efce55d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 0x7efce015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efce55d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efce55d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce015c480 con 0x7efce0068bb0 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efce55d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce00b2a40 con 0x7efce0159c10 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efce55d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce015b5d0 con 0x7efce00b5ea0 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcdeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 0x7efce015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:37644/0 (socket says 172.21.15.46:37644) 2023-10-07T09:06:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 -- 172.21.15.46:0/402248965 learned_addr learned my addr 172.21.15.46:0/402248965 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:08.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcdf7fe700 1 --1- 172.21.15.46:0/402248965 >> v1:172.21.15.133:6789/0 conn(0x7efce0068bb0 0x7efce015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:51786/0 (socket says 172.21.15.46:51786) 2023-10-07T09:06:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 -- 172.21.15.46:0/402248965 >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 msgr2=0x7efce015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 --2- 172.21.15.46:0/402248965 >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 0x7efce015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 -- 172.21.15.46:0/402248965 >> v1:172.21.15.133:6789/0 conn(0x7efce0068bb0 legacy=0x7efce015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcde7fc700 1 -- 172.21.15.46:0/402248965 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce015b870 con 0x7efce00b5ea0 2023-10-07T09:06:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.897+0000 7efcdeffd700 1 --2- 172.21.15.46:0/402248965 >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 0x7efce015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efcde7fc700 1 --2- 172.21.15.46:0/402248965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcd40099b0 tx=0x7efcd4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44caa56f9571bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efcddffb700 1 -- 172.21.15.46:0/402248965 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4009ea0 con 0x7efce00b5ea0 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efcddffb700 1 -- 172.21.15.46:0/402248965 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd400b860 con 0x7efce00b5ea0 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efcddffb700 1 -- 172.21.15.46:0/402248965 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400bc00 con 0x7efce00b5ea0 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 -- 172.21.15.46:0/402248965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 msgr2=0x7efce0068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 --2- 172.21.15.46:0/402248965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcd40099b0 tx=0x7efcd4009250 comp rx=0 tx=0).stop 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 -- 172.21.15.46:0/402248965 shutdown_connections 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 --2- 172.21.15.46:0/402248965 >> v2:172.21.15.133:3300/0 conn(0x7efce0159c10 0x7efce015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 --2- 172.21.15.46:0/402248965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce00b5ea0 0x7efce0068670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 -- 172.21.15.46:0/402248965 >> 172.21.15.46:0/402248965 conn(0x7efce0099a20 msgr2=0x7efce00af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 -- 172.21.15.46:0/402248965 shutdown_connections 2023-10-07T09:06:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.898+0000 7efce55d9700 1 -- 172.21.15.46:0/402248965 wait complete. 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 Processor -- start 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 -- start start 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce0068bb0 0x7efce014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 0x7efce014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce014dff0 con 0x7efce00b5ea0 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce014e2d0 con 0x7efce0159c10 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efce55d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce014e5b0 con 0x7efce0068bb0 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.900+0000 7efcde7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52898/0 (socket says 172.21.15.46:52898) 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 -- 172.21.15.46:0/3214140504 learned_addr learned my addr 172.21.15.46:0/3214140504 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcdeffd700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce0068bb0 0x7efce014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcdf7fe700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 0x7efce014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 -- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce0068bb0 msgr2=0x7efce014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce0068bb0 0x7efce014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 -- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 msgr2=0x7efce014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 0x7efce014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 -- 172.21.15.46:0/3214140504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0009420 con 0x7efce00b5ea0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcdf7fe700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 0x7efce014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcde7fc700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efce015b710 tx=0x7efcd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400bbe0 con 0x7efce00b5ea0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4011420 con 0x7efce00b5ea0 2023-10-07T09:06:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd40094f0 con 0x7efce00b5ea0 2023-10-07T09:06:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40117c0 con 0x7efce00b5ea0 2023-10-07T09:06:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.901+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce014eb70 con 0x7efce00b5ea0 2023-10-07T09:06:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.902+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce014ed90 con 0x7efce00b5ea0 2023-10-07T09:06:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.903+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efcd4011bf0 con 0x7efce00b5ea0 2023-10-07T09:06:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.903+0000 7efcc6ffd700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 0x7efccc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.903+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7efcd4086520 con 0x7efce00b5ea0 2023-10-07T09:06:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.903+0000 7efcdeffd700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 0x7efccc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.904+0000 7efcdeffd700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 0x7efccc0697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ea0 tx=0x7efcd00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:08.908+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcd4053160 con 0x7efce00b5ea0 2023-10-07T09:06:09.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.144+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000195165"} v 0) v1 -- 0x7efce004c3c0 con 0x7efce00b5ea0 2023-10-07T09:06:09.145 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:06:09.145+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:06:09.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.149+0000 7efcc6ffd700 1 -- 172.21.15.46:0/3214140504 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000195165"}]=0 volume_0000000000195165 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 195+0+0 (secure 0 0 0) 0x7efcd4056780 con 0x7efce00b5ea0 2023-10-07T09:06:09.151 INFO:tasks.ceph.mds.c.smithi046.stderr: -759> 2023-10-07T09:05:55.530+0000 7f464618c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 msgr2=0x7efccc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 0x7efccc0697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ea0 tx=0x7efcd00091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 msgr2=0x7efce014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efce015b710 tx=0x7efcd4017000 comp rx=0 tx=0).stop 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 shutdown_connections 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efccc067320 0x7efccc0697d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0159c10 0x7efce014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efce0068bb0 0x7efce014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 --2- 172.21.15.46:0/3214140504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efce00b5ea0 0x7efce014f090 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 >> 172.21.15.46:0/3214140504 conn(0x7efce0099a20 msgr2=0x7efce009a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 shutdown_connections 2023-10-07T09:06:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.152+0000 7efce55d9700 1 -- 172.21.15.46:0/3214140504 wait complete. 2023-10-07T09:06:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:volume_0000000000195165 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:06:09.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000195165 --yes-i-really-mean-it 2023-10-07T09:06:09.172 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:06:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.287+0000 7fd200461700 1 Processor -- start 2023-10-07T09:06:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.287+0000 7fd200461700 1 -- start start 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd200461700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1f8069d60 0x7fd1f80c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd200461700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1f80c81f0 0x7fd1f80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd200461700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f806bdb0 con 0x7fd1f80aca80 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd200461700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80cb370 con 0x7fd1f8069d60 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd200461700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f8159f60 con 0x7fd1f80c81f0 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd1fd9fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1f8069d60 0x7fd1f80c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd1fe1fd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd1f80aca80 0x7fd1f806aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54616/0 (socket says 172.21.15.46:54616) 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.288+0000 7fd1fe1fd700 1 -- 172.21.15.46:0/4244209519 learned_addr learned my addr 172.21.15.46:0/4244209519 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fe9fe700 1 --2- 172.21.15.46:0/4244209519 >> v2:172.21.15.133:3300/0 conn(0x7fd1f80c81f0 0x7fd1f80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/4244209519 >> v2:172.21.15.133:3300/0 conn(0x7fd1f80c81f0 msgr2=0x7fd1f80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd9fc700 1 --2- 172.21.15.46:0/4244209519 >> v2:172.21.15.133:3300/0 conn(0x7fd1f80c81f0 0x7fd1f80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/4244209519 >> v1:172.21.15.46:6789/0 conn(0x7fd1f80aca80 legacy=0x7fd1f806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd1fb700 1 -- 172.21.15.46:0/4244209519 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662533500 0 0) 0x7fd1f806bdb0 con 0x7fd1f80aca80 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/4244209519 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f806b2b0 con 0x7fd1f8069d60 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd9fc700 1 --2- 172.21.15.46:0/4244209519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8069d60 0x7fd1f80c7cb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80b0190 tx=0x7fd1ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb2f88154ea437 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd1fb700 1 -- 172.21.15.46:0/4244209519 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00b6b0 con 0x7fd1f8069d60 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd1fb700 1 -- 172.21.15.46:0/4244209519 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec00b810 con 0x7fd1f8069d60 2023-10-07T09:06:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.289+0000 7fd1fd1fb700 1 -- 172.21.15.46:0/4244209519 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00bbb0 con 0x7fd1f8069d60 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 -- 172.21.15.46:0/4244209519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8069d60 msgr2=0x7fd1f80c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 --2- 172.21.15.46:0/4244209519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8069d60 0x7fd1f80c7cb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80b0190 tx=0x7fd1ec0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 -- 172.21.15.46:0/4244209519 shutdown_connections 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 --2- 172.21.15.46:0/4244209519 >> v2:172.21.15.133:3300/0 conn(0x7fd1f80c81f0 0x7fd1f80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 --2- 172.21.15.46:0/4244209519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8069d60 0x7fd1f80c7cb0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 -- 172.21.15.46:0/4244209519 >> 172.21.15.46:0/4244209519 conn(0x7fd1f80cd670 msgr2=0x7fd1f80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 -- 172.21.15.46:0/4244209519 shutdown_connections 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.290+0000 7fd200461700 1 -- 172.21.15.46:0/4244209519 wait complete. 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.291+0000 7fd200461700 1 Processor -- start 2023-10-07T09:06:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.291+0000 7fd200461700 1 -- start start 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1f8069d60 0x7fd1f815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1f80c81f0 0x7fd1f80b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815b380 con 0x7fd1f80aca80 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815a770 con 0x7fd1f80c81f0 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815aa50 con 0x7fd1f8069d60 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52930/0 (socket says 172.21.15.46:52930) 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/2147393736 learned_addr learned my addr 172.21.15.46:0/2147393736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fe1fd700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1f8069d60 0x7fd1f815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fe9fe700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1f80c81f0 0x7fd1f80b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1f8069d60 msgr2=0x7fd1f815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1f8069d60 0x7fd1f815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1f80c81f0 msgr2=0x7fd1f80b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1f80c81f0 0x7fd1f80b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 -- 172.21.15.46:0/2147393736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec009420 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1fd9fc700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec013000 tx=0x7fd1ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00bb90 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec011420 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f815ad30 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0117c0 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.292+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f80b2080 con 0x7fd1f80aca80 2023-10-07T09:06:09.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.293+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f815b4f0 con 0x7fd1f80aca80 2023-10-07T09:06:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.294+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1ec011bf0 con 0x7fd1f80aca80 2023-10-07T09:06:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.294+0000 7fd1f67fc700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 0x7fd1e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.294+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fd1ec0866f0 con 0x7fd1f80aca80 2023-10-07T09:06:09.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.294+0000 7fd1fe1fd700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 0x7fd1e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:09.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.295+0000 7fd1fe1fd700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 0x7fd1e40697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0001360 tx=0x7fd1f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:09.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.298+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1ec0532e0 con 0x7fd1f80aca80 2023-10-07T09:06:09.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:09.536+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000195165", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd1f804c3c0 con 0x7fd1f80aca80 2023-10-07T09:06:10.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.153+0000 7fd1f67fc700 1 -- 172.21.15.46:0/2147393736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000195165", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd1ec056900 con 0x7fd1f80aca80 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.155+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 msgr2=0x7fd1e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.155+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 0x7fd1e40697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0001360 tx=0x7fd1f0009040 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.155+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 msgr2=0x7fd1f81574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.155+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec013000 tx=0x7fd1ec017000 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 shutdown_connections 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd1e4067320 0x7fd1e40697d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1f80c81f0 0x7fd1f80b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1f8069d60 0x7fd1f815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 --2- 172.21.15.46:0/2147393736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f80aca80 0x7fd1f81574c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 >> 172.21.15.46:0/2147393736 conn(0x7fd1f80cd670 msgr2=0x7fd1f80c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:10.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 shutdown_connections 2023-10-07T09:06:10.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.156+0000 7fd200461700 1 -- 172.21.15.46:0/2147393736 wait complete. 2023-10-07T09:06:10.171 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000195165.meta cephfs.volume_0000000000195165.meta --yes-i-really-really-mean-it 2023-10-07T09:06:10.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.343+0000 7f30cca7b700 1 Processor -- start 2023-10-07T09:06:10.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.343+0000 7f30cca7b700 1 -- start start 2023-10-07T09:06:10.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30cca7b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c80cd910 0x7f30c80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30cca7b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30c80b55a0 0x7f30c80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30cca7b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80b5b00 con 0x7f30c8159ec0 2023-10-07T09:06:10.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30cca7b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80b5da0 con 0x7f30c80b55a0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30cca7b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80b6080 con 0x7f30c80cd910 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30c6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30c80b55a0 0x7f30c80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30c6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30c80b55a0 0x7f30c80ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46186/0 (socket says 172.21.15.46:46186) 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30c6d9d700 1 -- 172.21.15.46:0/288552047 learned_addr learned my addr 172.21.15.46:0/288552047 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.344+0000 7f30c5d9b700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c80cd910 0x7f30c80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c6d9d700 1 -- 172.21.15.46:0/288552047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c80cd910 msgr2=0x7f30c80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c6d9d700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c80cd910 0x7f30c80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c6d9d700 1 -- 172.21.15.46:0/288552047 >> v1:172.21.15.133:6789/0 conn(0x7f30c8159ec0 legacy=0x7f30c80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c6d9d700 1 -- 172.21.15.46:0/288552047 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80cc100 con 0x7f30c80b55a0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c6d9d700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c80b55a0 0x7f30c80ce880 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009f20 tx=0x7f30c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0fd7b7a1fa0040 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c559a700 1 -- 172.21.15.46:0/288552047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000e070 con 0x7f30c80b55a0 2023-10-07T09:06:10.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c559a700 1 -- 172.21.15.46:0/288552047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000ba80 con 0x7f30c80b55a0 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30c559a700 1 -- 172.21.15.46:0/288552047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c00092e0 con 0x7f30c80b55a0 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 -- 172.21.15.46:0/288552047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c80b55a0 msgr2=0x7f30c80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c80b55a0 0x7f30c80ce880 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009f20 tx=0x7f30c0009840 comp rx=0 tx=0).stop 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 -- 172.21.15.46:0/288552047 shutdown_connections 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c80b55a0 0x7f30c80ce880 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 --2- 172.21.15.46:0/288552047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c80cd910 0x7f30c80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 -- 172.21.15.46:0/288552047 >> 172.21.15.46:0/288552047 conn(0x7f30c80999f0 msgr2=0x7f30c80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 -- 172.21.15.46:0/288552047 shutdown_connections 2023-10-07T09:06:10.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.345+0000 7f30cca7b700 1 -- 172.21.15.46:0/288552047 wait complete. 2023-10-07T09:06:10.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 Processor -- start 2023-10-07T09:06:10.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 -- start start 2023-10-07T09:06:10.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 0x7f30c81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 0x7f30c809dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8152d80 con 0x7f30c81515c0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80698e0 con 0x7f30c80b55a0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30cca7b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8068d50 con 0x7f30c8159ec0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30c6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30c6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46192/0 (socket says 172.21.15.46:46192) 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.347+0000 7f30c6d9d700 1 -- 172.21.15.46:0/1953865329 learned_addr learned my addr 172.21.15.46:0/1953865329 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c5d9b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 0x7f30c809dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c659c700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 0x7f30c81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 -- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 msgr2=0x7f30c809dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 0x7f30c809dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 -- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 msgr2=0x7f30c81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 0x7f30c81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 -- 172.21.15.46:0/1953865329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009ae0 con 0x7f30c81515c0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c5d9b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 0x7f30c809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c659c700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 0x7f30c81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30c6d9d700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f30c000b6c0 tx=0x7f30c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c00032f0 con 0x7f30c81515c0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0008e40 con 0x7f30c81515c0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c001c620 con 0x7f30c81515c0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c8068fb0 con 0x7f30c81515c0 2023-10-07T09:06:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.348+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c8069570 con 0x7f30c81515c0 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.349+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c8069a90 con 0x7f30c81515c0 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.349+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30c0003040 con 0x7f30c81515c0 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.350+0000 7f30be7fc700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 0x7f30a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.350+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f30c0086660 con 0x7f30c81515c0 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.350+0000 7f30c659c700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 0x7f30a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:10.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.351+0000 7f30c659c700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 0x7f30a80697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.354+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30c8069a90 con 0x7f30c81515c0 2023-10-07T09:06:10.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:10.548+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000195165.meta", "pool2": "cephfs.volume_0000000000195165.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30c8063c90 con 0x7f30c81515c0 2023-10-07T09:06:11.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.157+0000 7f30be7fc700 1 -- 172.21.15.46:0/1953865329 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000195165.meta", "pool2": "cephfs.volume_0000000000195165.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000195165.meta' removed v143) v1 ==== 241+0+0 (secure 0 0 0) 0x7f30c0053240 con 0x7f30c81515c0 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 msgr2=0x7f30a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 0x7f30a80697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8009040 comp rx=0 tx=0).stop 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 msgr2=0x7f30c80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f30c000b6c0 tx=0x7f30c0018000 comp rx=0 tx=0).stop 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 shutdown_connections 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f30a8067320 0x7f30a80697d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c81515c0 0x7f30c80c8a30 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80b55a0 0x7f30c81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.161+0000 7f30cca7b700 1 --2- 172.21.15.46:0/1953865329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30c8159ec0 0x7f30c809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.162+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 >> 172.21.15.46:0/1953865329 conn(0x7f30c80999f0 msgr2=0x7f30c80c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:11.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.162+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 shutdown_connections 2023-10-07T09:06:11.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.162+0000 7f30cca7b700 1 -- 172.21.15.46:0/1953865329 wait complete. 2023-10-07T09:06:11.164 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000000195165.meta' removed 2023-10-07T09:06:11.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000195165.data cephfs.volume_0000000000195165.data --yes-i-really-really-mean-it 2023-10-07T09:06:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.308+0000 7fd763358700 1 Processor -- start 2023-10-07T09:06:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.308+0000 7fd763358700 1 -- start start 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd763358700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd75c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd763358700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0b5b00 con 0x7fd75c0b53d0 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd763358700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0b5da0 con 0x7fd75c0cf350 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd763358700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0b6080 con 0x7fd75c159ec0 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd7608f3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd75c0b53d0 0x7fd75c0cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34244/0 (socket says 172.21.15.46:34244) 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd7608f3700 1 -- 172.21.15.46:0/3866986077 learned_addr learned my addr 172.21.15.46:0/3866986077 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd75c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049004658 0 0) 0x7fd75c0b5b00 con 0x7fd75c0b53d0 2023-10-07T09:06:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd748003570 con 0x7fd75c0b53d0 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090249746 0 0) 0x7fd75c0b5da0 con 0x7fd75c0cf350 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75c0b5b00 con 0x7fd75c0cf350 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739467065 0 0) 0x7fd748003570 con 0x7fd75c0b53d0 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 msgr2=0x7fd75c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd75c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 >> v1:172.21.15.133:6789/0 conn(0x7fd75c0cf350 legacy=0x7fd75c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0cc100 con 0x7fd75c0b53d0 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd74c001470 con 0x7fd75c0b53d0 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 >> v1:172.21.15.46:6789/0 conn(0x7fd75c0b53d0 legacy=0x7fd75c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd748004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.309+0000 7fd753fff700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd748004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd748004d50 0x7fd7480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0b6080 con 0x7fd748003c20 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74800bb40 con 0x7fd748004d50 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74800bd00 con 0x7fd75c159ec0 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd748004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7608f3700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd748004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7618f5700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd748004d50 0x7fd7480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 -- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 msgr2=0x7fd748004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c159ec0 0x7fd748004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 -- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd748004d50 msgr2=0x7fd7480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd748004d50 0x7fd7480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 -- 172.21.15.46:0/3866986077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748003570 con 0x7fd748003c20 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd748004010 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd758009bf0 tx=0x7fd758009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64f011d806c2967 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758005a00 con 0x7fd748003c20 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758005b60 con 0x7fd748003c20 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.310+0000 7fd753fff700 1 -- 172.21.15.46:0/3866986077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800e710 con 0x7fd748003c20 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 -- 172.21.15.46:0/3866986077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 msgr2=0x7fd748004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 --2- 172.21.15.46:0/3866986077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd748004010 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd758009bf0 tx=0x7fd758009120 comp rx=0 tx=0).stop 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd7618f5700 1 -- 172.21.15.46:0/3866986077 reap_dead start 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 -- 172.21.15.46:0/3866986077 shutdown_connections 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 -- 172.21.15.46:0/3866986077 >> 172.21.15.46:0/3866986077 conn(0x7fd75c0999f0 msgr2=0x7fd75c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 -- 172.21.15.46:0/3866986077 shutdown_connections 2023-10-07T09:06:11.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.311+0000 7fd763358700 1 -- 172.21.15.46:0/3866986077 wait complete. 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.312+0000 7fd763358700 1 Processor -- start 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.312+0000 7fd763358700 1 -- start start 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c1522a0 0x7fd75c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd75c16aa20 0x7fd75c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c06b340 con 0x7fd748003c20 2023-10-07T09:06:11.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c16a590 con 0x7fd75c16aa20 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd763358700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c16a240 con 0x7fd75c1522a0 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46208/0 (socket says 172.21.15.46:46208) 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 -- 172.21.15.46:0/3463614709 learned_addr learned my addr 172.21.15.46:0/3463614709 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7608f3700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c1522a0 0x7fd75c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7618f5700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd75c16aa20 0x7fd75c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 -- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c1522a0 msgr2=0x7fd75c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c1522a0 0x7fd75c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 -- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd75c16aa20 msgr2=0x7fd75c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd75c16aa20 0x7fd75c154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 -- 172.21.15.46:0/3463614709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c152c30 con 0x7fd748003c20 2023-10-07T09:06:11.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.313+0000 7fd7610f4700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd748004790 tx=0x7fd758019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.314+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758006240 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.314+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580063a0 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.314+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c152f10 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.314+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758006760 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.314+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c151e30 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.315+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c0b2af0 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.315+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd758013680 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.315+0000 7fd7517fa700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 0x7fd7400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.316+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5394+0+0 (secure 0 0 0) 0x7fd7580861b0 con 0x7fd748003c20 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.316+0000 7fd7608f3700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 0x7fd7400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:11.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.316+0000 7fd7608f3700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 0x7fd7400697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd75c152670 tx=0x7fd74c001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:11.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.320+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd758053080 con 0x7fd748003c20 2023-10-07T09:06:11.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:11.518+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000195165.data", "pool2": "cephfs.volume_0000000000195165.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd75c16a870 con 0x7fd748003c20 2023-10-07T09:06:12.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.161+0000 7fd7517fa700 1 -- 172.21.15.46:0/3463614709 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000195165.data", "pool2": "cephfs.volume_0000000000195165.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000195165.data' removed v144) v1 ==== 241+0+0 (secure 0 0 0) 0x7fd7580566a0 con 0x7fd748003c20 2023-10-07T09:06:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.165+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 msgr2=0x7fd7400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.165+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 0x7fd7400697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd75c152670 tx=0x7fd74c001e10 comp rx=0 tx=0).stop 2023-10-07T09:06:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.166+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 msgr2=0x7fd75c1518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.166+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd748004790 tx=0x7fd758019000 comp rx=0 tx=0).stop 2023-10-07T09:06:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 shutdown_connections 2023-10-07T09:06:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd740067320 0x7fd7400697d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd75c16aa20 0x7fd75c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd748003c20 0x7fd75c1518f0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 --2- 172.21.15.46:0/3463614709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd75c1522a0 0x7fd75c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 >> 172.21.15.46:0/3463614709 conn(0x7fd75c0999f0 msgr2=0x7fd75c159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.167+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 shutdown_connections 2023-10-07T09:06:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.168+0000 7fd763358700 1 -- 172.21.15.46:0/3463614709 wait complete. 2023-10-07T09:06:12.170 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000000195165.data' removed 2023-10-07T09:06:12.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:06:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.309+0000 7f472dfa2700 1 Processor -- start 2023-10-07T09:06:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.309+0000 7f472dfa2700 1 -- start start 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f472dfa2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f472806eb80 0x7f47280b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f472dfa2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280b27b0 con 0x7f47280b0d20 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f472dfa2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280b1de0 con 0x7f4728159a50 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f472dfa2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47280c9180 con 0x7f472806eb80 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f472d7a1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f472806eb80 0x7f47280b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f4727fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f47280b0d20 0x7f472806e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34254/0 (socket says 172.21.15.46:34254) 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.310+0000 7f4727fff700 1 -- 172.21.15.46:0/3437335047 learned_addr learned my addr 172.21.15.46:0/3437335047 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f472d7a1700 1 -- 172.21.15.46:0/3437335047 >> v1:172.21.15.133:6789/0 conn(0x7f4728159a50 legacy=0x7f47280b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f472d7a1700 1 -- 172.21.15.46:0/3437335047 >> v1:172.21.15.46:6789/0 conn(0x7f47280b0d20 legacy=0x7f472806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f47277fe700 1 -- 172.21.15.46:0/3437335047 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981780944 0 0) 0x7f471c001110 con 0x7f47280b0d20 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f472d7a1700 1 -- 172.21.15.46:0/3437335047 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280b11d0 con 0x7f472806eb80 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f472d7a1700 1 --2- 172.21.15.46:0/3437335047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f472806eb80 0x7f47280b2270 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f4720009e60 tx=0x7f4720009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5483a4c4cb5fcd3c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f47277fe700 1 -- 172.21.15.46:0/3437335047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000e070 con 0x7f472806eb80 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f47277fe700 1 -- 172.21.15.46:0/3437335047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000bc30 con 0x7f472806eb80 2023-10-07T09:06:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.311+0000 7f47277fe700 1 -- 172.21.15.46:0/3437335047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720012430 con 0x7f472806eb80 2023-10-07T09:06:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 -- 172.21.15.46:0/3437335047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f472806eb80 msgr2=0x7f47280b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 --2- 172.21.15.46:0/3437335047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f472806eb80 0x7f47280b2270 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f4720009e60 tx=0x7f4720009780 comp rx=0 tx=0).stop 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 -- 172.21.15.46:0/3437335047 shutdown_connections 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 --2- 172.21.15.46:0/3437335047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f472806eb80 0x7f47280b2270 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 -- 172.21.15.46:0/3437335047 >> 172.21.15.46:0/3437335047 conn(0x7f47280c9f70 msgr2=0x7f472806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 -- 172.21.15.46:0/3437335047 shutdown_connections 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.312+0000 7f472dfa2700 1 -- 172.21.15.46:0/3437335047 wait complete. 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.313+0000 7f472dfa2700 1 Processor -- start 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.313+0000 7f472dfa2700 1 -- start start 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 0x7f47281550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4728159a50 0x7f47281536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472815a8b0 con 0x7f47280b0d20 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472815ab20 con 0x7f472806eb80 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472dfa2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472815ae00 con 0x7f4728159a50 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46230/0 (socket says 172.21.15.46:46230) 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 -- 172.21.15.46:0/364007157 learned_addr learned my addr 172.21.15.46:0/364007157 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472cfa0700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 0x7f47281550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472d7a1700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4728159a50 0x7f47281536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 -- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4728159a50 msgr2=0x7f47281536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4728159a50 0x7f47281536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 -- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 msgr2=0x7f47281550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 0x7f47281550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 -- 172.21.15.46:0/364007157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009a20 con 0x7f47280b0d20 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f472cfa0700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 0x7f47281550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.314+0000 7f4727fff700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c810 tx=0x7f471c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.315+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c005b30 con 0x7f47280b0d20 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.315+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c005c90 con 0x7f47280b0d20 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.315+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472815b0e0 con 0x7f47280b0d20 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.315+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c007300 con 0x7f47280b0d20 2023-10-07T09:06:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.315+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472815b6a0 con 0x7f47280b0d20 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.316+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472815b890 con 0x7f47280b0d20 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.316+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f471c0076f0 con 0x7f47280b0d20 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.316+0000 7f4724ff9700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 0x7f47140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.316+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f471c084380 con 0x7f47280b0d20 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.317+0000 7f472cfa0700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 0x7f47140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.317+0000 7f472cfa0700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 0x7f47140697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4718007fd0 tx=0x7f4718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.321+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f471c054da0 con 0x7f47280b0d20 2023-10-07T09:06:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.522+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f47280b27b0 con 0x7f47280b0d20 2023-10-07T09:06:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.526+0000 7f4724ff9700 1 -- 172.21.15.46:0/364007157 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47280b27b0 con 0x7f47280b0d20 2023-10-07T09:06:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 msgr2=0x7f47140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 0x7f47140697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4718007fd0 tx=0x7f4718009040 comp rx=0 tx=0).stop 2023-10-07T09:06:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 msgr2=0x7f47281555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c810 tx=0x7f471c007c50 comp rx=0 tx=0).stop 2023-10-07T09:06:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 shutdown_connections 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4714067320 0x7f47140697d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4728159a50 0x7f47281536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f472806eb80 0x7f47281550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 --2- 172.21.15.46:0/364007157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47280b0d20 0x7f47281555e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 >> 172.21.15.46:0/364007157 conn(0x7f47280c9f70 msgr2=0x7f47280c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 shutdown_connections 2023-10-07T09:06:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.528+0000 7f472dfa2700 1 -- 172.21.15.46:0/364007157 wait complete. 2023-10-07T09:06:12.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-07T09:06:12.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.660+0000 7f6b5b951700 1 Processor -- start 2023-10-07T09:06:12.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.660+0000 7f6b5b951700 1 -- start start 2023-10-07T09:06:12.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b5b951700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b5415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b5b951700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b5415db10 0x7f6b54069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b5b951700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5415a160 con 0x7f6b54159890 2023-10-07T09:06:12.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b5b951700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b540d13a0 con 0x7f6b5415db10 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b5b951700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5415e140 con 0x7f6b54159c60 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b596ed700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6b54159890 0x7f6b5415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34264/0 (socket says 172.21.15.46:34264) 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b596ed700 1 -- 172.21.15.46:0/1129586442 learned_addr learned my addr 172.21.15.46:0/1129586442 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b58eec700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b5415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b59eee700 1 --2- 172.21.15.46:0/1129586442 >> v2:172.21.15.133:3300/0 conn(0x7f6b5415db10 0x7f6b54069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056830306 0 0) 0x7f6b5415a160 con 0x7f6b54159890 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b40003570 con 0x7f6b54159890 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125086111 0 0) 0x7f6b40003570 con 0x7f6b54159890 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 msgr2=0x7f6b5415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b5415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 >> v2:172.21.15.133:3300/0 conn(0x7f6b5415db10 msgr2=0x7f6b54069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:12.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 --2- 172.21.15.46:0/1129586442 >> v2:172.21.15.133:3300/0 conn(0x7f6b5415db10 0x7f6b54069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5415a3d0 con 0x7f6b54159890 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f6b50001470 con 0x7f6b54159890 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.661+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 >> v1:172.21.15.46:6789/0 conn(0x7f6b54159890 legacy=0x7f6b5415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40003a60 0x7f6b40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b40004810 0x7f6b40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540d13a0 con 0x7f6b40004810 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5415e140 con 0x7f6b40003a60 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4000ba60 con 0x7f6b54159c60 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b40004810 0x7f6b40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b596ed700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40003a60 0x7f6b40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b59eee700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 -- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 msgr2=0x7f6b400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 -- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40003a60 msgr2=0x7f6b40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40003a60 0x7f6b40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 -- 172.21.15.46:0/1129586442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40003570 con 0x7f6b40004810 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b596ed700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40003a60 0x7f6b40003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b59eee700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b54159c60 0x7f6b400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b58eec700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b40004810 0x7f6b40004c80 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009c00 tx=0x7f6b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6bc65847ab29c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400e710 con 0x7f6b40004810 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4400e870 con 0x7f6b40004810 2023-10-07T09:06:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.662+0000 7f6b4bfff700 1 -- 172.21.15.46:0/1129586442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400ec30 con 0x7f6b40004810 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 -- 172.21.15.46:0/1129586442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b40004810 msgr2=0x7f6b40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 --2- 172.21.15.46:0/1129586442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b40004810 0x7f6b40004c80 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009c00 tx=0x7f6b440091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b59eee700 1 -- 172.21.15.46:0/1129586442 reap_dead start 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 -- 172.21.15.46:0/1129586442 shutdown_connections 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 -- 172.21.15.46:0/1129586442 >> 172.21.15.46:0/1129586442 conn(0x7f6b54068e20 msgr2=0x7f6b540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 -- 172.21.15.46:0/1129586442 shutdown_connections 2023-10-07T09:06:12.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.663+0000 7f6b5b951700 1 -- 172.21.15.46:0/1129586442 wait complete. 2023-10-07T09:06:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.664+0000 7f6b5b951700 1 Processor -- start 2023-10-07T09:06:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.664+0000 7f6b5b951700 1 -- start start 2023-10-07T09:06:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 0x7f6b540c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b540c97a0 0x7f6b54169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540c8db0 con 0x7f6b5416a060 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5416aa40 con 0x7f6b40004810 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b5b951700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540c81a0 con 0x7f6b540c97a0 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46252/0 (socket says 172.21.15.46:46252) 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 -- 172.21.15.46:0/2025808447 learned_addr learned my addr 172.21.15.46:0/2025808447 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b58eec700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b540c97a0 0x7f6b54169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b596ed700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 0x7f6b540c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 -- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b540c97a0 msgr2=0x7f6b54169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b540c97a0 0x7f6b54169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 -- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 msgr2=0x7f6b540c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 0x7f6b540c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b59eee700 1 -- 172.21.15.46:0/2025808447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540c8480 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.665+0000 7f6b596ed700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 0x7f6b540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b59eee700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6b5406a890 tx=0x7f6b4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c01b070 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c00f040 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b540c8760 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00e050 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.666+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540c7de0 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.667+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5404c3c0 con 0x7f6b5416a060 2023-10-07T09:06:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.667+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b4c003020 con 0x7f6b5416a060 2023-10-07T09:06:12.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.668+0000 7f6b497fa700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 0x7f6b380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:12.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.668+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6b4c084fa0 con 0x7f6b5416a060 2023-10-07T09:06:12.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.668+0000 7f6b596ed700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 0x7f6b380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:12.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.668+0000 7f6b596ed700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 0x7f6b380697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b50000e10 tx=0x7f6b50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:12.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.672+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b4c051e20 con 0x7f6b5416a060 2023-10-07T09:06:12.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:06:12.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:06:12.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:12.950+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f6b540c8ef0 con 0x7f6b5416a060 2023-10-07T09:06:13.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.162+0000 7f6b497fa700 1 -- 172.21.15.46:0/2025808447 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v380) v1 ==== 135+0+0 (secure 0 0 0) 0x7f6b540c8ef0 con 0x7f6b5416a060 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 msgr2=0x7f6b380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 0x7f6b380697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b50000e10 tx=0x7f6b50009040 comp rx=0 tx=0).stop 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 msgr2=0x7f6b5416a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6b5406a890 tx=0x7f6b4c00b040 comp rx=0 tx=0).stop 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 shutdown_connections 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6b38067320 0x7f6b380697d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b5416a060 0x7f6b5416a500 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b40004810 0x7f6b540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 --2- 172.21.15.46:0/2025808447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b540c97a0 0x7f6b54169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 >> 172.21.15.46:0/2025808447 conn(0x7f6b54068e20 msgr2=0x7f6b54153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 shutdown_connections 2023-10-07T09:06:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.164+0000 7f6b5b951700 1 -- 172.21.15.46:0/2025808447 wait complete. 2023-10-07T09:06:13.177 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ok 2023-10-07T09:06:13.177 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) That renaming volume fails without --yes-i-really-mean-it flag. 2023-10-07T09:06:13.177 INFO:tasks.cephfs_test_runner:test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:06:13.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-07T09:06:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.297+0000 7f06315e7700 1 Processor -- start 2023-10-07T09:06:13.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.297+0000 7f06315e7700 1 -- start start 2023-10-07T09:06:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f06315e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f06315e7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f06315e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c15a160 con 0x7f062c159c60 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f06315e7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c069f20 con 0x7f062c069560 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f06315e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0d13a0 con 0x7f062c159890 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:34666/0 (socket says 172.21.15.46:34666) 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062b7fe700 1 -- 172.21.15.46:0/895248714 learned_addr learned my addr 172.21.15.46:0/895248714 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:13.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f062c159c60 0x7f062c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:59992/0 (socket says 172.21.15.46:59992) 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062affd700 1 -- 172.21.15.46:0/895248714 >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 msgr2=0x7f062c0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.298+0000 7f062affd700 1 --2- 172.21.15.46:0/895248714 >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f062affd700 1 -- 172.21.15.46:0/895248714 >> v1:172.21.15.133:6789/0 conn(0x7f062c159c60 legacy=0x7f062c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f062affd700 1 -- 172.21.15.46:0/895248714 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c15e140 con 0x7f062c159890 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f062b7fe700 1 --2- 172.21.15.46:0/895248714 >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f062affd700 1 --2- 172.21.15.46:0/895248714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c15abd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06240098e0 tx=0x7f06240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=298b437645c79005 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:13.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f0629ffb700 1 -- 172.21.15.46:0/895248714 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400b640 con 0x7f062c159890 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f0629ffb700 1 -- 172.21.15.46:0/895248714 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062400b7a0 con 0x7f062c159890 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f0629ffb700 1 -- 172.21.15.46:0/895248714 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400bb40 con 0x7f062c159890 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 -- 172.21.15.46:0/895248714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 msgr2=0x7f062c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 --2- 172.21.15.46:0/895248714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c15abd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06240098e0 tx=0x7f06240091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 -- 172.21.15.46:0/895248714 shutdown_connections 2023-10-07T09:06:13.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 --2- 172.21.15.46:0/895248714 >> v2:172.21.15.133:3300/0 conn(0x7f062c069560 0x7f062c0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 --2- 172.21.15.46:0/895248714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c15abd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.299+0000 7f06315e7700 1 -- 172.21.15.46:0/895248714 >> 172.21.15.46:0/895248714 conn(0x7f062c068e20 msgr2=0x7f062c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:13.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.300+0000 7f06315e7700 1 -- 172.21.15.46:0/895248714 shutdown_connections 2023-10-07T09:06:13.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.300+0000 7f06315e7700 1 -- 172.21.15.46:0/895248714 wait complete. 2023-10-07T09:06:13.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.301+0000 7f06315e7700 1 Processor -- start 2023-10-07T09:06:13.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.301+0000 7f06315e7700 1 -- start start 2023-10-07T09:06:13.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 0x7f062c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c16ad90 con 0x7f062c069560 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b5130 con 0x7f062c159c60 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b5410 con 0x7f062c159890 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46262/0 (socket says 172.21.15.46:46262) 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 -- 172.21.15.46:0/3024053495 learned_addr learned my addr 172.21.15.46:0/3024053495 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062a7fc700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062b7fe700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 0x7f062c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 -- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 msgr2=0x7f062c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 -- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 msgr2=0x7f062c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 0x7f062c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 -- 172.21.15.46:0/3024053495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009ae0 con 0x7f062c069560 2023-10-07T09:06:13.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062b7fe700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 0x7f062c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062a7fc700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f062affd700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f062c070e20 tx=0x7f0624017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062401bda0 con 0x7f062c069560 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011420 con 0x7f062c069560 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240117e0 con 0x7f062c069560 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.302+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624009420 con 0x7f062c069560 2023-10-07T09:06:13.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.303+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c0b59d0 con 0x7f062c069560 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.303+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c04c3c0 con 0x7f062c069560 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.304+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0624011b50 con 0x7f062c069560 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.304+0000 7f0622ffd700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 0x7f060c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.304+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0624086100 con 0x7f062c069560 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.304+0000 7f062a7fc700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 0x7f060c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:13.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.305+0000 7f062a7fc700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 0x7f060c0697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0614007fd0 tx=0x7f0614007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:13.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.309+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0624053090 con 0x7f062c069560 2023-10-07T09:06:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:13.580+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f062c0ca720 con 0x7f062c069560 2023-10-07T09:06:14.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.165+0000 7f0622ffd700 1 -- 172.21.15.46:0/3024053495 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v381) v1 ==== 170+0+0 (secure 0 0 0) 0x7f06240566b0 con 0x7f062c069560 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 msgr2=0x7f060c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 0x7f060c0697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0614007fd0 tx=0x7f0614007e10 comp rx=0 tx=0).stop 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 msgr2=0x7f062c16a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f062c070e20 tx=0x7f0624017000 comp rx=0 tx=0).stop 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 shutdown_connections 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f060c067320 0x7f060c0697d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f062c159c60 0x7f062c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f062c069560 0x7f062c16a850 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 --2- 172.21.15.46:0/3024053495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f062c159890 0x7f062c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 >> 172.21.15.46:0/3024053495 conn(0x7f062c068e20 msgr2=0x7f062c15b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 shutdown_connections 2023-10-07T09:06:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.168+0000 7f06315e7700 1 -- 172.21.15.46:0/3024053495 wait complete. 2023-10-07T09:06:14.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:06:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.305+0000 7fb288b19700 1 Processor -- start 2023-10-07T09:06:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.305+0000 7fb288b19700 1 -- start start 2023-10-07T09:06:14.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.306+0000 7fb288b19700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb28415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.306+0000 7fb288b19700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28415a160 con 0x7fb284069560 2023-10-07T09:06:14.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.306+0000 7fb288b19700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2840d13a0 con 0x7fb284159c60 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.306+0000 7fb288b19700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28415e140 con 0x7fb284159890 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.306+0000 7fb282d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb284069560 0x7fb2840ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34274/0 (socket says 172.21.15.46:34274) 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb282d9d700 1 -- 172.21.15.46:0/4003236693 learned_addr learned my addr 172.21.15.46:0/4003236693 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28259c700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb28415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819271689 0 0) 0x7fb28415a160 con 0x7fb284069560 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb270003570 con 0x7fb284069560 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827483649 0 0) 0x7fb270003570 con 0x7fb284069560 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 msgr2=0x7fb28415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb28415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 >> v1:172.21.15.133:6789/0 conn(0x7fb284159c60 legacy=0x7fb28415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28415a3d0 con 0x7fb284069560 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb27c0017f0 con 0x7fb284069560 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 >> v1:172.21.15.46:6789/0 conn(0x7fb284069560 legacy=0x7fb2840ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb270003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb270004010 0x7fb270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004d50 0x7fb2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28415e140 con 0x7fb270004010 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27000bbf0 con 0x7fb270004d50 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27000bdb0 con 0x7fb284159890 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb281d9b700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb270004010 0x7fb270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb28259c700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb270003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.307+0000 7fb282d9d700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004d50 0x7fb2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 -- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 msgr2=0x7fb270003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb284159890 0x7fb270003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 -- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004d50 msgr2=0x7fb2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004d50 0x7fb2700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 -- 172.21.15.46:0/4003236693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270003570 con 0x7fb270004010 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb282d9d700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004d50 0x7fb2700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb281d9b700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb270004010 0x7fb270004810 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb28415a090 tx=0x7fb26c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d965999254f7cb55 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c012420 con 0x7fb270004010 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c012580 con 0x7fb270004010 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb28159a700 1 -- 172.21.15.46:0/4003236693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c012920 con 0x7fb270004010 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb288b19700 1 -- 172.21.15.46:0/4003236693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb270004010 msgr2=0x7fb270004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb288b19700 1 --2- 172.21.15.46:0/4003236693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb270004010 0x7fb270004810 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb28415a090 tx=0x7fb26c007d30 comp rx=0 tx=0).stop 2023-10-07T09:06:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb282d9d700 1 -- 172.21.15.46:0/4003236693 reap_dead start 2023-10-07T09:06:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb288b19700 1 -- 172.21.15.46:0/4003236693 shutdown_connections 2023-10-07T09:06:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.308+0000 7fb288b19700 1 -- 172.21.15.46:0/4003236693 >> 172.21.15.46:0/4003236693 conn(0x7fb284068e20 msgr2=0x7fb2840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.309+0000 7fb288b19700 1 -- 172.21.15.46:0/4003236693 shutdown_connections 2023-10-07T09:06:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.309+0000 7fb288b19700 1 -- 172.21.15.46:0/4003236693 wait complete. 2023-10-07T09:06:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 Processor -- start 2023-10-07T09:06:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 -- start start 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 0x7fb284156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2840cf9e0 0x7fb284154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2841550e0 con 0x7fb2840cd0c0 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840cda80 con 0x7fb270004010 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb288b19700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840cfe50 con 0x7fb2840cf9e0 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb282d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb282d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46280/0 (socket says 172.21.15.46:46280) 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.310+0000 7fb282d9d700 1 -- 172.21.15.46:0/4183313326 learned_addr learned my addr 172.21.15.46:0/4183313326 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb28259c700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 0x7fb284156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb281d9b700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2840cf9e0 0x7fb284154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 -- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2840cf9e0 msgr2=0x7fb284154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2840cf9e0 0x7fb284154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 -- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 msgr2=0x7fb284156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 0x7fb284156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 -- 172.21.15.46:0/4183313326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb284153b00 con 0x7fb2840cd0c0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb28259c700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 0x7fb284156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb282d9d700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b67f0 tx=0x7fb27c001300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c017070 con 0x7fb2840cd0c0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c00ec10 con 0x7fb2840cd0c0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb284153de0 con 0x7fb2840cd0c0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c013420 con 0x7fb2840cd0c0 2023-10-07T09:06:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.311+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2841543a0 con 0x7fb2840cd0c0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.312+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28404c3c0 con 0x7fb2840cd0c0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.312+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb27c013790 con 0x7fb2840cd0c0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.313+0000 7fb27a7fc700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 0x7fb2640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.313+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb27c084910 con 0x7fb2840cd0c0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.313+0000 7fb28259c700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 0x7fb2640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.314+0000 7fb28259c700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 0x7fb2640697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb274006f00 tx=0x7fb274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.317+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb27c051860 con 0x7fb2840cd0c0 2023-10-07T09:06:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.508+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb28406a5b0 con 0x7fb2840cd0c0 2023-10-07T09:06:14.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.512+0000 7fb27a7fc700 1 -- 172.21.15.46:0/4183313326 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb27c054e80 con 0x7fb2840cd0c0 2023-10-07T09:06:14.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 msgr2=0x7fb2640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 0x7fb2640697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb274006f00 tx=0x7fb274008040 comp rx=0 tx=0).stop 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 msgr2=0x7fb2840cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b67f0 tx=0x7fb27c001300 comp rx=0 tx=0).stop 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 shutdown_connections 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb264067320 0x7fb2640697d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840cd0c0 0x7fb2840cd540 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb270004010 0x7fb284156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 --2- 172.21.15.46:0/4183313326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2840cf9e0 0x7fb284154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 >> 172.21.15.46:0/4183313326 conn(0x7fb284068e20 msgr2=0x7fb28415d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:14.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 shutdown_connections 2023-10-07T09:06:14.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.514+0000 7fb288b19700 1 -- 172.21.15.46:0/4183313326 wait complete. 2023-10-07T09:06:14.527 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:06:14.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:14.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:14.603 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:06:14.603 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:06:14.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:14.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.721+0000 7f2731f0f700 1 Processor -- start 2023-10-07T09:06:14.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.721+0000 7f2731f0f700 1 -- start start 2023-10-07T09:06:14.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f2731f0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f272c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f2731f0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f272c159c60 0x7f272c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f2731f0f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c15a160 con 0x7f272c15db10 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f2731f0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0d13a0 con 0x7f272c159c60 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f2731f0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15e140 con 0x7f272c159890 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f272bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f272c15db10 0x7f272c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34284/0 (socket says 172.21.15.46:34284) 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f272bfff700 1 -- 172.21.15.46:0/1554891576 learned_addr learned my addr 172.21.15.46:0/1554891576 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f272b7fe700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f272c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.722+0000 7f272affd700 1 --2- 172.21.15.46:0/1554891576 >> v2:172.21.15.133:3300/0 conn(0x7f272c159c60 0x7f272c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260669782 0 0) 0x7f272c15a160 con 0x7f272c15db10 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714003570 con 0x7f272c15db10 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131854162 0 0) 0x7f2714003570 con 0x7f272c15db10 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 msgr2=0x7f272c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f272c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 >> v2:172.21.15.133:3300/0 conn(0x7f272c159c60 msgr2=0x7f272c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 --2- 172.21.15.46:0/1554891576 >> v2:172.21.15.133:3300/0 conn(0x7f272c159c60 0x7f272c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c15a3d0 con 0x7f272c15db10 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f27240017f0 con 0x7f272c15db10 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 >> v1:172.21.15.46:6789/0 conn(0x7f272c15db10 legacy=0x7f272c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f2714003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714004810 0x7f2714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f27140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0d13a0 con 0x7f2714003a60 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15e140 con 0x7f2714004810 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271400ba60 con 0x7f272c159890 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f2714003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272affd700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714004810 0x7f2714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272bfff700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f27140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 -- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 msgr2=0x7f27140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c159890 0x7f27140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 -- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714004810 msgr2=0x7f2714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714004810 0x7f2714004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 -- 172.21.15.46:0/1554891576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714003570 con 0x7f2714003a60 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.723+0000 7f272b7fe700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f2714003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f271c009c30 tx=0x7f271c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cead593372c487e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00e710 con 0x7f2714003a60 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00e870 con 0x7f2714003a60 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f272a7fc700 1 -- 172.21.15.46:0/1554891576 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00ec30 con 0x7f2714003a60 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 -- 172.21.15.46:0/1554891576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 msgr2=0x7f2714003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 --2- 172.21.15.46:0/1554891576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f2714003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f271c009c30 tx=0x7f271c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f272bfff700 1 -- 172.21.15.46:0/1554891576 reap_dead start 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 -- 172.21.15.46:0/1554891576 shutdown_connections 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 -- 172.21.15.46:0/1554891576 >> 172.21.15.46:0/1554891576 conn(0x7f272c068e20 msgr2=0x7f272c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 -- 172.21.15.46:0/1554891576 shutdown_connections 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.724+0000 7f2731f0f700 1 -- 172.21.15.46:0/1554891576 wait complete. 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.725+0000 7f2731f0f700 1 Processor -- start 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.725+0000 7f2731f0f700 1 -- start start 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c0b1c10 0x7f272c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c0c8a30 0x7f272c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15ee40 con 0x7f2714003a60 2023-10-07T09:06:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0c93e0 con 0x7f272c0c8a30 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f2731f0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15fc40 con 0x7f272c0b1c10 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f272b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f272b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46302/0 (socket says 172.21.15.46:46302) 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f272b7fe700 1 -- 172.21.15.46:0/2347847281 learned_addr learned my addr 172.21.15.46:0/2347847281 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f272affd700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c0b1c10 0x7f272c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.726+0000 7f272bfff700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c0c8a30 0x7f272c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 -- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c0b1c10 msgr2=0x7f272c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c0b1c10 0x7f272c14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 -- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c0c8a30 msgr2=0x7f272c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c0c8a30 0x7f272c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 -- 172.21.15.46:0/2347847281 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c14ca20 con 0x7f2714003a60 2023-10-07T09:06:14.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f272b7fe700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e4b0 tx=0x7f271c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c022070 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00e9e0 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c0b2080 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c006e50 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.727+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c15f310 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.728+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c04c3c0 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.728+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f271c01c660 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.729+0000 7f27137fe700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 0x7f27180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.729+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f271c086010 con 0x7f2714003a60 2023-10-07T09:06:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.729+0000 7f272affd700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 0x7f27180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.729+0000 7f272affd700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 0x7f27180697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f272c0c8960 tx=0x7f27200091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.733+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f271c053090 con 0x7f2714003a60 2023-10-07T09:06:14.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.970+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f272c0cab80 con 0x7f2714003a60 2023-10-07T09:06:14.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.971+0000 7f27137fe700 1 -- 172.21.15.46:0/2347847281 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f271c017de0 con 0x7f2714003a60 2023-10-07T09:06:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:14.972 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":96,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3442112220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3442112220},{"type":"v1","addr":"172.21.15.46:6835","nonce":3442112220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3490202015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3490202015},{"type":"v1","addr":"172.21.15.133:6837","nonce":3490202015}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/533287178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":533287178},{"type":"v1","addr":"172.21.15.133:6836","nonce":533287178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7836,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1380756090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1380756090},{"type":"v1","addr":"172.21.15.46:6834","nonce":1380756090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[]} 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 msgr2=0x7f27180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 0x7f27180697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f272c0c8960 tx=0x7f27200091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 msgr2=0x7f272c15e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e4b0 tx=0x7f271c01a000 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 shutdown_connections 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2718067320 0x7f27180697d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c0c8a30 0x7f272c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2714003a60 0x7f272c15e900 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 --2- 172.21.15.46:0/2347847281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f272c0b1c10 0x7f272c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 >> 172.21.15.46:0/2347847281 conn(0x7f272c068e20 msgr2=0x7f272c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:14.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 shutdown_connections 2023-10-07T09:06:14.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:14.973+0000 7f2731f0f700 1 -- 172.21.15.46:0/2347847281 wait complete. 2023-10-07T09:06:14.975 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 96 2023-10-07T09:06:14.986 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:06:14.986 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:06:14.986 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:06:14.989 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:14.989 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:06:14.989 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:06:14.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:06:14.990 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:14.990 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:06:14.990 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:06:14.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:06:14.990 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:14.990 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:06:14.991 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:06:14.991 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:06:14.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:14.994 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:06:14.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:06:14.998 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:06:14.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:06:15.001 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:06:15.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:06:15.002 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:06:15.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:06:15.041 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:06:15.042 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:15.043 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:06:15.043 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:15.043 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:06:15.044 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:15.044 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:06:15.044 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:15.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:06:15.117 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:06:15.117 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:06:15.125 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:06:15.125 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:06:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.168+0000 7fc39b20a700 1 Processor -- start 2023-10-07T09:06:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.168+0000 7fc39b20a700 1 -- start start 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39b20a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc39406c0f0 0x7fc3940ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39b20a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3941410a0 0x7fc3940cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39b20a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940b1500 con 0x7fc394140cd0 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39b20a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940cd790 con 0x7fc39406c0f0 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39b20a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940cda20 con 0x7fc3941410a0 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc399a07700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc39406c0f0 0x7fc3940ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc399a07700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc39406c0f0 0x7fc3940ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46316/0 (socket says 172.21.15.46:46316) 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc399a07700 1 -- 172.21.15.46:0/302826800 learned_addr learned my addr 172.21.15.46:0/302826800 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc39aa09700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3941410a0 0x7fc3940cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.169+0000 7fc399a07700 1 -- 172.21.15.46:0/302826800 >> v2:172.21.15.133:3300/0 conn(0x7fc3941410a0 msgr2=0x7fc3940cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399a07700 1 --2- 172.21.15.46:0/302826800 >> v2:172.21.15.133:3300/0 conn(0x7fc3941410a0 0x7fc3940cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399a07700 1 -- 172.21.15.46:0/302826800 >> v1:172.21.15.133:6789/0 conn(0x7fc394140cd0 legacy=0x7fc39406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399a07700 1 -- 172.21.15.46:0/302826800 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940cdd00 con 0x7fc39406c0f0 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399a07700 1 --2- 172.21.15.46:0/302826800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc3940ccd10 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc3880099b0 tx=0x7fc388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409cf13bfcd07692 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399206700 1 -- 172.21.15.46:0/302826800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388009ea0 con 0x7fc39406c0f0 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399206700 1 -- 172.21.15.46:0/302826800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800b820 con 0x7fc39406c0f0 2023-10-07T09:06:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc399206700 1 -- 172.21.15.46:0/302826800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800bbc0 con 0x7fc39406c0f0 2023-10-07T09:06:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc39b20a700 1 -- 172.21.15.46:0/302826800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 msgr2=0x7fc3940ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.170+0000 7fc39b20a700 1 --2- 172.21.15.46:0/302826800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc3940ccd10 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc3880099b0 tx=0x7fc388009250 comp rx=0 tx=0).stop 2023-10-07T09:06:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 -- 172.21.15.46:0/302826800 shutdown_connections 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 --2- 172.21.15.46:0/302826800 >> v2:172.21.15.133:3300/0 conn(0x7fc3941410a0 0x7fc3940cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 --2- 172.21.15.46:0/302826800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc3940ccd10 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 -- 172.21.15.46:0/302826800 >> 172.21.15.46:0/302826800 conn(0x7fc3940ce430 msgr2=0x7fc3940ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 -- 172.21.15.46:0/302826800 shutdown_connections 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.171+0000 7fc39b20a700 1 -- 172.21.15.46:0/302826800 wait complete. 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 Processor -- start 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 -- start start 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc394140cd0 0x7fc3941554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3941410a0 0x7fc394139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394139940 con 0x7fc39406c0f0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940af7a0 con 0x7fc3941410a0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.172+0000 7fc39b20a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941559f0 con 0x7fc394140cd0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46326/0 (socket says 172.21.15.46:46326) 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 -- 172.21.15.46:0/439839835 learned_addr learned my addr 172.21.15.46:0/439839835 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc399a07700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc394140cd0 0x7fc3941554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39aa09700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3941410a0 0x7fc394139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 -- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc394140cd0 msgr2=0x7fc3941554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc394140cd0 0x7fc3941554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 -- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3941410a0 msgr2=0x7fc394139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3941410a0 0x7fc394139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:15.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 -- 172.21.15.46:0/439839835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094f0 con 0x7fc39406c0f0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39a208700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc38400cb40 tx=0x7fc3840017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400ce50 con 0x7fc39406c0f0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400a7a0 con 0x7fc39406c0f0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc394138d30 con 0x7fc39406c0f0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400ab60 con 0x7fc39406c0f0 2023-10-07T09:06:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.173+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3941392f0 con 0x7fc39406c0f0 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.174+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394139c20 con 0x7fc39406c0f0 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.175+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc384003030 con 0x7fc39406c0f0 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.175+0000 7fc3927fc700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 0x7fc3800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.175+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc3840848f0 con 0x7fc39406c0f0 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.175+0000 7fc399a07700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 0x7fc3800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.176+0000 7fc399a07700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 0x7fc3800697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc3880099b0 tx=0x7fc388017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:15.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.179+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc384051880 con 0x7fc39406c0f0 2023-10-07T09:06:15.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:15.392+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc39404c3c0 con 0x7fc39406c0f0 2023-10-07T09:06:16.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.197+0000 7fc3927fc700 1 -- 172.21.15.46:0/439839835 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc384054ea0 con 0x7fc39406c0f0 2023-10-07T09:06:16.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 msgr2=0x7fc3800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 0x7fc3800697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc3880099b0 tx=0x7fc388017000 comp rx=0 tx=0).stop 2023-10-07T09:06:16.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 msgr2=0x7fc39415ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc38400cb40 tx=0x7fc3840017b0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 shutdown_connections 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc380067320 0x7fc3800697d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3941410a0 0x7fc394139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc39406c0f0 0x7fc39415ca40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 --2- 172.21.15.46:0/439839835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc394140cd0 0x7fc3941554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 >> 172.21.15.46:0/439839835 conn(0x7fc3940ce430 msgr2=0x7fc39406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 shutdown_connections 2023-10-07T09:06:16.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.200+0000 7fc39b20a700 1 -- 172.21.15.46:0/439839835 wait complete. 2023-10-07T09:06:16.203 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:06:16.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:06:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.341+0000 7f530d945700 1 Processor -- start 2023-10-07T09:06:16.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.341+0000 7f530d945700 1 -- start start 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f530d945700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53080b1850 0x7f53080b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f530d945700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53081579f0 0x7f53080abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f530d945700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080cb300 con 0x7f53080ae680 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f530d945700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530806fc30 con 0x7f53080b1850 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f530d945700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080cc260 con 0x7f53081579f0 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53080b1850 0x7f53080b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53080b1850 0x7f53080b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46328/0 (socket says 172.21.15.46:46328) 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 -- 172.21.15.46:0/754327441 learned_addr learned my addr 172.21.15.46:0/754327441 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f53077fe700 1 --2- 172.21.15.46:0/754327441 >> v2:172.21.15.133:3300/0 conn(0x7f53081579f0 0x7f53080abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 -- 172.21.15.46:0/754327441 >> v2:172.21.15.133:3300/0 conn(0x7f53081579f0 msgr2=0x7f53080abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 --2- 172.21.15.46:0/754327441 >> v2:172.21.15.133:3300/0 conn(0x7f53081579f0 0x7f53080abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 -- 172.21.15.46:0/754327441 >> v1:172.21.15.133:6789/0 conn(0x7f53080ae680 legacy=0x7f53081572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.342+0000 7f5306ffd700 1 -- 172.21.15.46:0/754327441 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080cb5e0 con 0x7f53080b1850 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f5306ffd700 1 --2- 172.21.15.46:0/754327441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080b1850 0x7f53080b1c20 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f53080cc160 tx=0x7f5300009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d0a959a8fc6949 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f5305ffb700 1 -- 172.21.15.46:0/754327441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000e070 con 0x7f53080b1850 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f5305ffb700 1 -- 172.21.15.46:0/754327441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000ba50 con 0x7f53080b1850 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f5305ffb700 1 -- 172.21.15.46:0/754327441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000092e0 con 0x7f53080b1850 2023-10-07T09:06:16.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 -- 172.21.15.46:0/754327441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080b1850 msgr2=0x7f53080b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 --2- 172.21.15.46:0/754327441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080b1850 0x7f53080b1c20 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f53080cc160 tx=0x7f5300009840 comp rx=0 tx=0).stop 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 -- 172.21.15.46:0/754327441 shutdown_connections 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 --2- 172.21.15.46:0/754327441 >> v2:172.21.15.133:3300/0 conn(0x7f53081579f0 0x7f53080abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 --2- 172.21.15.46:0/754327441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080b1850 0x7f53080b1c20 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 -- 172.21.15.46:0/754327441 >> 172.21.15.46:0/754327441 conn(0x7f530806a320 msgr2=0x7f53080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 -- 172.21.15.46:0/754327441 shutdown_connections 2023-10-07T09:06:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.343+0000 7f530d945700 1 -- 172.21.15.46:0/754327441 wait complete. 2023-10-07T09:06:16.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 Processor -- start 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 -- start start 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 0x7f530814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53081579f0 0x7f530814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530815a5d0 con 0x7f53080ae680 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530814df00 con 0x7f53080b1850 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f530d945700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530814e9d0 con 0x7f53081579f0 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f5306ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f5306ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46344/0 (socket says 172.21.15.46:46344) 2023-10-07T09:06:16.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.345+0000 7f5306ffd700 1 -- 172.21.15.46:0/3406229640 learned_addr learned my addr 172.21.15.46:0/3406229640 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f53077fe700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53081579f0 0x7f530814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 -- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53081579f0 msgr2=0x7f530814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53081579f0 0x7f530814b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f53067fc700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 0x7f530814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 -- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 msgr2=0x7f530814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 0x7f530814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 -- 172.21.15.46:0/3406229640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300009ae0 con 0x7f53080ae680 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f53067fc700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 0x7f530814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:16.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f5306ffd700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5308064290 tx=0x7f5300018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300008ac0 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5300008c40 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530815a7e0 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300026460 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.346+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530814e130 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.347+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530804c3c0 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.348+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5300003040 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.348+0000 7f52feffd700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 0x7f52e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.348+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5300086990 con 0x7f53080ae680 2023-10-07T09:06:16.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.348+0000 7f53067fc700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 0x7f52e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.349+0000 7f53067fc700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 0x7f52e80697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f53080abbd0 tx=0x7f52f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.352+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5300053910 con 0x7f53080ae680 2023-10-07T09:06:16.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.622+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f530815aa10 con 0x7f53080ae680 2023-10-07T09:06:16.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.623+0000 7f52feffd700 1 -- 172.21.15.46:0/3406229640 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5300021090 con 0x7f53080ae680 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:16.624 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.626 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:06:16.627 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.628 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:06:16.629 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.630 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.631 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:16.632 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:06:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.635 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:16.637 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:06:16.638 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 msgr2=0x7f52e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 0x7f52e80697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f53080abbd0 tx=0x7f52f0009040 comp rx=0 tx=0).stop 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 msgr2=0x7f530814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5308064290 tx=0x7f5300018000 comp rx=0 tx=0).stop 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 shutdown_connections 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f52e8067320 0x7f52e80697d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53081579f0 0x7f530814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53080ae680 0x7f530814c780 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 --2- 172.21.15.46:0/3406229640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53080b1850 0x7f530814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 >> 172.21.15.46:0/3406229640 conn(0x7f530806a320 msgr2=0x7f53080ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 shutdown_connections 2023-10-07T09:06:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.625+0000 7f530d945700 1 -- 172.21.15.46:0/3406229640 wait complete. 2023-10-07T09:06:16.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.760+0000 7fa76ca24700 1 Processor -- start 2023-10-07T09:06:16.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.760+0000 7fa76ca24700 1 -- start start 2023-10-07T09:06:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa76ca24700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 0x7fa7680b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa76ca24700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 0x7fa7680b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa76ca24700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680b11d0 con 0x7fa76815d230 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa76ca24700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680b14b0 con 0x7fa768159420 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa76ca24700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680b1790 con 0x7fa7681597f0 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa7677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 0x7fa7680b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 0x7fa7680b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa767fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa76815d230 0x7fa7680b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:60054/0 (socket says 172.21.15.46:60054) 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.761+0000 7fa767fff700 1 -- 172.21.15.46:0/1474810833 learned_addr learned my addr 172.21.15.46:0/1474810833 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa766ffd700 1 -- 172.21.15.46:0/1474810833 >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 msgr2=0x7fa7680b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa766ffd700 1 --2- 172.21.15.46:0/1474810833 >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 0x7fa7680b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa766ffd700 1 -- 172.21.15.46:0/1474810833 >> v1:172.21.15.133:6789/0 conn(0x7fa76815d230 legacy=0x7fa7680b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa7667fc700 1 -- 172.21.15.46:0/1474810833 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705858541 0 0) 0x7fa7680b11d0 con 0x7fa76815d230 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa766ffd700 1 -- 172.21.15.46:0/1474810833 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680b1a70 con 0x7fa7681597f0 2023-10-07T09:06:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa7677fe700 1 --2- 172.21.15.46:0/1474810833 >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 0x7fa7680b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa766ffd700 1 --2- 172.21.15.46:0/1474810833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 0x7fa7680b2270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098e0 tx=0x7fa75c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12a87377980460e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa7667fc700 1 -- 172.21.15.46:0/1474810833 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00b640 con 0x7fa7681597f0 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa7667fc700 1 -- 172.21.15.46:0/1474810833 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00b7a0 con 0x7fa7681597f0 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.762+0000 7fa7667fc700 1 -- 172.21.15.46:0/1474810833 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00bb40 con 0x7fa7681597f0 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 -- 172.21.15.46:0/1474810833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 msgr2=0x7fa7680b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1474810833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 0x7fa7680b2270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098e0 tx=0x7fa75c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 -- 172.21.15.46:0/1474810833 shutdown_connections 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1474810833 >> v2:172.21.15.133:3300/0 conn(0x7fa768159420 0x7fa7680b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1474810833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7681597f0 0x7fa7680b2270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 -- 172.21.15.46:0/1474810833 >> 172.21.15.46:0/1474810833 conn(0x7fa7680d0660 msgr2=0x7fa7680d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 -- 172.21.15.46:0/1474810833 shutdown_connections 2023-10-07T09:06:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.763+0000 7fa76ca24700 1 -- 172.21.15.46:0/1474810833 wait complete. 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.764+0000 7fa76ca24700 1 Processor -- start 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.764+0000 7fa76ca24700 1 -- start start 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7681597f0 0x7fa76814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa76815d230 0x7fa76814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76814b830 con 0x7fa768159420 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76815e370 con 0x7fa7681597f0 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76815ca20 con 0x7fa76815d230 2023-10-07T09:06:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46358/0 (socket says 172.21.15.46:46358) 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 -- 172.21.15.46:0/1598176086 learned_addr learned my addr 172.21.15.46:0/1598176086 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa766ffd700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7681597f0 0x7fa76814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa767fff700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa76815d230 0x7fa76814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 -- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa76815d230 msgr2=0x7fa76814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa76815d230 0x7fa76814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 -- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7681597f0 msgr2=0x7fa76814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7681597f0 0x7fa76814adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 -- 172.21.15.46:0/1598176086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758009420 con 0x7fa768159420 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa7677fe700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa75800ec80 tx=0x7fa7580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800c970 con 0x7fa768159420 2023-10-07T09:06:16.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75800cad0 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c009420 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.765+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800ce50 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.766+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7681538f0 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.766+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76804c3c0 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.767+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa758013680 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.767+0000 7fa74f7fe700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 0x7fa7540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.767+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa758084cf0 con 0x7fa768159420 2023-10-07T09:06:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.767+0000 7fa766ffd700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 0x7fa7540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:16.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.768+0000 7fa766ffd700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 0x7fa7540697d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa7681585f0 tx=0x7fa75c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:16.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.771+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa758051cd0 con 0x7fa768159420 2023-10-07T09:06:16.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.965+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa768156a20 con 0x7fa768159420 2023-10-07T09:06:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.966+0000 7fa74f7fe700 1 -- 172.21.15.46:0/1598176086 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+12144 (secure 0 0 0) 0x7fa7580552f0 con 0x7fa768159420 2023-10-07T09:06:16.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:16.967 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":149,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:16.191909+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 msgr2=0x7fa7540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 0x7fa7540697d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa7681585f0 tx=0x7fa75c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 msgr2=0x7fa76815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa75800ec80 tx=0x7fa7580091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 shutdown_connections 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa754067320 0x7fa7540697d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa76815d230 0x7fa76814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa768159420 0x7fa76815c4e0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 --2- 172.21.15.46:0/1598176086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7681597f0 0x7fa76814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 >> 172.21.15.46:0/1598176086 conn(0x7fa7680d0660 msgr2=0x7fa76815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 shutdown_connections 2023-10-07T09:06:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:16.968+0000 7fa76ca24700 1 -- 172.21.15.46:0/1598176086 wait complete. 2023-10-07T09:06:16.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:06:16.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:06:17.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.102+0000 7f9d75094700 1 Processor -- start 2023-10-07T09:06:17.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.102+0000 7f9d75094700 1 -- start start 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d75094700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9d700b16d0 0x7f9d700b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d75094700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d75094700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d700b2080 con 0x7f9d700b4e70 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d75094700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d700cfb00 con 0x7f9d700b16d0 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d75094700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700b5c40 con 0x7f9d700b33b0 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9d700b16d0 0x7f9d700b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9d700b16d0 0x7f9d700b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46364/0 (socket says 172.21.15.46:46364) 2023-10-07T09:06:17.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9d700b4e70 0x7f9d700ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34310/0 (socket says 172.21.15.46:34310) 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 -- 172.21.15.46:0/1201667112 learned_addr learned my addr 172.21.15.46:0/1201667112 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d74893700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 -- 172.21.15.46:0/1201667112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 msgr2=0x7f9d700b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 -- 172.21.15.46:0/1201667112 >> v1:172.21.15.46:6789/0 conn(0x7f9d700b4e70 legacy=0x7f9d700ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6effd700 1 -- 172.21.15.46:0/1201667112 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693176927 0 0) 0x7f9d700b2080 con 0x7f9d700b4e70 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 -- 172.21.15.46:0/1201667112 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700b5f20 con 0x7f9d700b16d0 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.103+0000 7f9d6f7fe700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b16d0 0x7f9d700b1b40 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9d600099b0 tx=0x7f9d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454b3e358896a9a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d6effd700 1 -- 172.21.15.46:0/1201667112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000b860 con 0x7f9d700b16d0 2023-10-07T09:06:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d6effd700 1 -- 172.21.15.46:0/1201667112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6000b9c0 con 0x7f9d700b16d0 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d6effd700 1 -- 172.21.15.46:0/1201667112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000bd80 con 0x7f9d700b16d0 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 -- 172.21.15.46:0/1201667112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b16d0 msgr2=0x7f9d700b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b16d0 0x7f9d700b1b40 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9d600099b0 tx=0x7f9d60009250 comp rx=0 tx=0).stop 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 -- 172.21.15.46:0/1201667112 shutdown_connections 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 --2- 172.21.15.46:0/1201667112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b16d0 0x7f9d700b1b40 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 -- 172.21.15.46:0/1201667112 >> 172.21.15.46:0/1201667112 conn(0x7f9d700d10c0 msgr2=0x7f9d700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 -- 172.21.15.46:0/1201667112 shutdown_connections 2023-10-07T09:06:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.104+0000 7f9d75094700 1 -- 172.21.15.46:0/1201667112 wait complete. 2023-10-07T09:06:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.105+0000 7f9d75094700 1 Processor -- start 2023-10-07T09:06:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 -- start start 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d700b16d0 0x7f9d700c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700cc3a0 con 0x7f9d700b4e70 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700cbe90 con 0x7f9d700b16d0 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d75094700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d701578b0 con 0x7f9d700b33b0 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d74893700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d74893700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46366/0 (socket says 172.21.15.46:46366) 2023-10-07T09:06:17.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.106+0000 7f9d74893700 1 -- 172.21.15.46:0/3098787322 learned_addr learned my addr 172.21.15.46:0/3098787322 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d6f7fe700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d6ffff700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d700b16d0 0x7f9d700c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 -- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 msgr2=0x7f9d700cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 -- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d700b16d0 msgr2=0x7f9d700c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d700b16d0 0x7f9d700c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 -- 172.21.15.46:0/3098787322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600094f0 con 0x7f9d700b4e70 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d74893700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800ceb0 tx=0x7f9d68007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800ae40 con 0x7f9d700b4e70 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68016430 con 0x7f9d700b4e70 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d700cc0c0 con 0x7f9d700b4e70 2023-10-07T09:06:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680167d0 con 0x7f9d700b4e70 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.107+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d700c6940 con 0x7f9d700b4e70 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.108+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d700c64c0 con 0x7f9d700b4e70 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.109+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9d68003020 con 0x7f9d700b4e70 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.109+0000 7f9d57fff700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 0x7f9d5c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.109+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d68012070 con 0x7f9d700b4e70 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.109+0000 7f9d6ffff700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 0x7f9d5c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.110+0000 7f9d6ffff700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 0x7f9d5c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007fd0 tx=0x7f9d64007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.113+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d700c64c0 con 0x7f9d700b4e70 2023-10-07T09:06:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.306+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d700c64c0 con 0x7f9d700b4e70 2023-10-07T09:06:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.307+0000 7f9d57fff700 1 -- 172.21.15.46:0/3098787322 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d700c64c0 con 0x7f9d700b4e70 2023-10-07T09:06:17.308 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:06:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 msgr2=0x7f9d5c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 0x7f9d5c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007fd0 tx=0x7f9d64007e10 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 msgr2=0x7f9d70157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800ceb0 tx=0x7f9d68007870 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 shutdown_connections 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9d5c067320 0x7f9d5c0697d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d700b4e70 0x7f9d70157370 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d700b16d0 0x7f9d700c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 --2- 172.21.15.46:0/3098787322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d700b33b0 0x7f9d700cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 >> 172.21.15.46:0/3098787322 conn(0x7f9d700d10c0 msgr2=0x7f9d70069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 shutdown_connections 2023-10-07T09:06:17.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.309+0000 7f9d75094700 1 -- 172.21.15.46:0/3098787322 wait complete. 2023-10-07T09:06:17.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:06:17.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.440+0000 7f55ad255700 1 Processor -- start 2023-10-07T09:06:17.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.440+0000 7f55ad255700 1 -- start start 2023-10-07T09:06:17.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55ad255700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 0x7f55a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55ad255700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55a8069560 0x7f55a80699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55ad255700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a815a160 con 0x7f55a8159c60 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55ad255700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a8069f20 con 0x7f55a8069560 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55ad255700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a80d13a0 con 0x7f55a8159890 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55a8069560 0x7f55a80699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a6d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 0x7f55a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a6d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 0x7f55a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:56850/0 (socket says 172.21.15.46:56850) 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55a8069560 0x7f55a80699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:34832/0 (socket says 172.21.15.46:34832) 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f55a8159c60 0x7f55a815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:60066/0 (socket says 172.21.15.46:60066) 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a6d9d700 1 -- 172.21.15.46:0/1547606680 learned_addr learned my addr 172.21.15.46:0/1547606680 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 -- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 msgr2=0x7f55a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 --2- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 0x7f55a815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 -- 172.21.15.46:0/1547606680 >> v1:172.21.15.133:6789/0 conn(0x7f55a8159c60 legacy=0x7f55a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a759e700 1 -- 172.21.15.46:0/1547606680 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a815e140 con 0x7f55a8069560 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.441+0000 7f55a5d9b700 1 -- 172.21.15.46:0/1547606680 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367190487 0 0) 0x7f55a815a160 con 0x7f55a8159c60 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55a759e700 1 --2- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8069560 0x7f55a80699e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009e60 tx=0x7f55a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768be43f5a3e3ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55a5d9b700 1 -- 172.21.15.46:0/1547606680 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000e070 con 0x7f55a8069560 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55a5d9b700 1 -- 172.21.15.46:0/1547606680 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000bb60 con 0x7f55a8069560 2023-10-07T09:06:17.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55a5d9b700 1 -- 172.21.15.46:0/1547606680 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0012430 con 0x7f55a8069560 2023-10-07T09:06:17.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 -- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8069560 msgr2=0x7f55a80699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 --2- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8069560 0x7f55a80699e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009e60 tx=0x7f55a0009780 comp rx=0 tx=0).stop 2023-10-07T09:06:17.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 -- 172.21.15.46:0/1547606680 shutdown_connections 2023-10-07T09:06:17.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 --2- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8069560 0x7f55a80699e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 --2- 172.21.15.46:0/1547606680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8159890 0x7f55a815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 -- 172.21.15.46:0/1547606680 >> 172.21.15.46:0/1547606680 conn(0x7f55a8068e20 msgr2=0x7f55a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 -- 172.21.15.46:0/1547606680 shutdown_connections 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.442+0000 7f55ad255700 1 -- 172.21.15.46:0/1547606680 wait complete. 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.443+0000 7f55ad255700 1 Processor -- start 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 -- start start 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8069560 0x7f55a815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8159c60 0x7f55a8154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8155770 con 0x7f55a8159890 2023-10-07T09:06:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a815efc0 con 0x7f55a8159c60 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55ad255700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8154cc0 con 0x7f55a8069560 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55a659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55a659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46370/0 (socket says 172.21.15.46:46370) 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55a659c700 1 -- 172.21.15.46:0/3304878023 learned_addr learned my addr 172.21.15.46:0/3304878023 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55a6d9d700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8069560 0x7f55a815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.444+0000 7f55a759e700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8159c60 0x7f55a8154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 -- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8069560 msgr2=0x7f55a815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8069560 0x7f55a815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 -- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8159c60 msgr2=0x7f55a8154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8159c60 0x7f55a8154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 -- 172.21.15.46:0/3304878023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0009a20 con 0x7f55a8159890 2023-10-07T09:06:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55a659c700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f559000c810 tx=0x7f5590007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590005b40 con 0x7f55a8159890 2023-10-07T09:06:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590005cc0 con 0x7f55a8159890 2023-10-07T09:06:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a80b3fe0 con 0x7f55a8159890 2023-10-07T09:06:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590007320 con 0x7f55a8159890 2023-10-07T09:06:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.445+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a815b8a0 con 0x7f55a8159890 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.446+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a80b4500 con 0x7f55a8159890 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.447+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f559001c440 con 0x7f55a8159890 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.447+0000 7f559effd700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.447+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5590083de0 con 0x7f55a8159890 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.447+0000 7f55a6d9d700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.448+0000 7f55a6d9d700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 0x7f55880697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5598006d40 tx=0x7f5598009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.451+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a80b4500 con 0x7f55a8159890 2023-10-07T09:06:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.647+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f55a815ed90 con 0x7f55a8159890 2023-10-07T09:06:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.648+0000 7f559effd700 1 -- 172.21.15.46:0/3304878023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) v1 ==== 84+0+65 (secure 0 0 0) 0x7f55a815ed90 con 0x7f55a8159890 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:17.649 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 msgr2=0x7f55880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 0x7f55880697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5598006d40 tx=0x7f5598009250 comp rx=0 tx=0).stop 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 msgr2=0x7f55a80b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f559000c810 tx=0x7f5590007de0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 shutdown_connections 2023-10-07T09:06:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55a8159c60 0x7f55a8154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55a8069560 0x7f55a815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 --2- 172.21.15.46:0/3304878023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a8159890 0x7f55a80b3590 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 >> 172.21.15.46:0/3304878023 conn(0x7f55a8068e20 msgr2=0x7f55a81580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 shutdown_connections 2023-10-07T09:06:17.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.650+0000 7f55ad255700 1 -- 172.21.15.46:0/3304878023 wait complete. 2023-10-07T09:06:17.662 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:06:17.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:06:17.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.785+0000 7ff69a775700 1 Processor -- start 2023-10-07T09:06:17.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.785+0000 7ff69a775700 1 -- start start 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff69a775700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6940b0790 0x7ff6940cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff69a775700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 0x7ff694159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff69a775700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940cfa00 con 0x7ff6940b03c0 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff69a775700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940cb580 con 0x7ff6940b0790 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff69a775700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940cf160 con 0x7ff6941591e0 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff699f74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 0x7ff694159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff699f74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 0x7ff694159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:56862/0 (socket says 172.21.15.46:56862) 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff698f72700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6940b0790 0x7ff6940cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.786+0000 7ff699f74700 1 -- 172.21.15.46:0/1363747684 learned_addr learned my addr 172.21.15.46:0/1363747684 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff698f72700 1 -- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 msgr2=0x7ff694159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff698f72700 1 --2- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 0x7ff694159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff698f72700 1 -- 172.21.15.46:0/1363747684 >> v1:172.21.15.133:6789/0 conn(0x7ff6940b03c0 legacy=0x7ff6940b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff698f72700 1 -- 172.21.15.46:0/1363747684 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940cf440 con 0x7ff6940b0790 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff693fff700 1 -- 172.21.15.46:0/1363747684 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126904738 0 0) 0x7ff6940cfa00 con 0x7ff6940b03c0 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff698f72700 1 --2- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940cea70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff688009910 tx=0x7ff6880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804168098b273e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff693fff700 1 -- 172.21.15.46:0/1363747684 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800b640 con 0x7ff6940b0790 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff693fff700 1 -- 172.21.15.46:0/1363747684 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800b7a0 con 0x7ff6940b0790 2023-10-07T09:06:17.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.787+0000 7ff693fff700 1 -- 172.21.15.46:0/1363747684 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800bb60 con 0x7ff6940b0790 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 -- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 msgr2=0x7ff6940cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 --2- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940cea70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff688009910 tx=0x7ff6880091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 -- 172.21.15.46:0/1363747684 shutdown_connections 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 --2- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6941591e0 0x7ff694159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 --2- 172.21.15.46:0/1363747684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940cea70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 -- 172.21.15.46:0/1363747684 >> 172.21.15.46:0/1363747684 conn(0x7ff694063230 msgr2=0x7ff694063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 -- 172.21.15.46:0/1363747684 shutdown_connections 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.788+0000 7ff69a775700 1 -- 172.21.15.46:0/1363747684 wait complete. 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.789+0000 7ff69a775700 1 Processor -- start 2023-10-07T09:06:17.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.789+0000 7ff69a775700 1 -- start start 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6940b03c0 0x7ff6941588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69406e530 con 0x7ff6941591e0 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69406e810 con 0x7ff6940b0790 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff69a775700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69406eaf0 con 0x7ff6940b03c0 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46384/0 (socket says 172.21.15.46:46384) 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 -- 172.21.15.46:0/2922945278 learned_addr learned my addr 172.21.15.46:0/2922945278 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699773700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6940b03c0 0x7ff6941588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff698f72700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 -- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6940b03c0 msgr2=0x7ff6941588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6940b03c0 0x7ff6941588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 -- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 msgr2=0x7ff6940c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.790+0000 7ff699f74700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff699f74700 1 -- 172.21.15.46:0/2922945278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009420 con 0x7ff6941591e0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff699f74700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e930 tx=0x7ff68c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c013680 con 0x7ff6941591e0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0137e0 con 0x7ff6941591e0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69406edd0 con 0x7ff6941591e0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c013ba0 con 0x7ff6941591e0 2023-10-07T09:06:17.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.791+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694158e30 con 0x7ff6941591e0 2023-10-07T09:06:17.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.792+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69406f2f0 con 0x7ff6941591e0 2023-10-07T09:06:17.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.792+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff68c00c3e0 con 0x7ff6941591e0 2023-10-07T09:06:17.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.793+0000 7ff6917fa700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 0x7ff6800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:17.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.793+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff68c084aa0 con 0x7ff6941591e0 2023-10-07T09:06:17.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.793+0000 7ff699773700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 0x7ff6800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:17.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.793+0000 7ff699773700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 0x7ff6800697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff684007fd0 tx=0x7ff684001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:17.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.797+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff68c051a40 con 0x7ff6941591e0 2023-10-07T09:06:17.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:17.990+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff69404c3c0 con 0x7ff6941591e0 2023-10-07T09:06:18.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.203+0000 7ff6917fa700 1 -- 172.21.15.46:0/2922945278 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff68c055060 con 0x7ff6941591e0 2023-10-07T09:06:18.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 msgr2=0x7ff6800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 0x7ff6800697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff684007fd0 tx=0x7ff684001640 comp rx=0 tx=0).stop 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 msgr2=0x7ff6940c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e930 tx=0x7ff68c009250 comp rx=0 tx=0).stop 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 shutdown_connections 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff680067320 0x7ff6800697d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6941591e0 0x7ff6940c8e60 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6940b03c0 0x7ff6941588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 --2- 172.21.15.46:0/2922945278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6940b0790 0x7ff6940c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.207+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 >> 172.21.15.46:0/2922945278 conn(0x7ff694063230 msgr2=0x7ff6940b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.208+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 shutdown_connections 2023-10-07T09:06:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.208+0000 7ff69a775700 1 -- 172.21.15.46:0/2922945278 wait complete. 2023-10-07T09:06:18.210 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:06:18.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:06:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.348+0000 7f4e30cfe700 1 Processor -- start 2023-10-07T09:06:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.348+0000 7f4e30cfe700 1 -- start start 2023-10-07T09:06:18.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e30cfe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4e2c1595d0 0x7f4e2c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e30cfe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e2c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e30cfe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c0b10f0 con 0x7f4e2c0cf480 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e30cfe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c0cd530 con 0x7f4e2c1595d0 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e30cfe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15e000 con 0x7f4e2c15d930 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e2c0cf480 0x7f4e2c15d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34316/0 (socket says 172.21.15.46:34316) 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2affd700 1 -- 172.21.15.46:0/1244646704 learned_addr learned my addr 172.21.15.46:0/1244646704 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:18.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e2c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2b7fe700 1 --2- 172.21.15.46:0/1244646704 >> v2:172.21.15.133:3300/0 conn(0x7f4e2c1595d0 0x7f4e2c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303998724 0 0) 0x7f4e2c0b10f0 con 0x7f4e2c0cf480 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.349+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e14003570 con 0x7f4e2c0cf480 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1166475257 0 0) 0x7f4e14003570 con 0x7f4e2c0cf480 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 msgr2=0x7f4e2c0b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e2c0b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 >> v2:172.21.15.133:3300/0 conn(0x7f4e2c1595d0 msgr2=0x7f4e2c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 --2- 172.21.15.46:0/1244646704 >> v2:172.21.15.133:3300/0 conn(0x7f4e2c1595d0 0x7f4e2c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0cf990 con 0x7f4e2c0cf480 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4e20001470 con 0x7f4e2c0cf480 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 >> v1:172.21.15.46:6789/0 conn(0x7f4e2c0cf480 legacy=0x7f4e2c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e14004d50 0x7f4e140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0cd530 con 0x7f4e14004d50 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15e000 con 0x7f4e14003a60 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1400ba60 con 0x7f4e2c15d930 2023-10-07T09:06:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e14004d50 0x7f4e140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2affd700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2b7fe700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 -- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 msgr2=0x7f4e14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c15d930 0x7f4e14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 -- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e14003a60 msgr2=0x7f4e14003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 -- 172.21.15.46:0/1244646704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14003570 con 0x7f4e14004d50 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.350+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e14004d50 0x7f4e140051c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c15dd30 tx=0x7f4e2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c67967c77f3f6bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400e9a0 con 0x7f4e14004d50 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400f040 con 0x7f4e14004d50 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e2a7fc700 1 -- 172.21.15.46:0/1244646704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400ed50 con 0x7f4e14004d50 2023-10-07T09:06:18.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 -- 172.21.15.46:0/1244646704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e14004d50 msgr2=0x7f4e140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/1244646704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e14004d50 0x7f4e140051c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c15dd30 tx=0x7f4e2400b040 comp rx=0 tx=0).stop 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e2bfff700 1 -- 172.21.15.46:0/1244646704 reap_dead start 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 -- 172.21.15.46:0/1244646704 shutdown_connections 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 -- 172.21.15.46:0/1244646704 >> 172.21.15.46:0/1244646704 conn(0x7f4e2c0d05f0 msgr2=0x7f4e2c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 -- 172.21.15.46:0/1244646704 shutdown_connections 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.351+0000 7f4e30cfe700 1 -- 172.21.15.46:0/1244646704 wait complete. 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.352+0000 7f4e30cfe700 1 Processor -- start 2023-10-07T09:06:18.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.352+0000 7f4e30cfe700 1 -- start start 2023-10-07T09:06:18.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c14ca60 0x7f4e2c14f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2c14d210 0x7f4e2c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c150200 con 0x7f4e2c14fa80 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c14ff20 con 0x7f4e2c14d210 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e30cfe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15b2a0 con 0x7f4e2c14ca60 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e2affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e2affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46402/0 (socket says 172.21.15.46:46402) 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e2affd700 1 -- 172.21.15.46:0/2612267067 learned_addr learned my addr 172.21.15.46:0/2612267067 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e2b7fe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c14ca60 0x7f4e2c14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.353+0000 7f4e2bfff700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2c14d210 0x7f4e2c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 -- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c14ca60 msgr2=0x7f4e2c14f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c14ca60 0x7f4e2c14f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 -- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2c14d210 msgr2=0x7f4e2c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2c14d210 0x7f4e2c0b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 -- 172.21.15.46:0/2612267067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c15b580 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e2affd700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4e20004fd0 tx=0x7f4e20001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20018030 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000f6a0 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c15b860 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000fa40 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.354+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c15bd80 con 0x7f4e2c14fa80 2023-10-07T09:06:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.355+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c15bf70 con 0x7f4e2c14fa80 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.355+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e2001b070 con 0x7f4e2c14fa80 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.356+0000 7f4e137fe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 0x7f4e180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.356+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4e20019070 con 0x7f4e2c14fa80 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.356+0000 7f4e2b7fe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 0x7f4e180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.357+0000 7f4e2b7fe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 0x7f4e180697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0090f0 tx=0x7f4e1c009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.360+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e200517a0 con 0x7f4e2c14fa80 2023-10-07T09:06:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:18.556+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4e2c04c3c0 con 0x7f4e2c14fa80 2023-10-07T09:06:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.209+0000 7f4e137fe700 1 -- 172.21.15.46:0/2612267067 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4e20054dc0 con 0x7f4e2c14fa80 2023-10-07T09:06:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.216+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 msgr2=0x7f4e180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.216+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 0x7f4e180697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0090f0 tx=0x7f4e1c009120 comp rx=0 tx=0).stop 2023-10-07T09:06:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.216+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 msgr2=0x7f4e2c0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.216+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4e20004fd0 tx=0x7f4e20001e90 comp rx=0 tx=0).stop 2023-10-07T09:06:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 shutdown_connections 2023-10-07T09:06:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4e18067320 0x7f4e180697d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2c14d210 0x7f4e2c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e2c14ca60 0x7f4e2c14f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 --2- 172.21.15.46:0/2612267067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c14fa80 0x7f4e2c0b4d10 secure :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4e20004fd0 tx=0x7f4e20001e90 comp rx=0 tx=0).stop 2023-10-07T09:06:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.218+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 >> 172.21.15.46:0/2612267067 conn(0x7f4e2c0d05f0 msgr2=0x7f4e2c0698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.221+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 shutdown_connections 2023-10-07T09:06:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.222+0000 7f4e30cfe700 1 -- 172.21.15.46:0/2612267067 wait complete. 2023-10-07T09:06:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:06:19.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:06:19.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 Processor -- start 2023-10-07T09:06:19.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 -- start start 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc00b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 0x7f3dc00b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc006cff0 con 0x7f3dc00689b0 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc006bf50 con 0x7f3dc0159970 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.366+0000 7f3dc541b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc006c230 con 0x7f3dc00685e0 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbe7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3dc00689b0 0x7f3dc0159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:34326/0 (socket says 172.21.15.46:34326) 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbe7fc700 1 -- 172.21.15.46:0/1035118416 learned_addr learned my addr 172.21.15.46:0/1035118416 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/1035118416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc00b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbf7fe700 1 --2- 172.21.15.46:0/1035118416 >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 0x7f3dc00b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983555479 0 0) 0x7f3dc006cff0 con 0x7f3dc00689b0 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac003570 con 0x7f3dc00689b0 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1549494495 0 0) 0x7f3dac003570 con 0x7f3dc00689b0 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 -- 172.21.15.46:0/1035118416 >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 msgr2=0x7f3dc00b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/1035118416 >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 0x7f3dc00b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 -- 172.21.15.46:0/1035118416 >> v1:172.21.15.46:6789/0 conn(0x7f3dc00689b0 legacy=0x7f3dc0159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 -- 172.21.15.46:0/1035118416 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc006c510 con 0x7f3dc00685e0 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbf7fe700 1 --2- 172.21.15.46:0/1035118416 >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 0x7f3dc00b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.367+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/1035118416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc00b0b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009e60 tx=0x7f3db0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8178c61a3a4ae1dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000e070 con 0x7f3dc00685e0 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000b7a0 con 0x7f3dc00685e0 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dbdffb700 1 -- 172.21.15.46:0/1035118416 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8001470 con 0x7f3dc00685e0 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 -- 172.21.15.46:0/1035118416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 msgr2=0x7f3dc00b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 --2- 172.21.15.46:0/1035118416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc00b0b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009e60 tx=0x7f3db0009780 comp rx=0 tx=0).stop 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 -- 172.21.15.46:0/1035118416 shutdown_connections 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 --2- 172.21.15.46:0/1035118416 >> v2:172.21.15.133:3300/0 conn(0x7f3dc0159970 0x7f3dc00b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 --2- 172.21.15.46:0/1035118416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc00b0b60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 -- 172.21.15.46:0/1035118416 >> 172.21.15.46:0/1035118416 conn(0x7f3dc006a940 msgr2=0x7f3dc006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 -- 172.21.15.46:0/1035118416 shutdown_connections 2023-10-07T09:06:19.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.368+0000 7f3dc541b700 1 -- 172.21.15.46:0/1035118416 wait complete. 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.369+0000 7f3dc541b700 1 Processor -- start 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.369+0000 7f3dc541b700 1 -- start start 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc00689b0 0x7f3dc00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc014c000 con 0x7f3dc0159970 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00afd30 con 0x7f3dc00689b0 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dc541b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc014e150 con 0x7f3dc00685e0 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46406/0 (socket says 172.21.15.46:46406) 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 -- 172.21.15.46:0/3598407819 learned_addr learned my addr 172.21.15.46:0/3598407819 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbe7fc700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc00689b0 0x7f3dc00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 -- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 msgr2=0x7f3dc014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc014b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 -- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc00689b0 msgr2=0x7f3dc00ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc00689b0 0x7f3dc00ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.370+0000 7f3dbf7fe700 1 -- 172.21.15.46:0/3598407819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8009420 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3dbf7fe700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3db800ea20 tx=0x7f3db80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800ee60 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800c850 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0009a20 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800cc10 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.371+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc014e710 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.372+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc006d840 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.372+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3db8013470 con 0x7f3dc0159970 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.373+0000 7f3db6ffd700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 0x7f3da00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.373+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3db8084be0 con 0x7f3dc0159970 2023-10-07T09:06:19.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.373+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 0x7f3da00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:19.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.373+0000 7f3dbeffd700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 0x7f3da00697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097c0 tx=0x7f3db0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.377+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3db80518d0 con 0x7f3dc0159970 2023-10-07T09:06:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:19.616+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3dc006c7f0 con 0x7f3dc0159970 2023-10-07T09:06:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.218+0000 7f3db6ffd700 1 -- 172.21.15.46:0/3598407819 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v98) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3db80170c0 con 0x7f3dc0159970 2023-10-07T09:06:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 msgr2=0x7f3da00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 0x7f3da00697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097c0 tx=0x7f3db0018000 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 msgr2=0x7f3dc0169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3db800ea20 tx=0x7f3db80091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 shutdown_connections 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3da0067320 0x7f3da00697d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0159970 0x7f3dc0169f50 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3dc00685e0 0x7f3dc014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 --2- 172.21.15.46:0/3598407819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc00689b0 0x7f3dc00ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 >> 172.21.15.46:0/3598407819 conn(0x7f3dc006a940 msgr2=0x7f3dc00b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 shutdown_connections 2023-10-07T09:06:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.221+0000 7f3dc541b700 1 -- 172.21.15.46:0/3598407819 wait complete. 2023-10-07T09:06:20.224 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 26 and data pool 27 2023-10-07T09:06:20.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.358+0000 7f1683ce2700 1 Processor -- start 2023-10-07T09:06:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.358+0000 7f1683ce2700 1 -- start start 2023-10-07T09:06:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1683ce2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f167c06bcd0 0x7f167c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1683ce2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f167c06c0a0 0x7f167c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1683ce2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c15d7e0 con 0x7f167c15df50 2023-10-07T09:06:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1683ce2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c15dac0 con 0x7f167c06bcd0 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1683ce2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c15aa30 con 0x7f167c06c0a0 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1681a7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f167c06bcd0 0x7f167c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1681a7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f167c06bcd0 0x7f167c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57780/0 (socket says 172.21.15.46:57780) 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.359+0000 7f1681a7e700 1 -- 172.21.15.46:0/1770903064 learned_addr learned my addr 172.21.15.46:0/1770903064 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f168127d700 1 --2- 172.21.15.46:0/1770903064 >> v2:172.21.15.133:3300/0 conn(0x7f167c06c0a0 0x7f167c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1681a7e700 1 -- 172.21.15.46:0/1770903064 >> v2:172.21.15.133:3300/0 conn(0x7f167c06c0a0 msgr2=0x7f167c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1681a7e700 1 --2- 172.21.15.46:0/1770903064 >> v2:172.21.15.133:3300/0 conn(0x7f167c06c0a0 0x7f167c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1681a7e700 1 -- 172.21.15.46:0/1770903064 >> v1:172.21.15.133:6789/0 conn(0x7f167c15df50 legacy=0x7f167c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1681a7e700 1 -- 172.21.15.46:0/1770903064 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c15ad10 con 0x7f167c06bcd0 2023-10-07T09:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1681a7e700 1 --2- 172.21.15.46:0/1770903064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06bcd0 0x7f167c0caa90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f167c06b4e0 tx=0x7f1674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d790fa9e802afaec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1680a7c700 1 -- 172.21.15.46:0/1770903064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167400b860 con 0x7f167c06bcd0 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1680a7c700 1 -- 172.21.15.46:0/1770903064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167400b9c0 con 0x7f167c06bcd0 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.360+0000 7f1680a7c700 1 -- 172.21.15.46:0/1770903064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167400bd80 con 0x7f167c06bcd0 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 -- 172.21.15.46:0/1770903064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06bcd0 msgr2=0x7f167c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 --2- 172.21.15.46:0/1770903064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06bcd0 0x7f167c0caa90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f167c06b4e0 tx=0x7f1674009250 comp rx=0 tx=0).stop 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 -- 172.21.15.46:0/1770903064 shutdown_connections 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 --2- 172.21.15.46:0/1770903064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06bcd0 0x7f167c0caa90 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 --2- 172.21.15.46:0/1770903064 >> v2:172.21.15.133:3300/0 conn(0x7f167c06c0a0 0x7f167c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 -- 172.21.15.46:0/1770903064 >> 172.21.15.46:0/1770903064 conn(0x7f167c0ce600 msgr2=0x7f167c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 -- 172.21.15.46:0/1770903064 shutdown_connections 2023-10-07T09:06:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.361+0000 7f1683ce2700 1 -- 172.21.15.46:0/1770903064 wait complete. 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 Processor -- start 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 -- start start 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 0x7f167c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f167c15df50 0x7f167c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b3990 con 0x7f167c06c0a0 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b2d80 con 0x7f167c06bcd0 2023-10-07T09:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.362+0000 7f1683ce2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b3060 con 0x7f167c15df50 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57792/0 (socket says 172.21.15.46:57792) 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 -- 172.21.15.46:0/2449242352 learned_addr learned my addr 172.21.15.46:0/2449242352 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1681a7e700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 0x7f167c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168227f700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f167c15df50 0x7f167c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 -- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f167c15df50 msgr2=0x7f167c0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f167c15df50 0x7f167c0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 -- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 msgr2=0x7f167c1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 0x7f167c1491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 -- 172.21.15.46:0/2449242352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740094f0 con 0x7f167c06c0a0 2023-10-07T09:06:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1681a7e700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 0x7f167c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f168127d700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f167000d860 tx=0x7f1670008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700125f0 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670012750 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670012b10 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0b3340 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.363+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c149700 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.365+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c0b3b00 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.365+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f167001e460 con 0x7f167c06c0a0 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.365+0000 7f1679ffb700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 0x7f16680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.365+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1670085370 con 0x7f167c06c0a0 2023-10-07T09:06:20.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.366+0000 7f1681a7e700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 0x7f16680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.366+0000 7f1681a7e700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 0x7f16680697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f167c06b4e0 tx=0x7f1674017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.370+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1670055a50 con 0x7f167c06c0a0 2023-10-07T09:06:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.562+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f167c04c3c0 con 0x7f167c06c0a0 2023-10-07T09:06:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.563+0000 7f1679ffb700 1 -- 172.21.15.46:0/2449242352 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f16700555e0 con 0x7f167c06c0a0 2023-10-07T09:06:20.564 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:20.564 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":152,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:19.618005+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:20.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 msgr2=0x7f16680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 0x7f16680697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f167c06b4e0 tx=0x7f1674017000 comp rx=0 tx=0).stop 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 msgr2=0x7f167c0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f167000d860 tx=0x7f1670008040 comp rx=0 tx=0).stop 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 shutdown_connections 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1668067320 0x7f16680697d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f167c15df50 0x7f167c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f167c06bcd0 0x7f167c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 --2- 172.21.15.46:0/2449242352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c06c0a0 0x7f167c0b2370 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 >> 172.21.15.46:0/2449242352 conn(0x7f167c0ce600 msgr2=0x7f167c0c3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 shutdown_connections 2023-10-07T09:06:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.565+0000 7f1683ce2700 1 -- 172.21.15.46:0/2449242352 wait complete. 2023-10-07T09:06:20.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.696+0000 7f704f421700 1 Processor -- start 2023-10-07T09:06:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.696+0000 7f704f421700 1 -- start start 2023-10-07T09:06:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704f421700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704f421700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704f421700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704815a160 con 0x7f704815db10 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704f421700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70480d13a0 con 0x7f7048159890 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704f421700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704815e140 con 0x7f7048159c60 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704d1bd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704d9be700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f704815db10 0x7f7048069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48602/0 (socket says 172.21.15.46:48602) 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704d9be700 1 -- 172.21.15.46:0/2208575992 learned_addr learned my addr 172.21.15.46:0/2208575992 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.697+0000 7f704c9bc700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f704d1bd700 1 -- 172.21.15.46:0/2208575992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 msgr2=0x7f704815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f704d1bd700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f704d1bd700 1 -- 172.21.15.46:0/2208575992 >> v1:172.21.15.46:6789/0 conn(0x7f704815db10 legacy=0x7f7048069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f7047fff700 1 -- 172.21.15.46:0/2208575992 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592314763 0 0) 0x7f704815a160 con 0x7f704815db10 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f704d1bd700 1 -- 172.21.15.46:0/2208575992 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704815a3d0 con 0x7f7048159890 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f704d1bd700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f70380098e0 tx=0x7f70380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6906cc74da0f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f7047fff700 1 -- 172.21.15.46:0/2208575992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038009e80 con 0x7f7048159890 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f7047fff700 1 -- 172.21.15.46:0/2208575992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800b860 con 0x7f7048159890 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.698+0000 7f7047fff700 1 -- 172.21.15.46:0/2208575992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800bbe0 con 0x7f7048159890 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 -- 172.21.15.46:0/2208575992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 msgr2=0x7f704815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f70380098e0 tx=0x7f70380091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 -- 172.21.15.46:0/2208575992 shutdown_connections 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7048159890 0x7f704815abd0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 --2- 172.21.15.46:0/2208575992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f704815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 -- 172.21.15.46:0/2208575992 >> 172.21.15.46:0/2208575992 conn(0x7f7048068e20 msgr2=0x7f70480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 -- 172.21.15.46:0/2208575992 shutdown_connections 2023-10-07T09:06:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.699+0000 7f704f421700 1 -- 172.21.15.46:0/2208575992 wait complete. 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.700+0000 7f704f421700 1 Processor -- start 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.700+0000 7f704f421700 1 -- start start 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 0x7f70480cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480ce140 con 0x7f704815db10 2023-10-07T09:06:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480b36c0 con 0x7f7048159890 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480cd600 con 0x7f7048159c60 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57814/0 (socket says 172.21.15.46:57814) 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 -- 172.21.15.46:0/964006740 learned_addr learned my addr 172.21.15.46:0/964006740 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d1bd700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 0x7f70480cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704c9bc700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 -- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 msgr2=0x7f70480c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 -- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 msgr2=0x7f70480cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 0x7f70480cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 -- 172.21.15.46:0/964006740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009420 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d1bd700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 0x7f70480cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704d9be700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f704000cc20 tx=0x7f70400019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040015ca0 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040015e00 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040004e00 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70480cd8a0 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.701+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70480cde60 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.702+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704804c3c0 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.703+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f704000a850 con 0x7f704815db10 2023-10-07T09:06:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.703+0000 7f70457fa700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 0x7f70340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.703+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f704008d0c0 con 0x7f704815db10 2023-10-07T09:06:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.704+0000 7f704d1bd700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 0x7f70340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.704+0000 7f704d1bd700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 0x7f70340697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70380091e0 tx=0x7f7038017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.707+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7040059ea0 con 0x7f704815db10 2023-10-07T09:06:20.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.900+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70480b3800 con 0x7f704815db10 2023-10-07T09:06:20.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.900+0000 7f70457fa700 1 -- 172.21.15.46:0/964006740 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f704005d4c0 con 0x7f704815db10 2023-10-07T09:06:20.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:20.901 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":152,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:19.618005+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 msgr2=0x7f70340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 0x7f70340697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70380091e0 tx=0x7f7038017000 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 msgr2=0x7f70480cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f704000cc20 tx=0x7f70400019b0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 shutdown_connections 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7034067320 0x7f70340697d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f704815db10 0x7f70480cd0c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7048159890 0x7f70480cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 --2- 172.21.15.46:0/964006740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7048159c60 0x7f70480c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 >> 172.21.15.46:0/964006740 conn(0x7f7048068e20 msgr2=0x7f704814d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:20.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 shutdown_connections 2023-10-07T09:06:20.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:20.903+0000 7f704f421700 1 -- 172.21.15.46:0/964006740 wait complete. 2023-10-07T09:06:20.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:06:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 Processor -- start 2023-10-07T09:06:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 -- start start 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49c006bcd0 0x7f49c00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49c006c0a0 0x7f49c015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c015d7e0 con 0x7f49c015df50 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c015dac0 con 0x7f49c006bcd0 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.042+0000 7f49c6294700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c015aa30 con 0x7f49c006c0a0 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49c006bcd0 0x7f49c00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49c006bcd0 0x7f49c00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57822/0 (socket says 172.21.15.46:57822) 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 -- 172.21.15.46:0/3308752753 learned_addr learned my addr 172.21.15.46:0/3308752753 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bf7fe700 1 --2- 172.21.15.46:0/3308752753 >> v2:172.21.15.133:3300/0 conn(0x7f49c006c0a0 0x7f49c015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 -- 172.21.15.46:0/3308752753 >> v2:172.21.15.133:3300/0 conn(0x7f49c006c0a0 msgr2=0x7f49c015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 --2- 172.21.15.46:0/3308752753 >> v2:172.21.15.133:3300/0 conn(0x7f49c006c0a0 0x7f49c015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 -- 172.21.15.46:0/3308752753 >> v1:172.21.15.133:6789/0 conn(0x7f49c015df50 legacy=0x7f49c00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 -- 172.21.15.46:0/3308752753 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c015ad10 con 0x7f49c006bcd0 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49bffff700 1 --2- 172.21.15.46:0/3308752753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006bcd0 0x7f49c00caa90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f49c006b4e0 tx=0x7f49b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c0f64c29d2780b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49beffd700 1 -- 172.21.15.46:0/3308752753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000b820 con 0x7f49c006bcd0 2023-10-07T09:06:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49beffd700 1 -- 172.21.15.46:0/3308752753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000b980 con 0x7f49c006bcd0 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.043+0000 7f49beffd700 1 -- 172.21.15.46:0/3308752753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000bd40 con 0x7f49c006bcd0 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 -- 172.21.15.46:0/3308752753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006bcd0 msgr2=0x7f49c00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 --2- 172.21.15.46:0/3308752753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006bcd0 0x7f49c00caa90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f49c006b4e0 tx=0x7f49b0009250 comp rx=0 tx=0).stop 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 -- 172.21.15.46:0/3308752753 shutdown_connections 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 --2- 172.21.15.46:0/3308752753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006bcd0 0x7f49c00caa90 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 --2- 172.21.15.46:0/3308752753 >> v2:172.21.15.133:3300/0 conn(0x7f49c006c0a0 0x7f49c015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 -- 172.21.15.46:0/3308752753 >> 172.21.15.46:0/3308752753 conn(0x7f49c00ce600 msgr2=0x7f49c00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 -- 172.21.15.46:0/3308752753 shutdown_connections 2023-10-07T09:06:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.044+0000 7f49c6294700 1 -- 172.21.15.46:0/3308752753 wait complete. 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.045+0000 7f49c6294700 1 Processor -- start 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.045+0000 7f49c6294700 1 -- start start 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c006bcd0 0x7f49c015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c015df50 0x7f49c0148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0159bd0 con 0x7f49c006c0a0 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0148880 con 0x7f49c006bcd0 2023-10-07T09:06:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c6294700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c016db60 con 0x7f49c015df50 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57824/0 (socket says 172.21.15.46:57824) 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 -- 172.21.15.46:0/3709675419 learned_addr learned my addr 172.21.15.46:0/3709675419 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bffff700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c006bcd0 0x7f49c015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49c4831700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c015df50 0x7f49c0148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 -- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c015df50 msgr2=0x7f49c0148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c015df50 0x7f49c0148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:21.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 -- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c006bcd0 msgr2=0x7f49c015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c006bcd0 0x7f49c015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 -- 172.21.15.46:0/3709675419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00094f0 con 0x7f49c006c0a0 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49bf7fe700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f49b400d890 tx=0x7f49b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.046+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40125f0 con 0x7f49c006c0a0 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.047+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4012750 con 0x7f49c006c0a0 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.047+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c0169b10 con 0x7f49c006c0a0 2023-10-07T09:06:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.047+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012b10 con 0x7f49c006c0a0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.047+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c016d510 con 0x7f49c006c0a0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.048+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c016dcd0 con 0x7f49c006c0a0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.048+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f49b401e460 con 0x7f49c006c0a0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.048+0000 7f49a7fff700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 0x7f49ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.049+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49b4085200 con 0x7f49c006c0a0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.049+0000 7f49bffff700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 0x7f49ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.049+0000 7f49bffff700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 0x7f49ac0697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f49c006b4e0 tx=0x7f49b0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:21.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.053+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49b4051e50 con 0x7f49c006c0a0 2023-10-07T09:06:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:21.294+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f49c004c3c0 con 0x7f49c006c0a0 2023-10-07T09:06:22.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.231+0000 7f49a7fff700 1 -- 172.21.15.46:0/3709675419 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49b4055470 con 0x7f49c006c0a0 2023-10-07T09:06:22.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 msgr2=0x7f49ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 0x7f49ac0697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f49c006b4e0 tx=0x7f49b0016000 comp rx=0 tx=0).stop 2023-10-07T09:06:22.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 msgr2=0x7f49c0159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f49b400d890 tx=0x7f49b4008040 comp rx=0 tx=0).stop 2023-10-07T09:06:22.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 shutdown_connections 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f49ac067320 0x7f49ac0697d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c015df50 0x7f49c0148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c006bcd0 0x7f49c015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 --2- 172.21.15.46:0/3709675419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c006c0a0 0x7f49c0159690 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 >> 172.21.15.46:0/3709675419 conn(0x7f49c00ce600 msgr2=0x7f49c0157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 shutdown_connections 2023-10-07T09:06:22.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.234+0000 7f49c6294700 1 -- 172.21.15.46:0/3709675419 wait complete. 2023-10-07T09:06:22.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:06:22.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.378+0000 7fdc9759e700 1 Processor -- start 2023-10-07T09:06:22.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.378+0000 7fdc9759e700 1 -- start start 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc980b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9759e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980cfb00 con 0x7fdc980b16d0 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980b5c40 con 0x7fdc980b4e70 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980b5f20 con 0x7fdc980b1b40 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc95d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdc980b16d0 0x7fdc980b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48606/0 (socket says 172.21.15.46:48606) 2023-10-07T09:06:22.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc95d9b700 1 -- 172.21.15.46:0/2649758839 learned_addr learned my addr 172.21.15.46:0/2649758839 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc96d9d700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc980b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798752171 0 0) 0x7fdc980cfb00 con 0x7fdc980b16d0 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.379+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84003570 con 0x7fdc980b16d0 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758742276 0 0) 0x7fdc980b5c40 con 0x7fdc980b4e70 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc980cfb00 con 0x7fdc980b4e70 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067096015 0 0) 0x7fdc84003570 con 0x7fdc980b16d0 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 msgr2=0x7fdc980b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:22.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc980b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 >> v1:172.21.15.133:6789/0 conn(0x7fdc980b4e70 legacy=0x7fdc980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980b6200 con 0x7fdc980b16d0 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fdc80001470 con 0x7fdc980b16d0 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 >> v1:172.21.15.46:6789/0 conn(0x7fdc980b16d0 legacy=0x7fdc980b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc84003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc84004d50 0x7fdc840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980b5f20 con 0x7fdc840041d0 2023-10-07T09:06:22.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8400bca0 con 0x7fdc84004d50 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8400be60 con 0x7fdc980b1b40 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc9659c700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc84003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc96d9d700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc84004d50 0x7fdc840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 -- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 msgr2=0x7fdc84003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980b1b40 0x7fdc84003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 -- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc84004d50 msgr2=0x7fdc840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc84004d50 0x7fdc840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 -- 172.21.15.46:0/2649758839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84003570 con 0x7fdc840041d0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.380+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc84004810 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f463991d9d72f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000ca80 con 0x7fdc840041d0 2023-10-07T09:06:22.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8000cbe0 con 0x7fdc840041d0 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9559a700 1 -- 172.21.15.46:0/2649758839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80005920 con 0x7fdc840041d0 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 -- 172.21.15.46:0/2649758839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 msgr2=0x7fdc84004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 --2- 172.21.15.46:0/2649758839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc84004810 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80001d40 comp rx=0 tx=0).stop 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc96d9d700 1 -- 172.21.15.46:0/2649758839 reap_dead start 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 -- 172.21.15.46:0/2649758839 shutdown_connections 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 -- 172.21.15.46:0/2649758839 >> 172.21.15.46:0/2649758839 conn(0x7fdc980d10c0 msgr2=0x7fdc980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 -- 172.21.15.46:0/2649758839 shutdown_connections 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.381+0000 7fdc9759e700 1 -- 172.21.15.46:0/2649758839 wait complete. 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.382+0000 7fdc9759e700 1 Processor -- start 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.382+0000 7fdc9759e700 1 -- start start 2023-10-07T09:06:22.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc980caf50 0x7fdc981459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 0x7fdc980b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98145f20 con 0x7fdc840041d0 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98158660 con 0x7fdc980caf50 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c9c10 con 0x7fdc980c8700 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57836/0 (socket says 172.21.15.46:57836) 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 -- 172.21.15.46:0/8086469 learned_addr learned my addr 172.21.15.46:0/8086469 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc980caf50 0x7fdc981459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc96d9d700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 0x7fdc980b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 -- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 msgr2=0x7fdc980b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 0x7fdc980b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 -- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc980caf50 msgr2=0x7fdc981459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc980caf50 0x7fdc981459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc9659c700 1 -- 172.21.15.46:0/8086469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980c9000 con 0x7fdc840041d0 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.383+0000 7fdc96d9d700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 0x7fdc980b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc9659c700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000f8b0 tx=0x7fdc90007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90013600 con 0x7fdc840041d0 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90013780 con 0x7fdc840041d0 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980c92e0 con 0x7fdc840041d0 2023-10-07T09:06:22.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90013b40 con 0x7fdc840041d0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.384+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980c98a0 con 0x7fdc840041d0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.385+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98088990 con 0x7fdc840041d0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.385+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdc9001c400 con 0x7fdc840041d0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.386+0000 7fdc8e7fc700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 0x7fdc780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.386+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc900850b0 con 0x7fdc840041d0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.386+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 0x7fdc780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.386+0000 7fdc95d9b700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 0x7fdc780697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc80001120 tx=0x7fdc80015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:22.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.390+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc90051df0 con 0x7fdc840041d0 2023-10-07T09:06:22.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:22.629+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc9804bb80 con 0x7fdc840041d0 2023-10-07T09:06:23.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.231+0000 7fdc8e7fc700 1 -- 172.21.15.46:0/8086469 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v102) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc90055410 con 0x7fdc840041d0 2023-10-07T09:06:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.233+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 msgr2=0x7fdc780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.233+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 0x7fdc780697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc80001120 tx=0x7fdc80015000 comp rx=0 tx=0).stop 2023-10-07T09:06:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.233+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 msgr2=0x7fdc980ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.233+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000f8b0 tx=0x7fdc90007d30 comp rx=0 tx=0).stop 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 shutdown_connections 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc78067320 0x7fdc780697d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc980c8700 0x7fdc980b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc840041d0 0x7fdc980ca0a0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 --2- 172.21.15.46:0/8086469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc980caf50 0x7fdc981459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 >> 172.21.15.46:0/8086469 conn(0x7fdc980d10c0 msgr2=0x7fdc9815c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 shutdown_connections 2023-10-07T09:06:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.234+0000 7fdc9759e700 1 -- 172.21.15.46:0/8086469 wait complete. 2023-10-07T09:06:23.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.370+0000 7f5ff10c4700 1 Processor -- start 2023-10-07T09:06:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.370+0000 7f5ff10c4700 1 -- start start 2023-10-07T09:06:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.370+0000 7f5ff10c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff10c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fec1597f0 0x7f5fec0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff10c4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0b11d0 con 0x7f5fec15d230 2023-10-07T09:06:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff10c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0b14b0 con 0x7f5fec1597f0 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff10c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b1790 con 0x7f5fec159420 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff08c3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5fec15d230 0x7f5fec0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48612/0 (socket says 172.21.15.46:48612) 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5ff08c3700 1 -- 172.21.15.46:0/3681908251 learned_addr learned my addr 172.21.15.46:0/3681908251 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5febfff700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feb7fe700 1 --2- 172.21.15.46:0/3681908251 >> v2:172.21.15.133:3300/0 conn(0x7f5fec1597f0 0x7f5fec0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86914365 0 0) 0x7f5fec0b11d0 con 0x7f5fec15d230 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd4003570 con 0x7f5fec15d230 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633889011 0 0) 0x7f5fd4003570 con 0x7f5fec15d230 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 msgr2=0x7f5fec0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fec0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 >> v2:172.21.15.133:3300/0 conn(0x7f5fec1597f0 msgr2=0x7f5fec0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 --2- 172.21.15.46:0/3681908251 >> v2:172.21.15.133:3300/0 conn(0x7f5fec1597f0 0x7f5fec0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0b1a70 con 0x7f5fec15d230 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5fe40017f0 con 0x7f5fec15d230 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 >> v1:172.21.15.46:6789/0 conn(0x7f5fec15d230 legacy=0x7f5fec0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fd4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fd4003fe0 0x7f5fd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b14b0 con 0x7f5fd4004d50 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b1790 con 0x7f5fd4003fe0 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.371+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400ba90 con 0x7f5fec159420 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5febfff700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fd4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5feb7fe700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fd4003fe0 0x7f5fd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 -- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 msgr2=0x7f5fd4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec159420 0x7f5fd4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 -- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fd4003fe0 msgr2=0x7f5fd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fd4003fe0 0x7f5fd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 -- 172.21.15.46:0/3681908251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4003570 con 0x7f5fd4004d50 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a970 tx=0x7f5fe4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50212c9ba36bd03d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4012440 con 0x7f5fd4004d50 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40125c0 con 0x7f5fd4004d50 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.372+0000 7f5feaffd700 1 -- 172.21.15.46:0/3681908251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4012980 con 0x7f5fd4004d50 2023-10-07T09:06:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 -- 172.21.15.46:0/3681908251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd4004d50 msgr2=0x7f5fd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/3681908251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a970 tx=0x7f5fe4002210 comp rx=0 tx=0).stop 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff08c3700 1 -- 172.21.15.46:0/3681908251 reap_dead start 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 -- 172.21.15.46:0/3681908251 shutdown_connections 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 -- 172.21.15.46:0/3681908251 >> 172.21.15.46:0/3681908251 conn(0x7f5fec0d0660 msgr2=0x7f5fec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 -- 172.21.15.46:0/3681908251 shutdown_connections 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.373+0000 7f5ff10c4700 1 -- 172.21.15.46:0/3681908251 wait complete. 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.374+0000 7f5ff10c4700 1 Processor -- start 2023-10-07T09:06:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.374+0000 7f5ff10c4700 1 -- start start 2023-10-07T09:06:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec1493b0 0x7f5fec15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 0x7f5fec0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c6a80 con 0x7f5fec0c7c40 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c80b0 con 0x7f5fec1493b0 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c5eb0 con 0x7f5fec1560a0 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57866/0 (socket says 172.21.15.46:57866) 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 -- 172.21.15.46:0/2067316738 learned_addr learned my addr 172.21.15.46:0/2067316738 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5febfff700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec1493b0 0x7f5fec15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5feb7fe700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 0x7f5fec0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 -- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 msgr2=0x7f5fec0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 0x7f5fec0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 -- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec1493b0 msgr2=0x7f5fec15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec1493b0 0x7f5fec15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 -- 172.21.15.46:0/2067316738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec156930 con 0x7f5fec0c7c40 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5feb7fe700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 0x7f5fec0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff08c3700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4012af0 tx=0x7f5fe4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4012440 con 0x7f5fec0c7c40 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40017b0 con 0x7f5fec0c7c40 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec0c6150 con 0x7f5fec0c7c40 2023-10-07T09:06:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007530 con 0x7f5fec0c7c40 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.375+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec0c6710 con 0x7f5fec0c7c40 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.376+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec04c3c0 con 0x7f5fec0c7c40 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.377+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5fe4019030 con 0x7f5fec0c7c40 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.377+0000 7f5fd3fff700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 0x7f5fd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.377+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fe4086b70 con 0x7f5fec0c7c40 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.377+0000 7f5febfff700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 0x7f5fd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.378+0000 7f5febfff700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 0x7f5fd80697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0006f00 tx=0x7f5fe00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.381+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe4053800 con 0x7f5fec0c7c40 2023-10-07T09:06:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.617+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fec0b1d50 con 0x7f5fec0c7c40 2023-10-07T09:06:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.618+0000 7f5fd3fff700 1 -- 172.21.15.46:0/2067316738 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7f5fe4017090 con 0x7f5fec0c7c40 2023-10-07T09:06:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:23.620 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 msgr2=0x7f5fd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 0x7f5fd80697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0006f00 tx=0x7f5fe00091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 msgr2=0x7f5fec159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4012af0 tx=0x7f5fe4015000 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 shutdown_connections 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5fd8067320 0x7f5fd80697d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fec0c7c40 0x7f5fec159d70 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec1493b0 0x7f5fec15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 --2- 172.21.15.46:0/2067316738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec1560a0 0x7f5fec0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 >> 172.21.15.46:0/2067316738 conn(0x7f5fec0d0660 msgr2=0x7f5fec069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 shutdown_connections 2023-10-07T09:06:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.620+0000 7f5ff10c4700 1 -- 172.21.15.46:0/2067316738 wait complete. 2023-10-07T09:06:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 102 2023-10-07T09:06:23.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.751+0000 7fd61a735700 1 Processor -- start 2023-10-07T09:06:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.751+0000 7fd61a735700 1 -- start start 2023-10-07T09:06:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd61a735700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd614159c60 0x7fd61415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd61a735700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd61415db10 0x7fd614069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd61a735700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61415a160 con 0x7fd614159890 2023-10-07T09:06:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd61a735700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6140d13a0 con 0x7fd61415db10 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd61a735700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61415e140 con 0x7fd614159c60 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd61415db10 0x7fd614069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd61415db10 0x7fd614069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57880/0 (socket says 172.21.15.46:57880) 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 -- 172.21.15.46:0/2624259173 learned_addr learned my addr 172.21.15.46:0/2624259173 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd613fff700 1 --1- 172.21.15.46:0/2624259173 >> v1:172.21.15.133:6789/0 conn(0x7fd614159890 0x7fd61415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:38658/0 (socket says 172.21.15.46:38658) 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd6137fe700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd614159c60 0x7fd61415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 -- 172.21.15.46:0/2624259173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd614159c60 msgr2=0x7fd61415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd614159c60 0x7fd61415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 -- 172.21.15.46:0/2624259173 >> v1:172.21.15.133:6789/0 conn(0x7fd614159890 legacy=0x7fd61415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 -- 172.21.15.46:0/2624259173 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61415a3d0 con 0x7fd61415db10 2023-10-07T09:06:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.752+0000 7fd618cd2700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd61415db10 0x7fd614069560 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009f20 tx=0x7fd60c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568dec9025157101 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd612ffd700 1 -- 172.21.15.46:0/2624259173 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00e070 con 0x7fd61415db10 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd612ffd700 1 -- 172.21.15.46:0/2624259173 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00b9d0 con 0x7fd61415db10 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd612ffd700 1 -- 172.21.15.46:0/2624259173 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0092e0 con 0x7fd61415db10 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 -- 172.21.15.46:0/2624259173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd61415db10 msgr2=0x7fd614069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd61415db10 0x7fd614069560 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009f20 tx=0x7fd60c009840 comp rx=0 tx=0).stop 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 -- 172.21.15.46:0/2624259173 shutdown_connections 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd61415db10 0x7fd614069560 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 --2- 172.21.15.46:0/2624259173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd614159c60 0x7fd61415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 -- 172.21.15.46:0/2624259173 >> 172.21.15.46:0/2624259173 conn(0x7fd614068e20 msgr2=0x7fd6140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 -- 172.21.15.46:0/2624259173 shutdown_connections 2023-10-07T09:06:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.753+0000 7fd61a735700 1 -- 172.21.15.46:0/2624259173 wait complete. 2023-10-07T09:06:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.754+0000 7fd61a735700 1 Processor -- start 2023-10-07T09:06:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.754+0000 7fd61a735700 1 -- start start 2023-10-07T09:06:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd614159c60 0x7fd61416d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 0x7fd6140cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61416e450 con 0x7fd614159890 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140b0c50 con 0x7fd614159c60 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd61a735700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140b0f30 con 0x7fd61415db10 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd613fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57886/0 (socket says 172.21.15.46:57886) 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd613fff700 1 -- 172.21.15.46:0/1409072335 learned_addr learned my addr 172.21.15.46:0/1409072335 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd6137fe700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd614159c60 0x7fd61416d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.755+0000 7fd618cd2700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 0x7fd6140cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 -- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 msgr2=0x7fd6140cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 0x7fd6140cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 -- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd614159c60 msgr2=0x7fd61416d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd614159c60 0x7fd61416d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 -- 172.21.15.46:0/1409072335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009ae0 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd618cd2700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 0x7fd6140cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd613fff700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c7c0 tx=0x7fd5fc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc005a70 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc005bf0 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6140b1210 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0070f0 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.756+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6140b17d0 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.757+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61404c3c0 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.757+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd5fc007460 con 0x7fd614159890 2023-10-07T09:06:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.758+0000 7fd60bfff700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 0x7fd5f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.758+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5fc084610 con 0x7fd614159890 2023-10-07T09:06:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.758+0000 7fd6137fe700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 0x7fd5f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.758+0000 7fd6137fe700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 0x7fd5f40697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd6140d0f20 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.762+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5fc051420 con 0x7fd614159890 2023-10-07T09:06:23.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.958+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6140b1b40 con 0x7fd614159890 2023-10-07T09:06:23.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.959+0000 7fd60bfff700 1 -- 172.21.15.46:0/1409072335 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fd5fc054a40 con 0x7fd614159890 2023-10-07T09:06:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:23.961 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":153,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:20.936059+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:23.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 msgr2=0x7fd5f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 0x7fd5f40697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd6140d0f20 tx=0x7fd604008040 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 msgr2=0x7fd6140b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c7c0 tx=0x7fd5fc007f70 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 shutdown_connections 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5f4067320 0x7fd5f40697d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd61415db10 0x7fd6140cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd614159890 0x7fd6140b1cd0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 --2- 172.21.15.46:0/1409072335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd614159c60 0x7fd61416d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 >> 172.21.15.46:0/1409072335 conn(0x7fd614068e20 msgr2=0x7fd614153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 shutdown_connections 2023-10-07T09:06:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:23.961+0000 7fd61a735700 1 -- 172.21.15.46:0/1409072335 wait complete. 2023-10-07T09:06:23.975 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:06:23.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:06:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.091+0000 7f913f8e8700 1 Processor -- start 2023-10-07T09:06:24.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 -- start start 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91380caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f913806c0a0 0x7f913815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913815d7e0 con 0x7f913815df50 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913815dac0 con 0x7f913806c0a0 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913f8e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913815aa30 con 0x7f913806bcd0 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.092+0000 7f913de85700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f913815df50 0x7f91380c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48614/0 (socket says 172.21.15.46:48614) 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913de85700 1 -- 172.21.15.46:0/282781249 learned_addr learned my addr 172.21.15.46:0/282781249 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913ce83700 1 --2- 172.21.15.46:0/282781249 >> v2:172.21.15.133:3300/0 conn(0x7f913806c0a0 0x7f913815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913d684700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91380caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395682456 0 0) 0x7f913815d7e0 con 0x7f913815df50 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9120003570 con 0x7f913815df50 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3367542015 0 0) 0x7f9120003570 con 0x7f913815df50 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 msgr2=0x7f91380caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91380caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 >> v2:172.21.15.133:3300/0 conn(0x7f913806c0a0 msgr2=0x7f913815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 --2- 172.21.15.46:0/282781249 >> v2:172.21.15.133:3300/0 conn(0x7f913806c0a0 0x7f913815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913815ad10 con 0x7f913815df50 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f91280017f0 con 0x7f913815df50 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913d684700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91380caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 >> v1:172.21.15.46:6789/0 conn(0x7f913815df50 legacy=0x7f91380c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9120003a60 0x7f9120003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913815dac0 con 0x7f9120004810 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913815aa30 con 0x7f9120003a60 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912000ba90 con 0x7f913806bcd0 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913ce83700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913d684700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9120003a60 0x7f9120003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.093+0000 7f913de85700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 -- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 msgr2=0x7f91200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f913806bcd0 0x7f91200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 -- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9120003a60 msgr2=0x7f9120003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9120003a60 0x7f9120003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 -- 172.21.15.46:0/282781249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009420 con 0x7f9120004810 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913ce83700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9120004c80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f912c009c00 tx=0x7f912c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929ea1178e4bf93b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00e6b0 con 0x7f9120004810 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c00e810 con 0x7f9120004810 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f9137fff700 1 -- 172.21.15.46:0/282781249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ebd0 con 0x7f9120004810 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913f8e8700 1 -- 172.21.15.46:0/282781249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 msgr2=0x7f9120004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913f8e8700 1 --2- 172.21.15.46:0/282781249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9120004c80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f912c009c00 tx=0x7f912c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913de85700 1 -- 172.21.15.46:0/282781249 reap_dead start 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913f8e8700 1 -- 172.21.15.46:0/282781249 shutdown_connections 2023-10-07T09:06:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.094+0000 7f913f8e8700 1 -- 172.21.15.46:0/282781249 >> 172.21.15.46:0/282781249 conn(0x7f91380ce600 msgr2=0x7f91380cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.095+0000 7f913f8e8700 1 -- 172.21.15.46:0/282781249 shutdown_connections 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.095+0000 7f913f8e8700 1 -- 172.21.15.46:0/282781249 wait complete. 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 Processor -- start 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 -- start start 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380c4630 0x7f91380b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4aa0 0x7f91380b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91381551b0 con 0x7f9120004810 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138153c10 con 0x7f91380c4aa0 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.096+0000 7f913f8e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138153eb0 con 0x7f91380c4630 2023-10-07T09:06:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57902/0 (socket says 172.21.15.46:57902) 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 -- 172.21.15.46:0/1342369085 learned_addr learned my addr 172.21.15.46:0/1342369085 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913de85700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4aa0 0x7f91380b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913ce83700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380c4630 0x7f91380b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 -- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380c4630 msgr2=0x7f91380b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380c4630 0x7f91380b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 -- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4aa0 msgr2=0x7f91380b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4aa0 0x7f91380b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 -- 172.21.15.46:0/1342369085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138154190 con 0x7f9120004810 2023-10-07T09:06:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913d684700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9130011d70 tx=0x7f91300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000fcd0 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000fe30 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138154470 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130014670 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.097+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913816e490 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.098+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913804c3c0 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.099+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9130014a60 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.099+0000 7f91357fa700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 0x7f91240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.099+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9130018030 con 0x7f9120004810 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.099+0000 7f913ce83700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 0x7f91240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.100+0000 7f913ce83700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 0x7f91240697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f912c0091e0 tx=0x7f912c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.103+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9130052910 con 0x7f9120004810 2023-10-07T09:06:24.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.293+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f913815aff0 con 0x7f9124067320 2023-10-07T09:06:24.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.301+0000 7f91357fa700 1 -- 172.21.15.46:0/1342369085 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289870 (secure 0 0 0) 0x7f913815aff0 con 0x7f9124067320 2023-10-07T09:06:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:24.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 msgr2=0x7f91240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 0x7f91240697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f912c0091e0 tx=0x7f912c01a000 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 msgr2=0x7f9138154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9130011d70 tx=0x7f91300091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 shutdown_connections 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9124067320 0x7f91240697d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4aa0 0x7f91380b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9120004810 0x7f9138154c70 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 --2- 172.21.15.46:0/1342369085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380c4630 0x7f91380b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 >> 172.21.15.46:0/1342369085 conn(0x7f91380ce600 msgr2=0x7f913815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 shutdown_connections 2023-10-07T09:06:24.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.304+0000 7f913f8e8700 1 -- 172.21.15.46:0/1342369085 wait complete. 2023-10-07T09:06:24.310 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:06:24.318 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2023-10-07T09:06:23.875848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427332,"kb_used_data":16260,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547388,"statfs":{"total":773094113280,"available":770608525312,"internally_reserved":0,"allocated":16650240,"data_stored":8044106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673056"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958320+0000","last_change":"2023-10-07T09:06:19.958320+0000","last_active":"2023-10-07T09:06:19.958320+0000","last_peered":"2023-10-07T09:06:19.958320+0000","last_clean":"2023-10-07T09:06:19.958320+0000","last_became_active":"2023-10-07T09:06:19.958058+0000","last_became_peered":"2023-10-07T09:06:19.958058+0000","last_unstale":"2023-10-07T09:06:19.958320+0000","last_undegraded":"2023-10-07T09:06:19.958320+0000","last_fullsized":"2023-10-07T09:06:19.958320+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:53.562287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961515+0000","last_change":"2023-10-07T09:06:19.961515+0000","last_active":"2023-10-07T09:06:19.961515+0000","last_peered":"2023-10-07T09:06:19.961515+0000","last_clean":"2023-10-07T09:06:19.961515+0000","last_became_active":"2023-10-07T09:06:19.961075+0000","last_became_peered":"2023-10-07T09:06:19.961075+0000","last_unstale":"2023-10-07T09:06:19.961515+0000","last_undegraded":"2023-10-07T09:06:19.961515+0000","last_fullsized":"2023-10-07T09:06:19.961515+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:20:03.804570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957840+0000","last_change":"2023-10-07T09:06:19.957840+0000","last_active":"2023-10-07T09:06:19.957840+0000","last_peered":"2023-10-07T09:06:19.957840+0000","last_clean":"2023-10-07T09:06:19.957840+0000","last_became_active":"2023-10-07T09:06:19.957506+0000","last_became_peered":"2023-10-07T09:06:19.957506+0000","last_unstale":"2023-10-07T09:06:19.957840+0000","last_undegraded":"2023-10-07T09:06:19.957840+0000","last_fullsized":"2023-10-07T09:06:19.957840+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.960951+0000","last_change":"2023-10-07T09:06:19.960951+0000","last_active":"2023-10-07T09:06:19.960951+0000","last_peered":"2023-10-07T09:06:19.960951+0000","last_clean":"2023-10-07T09:06:19.960951+0000","last_became_active":"2023-10-07T09:06:19.960615+0000","last_became_peered":"2023-10-07T09:06:19.960615+0000","last_unstale":"2023-10-07T09:06:19.960951+0000","last_undegraded":"2023-10-07T09:06:19.960951+0000","last_fullsized":"2023-10-07T09:06:19.960951+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:50.796999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950681+0000","last_change":"2023-10-07T09:06:19.950681+0000","last_active":"2023-10-07T09:06:19.950681+0000","last_peered":"2023-10-07T09:06:19.950681+0000","last_clean":"2023-10-07T09:06:19.950681+0000","last_became_active":"2023-10-07T09:06:19.950160+0000","last_became_peered":"2023-10-07T09:06:19.950160+0000","last_unstale":"2023-10-07T09:06:19.950681+0000","last_undegraded":"2023-10-07T09:06:19.950681+0000","last_fullsized":"2023-10-07T09:06:19.950681+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:46.044935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954022+0000","last_change":"2023-10-07T09:06:19.954022+0000","last_active":"2023-10-07T09:06:19.954022+0000","last_peered":"2023-10-07T09:06:19.954022+0000","last_clean":"2023-10-07T09:06:19.954022+0000","last_became_active":"2023-10-07T09:06:19.953658+0000","last_became_peered":"2023-10-07T09:06:19.953658+0000","last_unstale":"2023-10-07T09:06:19.954022+0000","last_undegraded":"2023-10-07T09:06:19.954022+0000","last_fullsized":"2023-10-07T09:06:19.954022+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:43.119885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.960687+0000","last_change":"2023-10-07T09:06:19.960687+0000","last_active":"2023-10-07T09:06:19.960687+0000","last_peered":"2023-10-07T09:06:19.960687+0000","last_clean":"2023-10-07T09:06:19.960687+0000","last_became_active":"2023-10-07T09:06:19.960360+0000","last_became_peered":"2023-10-07T09:06:19.960360+0000","last_unstale":"2023-10-07T09:06:19.960687+0000","last_undegraded":"2023-10-07T09:06:19.960687+0000","last_fullsized":"2023-10-07T09:06:19.960687+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:24.773927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.947342+0000","last_change":"2023-10-07T09:06:19.947342+0000","last_active":"2023-10-07T09:06:19.947342+0000","last_peered":"2023-10-07T09:06:19.947342+0000","last_clean":"2023-10-07T09:06:19.947342+0000","last_became_active":"2023-10-07T09:06:19.947064+0000","last_became_peered":"2023-10-07T09:06:19.947064+0000","last_unstale":"2023-10-07T09:06:19.947342+0000","last_undegraded":"2023-10-07T09:06:19.947342+0000","last_fullsized":"2023-10-07T09:06:19.947342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:50.656307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957997+0000","last_change":"2023-10-07T09:06:19.957997+0000","last_active":"2023-10-07T09:06:19.957997+0000","last_peered":"2023-10-07T09:06:19.957997+0000","last_clean":"2023-10-07T09:06:19.957997+0000","last_became_active":"2023-10-07T09:06:19.957733+0000","last_became_peered":"2023-10-07T09:06:19.957733+0000","last_unstale":"2023-10-07T09:06:19.957997+0000","last_undegraded":"2023-10-07T09:06:19.957997+0000","last_fullsized":"2023-10-07T09:06:19.957997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:19:01.772185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948971+0000","last_change":"2023-10-07T09:06:19.948971+0000","last_active":"2023-10-07T09:06:19.948971+0000","last_peered":"2023-10-07T09:06:19.948971+0000","last_clean":"2023-10-07T09:06:19.948971+0000","last_became_active":"2023-10-07T09:06:19.948758+0000","last_became_peered":"2023-10-07T09:06:19.948758+0000","last_unstale":"2023-10-07T09:06:19.948971+0000","last_undegraded":"2023-10-07T09:06:19.948971+0000","last_fullsized":"2023-10-07T09:06:19.948971+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:13:50.768648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953717+0000","last_change":"2023-10-07T09:06:19.953717+0000","last_active":"2023-10-07T09:06:19.953717+0000","last_peered":"2023-10-07T09:06:19.953717+0000","last_clean":"2023-10-07T09:06:19.953717+0000","last_became_active":"2023-10-07T09:06:19.953416+0000","last_became_peered":"2023-10-07T09:06:19.953416+0000","last_unstale":"2023-10-07T09:06:19.953717+0000","last_undegraded":"2023-10-07T09:06:19.953717+0000","last_fullsized":"2023-10-07T09:06:19.953717+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954174+0000","last_change":"2023-10-07T09:06:19.954174+0000","last_active":"2023-10-07T09:06:19.954174+0000","last_peered":"2023-10-07T09:06:19.954174+0000","last_clean":"2023-10-07T09:06:19.954174+0000","last_became_active":"2023-10-07T09:06:19.953764+0000","last_became_peered":"2023-10-07T09:06:19.953764+0000","last_unstale":"2023-10-07T09:06:19.954174+0000","last_undegraded":"2023-10-07T09:06:19.954174+0000","last_fullsized":"2023-10-07T09:06:19.954174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955442+0000","last_change":"2023-10-07T09:06:19.955442+0000","last_active":"2023-10-07T09:06:19.955442+0000","last_peered":"2023-10-07T09:06:19.955442+0000","last_clean":"2023-10-07T09:06:19.955442+0000","last_became_active":"2023-10-07T09:06:19.955164+0000","last_became_peered":"2023-10-07T09:06:19.955164+0000","last_unstale":"2023-10-07T09:06:19.955442+0000","last_undegraded":"2023-10-07T09:06:19.955442+0000","last_fullsized":"2023-10-07T09:06:19.955442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:19.490699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954662+0000","last_change":"2023-10-07T09:06:19.954662+0000","last_active":"2023-10-07T09:06:19.954662+0000","last_peered":"2023-10-07T09:06:19.954662+0000","last_clean":"2023-10-07T09:06:19.954662+0000","last_became_active":"2023-10-07T09:06:19.954383+0000","last_became_peered":"2023-10-07T09:06:19.954383+0000","last_unstale":"2023-10-07T09:06:19.954662+0000","last_undegraded":"2023-10-07T09:06:19.954662+0000","last_fullsized":"2023-10-07T09:06:19.954662+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:58.929235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951957+0000","last_change":"2023-10-07T09:06:19.951957+0000","last_active":"2023-10-07T09:06:19.951957+0000","last_peered":"2023-10-07T09:06:19.951957+0000","last_clean":"2023-10-07T09:06:19.951957+0000","last_became_active":"2023-10-07T09:06:19.949731+0000","last_became_peered":"2023-10-07T09:06:19.949731+0000","last_unstale":"2023-10-07T09:06:19.951957+0000","last_undegraded":"2023-10-07T09:06:19.951957+0000","last_fullsized":"2023-10-07T09:06:19.951957+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:22.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957055+0000","last_change":"2023-10-07T09:06:19.957055+0000","last_active":"2023-10-07T09:06:19.957055+0000","last_peered":"2023-10-07T09:06:19.957055+0000","last_clean":"2023-10-07T09:06:19.957055+0000","last_became_active":"2023-10-07T09:06:19.956787+0000","last_became_peered":"2023-10-07T09:06:19.956787+0000","last_unstale":"2023-10-07T09:06:19.957055+0000","last_undegraded":"2023-10-07T09:06:19.957055+0000","last_fullsized":"2023-10-07T09:06:19.957055+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:45.871077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958504+0000","last_change":"2023-10-07T09:06:19.958504+0000","last_active":"2023-10-07T09:06:19.958504+0000","last_peered":"2023-10-07T09:06:19.958504+0000","last_clean":"2023-10-07T09:06:19.958504+0000","last_became_active":"2023-10-07T09:06:19.958159+0000","last_became_peered":"2023-10-07T09:06:19.958159+0000","last_unstale":"2023-10-07T09:06:19.958504+0000","last_undegraded":"2023-10-07T09:06:19.958504+0000","last_fullsized":"2023-10-07T09:06:19.958504+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:06.485241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950121+0000","last_change":"2023-10-07T09:06:19.950121+0000","last_active":"2023-10-07T09:06:19.950121+0000","last_peered":"2023-10-07T09:06:19.950121+0000","last_clean":"2023-10-07T09:06:19.950121+0000","last_became_active":"2023-10-07T09:06:19.949856+0000","last_became_peered":"2023-10-07T09:06:19.949856+0000","last_unstale":"2023-10-07T09:06:19.950121+0000","last_undegraded":"2023-10-07T09:06:19.950121+0000","last_fullsized":"2023-10-07T09:06:19.950121+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:53.562287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950275+0000","last_change":"2023-10-07T09:06:19.950275+0000","last_active":"2023-10-07T09:06:19.950275+0000","last_peered":"2023-10-07T09:06:19.950275+0000","last_clean":"2023-10-07T09:06:19.950275+0000","last_became_active":"2023-10-07T09:06:19.949678+0000","last_became_peered":"2023-10-07T09:06:19.949678+0000","last_unstale":"2023-10-07T09:06:19.950275+0000","last_undegraded":"2023-10-07T09:06:19.950275+0000","last_fullsized":"2023-10-07T09:06:19.950275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:14:54.557342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950275+0000","last_change":"2023-10-07T09:06:19.950275+0000","last_active":"2023-10-07T09:06:19.950275+0000","last_peered":"2023-10-07T09:06:19.950275+0000","last_clean":"2023-10-07T09:06:19.950275+0000","last_became_active":"2023-10-07T09:06:19.950021+0000","last_became_peered":"2023-10-07T09:06:19.950021+0000","last_unstale":"2023-10-07T09:06:19.950275+0000","last_undegraded":"2023-10-07T09:06:19.950275+0000","last_fullsized":"2023-10-07T09:06:19.950275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:16.851846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955442+0000","last_change":"2023-10-07T09:06:19.955442+0000","last_active":"2023-10-07T09:06:19.955442+0000","last_peered":"2023-10-07T09:06:19.955442+0000","last_clean":"2023-10-07T09:06:19.955442+0000","last_became_active":"2023-10-07T09:06:19.955190+0000","last_became_peered":"2023-10-07T09:06:19.955190+0000","last_unstale":"2023-10-07T09:06:19.955442+0000","last_undegraded":"2023-10-07T09:06:19.955442+0000","last_fullsized":"2023-10-07T09:06:19.955442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:20.975936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953543+0000","last_change":"2023-10-07T09:06:19.953543+0000","last_active":"2023-10-07T09:06:19.953543+0000","last_peered":"2023-10-07T09:06:19.953543+0000","last_clean":"2023-10-07T09:06:19.953543+0000","last_became_active":"2023-10-07T09:06:19.953320+0000","last_became_peered":"2023-10-07T09:06:19.953320+0000","last_unstale":"2023-10-07T09:06:19.953543+0000","last_undegraded":"2023-10-07T09:06:19.953543+0000","last_fullsized":"2023-10-07T09:06:19.953543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:28.488678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953424+0000","last_change":"2023-10-07T09:06:19.953424+0000","last_active":"2023-10-07T09:06:19.953424+0000","last_peered":"2023-10-07T09:06:19.953424+0000","last_clean":"2023-10-07T09:06:19.953424+0000","last_became_active":"2023-10-07T09:06:19.953162+0000","last_became_peered":"2023-10-07T09:06:19.953162+0000","last_unstale":"2023-10-07T09:06:19.953424+0000","last_undegraded":"2023-10-07T09:06:19.953424+0000","last_fullsized":"2023-10-07T09:06:19.953424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:07.166035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957769+0000","last_change":"2023-10-07T09:06:19.957769+0000","last_active":"2023-10-07T09:06:19.957769+0000","last_peered":"2023-10-07T09:06:19.957769+0000","last_clean":"2023-10-07T09:06:19.957769+0000","last_became_active":"2023-10-07T09:06:19.957465+0000","last_became_peered":"2023-10-07T09:06:19.957465+0000","last_unstale":"2023-10-07T09:06:19.957769+0000","last_undegraded":"2023-10-07T09:06:19.957769+0000","last_fullsized":"2023-10-07T09:06:19.957769+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:00.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951305+0000","last_change":"2023-10-07T09:06:19.951305+0000","last_active":"2023-10-07T09:06:19.951305+0000","last_peered":"2023-10-07T09:06:19.951305+0000","last_clean":"2023-10-07T09:06:19.951305+0000","last_became_active":"2023-10-07T09:06:19.949768+0000","last_became_peered":"2023-10-07T09:06:19.949768+0000","last_unstale":"2023-10-07T09:06:19.951305+0000","last_undegraded":"2023-10-07T09:06:19.951305+0000","last_fullsized":"2023-10-07T09:06:19.951305+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:29.886940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954740+0000","last_change":"2023-10-07T09:06:19.954740+0000","last_active":"2023-10-07T09:06:19.954740+0000","last_peered":"2023-10-07T09:06:19.954740+0000","last_clean":"2023-10-07T09:06:19.954740+0000","last_became_active":"2023-10-07T09:06:19.954426+0000","last_became_peered":"2023-10-07T09:06:19.954426+0000","last_unstale":"2023-10-07T09:06:19.954740+0000","last_undegraded":"2023-10-07T09:06:19.954740+0000","last_fullsized":"2023-10-07T09:06:19.954740+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:26.152145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952836+0000","last_change":"2023-10-07T09:06:19.952836+0000","last_active":"2023-10-07T09:06:19.952836+0000","last_peered":"2023-10-07T09:06:19.952836+0000","last_clean":"2023-10-07T09:06:19.952836+0000","last_became_active":"2023-10-07T09:06:19.952483+0000","last_became_peered":"2023-10-07T09:06:19.952483+0000","last_unstale":"2023-10-07T09:06:19.952836+0000","last_undegraded":"2023-10-07T09:06:19.952836+0000","last_fullsized":"2023-10-07T09:06:19.952836+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:55.168892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.942373+0000","last_change":"2023-10-07T09:06:19.942373+0000","last_active":"2023-10-07T09:06:19.942373+0000","last_peered":"2023-10-07T09:06:19.942373+0000","last_clean":"2023-10-07T09:06:19.942373+0000","last_became_active":"2023-10-07T09:06:19.942111+0000","last_became_peered":"2023-10-07T09:06:19.942111+0000","last_unstale":"2023-10-07T09:06:19.942373+0000","last_undegraded":"2023-10-07T09:06:19.942373+0000","last_fullsized":"2023-10-07T09:06:19.942373+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:55.168892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954647+0000","last_change":"2023-10-07T09:06:19.954647+0000","last_active":"2023-10-07T09:06:19.954647+0000","last_peered":"2023-10-07T09:06:19.954647+0000","last_clean":"2023-10-07T09:06:19.954647+0000","last_became_active":"2023-10-07T09:06:19.954316+0000","last_became_peered":"2023-10-07T09:06:19.954316+0000","last_unstale":"2023-10-07T09:06:19.954647+0000","last_undegraded":"2023-10-07T09:06:19.954647+0000","last_fullsized":"2023-10-07T09:06:19.954647+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:28.488678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952981+0000","last_change":"2023-10-07T09:06:19.952981+0000","last_active":"2023-10-07T09:06:19.952981+0000","last_peered":"2023-10-07T09:06:19.952981+0000","last_clean":"2023-10-07T09:06:19.952981+0000","last_became_active":"2023-10-07T09:06:19.952715+0000","last_became_peered":"2023-10-07T09:06:19.952715+0000","last_unstale":"2023-10-07T09:06:19.952981+0000","last_undegraded":"2023-10-07T09:06:19.952981+0000","last_fullsized":"2023-10-07T09:06:19.952981+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:53.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.956005+0000","last_change":"2023-10-07T09:06:19.956005+0000","last_active":"2023-10-07T09:06:19.956005+0000","last_peered":"2023-10-07T09:06:19.956005+0000","last_clean":"2023-10-07T09:06:19.956005+0000","last_became_active":"2023-10-07T09:06:19.955721+0000","last_became_peered":"2023-10-07T09:06:19.955721+0000","last_unstale":"2023-10-07T09:06:19.956005+0000","last_undegraded":"2023-10-07T09:06:19.956005+0000","last_fullsized":"2023-10-07T09:06:19.956005+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:58.929235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.949349+0000","last_change":"2023-10-07T09:06:19.949349+0000","last_active":"2023-10-07T09:06:19.949349+0000","last_peered":"2023-10-07T09:06:19.949349+0000","last_clean":"2023-10-07T09:06:19.949349+0000","last_became_active":"2023-10-07T09:06:19.949024+0000","last_became_peered":"2023-10-07T09:06:19.949024+0000","last_unstale":"2023-10-07T09:06:19.949349+0000","last_undegraded":"2023-10-07T09:06:19.949349+0000","last_fullsized":"2023-10-07T09:06:19.949349+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:31.485912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955076+0000","last_change":"2023-10-07T09:06:19.955076+0000","last_active":"2023-10-07T09:06:19.955076+0000","last_peered":"2023-10-07T09:06:19.955076+0000","last_clean":"2023-10-07T09:06:19.955076+0000","last_became_active":"2023-10-07T09:06:19.954817+0000","last_became_peered":"2023-10-07T09:06:19.954817+0000","last_unstale":"2023-10-07T09:06:19.955076+0000","last_undegraded":"2023-10-07T09:06:19.955076+0000","last_fullsized":"2023-10-07T09:06:19.955076+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:06.675464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.231864+0000","last_change":"2023-10-07T09:06:19.220616+0000","last_active":"2023-10-07T09:06:20.231864+0000","last_peered":"2023-10-07T09:06:20.231864+0000","last_clean":"2023-10-07T09:06:20.231864+0000","last_became_active":"2023-10-07T09:06:19.220327+0000","last_became_peered":"2023-10-07T09:06:19.220327+0000","last_unstale":"2023-10-07T09:06:20.231864+0000","last_undegraded":"2023-10-07T09:06:20.231864+0000","last_fullsized":"2023-10-07T09:06:20.231864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:24.421191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958798+0000","last_change":"2023-10-07T09:06:19.958798+0000","last_active":"2023-10-07T09:06:19.958798+0000","last_peered":"2023-10-07T09:06:19.958798+0000","last_clean":"2023-10-07T09:06:19.958798+0000","last_became_active":"2023-10-07T09:06:19.958465+0000","last_became_peered":"2023-10-07T09:06:19.958465+0000","last_unstale":"2023-10-07T09:06:19.958798+0000","last_undegraded":"2023-10-07T09:06:19.958798+0000","last_fullsized":"2023-10-07T09:06:19.958798+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:19.490699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950835+0000","last_change":"2023-10-07T09:06:19.224148+0000","last_active":"2023-10-07T09:06:19.950835+0000","last_peered":"2023-10-07T09:06:19.950835+0000","last_clean":"2023-10-07T09:06:19.950835+0000","last_became_active":"2023-10-07T09:06:19.223895+0000","last_became_peered":"2023-10-07T09:06:19.223895+0000","last_unstale":"2023-10-07T09:06:19.950835+0000","last_undegraded":"2023-10-07T09:06:19.950835+0000","last_fullsized":"2023-10-07T09:06:19.950835+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:46.562144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954867+0000","last_change":"2023-10-07T09:06:19.954867+0000","last_active":"2023-10-07T09:06:19.954867+0000","last_peered":"2023-10-07T09:06:19.954867+0000","last_clean":"2023-10-07T09:06:19.954867+0000","last_became_active":"2023-10-07T09:06:19.954585+0000","last_became_peered":"2023-10-07T09:06:19.954585+0000","last_unstale":"2023-10-07T09:06:19.954867+0000","last_undegraded":"2023-10-07T09:06:19.954867+0000","last_fullsized":"2023-10-07T09:06:19.954867+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:23.000187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224567+0000","last_change":"2023-10-07T09:06:19.223254+0000","last_active":"2023-10-07T09:06:20.224567+0000","last_peered":"2023-10-07T09:06:20.224567+0000","last_clean":"2023-10-07T09:06:20.224567+0000","last_became_active":"2023-10-07T09:06:19.222947+0000","last_became_peered":"2023-10-07T09:06:19.222947+0000","last_unstale":"2023-10-07T09:06:20.224567+0000","last_undegraded":"2023-10-07T09:06:20.224567+0000","last_fullsized":"2023-10-07T09:06:20.224567+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:46.260414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951396+0000","last_change":"2023-10-07T09:06:19.951396+0000","last_active":"2023-10-07T09:06:19.951396+0000","last_peered":"2023-10-07T09:06:19.951396+0000","last_clean":"2023-10-07T09:06:19.951396+0000","last_became_active":"2023-10-07T09:06:19.950023+0000","last_became_peered":"2023-10-07T09:06:19.950023+0000","last_unstale":"2023-10-07T09:06:19.951396+0000","last_undegraded":"2023-10-07T09:06:19.951396+0000","last_fullsized":"2023-10-07T09:06:19.951396+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:31.485912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.229107+0000","last_change":"2023-10-07T09:06:19.230592+0000","last_active":"2023-10-07T09:06:20.229107+0000","last_peered":"2023-10-07T09:06:20.229107+0000","last_clean":"2023-10-07T09:06:20.229107+0000","last_became_active":"2023-10-07T09:06:19.230410+0000","last_became_peered":"2023-10-07T09:06:19.230410+0000","last_unstale":"2023-10-07T09:06:20.229107+0000","last_undegraded":"2023-10-07T09:06:20.229107+0000","last_fullsized":"2023-10-07T09:06:20.229107+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:42.115354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961030+0000","last_change":"2023-10-07T09:06:19.961030+0000","last_active":"2023-10-07T09:06:19.961030+0000","last_peered":"2023-10-07T09:06:19.961030+0000","last_clean":"2023-10-07T09:06:19.961030+0000","last_became_active":"2023-10-07T09:06:19.960747+0000","last_became_peered":"2023-10-07T09:06:19.960747+0000","last_unstale":"2023-10-07T09:06:19.961030+0000","last_undegraded":"2023-10-07T09:06:19.961030+0000","last_fullsized":"2023-10-07T09:06:19.961030+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:48:38.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.938000+0000","last_change":"2023-10-07T09:06:19.220116+0000","last_active":"2023-10-07T09:06:19.938000+0000","last_peered":"2023-10-07T09:06:19.938000+0000","last_clean":"2023-10-07T09:06:19.938000+0000","last_became_active":"2023-10-07T09:06:19.219798+0000","last_became_peered":"2023-10-07T09:06:19.219798+0000","last_unstale":"2023-10-07T09:06:19.938000+0000","last_undegraded":"2023-10-07T09:06:19.938000+0000","last_fullsized":"2023-10-07T09:06:19.938000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:36:26.225001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958010+0000","last_change":"2023-10-07T09:06:19.958010+0000","last_active":"2023-10-07T09:06:19.958010+0000","last_peered":"2023-10-07T09:06:19.958010+0000","last_clean":"2023-10-07T09:06:19.958010+0000","last_became_active":"2023-10-07T09:06:19.957662+0000","last_became_peered":"2023-10-07T09:06:19.957662+0000","last_unstale":"2023-10-07T09:06:19.958010+0000","last_undegraded":"2023-10-07T09:06:19.958010+0000","last_fullsized":"2023-10-07T09:06:19.958010+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:53.127386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.220388+0000","last_change":"2023-10-07T09:06:19.219393+0000","last_active":"2023-10-07T09:06:19.220388+0000","last_peered":"2023-10-07T09:06:19.220388+0000","last_clean":"2023-10-07T09:06:19.220388+0000","last_became_active":"2023-10-07T09:06:19.219067+0000","last_became_peered":"2023-10-07T09:06:19.219067+0000","last_unstale":"2023-10-07T09:06:19.220388+0000","last_undegraded":"2023-10-07T09:06:19.220388+0000","last_fullsized":"2023-10-07T09:06:19.220388+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:25.039376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.962232+0000","last_change":"2023-10-07T09:06:19.962232+0000","last_active":"2023-10-07T09:06:19.962232+0000","last_peered":"2023-10-07T09:06:19.962232+0000","last_clean":"2023-10-07T09:06:19.962232+0000","last_became_active":"2023-10-07T09:06:19.961945+0000","last_became_peered":"2023-10-07T09:06:19.961945+0000","last_unstale":"2023-10-07T09:06:19.962232+0000","last_undegraded":"2023-10-07T09:06:19.962232+0000","last_fullsized":"2023-10-07T09:06:19.962232+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:20.020071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228186+0000","last_change":"2023-10-07T09:06:19.223231+0000","last_active":"2023-10-07T09:06:19.228186+0000","last_peered":"2023-10-07T09:06:19.228186+0000","last_clean":"2023-10-07T09:06:19.228186+0000","last_became_active":"2023-10-07T09:06:19.222976+0000","last_became_peered":"2023-10-07T09:06:19.222976+0000","last_unstale":"2023-10-07T09:06:19.228186+0000","last_undegraded":"2023-10-07T09:06:19.228186+0000","last_fullsized":"2023-10-07T09:06:19.228186+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:24.421191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958311+0000","last_change":"2023-10-07T09:06:19.958311+0000","last_active":"2023-10-07T09:06:19.958311+0000","last_peered":"2023-10-07T09:06:19.958311+0000","last_clean":"2023-10-07T09:06:19.958311+0000","last_became_active":"2023-10-07T09:06:19.958011+0000","last_became_peered":"2023-10-07T09:06:19.958011+0000","last_unstale":"2023-10-07T09:06:19.958311+0000","last_undegraded":"2023-10-07T09:06:19.958311+0000","last_fullsized":"2023-10-07T09:06:19.958311+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:38.773435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225627+0000","last_change":"2023-10-07T09:06:19.221054+0000","last_active":"2023-10-07T09:06:19.225627+0000","last_peered":"2023-10-07T09:06:19.225627+0000","last_clean":"2023-10-07T09:06:19.225627+0000","last_became_active":"2023-10-07T09:06:19.220786+0000","last_became_peered":"2023-10-07T09:06:19.220786+0000","last_unstale":"2023-10-07T09:06:19.225627+0000","last_undegraded":"2023-10-07T09:06:19.225627+0000","last_fullsized":"2023-10-07T09:06:19.225627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:01.225549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957582+0000","last_change":"2023-10-07T09:06:19.957582+0000","last_active":"2023-10-07T09:06:19.957582+0000","last_peered":"2023-10-07T09:06:19.957582+0000","last_clean":"2023-10-07T09:06:19.957582+0000","last_became_active":"2023-10-07T09:06:19.957329+0000","last_became_peered":"2023-10-07T09:06:19.957329+0000","last_unstale":"2023-10-07T09:06:19.957582+0000","last_undegraded":"2023-10-07T09:06:19.957582+0000","last_fullsized":"2023-10-07T09:06:19.957582+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:13.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228117+0000","last_change":"2023-10-07T09:06:19.221762+0000","last_active":"2023-10-07T09:06:19.228117+0000","last_peered":"2023-10-07T09:06:19.228117+0000","last_clean":"2023-10-07T09:06:19.228117+0000","last_became_active":"2023-10-07T09:06:19.221515+0000","last_became_peered":"2023-10-07T09:06:19.221515+0000","last_unstale":"2023-10-07T09:06:19.228117+0000","last_undegraded":"2023-10-07T09:06:19.228117+0000","last_fullsized":"2023-10-07T09:06:19.228117+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:05.670933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957182+0000","last_change":"2023-10-07T09:06:19.957182+0000","last_active":"2023-10-07T09:06:19.957182+0000","last_peered":"2023-10-07T09:06:19.957182+0000","last_clean":"2023-10-07T09:06:19.957182+0000","last_became_active":"2023-10-07T09:06:19.956843+0000","last_became_peered":"2023-10-07T09:06:19.956843+0000","last_unstale":"2023-10-07T09:06:19.957182+0000","last_undegraded":"2023-10-07T09:06:19.957182+0000","last_fullsized":"2023-10-07T09:06:19.957182+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:04:14.830343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.228618+0000","last_change":"2023-10-07T09:06:19.227990+0000","last_active":"2023-10-07T09:06:20.228618+0000","last_peered":"2023-10-07T09:06:20.228618+0000","last_clean":"2023-10-07T09:06:20.228618+0000","last_became_active":"2023-10-07T09:06:19.227722+0000","last_became_peered":"2023-10-07T09:06:19.227722+0000","last_unstale":"2023-10-07T09:06:20.228618+0000","last_undegraded":"2023-10-07T09:06:20.228618+0000","last_fullsized":"2023-10-07T09:06:20.228618+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:10.267755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.949890+0000","last_change":"2023-10-07T09:06:19.949890+0000","last_active":"2023-10-07T09:06:19.949890+0000","last_peered":"2023-10-07T09:06:19.949890+0000","last_clean":"2023-10-07T09:06:19.949890+0000","last_became_active":"2023-10-07T09:06:19.949632+0000","last_became_peered":"2023-10-07T09:06:19.949632+0000","last_unstale":"2023-10-07T09:06:19.949890+0000","last_undegraded":"2023-10-07T09:06:19.949890+0000","last_fullsized":"2023-10-07T09:06:19.949890+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:14:54.557342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.232025+0000","last_change":"2023-10-07T09:06:19.228738+0000","last_active":"2023-10-07T09:06:20.232025+0000","last_peered":"2023-10-07T09:06:20.232025+0000","last_clean":"2023-10-07T09:06:20.232025+0000","last_became_active":"2023-10-07T09:06:19.228490+0000","last_became_peered":"2023-10-07T09:06:19.228490+0000","last_unstale":"2023-10-07T09:06:20.232025+0000","last_undegraded":"2023-10-07T09:06:20.232025+0000","last_fullsized":"2023-10-07T09:06:20.232025+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:49.651776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948975+0000","last_change":"2023-10-07T09:06:19.948975+0000","last_active":"2023-10-07T09:06:19.948975+0000","last_peered":"2023-10-07T09:06:19.948975+0000","last_clean":"2023-10-07T09:06:19.948975+0000","last_became_active":"2023-10-07T09:06:19.948319+0000","last_became_peered":"2023-10-07T09:06:19.948319+0000","last_unstale":"2023-10-07T09:06:19.948975+0000","last_undegraded":"2023-10-07T09:06:19.948975+0000","last_fullsized":"2023-10-07T09:06:19.948975+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:39.821449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224385+0000","last_change":"2023-10-07T09:06:19.220912+0000","last_active":"2023-10-07T09:06:20.224385+0000","last_peered":"2023-10-07T09:06:20.224385+0000","last_clean":"2023-10-07T09:06:20.224385+0000","last_became_active":"2023-10-07T09:06:19.220616+0000","last_became_peered":"2023-10-07T09:06:19.220616+0000","last_unstale":"2023-10-07T09:06:20.224385+0000","last_undegraded":"2023-10-07T09:06:20.224385+0000","last_fullsized":"2023-10-07T09:06:20.224385+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:20:02.800039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955414+0000","last_change":"2023-10-07T09:06:19.955414+0000","last_active":"2023-10-07T09:06:19.955414+0000","last_peered":"2023-10-07T09:06:19.955414+0000","last_clean":"2023-10-07T09:06:19.955414+0000","last_became_active":"2023-10-07T09:06:19.955153+0000","last_became_peered":"2023-10-07T09:06:19.955153+0000","last_unstale":"2023-10-07T09:06:19.955414+0000","last_undegraded":"2023-10-07T09:06:19.955414+0000","last_fullsized":"2023-10-07T09:06:19.955414+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:59.390904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.230246+0000","last_change":"2023-10-07T09:06:19.227827+0000","last_active":"2023-10-07T09:06:19.230246+0000","last_peered":"2023-10-07T09:06:19.230246+0000","last_clean":"2023-10-07T09:06:19.230246+0000","last_became_active":"2023-10-07T09:06:19.227588+0000","last_became_peered":"2023-10-07T09:06:19.227588+0000","last_unstale":"2023-10-07T09:06:19.230246+0000","last_undegraded":"2023-10-07T09:06:19.230246+0000","last_fullsized":"2023-10-07T09:06:19.230246+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:37.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958011+0000","last_change":"2023-10-07T09:06:19.958011+0000","last_active":"2023-10-07T09:06:19.958011+0000","last_peered":"2023-10-07T09:06:19.958011+0000","last_clean":"2023-10-07T09:06:19.958011+0000","last_became_active":"2023-10-07T09:06:19.957487+0000","last_became_peered":"2023-10-07T09:06:19.957487+0000","last_unstale":"2023-10-07T09:06:19.958011+0000","last_undegraded":"2023-10-07T09:06:19.958011+0000","last_fullsized":"2023-10-07T09:06:19.958011+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:19:01.772185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.224541+0000","last_change":"2023-10-07T09:06:19.223439+0000","last_active":"2023-10-07T09:06:19.224541+0000","last_peered":"2023-10-07T09:06:19.224541+0000","last_clean":"2023-10-07T09:06:19.224541+0000","last_became_active":"2023-10-07T09:06:19.223181+0000","last_became_peered":"2023-10-07T09:06:19.223181+0000","last_unstale":"2023-10-07T09:06:19.224541+0000","last_undegraded":"2023-10-07T09:06:19.224541+0000","last_fullsized":"2023-10-07T09:06:19.224541+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:33.680340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958195+0000","last_change":"2023-10-07T09:06:19.958195+0000","last_active":"2023-10-07T09:06:19.958195+0000","last_peered":"2023-10-07T09:06:19.958195+0000","last_clean":"2023-10-07T09:06:19.958195+0000","last_became_active":"2023-10-07T09:06:19.957930+0000","last_became_peered":"2023-10-07T09:06:19.957930+0000","last_unstale":"2023-10-07T09:06:19.958195+0000","last_undegraded":"2023-10-07T09:06:19.958195+0000","last_fullsized":"2023-10-07T09:06:19.958195+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:13:50.768648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.229679+0000","last_change":"2023-10-07T09:06:19.220243+0000","last_active":"2023-10-07T09:06:20.229679+0000","last_peered":"2023-10-07T09:06:20.229679+0000","last_clean":"2023-10-07T09:06:20.229679+0000","last_became_active":"2023-10-07T09:06:19.219953+0000","last_became_peered":"2023-10-07T09:06:19.219953+0000","last_unstale":"2023-10-07T09:06:20.229679+0000","last_undegraded":"2023-10-07T09:06:20.229679+0000","last_fullsized":"2023-10-07T09:06:20.229679+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:19.650766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961339+0000","last_change":"2023-10-07T09:06:19.961339+0000","last_active":"2023-10-07T09:06:19.961339+0000","last_peered":"2023-10-07T09:06:19.961339+0000","last_clean":"2023-10-07T09:06:19.961339+0000","last_became_active":"2023-10-07T09:06:19.960725+0000","last_became_peered":"2023-10-07T09:06:19.960725+0000","last_unstale":"2023-10-07T09:06:19.961339+0000","last_undegraded":"2023-10-07T09:06:19.961339+0000","last_fullsized":"2023-10-07T09:06:19.961339+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.937855+0000","last_change":"2023-10-07T09:06:19.218306+0000","last_active":"2023-10-07T09:06:19.937855+0000","last_peered":"2023-10-07T09:06:19.937855+0000","last_clean":"2023-10-07T09:06:19.937855+0000","last_became_active":"2023-10-07T09:06:19.218020+0000","last_became_peered":"2023-10-07T09:06:19.218020+0000","last_unstale":"2023-10-07T09:06:19.937855+0000","last_undegraded":"2023-10-07T09:06:19.937855+0000","last_fullsized":"2023-10-07T09:06:19.937855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:19.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951614+0000","last_change":"2023-10-07T09:06:19.951614+0000","last_active":"2023-10-07T09:06:19.951614+0000","last_peered":"2023-10-07T09:06:19.951614+0000","last_clean":"2023-10-07T09:06:19.951614+0000","last_became_active":"2023-10-07T09:06:19.949673+0000","last_became_peered":"2023-10-07T09:06:19.949673+0000","last_unstale":"2023-10-07T09:06:19.951614+0000","last_undegraded":"2023-10-07T09:06:19.951614+0000","last_fullsized":"2023-10-07T09:06:19.951614+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:13.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224339+0000","last_change":"2023-10-07T09:06:19.217394+0000","last_active":"2023-10-07T09:06:20.224339+0000","last_peered":"2023-10-07T09:06:20.224339+0000","last_clean":"2023-10-07T09:06:20.224339+0000","last_became_active":"2023-10-07T09:06:19.217136+0000","last_became_peered":"2023-10-07T09:06:19.217136+0000","last_unstale":"2023-10-07T09:06:20.224339+0000","last_undegraded":"2023-10-07T09:06:20.224339+0000","last_fullsized":"2023-10-07T09:06:20.224339+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:23:54.383838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950758+0000","last_change":"2023-10-07T09:06:19.950758+0000","last_active":"2023-10-07T09:06:19.950758+0000","last_peered":"2023-10-07T09:06:19.950758+0000","last_clean":"2023-10-07T09:06:19.950758+0000","last_became_active":"2023-10-07T09:06:19.950494+0000","last_became_peered":"2023-10-07T09:06:19.950494+0000","last_unstale":"2023-10-07T09:06:19.950758+0000","last_undegraded":"2023-10-07T09:06:19.950758+0000","last_fullsized":"2023-10-07T09:06:19.950758+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:38.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.943955+0000","last_change":"2023-10-07T09:06:19.220818+0000","last_active":"2023-10-07T09:06:19.943955+0000","last_peered":"2023-10-07T09:06:19.943955+0000","last_clean":"2023-10-07T09:06:19.943955+0000","last_became_active":"2023-10-07T09:06:19.220543+0000","last_became_peered":"2023-10-07T09:06:19.220543+0000","last_unstale":"2023-10-07T09:06:19.943955+0000","last_undegraded":"2023-10-07T09:06:19.943955+0000","last_fullsized":"2023-10-07T09:06:19.943955+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:24.263502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955951+0000","last_change":"2023-10-07T09:06:19.955951+0000","last_active":"2023-10-07T09:06:19.955951+0000","last_peered":"2023-10-07T09:06:19.955951+0000","last_clean":"2023-10-07T09:06:19.955951+0000","last_became_active":"2023-10-07T09:06:19.955649+0000","last_became_peered":"2023-10-07T09:06:19.955649+0000","last_unstale":"2023-10-07T09:06:19.955951+0000","last_undegraded":"2023-10-07T09:06:19.955951+0000","last_fullsized":"2023-10-07T09:06:19.955951+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:06.485241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.223076+0000","last_change":"2023-10-07T09:06:19.220097+0000","last_active":"2023-10-07T09:06:19.223076+0000","last_peered":"2023-10-07T09:06:19.223076+0000","last_clean":"2023-10-07T09:06:19.223076+0000","last_became_active":"2023-10-07T09:06:19.219808+0000","last_became_peered":"2023-10-07T09:06:19.219808+0000","last_unstale":"2023-10-07T09:06:19.223076+0000","last_undegraded":"2023-10-07T09:06:19.223076+0000","last_fullsized":"2023-10-07T09:06:19.223076+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:36.744504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952522+0000","last_change":"2023-10-07T09:06:19.952522+0000","last_active":"2023-10-07T09:06:19.952522+0000","last_peered":"2023-10-07T09:06:19.952522+0000","last_clean":"2023-10-07T09:06:19.952522+0000","last_became_active":"2023-10-07T09:06:19.952235+0000","last_became_peered":"2023-10-07T09:06:19.952235+0000","last_unstale":"2023-10-07T09:06:19.952522+0000","last_undegraded":"2023-10-07T09:06:19.952522+0000","last_fullsized":"2023-10-07T09:06:19.952522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:22.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.228966+0000","last_change":"2023-10-07T09:06:19.221688+0000","last_active":"2023-10-07T09:06:20.228966+0000","last_peered":"2023-10-07T09:06:20.228966+0000","last_clean":"2023-10-07T09:06:20.228966+0000","last_became_active":"2023-10-07T09:06:19.221427+0000","last_became_peered":"2023-10-07T09:06:19.221427+0000","last_unstale":"2023-10-07T09:06:20.228966+0000","last_undegraded":"2023-10-07T09:06:20.228966+0000","last_fullsized":"2023-10-07T09:06:20.228966+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.638438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.942457+0000","last_change":"2023-10-07T09:06:19.942457+0000","last_active":"2023-10-07T09:06:19.942457+0000","last_peered":"2023-10-07T09:06:19.942457+0000","last_clean":"2023-10-07T09:06:19.942457+0000","last_became_active":"2023-10-07T09:06:19.942198+0000","last_became_peered":"2023-10-07T09:06:19.942198+0000","last_unstale":"2023-10-07T09:06:19.942457+0000","last_undegraded":"2023-10-07T09:06:19.942457+0000","last_fullsized":"2023-10-07T09:06:19.942457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:53.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.233824+0000","last_change":"2023-10-07T09:06:19.233390+0000","last_active":"2023-10-07T09:06:19.233824+0000","last_peered":"2023-10-07T09:06:19.233824+0000","last_clean":"2023-10-07T09:06:19.233824+0000","last_became_active":"2023-10-07T09:06:19.233178+0000","last_became_peered":"2023-10-07T09:06:19.233178+0000","last_unstale":"2023-10-07T09:06:19.233824+0000","last_undegraded":"2023-10-07T09:06:19.233824+0000","last_fullsized":"2023-10-07T09:06:19.233824+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.638438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954930+0000","last_change":"2023-10-07T09:06:19.954930+0000","last_active":"2023-10-07T09:06:19.954930+0000","last_peered":"2023-10-07T09:06:19.954930+0000","last_clean":"2023-10-07T09:06:19.954930+0000","last_became_active":"2023-10-07T09:06:19.954673+0000","last_became_peered":"2023-10-07T09:06:19.954673+0000","last_unstale":"2023-10-07T09:06:19.954930+0000","last_undegraded":"2023-10-07T09:06:19.954930+0000","last_fullsized":"2023-10-07T09:06:19.954930+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:30.396146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.230531+0000","last_change":"2023-10-07T09:06:19.228318+0000","last_active":"2023-10-07T09:06:19.230531+0000","last_peered":"2023-10-07T09:06:19.230531+0000","last_clean":"2023-10-07T09:06:19.230531+0000","last_became_active":"2023-10-07T09:06:19.228002+0000","last_became_peered":"2023-10-07T09:06:19.228002+0000","last_unstale":"2023-10-07T09:06:19.230531+0000","last_undegraded":"2023-10-07T09:06:19.230531+0000","last_fullsized":"2023-10-07T09:06:19.230531+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:59:07.106246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952950+0000","last_change":"2023-10-07T09:06:19.952950+0000","last_active":"2023-10-07T09:06:19.952950+0000","last_peered":"2023-10-07T09:06:19.952950+0000","last_clean":"2023-10-07T09:06:19.952950+0000","last_became_active":"2023-10-07T09:06:19.952688+0000","last_became_peered":"2023-10-07T09:06:19.952688+0000","last_unstale":"2023-10-07T09:06:19.952950+0000","last_undegraded":"2023-10-07T09:06:19.952950+0000","last_fullsized":"2023-10-07T09:06:19.952950+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:20.158101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225718+0000","last_change":"2023-10-07T09:06:19.223862+0000","last_active":"2023-10-07T09:06:19.225718+0000","last_peered":"2023-10-07T09:06:19.225718+0000","last_clean":"2023-10-07T09:06:19.225718+0000","last_became_active":"2023-10-07T09:06:19.223551+0000","last_became_peered":"2023-10-07T09:06:19.223551+0000","last_unstale":"2023-10-07T09:06:19.225718+0000","last_undegraded":"2023-10-07T09:06:19.225718+0000","last_fullsized":"2023-10-07T09:06:19.225718+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:06.161504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954391+0000","last_change":"2023-10-07T09:06:19.954391+0000","last_active":"2023-10-07T09:06:19.954391+0000","last_peered":"2023-10-07T09:06:19.954391+0000","last_clean":"2023-10-07T09:06:19.954391+0000","last_became_active":"2023-10-07T09:06:19.954165+0000","last_became_peered":"2023-10-07T09:06:19.954165+0000","last_unstale":"2023-10-07T09:06:19.954391+0000","last_undegraded":"2023-10-07T09:06:19.954391+0000","last_fullsized":"2023-10-07T09:06:19.954391+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.226666+0000","last_change":"2023-10-07T09:06:19.218996+0000","last_active":"2023-10-07T09:06:20.226666+0000","last_peered":"2023-10-07T09:06:20.226666+0000","last_clean":"2023-10-07T09:06:20.226666+0000","last_became_active":"2023-10-07T09:06:19.218726+0000","last_became_peered":"2023-10-07T09:06:19.218726+0000","last_unstale":"2023-10-07T09:06:20.226666+0000","last_undegraded":"2023-10-07T09:06:20.226666+0000","last_fullsized":"2023-10-07T09:06:20.226666+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:43.203212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957889+0000","last_change":"2023-10-07T09:06:19.957889+0000","last_active":"2023-10-07T09:06:19.957889+0000","last_peered":"2023-10-07T09:06:19.957889+0000","last_clean":"2023-10-07T09:06:19.957889+0000","last_became_active":"2023-10-07T09:06:19.956498+0000","last_became_peered":"2023-10-07T09:06:19.956498+0000","last_unstale":"2023-10-07T09:06:19.957889+0000","last_undegraded":"2023-10-07T09:06:19.957889+0000","last_fullsized":"2023-10-07T09:06:19.957889+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:45.871077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226106+0000","last_change":"2023-10-07T09:06:19.225106+0000","last_active":"2023-10-07T09:06:19.226106+0000","last_peered":"2023-10-07T09:06:19.226106+0000","last_clean":"2023-10-07T09:06:19.226106+0000","last_became_active":"2023-10-07T09:06:19.224394+0000","last_became_peered":"2023-10-07T09:06:19.224394+0000","last_unstale":"2023-10-07T09:06:19.226106+0000","last_undegraded":"2023-10-07T09:06:19.226106+0000","last_fullsized":"2023-10-07T09:06:19.226106+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:38.816918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951655+0000","last_change":"2023-10-07T09:06:19.951655+0000","last_active":"2023-10-07T09:06:19.951655+0000","last_peered":"2023-10-07T09:06:19.951655+0000","last_clean":"2023-10-07T09:06:19.951655+0000","last_became_active":"2023-10-07T09:06:19.951379+0000","last_became_peered":"2023-10-07T09:06:19.951379+0000","last_unstale":"2023-10-07T09:06:19.951655+0000","last_undegraded":"2023-10-07T09:06:19.951655+0000","last_fullsized":"2023-10-07T09:06:19.951655+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225589+0000","last_change":"2023-10-07T09:06:19.221301+0000","last_active":"2023-10-07T09:06:19.225589+0000","last_peered":"2023-10-07T09:06:19.225589+0000","last_clean":"2023-10-07T09:06:19.225589+0000","last_became_active":"2023-10-07T09:06:19.220969+0000","last_became_peered":"2023-10-07T09:06:19.220969+0000","last_unstale":"2023-10-07T09:06:19.225589+0000","last_undegraded":"2023-10-07T09:06:19.225589+0000","last_fullsized":"2023-10-07T09:06:19.225589+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:18.486168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948276+0000","last_change":"2023-10-07T09:06:19.948276+0000","last_active":"2023-10-07T09:06:19.948276+0000","last_peered":"2023-10-07T09:06:19.948276+0000","last_clean":"2023-10-07T09:06:19.948276+0000","last_became_active":"2023-10-07T09:06:19.947960+0000","last_became_peered":"2023-10-07T09:06:19.947960+0000","last_unstale":"2023-10-07T09:06:19.948276+0000","last_undegraded":"2023-10-07T09:06:19.948276+0000","last_fullsized":"2023-10-07T09:06:19.948276+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:26.043907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.223098+0000","last_change":"2023-10-07T09:06:19.222174+0000","last_active":"2023-10-07T09:06:19.223098+0000","last_peered":"2023-10-07T09:06:19.223098+0000","last_clean":"2023-10-07T09:06:19.223098+0000","last_became_active":"2023-10-07T09:06:19.221872+0000","last_became_peered":"2023-10-07T09:06:19.221872+0000","last_unstale":"2023-10-07T09:06:19.223098+0000","last_undegraded":"2023-10-07T09:06:19.223098+0000","last_fullsized":"2023-10-07T09:06:19.223098+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:17.799159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954802+0000","last_change":"2023-10-07T09:06:19.954802+0000","last_active":"2023-10-07T09:06:19.954802+0000","last_peered":"2023-10-07T09:06:19.954802+0000","last_clean":"2023-10-07T09:06:19.954802+0000","last_became_active":"2023-10-07T09:06:19.954468+0000","last_became_peered":"2023-10-07T09:06:19.954468+0000","last_unstale":"2023-10-07T09:06:19.954802+0000","last_undegraded":"2023-10-07T09:06:19.954802+0000","last_fullsized":"2023-10-07T09:06:19.954802+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:07.033390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226956+0000","last_change":"2023-10-07T09:06:19.226367+0000","last_active":"2023-10-07T09:06:19.226956+0000","last_peered":"2023-10-07T09:06:19.226956+0000","last_clean":"2023-10-07T09:06:19.226956+0000","last_became_active":"2023-10-07T09:06:19.226062+0000","last_became_peered":"2023-10-07T09:06:19.226062+0000","last_unstale":"2023-10-07T09:06:19.226956+0000","last_undegraded":"2023-10-07T09:06:19.226956+0000","last_fullsized":"2023-10-07T09:06:19.226956+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:52.122855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.956984+0000","last_change":"2023-10-07T09:06:19.956984+0000","last_active":"2023-10-07T09:06:19.956984+0000","last_peered":"2023-10-07T09:06:19.956984+0000","last_clean":"2023-10-07T09:06:19.956984+0000","last_became_active":"2023-10-07T09:06:19.956729+0000","last_became_peered":"2023-10-07T09:06:19.956729+0000","last_unstale":"2023-10-07T09:06:19.956984+0000","last_undegraded":"2023-10-07T09:06:19.956984+0000","last_fullsized":"2023-10-07T09:06:19.956984+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:20.158101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226292+0000","last_change":"2023-10-07T09:06:19.222125+0000","last_active":"2023-10-07T09:06:19.226292+0000","last_peered":"2023-10-07T09:06:19.226292+0000","last_clean":"2023-10-07T09:06:19.226292+0000","last_became_active":"2023-10-07T09:06:19.221862+0000","last_became_peered":"2023-10-07T09:06:19.221862+0000","last_unstale":"2023-10-07T09:06:19.226292+0000","last_undegraded":"2023-10-07T09:06:19.226292+0000","last_fullsized":"2023-10-07T09:06:19.226292+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:27.484147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957781+0000","last_change":"2023-10-07T09:06:19.957781+0000","last_active":"2023-10-07T09:06:19.957781+0000","last_peered":"2023-10-07T09:06:19.957781+0000","last_clean":"2023-10-07T09:06:19.957781+0000","last_became_active":"2023-10-07T09:06:19.957141+0000","last_became_peered":"2023-10-07T09:06:19.957141+0000","last_unstale":"2023-10-07T09:06:19.957781+0000","last_undegraded":"2023-10-07T09:06:19.957781+0000","last_fullsized":"2023-10-07T09:06:19.957781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:29.886940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228208+0000","last_change":"2023-10-07T09:06:19.222733+0000","last_active":"2023-10-07T09:06:19.228208+0000","last_peered":"2023-10-07T09:06:19.228208+0000","last_clean":"2023-10-07T09:06:19.228208+0000","last_became_active":"2023-10-07T09:06:19.222457+0000","last_became_peered":"2023-10-07T09:06:19.222457+0000","last_unstale":"2023-10-07T09:06:19.228208+0000","last_undegraded":"2023-10-07T09:06:19.228208+0000","last_fullsized":"2023-10-07T09:06:19.228208+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:29.391615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958844+0000","last_change":"2023-10-07T09:06:19.958844+0000","last_active":"2023-10-07T09:06:19.958844+0000","last_peered":"2023-10-07T09:06:19.958844+0000","last_clean":"2023-10-07T09:06:19.958844+0000","last_became_active":"2023-10-07T09:06:19.958563+0000","last_became_peered":"2023-10-07T09:06:19.958563+0000","last_unstale":"2023-10-07T09:06:19.958844+0000","last_undegraded":"2023-10-07T09:06:19.958844+0000","last_fullsized":"2023-10-07T09:06:19.958844+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:38.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228058+0000","last_change":"2023-10-07T09:06:19.227020+0000","last_active":"2023-10-07T09:06:19.228058+0000","last_peered":"2023-10-07T09:06:19.228058+0000","last_clean":"2023-10-07T09:06:19.228058+0000","last_became_active":"2023-10-07T09:06:19.226748+0000","last_became_peered":"2023-10-07T09:06:19.226748+0000","last_unstale":"2023-10-07T09:06:19.228058+0000","last_undegraded":"2023-10-07T09:06:19.228058+0000","last_fullsized":"2023-10-07T09:06:19.228058+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:29.391615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950371+0000","last_change":"2023-10-07T09:06:19.950371+0000","last_active":"2023-10-07T09:06:19.950371+0000","last_peered":"2023-10-07T09:06:19.950371+0000","last_clean":"2023-10-07T09:06:19.950371+0000","last_became_active":"2023-10-07T09:06:19.949535+0000","last_became_peered":"2023-10-07T09:06:19.949535+0000","last_unstale":"2023-10-07T09:06:19.950371+0000","last_undegraded":"2023-10-07T09:06:19.950371+0000","last_fullsized":"2023-10-07T09:06:19.950371+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:10.339867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950421+0000","last_change":"2023-10-07T09:06:19.222716+0000","last_active":"2023-10-07T09:06:19.950421+0000","last_peered":"2023-10-07T09:06:19.950421+0000","last_clean":"2023-10-07T09:06:19.950421+0000","last_became_active":"2023-10-07T09:06:19.222445+0000","last_became_peered":"2023-10-07T09:06:19.222445+0000","last_unstale":"2023-10-07T09:06:19.950421+0000","last_undegraded":"2023-10-07T09:06:19.950421+0000","last_fullsized":"2023-10-07T09:06:19.950421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:57:20.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.220702+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:06:19.220702+0000","last_peered":"2023-10-07T09:06:19.220702+0000","last_clean":"2023-10-07T09:06:19.220702+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:06:19.220702+0000","last_undegraded":"2023-10-07T09:06:19.220702+0000","last_fullsized":"2023-10-07T09:06:19.220702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1449318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.85799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.505},"min":{"1min":0.40200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65600000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.50900000000000001},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.53800000000000003},"min":{"1min":0.33300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.625}]},{"osd":6,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.76000000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":857414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70699999999999996,"5min":0.748,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73999999999999999,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.439,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51500000000000001,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":1.29},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55500000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":4.0880000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.499,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54200000000000004,"15min":0.58299999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.62},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35599999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":857470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.317}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.69299999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1447872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.432,"5min":0.501,"15min":0.54500000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.38800000000000001},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.625},"last":0.318}]},{"osd":3,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.35299999999999998},"min":{"1min":0.26600000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.433,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.42699999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.627},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57999999999999996,"15min":0.61799999999999999},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.95399999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82399999999999995,"5min":0.83299999999999996,"15min":0.86399999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.66000000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83899999999999997,"5min":0.84099999999999997,"15min":1},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60999999999999999,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41399999999999998},"max":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":1.006},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.879,"15min":1.0389999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60399999999999998,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.53200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":857414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.58899999999999997},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":10.214},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.48999999999999999,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.27900000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.22},"max":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.755},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.65000000000000002},"min":{"1min":0.29699999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54300000000000004,"5min":0.67000000000000004,"15min":10.144},"last":0.30499999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.70399999999999996},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":10.071},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.71999999999999997},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.65000000000000002,"5min":0.71199999999999997,"15min":10.183},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55000000000000004,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":1.0549999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":1.1240000000000001},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.0880000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.875,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83399999999999996,"5min":4.391,"15min":4.391},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":857596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":859054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.81399999999999995},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":9.7040000000000006},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67900000000000005,"5min":0.73199999999999998,"15min":5.6319999999999997},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.90100000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":9.8439999999999994},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.871},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.89900000000000002},"min":{"1min":0.499,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":10.01},"last":0.77800000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.70999999999999996},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":5.569},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.872},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":10.131},"last":0.755}]},{"osd":5,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.623}]},{"osd":6,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303268,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068572,"statfs":{"total":96636764160,"available":96326217728,"internally_reserved":0,"allocated":1929216,"data_stored":857968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.438}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.375},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36299999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.31}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:06:24.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:06:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.476+0000 7fe0d6a83700 1 Processor -- start 2023-10-07T09:06:24.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.476+0000 7fe0d6a83700 1 -- start start 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6a83700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe0d01597f0 0x7fe0d00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6a83700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00b11d0 con 0x7fe0d015d230 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6a83700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00b14b0 con 0x7fe0d0159420 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6a83700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d00b1790 con 0x7fe0d01597f0 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d5280700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe0d01597f0 0x7fe0d00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6282700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe0d015d230 0x7fe0d015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48624/0 (socket says 172.21.15.46:48624) 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d6282700 1 -- 172.21.15.46:0/863024841 learned_addr learned my addr 172.21.15.46:0/863024841 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d5280700 1 -- 172.21.15.46:0/863024841 >> v1:172.21.15.133:6789/0 conn(0x7fe0d0159420 legacy=0x7fe0d00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d5280700 1 -- 172.21.15.46:0/863024841 >> v1:172.21.15.46:6789/0 conn(0x7fe0d015d230 legacy=0x7fe0d015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d5280700 1 -- 172.21.15.46:0/863024841 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d00b1a70 con 0x7fe0d01597f0 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.477+0000 7fe0d4a7f700 1 -- 172.21.15.46:0/863024841 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632476052 0 0) 0x7fe0d00b11d0 con 0x7fe0d015d230 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d5280700 1 --2- 172.21.15.46:0/863024841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00b2270 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098e0 tx=0x7fe0c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153747776b8d2675 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d4a7f700 1 -- 172.21.15.46:0/863024841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4009e80 con 0x7fe0d01597f0 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d4a7f700 1 -- 172.21.15.46:0/863024841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400b860 con 0x7fe0d01597f0 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d4a7f700 1 -- 172.21.15.46:0/863024841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400bbe0 con 0x7fe0d01597f0 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 -- 172.21.15.46:0/863024841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 msgr2=0x7fe0d00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/863024841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00b2270 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098e0 tx=0x7fe0c40091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 -- 172.21.15.46:0/863024841 shutdown_connections 2023-10-07T09:06:24.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/863024841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00b2270 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 -- 172.21.15.46:0/863024841 >> 172.21.15.46:0/863024841 conn(0x7fe0d00d0660 msgr2=0x7fe0d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:24.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 -- 172.21.15.46:0/863024841 shutdown_connections 2023-10-07T09:06:24.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.478+0000 7fe0d6a83700 1 -- 172.21.15.46:0/863024841 wait complete. 2023-10-07T09:06:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.479+0000 7fe0d6a83700 1 Processor -- start 2023-10-07T09:06:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 -- start start 2023-10-07T09:06:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 0x7fe0d015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d015d230 0x7fe0d00c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00c60b0 con 0x7fe0d01597f0 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00c54a0 con 0x7fe0d015d230 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d6a83700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00c5780 con 0x7fe0d0159420 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d5280700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d5280700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57922/0 (socket says 172.21.15.46:57922) 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.480+0000 7fe0d5280700 1 -- 172.21.15.46:0/2723214814 learned_addr learned my addr 172.21.15.46:0/2723214814 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d6282700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d015d230 0x7fe0d00c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5a81700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 0x7fe0d015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 -- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 msgr2=0x7fe0d015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 0x7fe0d015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 -- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d015d230 msgr2=0x7fe0d00c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d015d230 0x7fe0d00c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 -- 172.21.15.46:0/2723214814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009420 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5a81700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 0x7fe0d015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d5280700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4013000 tx=0x7fe0c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401f070 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400b9d0 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d00c5a60 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4025670 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.481+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d015b940 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.482+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d01567e0 con 0x7fe0d01597f0 2023-10-07T09:06:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.483+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe0c4023070 con 0x7fe0d01597f0 2023-10-07T09:06:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.483+0000 7fe0cdffb700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 0x7fe0bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.483+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0c40862a0 con 0x7fe0d01597f0 2023-10-07T09:06:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.483+0000 7fe0d5a81700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 0x7fe0bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.484+0000 7fe0d5a81700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 0x7fe0bc0697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0007fd0 tx=0x7fe0c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.487+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0c4052f30 con 0x7fe0d01597f0 2023-10-07T09:06:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.675+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0d004c3c0 con 0x7fe0bc067320 2023-10-07T09:06:24.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.683+0000 7fe0cdffb700 1 -- 172.21.15.46:0/2723214814 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289870 (secure 0 0 0) 0x7fe0d004c3c0 con 0x7fe0bc067320 2023-10-07T09:06:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 msgr2=0x7fe0bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 0x7fe0bc0697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0007fd0 tx=0x7fe0c0009040 comp rx=0 tx=0).stop 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 msgr2=0x7fe0d00c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4013000 tx=0x7fe0c4017000 comp rx=0 tx=0).stop 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 shutdown_connections 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe0bc067320 0x7fe0bc0697d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d015d230 0x7fe0d00c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0d0159420 0x7fe0d015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.686+0000 7fe0d6a83700 1 --2- 172.21.15.46:0/2723214814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0d01597f0 0x7fe0d00c6bd0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.687+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 >> 172.21.15.46:0/2723214814 conn(0x7fe0d00d0660 msgr2=0x7fe0d00b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.687+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 shutdown_connections 2023-10-07T09:06:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.687+0000 7fe0d6a83700 1 -- 172.21.15.46:0/2723214814 wait complete. 2023-10-07T09:06:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:06:24.700 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2023-10-07T09:06:23.875848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427332,"kb_used_data":16260,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547388,"statfs":{"total":773094113280,"available":770608525312,"internally_reserved":0,"allocated":16650240,"data_stored":8044106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673056"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958320+0000","last_change":"2023-10-07T09:06:19.958320+0000","last_active":"2023-10-07T09:06:19.958320+0000","last_peered":"2023-10-07T09:06:19.958320+0000","last_clean":"2023-10-07T09:06:19.958320+0000","last_became_active":"2023-10-07T09:06:19.958058+0000","last_became_peered":"2023-10-07T09:06:19.958058+0000","last_unstale":"2023-10-07T09:06:19.958320+0000","last_undegraded":"2023-10-07T09:06:19.958320+0000","last_fullsized":"2023-10-07T09:06:19.958320+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:53.562287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961515+0000","last_change":"2023-10-07T09:06:19.961515+0000","last_active":"2023-10-07T09:06:19.961515+0000","last_peered":"2023-10-07T09:06:19.961515+0000","last_clean":"2023-10-07T09:06:19.961515+0000","last_became_active":"2023-10-07T09:06:19.961075+0000","last_became_peered":"2023-10-07T09:06:19.961075+0000","last_unstale":"2023-10-07T09:06:19.961515+0000","last_undegraded":"2023-10-07T09:06:19.961515+0000","last_fullsized":"2023-10-07T09:06:19.961515+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:20:03.804570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957840+0000","last_change":"2023-10-07T09:06:19.957840+0000","last_active":"2023-10-07T09:06:19.957840+0000","last_peered":"2023-10-07T09:06:19.957840+0000","last_clean":"2023-10-07T09:06:19.957840+0000","last_became_active":"2023-10-07T09:06:19.957506+0000","last_became_peered":"2023-10-07T09:06:19.957506+0000","last_unstale":"2023-10-07T09:06:19.957840+0000","last_undegraded":"2023-10-07T09:06:19.957840+0000","last_fullsized":"2023-10-07T09:06:19.957840+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.960951+0000","last_change":"2023-10-07T09:06:19.960951+0000","last_active":"2023-10-07T09:06:19.960951+0000","last_peered":"2023-10-07T09:06:19.960951+0000","last_clean":"2023-10-07T09:06:19.960951+0000","last_became_active":"2023-10-07T09:06:19.960615+0000","last_became_peered":"2023-10-07T09:06:19.960615+0000","last_unstale":"2023-10-07T09:06:19.960951+0000","last_undegraded":"2023-10-07T09:06:19.960951+0000","last_fullsized":"2023-10-07T09:06:19.960951+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:50.796999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950681+0000","last_change":"2023-10-07T09:06:19.950681+0000","last_active":"2023-10-07T09:06:19.950681+0000","last_peered":"2023-10-07T09:06:19.950681+0000","last_clean":"2023-10-07T09:06:19.950681+0000","last_became_active":"2023-10-07T09:06:19.950160+0000","last_became_peered":"2023-10-07T09:06:19.950160+0000","last_unstale":"2023-10-07T09:06:19.950681+0000","last_undegraded":"2023-10-07T09:06:19.950681+0000","last_fullsized":"2023-10-07T09:06:19.950681+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:46.044935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954022+0000","last_change":"2023-10-07T09:06:19.954022+0000","last_active":"2023-10-07T09:06:19.954022+0000","last_peered":"2023-10-07T09:06:19.954022+0000","last_clean":"2023-10-07T09:06:19.954022+0000","last_became_active":"2023-10-07T09:06:19.953658+0000","last_became_peered":"2023-10-07T09:06:19.953658+0000","last_unstale":"2023-10-07T09:06:19.954022+0000","last_undegraded":"2023-10-07T09:06:19.954022+0000","last_fullsized":"2023-10-07T09:06:19.954022+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:43.119885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.960687+0000","last_change":"2023-10-07T09:06:19.960687+0000","last_active":"2023-10-07T09:06:19.960687+0000","last_peered":"2023-10-07T09:06:19.960687+0000","last_clean":"2023-10-07T09:06:19.960687+0000","last_became_active":"2023-10-07T09:06:19.960360+0000","last_became_peered":"2023-10-07T09:06:19.960360+0000","last_unstale":"2023-10-07T09:06:19.960687+0000","last_undegraded":"2023-10-07T09:06:19.960687+0000","last_fullsized":"2023-10-07T09:06:19.960687+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:24.773927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.947342+0000","last_change":"2023-10-07T09:06:19.947342+0000","last_active":"2023-10-07T09:06:19.947342+0000","last_peered":"2023-10-07T09:06:19.947342+0000","last_clean":"2023-10-07T09:06:19.947342+0000","last_became_active":"2023-10-07T09:06:19.947064+0000","last_became_peered":"2023-10-07T09:06:19.947064+0000","last_unstale":"2023-10-07T09:06:19.947342+0000","last_undegraded":"2023-10-07T09:06:19.947342+0000","last_fullsized":"2023-10-07T09:06:19.947342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:50.656307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957997+0000","last_change":"2023-10-07T09:06:19.957997+0000","last_active":"2023-10-07T09:06:19.957997+0000","last_peered":"2023-10-07T09:06:19.957997+0000","last_clean":"2023-10-07T09:06:19.957997+0000","last_became_active":"2023-10-07T09:06:19.957733+0000","last_became_peered":"2023-10-07T09:06:19.957733+0000","last_unstale":"2023-10-07T09:06:19.957997+0000","last_undegraded":"2023-10-07T09:06:19.957997+0000","last_fullsized":"2023-10-07T09:06:19.957997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:19:01.772185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948971+0000","last_change":"2023-10-07T09:06:19.948971+0000","last_active":"2023-10-07T09:06:19.948971+0000","last_peered":"2023-10-07T09:06:19.948971+0000","last_clean":"2023-10-07T09:06:19.948971+0000","last_became_active":"2023-10-07T09:06:19.948758+0000","last_became_peered":"2023-10-07T09:06:19.948758+0000","last_unstale":"2023-10-07T09:06:19.948971+0000","last_undegraded":"2023-10-07T09:06:19.948971+0000","last_fullsized":"2023-10-07T09:06:19.948971+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:13:50.768648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953717+0000","last_change":"2023-10-07T09:06:19.953717+0000","last_active":"2023-10-07T09:06:19.953717+0000","last_peered":"2023-10-07T09:06:19.953717+0000","last_clean":"2023-10-07T09:06:19.953717+0000","last_became_active":"2023-10-07T09:06:19.953416+0000","last_became_peered":"2023-10-07T09:06:19.953416+0000","last_unstale":"2023-10-07T09:06:19.953717+0000","last_undegraded":"2023-10-07T09:06:19.953717+0000","last_fullsized":"2023-10-07T09:06:19.953717+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954174+0000","last_change":"2023-10-07T09:06:19.954174+0000","last_active":"2023-10-07T09:06:19.954174+0000","last_peered":"2023-10-07T09:06:19.954174+0000","last_clean":"2023-10-07T09:06:19.954174+0000","last_became_active":"2023-10-07T09:06:19.953764+0000","last_became_peered":"2023-10-07T09:06:19.953764+0000","last_unstale":"2023-10-07T09:06:19.954174+0000","last_undegraded":"2023-10-07T09:06:19.954174+0000","last_fullsized":"2023-10-07T09:06:19.954174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955442+0000","last_change":"2023-10-07T09:06:19.955442+0000","last_active":"2023-10-07T09:06:19.955442+0000","last_peered":"2023-10-07T09:06:19.955442+0000","last_clean":"2023-10-07T09:06:19.955442+0000","last_became_active":"2023-10-07T09:06:19.955164+0000","last_became_peered":"2023-10-07T09:06:19.955164+0000","last_unstale":"2023-10-07T09:06:19.955442+0000","last_undegraded":"2023-10-07T09:06:19.955442+0000","last_fullsized":"2023-10-07T09:06:19.955442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:19.490699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954662+0000","last_change":"2023-10-07T09:06:19.954662+0000","last_active":"2023-10-07T09:06:19.954662+0000","last_peered":"2023-10-07T09:06:19.954662+0000","last_clean":"2023-10-07T09:06:19.954662+0000","last_became_active":"2023-10-07T09:06:19.954383+0000","last_became_peered":"2023-10-07T09:06:19.954383+0000","last_unstale":"2023-10-07T09:06:19.954662+0000","last_undegraded":"2023-10-07T09:06:19.954662+0000","last_fullsized":"2023-10-07T09:06:19.954662+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:58.929235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951957+0000","last_change":"2023-10-07T09:06:19.951957+0000","last_active":"2023-10-07T09:06:19.951957+0000","last_peered":"2023-10-07T09:06:19.951957+0000","last_clean":"2023-10-07T09:06:19.951957+0000","last_became_active":"2023-10-07T09:06:19.949731+0000","last_became_peered":"2023-10-07T09:06:19.949731+0000","last_unstale":"2023-10-07T09:06:19.951957+0000","last_undegraded":"2023-10-07T09:06:19.951957+0000","last_fullsized":"2023-10-07T09:06:19.951957+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:22.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957055+0000","last_change":"2023-10-07T09:06:19.957055+0000","last_active":"2023-10-07T09:06:19.957055+0000","last_peered":"2023-10-07T09:06:19.957055+0000","last_clean":"2023-10-07T09:06:19.957055+0000","last_became_active":"2023-10-07T09:06:19.956787+0000","last_became_peered":"2023-10-07T09:06:19.956787+0000","last_unstale":"2023-10-07T09:06:19.957055+0000","last_undegraded":"2023-10-07T09:06:19.957055+0000","last_fullsized":"2023-10-07T09:06:19.957055+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:45.871077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958504+0000","last_change":"2023-10-07T09:06:19.958504+0000","last_active":"2023-10-07T09:06:19.958504+0000","last_peered":"2023-10-07T09:06:19.958504+0000","last_clean":"2023-10-07T09:06:19.958504+0000","last_became_active":"2023-10-07T09:06:19.958159+0000","last_became_peered":"2023-10-07T09:06:19.958159+0000","last_unstale":"2023-10-07T09:06:19.958504+0000","last_undegraded":"2023-10-07T09:06:19.958504+0000","last_fullsized":"2023-10-07T09:06:19.958504+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:06.485241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950121+0000","last_change":"2023-10-07T09:06:19.950121+0000","last_active":"2023-10-07T09:06:19.950121+0000","last_peered":"2023-10-07T09:06:19.950121+0000","last_clean":"2023-10-07T09:06:19.950121+0000","last_became_active":"2023-10-07T09:06:19.949856+0000","last_became_peered":"2023-10-07T09:06:19.949856+0000","last_unstale":"2023-10-07T09:06:19.950121+0000","last_undegraded":"2023-10-07T09:06:19.950121+0000","last_fullsized":"2023-10-07T09:06:19.950121+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:53.562287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950275+0000","last_change":"2023-10-07T09:06:19.950275+0000","last_active":"2023-10-07T09:06:19.950275+0000","last_peered":"2023-10-07T09:06:19.950275+0000","last_clean":"2023-10-07T09:06:19.950275+0000","last_became_active":"2023-10-07T09:06:19.949678+0000","last_became_peered":"2023-10-07T09:06:19.949678+0000","last_unstale":"2023-10-07T09:06:19.950275+0000","last_undegraded":"2023-10-07T09:06:19.950275+0000","last_fullsized":"2023-10-07T09:06:19.950275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:14:54.557342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950275+0000","last_change":"2023-10-07T09:06:19.950275+0000","last_active":"2023-10-07T09:06:19.950275+0000","last_peered":"2023-10-07T09:06:19.950275+0000","last_clean":"2023-10-07T09:06:19.950275+0000","last_became_active":"2023-10-07T09:06:19.950021+0000","last_became_peered":"2023-10-07T09:06:19.950021+0000","last_unstale":"2023-10-07T09:06:19.950275+0000","last_undegraded":"2023-10-07T09:06:19.950275+0000","last_fullsized":"2023-10-07T09:06:19.950275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:16.851846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955442+0000","last_change":"2023-10-07T09:06:19.955442+0000","last_active":"2023-10-07T09:06:19.955442+0000","last_peered":"2023-10-07T09:06:19.955442+0000","last_clean":"2023-10-07T09:06:19.955442+0000","last_became_active":"2023-10-07T09:06:19.955190+0000","last_became_peered":"2023-10-07T09:06:19.955190+0000","last_unstale":"2023-10-07T09:06:19.955442+0000","last_undegraded":"2023-10-07T09:06:19.955442+0000","last_fullsized":"2023-10-07T09:06:19.955442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:20.975936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953543+0000","last_change":"2023-10-07T09:06:19.953543+0000","last_active":"2023-10-07T09:06:19.953543+0000","last_peered":"2023-10-07T09:06:19.953543+0000","last_clean":"2023-10-07T09:06:19.953543+0000","last_became_active":"2023-10-07T09:06:19.953320+0000","last_became_peered":"2023-10-07T09:06:19.953320+0000","last_unstale":"2023-10-07T09:06:19.953543+0000","last_undegraded":"2023-10-07T09:06:19.953543+0000","last_fullsized":"2023-10-07T09:06:19.953543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:28.488678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.953424+0000","last_change":"2023-10-07T09:06:19.953424+0000","last_active":"2023-10-07T09:06:19.953424+0000","last_peered":"2023-10-07T09:06:19.953424+0000","last_clean":"2023-10-07T09:06:19.953424+0000","last_became_active":"2023-10-07T09:06:19.953162+0000","last_became_peered":"2023-10-07T09:06:19.953162+0000","last_unstale":"2023-10-07T09:06:19.953424+0000","last_undegraded":"2023-10-07T09:06:19.953424+0000","last_fullsized":"2023-10-07T09:06:19.953424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:07.166035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957769+0000","last_change":"2023-10-07T09:06:19.957769+0000","last_active":"2023-10-07T09:06:19.957769+0000","last_peered":"2023-10-07T09:06:19.957769+0000","last_clean":"2023-10-07T09:06:19.957769+0000","last_became_active":"2023-10-07T09:06:19.957465+0000","last_became_peered":"2023-10-07T09:06:19.957465+0000","last_unstale":"2023-10-07T09:06:19.957769+0000","last_undegraded":"2023-10-07T09:06:19.957769+0000","last_fullsized":"2023-10-07T09:06:19.957769+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:29:00.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951305+0000","last_change":"2023-10-07T09:06:19.951305+0000","last_active":"2023-10-07T09:06:19.951305+0000","last_peered":"2023-10-07T09:06:19.951305+0000","last_clean":"2023-10-07T09:06:19.951305+0000","last_became_active":"2023-10-07T09:06:19.949768+0000","last_became_peered":"2023-10-07T09:06:19.949768+0000","last_unstale":"2023-10-07T09:06:19.951305+0000","last_undegraded":"2023-10-07T09:06:19.951305+0000","last_fullsized":"2023-10-07T09:06:19.951305+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:29.886940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954740+0000","last_change":"2023-10-07T09:06:19.954740+0000","last_active":"2023-10-07T09:06:19.954740+0000","last_peered":"2023-10-07T09:06:19.954740+0000","last_clean":"2023-10-07T09:06:19.954740+0000","last_became_active":"2023-10-07T09:06:19.954426+0000","last_became_peered":"2023-10-07T09:06:19.954426+0000","last_unstale":"2023-10-07T09:06:19.954740+0000","last_undegraded":"2023-10-07T09:06:19.954740+0000","last_fullsized":"2023-10-07T09:06:19.954740+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:26.152145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952836+0000","last_change":"2023-10-07T09:06:19.952836+0000","last_active":"2023-10-07T09:06:19.952836+0000","last_peered":"2023-10-07T09:06:19.952836+0000","last_clean":"2023-10-07T09:06:19.952836+0000","last_became_active":"2023-10-07T09:06:19.952483+0000","last_became_peered":"2023-10-07T09:06:19.952483+0000","last_unstale":"2023-10-07T09:06:19.952836+0000","last_undegraded":"2023-10-07T09:06:19.952836+0000","last_fullsized":"2023-10-07T09:06:19.952836+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:55.168892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.942373+0000","last_change":"2023-10-07T09:06:19.942373+0000","last_active":"2023-10-07T09:06:19.942373+0000","last_peered":"2023-10-07T09:06:19.942373+0000","last_clean":"2023-10-07T09:06:19.942373+0000","last_became_active":"2023-10-07T09:06:19.942111+0000","last_became_peered":"2023-10-07T09:06:19.942111+0000","last_unstale":"2023-10-07T09:06:19.942373+0000","last_undegraded":"2023-10-07T09:06:19.942373+0000","last_fullsized":"2023-10-07T09:06:19.942373+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:55.168892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954647+0000","last_change":"2023-10-07T09:06:19.954647+0000","last_active":"2023-10-07T09:06:19.954647+0000","last_peered":"2023-10-07T09:06:19.954647+0000","last_clean":"2023-10-07T09:06:19.954647+0000","last_became_active":"2023-10-07T09:06:19.954316+0000","last_became_peered":"2023-10-07T09:06:19.954316+0000","last_unstale":"2023-10-07T09:06:19.954647+0000","last_undegraded":"2023-10-07T09:06:19.954647+0000","last_fullsized":"2023-10-07T09:06:19.954647+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:28.488678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952981+0000","last_change":"2023-10-07T09:06:19.952981+0000","last_active":"2023-10-07T09:06:19.952981+0000","last_peered":"2023-10-07T09:06:19.952981+0000","last_clean":"2023-10-07T09:06:19.952981+0000","last_became_active":"2023-10-07T09:06:19.952715+0000","last_became_peered":"2023-10-07T09:06:19.952715+0000","last_unstale":"2023-10-07T09:06:19.952981+0000","last_undegraded":"2023-10-07T09:06:19.952981+0000","last_fullsized":"2023-10-07T09:06:19.952981+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:53.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.956005+0000","last_change":"2023-10-07T09:06:19.956005+0000","last_active":"2023-10-07T09:06:19.956005+0000","last_peered":"2023-10-07T09:06:19.956005+0000","last_clean":"2023-10-07T09:06:19.956005+0000","last_became_active":"2023-10-07T09:06:19.955721+0000","last_became_peered":"2023-10-07T09:06:19.955721+0000","last_unstale":"2023-10-07T09:06:19.956005+0000","last_undegraded":"2023-10-07T09:06:19.956005+0000","last_fullsized":"2023-10-07T09:06:19.956005+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:58.929235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.949349+0000","last_change":"2023-10-07T09:06:19.949349+0000","last_active":"2023-10-07T09:06:19.949349+0000","last_peered":"2023-10-07T09:06:19.949349+0000","last_clean":"2023-10-07T09:06:19.949349+0000","last_became_active":"2023-10-07T09:06:19.949024+0000","last_became_peered":"2023-10-07T09:06:19.949024+0000","last_unstale":"2023-10-07T09:06:19.949349+0000","last_undegraded":"2023-10-07T09:06:19.949349+0000","last_fullsized":"2023-10-07T09:06:19.949349+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:31.485912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955076+0000","last_change":"2023-10-07T09:06:19.955076+0000","last_active":"2023-10-07T09:06:19.955076+0000","last_peered":"2023-10-07T09:06:19.955076+0000","last_clean":"2023-10-07T09:06:19.955076+0000","last_became_active":"2023-10-07T09:06:19.954817+0000","last_became_peered":"2023-10-07T09:06:19.954817+0000","last_unstale":"2023-10-07T09:06:19.955076+0000","last_undegraded":"2023-10-07T09:06:19.955076+0000","last_fullsized":"2023-10-07T09:06:19.955076+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:06.675464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.231864+0000","last_change":"2023-10-07T09:06:19.220616+0000","last_active":"2023-10-07T09:06:20.231864+0000","last_peered":"2023-10-07T09:06:20.231864+0000","last_clean":"2023-10-07T09:06:20.231864+0000","last_became_active":"2023-10-07T09:06:19.220327+0000","last_became_peered":"2023-10-07T09:06:19.220327+0000","last_unstale":"2023-10-07T09:06:20.231864+0000","last_undegraded":"2023-10-07T09:06:20.231864+0000","last_fullsized":"2023-10-07T09:06:20.231864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:24.421191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958798+0000","last_change":"2023-10-07T09:06:19.958798+0000","last_active":"2023-10-07T09:06:19.958798+0000","last_peered":"2023-10-07T09:06:19.958798+0000","last_clean":"2023-10-07T09:06:19.958798+0000","last_became_active":"2023-10-07T09:06:19.958465+0000","last_became_peered":"2023-10-07T09:06:19.958465+0000","last_unstale":"2023-10-07T09:06:19.958798+0000","last_undegraded":"2023-10-07T09:06:19.958798+0000","last_fullsized":"2023-10-07T09:06:19.958798+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:19.490699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950835+0000","last_change":"2023-10-07T09:06:19.224148+0000","last_active":"2023-10-07T09:06:19.950835+0000","last_peered":"2023-10-07T09:06:19.950835+0000","last_clean":"2023-10-07T09:06:19.950835+0000","last_became_active":"2023-10-07T09:06:19.223895+0000","last_became_peered":"2023-10-07T09:06:19.223895+0000","last_unstale":"2023-10-07T09:06:19.950835+0000","last_undegraded":"2023-10-07T09:06:19.950835+0000","last_fullsized":"2023-10-07T09:06:19.950835+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:46.562144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954867+0000","last_change":"2023-10-07T09:06:19.954867+0000","last_active":"2023-10-07T09:06:19.954867+0000","last_peered":"2023-10-07T09:06:19.954867+0000","last_clean":"2023-10-07T09:06:19.954867+0000","last_became_active":"2023-10-07T09:06:19.954585+0000","last_became_peered":"2023-10-07T09:06:19.954585+0000","last_unstale":"2023-10-07T09:06:19.954867+0000","last_undegraded":"2023-10-07T09:06:19.954867+0000","last_fullsized":"2023-10-07T09:06:19.954867+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:23.000187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224567+0000","last_change":"2023-10-07T09:06:19.223254+0000","last_active":"2023-10-07T09:06:20.224567+0000","last_peered":"2023-10-07T09:06:20.224567+0000","last_clean":"2023-10-07T09:06:20.224567+0000","last_became_active":"2023-10-07T09:06:19.222947+0000","last_became_peered":"2023-10-07T09:06:19.222947+0000","last_unstale":"2023-10-07T09:06:20.224567+0000","last_undegraded":"2023-10-07T09:06:20.224567+0000","last_fullsized":"2023-10-07T09:06:20.224567+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:05:46.260414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951396+0000","last_change":"2023-10-07T09:06:19.951396+0000","last_active":"2023-10-07T09:06:19.951396+0000","last_peered":"2023-10-07T09:06:19.951396+0000","last_clean":"2023-10-07T09:06:19.951396+0000","last_became_active":"2023-10-07T09:06:19.950023+0000","last_became_peered":"2023-10-07T09:06:19.950023+0000","last_unstale":"2023-10-07T09:06:19.951396+0000","last_undegraded":"2023-10-07T09:06:19.951396+0000","last_fullsized":"2023-10-07T09:06:19.951396+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:31.485912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.229107+0000","last_change":"2023-10-07T09:06:19.230592+0000","last_active":"2023-10-07T09:06:20.229107+0000","last_peered":"2023-10-07T09:06:20.229107+0000","last_clean":"2023-10-07T09:06:20.229107+0000","last_became_active":"2023-10-07T09:06:19.230410+0000","last_became_peered":"2023-10-07T09:06:19.230410+0000","last_unstale":"2023-10-07T09:06:20.229107+0000","last_undegraded":"2023-10-07T09:06:20.229107+0000","last_fullsized":"2023-10-07T09:06:20.229107+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:02:42.115354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961030+0000","last_change":"2023-10-07T09:06:19.961030+0000","last_active":"2023-10-07T09:06:19.961030+0000","last_peered":"2023-10-07T09:06:19.961030+0000","last_clean":"2023-10-07T09:06:19.961030+0000","last_became_active":"2023-10-07T09:06:19.960747+0000","last_became_peered":"2023-10-07T09:06:19.960747+0000","last_unstale":"2023-10-07T09:06:19.961030+0000","last_undegraded":"2023-10-07T09:06:19.961030+0000","last_fullsized":"2023-10-07T09:06:19.961030+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:48:38.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.938000+0000","last_change":"2023-10-07T09:06:19.220116+0000","last_active":"2023-10-07T09:06:19.938000+0000","last_peered":"2023-10-07T09:06:19.938000+0000","last_clean":"2023-10-07T09:06:19.938000+0000","last_became_active":"2023-10-07T09:06:19.219798+0000","last_became_peered":"2023-10-07T09:06:19.219798+0000","last_unstale":"2023-10-07T09:06:19.938000+0000","last_undegraded":"2023-10-07T09:06:19.938000+0000","last_fullsized":"2023-10-07T09:06:19.938000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:36:26.225001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958010+0000","last_change":"2023-10-07T09:06:19.958010+0000","last_active":"2023-10-07T09:06:19.958010+0000","last_peered":"2023-10-07T09:06:19.958010+0000","last_clean":"2023-10-07T09:06:19.958010+0000","last_became_active":"2023-10-07T09:06:19.957662+0000","last_became_peered":"2023-10-07T09:06:19.957662+0000","last_unstale":"2023-10-07T09:06:19.958010+0000","last_undegraded":"2023-10-07T09:06:19.958010+0000","last_fullsized":"2023-10-07T09:06:19.958010+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:53.127386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.220388+0000","last_change":"2023-10-07T09:06:19.219393+0000","last_active":"2023-10-07T09:06:19.220388+0000","last_peered":"2023-10-07T09:06:19.220388+0000","last_clean":"2023-10-07T09:06:19.220388+0000","last_became_active":"2023-10-07T09:06:19.219067+0000","last_became_peered":"2023-10-07T09:06:19.219067+0000","last_unstale":"2023-10-07T09:06:19.220388+0000","last_undegraded":"2023-10-07T09:06:19.220388+0000","last_fullsized":"2023-10-07T09:06:19.220388+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:25.039376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.962232+0000","last_change":"2023-10-07T09:06:19.962232+0000","last_active":"2023-10-07T09:06:19.962232+0000","last_peered":"2023-10-07T09:06:19.962232+0000","last_clean":"2023-10-07T09:06:19.962232+0000","last_became_active":"2023-10-07T09:06:19.961945+0000","last_became_peered":"2023-10-07T09:06:19.961945+0000","last_unstale":"2023-10-07T09:06:19.962232+0000","last_undegraded":"2023-10-07T09:06:19.962232+0000","last_fullsized":"2023-10-07T09:06:19.962232+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:20.020071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228186+0000","last_change":"2023-10-07T09:06:19.223231+0000","last_active":"2023-10-07T09:06:19.228186+0000","last_peered":"2023-10-07T09:06:19.228186+0000","last_clean":"2023-10-07T09:06:19.228186+0000","last_became_active":"2023-10-07T09:06:19.222976+0000","last_became_peered":"2023-10-07T09:06:19.222976+0000","last_unstale":"2023-10-07T09:06:19.228186+0000","last_undegraded":"2023-10-07T09:06:19.228186+0000","last_fullsized":"2023-10-07T09:06:19.228186+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:24.421191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958311+0000","last_change":"2023-10-07T09:06:19.958311+0000","last_active":"2023-10-07T09:06:19.958311+0000","last_peered":"2023-10-07T09:06:19.958311+0000","last_clean":"2023-10-07T09:06:19.958311+0000","last_became_active":"2023-10-07T09:06:19.958011+0000","last_became_peered":"2023-10-07T09:06:19.958011+0000","last_unstale":"2023-10-07T09:06:19.958311+0000","last_undegraded":"2023-10-07T09:06:19.958311+0000","last_fullsized":"2023-10-07T09:06:19.958311+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:38.773435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225627+0000","last_change":"2023-10-07T09:06:19.221054+0000","last_active":"2023-10-07T09:06:19.225627+0000","last_peered":"2023-10-07T09:06:19.225627+0000","last_clean":"2023-10-07T09:06:19.225627+0000","last_became_active":"2023-10-07T09:06:19.220786+0000","last_became_peered":"2023-10-07T09:06:19.220786+0000","last_unstale":"2023-10-07T09:06:19.225627+0000","last_undegraded":"2023-10-07T09:06:19.225627+0000","last_fullsized":"2023-10-07T09:06:19.225627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:01.225549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957582+0000","last_change":"2023-10-07T09:06:19.957582+0000","last_active":"2023-10-07T09:06:19.957582+0000","last_peered":"2023-10-07T09:06:19.957582+0000","last_clean":"2023-10-07T09:06:19.957582+0000","last_became_active":"2023-10-07T09:06:19.957329+0000","last_became_peered":"2023-10-07T09:06:19.957329+0000","last_unstale":"2023-10-07T09:06:19.957582+0000","last_undegraded":"2023-10-07T09:06:19.957582+0000","last_fullsized":"2023-10-07T09:06:19.957582+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:13.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228117+0000","last_change":"2023-10-07T09:06:19.221762+0000","last_active":"2023-10-07T09:06:19.228117+0000","last_peered":"2023-10-07T09:06:19.228117+0000","last_clean":"2023-10-07T09:06:19.228117+0000","last_became_active":"2023-10-07T09:06:19.221515+0000","last_became_peered":"2023-10-07T09:06:19.221515+0000","last_unstale":"2023-10-07T09:06:19.228117+0000","last_undegraded":"2023-10-07T09:06:19.228117+0000","last_fullsized":"2023-10-07T09:06:19.228117+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:05.670933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957182+0000","last_change":"2023-10-07T09:06:19.957182+0000","last_active":"2023-10-07T09:06:19.957182+0000","last_peered":"2023-10-07T09:06:19.957182+0000","last_clean":"2023-10-07T09:06:19.957182+0000","last_became_active":"2023-10-07T09:06:19.956843+0000","last_became_peered":"2023-10-07T09:06:19.956843+0000","last_unstale":"2023-10-07T09:06:19.957182+0000","last_undegraded":"2023-10-07T09:06:19.957182+0000","last_fullsized":"2023-10-07T09:06:19.957182+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:04:14.830343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.228618+0000","last_change":"2023-10-07T09:06:19.227990+0000","last_active":"2023-10-07T09:06:20.228618+0000","last_peered":"2023-10-07T09:06:20.228618+0000","last_clean":"2023-10-07T09:06:20.228618+0000","last_became_active":"2023-10-07T09:06:19.227722+0000","last_became_peered":"2023-10-07T09:06:19.227722+0000","last_unstale":"2023-10-07T09:06:20.228618+0000","last_undegraded":"2023-10-07T09:06:20.228618+0000","last_fullsized":"2023-10-07T09:06:20.228618+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:10.267755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.949890+0000","last_change":"2023-10-07T09:06:19.949890+0000","last_active":"2023-10-07T09:06:19.949890+0000","last_peered":"2023-10-07T09:06:19.949890+0000","last_clean":"2023-10-07T09:06:19.949890+0000","last_became_active":"2023-10-07T09:06:19.949632+0000","last_became_peered":"2023-10-07T09:06:19.949632+0000","last_unstale":"2023-10-07T09:06:19.949890+0000","last_undegraded":"2023-10-07T09:06:19.949890+0000","last_fullsized":"2023-10-07T09:06:19.949890+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:14:54.557342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.232025+0000","last_change":"2023-10-07T09:06:19.228738+0000","last_active":"2023-10-07T09:06:20.232025+0000","last_peered":"2023-10-07T09:06:20.232025+0000","last_clean":"2023-10-07T09:06:20.232025+0000","last_became_active":"2023-10-07T09:06:19.228490+0000","last_became_peered":"2023-10-07T09:06:19.228490+0000","last_unstale":"2023-10-07T09:06:20.232025+0000","last_undegraded":"2023-10-07T09:06:20.232025+0000","last_fullsized":"2023-10-07T09:06:20.232025+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:24:49.651776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948975+0000","last_change":"2023-10-07T09:06:19.948975+0000","last_active":"2023-10-07T09:06:19.948975+0000","last_peered":"2023-10-07T09:06:19.948975+0000","last_clean":"2023-10-07T09:06:19.948975+0000","last_became_active":"2023-10-07T09:06:19.948319+0000","last_became_peered":"2023-10-07T09:06:19.948319+0000","last_unstale":"2023-10-07T09:06:19.948975+0000","last_undegraded":"2023-10-07T09:06:19.948975+0000","last_fullsized":"2023-10-07T09:06:19.948975+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:39.821449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224385+0000","last_change":"2023-10-07T09:06:19.220912+0000","last_active":"2023-10-07T09:06:20.224385+0000","last_peered":"2023-10-07T09:06:20.224385+0000","last_clean":"2023-10-07T09:06:20.224385+0000","last_became_active":"2023-10-07T09:06:19.220616+0000","last_became_peered":"2023-10-07T09:06:19.220616+0000","last_unstale":"2023-10-07T09:06:20.224385+0000","last_undegraded":"2023-10-07T09:06:20.224385+0000","last_fullsized":"2023-10-07T09:06:20.224385+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:20:02.800039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955414+0000","last_change":"2023-10-07T09:06:19.955414+0000","last_active":"2023-10-07T09:06:19.955414+0000","last_peered":"2023-10-07T09:06:19.955414+0000","last_clean":"2023-10-07T09:06:19.955414+0000","last_became_active":"2023-10-07T09:06:19.955153+0000","last_became_peered":"2023-10-07T09:06:19.955153+0000","last_unstale":"2023-10-07T09:06:19.955414+0000","last_undegraded":"2023-10-07T09:06:19.955414+0000","last_fullsized":"2023-10-07T09:06:19.955414+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:06:59.390904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.230246+0000","last_change":"2023-10-07T09:06:19.227827+0000","last_active":"2023-10-07T09:06:19.230246+0000","last_peered":"2023-10-07T09:06:19.230246+0000","last_clean":"2023-10-07T09:06:19.230246+0000","last_became_active":"2023-10-07T09:06:19.227588+0000","last_became_peered":"2023-10-07T09:06:19.227588+0000","last_unstale":"2023-10-07T09:06:19.230246+0000","last_undegraded":"2023-10-07T09:06:19.230246+0000","last_fullsized":"2023-10-07T09:06:19.230246+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:37.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958011+0000","last_change":"2023-10-07T09:06:19.958011+0000","last_active":"2023-10-07T09:06:19.958011+0000","last_peered":"2023-10-07T09:06:19.958011+0000","last_clean":"2023-10-07T09:06:19.958011+0000","last_became_active":"2023-10-07T09:06:19.957487+0000","last_became_peered":"2023-10-07T09:06:19.957487+0000","last_unstale":"2023-10-07T09:06:19.958011+0000","last_undegraded":"2023-10-07T09:06:19.958011+0000","last_fullsized":"2023-10-07T09:06:19.958011+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:19:01.772185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.224541+0000","last_change":"2023-10-07T09:06:19.223439+0000","last_active":"2023-10-07T09:06:19.224541+0000","last_peered":"2023-10-07T09:06:19.224541+0000","last_clean":"2023-10-07T09:06:19.224541+0000","last_became_active":"2023-10-07T09:06:19.223181+0000","last_became_peered":"2023-10-07T09:06:19.223181+0000","last_unstale":"2023-10-07T09:06:19.224541+0000","last_undegraded":"2023-10-07T09:06:19.224541+0000","last_fullsized":"2023-10-07T09:06:19.224541+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:33.680340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958195+0000","last_change":"2023-10-07T09:06:19.958195+0000","last_active":"2023-10-07T09:06:19.958195+0000","last_peered":"2023-10-07T09:06:19.958195+0000","last_clean":"2023-10-07T09:06:19.958195+0000","last_became_active":"2023-10-07T09:06:19.957930+0000","last_became_peered":"2023-10-07T09:06:19.957930+0000","last_unstale":"2023-10-07T09:06:19.958195+0000","last_undegraded":"2023-10-07T09:06:19.958195+0000","last_fullsized":"2023-10-07T09:06:19.958195+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:13:50.768648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.229679+0000","last_change":"2023-10-07T09:06:19.220243+0000","last_active":"2023-10-07T09:06:20.229679+0000","last_peered":"2023-10-07T09:06:20.229679+0000","last_clean":"2023-10-07T09:06:20.229679+0000","last_became_active":"2023-10-07T09:06:19.219953+0000","last_became_peered":"2023-10-07T09:06:19.219953+0000","last_unstale":"2023-10-07T09:06:20.229679+0000","last_undegraded":"2023-10-07T09:06:20.229679+0000","last_fullsized":"2023-10-07T09:06:20.229679+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:19.650766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.961339+0000","last_change":"2023-10-07T09:06:19.961339+0000","last_active":"2023-10-07T09:06:19.961339+0000","last_peered":"2023-10-07T09:06:19.961339+0000","last_clean":"2023-10-07T09:06:19.961339+0000","last_became_active":"2023-10-07T09:06:19.960725+0000","last_became_peered":"2023-10-07T09:06:19.960725+0000","last_unstale":"2023-10-07T09:06:19.961339+0000","last_undegraded":"2023-10-07T09:06:19.961339+0000","last_fullsized":"2023-10-07T09:06:19.961339+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.937855+0000","last_change":"2023-10-07T09:06:19.218306+0000","last_active":"2023-10-07T09:06:19.937855+0000","last_peered":"2023-10-07T09:06:19.937855+0000","last_clean":"2023-10-07T09:06:19.937855+0000","last_became_active":"2023-10-07T09:06:19.218020+0000","last_became_peered":"2023-10-07T09:06:19.218020+0000","last_unstale":"2023-10-07T09:06:19.937855+0000","last_undegraded":"2023-10-07T09:06:19.937855+0000","last_fullsized":"2023-10-07T09:06:19.937855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:19.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951614+0000","last_change":"2023-10-07T09:06:19.951614+0000","last_active":"2023-10-07T09:06:19.951614+0000","last_peered":"2023-10-07T09:06:19.951614+0000","last_clean":"2023-10-07T09:06:19.951614+0000","last_became_active":"2023-10-07T09:06:19.949673+0000","last_became_peered":"2023-10-07T09:06:19.949673+0000","last_unstale":"2023-10-07T09:06:19.951614+0000","last_undegraded":"2023-10-07T09:06:19.951614+0000","last_fullsized":"2023-10-07T09:06:19.951614+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:13.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.224339+0000","last_change":"2023-10-07T09:06:19.217394+0000","last_active":"2023-10-07T09:06:20.224339+0000","last_peered":"2023-10-07T09:06:20.224339+0000","last_clean":"2023-10-07T09:06:20.224339+0000","last_became_active":"2023-10-07T09:06:19.217136+0000","last_became_peered":"2023-10-07T09:06:19.217136+0000","last_unstale":"2023-10-07T09:06:20.224339+0000","last_undegraded":"2023-10-07T09:06:20.224339+0000","last_fullsized":"2023-10-07T09:06:20.224339+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:23:54.383838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950758+0000","last_change":"2023-10-07T09:06:19.950758+0000","last_active":"2023-10-07T09:06:19.950758+0000","last_peered":"2023-10-07T09:06:19.950758+0000","last_clean":"2023-10-07T09:06:19.950758+0000","last_became_active":"2023-10-07T09:06:19.950494+0000","last_became_peered":"2023-10-07T09:06:19.950494+0000","last_unstale":"2023-10-07T09:06:19.950758+0000","last_undegraded":"2023-10-07T09:06:19.950758+0000","last_fullsized":"2023-10-07T09:06:19.950758+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:38.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.943955+0000","last_change":"2023-10-07T09:06:19.220818+0000","last_active":"2023-10-07T09:06:19.943955+0000","last_peered":"2023-10-07T09:06:19.943955+0000","last_clean":"2023-10-07T09:06:19.943955+0000","last_became_active":"2023-10-07T09:06:19.220543+0000","last_became_peered":"2023-10-07T09:06:19.220543+0000","last_unstale":"2023-10-07T09:06:19.943955+0000","last_undegraded":"2023-10-07T09:06:19.943955+0000","last_fullsized":"2023-10-07T09:06:19.943955+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:24.263502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.955951+0000","last_change":"2023-10-07T09:06:19.955951+0000","last_active":"2023-10-07T09:06:19.955951+0000","last_peered":"2023-10-07T09:06:19.955951+0000","last_clean":"2023-10-07T09:06:19.955951+0000","last_became_active":"2023-10-07T09:06:19.955649+0000","last_became_peered":"2023-10-07T09:06:19.955649+0000","last_unstale":"2023-10-07T09:06:19.955951+0000","last_undegraded":"2023-10-07T09:06:19.955951+0000","last_fullsized":"2023-10-07T09:06:19.955951+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:06.485241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.223076+0000","last_change":"2023-10-07T09:06:19.220097+0000","last_active":"2023-10-07T09:06:19.223076+0000","last_peered":"2023-10-07T09:06:19.223076+0000","last_clean":"2023-10-07T09:06:19.223076+0000","last_became_active":"2023-10-07T09:06:19.219808+0000","last_became_peered":"2023-10-07T09:06:19.219808+0000","last_unstale":"2023-10-07T09:06:19.223076+0000","last_undegraded":"2023-10-07T09:06:19.223076+0000","last_fullsized":"2023-10-07T09:06:19.223076+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:13:36.744504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952522+0000","last_change":"2023-10-07T09:06:19.952522+0000","last_active":"2023-10-07T09:06:19.952522+0000","last_peered":"2023-10-07T09:06:19.952522+0000","last_clean":"2023-10-07T09:06:19.952522+0000","last_became_active":"2023-10-07T09:06:19.952235+0000","last_became_peered":"2023-10-07T09:06:19.952235+0000","last_unstale":"2023-10-07T09:06:19.952522+0000","last_undegraded":"2023-10-07T09:06:19.952522+0000","last_fullsized":"2023-10-07T09:06:19.952522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:22.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.228966+0000","last_change":"2023-10-07T09:06:19.221688+0000","last_active":"2023-10-07T09:06:20.228966+0000","last_peered":"2023-10-07T09:06:20.228966+0000","last_clean":"2023-10-07T09:06:20.228966+0000","last_became_active":"2023-10-07T09:06:19.221427+0000","last_became_peered":"2023-10-07T09:06:19.221427+0000","last_unstale":"2023-10-07T09:06:20.228966+0000","last_undegraded":"2023-10-07T09:06:20.228966+0000","last_fullsized":"2023-10-07T09:06:20.228966+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.638438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.942457+0000","last_change":"2023-10-07T09:06:19.942457+0000","last_active":"2023-10-07T09:06:19.942457+0000","last_peered":"2023-10-07T09:06:19.942457+0000","last_clean":"2023-10-07T09:06:19.942457+0000","last_became_active":"2023-10-07T09:06:19.942198+0000","last_became_peered":"2023-10-07T09:06:19.942198+0000","last_unstale":"2023-10-07T09:06:19.942457+0000","last_undegraded":"2023-10-07T09:06:19.942457+0000","last_fullsized":"2023-10-07T09:06:19.942457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:53.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.233824+0000","last_change":"2023-10-07T09:06:19.233390+0000","last_active":"2023-10-07T09:06:19.233824+0000","last_peered":"2023-10-07T09:06:19.233824+0000","last_clean":"2023-10-07T09:06:19.233824+0000","last_became_active":"2023-10-07T09:06:19.233178+0000","last_became_peered":"2023-10-07T09:06:19.233178+0000","last_unstale":"2023-10-07T09:06:19.233824+0000","last_undegraded":"2023-10-07T09:06:19.233824+0000","last_fullsized":"2023-10-07T09:06:19.233824+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:27.638438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954930+0000","last_change":"2023-10-07T09:06:19.954930+0000","last_active":"2023-10-07T09:06:19.954930+0000","last_peered":"2023-10-07T09:06:19.954930+0000","last_clean":"2023-10-07T09:06:19.954930+0000","last_became_active":"2023-10-07T09:06:19.954673+0000","last_became_peered":"2023-10-07T09:06:19.954673+0000","last_unstale":"2023-10-07T09:06:19.954930+0000","last_undegraded":"2023-10-07T09:06:19.954930+0000","last_fullsized":"2023-10-07T09:06:19.954930+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:30.396146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.230531+0000","last_change":"2023-10-07T09:06:19.228318+0000","last_active":"2023-10-07T09:06:19.230531+0000","last_peered":"2023-10-07T09:06:19.230531+0000","last_clean":"2023-10-07T09:06:19.230531+0000","last_became_active":"2023-10-07T09:06:19.228002+0000","last_became_peered":"2023-10-07T09:06:19.228002+0000","last_unstale":"2023-10-07T09:06:19.230531+0000","last_undegraded":"2023-10-07T09:06:19.230531+0000","last_fullsized":"2023-10-07T09:06:19.230531+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:59:07.106246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.952950+0000","last_change":"2023-10-07T09:06:19.952950+0000","last_active":"2023-10-07T09:06:19.952950+0000","last_peered":"2023-10-07T09:06:19.952950+0000","last_clean":"2023-10-07T09:06:19.952950+0000","last_became_active":"2023-10-07T09:06:19.952688+0000","last_became_peered":"2023-10-07T09:06:19.952688+0000","last_unstale":"2023-10-07T09:06:19.952950+0000","last_undegraded":"2023-10-07T09:06:19.952950+0000","last_fullsized":"2023-10-07T09:06:19.952950+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:20.158101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225718+0000","last_change":"2023-10-07T09:06:19.223862+0000","last_active":"2023-10-07T09:06:19.225718+0000","last_peered":"2023-10-07T09:06:19.225718+0000","last_clean":"2023-10-07T09:06:19.225718+0000","last_became_active":"2023-10-07T09:06:19.223551+0000","last_became_peered":"2023-10-07T09:06:19.223551+0000","last_unstale":"2023-10-07T09:06:19.225718+0000","last_undegraded":"2023-10-07T09:06:19.225718+0000","last_fullsized":"2023-10-07T09:06:19.225718+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:06.161504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954391+0000","last_change":"2023-10-07T09:06:19.954391+0000","last_active":"2023-10-07T09:06:19.954391+0000","last_peered":"2023-10-07T09:06:19.954391+0000","last_clean":"2023-10-07T09:06:19.954391+0000","last_became_active":"2023-10-07T09:06:19.954165+0000","last_became_peered":"2023-10-07T09:06:19.954165+0000","last_unstale":"2023-10-07T09:06:19.954391+0000","last_undegraded":"2023-10-07T09:06:19.954391+0000","last_fullsized":"2023-10-07T09:06:19.954391+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:13.484301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:20.226666+0000","last_change":"2023-10-07T09:06:19.218996+0000","last_active":"2023-10-07T09:06:20.226666+0000","last_peered":"2023-10-07T09:06:20.226666+0000","last_clean":"2023-10-07T09:06:20.226666+0000","last_became_active":"2023-10-07T09:06:19.218726+0000","last_became_peered":"2023-10-07T09:06:19.218726+0000","last_unstale":"2023-10-07T09:06:20.226666+0000","last_undegraded":"2023-10-07T09:06:20.226666+0000","last_fullsized":"2023-10-07T09:06:20.226666+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:43.203212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957889+0000","last_change":"2023-10-07T09:06:19.957889+0000","last_active":"2023-10-07T09:06:19.957889+0000","last_peered":"2023-10-07T09:06:19.957889+0000","last_clean":"2023-10-07T09:06:19.957889+0000","last_became_active":"2023-10-07T09:06:19.956498+0000","last_became_peered":"2023-10-07T09:06:19.956498+0000","last_unstale":"2023-10-07T09:06:19.957889+0000","last_undegraded":"2023-10-07T09:06:19.957889+0000","last_fullsized":"2023-10-07T09:06:19.957889+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:31:45.871077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226106+0000","last_change":"2023-10-07T09:06:19.225106+0000","last_active":"2023-10-07T09:06:19.226106+0000","last_peered":"2023-10-07T09:06:19.226106+0000","last_clean":"2023-10-07T09:06:19.226106+0000","last_became_active":"2023-10-07T09:06:19.224394+0000","last_became_peered":"2023-10-07T09:06:19.224394+0000","last_unstale":"2023-10-07T09:06:19.226106+0000","last_undegraded":"2023-10-07T09:06:19.226106+0000","last_fullsized":"2023-10-07T09:06:19.226106+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:09:38.816918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.951655+0000","last_change":"2023-10-07T09:06:19.951655+0000","last_active":"2023-10-07T09:06:19.951655+0000","last_peered":"2023-10-07T09:06:19.951655+0000","last_clean":"2023-10-07T09:06:19.951655+0000","last_became_active":"2023-10-07T09:06:19.951379+0000","last_became_peered":"2023-10-07T09:06:19.951379+0000","last_unstale":"2023-10-07T09:06:19.951655+0000","last_undegraded":"2023-10-07T09:06:19.951655+0000","last_fullsized":"2023-10-07T09:06:19.951655+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:51.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.225589+0000","last_change":"2023-10-07T09:06:19.221301+0000","last_active":"2023-10-07T09:06:19.225589+0000","last_peered":"2023-10-07T09:06:19.225589+0000","last_clean":"2023-10-07T09:06:19.225589+0000","last_became_active":"2023-10-07T09:06:19.220969+0000","last_became_peered":"2023-10-07T09:06:19.220969+0000","last_unstale":"2023-10-07T09:06:19.225589+0000","last_undegraded":"2023-10-07T09:06:19.225589+0000","last_fullsized":"2023-10-07T09:06:19.225589+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:18.486168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.948276+0000","last_change":"2023-10-07T09:06:19.948276+0000","last_active":"2023-10-07T09:06:19.948276+0000","last_peered":"2023-10-07T09:06:19.948276+0000","last_clean":"2023-10-07T09:06:19.948276+0000","last_became_active":"2023-10-07T09:06:19.947960+0000","last_became_peered":"2023-10-07T09:06:19.947960+0000","last_unstale":"2023-10-07T09:06:19.948276+0000","last_undegraded":"2023-10-07T09:06:19.948276+0000","last_fullsized":"2023-10-07T09:06:19.948276+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:26.043907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.223098+0000","last_change":"2023-10-07T09:06:19.222174+0000","last_active":"2023-10-07T09:06:19.223098+0000","last_peered":"2023-10-07T09:06:19.223098+0000","last_clean":"2023-10-07T09:06:19.223098+0000","last_became_active":"2023-10-07T09:06:19.221872+0000","last_became_peered":"2023-10-07T09:06:19.221872+0000","last_unstale":"2023-10-07T09:06:19.223098+0000","last_undegraded":"2023-10-07T09:06:19.223098+0000","last_fullsized":"2023-10-07T09:06:19.223098+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:17.799159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.954802+0000","last_change":"2023-10-07T09:06:19.954802+0000","last_active":"2023-10-07T09:06:19.954802+0000","last_peered":"2023-10-07T09:06:19.954802+0000","last_clean":"2023-10-07T09:06:19.954802+0000","last_became_active":"2023-10-07T09:06:19.954468+0000","last_became_peered":"2023-10-07T09:06:19.954468+0000","last_unstale":"2023-10-07T09:06:19.954802+0000","last_undegraded":"2023-10-07T09:06:19.954802+0000","last_fullsized":"2023-10-07T09:06:19.954802+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:07.033390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226956+0000","last_change":"2023-10-07T09:06:19.226367+0000","last_active":"2023-10-07T09:06:19.226956+0000","last_peered":"2023-10-07T09:06:19.226956+0000","last_clean":"2023-10-07T09:06:19.226956+0000","last_became_active":"2023-10-07T09:06:19.226062+0000","last_became_peered":"2023-10-07T09:06:19.226062+0000","last_unstale":"2023-10-07T09:06:19.226956+0000","last_undegraded":"2023-10-07T09:06:19.226956+0000","last_fullsized":"2023-10-07T09:06:19.226956+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:52.122855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.956984+0000","last_change":"2023-10-07T09:06:19.956984+0000","last_active":"2023-10-07T09:06:19.956984+0000","last_peered":"2023-10-07T09:06:19.956984+0000","last_clean":"2023-10-07T09:06:19.956984+0000","last_became_active":"2023-10-07T09:06:19.956729+0000","last_became_peered":"2023-10-07T09:06:19.956729+0000","last_unstale":"2023-10-07T09:06:19.956984+0000","last_undegraded":"2023-10-07T09:06:19.956984+0000","last_fullsized":"2023-10-07T09:06:19.956984+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:19:20.158101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.226292+0000","last_change":"2023-10-07T09:06:19.222125+0000","last_active":"2023-10-07T09:06:19.226292+0000","last_peered":"2023-10-07T09:06:19.226292+0000","last_clean":"2023-10-07T09:06:19.226292+0000","last_became_active":"2023-10-07T09:06:19.221862+0000","last_became_peered":"2023-10-07T09:06:19.221862+0000","last_unstale":"2023-10-07T09:06:19.226292+0000","last_undegraded":"2023-10-07T09:06:19.226292+0000","last_fullsized":"2023-10-07T09:06:19.226292+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:27.484147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.957781+0000","last_change":"2023-10-07T09:06:19.957781+0000","last_active":"2023-10-07T09:06:19.957781+0000","last_peered":"2023-10-07T09:06:19.957781+0000","last_clean":"2023-10-07T09:06:19.957781+0000","last_became_active":"2023-10-07T09:06:19.957141+0000","last_became_peered":"2023-10-07T09:06:19.957141+0000","last_unstale":"2023-10-07T09:06:19.957781+0000","last_undegraded":"2023-10-07T09:06:19.957781+0000","last_fullsized":"2023-10-07T09:06:19.957781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:30:29.886940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228208+0000","last_change":"2023-10-07T09:06:19.222733+0000","last_active":"2023-10-07T09:06:19.228208+0000","last_peered":"2023-10-07T09:06:19.228208+0000","last_clean":"2023-10-07T09:06:19.228208+0000","last_became_active":"2023-10-07T09:06:19.222457+0000","last_became_peered":"2023-10-07T09:06:19.222457+0000","last_unstale":"2023-10-07T09:06:19.228208+0000","last_undegraded":"2023-10-07T09:06:19.228208+0000","last_fullsized":"2023-10-07T09:06:19.228208+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:29.391615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.958844+0000","last_change":"2023-10-07T09:06:19.958844+0000","last_active":"2023-10-07T09:06:19.958844+0000","last_peered":"2023-10-07T09:06:19.958844+0000","last_clean":"2023-10-07T09:06:19.958844+0000","last_became_active":"2023-10-07T09:06:19.958563+0000","last_became_peered":"2023-10-07T09:06:19.958563+0000","last_unstale":"2023-10-07T09:06:19.958844+0000","last_undegraded":"2023-10-07T09:06:19.958844+0000","last_fullsized":"2023-10-07T09:06:19.958844+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:38.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.228058+0000","last_change":"2023-10-07T09:06:19.227020+0000","last_active":"2023-10-07T09:06:19.228058+0000","last_peered":"2023-10-07T09:06:19.228058+0000","last_clean":"2023-10-07T09:06:19.228058+0000","last_became_active":"2023-10-07T09:06:19.226748+0000","last_became_peered":"2023-10-07T09:06:19.226748+0000","last_unstale":"2023-10-07T09:06:19.228058+0000","last_undegraded":"2023-10-07T09:06:19.228058+0000","last_fullsized":"2023-10-07T09:06:19.228058+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:29.391615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":8,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950371+0000","last_change":"2023-10-07T09:06:19.950371+0000","last_active":"2023-10-07T09:06:19.950371+0000","last_peered":"2023-10-07T09:06:19.950371+0000","last_clean":"2023-10-07T09:06:19.950371+0000","last_became_active":"2023-10-07T09:06:19.949535+0000","last_became_peered":"2023-10-07T09:06:19.949535+0000","last_unstale":"2023-10-07T09:06:19.950371+0000","last_undegraded":"2023-10-07T09:06:19.950371+0000","last_fullsized":"2023-10-07T09:06:19.950371+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:19.202216+0000","last_clean_scrub_stamp":"2023-10-07T09:06:19.202216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:10.339867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.950421+0000","last_change":"2023-10-07T09:06:19.222716+0000","last_active":"2023-10-07T09:06:19.950421+0000","last_peered":"2023-10-07T09:06:19.950421+0000","last_clean":"2023-10-07T09:06:19.950421+0000","last_became_active":"2023-10-07T09:06:19.222445+0000","last_became_peered":"2023-10-07T09:06:19.222445+0000","last_unstale":"2023-10-07T09:06:19.950421+0000","last_undegraded":"2023-10-07T09:06:19.950421+0000","last_fullsized":"2023-10-07T09:06:19.950421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:18.197685+0000","last_clean_scrub_stamp":"2023-10-07T09:06:18.197685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:57:20.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-07T09:06:19.220702+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:06:19.220702+0000","last_peered":"2023-10-07T09:06:19.220702+0000","last_clean":"2023-10-07T09:06:19.220702+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:06:19.220702+0000","last_undegraded":"2023-10-07T09:06:19.220702+0000","last_fullsized":"2023-10-07T09:06:19.220702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1449318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.85799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.505},"min":{"1min":0.40200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65600000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.50900000000000001},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.53800000000000003},"min":{"1min":0.33300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.625}]},{"osd":6,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.76000000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":857414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70699999999999996,"5min":0.748,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73999999999999999,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.439,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51500000000000001,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":1.29},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55500000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":4.0880000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.499,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54200000000000004,"15min":0.58299999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.62},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35599999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":857470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.317}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.69299999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1447872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.432,"5min":0.501,"15min":0.54500000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.191},"max":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.38800000000000001},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.625},"last":0.318}]},{"osd":3,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.35299999999999998},"min":{"1min":0.26600000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.433,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.42699999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.63500000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.627},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57999999999999996,"15min":0.61799999999999999},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.95399999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82399999999999995,"5min":0.83299999999999996,"15min":0.86399999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.66000000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83899999999999997,"5min":0.84099999999999997,"15min":1},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60999999999999999,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41399999999999998},"max":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":1.006},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 09:05:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.879,"15min":1.0389999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60399999999999998,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.53200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":857414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.58899999999999997},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":10.214},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.48999999999999999,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.27900000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.22},"max":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.755},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.65000000000000002},"min":{"1min":0.29699999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54300000000000004,"5min":0.67000000000000004,"15min":10.144},"last":0.30499999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.70399999999999996},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":10.071},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.71999999999999997},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.65000000000000002,"5min":0.71199999999999997,"15min":10.183},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55000000000000004,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":1.0549999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":1.1240000000000001},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.0880000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.875,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:05:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83399999999999996,"5min":4.391,"15min":4.391},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":857596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":859054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.81399999999999995},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":9.7040000000000006},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67900000000000005,"5min":0.73199999999999998,"15min":5.6319999999999997},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.90100000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":9.8439999999999994},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.871},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":9.9979999999999993},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.89900000000000002},"min":{"1min":0.499,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":10.01},"last":0.77800000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.70999999999999996},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":5.569},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.872},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":10.131},"last":0.755}]},{"osd":5,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.623}]},{"osd":6,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303268,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068572,"statfs":{"total":96636764160,"available":96326217728,"internally_reserved":0,"allocated":1929216,"data_stored":857968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.438}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.375},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36299999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.31}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:06:24.707 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:06:24.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:06:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.864+0000 7fe1e7680700 1 Processor -- start 2023-10-07T09:06:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.865+0000 7fe1e7680700 1 -- start start 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.865+0000 7fe1e7680700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe1e00cbb90 0x7fe1e00af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.865+0000 7fe1e7680700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00af860 con 0x7fe1e0069c70 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.865+0000 7fe1e7680700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00ce380 con 0x7fe1e0159950 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.865+0000 7fe1e7680700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e00cec20 con 0x7fe1e00cbb90 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e4c1b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe1e0069c70 0x7fe1e00cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48630/0 (socket says 172.21.15.46:48630) 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e5c1d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe1e00cbb90 0x7fe1e00af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e4c1b700 1 -- 172.21.15.46:0/1410953551 learned_addr learned my addr 172.21.15.46:0/1410953551 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1dffff700 1 -- 172.21.15.46:0/1410953551 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994750070 0 0) 0x7fe1e00af860 con 0x7fe1e0069c70 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1dffff700 1 -- 172.21.15.46:0/1410953551 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c8003570 con 0x7fe1e0069c70 2023-10-07T09:06:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e5c1d700 1 -- 172.21.15.46:0/1410953551 >> v1:172.21.15.133:6789/0 conn(0x7fe1e0159950 legacy=0x7fe1e0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e5c1d700 1 -- 172.21.15.46:0/1410953551 >> v1:172.21.15.46:6789/0 conn(0x7fe1e0069c70 legacy=0x7fe1e00cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e5c1d700 1 -- 172.21.15.46:0/1410953551 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00cbfb0 con 0x7fe1e00cbb90 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1e5c1d700 1 --2- 172.21.15.46:0/1410953551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e00cbb90 0x7fe1e00af320 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80098e0 tx=0x7fe1d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0e718ff64b4a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1dffff700 1 -- 172.21.15.46:0/1410953551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800b640 con 0x7fe1e00cbb90 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1dffff700 1 -- 172.21.15.46:0/1410953551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d800b7a0 con 0x7fe1e00cbb90 2023-10-07T09:06:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.866+0000 7fe1dffff700 1 -- 172.21.15.46:0/1410953551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800bb40 con 0x7fe1e00cbb90 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 -- 172.21.15.46:0/1410953551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e00cbb90 msgr2=0x7fe1e00af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 --2- 172.21.15.46:0/1410953551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e00cbb90 0x7fe1e00af320 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80098e0 tx=0x7fe1d80091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 -- 172.21.15.46:0/1410953551 shutdown_connections 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 --2- 172.21.15.46:0/1410953551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e00cbb90 0x7fe1e00af320 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 -- 172.21.15.46:0/1410953551 >> 172.21.15.46:0/1410953551 conn(0x7fe1e0068e00 msgr2=0x7fe1e00d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 -- 172.21.15.46:0/1410953551 shutdown_connections 2023-10-07T09:06:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.867+0000 7fe1e7680700 1 -- 172.21.15.46:0/1410953551 wait complete. 2023-10-07T09:06:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.868+0000 7fe1e7680700 1 Processor -- start 2023-10-07T09:06:24.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.868+0000 7fe1e7680700 1 -- start start 2023-10-07T09:06:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1e00cbb90 0x7fe1e0155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e0159950 0x7fe1e00b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00b4190 con 0x7fe1e0069c70 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00b64c0 con 0x7fe1e0159950 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e7680700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0158be0 con 0x7fe1e00cbb90 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57928/0 (socket says 172.21.15.46:57928) 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 -- 172.21.15.46:0/333907604 learned_addr learned my addr 172.21.15.46:0/333907604 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 -- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1e00cbb90 msgr2=0x7fe1e0155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e5c1d700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e0159950 0x7fe1e00b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e4c1b700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1e00cbb90 0x7fe1e0155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1e00cbb90 0x7fe1e0155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 -- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e0159950 msgr2=0x7fe1e00b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e0159950 0x7fe1e00b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 -- 172.21.15.46:0/333907604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8009420 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.869+0000 7fe1e541c700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c910 tx=0x7fe1d0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.870+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000a7a0 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.870+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000a920 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.870+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00b3860 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.870+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000ace0 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.870+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e00b3e20 con 0x7fe1e0069c70 2023-10-07T09:06:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.871+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e00b4470 con 0x7fe1e0069c70 2023-10-07T09:06:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.871+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe1d0003030 con 0x7fe1e0069c70 2023-10-07T09:06:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.872+0000 7fe1dd7fa700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 0x7fe1cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.872+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1d0084cf0 con 0x7fe1e0069c70 2023-10-07T09:06:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.872+0000 7fe1e4c1b700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 0x7fe1cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.872+0000 7fe1e4c1b700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 0x7fe1cc0697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40058d0 tx=0x7fe1d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:24.876+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1d0051980 con 0x7fe1e0069c70 2023-10-07T09:06:25.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.150+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe1e00718b0 con 0x7fe1e0069c70 2023-10-07T09:06:25.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.154+0000 7fe1dd7fa700 1 -- 172.21.15.46:0/333907604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe1d0054fa0 con 0x7fe1e0069c70 2023-10-07T09:06:25.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 msgr2=0x7fe1cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 0x7fe1cc0697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40058d0 tx=0x7fe1d4009040 comp rx=0 tx=0).stop 2023-10-07T09:06:25.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 msgr2=0x7fe1e0159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c910 tx=0x7fe1d0001710 comp rx=0 tx=0).stop 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 shutdown_connections 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe1cc067320 0x7fe1cc0697d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e0159950 0x7fe1e00b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1e0069c70 0x7fe1e0159d20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 --2- 172.21.15.46:0/333907604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1e00cbb90 0x7fe1e0155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 >> 172.21.15.46:0/333907604 conn(0x7fe1e0068e00 msgr2=0x7fe1e015d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:25.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 shutdown_connections 2023-10-07T09:06:25.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.156+0000 7fe1e7680700 1 -- 172.21.15.46:0/333907604 wait complete. 2023-10-07T09:06:25.160 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:06:25.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.288+0000 7fb1dcbbe700 1 Processor -- start 2023-10-07T09:06:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.288+0000 7fb1dcbbe700 1 -- start start 2023-10-07T09:06:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1dcbbe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb1d8159420 0x7fb1d80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1dcbbe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1d81597f0 0x7fb1d80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1dcbbe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80b11d0 con 0x7fb1d815d230 2023-10-07T09:06:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1dcbbe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b14b0 con 0x7fb1d8159420 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1dcbbe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b1790 con 0x7fb1d81597f0 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb1d8159420 0x7fb1d80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb1d815d230 0x7fb1d815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48636/0 (socket says 172.21.15.46:48636) 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d7fff700 1 -- 172.21.15.46:0/2264390223 learned_addr learned my addr 172.21.15.46:0/2264390223 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d6ffd700 1 --2- 172.21.15.46:0/2264390223 >> v2:172.21.15.133:3300/0 conn(0x7fb1d81597f0 0x7fb1d80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d77fe700 1 -- 172.21.15.46:0/2264390223 >> v2:172.21.15.133:3300/0 conn(0x7fb1d81597f0 msgr2=0x7fb1d80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d77fe700 1 --2- 172.21.15.46:0/2264390223 >> v2:172.21.15.133:3300/0 conn(0x7fb1d81597f0 0x7fb1d80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d77fe700 1 -- 172.21.15.46:0/2264390223 >> v1:172.21.15.46:6789/0 conn(0x7fb1d815d230 legacy=0x7fb1d815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.289+0000 7fb1d77fe700 1 -- 172.21.15.46:0/2264390223 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80b1a70 con 0x7fb1d8159420 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1d77fe700 1 --2- 172.21.15.46:0/2264390223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d8159420 0x7fb1d80b5f40 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8089750 tx=0x7fb1c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b15866b382b326 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1d67fc700 1 -- 172.21.15.46:0/2264390223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800b6b0 con 0x7fb1d8159420 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1d67fc700 1 -- 172.21.15.46:0/2264390223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800b810 con 0x7fb1d8159420 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1d67fc700 1 -- 172.21.15.46:0/2264390223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800bbb0 con 0x7fb1d8159420 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2264390223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d8159420 msgr2=0x7fb1d80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2264390223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d8159420 0x7fb1d80b5f40 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8089750 tx=0x7fb1c80091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2264390223 shutdown_connections 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2264390223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d8159420 0x7fb1d80b5f40 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2264390223 >> v2:172.21.15.133:3300/0 conn(0x7fb1d81597f0 0x7fb1d80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2264390223 >> 172.21.15.46:0/2264390223 conn(0x7fb1d80d0660 msgr2=0x7fb1d80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2264390223 shutdown_connections 2023-10-07T09:06:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.290+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2264390223 wait complete. 2023-10-07T09:06:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 Processor -- start 2023-10-07T09:06:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 -- start start 2023-10-07T09:06:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1d8159420 0x7fb1d80c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d815d230 0x7fb1d8146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80cb410 con 0x7fb1d81597f0 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80d03a0 con 0x7fb1d815d230 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.292+0000 7fb1dcbbe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c6360 con 0x7fb1d8159420 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57940/0 (socket says 172.21.15.46:57940) 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 -- 172.21.15.46:0/2781421719 learned_addr learned my addr 172.21.15.46:0/2781421719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d77fe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1d8159420 0x7fb1d80c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d7fff700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d815d230 0x7fb1d8146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 -- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1d8159420 msgr2=0x7fb1d80c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1d8159420 0x7fb1d80c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 -- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d815d230 msgr2=0x7fb1d8146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d815d230 0x7fb1d8146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 -- 172.21.15.46:0/2781421719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009420 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1d6ffd700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d890 tx=0x7fb1cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00b600 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00b780 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00bb40 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80caab0 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.293+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d80cae00 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.294+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d804c3c0 con 0x7fb1d81597f0 2023-10-07T09:06:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.295+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb1cc01e460 con 0x7fb1d81597f0 2023-10-07T09:06:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.295+0000 7fb1bf7fe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 0x7fb1c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.295+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1cc085340 con 0x7fb1d81597f0 2023-10-07T09:06:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.295+0000 7fb1d77fe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 0x7fb1c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.296+0000 7fb1d77fe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 0x7fb1c40697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8003080 tx=0x7fb1c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.299+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1cc051fd0 con 0x7fb1d81597f0 2023-10-07T09:06:25.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.539+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1d80ca860 con 0x7fb1d81597f0 2023-10-07T09:06:25.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.540+0000 7fb1bf7fe700 1 -- 172.21.15.46:0/2781421719 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fb1cc0555f0 con 0x7fb1d81597f0 2023-10-07T09:06:25.541 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:25.542 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 msgr2=0x7fb1c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 0x7fb1c40697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8003080 tx=0x7fb1c8017000 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 msgr2=0x7fb1d80c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d890 tx=0x7fb1cc008040 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 shutdown_connections 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb1c4067320 0x7fb1c40697d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d815d230 0x7fb1d8146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb1d8159420 0x7fb1d80c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 --2- 172.21.15.46:0/2781421719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d81597f0 0x7fb1d80c8a90 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 >> 172.21.15.46:0/2781421719 conn(0x7fb1d80d0660 msgr2=0x7fb1d8069940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 shutdown_connections 2023-10-07T09:06:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:25.542+0000 7fb1dcbbe700 1 -- 172.21.15.46:0/2781421719 wait complete. 2023-10-07T09:06:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 102 2023-10-07T09:06:25.942 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-10-07T09:06:25.941+0000 7f451adac700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:06:25.958 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:06:19.618312+0000', 'modified': '2023-10-07T09:06:23.230643+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7914}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7914': {'gid': 7914, 'name': 'd', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2926043182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 2926043182}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2926043182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:06:25.958 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:06:25.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-07T09:06:26.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.082+0000 7f567e8f9700 1 Processor -- start 2023-10-07T09:06:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.082+0000 7f567e8f9700 1 -- start start 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567e8f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f56780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567e8f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f567815df50 0x7f567815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567e8f9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567815d7e0 con 0x7f567806bcd0 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567e8f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567815dac0 con 0x7f567815df50 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567e8f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567815aa30 con 0x7f567806c0a0 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5677fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f567806bcd0 0x7f567815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48648/0 (socket says 172.21.15.46:48648) 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5677fff700 1 -- 172.21.15.46:0/3307940388 learned_addr learned my addr 172.21.15.46:0/3307940388 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258104446 0 0) 0x7f567815d7e0 con 0x7f567806bcd0 2023-10-07T09:06:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f56777fe700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f56780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5660003570 con 0x7f567806bcd0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f567ce96700 1 --2- 172.21.15.46:0/3307940388 >> v2:172.21.15.133:3300/0 conn(0x7f567815df50 0x7f567815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448046590 0 0) 0x7f5660003570 con 0x7f567806bcd0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 msgr2=0x7f56780caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f56780caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 >> v2:172.21.15.133:3300/0 conn(0x7f567815df50 msgr2=0x7f567815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 --2- 172.21.15.46:0/3307940388 >> v2:172.21.15.133:3300/0 conn(0x7f567815df50 0x7f567815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567815ad10 con 0x7f567806bcd0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5668001470 con 0x7f567806bcd0 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 >> v1:172.21.15.46:6789/0 conn(0x7f567806bcd0 legacy=0x7f567815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5660003a60 0x7f5660003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f5660004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.083+0000 7f5676ffd700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660004d50 0x7f56600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567815dac0 con 0x7f5660003a60 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567815aa30 con 0x7f5660004d50 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566000bae0 con 0x7f567806c0a0 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5660003a60 0x7f5660003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f56777fe700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f5660004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f567ce96700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660004d50 0x7f56600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 -- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 msgr2=0x7f5660004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f567806c0a0 0x7f5660004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 -- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660004d50 msgr2=0x7f56600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660004d50 0x7f56600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 -- 172.21.15.46:0/3307940388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660003570 con 0x7f5660003a60 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f567ce96700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660004d50 0x7f56600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5677fff700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5660003a60 0x7f5660003e70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f566800c3c0 tx=0x7f5668001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04357430921d812 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800cc90 con 0x7f5660003a60 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800ce10 con 0x7f5660003a60 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.084+0000 7f5676ffd700 1 -- 172.21.15.46:0/3307940388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668005b70 con 0x7f5660003a60 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 -- 172.21.15.46:0/3307940388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5660003a60 msgr2=0x7f5660003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 --2- 172.21.15.46:0/3307940388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5660003a60 0x7f5660003e70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f566800c3c0 tx=0x7f5668001e90 comp rx=0 tx=0).stop 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567ce96700 1 -- 172.21.15.46:0/3307940388 reap_dead start 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 -- 172.21.15.46:0/3307940388 shutdown_connections 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 -- 172.21.15.46:0/3307940388 >> 172.21.15.46:0/3307940388 conn(0x7f56780ce600 msgr2=0x7f56780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 -- 172.21.15.46:0/3307940388 shutdown_connections 2023-10-07T09:06:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.085+0000 7f567e8f9700 1 -- 172.21.15.46:0/3307940388 wait complete. 2023-10-07T09:06:26.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.086+0000 7f567e8f9700 1 Processor -- start 2023-10-07T09:06:26.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.086+0000 7f567e8f9700 1 -- start start 2023-10-07T09:06:26.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660003a60 0x7f567816b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56780cba80 0x7f56780b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cbf20 con 0x7f5678154060 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678155780 con 0x7f5660003a60 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56781565e0 con 0x7f56780cba80 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57962/0 (socket says 172.21.15.46:57962) 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 -- 172.21.15.46:0/2931411133 learned_addr learned my addr 172.21.15.46:0/2931411133 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567ce96700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56780cba80 0x7f56780b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f5677fff700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660003a60 0x7f567816b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 -- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56780cba80 msgr2=0x7f56780b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56780cba80 0x7f56780b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 -- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660003a60 msgr2=0x7f567816b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660003a60 0x7f567816b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 -- 172.21.15.46:0/2931411133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56781544d0 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f56777fe700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f566c0119c0 tx=0x7f566c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f565ffff700 1 -- 172.21.15.46:0/2931411133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c00f650 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f565ffff700 1 -- 172.21.15.46:0/2931411133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00f7b0 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56781559d0 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f565ffff700 1 -- 172.21.15.46:0/2931411133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c00fb70 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.087+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678155f90 con 0x7f5678154060 2023-10-07T09:06:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.089+0000 7f565ffff700 1 -- 172.21.15.46:0/2931411133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f566c015460 con 0x7f5678154060 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.089+0000 7f565ffff700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 0x7f56640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.089+0000 7f565ffff700 1 -- 172.21.15.46:0/2931411133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f566c0853e0 con 0x7f5678154060 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.089+0000 7f5677fff700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 0x7f56640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.090+0000 7f5677fff700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 0x7f56640697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f567816d3a0 tx=0x7f5668015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.091+0000 7f5687bf1b80 1 Processor -- start 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.091+0000 7f5687bf1b80 1 -- start start 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca459a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca459f60 0x562aca42ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca387a70 con 0x562aca430a50 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca385270 con 0x562aca47ad00 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aca381060 con 0x562aca459f60 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57978/0 (socket says 172.21.15.46:57978) 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 -- 172.21.15.46:0/64467502 learned_addr learned my addr 172.21.15.46:0/64467502 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f56777fe700 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca459a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f567ce96700 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca459f60 0x562aca42ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 -- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca459f60 msgr2=0x562aca42ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca459f60 0x562aca42ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 -- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 msgr2=0x562aca459a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca459a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.092+0000 7f5677fff700 1 -- 172.21.15.46:0/64467502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aca21b270 con 0x562aca430a50 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f5677fff700 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f5668007bb0 tx=0x7f5668021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b8871df67c0f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f565d7fa700 1 -- 172.21.15.46:0/64467502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668007be0 con 0x562aca430a50 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f565d7fa700 1 -- 172.21.15.46:0/64467502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668023070 con 0x562aca430a50 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f565d7fa700 1 -- 172.21.15.46:0/64467502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668000c30 con 0x562aca430a50 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f5687bf1b80 1 -- 172.21.15.46:0/64467502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 msgr2=0x562aca430e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.093+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f5668007bb0 tx=0x7f5668021070 comp rx=0 tx=0).stop 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 -- 172.21.15.46:0/64467502 shutdown_connections 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca459f60 0x562aca42ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca430a50 0x562aca430e20 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/64467502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca459a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 -- 172.21.15.46:0/64467502 >> 172.21.15.46:0/64467502 conn(0x562aca432370 msgr2=0x562aca432740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 -- 172.21.15.46:0/64467502 shutdown_connections 2023-10-07T09:06:26.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 -- 172.21.15.46:0/64467502 wait complete. 2023-10-07T09:06:26.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 -- start start 2023-10-07T09:06:26.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.094+0000 7f5687bf1b80 1 Processor -- start 2023-10-07T09:06:26.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca430a50 0x562aca456370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca470e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca32c890 con 0x562aca459f60 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca347ea0 con 0x562aca47ad00 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aca203e30 con 0x562aca430a50 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5687bf1b80 10 client.0 _ll_register_callbacks cb 0x562aca3f4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57986/0 (socket says 172.21.15.46:57986) 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 -- 172.21.15.46:0/4032693026 learned_addr learned my addr 172.21.15.46:0/4032693026 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f5677fff700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca430a50 0x562aca456370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f567ce96700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca470e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 -- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca430a50 msgr2=0x562aca456370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca430a50 0x562aca456370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 -- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 msgr2=0x562aca470e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca470e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.095+0000 7f56777fe700 1 -- 172.21.15.46:0/4032693026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5660003570 con 0x562aca459f60 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56777fe700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f566c055a90 tx=0x7f566c05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c15e9e9552d65e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c058f80 con 0x562aca459f60 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f566c05ccd0 con 0x562aca459f60 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aca425b70 con 0x562aca459f60 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566c083120 con 0x562aca459f60 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 10 client.8040 fetch_fsmap learned FSMap version 102 2023-10-07T09:06:26.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x562aca1bdfe0 con 0x562aca459f60 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562aca425b70 con 0x562aca459f60 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f566c055280 con 0x562aca459f60 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 10 client.8040 fetch_fsmap finished waiting for FSMap version 102 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 10 client.8040 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 20 client.8040 populate_metadata read hostname 'smithi046' 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca4721d0 0x562aca4725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 4 client.8040 mds_command: new command op to 7914 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 --> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aca402aa0 con 0x562aca4721d0 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.096+0000 7f5677fff700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca4721d0 0x562aca4725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.097+0000 7f56567fc700 10 client.8040 ms_handle_connect on v2:172.21.15.133:6835/2926043182 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.097+0000 7f5677fff700 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca4721d0 0x562aca4725a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1023436235acf288 server_cookie=2c9e8a7786afde1c in_seq=0 out_seq=0 2023-10-07T09:06:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f56567fc700 1 -- 172.21.15.46:0/4032693026 <== mds.0 v2:172.21.15.133:6835/2926043182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562aca402aa0 con 0x562aca4721d0 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f56567fc700 10 client.8040 handle_command_reply: tid=0 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 client.8040 shutdown 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 msgr2=0x562aca48b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f566c055a90 tx=0x7f566c05b040 comp rx=0 tx=0).stop 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 shutdown_connections 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca4721d0 0x562aca4725a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca47ad00 0x562aca470e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f56567fc700 0 client.8040 ms_handle_reset on v2:172.21.15.133:6835/2926043182 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca430a50 0x562aca456370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/4032693026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca48b070 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 >> 172.21.15.46:0/4032693026 conn(0x562aca432370 msgr2=0x562aca476550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 shutdown_connections 2023-10-07T09:06:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 1 -- 172.21.15.46:0/4032693026 wait complete. 2023-10-07T09:06:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.098+0000 7f5687bf1b80 20 client.8040 trim_cache size 0 max 16384 2023-10-07T09:06:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.115+0000 7f5687bf1b80 1 Processor -- start 2023-10-07T09:06:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.115+0000 7f5687bf1b80 1 -- start start 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca489310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca4588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca476120 con 0x562aca459f60 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca4916e0 con 0x562aca430a50 2023-10-07T09:06:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aca42e820 con 0x562aca4721d0 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57994/0 (socket says 172.21.15.46:57994) 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 -- 172.21.15.46:0/2436767641 learned_addr learned my addr 172.21.15.46:0/2436767641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f567ce96700 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca4588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f5677fff700 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca489310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 -- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 msgr2=0x562aca4588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca4588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 -- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 msgr2=0x562aca489310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca489310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 -- 172.21.15.46:0/2436767641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aca34f780 con 0x562aca459f60 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f56777fe700 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f566c06c2c0 tx=0x7f566c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95dfd6e6dde3ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f565dffb700 1 -- 172.21.15.46:0/2436767641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c05ccd0 con 0x562aca459f60 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f565dffb700 1 -- 172.21.15.46:0/2436767641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c058f80 con 0x562aca459f60 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.116+0000 7f565dffb700 1 -- 172.21.15.46:0/2436767641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c055d30 con 0x562aca459f60 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 -- 172.21.15.46:0/2436767641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 msgr2=0x562aca458380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f566c06c2c0 tx=0x7f566c06b000 comp rx=0 tx=0).stop 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 -- 172.21.15.46:0/2436767641 shutdown_connections 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca4588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca489310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/2436767641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca458380 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 -- 172.21.15.46:0/2436767641 >> 172.21.15.46:0/2436767641 conn(0x562aca432370 msgr2=0x562aca4294b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 -- 172.21.15.46:0/2436767641 shutdown_connections 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.117+0000 7f5687bf1b80 1 -- 172.21.15.46:0/2436767641 wait complete. 2023-10-07T09:06:26.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 -- start start 2023-10-07T09:06:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 Processor -- start 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca470ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca489310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca431150 con 0x562aca459f60 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aca4dc760 con 0x562aca430a50 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aca4e0810 con 0x562aca4721d0 2023-10-07T09:06:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f5687bf1b80 10 client.0 _ll_register_callbacks cb 0x562aca3f4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f56777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57996/0 (socket says 172.21.15.46:57996) 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.118+0000 7f56777fe700 1 -- 172.21.15.46:0/3114922728 learned_addr learned my addr 172.21.15.46:0/3114922728 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 -- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 msgr2=0x562aca489310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca489310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 -- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 msgr2=0x562aca470ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca470ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 -- 172.21.15.46:0/3114922728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aca1bdfe0 con 0x562aca459f60 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56777fe700 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f566c055a90 tx=0x7f566c081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e4f3155e950968 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c055d30 con 0x562aca459f60 2023-10-07T09:06:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f566c0680d0 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5668023070 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566c055280 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 10 client.8046 fetch_fsmap learned FSMap version 102 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x562aca336470 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c078070 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f566c05c840 con 0x562aca459f60 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 10 client.8046 fetch_fsmap finished waiting for FSMap version 102 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 10 client.8046 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 20 client.8046 populate_metadata read hostname 'smithi046' 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca47ad00 0x562aca454b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 4 client.8046 mds_command: new command op to 7914 tid=0[{"prefix": "status"}] 2023-10-07T09:06:26.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.119+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 --> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562aca323e00 con 0x562aca47ad00 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5677fff700 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca47ad00 0x562aca454b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f56567fc700 10 client.8046 ms_handle_connect on v2:172.21.15.133:6835/2926043182 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5677fff700 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca47ad00 0x562aca454b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c56736f8e45747 server_cookie=185482e9476bae9b in_seq=0 out_seq=0 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f56567fc700 1 -- 172.21.15.46:0/3114922728 <== mds.0 v2:172.21.15.133:6835/2926043182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x562aca323e00 con 0x562aca47ad00 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f56567fc700 10 client.8046 handle_command_reply: tid=0 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 client.8046 shutdown 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 msgr2=0x562aca4dbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f566c055a90 tx=0x7f566c081000 comp rx=0 tx=0).stop 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 shutdown_connections 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:6835/2926043182,v1:172.21.15.133:6837/2926043182] conn(0x562aca47ad00 0x562aca454b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562aca4721d0 0x562aca489310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562aca430a50 0x562aca470ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f56567fc700 0 client.8046 ms_handle_reset on v2:172.21.15.133:6835/2926043182 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 --2- 172.21.15.46:0/3114922728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562aca459f60 0x562aca4dbee0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 >> 172.21.15.46:0/3114922728 conn(0x562aca432370 msgr2=0x562aca460360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.120+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 shutdown_connections 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f5687bf1b80 1 -- 172.21.15.46:0/3114922728 wait complete. 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f5687bf1b80 20 client.8046 trim_cache size 0 max 16384 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:06:26.129 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 7914, 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9046751369999999, 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 102, 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 153, 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 153, 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.995526763000001 2023-10-07T09:06:26.130 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:06:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 msgr2=0x7f56640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 0x7f56640697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f567816d3a0 tx=0x7f5668015000 comp rx=0 tx=0).stop 2023-10-07T09:06:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 msgr2=0x7f56780cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f566c0119c0 tx=0x7f566c008040 comp rx=0 tx=0).stop 2023-10-07T09:06:26.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 shutdown_connections 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5664067320 0x7f56640697d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56780cba80 0x7f56780b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5660003a60 0x7f567816b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 --2- 172.21.15.46:0/2931411133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5678154060 0x7f56780cb540 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 >> 172.21.15.46:0/2931411133 conn(0x7f56780ce600 msgr2=0x7f5678154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 shutdown_connections 2023-10-07T09:06:26.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.121+0000 7f567e8f9700 1 -- 172.21.15.46:0/2931411133 wait complete. 2023-10-07T09:06:26.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:06:26.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.252+0000 7ff9c2679700 1 Processor -- start 2023-10-07T09:06:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.252+0000 7ff9c2679700 1 -- start start 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c2679700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff9bc159c60 0x7ff9bc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c2679700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc15db10 0x7ff9bc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c2679700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc15a160 con 0x7ff9bc159890 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c2679700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc15df50 con 0x7ff9bc159c60 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c2679700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0d13a0 con 0x7ff9bc15db10 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff9bc159c60 0x7ff9bc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bbfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff9bc159890 0x7ff9bc15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48660/0 (socket says 172.21.15.46:48660) 2023-10-07T09:06:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bbfff700 1 -- 172.21.15.46:0/202518965 learned_addr learned my addr 172.21.15.46:0/202518965 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9c0c16700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc15db10 0x7ff9bc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/202518965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc15db10 msgr2=0x7ff9bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc15db10 0x7ff9bc069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/202518965 >> v1:172.21.15.46:6789/0 conn(0x7ff9bc159890 legacy=0x7ff9bc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/202518965 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc15e140 con 0x7ff9bc159c60 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9baffd700 1 -- 172.21.15.46:0/202518965 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157163655 0 0) 0x7ff9bc15a160 con 0x7ff9bc159890 2023-10-07T09:06:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.253+0000 7ff9bb7fe700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc15d5d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098e0 tx=0x7ff9b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4e8a22156706eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9baffd700 1 -- 172.21.15.46:0/202518965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0009e80 con 0x7ff9bc159c60 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9baffd700 1 -- 172.21.15.46:0/202518965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b000b860 con 0x7ff9bc159c60 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9baffd700 1 -- 172.21.15.46:0/202518965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000bbe0 con 0x7ff9bc159c60 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 -- 172.21.15.46:0/202518965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 msgr2=0x7ff9bc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc15d5d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098e0 tx=0x7ff9b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 -- 172.21.15.46:0/202518965 shutdown_connections 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc15db10 0x7ff9bc069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 --2- 172.21.15.46:0/202518965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc15d5d0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 -- 172.21.15.46:0/202518965 >> 172.21.15.46:0/202518965 conn(0x7ff9bc068e20 msgr2=0x7ff9bc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 -- 172.21.15.46:0/202518965 shutdown_connections 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.254+0000 7ff9c2679700 1 -- 172.21.15.46:0/202518965 wait complete. 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.255+0000 7ff9c2679700 1 Processor -- start 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.255+0000 7ff9c2679700 1 -- start start 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc159890 0x7ff9bc145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 0x7ff9bc15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0b3fa0 con 0x7ff9bc159c60 2023-10-07T09:06:26.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0b4280 con 0x7ff9bc15db10 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c2679700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc1457a0 con 0x7ff9bc159890 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58008/0 (socket says 172.21.15.46:58008) 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/4244631300 learned_addr learned my addr 172.21.15.46:0/4244631300 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9bbfff700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc159890 0x7ff9bc145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.256+0000 7ff9c0c16700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 0x7ff9bc15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc159890 msgr2=0x7ff9bc145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc159890 0x7ff9bc145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 msgr2=0x7ff9bc15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 0x7ff9bc15f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 -- 172.21.15.46:0/4244631300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009420 con 0x7ff9bc159c60 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9c0c16700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 0x7ff9bc15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9bb7fe700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b3c0 tx=0x7ff9b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000b9d0 con 0x7ff9bc159c60 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b000bb30 con 0x7ff9bc159c60 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0b21d0 con 0x7ff9bc159c60 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0025670 con 0x7ff9bc159c60 2023-10-07T09:06:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.257+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc0b2790 con 0x7ff9bc159c60 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.258+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0b4410 con 0x7ff9bc159c60 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.259+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9b0023070 con 0x7ff9bc159c60 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.259+0000 7ff9a3fff700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 0x7ff9a8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.259+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b0086240 con 0x7ff9bc159c60 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.259+0000 7ff9bbfff700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 0x7ff9a8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.260+0000 7ff9bbfff700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 0x7ff9a8069800 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007fd0 tx=0x7ff9ac007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.263+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9b0052ed0 con 0x7ff9bc159c60 2023-10-07T09:06:26.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.505+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9bc04c3c0 con 0x7ff9bc159c60 2023-10-07T09:06:26.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.505+0000 7ff9a3fff700 1 -- 172.21.15.46:0/4244631300 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff9b00564f0 con 0x7ff9bc159c60 2023-10-07T09:06:26.507 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 msgr2=0x7ff9a8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 0x7ff9a8069800 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007fd0 tx=0x7ff9ac007d30 comp rx=0 tx=0).stop 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 msgr2=0x7ff9bc0b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b3c0 tx=0x7ff9b0017000 comp rx=0 tx=0).stop 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 shutdown_connections 2023-10-07T09:06:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff9a8067350 0x7ff9a8069800 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9bc15db10 0x7ff9bc15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9bc159890 0x7ff9bc145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 --2- 172.21.15.46:0/4244631300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9bc159c60 0x7ff9bc0b0540 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 >> 172.21.15.46:0/4244631300 conn(0x7ff9bc068e20 msgr2=0x7ff9bc156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 shutdown_connections 2023-10-07T09:06:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:26.507+0000 7ff9c2679700 1 -- 172.21.15.46:0/4244631300 wait complete. 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:06:26.521 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:06:26.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:26.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.522 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:06:26.537 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42027sec preferred_lft 42027sec 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.540 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:06:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:06:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:26.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.541 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:06:26.601 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:06:26.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.603 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:06:26.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:06:26.660 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:06:26.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:06:26.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:06:26.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:06:26.660 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:06:26.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.761 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:06:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:06:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:06:26.776 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:26.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:26.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:06:26.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:26.841 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:26.896 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:26.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:26.897 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:26.950 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:06:26.950 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:06:26.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:27.031 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:27.050 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:27.050 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:27.050 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:27.050 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:27.051 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:27.051 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:27.051 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:27.051 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:27.073 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:27.073 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:27.073 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:06:27.074 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:06:27.076 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:06:27.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:27.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:06:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.301+0000 7f2fcd70b700 1 Processor -- start 2023-10-07T09:06:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.301+0000 7f2fcd70b700 1 -- start start 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fcd70b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fc81597e0 0x7f2fc806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fcd70b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fc806c050 0x7f2fc8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fcd70b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc806bbc0 con 0x7f2fc8159bb0 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fcd70b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80c8660 con 0x7f2fc806c050 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fcd70b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc806ad10 con 0x7f2fc81597e0 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc67fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2fc806c050 0x7f2fc8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2fc8159bb0 0x7f2fc815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48676/0 (socket says 172.21.15.46:48676) 2023-10-07T09:06:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc77fe700 1 -- 172.21.15.46:0/2473299679 learned_addr learned my addr 172.21.15.46:0/2473299679 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc6ffd700 1 --2- 172.21.15.46:0/2473299679 >> v2:172.21.15.133:3300/0 conn(0x7f2fc81597e0 0x7f2fc806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2473299679 >> v2:172.21.15.133:3300/0 conn(0x7f2fc81597e0 msgr2=0x7f2fc806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc67fc700 1 --2- 172.21.15.46:0/2473299679 >> v2:172.21.15.133:3300/0 conn(0x7f2fc81597e0 0x7f2fc806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2473299679 >> v1:172.21.15.46:6789/0 conn(0x7f2fc8159bb0 legacy=0x7f2fc815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc5ffb700 1 -- 172.21.15.46:0/2473299679 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376936238 0 0) 0x7f2fc806bbc0 con 0x7f2fc8159bb0 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.302+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2473299679 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc806afb0 con 0x7f2fc806c050 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fc67fc700 1 --2- 172.21.15.46:0/2473299679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc806c050 0x7f2fc8068390 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8064fd0 tx=0x7f2fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0370b63dac0dcf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fc5ffb700 1 -- 172.21.15.46:0/2473299679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000b6b0 con 0x7f2fc806c050 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fc5ffb700 1 -- 172.21.15.46:0/2473299679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000b810 con 0x7f2fc806c050 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fc5ffb700 1 -- 172.21.15.46:0/2473299679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000bbb0 con 0x7f2fc806c050 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2473299679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc806c050 msgr2=0x7f2fc8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2473299679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc806c050 0x7f2fc8068390 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8064fd0 tx=0x7f2fb00091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2473299679 shutdown_connections 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2473299679 >> v2:172.21.15.133:3300/0 conn(0x7f2fc81597e0 0x7f2fc806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2473299679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc806c050 0x7f2fc8068390 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2473299679 >> 172.21.15.46:0/2473299679 conn(0x7f2fc80cdd80 msgr2=0x7f2fc80c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2473299679 shutdown_connections 2023-10-07T09:06:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.303+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2473299679 wait complete. 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 Processor -- start 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 -- start start 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc806c050 0x7f2fc8157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc8159bb0 0x7f2fc80b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc81583c0 con 0x7f2fc81597e0 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815b410 con 0x7f2fc8159bb0 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fcd70b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815bf30 con 0x7f2fc806c050 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fc67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fc67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58030/0 (socket says 172.21.15.46:58030) 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.305+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2699800873 learned_addr learned my addr 172.21.15.46:0/2699800873 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc806c050 msgr2=0x7f2fc8157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc806c050 0x7f2fc8157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc8159bb0 msgr2=0x7f2fc80b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc8159bb0 0x7f2fc80b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 -- 172.21.15.46:0/2699800873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009420 con 0x7f2fc81597e0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fc67fc700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b0e0 tx=0x7f2fb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011420 con 0x7f2fc81597e0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0011580 con 0x7f2fc81597e0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc815b600 con 0x7f2fc81597e0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011940 con 0x7f2fc81597e0 2023-10-07T09:06:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.306+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc815bbc0 con 0x7f2fc81597e0 2023-10-07T09:06:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.307+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc804c3c0 con 0x7f2fc81597e0 2023-10-07T09:06:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.307+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2fb0011d30 con 0x7f2fc81597e0 2023-10-07T09:06:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.308+0000 7f2fbeffd700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 0x7f2fa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.308+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fb0086670 con 0x7f2fc81597e0 2023-10-07T09:06:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.308+0000 7f2fc6ffd700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 0x7f2fa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.309+0000 7f2fc6ffd700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 0x7f2fa80697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009a60 tx=0x7f2fb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.312+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb0053300 con 0x7f2fc81597e0 2023-10-07T09:06:27.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.551+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2fc815c0c0 con 0x7f2fc81597e0 2023-10-07T09:06:27.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.552+0000 7f2fbeffd700 1 -- 172.21.15.46:0/2699800873 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2fb0056920 con 0x7f2fc81597e0 2023-10-07T09:06:27.554 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 msgr2=0x7f2fa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 0x7f2fa80697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009a60 tx=0x7f2fb8008040 comp rx=0 tx=0).stop 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 msgr2=0x7f2fc814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b0e0 tx=0x7f2fb0017000 comp rx=0 tx=0).stop 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 shutdown_connections 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2fa8067320 0x7f2fa80697d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc8159bb0 0x7f2fc80b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc806c050 0x7f2fc8157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 --2- 172.21.15.46:0/2699800873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fc81597e0 0x7f2fc814a720 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 >> 172.21.15.46:0/2699800873 conn(0x7f2fc80cdd80 msgr2=0x7f2fc815ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 shutdown_connections 2023-10-07T09:06:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:27.554+0000 7f2fcd70b700 1 -- 172.21.15.46:0/2699800873 wait complete. 2023-10-07T09:06:27.567 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:06:27.568 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:27.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.568 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:06:27.587 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:06:27.587 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:06:27.587 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:06:27.587 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.587 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:27.588 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42018sec preferred_lft 42018sec 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:06:27.589 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:27.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.590 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:06:27.656 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:06:27.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.657 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:06:27.716 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:06:27.716 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:06:27.717 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:06:27.717 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:06:27.717 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:06:27.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.717 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:06:27.717 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:06:27.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:06:27.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:06:27.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:06:27.718 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:06:27.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.823 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:06:27.838 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:06:27.838 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:06:27.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:27.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:27.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:06:27.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:27.903 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:27.958 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:27.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:27.959 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:28.013 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:06:28.013 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:06:28.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:28.093 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:28.093 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:28.112 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:28.133 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:28.133 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:28.133 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:06:28.134 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:06:28.136 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:06:28.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:28.136 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:28.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:06:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.327+0000 7faedd69a700 1 Processor -- start 2023-10-07T09:06:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.327+0000 7faedd69a700 1 -- start start 2023-10-07T09:06:28.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faedd69a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 0x7faed80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faedd69a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faed80b55a0 0x7faed80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faedd69a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80b5b00 con 0x7faed8159ec0 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faedd69a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80b5da0 con 0x7faed80b55a0 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faedd69a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80b6080 con 0x7faed80cd910 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faed8159ec0 0x7faed80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48692/0 (socket says 172.21.15.46:48692) 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed6ffd700 1 -- 172.21.15.46:0/415841571 learned_addr learned my addr 172.21.15.46:0/415841571 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed67fc700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 0x7faed80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:28.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed77fe700 1 --2- 172.21.15.46:0/415841571 >> v2:172.21.15.133:3300/0 conn(0x7faed80b55a0 0x7faed80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473399760 0 0) 0x7faed80b5b00 con 0x7faed8159ec0 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.328+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec0003570 con 0x7faed8159ec0 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed77fe700 1 -- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 msgr2=0x7faed80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3812728855 0 0) 0x7faec0003570 con 0x7faed8159ec0 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed77fe700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 0x7faed80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed77fe700 1 -- 172.21.15.46:0/415841571 >> v1:172.21.15.46:6789/0 conn(0x7faed8159ec0 legacy=0x7faed80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed77fe700 1 -- 172.21.15.46:0/415841571 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80cc100 con 0x7faed80b55a0 2023-10-07T09:06:28.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed67fc700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 0x7faed80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed77fe700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed80b55a0 0x7faed80ce880 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e60 tx=0x7faed0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d746f5518a35c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000e070 con 0x7faed80b55a0 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000b7a0 con 0x7faed80b55a0 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faed5ffb700 1 -- 172.21.15.46:0/415841571 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80015f0 con 0x7faed80b55a0 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faedd69a700 1 -- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed80b55a0 msgr2=0x7faed80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.329+0000 7faedd69a700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed80b55a0 0x7faed80ce880 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e60 tx=0x7faed0009780 comp rx=0 tx=0).stop 2023-10-07T09:06:28.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 -- 172.21.15.46:0/415841571 shutdown_connections 2023-10-07T09:06:28.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed80b55a0 0x7faed80ce880 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:28.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 --2- 172.21.15.46:0/415841571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cd910 0x7faed80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:28.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 -- 172.21.15.46:0/415841571 >> 172.21.15.46:0/415841571 conn(0x7faed80999f0 msgr2=0x7faed80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:28.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 -- 172.21.15.46:0/415841571 shutdown_connections 2023-10-07T09:06:28.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.330+0000 7faedd69a700 1 -- 172.21.15.46:0/415841571 wait complete. 2023-10-07T09:06:28.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.331+0000 7faedd69a700 1 Processor -- start 2023-10-07T09:06:28.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.331+0000 7faedd69a700 1 -- start start 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed8159ec0 0x7faed8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cdcf0 0x7faed80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80ce6d0 con 0x7faed80b55a0 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80696b0 con 0x7faed8159ec0 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8069990 con 0x7faed80cdcf0 2023-10-07T09:06:28.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58036/0 (socket says 172.21.15.46:58036) 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 -- 172.21.15.46:0/122046524 learned_addr learned my addr 172.21.15.46:0/122046524 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 -- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cdcf0 msgr2=0x7faed80ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cdcf0 0x7faed80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 -- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed8159ec0 msgr2=0x7faed8156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed8159ec0 0x7faed8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 -- 172.21.15.46:0/122046524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009420 con 0x7faed80b55a0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faed6ffd700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7faec800cb60 tx=0x7faec80013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80070f0 con 0x7faed80b55a0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec8007270 con 0x7faed80b55a0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed0009a20 con 0x7faed80b55a0 2023-10-07T09:06:28.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8007630 con 0x7faed80b55a0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.332+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8069f50 con 0x7faed80b55a0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.333+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed809bbe0 con 0x7faed80b55a0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.334+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faec8005a00 con 0x7faed80b55a0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.334+0000 7faebeffd700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 0x7faec40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.334+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faec8084a30 con 0x7faed80b55a0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.334+0000 7faed67fc700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 0x7faec40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.335+0000 7faed67fc700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 0x7faec40697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faed80c9d00 tx=0x7faecc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:28.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.338+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed809bbe0 con 0x7faed80b55a0 2023-10-07T09:06:28.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:28.577+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faed809bbe0 con 0x7faed80b55a0 2023-10-07T09:06:29.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.163+0000 7faebeffd700 1 -- 172.21.15.46:0/122046524 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 136+0+0 (secure 0 0 0) 0x7faed809bbe0 con 0x7faed80b55a0 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 msgr2=0x7faec40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 0x7faec40697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faed80c9d00 tx=0x7faecc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 msgr2=0x7faed8169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7faec800cb60 tx=0x7faec80013b0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 shutdown_connections 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faec4067320 0x7faec40697d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faed80cdcf0 0x7faed80ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80b55a0 0x7faed8169730 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 --2- 172.21.15.46:0/122046524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faed8159ec0 0x7faed8156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 >> 172.21.15.46:0/122046524 conn(0x7faed80999f0 msgr2=0x7faed8158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:29.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 shutdown_connections 2023-10-07T09:06:29.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.166+0000 7faedd69a700 1 -- 172.21.15.46:0/122046524 wait complete. 2023-10-07T09:06:29.183 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:06:29.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 Processor -- start 2023-10-07T09:06:29.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 -- start start 2023-10-07T09:06:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3758159420 0x7f37580b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f375815d230 0x7f375815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580b2980 con 0x7f37581597f0 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375815db70 con 0x7f375815d230 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.309+0000 7f375d39d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580b11d0 con 0x7f3758159420 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f375815d230 0x7f375815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f37577fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f37581597f0 0x7f37580b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48702/0 (socket says 172.21.15.46:48702) 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f37577fe700 1 -- 172.21.15.46:0/2700828708 learned_addr learned my addr 172.21.15.46:0/2700828708 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f3757fff700 1 --2- 172.21.15.46:0/2700828708 >> v2:172.21.15.133:3300/0 conn(0x7f3758159420 0x7f37580b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 -- 172.21.15.46:0/2700828708 >> v2:172.21.15.133:3300/0 conn(0x7f3758159420 msgr2=0x7f37580b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 --2- 172.21.15.46:0/2700828708 >> v2:172.21.15.133:3300/0 conn(0x7f3758159420 0x7f37580b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 -- 172.21.15.46:0/2700828708 >> v1:172.21.15.46:6789/0 conn(0x7f37581597f0 legacy=0x7f37580b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 -- 172.21.15.46:0/2700828708 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580b14b0 con 0x7f375815d230 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f375cb9c700 1 --2- 172.21.15.46:0/2700828708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375815d230 0x7f375815d630 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f37580b2f20 tx=0x7f3750009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c11ca31379c2541 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f3756ffd700 1 -- 172.21.15.46:0/2700828708 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000e070 con 0x7f375815d230 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f3756ffd700 1 -- 172.21.15.46:0/2700828708 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375000bc30 con 0x7f375815d230 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.310+0000 7f3756ffd700 1 -- 172.21.15.46:0/2700828708 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750012430 con 0x7f375815d230 2023-10-07T09:06:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 -- 172.21.15.46:0/2700828708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375815d230 msgr2=0x7f375815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 --2- 172.21.15.46:0/2700828708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375815d230 0x7f375815d630 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f37580b2f20 tx=0x7f3750009780 comp rx=0 tx=0).stop 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 -- 172.21.15.46:0/2700828708 shutdown_connections 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 --2- 172.21.15.46:0/2700828708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375815d230 0x7f375815d630 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 --2- 172.21.15.46:0/2700828708 >> v2:172.21.15.133:3300/0 conn(0x7f3758159420 0x7f37580b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 -- 172.21.15.46:0/2700828708 >> 172.21.15.46:0/2700828708 conn(0x7f37580d0660 msgr2=0x7f37580d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 -- 172.21.15.46:0/2700828708 shutdown_connections 2023-10-07T09:06:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.311+0000 7f375d39d700 1 -- 172.21.15.46:0/2700828708 wait complete. 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.312+0000 7f375d39d700 1 Processor -- start 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.312+0000 7f375d39d700 1 -- start start 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3758159420 0x7f375815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 0x7f3758154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37580b5ea0 con 0x7f37581597f0 2023-10-07T09:06:29.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375815bdc0 con 0x7f375815d230 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375d39d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375815cb70 con 0x7f3758159420 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58042/0 (socket says 172.21.15.46:58042) 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 -- 172.21.15.46:0/1648957094 learned_addr learned my addr 172.21.15.46:0/1648957094 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375cb9c700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 0x7f3758154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f3757fff700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3758159420 0x7f375815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 -- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3758159420 msgr2=0x7f375815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3758159420 0x7f375815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 -- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 msgr2=0x7f3758154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 0x7f3758154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 -- 172.21.15.46:0/1648957094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009a20 con 0x7f37581597f0 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f375cb9c700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 0x7f3758154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.313+0000 7f37577fe700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c7c0 tx=0x7f374c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.314+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c005b30 con 0x7f37581597f0 2023-10-07T09:06:29.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.314+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c005c90 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.314+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375815b1b0 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.314+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c004a80 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.314+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375815ba50 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.315+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375815bf50 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.315+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f374c0070d0 con 0x7f37581597f0 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.315+0000 7f373ffff700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 0x7f37440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.315+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f374c0840c0 con 0x7f37581597f0 2023-10-07T09:06:29.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.316+0000 7f3757fff700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 0x7f37440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.316+0000 7f3757fff700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 0x7f37440697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3748006fd0 tx=0x7f3748008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.320+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f374c04b5a0 con 0x7f37581597f0 2023-10-07T09:06:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.539+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f375815b5a0 con 0x7f3744067320 2023-10-07T09:06:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.541+0000 7f373ffff700 1 -- 172.21.15.46:0/1648957094 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f375815b5a0 con 0x7f3744067320 2023-10-07T09:06:29.542 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:06:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:29.543 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 msgr2=0x7f37440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 0x7f37440697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3748006fd0 tx=0x7f3748008040 comp rx=0 tx=0).stop 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 msgr2=0x7f37580b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c7c0 tx=0x7f374c007f40 comp rx=0 tx=0).stop 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 shutdown_connections 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3744067320 0x7f37440697d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375815d230 0x7f3758154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3758159420 0x7f375815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 --2- 172.21.15.46:0/1648957094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37581597f0 0x7f37580b5070 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 >> 172.21.15.46:0/1648957094 conn(0x7f37580d0660 msgr2=0x7f3758156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 shutdown_connections 2023-10-07T09:06:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.543+0000 7f375d39d700 1 -- 172.21.15.46:0/1648957094 wait complete. 2023-10-07T09:06:29.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:06:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.677+0000 7fa8f7bba700 1 Processor -- start 2023-10-07T09:06:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.678+0000 7fa8f7bba700 1 -- start start 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.678+0000 7fa8f7bba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8f0159890 0x7fa8f015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.678+0000 7fa8f7bba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159c60 0x7fa8f015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.678+0000 7fa8f7bba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8f015db10 0x7fa8f0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f7bba700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f015a160 con 0x7fa8f0159890 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f7bba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00d13a0 con 0x7fa8f015db10 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f7bba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f015e140 con 0x7fa8f0159c60 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8f0159890 0x7fa8f015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8f0159890 0x7fa8f015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50428/0 (socket says 172.21.15.46:50428) 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 -- 172.21.15.46:0/4160033582 learned_addr learned my addr 172.21.15.46:0/4160033582 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5155700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159c60 0x7fa8f015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f6157700 1 --2- 172.21.15.46:0/4160033582 >> v2:172.21.15.133:3300/0 conn(0x7fa8f015db10 0x7fa8f0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 -- 172.21.15.46:0/4160033582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159c60 msgr2=0x7fa8f015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159c60 0x7fa8f015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 -- 172.21.15.46:0/4160033582 >> v2:172.21.15.133:3300/0 conn(0x7fa8f015db10 msgr2=0x7fa8f0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 --2- 172.21.15.46:0/4160033582 >> v2:172.21.15.133:3300/0 conn(0x7fa8f015db10 0x7fa8f0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 -- 172.21.15.46:0/4160033582 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f015a3d0 con 0x7fa8f0159890 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f5956700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f0159890 0x7fa8f015abd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0089b50 tx=0x7fa8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c807410f8a20f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f4954700 1 -- 172.21.15.46:0/4160033582 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800b640 con 0x7fa8f0159890 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f4954700 1 -- 172.21.15.46:0/4160033582 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800b7a0 con 0x7fa8f0159890 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.679+0000 7fa8f4954700 1 -- 172.21.15.46:0/4160033582 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800bb60 con 0x7fa8f0159890 2023-10-07T09:06:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 -- 172.21.15.46:0/4160033582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f0159890 msgr2=0x7fa8f015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f0159890 0x7fa8f015abd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0089b50 tx=0x7fa8e8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 -- 172.21.15.46:0/4160033582 shutdown_connections 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/4160033582 >> v2:172.21.15.133:3300/0 conn(0x7fa8f015db10 0x7fa8f0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f0159890 0x7fa8f015abd0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/4160033582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159c60 0x7fa8f015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 -- 172.21.15.46:0/4160033582 >> 172.21.15.46:0/4160033582 conn(0x7fa8f0068e20 msgr2=0x7fa8f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 -- 172.21.15.46:0/4160033582 shutdown_connections 2023-10-07T09:06:29.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.680+0000 7fa8f7bba700 1 -- 172.21.15.46:0/4160033582 wait complete. 2023-10-07T09:06:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.681+0000 7fa8f7bba700 1 Processor -- start 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.681+0000 7fa8f7bba700 1 -- start start 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159890 0x7fa8f01442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8f0159c60 0x7fa8f0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0144800 con 0x7fa8f015db10 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00b3590 con 0x7fa8f0159c60 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f7bba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00b3870 con 0x7fa8f0159890 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50434/0 (socket says 172.21.15.46:50434) 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 -- 172.21.15.46:0/1675103661 learned_addr learned my addr 172.21.15.46:0/1675103661 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 -- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159890 msgr2=0x7fa8f01442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f5956700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159890 0x7fa8f01442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159890 0x7fa8f01442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 -- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8f0159c60 msgr2=0x7fa8f0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f5155700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8f0159c60 0x7fa8f0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8f0159c60 0x7fa8f0156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 -- 172.21.15.46:0/1675103661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80094f0 con 0x7fa8f015db10 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.682+0000 7fa8f6157700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009e20 tx=0x7fa8e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.683+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cc20 con 0x7fa8f015db10 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.683+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000f040 con 0x7fa8f015db10 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.683+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f0156110 con 0x7fa8f015db10 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.683+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0014480 con 0x7fa8f015db10 2023-10-07T09:06:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.683+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01566d0 con 0x7fa8f015db10 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.684+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f004c3c0 con 0x7fa8f015db10 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.684+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8e00147f0 con 0x7fa8f015db10 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.685+0000 7fa8edffb700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 0x7fa8dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.685+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8e0085ab0 con 0x7fa8f015db10 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.685+0000 7fa8f5956700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 0x7fa8dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.686+0000 7fa8f5956700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 0x7fa8dc0697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0089b50 tx=0x7fa8e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.689+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8e0052630 con 0x7fa8f015db10 2023-10-07T09:06:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.883+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa8f00b39b0 con 0x7fa8f015db10 2023-10-07T09:06:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.883+0000 7fa8edffb700 1 -- 172.21.15.46:0/1675103661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8e00180c0 con 0x7fa8f015db10 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 msgr2=0x7fa8dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 0x7fa8dc0697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0089b50 tx=0x7fa8e8017000 comp rx=0 tx=0).stop 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 msgr2=0x7fa8f0157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009e20 tx=0x7fa8e000b040 comp rx=0 tx=0).stop 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 shutdown_connections 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa8dc067320 0x7fa8dc0697d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8f015db10 0x7fa8f0157250 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8f0159890 0x7fa8f01442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 --2- 172.21.15.46:0/1675103661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8f0159c60 0x7fa8f0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 >> 172.21.15.46:0/1675103661 conn(0x7fa8f0068e20 msgr2=0x7fa8f015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 shutdown_connections 2023-10-07T09:06:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:29.886+0000 7fa8f7bba700 1 -- 172.21.15.46:0/1675103661 wait complete. 2023-10-07T09:06:29.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000297515 2023-10-07T09:06:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.020+0000 7fca88864700 1 Processor -- start 2023-10-07T09:06:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.020+0000 7fca88864700 1 -- start start 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca88864700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca840b4e70 0x7fca840ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca88864700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca840b1b40 0x7fca8415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca88864700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840cfb00 con 0x7fca840b16d0 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca88864700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840b5c40 con 0x7fca840b1b40 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca88864700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840b5f20 con 0x7fca840b4e70 2023-10-07T09:06:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca840b1b40 0x7fca8415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca840b1b40 0x7fca8415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50440/0 (socket says 172.21.15.46:50440) 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 -- 172.21.15.46:0/736387060 learned_addr learned my addr 172.21.15.46:0/736387060 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca82d9d700 1 --2- 172.21.15.46:0/736387060 >> v2:172.21.15.133:3300/0 conn(0x7fca840b4e70 0x7fca840ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 -- 172.21.15.46:0/736387060 >> v2:172.21.15.133:3300/0 conn(0x7fca840b4e70 msgr2=0x7fca840ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 --2- 172.21.15.46:0/736387060 >> v2:172.21.15.133:3300/0 conn(0x7fca840b4e70 0x7fca840ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 -- 172.21.15.46:0/736387060 >> v1:172.21.15.133:6789/0 conn(0x7fca840b16d0 legacy=0x7fca8415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 -- 172.21.15.46:0/736387060 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840b6200 con 0x7fca840b1b40 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.021+0000 7fca8359e700 1 --2- 172.21.15.46:0/736387060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca8415d950 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fca84064910 tx=0x7fca7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24890baab096478f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca81d9b700 1 -- 172.21.15.46:0/736387060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00e070 con 0x7fca840b1b40 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca81d9b700 1 -- 172.21.15.46:0/736387060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00ba50 con 0x7fca840b1b40 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca81d9b700 1 -- 172.21.15.46:0/736387060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0092e0 con 0x7fca840b1b40 2023-10-07T09:06:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 -- 172.21.15.46:0/736387060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 msgr2=0x7fca8415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 --2- 172.21.15.46:0/736387060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca8415d950 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fca84064910 tx=0x7fca7c009840 comp rx=0 tx=0).stop 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 -- 172.21.15.46:0/736387060 shutdown_connections 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 --2- 172.21.15.46:0/736387060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca8415d950 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 --2- 172.21.15.46:0/736387060 >> v2:172.21.15.133:3300/0 conn(0x7fca840b4e70 0x7fca840ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 -- 172.21.15.46:0/736387060 >> 172.21.15.46:0/736387060 conn(0x7fca840d10c0 msgr2=0x7fca840affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 -- 172.21.15.46:0/736387060 shutdown_connections 2023-10-07T09:06:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.022+0000 7fca88864700 1 -- 172.21.15.46:0/736387060 wait complete. 2023-10-07T09:06:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.023+0000 7fca88864700 1 Processor -- start 2023-10-07T09:06:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.023+0000 7fca88864700 1 -- start start 2023-10-07T09:06:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca840b16d0 0x7fca840c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca84169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca840b4e70 0x7fca8416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca840c8200 con 0x7fca840b1b40 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84158760 con 0x7fca840b16d0 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca88864700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca840c67f0 con 0x7fca840b4e70 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca84169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca84169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50442/0 (socket says 172.21.15.46:50442) 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 -- 172.21.15.46:0/2047682899 learned_addr learned my addr 172.21.15.46:0/2047682899 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca82d9d700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca840b16d0 0x7fca840c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8359e700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca840b4e70 0x7fca8416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 -- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca840b4e70 msgr2=0x7fca8416a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca840b4e70 0x7fca8416a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 -- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca840b16d0 msgr2=0x7fca840c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.024+0000 7fca8259c700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca840b16d0 0x7fca840c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca8259c700 1 -- 172.21.15.46:0/2047682899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009ae0 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca8259c700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca840b1b40 0x7fca84169db0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c590 tx=0x7fca6c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011590 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c011710 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011ad0 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca88864700 1 -- 172.21.15.46:0/2047682899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca840c6ad0 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.025+0000 7fca88864700 1 -- 172.21.15.46:0/2047682899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca840ca820 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.026+0000 7fca88864700 1 -- 172.21.15.46:0/2047682899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca840c83b0 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.026+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fca6c01b3b0 con 0x7fca840b1b40 2023-10-07T09:06:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.027+0000 7fca7affd700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.027+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca6c0840e0 con 0x7fca840b1b40 2023-10-07T09:06:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.027+0000 7fca82d9d700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.027+0000 7fca82d9d700 1 --2- 172.21.15.46:0/2047682899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fca64067320 0x7fca640697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fca74006fd0 tx=0x7fca74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.031+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca840c83b0 con 0x7fca840b1b40 2023-10-07T09:06:30.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.254+0000 7fca88864700 1 -- 172.21.15.46:0/2047682899 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000297515", "target": ["mon-mgr", ""]}) v1 -- 0x7fca840c7d10 con 0x7fca64067320 2023-10-07T09:06:30.257 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:06:30.256+0000 7f470fd46700 -1 mgr.server reply reply (1) Operation not permitted WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-07T09:06:30.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.256+0000 7fca7affd700 1 -- 172.21.15.46:0/2047682899 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: -1 WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue.) v1 ==== 283+0+0 (secure 0 0 0) 0x7fca7400bdd0 con 0x7fca64067320 2023-10-07T09:06:30.259 INFO:teuthology.orchestra.run.smithi046.stderr:Error EPERM: WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-07T09:06:30.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:06:30.262 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:06:30.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:30.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:30.339 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:06:30.340 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:06:30.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:30.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:30.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:06:30.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:30.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:06:30.435 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:06:30.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:30.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:30.480 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:06:30.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:30.480 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:06:30.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:30.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.656+0000 7feeacbe6700 1 Processor -- start 2023-10-07T09:06:30.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.656+0000 7feeacbe6700 1 -- start start 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feeacbe6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feea81597f0 0x7feea80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feeacbe6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feea815d230 0x7feea815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feeacbe6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea815db70 con 0x7feea8159420 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feeacbe6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80b11d0 con 0x7feea815d230 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feeacbe6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80b14b0 con 0x7feea81597f0 2023-10-07T09:06:30.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feea815d230 0x7feea815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feea815d230 0x7feea815d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50452/0 (socket says 172.21.15.46:50452) 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 -- 172.21.15.46:0/3595207816 learned_addr learned my addr 172.21.15.46:0/3595207816 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea6ffd700 1 --2- 172.21.15.46:0/3595207816 >> v2:172.21.15.133:3300/0 conn(0x7feea81597f0 0x7feea80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 -- 172.21.15.46:0/3595207816 >> v2:172.21.15.133:3300/0 conn(0x7feea81597f0 msgr2=0x7feea80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 --2- 172.21.15.46:0/3595207816 >> v2:172.21.15.133:3300/0 conn(0x7feea81597f0 0x7feea80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 -- 172.21.15.46:0/3595207816 >> v1:172.21.15.133:6789/0 conn(0x7feea8159420 legacy=0x7feea80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.657+0000 7feea7fff700 1 -- 172.21.15.46:0/3595207816 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80b1790 con 0x7feea815d230 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feea7fff700 1 --2- 172.21.15.46:0/3595207816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea815d230 0x7feea815d630 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7feea8089750 tx=0x7feea0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4569f2f74821867 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feea67fc700 1 -- 172.21.15.46:0/3595207816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000e070 con 0x7feea815d230 2023-10-07T09:06:30.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feea67fc700 1 -- 172.21.15.46:0/3595207816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000ba50 con 0x7feea815d230 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feea67fc700 1 -- 172.21.15.46:0/3595207816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00092e0 con 0x7feea815d230 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 -- 172.21.15.46:0/3595207816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea815d230 msgr2=0x7feea815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 --2- 172.21.15.46:0/3595207816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea815d230 0x7feea815d630 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7feea8089750 tx=0x7feea0009840 comp rx=0 tx=0).stop 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 -- 172.21.15.46:0/3595207816 shutdown_connections 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 --2- 172.21.15.46:0/3595207816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea815d230 0x7feea815d630 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 --2- 172.21.15.46:0/3595207816 >> v2:172.21.15.133:3300/0 conn(0x7feea81597f0 0x7feea80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 -- 172.21.15.46:0/3595207816 >> 172.21.15.46:0/3595207816 conn(0x7feea80d0660 msgr2=0x7feea80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 -- 172.21.15.46:0/3595207816 shutdown_connections 2023-10-07T09:06:30.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.658+0000 7feeacbe6700 1 -- 172.21.15.46:0/3595207816 wait complete. 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 Processor -- start 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 -- start start 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea81597f0 0x7feea80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 0x7feea8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c5da0 con 0x7feea8159420 2023-10-07T09:06:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c6080 con 0x7feea815d230 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feeacbe6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c6360 con 0x7feea81597f0 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.660+0000 7feea77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50458/0 (socket says 172.21.15.46:50458) 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 -- 172.21.15.46:0/1979742519 learned_addr learned my addr 172.21.15.46:0/1979742519 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea6ffd700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea81597f0 0x7feea80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea7fff700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 0x7feea8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 -- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea81597f0 msgr2=0x7feea80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea81597f0 0x7feea80c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 -- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 msgr2=0x7feea8155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 0x7feea8155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 -- 172.21.15.46:0/1979742519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009ae0 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea7fff700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 0x7feea8155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feea77fe700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fee9800c590 tx=0x7fee9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98011590 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980116f0 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea815ac70 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98011ab0 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.661+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea8149520 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.662+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea804c3c0 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.663+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fee9801b3b0 con 0x7feea8159420 2023-10-07T09:06:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.663+0000 7fee8f7fe700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 0x7fee940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.664+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee98084640 con 0x7feea8159420 2023-10-07T09:06:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.664+0000 7feea6ffd700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 0x7fee940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.664+0000 7feea6ffd700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 0x7fee940697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feea80af620 tx=0x7fee9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.667+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee98051350 con 0x7feea8159420 2023-10-07T09:06:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.906+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feea80b1a70 con 0x7feea8159420 2023-10-07T09:06:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.907+0000 7fee8f7fe700 1 -- 172.21.15.46:0/1979742519 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fee98017090 con 0x7feea8159420 2023-10-07T09:06:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:30.909 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:30.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 msgr2=0x7fee940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 0x7fee940697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feea80af620 tx=0x7fee9c008040 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 msgr2=0x7feea8148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fee9800c590 tx=0x7fee9800c950 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 shutdown_connections 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee94067320 0x7fee940697d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feea815d230 0x7feea8155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feea8159420 0x7feea8148fe0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 --2- 172.21.15.46:0/1979742519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feea81597f0 0x7feea80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 >> 172.21.15.46:0/1979742519 conn(0x7feea80d0660 msgr2=0x7feea8158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 shutdown_connections 2023-10-07T09:06:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:30.909+0000 7feeacbe6700 1 -- 172.21.15.46:0/1979742519 wait complete. 2023-10-07T09:06:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 103 2023-10-07T09:06:30.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:31.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.039+0000 7f590d1b8700 1 Processor -- start 2023-10-07T09:06:31.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.039+0000 7f590d1b8700 1 -- start start 2023-10-07T09:06:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590d1b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5908159c60 0x7f590815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590d1b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590d1b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590815a160 con 0x7f5908159890 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590d1b8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590815df50 con 0x7f5908159c60 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590d1b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080d13a0 con 0x7f590815db10 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5908159c60 0x7f590815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5908159c60 0x7f590815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50462/0 (socket says 172.21.15.46:50462) 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.040+0000 7f590659c700 1 -- 172.21.15.46:0/822228426 learned_addr learned my addr 172.21.15.46:0/822228426 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590759e700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590659c700 1 -- 172.21.15.46:0/822228426 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 msgr2=0x7f5908069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590659c700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590659c700 1 -- 172.21.15.46:0/822228426 >> v1:172.21.15.133:6789/0 conn(0x7f5908159890 legacy=0x7f590815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590659c700 1 -- 172.21.15.46:0/822228426 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590815e140 con 0x7f5908159c60 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590659c700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f590815d5d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f58f00099b0 tx=0x7f58f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98137e58ef4c7843 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f5905d9b700 1 -- 172.21.15.46:0/822228426 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000b820 con 0x7f5908159c60 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f5905d9b700 1 -- 172.21.15.46:0/822228426 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000b980 con 0x7f5908159c60 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f5905d9b700 1 -- 172.21.15.46:0/822228426 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000bd20 con 0x7f5908159c60 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 -- 172.21.15.46:0/822228426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 msgr2=0x7f590815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f590815d5d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f58f00099b0 tx=0x7f58f0009250 comp rx=0 tx=0).stop 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 -- 172.21.15.46:0/822228426 shutdown_connections 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 --2- 172.21.15.46:0/822228426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f590815d5d0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.041+0000 7f590d1b8700 1 -- 172.21.15.46:0/822228426 >> 172.21.15.46:0/822228426 conn(0x7f5908068e20 msgr2=0x7f59080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.042+0000 7f590d1b8700 1 -- 172.21.15.46:0/822228426 shutdown_connections 2023-10-07T09:06:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.042+0000 7f590d1b8700 1 -- 172.21.15.46:0/822228426 wait complete. 2023-10-07T09:06:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 Processor -- start 2023-10-07T09:06:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 -- start start 2023-10-07T09:06:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 0x7f59080b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080ce140 con 0x7f5908159c60 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080cd770 con 0x7f5908159890 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.043+0000 7f590d1b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080cd160 con 0x7f590815db10 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50470/0 (socket says 172.21.15.46:50470) 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 -- 172.21.15.46:0/503444030 learned_addr learned my addr 172.21.15.46:0/503444030 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590759e700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f5906d9d700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 0x7f59080b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 -- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 msgr2=0x7f5908153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 -- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 msgr2=0x7f59080b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 0x7f59080b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 -- 172.21.15.46:0/503444030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00094f0 con 0x7f5908159c60 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f5906d9d700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 0x7f59080b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590659c700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009290 tx=0x7f58f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0011d90 con 0x7f5908159c60 2023-10-07T09:06:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0020070 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f001b6a0 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080cfbc0 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.044+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59080cfea0 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.045+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080cd8e0 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.046+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f58f0022030 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.046+0000 7f58feffd700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 0x7f58e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.046+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58f0086ac0 con 0x7f5908159c60 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.046+0000 7f5906d9d700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 0x7f58e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.047+0000 7f5906d9d700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 0x7f58e80697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f58f8002880 tx=0x7f58f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.050+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58f0053860 con 0x7f5908159c60 2023-10-07T09:06:31.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.246+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59080cd8e0 con 0x7f5908159c60 2023-10-07T09:06:31.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.246+0000 7f58feffd700 1 -- 172.21.15.46:0/503444030 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f58f0056e80 con 0x7f5908159c60 2023-10-07T09:06:31.248 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:31.248 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":153,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:20.936059+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:31.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 msgr2=0x7f58e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 0x7f58e80697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f58f8002880 tx=0x7f58f8009040 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 msgr2=0x7f59080cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009290 tx=0x7f58f0016000 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 shutdown_connections 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58e8067320 0x7f58e80697d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f590815db10 0x7f5908153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908159890 0x7f59080b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 --2- 172.21.15.46:0/503444030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5908159c60 0x7f59080cdc00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 >> 172.21.15.46:0/503444030 conn(0x7f5908068e20 msgr2=0x7f5908158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 shutdown_connections 2023-10-07T09:06:31.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.249+0000 7f590d1b8700 1 -- 172.21.15.46:0/503444030 wait complete. 2023-10-07T09:06:31.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:06:18.021534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:06:18.587494+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:06:31.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:06:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.383+0000 7fc039027700 1 Processor -- start 2023-10-07T09:06:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.383+0000 7fc039027700 1 -- start start 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc039027700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03406bcd0 0x7fc0340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc039027700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc03406c0a0 0x7fc03415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc039027700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03415d7e0 con 0x7fc03415df50 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc039027700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03415dac0 con 0x7fc03406c0a0 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc039027700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03415aa30 con 0x7fc03406bcd0 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc03259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc03406c0a0 0x7fc03415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc03259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc03406c0a0 0x7fc03415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50476/0 (socket says 172.21.15.46:50476) 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc03259c700 1 -- 172.21.15.46:0/2446470670 learned_addr learned my addr 172.21.15.46:0/2446470670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.384+0000 7fc032d9d700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03406bcd0 0x7fc0340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc03259c700 1 -- 172.21.15.46:0/2446470670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03406bcd0 msgr2=0x7fc0340caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc03259c700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03406bcd0 0x7fc0340caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc03259c700 1 -- 172.21.15.46:0/2446470670 >> v1:172.21.15.133:6789/0 conn(0x7fc03415df50 legacy=0x7fc0340c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc03259c700 1 -- 172.21.15.46:0/2446470670 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03415ad10 con 0x7fc03406c0a0 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc031d9b700 1 -- 172.21.15.46:0/2446470670 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750827642 0 0) 0x7fc03415d7e0 con 0x7fc03415df50 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc03259c700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406c0a0 0x7fc03415a1e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213d75968ef0a666 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc031d9b700 1 -- 172.21.15.46:0/2446470670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c009ea0 con 0x7fc03406c0a0 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc031d9b700 1 -- 172.21.15.46:0/2446470670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00b860 con 0x7fc03406c0a0 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.385+0000 7fc031d9b700 1 -- 172.21.15.46:0/2446470670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00bc20 con 0x7fc03406c0a0 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 -- 172.21.15.46:0/2446470670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406c0a0 msgr2=0x7fc03415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406c0a0 0x7fc03415a1e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c009250 comp rx=0 tx=0).stop 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 -- 172.21.15.46:0/2446470670 shutdown_connections 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03406bcd0 0x7fc0340caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 --2- 172.21.15.46:0/2446470670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406c0a0 0x7fc03415a1e0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 -- 172.21.15.46:0/2446470670 >> 172.21.15.46:0/2446470670 conn(0x7fc0340ce600 msgr2=0x7fc0340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 -- 172.21.15.46:0/2446470670 shutdown_connections 2023-10-07T09:06:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.386+0000 7fc039027700 1 -- 172.21.15.46:0/2446470670 wait complete. 2023-10-07T09:06:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.387+0000 7fc039027700 1 Processor -- start 2023-10-07T09:06:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.387+0000 7fc039027700 1 -- start start 2023-10-07T09:06:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03406c0a0 0x7fc034158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 0x7fc0340c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034159bb0 con 0x7fc03406bcd0 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340b3650 con 0x7fc03406c0a0 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc039027700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340b2a40 con 0x7fc03415df50 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50482/0 (socket says 172.21.15.46:50482) 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 -- 172.21.15.46:0/3295078019 learned_addr learned my addr 172.21.15.46:0/3295078019 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc03359e700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 0x7fc0340c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc03259c700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03406c0a0 0x7fc034158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 -- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 msgr2=0x7fc0340c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 0x7fc0340c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 -- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03406c0a0 msgr2=0x7fc034158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03406c0a0 0x7fc034158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 -- 172.21.15.46:0/3295078019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0094f0 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc03359e700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 0x7fc0340c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc032d9d700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e930 tx=0x7fc0240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.388+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400eed0 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.389+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02400c850 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.389+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0340b2d20 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.389+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cbf0 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.389+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0340b32e0 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.389+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03414c8a0 con 0x7fc03406bcd0 2023-10-07T09:06:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.390+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc024013470 con 0x7fc03406bcd0 2023-10-07T09:06:31.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.390+0000 7fc02affd700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 0x7fc0140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.390+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc024084ee0 con 0x7fc03406bcd0 2023-10-07T09:06:31.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.391+0000 7fc03259c700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 0x7fc0140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.391+0000 7fc03259c700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 0x7fc0140697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.395+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc024051b70 con 0x7fc03406bcd0 2023-10-07T09:06:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.585+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc03404c3c0 con 0x7fc03406bcd0 2023-10-07T09:06:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.586+0000 7fc02affd700 1 -- 172.21.15.46:0/3295078019 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc024055190 con 0x7fc03406bcd0 2023-10-07T09:06:31.588 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:06:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.587+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 msgr2=0x7fc0140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.587+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 0x7fc0140697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.587+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 msgr2=0x7fc03414c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.587+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e930 tx=0x7fc0240091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 shutdown_connections 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc014067320 0x7fc0140697d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc03415df50 0x7fc0340c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc03406bcd0 0x7fc03414c2a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 --2- 172.21.15.46:0/3295078019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03406c0a0 0x7fc034158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 >> 172.21.15.46:0/3295078019 conn(0x7fc0340ce600 msgr2=0x7fc03415c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 shutdown_connections 2023-10-07T09:06:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.588+0000 7fc039027700 1 -- 172.21.15.46:0/3295078019 wait complete. 2023-10-07T09:06:31.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:06:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.721+0000 7f3a4d635700 1 Processor -- start 2023-10-07T09:06:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.721+0000 7f3a4d635700 1 -- start start 2023-10-07T09:06:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a4d635700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a48159890 0x7f3a4815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a4d635700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4815a160 con 0x7f3a48069560 2023-10-07T09:06:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a4d635700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480d13a0 con 0x7f3a48159c60 2023-10-07T09:06:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a4d635700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4815e140 con 0x7f3a48159890 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a477fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3a48069560 0x7f3a480ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33496/0 (socket says 172.21.15.46:33496) 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a477fe700 1 -- 172.21.15.46:0/4132106285 learned_addr learned my addr 172.21.15.46:0/4132106285 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/4132106285 >> v2:172.21.15.133:3300/0 conn(0x7f3a48159890 0x7f3a4815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471341196 0 0) 0x7f3a4815a160 con 0x7f3a48069560 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.722+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a30003570 con 0x7f3a48069560 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330244372 0 0) 0x7f3a480d13a0 con 0x7f3a48159c60 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a4815a160 con 0x7f3a48159c60 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212309324 0 0) 0x7f3a30003570 con 0x7f3a48069560 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 >> v2:172.21.15.133:3300/0 conn(0x7f3a48159890 msgr2=0x7f3a4815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 --2- 172.21.15.46:0/4132106285 >> v2:172.21.15.133:3300/0 conn(0x7f3a48159890 0x7f3a4815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 >> v1:172.21.15.133:6789/0 conn(0x7f3a48159c60 legacy=0x7f3a4815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4815a3d0 con 0x7f3a48069560 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f3a400017f0 con 0x7f3a48069560 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 >> v1:172.21.15.46:6789/0 conn(0x7f3a48069560 legacy=0x7f3a480ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 0x7f3a30003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a30004810 0x7f3a30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a300051c0 0x7f3a3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4815e140 con 0x7f3a30003bf0 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3000c050 con 0x7f3a30004810 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3000c210 con 0x7f3a300051c0 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 0x7f3a30003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a467fc700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a30004810 0x7f3a30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a477fe700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a300051c0 0x7f3a3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 -- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a300051c0 msgr2=0x7f3a3000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a300051c0 0x7f3a3000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 -- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a30004810 msgr2=0x7f3a30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a30004810 0x7f3a30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a477fe700 1 -- 172.21.15.46:0/4132106285 reap_dead start 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 -- 172.21.15.46:0/4132106285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30003570 con 0x7f3a30003bf0 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 0x7f3a30003fc0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009c00 tx=0x7f3a380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feede937ef20e9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800e710 con 0x7f3a30003bf0 2023-10-07T09:06:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800e870 con 0x7f3a30003bf0 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.723+0000 7f3a45ffb700 1 -- 172.21.15.46:0/4132106285 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800ec30 con 0x7f3a30003bf0 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 -- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 msgr2=0x7f3a30003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 0x7f3a30003fc0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009c00 tx=0x7f3a380091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 -- 172.21.15.46:0/4132106285 shutdown_connections 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 --2- 172.21.15.46:0/4132106285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a30003bf0 0x7f3a30003fc0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 -- 172.21.15.46:0/4132106285 >> 172.21.15.46:0/4132106285 conn(0x7f3a48068e20 msgr2=0x7f3a480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 -- 172.21.15.46:0/4132106285 shutdown_connections 2023-10-07T09:06:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.724+0000 7f3a4d635700 1 -- 172.21.15.46:0/4132106285 wait complete. 2023-10-07T09:06:31.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.725+0000 7f3a4d635700 1 Processor -- start 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.725+0000 7f3a4d635700 1 -- start start 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 0x7f3a480c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 0x7f3a480cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480cdaa0 con 0x7f3a480cfba0 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480b3590 con 0x7f3a480cd0c0 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a4d635700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480c83d0 con 0x7f3a30003bf0 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50496/0 (socket says 172.21.15.46:50496) 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 -- 172.21.15.46:0/666441812 learned_addr learned my addr 172.21.15.46:0/666441812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a477fe700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 0x7f3a480cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 0x7f3a480c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 -- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 msgr2=0x7f3a480c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 0x7f3a480c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 -- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 msgr2=0x7f3a480cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 0x7f3a480cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a467fc700 1 -- 172.21.15.46:0/666441812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a480c9210 con 0x7f3a480cfba0 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a477fe700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 0x7f3a480cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.726+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 0x7f3a480c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a467fc700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e690 tx=0x7f3a3c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c012590 con 0x7f3a480cfba0 2023-10-07T09:06:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c0126f0 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a480c8600 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c012ab0 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.727+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a480c8bc0 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.728+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a480c93a0 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.728+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3a3c01d460 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.729+0000 7f3a2effd700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 0x7f3a340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.729+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a3c084f60 con 0x7f3a480cfba0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.729+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 0x7f3a340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.729+0000 7f3a46ffd700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 0x7f3a340697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3a380099c0 tx=0x7f3a3801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.733+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a3c051bf0 con 0x7f3a480cfba0 2023-10-07T09:06:31.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.925+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a4804c3c0 con 0x7f3a480cfba0 2023-10-07T09:06:31.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.925+0000 7f3a2effd700 1 -- 172.21.15.46:0/666441812 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a3c055210 con 0x7f3a480cfba0 2023-10-07T09:06:31.927 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 msgr2=0x7f3a340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 0x7f3a340697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3a380099c0 tx=0x7f3a3801a000 comp rx=0 tx=0).stop 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 msgr2=0x7f3a48141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e690 tx=0x7f3a3c009040 comp rx=0 tx=0).stop 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 shutdown_connections 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3a34067320 0x7f3a340697d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a480cd0c0 0x7f3a480cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a30003bf0 0x7f3a480c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 --2- 172.21.15.46:0/666441812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a480cfba0 0x7f3a48141100 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 >> 172.21.15.46:0/666441812 conn(0x7f3a48068e20 msgr2=0x7f3a48152400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 shutdown_connections 2023-10-07T09:06:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:31.927+0000 7f3a4d635700 1 -- 172.21.15.46:0/666441812 wait complete. 2023-10-07T09:06:31.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:06:32.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.061+0000 7f2ec9c33700 1 Processor -- start 2023-10-07T09:06:32.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.061+0000 7f2ec9c33700 1 -- start start 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.061+0000 7f2ec9c33700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ec4159c60 0x7f2ec415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec9c33700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ec415db10 0x7f2ec4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec9c33700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec415a160 con 0x7f2ec4159890 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec9c33700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec415df50 con 0x7f2ec4159c60 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec9c33700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40d13a0 con 0x7f2ec415db10 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ec4159c60 0x7f2ec415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ec4159c60 0x7f2ec415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50504/0 (socket says 172.21.15.46:50504) 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/2199318827 learned_addr learned my addr 172.21.15.46:0/2199318827 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:32.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec3fff700 1 --2- 172.21.15.46:0/2199318827 >> v2:172.21.15.133:3300/0 conn(0x7f2ec415db10 0x7f2ec4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/2199318827 >> v2:172.21.15.133:3300/0 conn(0x7f2ec415db10 msgr2=0x7f2ec4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 --2- 172.21.15.46:0/2199318827 >> v2:172.21.15.133:3300/0 conn(0x7f2ec415db10 0x7f2ec4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/2199318827 >> v1:172.21.15.133:6789/0 conn(0x7f2ec4159890 legacy=0x7f2ec415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/2199318827 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec415e140 con 0x7f2ec4159c60 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec2ffd700 1 --2- 172.21.15.46:0/2199318827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415d5d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406a890 tx=0x7f2eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e244bdf296c8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec27fc700 1 -- 172.21.15.46:0/2199318827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800b860 con 0x7f2ec4159c60 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec27fc700 1 -- 172.21.15.46:0/2199318827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb800b9c0 con 0x7f2ec4159c60 2023-10-07T09:06:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.062+0000 7f2ec27fc700 1 -- 172.21.15.46:0/2199318827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800bd60 con 0x7f2ec4159c60 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 -- 172.21.15.46:0/2199318827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 msgr2=0x7f2ec415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/2199318827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415d5d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406a890 tx=0x7f2eb8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 -- 172.21.15.46:0/2199318827 shutdown_connections 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/2199318827 >> v2:172.21.15.133:3300/0 conn(0x7f2ec415db10 0x7f2ec4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/2199318827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415d5d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 -- 172.21.15.46:0/2199318827 >> 172.21.15.46:0/2199318827 conn(0x7f2ec4068e20 msgr2=0x7f2ec40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 -- 172.21.15.46:0/2199318827 shutdown_connections 2023-10-07T09:06:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.063+0000 7f2ec9c33700 1 -- 172.21.15.46:0/2199318827 wait complete. 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.064+0000 7f2ec9c33700 1 Processor -- start 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.064+0000 7f2ec9c33700 1 -- start start 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ec4159890 0x7f2ec41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec415db10 0x7f2ec415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4169ed0 con 0x7f2ec4159c60 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec416a1b0 con 0x7f2ec415db10 2023-10-07T09:06:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec9c33700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec416a490 con 0x7f2ec4159890 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50516/0 (socket says 172.21.15.46:50516) 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/706273713 learned_addr learned my addr 172.21.15.46:0/706273713 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec3fff700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec415db10 0x7f2ec415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec37fe700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ec4159890 0x7f2ec41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ec4159890 msgr2=0x7f2ec41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ec4159890 0x7f2ec41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec415db10 msgr2=0x7f2ec415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec415db10 0x7f2ec415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.065+0000 7f2ec2ffd700 1 -- 172.21.15.46:0/706273713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80094f0 con 0x7f2ec4159c60 2023-10-07T09:06:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2ec2ffd700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4070e20 tx=0x7f2eb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8024440 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb80245a0 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec416a770 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8024960 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.066+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec4169b80 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.067+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec416a9b0 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.067+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2eb801a420 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.068+0000 7f2eab7fe700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 0x7f2eb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.068+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2eb8086ae0 con 0x7f2ec4159c60 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.068+0000 7f2ec37fe700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 0x7f2eb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.068+0000 7f2ec37fe700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 0x7f2eb00697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4003a80 tx=0x7f2eb4007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.072+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec416a9b0 con 0x7f2ec4159c60 2023-10-07T09:06:32.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.266+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ec416a9b0 con 0x7f2ec4159c60 2023-10-07T09:06:32.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.266+0000 7f2eab7fe700 1 -- 172.21.15.46:0/706273713 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ec416a9b0 con 0x7f2ec4159c60 2023-10-07T09:06:32.268 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 msgr2=0x7f2eb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 0x7f2eb00697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4003a80 tx=0x7f2eb4007ec0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 msgr2=0x7f2ec415cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4070e20 tx=0x7f2eb8017000 comp rx=0 tx=0).stop 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 shutdown_connections 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2eb0067320 0x7f2eb00697d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec415db10 0x7f2ec415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ec4159890 0x7f2ec41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 --2- 172.21.15.46:0/706273713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec4159c60 0x7f2ec415cf40 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.268+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 >> 172.21.15.46:0/706273713 conn(0x7f2ec4068e20 msgr2=0x7f2ec40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.269+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 shutdown_connections 2023-10-07T09:06:32.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.269+0000 7f2ec9c33700 1 -- 172.21.15.46:0/706273713 wait complete. 2023-10-07T09:06:32.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:32.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.400+0000 7fe3631d5700 1 Processor -- start 2023-10-07T09:06:32.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.400+0000 7fe3631d5700 1 -- start start 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe3631d5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe35c159890 0x7fe35c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe3631d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe35c159c60 0x7fe35c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe3631d5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c15a160 con 0x7fe35c15db10 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe3631d5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c15df50 con 0x7fe35c159890 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe3631d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c0d13a0 con 0x7fe35c159c60 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe35c159890 0x7fe35c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe361772700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe35c15db10 0x7fe35c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33500/0 (socket says 172.21.15.46:33500) 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe361772700 1 -- 172.21.15.46:0/3326075698 learned_addr learned my addr 172.21.15.46:0/3326075698 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe35bfff700 1 --2- 172.21.15.46:0/3326075698 >> v2:172.21.15.133:3300/0 conn(0x7fe35c159c60 0x7fe35c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 -- 172.21.15.46:0/3326075698 >> v2:172.21.15.133:3300/0 conn(0x7fe35c159c60 msgr2=0x7fe35c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 --2- 172.21.15.46:0/3326075698 >> v2:172.21.15.133:3300/0 conn(0x7fe35c159c60 0x7fe35c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 -- 172.21.15.46:0/3326075698 >> v1:172.21.15.46:6789/0 conn(0x7fe35c15db10 legacy=0x7fe35c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 -- 172.21.15.46:0/3326075698 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c15e140 con 0x7fe35c159890 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe35b7fe700 1 -- 172.21.15.46:0/3326075698 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652073825 0 0) 0x7fe35c15a160 con 0x7fe35c15db10 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe360f71700 1 --2- 172.21.15.46:0/3326075698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159890 0x7fe35c15abd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b67f0 tx=0x7fe3500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed691591667e631 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.401+0000 7fe35b7fe700 1 -- 172.21.15.46:0/3326075698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000b6b0 con 0x7fe35c159890 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe35b7fe700 1 -- 172.21.15.46:0/3326075698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000b810 con 0x7fe35c159890 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe35b7fe700 1 -- 172.21.15.46:0/3326075698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000bbb0 con 0x7fe35c159890 2023-10-07T09:06:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 -- 172.21.15.46:0/3326075698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159890 msgr2=0x7fe35c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3326075698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159890 0x7fe35c15abd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b67f0 tx=0x7fe3500091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 -- 172.21.15.46:0/3326075698 shutdown_connections 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3326075698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159890 0x7fe35c15abd0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3326075698 >> v2:172.21.15.133:3300/0 conn(0x7fe35c159c60 0x7fe35c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 -- 172.21.15.46:0/3326075698 >> 172.21.15.46:0/3326075698 conn(0x7fe35c068e20 msgr2=0x7fe35c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 -- 172.21.15.46:0/3326075698 shutdown_connections 2023-10-07T09:06:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.402+0000 7fe3631d5700 1 -- 172.21.15.46:0/3326075698 wait complete. 2023-10-07T09:06:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.403+0000 7fe3631d5700 1 Processor -- start 2023-10-07T09:06:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.403+0000 7fe3631d5700 1 -- start start 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe35c159890 0x7fe35c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 0x7fe35c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0cf3c0 con 0x7fe35c159c60 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0cf6a0 con 0x7fe35c15db10 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe3631d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0cf980 con 0x7fe35c159890 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50546/0 (socket says 172.21.15.46:50546) 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 -- 172.21.15.46:0/3270481578 learned_addr learned my addr 172.21.15.46:0/3270481578 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe361772700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 0x7fe35c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe360f71700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe35c159890 0x7fe35c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 -- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe35c159890 msgr2=0x7fe35c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe35c159890 0x7fe35c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 -- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 msgr2=0x7fe35c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 0x7fe35c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe35bfff700 1 -- 172.21.15.46:0/3270481578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009420 con 0x7fe35c159c60 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.404+0000 7fe361772700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 0x7fe35c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe35bfff700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe34800c7d0 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348011600 con 0x7fe35c159c60 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348011760 con 0x7fe35c159c60 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c0cfc60 con 0x7fe35c159c60 2023-10-07T09:06:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348011b20 con 0x7fe35c159c60 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.405+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c16a710 con 0x7fe35c159c60 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.406+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c0b3620 con 0x7fe35c159c60 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.406+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe3480193f0 con 0x7fe35c159c60 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.407+0000 7fe358ff9700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 0x7fe3400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.407+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3480851d0 con 0x7fe35c159c60 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.407+0000 7fe360f71700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 0x7fe3400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.408+0000 7fe360f71700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 0x7fe3400697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe3500093f0 tx=0x7fe350017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.411+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe35c0b3620 con 0x7fe35c159c60 2023-10-07T09:06:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.648+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe35c0b3620 con 0x7fe35c159c60 2023-10-07T09:06:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.648+0000 7fe358ff9700 1 -- 172.21.15.46:0/3270481578 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fe35c0b3620 con 0x7fe35c159c60 2023-10-07T09:06:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 msgr2=0x7fe3400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 0x7fe3400697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe3500093f0 tx=0x7fe350017000 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 msgr2=0x7fe35c16a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe34800c7d0 tx=0x7fe348008040 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 shutdown_connections 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe340067320 0x7fe3400697d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35c15db10 0x7fe35c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe35c159890 0x7fe35c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 --2- 172.21.15.46:0/3270481578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe35c159c60 0x7fe35c16a1d0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.650+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 >> 172.21.15.46:0/3270481578 conn(0x7fe35c068e20 msgr2=0x7fe35c1584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.651+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 shutdown_connections 2023-10-07T09:06:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.651+0000 7fe3631d5700 1 -- 172.21.15.46:0/3270481578 wait complete. 2023-10-07T09:06:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 103 2023-10-07T09:06:32.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.781+0000 7fb24de53700 1 Processor -- start 2023-10-07T09:06:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.782+0000 7fb24de53700 1 -- start start 2023-10-07T09:06:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.782+0000 7fb24de53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb24806c0a0 0x7fb2480caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.782+0000 7fb24de53700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24815d7e0 con 0x7fb24815df50 2023-10-07T09:06:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.782+0000 7fb24de53700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24815dac0 con 0x7fb24806bcd0 2023-10-07T09:06:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.782+0000 7fb24de53700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24815aa30 con 0x7fb24806c0a0 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb247fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb24815df50 0x7fb2480c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33514/0 (socket says 172.21.15.46:33514) 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb247fff700 1 -- 172.21.15.46:0/193776161 learned_addr learned my addr 172.21.15.46:0/193776161 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb246ffd700 1 --2- 172.21.15.46:0/193776161 >> v2:172.21.15.133:3300/0 conn(0x7fb24806c0a0 0x7fb2480caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb2467fc700 1 -- 172.21.15.46:0/193776161 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493312725 0 0) 0x7fb24815d7e0 con 0x7fb24815df50 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb2467fc700 1 -- 172.21.15.46:0/193776161 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb230003570 con 0x7fb24815df50 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb246ffd700 1 -- 172.21.15.46:0/193776161 >> v1:172.21.15.133:6789/0 conn(0x7fb24806bcd0 legacy=0x7fb24815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb246ffd700 1 -- 172.21.15.46:0/193776161 >> v1:172.21.15.46:6789/0 conn(0x7fb24815df50 legacy=0x7fb2480c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb246ffd700 1 -- 172.21.15.46:0/193776161 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24815ad10 con 0x7fb24806c0a0 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb246ffd700 1 --2- 172.21.15.46:0/193776161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24806c0a0 0x7fb2480caa90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0098e0 tx=0x7fb23c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67feebdd0263f7cd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb2467fc700 1 -- 172.21.15.46:0/193776161 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00b640 con 0x7fb24806c0a0 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb2467fc700 1 -- 172.21.15.46:0/193776161 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00b7a0 con 0x7fb24806c0a0 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.783+0000 7fb2467fc700 1 -- 172.21.15.46:0/193776161 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00bb40 con 0x7fb24806c0a0 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 -- 172.21.15.46:0/193776161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24806c0a0 msgr2=0x7fb2480caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 --2- 172.21.15.46:0/193776161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24806c0a0 0x7fb2480caa90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0098e0 tx=0x7fb23c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 -- 172.21.15.46:0/193776161 shutdown_connections 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 --2- 172.21.15.46:0/193776161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24806c0a0 0x7fb2480caa90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 -- 172.21.15.46:0/193776161 >> 172.21.15.46:0/193776161 conn(0x7fb2480ce600 msgr2=0x7fb2480cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 -- 172.21.15.46:0/193776161 shutdown_connections 2023-10-07T09:06:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.784+0000 7fb24de53700 1 -- 172.21.15.46:0/193776161 wait complete. 2023-10-07T09:06:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.785+0000 7fb24de53700 1 Processor -- start 2023-10-07T09:06:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.785+0000 7fb24de53700 1 -- start start 2023-10-07T09:06:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 0x7fb248146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24815df50 0x7fb2480c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24816be00 con 0x7fb24806c0a0 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24816b1f0 con 0x7fb24815df50 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb24de53700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24816b4d0 con 0x7fb24806bcd0 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb246ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb246ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50550/0 (socket says 172.21.15.46:50550) 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb246ffd700 1 -- 172.21.15.46:0/3531823236 learned_addr learned my addr 172.21.15.46:0/3531823236 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb247fff700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24815df50 0x7fb2480c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.786+0000 7fb2477fe700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 0x7fb248146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 -- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 msgr2=0x7fb248146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 0x7fb248146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 -- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24815df50 msgr2=0x7fb2480c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24815df50 0x7fb2480c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 -- 172.21.15.46:0/3531823236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb24806c0a0 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb2477fe700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 0x7fb248146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb246ffd700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0093f0 tx=0x7fb23c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c000bc0 con 0x7fb24806c0a0 2023-10-07T09:06:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00b910 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24816b7b0 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c025670 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.787+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb248167ae0 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.788+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24804c3c0 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.788+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb23c023070 con 0x7fb24806c0a0 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.789+0000 7fb22f7fe700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 0x7fb2340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.789+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb23c085e60 con 0x7fb24806c0a0 2023-10-07T09:06:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.789+0000 7fb2477fe700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 0x7fb2340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.789+0000 7fb2477fe700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 0x7fb2340697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb24806de20 tx=0x7fb238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.793+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb23c052af0 con 0x7fb24806c0a0 2023-10-07T09:06:32.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.986+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb24816bf40 con 0x7fb24806c0a0 2023-10-07T09:06:32.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.987+0000 7fb22f7fe700 1 -- 172.21.15.46:0/3531823236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fb23c015090 con 0x7fb24806c0a0 2023-10-07T09:06:32.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:32.989 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":153,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:20.936059+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 msgr2=0x7fb2340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 0x7fb2340697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb24806de20 tx=0x7fb238009040 comp rx=0 tx=0).stop 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 msgr2=0x7fb2480c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0093f0 tx=0x7fb23c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 shutdown_connections 2023-10-07T09:06:32.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb234067320 0x7fb2340697d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24815df50 0x7fb2480c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb24806bcd0 0x7fb248146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 --2- 172.21.15.46:0/3531823236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24806c0a0 0x7fb2480c33a0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 >> 172.21.15.46:0/3531823236 conn(0x7fb2480ce600 msgr2=0x7fb24806a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 shutdown_connections 2023-10-07T09:06:32.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:32.989+0000 7fb24de53700 1 -- 172.21.15.46:0/3531823236 wait complete. 2023-10-07T09:06:33.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:06:33.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.121+0000 7f2213d09700 1 Processor -- start 2023-10-07T09:06:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.121+0000 7f2213d09700 1 -- start start 2023-10-07T09:06:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2213d09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0b1420 0x7f220c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2213d09700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f220c0ccf90 0x7f220c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2213d09700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0cc300 con 0x7f220c0cbf30 2023-10-07T09:06:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2213d09700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c156bf0 con 0x7f220c0ccf90 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2213d09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0ae950 con 0x7f220c0b1420 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f220c0ccf90 0x7f220c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f220c0ccf90 0x7f220c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50556/0 (socket says 172.21.15.46:50556) 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 -- 172.21.15.46:0/1388099927 learned_addr learned my addr 172.21.15.46:0/1388099927 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22112a4700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0b1420 0x7f220c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 -- 172.21.15.46:0/1388099927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0b1420 msgr2=0x7f220c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0b1420 0x7f220c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 -- 172.21.15.46:0/1388099927 >> v1:172.21.15.133:6789/0 conn(0x7f220c0cbf30 legacy=0x7f220c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 -- 172.21.15.46:0/1388099927 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0ad370 con 0x7f220c0ccf90 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f22122a6700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0ccf90 0x7f220c0c9740 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f220400bc80 tx=0x7f220400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ada1e9f20d4ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2210aa3700 1 -- 172.21.15.46:0/1388099927 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400be90 con 0x7f220c0ccf90 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2210aa3700 1 -- 172.21.15.46:0/1388099927 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400ddc0 con 0x7f220c0ccf90 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.122+0000 7f2210aa3700 1 -- 172.21.15.46:0/1388099927 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040196b0 con 0x7f220c0ccf90 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 -- 172.21.15.46:0/1388099927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0ccf90 msgr2=0x7f220c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0ccf90 0x7f220c0c9740 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f220400bc80 tx=0x7f220400b4f0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 -- 172.21.15.46:0/1388099927 shutdown_connections 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0ccf90 0x7f220c0c9740 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 --2- 172.21.15.46:0/1388099927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0b1420 0x7f220c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 -- 172.21.15.46:0/1388099927 >> 172.21.15.46:0/1388099927 conn(0x7f220c06a320 msgr2=0x7f220c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 -- 172.21.15.46:0/1388099927 shutdown_connections 2023-10-07T09:06:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.123+0000 7f2213d09700 1 -- 172.21.15.46:0/1388099927 wait complete. 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.124+0000 7f2213d09700 1 Processor -- start 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.124+0000 7f2213d09700 1 -- start start 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f220c0b1420 0x7f220c0aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0ccf90 0x7f220c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0aada0 con 0x7f220c0cbf30 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0a7820 con 0x7f220c0b1420 2023-10-07T09:06:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2213d09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0a6f80 con 0x7f220c0ccf90 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50566/0 (socket says 172.21.15.46:50566) 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 -- 172.21.15.46:0/2771327328 learned_addr learned my addr 172.21.15.46:0/2771327328 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f2211aa5700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f220c0b1420 0x7f220c0aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22122a6700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0ccf90 0x7f220c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 -- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0ccf90 msgr2=0x7f220c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0ccf90 0x7f220c06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 -- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f220c0b1420 msgr2=0x7f220c0aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.125+0000 7f22112a4700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f220c0b1420 0x7f220c0aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f22112a4700 1 -- 172.21.15.46:0/2771327328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220400b790 con 0x7f220c0cbf30 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f22112a4700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f220000d8c0 tx=0x7f2200008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000125f0 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2200012750 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c0a7260 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200012af0 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.126+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0a8040 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.127+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c0a83b0 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.127+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f220001e460 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.128+0000 7f2209ffb700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 0x7f21f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.128+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22000851b0 con 0x7f220c0cbf30 2023-10-07T09:06:33.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.128+0000 7f2211aa5700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 0x7f21f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.129+0000 7f2211aa5700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 0x7f21f80697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007fd0 tx=0x7f21fc0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.132+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22000558d0 con 0x7f220c0cbf30 2023-10-07T09:06:33.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.369+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f220c04c3c0 con 0x7f220c0cbf30 2023-10-07T09:06:33.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.369+0000 7f2209ffb700 1 -- 172.21.15.46:0/2771327328 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4600 (secure 0 0 0) 0x7f2200055460 con 0x7f220c0cbf30 2023-10-07T09:06:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:33.371 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 msgr2=0x7f21f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 0x7f21f80697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007fd0 tx=0x7f21fc0016f0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 msgr2=0x7f220c0a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f220000d8c0 tx=0x7f2200008040 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 shutdown_connections 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f21f8067320 0x7f21f80697d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f220c0ccf90 0x7f220c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f220c0b1420 0x7f220c0aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 --2- 172.21.15.46:0/2771327328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f220c0cbf30 0x7f220c0a6680 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 >> 172.21.15.46:0/2771327328 conn(0x7f220c06a320 msgr2=0x7f220c15a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 shutdown_connections 2023-10-07T09:06:33.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.372+0000 7f2213d09700 1 -- 172.21.15.46:0/2771327328 wait complete. 2023-10-07T09:06:33.375 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 103 2023-10-07T09:06:33.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:33.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.503+0000 7f8e0299c700 1 Processor -- start 2023-10-07T09:06:33.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.503+0000 7f8e0299c700 1 -- start start 2023-10-07T09:06:33.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0299c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dfc159420 0x7f8dfc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0299c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc15d230 0x7f8dfc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0299c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0b2980 con 0x7f8dfc1597f0 2023-10-07T09:06:33.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0299c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc15dbb0 con 0x7f8dfc159420 2023-10-07T09:06:33.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0299c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b11d0 con 0x7f8dfc15d230 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dfc159420 0x7f8dfc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dfc159420 0x7f8dfc0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50578/0 (socket says 172.21.15.46:50578) 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 -- 172.21.15.46:0/55822264 learned_addr learned my addr 172.21.15.46:0/55822264 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0219b700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc15d230 0x7f8dfc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 -- 172.21.15.46:0/55822264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc15d230 msgr2=0x7f8dfc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc15d230 0x7f8dfc15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 -- 172.21.15.46:0/55822264 >> v1:172.21.15.133:6789/0 conn(0x7f8dfc1597f0 legacy=0x7f8dfc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.504+0000 7f8e0199a700 1 -- 172.21.15.46:0/55822264 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0b14b0 con 0x7f8dfc159420 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0199a700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc159420 0x7f8dfc0b5f40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099b0 tx=0x7f8df4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c6786ce900f68e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e00998700 1 -- 172.21.15.46:0/55822264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400b860 con 0x7f8dfc159420 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e00998700 1 -- 172.21.15.46:0/55822264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400b9c0 con 0x7f8dfc159420 2023-10-07T09:06:33.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e00998700 1 -- 172.21.15.46:0/55822264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400bd60 con 0x7f8dfc159420 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 -- 172.21.15.46:0/55822264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc159420 msgr2=0x7f8dfc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc159420 0x7f8dfc0b5f40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099b0 tx=0x7f8df4009250 comp rx=0 tx=0).stop 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 -- 172.21.15.46:0/55822264 shutdown_connections 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc15d230 0x7f8dfc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 --2- 172.21.15.46:0/55822264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc159420 0x7f8dfc0b5f40 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 -- 172.21.15.46:0/55822264 >> 172.21.15.46:0/55822264 conn(0x7f8dfc0d0660 msgr2=0x7f8dfc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.505+0000 7f8e0299c700 1 -- 172.21.15.46:0/55822264 shutdown_connections 2023-10-07T09:06:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.506+0000 7f8e0299c700 1 -- 172.21.15.46:0/55822264 wait complete. 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 Processor -- start 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 -- start start 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 0x7f8dfc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc15d230 0x7f8dfc0cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c6ba0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c9ba0 con 0x7f8dfc15d230 2023-10-07T09:06:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e0299c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c9870 con 0x7f8dfc159420 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e01199700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e01199700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50580/0 (socket says 172.21.15.46:50580) 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.507+0000 7f8e01199700 1 -- 172.21.15.46:0/2570326821 learned_addr learned my addr 172.21.15.46:0/2570326821 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e0199a700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 0x7f8dfc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e0219b700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc15d230 0x7f8dfc0cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 -- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 msgr2=0x7f8dfc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 0x7f8dfc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 -- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc15d230 msgr2=0x7f8dfc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc15d230 0x7f8dfc0cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 -- 172.21.15.46:0/2570326821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40094f0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e0199a700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 0x7f8dfc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:33.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e01199700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c7f0 tx=0x7f8df0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011590 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0011710 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc0c6300 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011ad0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.508+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc0c68c0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.509+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc04c3c0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.510+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8df001b3b0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.510+0000 7f8df9ffb700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.510+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8df0084120 con 0x7f8dfc1597f0 2023-10-07T09:06:33.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.510+0000 7f8e0199a700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.511+0000 7f8e0199a700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 0x7f8de80697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099b0 tx=0x7f8df4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.514+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8df0050db0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.751+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dfc0c9ce0 con 0x7f8dfc1597f0 2023-10-07T09:06:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.751+0000 7f8df9ffb700 1 -- 172.21.15.46:0/2570326821 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4600 (secure 0 0 0) 0x7f8df0017090 con 0x7f8dfc1597f0 2023-10-07T09:06:33.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:33.754 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:19.618312+0000","modified":"2023-10-07T09:06:23.230643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7914":{"gid":7914,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2926043182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2926043182},{"type":"v1","addr":"172.21.15.133:6837","nonce":2926043182}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 msgr2=0x7f8de80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 0x7f8de80697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099b0 tx=0x7f8df4017000 comp rx=0 tx=0).stop 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 msgr2=0x7f8dfc0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c7f0 tx=0x7f8df0007f50 comp rx=0 tx=0).stop 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 shutdown_connections 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc15d230 0x7f8dfc0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8dfc159420 0x7f8dfc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 --2- 172.21.15.46:0/2570326821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dfc1597f0 0x7f8dfc0cf950 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 >> 172.21.15.46:0/2570326821 conn(0x7f8dfc0d0660 msgr2=0x7f8dfc156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 shutdown_connections 2023-10-07T09:06:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.754+0000 7f8e0299c700 1 -- 172.21.15.46:0/2570326821 wait complete. 2023-10-07T09:06:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 103 2023-10-07T09:06:33.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:33.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.885+0000 7fd4f36c3700 1 Processor -- start 2023-10-07T09:06:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.885+0000 7fd4f36c3700 1 -- start start 2023-10-07T09:06:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f36c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4ec159890 0x7fd4ec15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f36c3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4ec069560 0x7fd4ec0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f36c3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec069ee0 con 0x7fd4ec159c60 2023-10-07T09:06:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f36c3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec15a160 con 0x7fd4ec069560 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f36c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0d13a0 con 0x7fd4ec159890 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f1c60700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4ec069560 0x7fd4ec0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f0c5e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd4ec159c60 0x7fd4ec15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33530/0 (socket says 172.21.15.46:33530) 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f0c5e700 1 -- 172.21.15.46:0/2697002172 learned_addr learned my addr 172.21.15.46:0/2697002172 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f145f700 1 --2- 172.21.15.46:0/2697002172 >> v2:172.21.15.133:3300/0 conn(0x7fd4ec159890 0x7fd4ec15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4e3fff700 1 -- 172.21.15.46:0/2697002172 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317498459 0 0) 0x7fd4ec069ee0 con 0x7fd4ec159c60 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4e3fff700 1 -- 172.21.15.46:0/2697002172 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d8003570 con 0x7fd4ec159c60 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f1c60700 1 -- 172.21.15.46:0/2697002172 >> v2:172.21.15.133:3300/0 conn(0x7fd4ec159890 msgr2=0x7fd4ec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f1c60700 1 --2- 172.21.15.46:0/2697002172 >> v2:172.21.15.133:3300/0 conn(0x7fd4ec159890 0x7fd4ec15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.886+0000 7fd4f1c60700 1 -- 172.21.15.46:0/2697002172 >> v1:172.21.15.46:6789/0 conn(0x7fd4ec159c60 legacy=0x7fd4ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f1c60700 1 -- 172.21.15.46:0/2697002172 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec15e140 con 0x7fd4ec069560 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f1c60700 1 --2- 172.21.15.46:0/2697002172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0699a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0d1090 tx=0x7fd4e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dad2b6ab16a119 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4e3fff700 1 -- 172.21.15.46:0/2697002172 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400e070 con 0x7fd4ec069560 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4e3fff700 1 -- 172.21.15.46:0/2697002172 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400bab0 con 0x7fd4ec069560 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4e3fff700 1 -- 172.21.15.46:0/2697002172 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400be70 con 0x7fd4ec069560 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 -- 172.21.15.46:0/2697002172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 msgr2=0x7fd4ec0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/2697002172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0699a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0d1090 tx=0x7fd4e4009780 comp rx=0 tx=0).stop 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 -- 172.21.15.46:0/2697002172 shutdown_connections 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/2697002172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0699a0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/2697002172 >> v2:172.21.15.133:3300/0 conn(0x7fd4ec159890 0x7fd4ec15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.887+0000 7fd4f36c3700 1 -- 172.21.15.46:0/2697002172 >> 172.21.15.46:0/2697002172 conn(0x7fd4ec068e20 msgr2=0x7fd4ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:33.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.888+0000 7fd4f36c3700 1 -- 172.21.15.46:0/2697002172 shutdown_connections 2023-10-07T09:06:33.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.888+0000 7fd4f36c3700 1 -- 172.21.15.46:0/2697002172 wait complete. 2023-10-07T09:06:33.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 Processor -- start 2023-10-07T09:06:33.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 -- start start 2023-10-07T09:06:33.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4ec159890 0x7fd4ec15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4ec159c60 0x7fd4ec0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0ce4b0 con 0x7fd4ec069560 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0cdb60 con 0x7fd4ec159c60 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.889+0000 7fd4f36c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0cde40 con 0x7fd4ec159890 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50592/0 (socket says 172.21.15.46:50592) 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 -- 172.21.15.46:0/1863905120 learned_addr learned my addr 172.21.15.46:0/1863905120 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 -- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4ec159890 msgr2=0x7fd4ec15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4ec159890 0x7fd4ec15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 -- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4ec159c60 msgr2=0x7fd4ec0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f1c60700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4ec159c60 0x7fd4ec0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4ec159c60 0x7fd4ec0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 -- 172.21.15.46:0/1863905120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009a20 con 0x7fd4ec069560 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f145f700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800ec80 tx=0x7fd4e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e800c9d0 con 0x7fd4ec069560 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e800cb30 con 0x7fd4ec069560 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8013470 con 0x7fd4ec069560 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0ce750 con 0x7fd4ec069560 2023-10-07T09:06:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.890+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec16d650 con 0x7fd4ec069560 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.891+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec0d1560 con 0x7fd4ec069560 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.892+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4e8013820 con 0x7fd4ec069560 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.892+0000 7fd4e17fa700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 0x7fd4d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.892+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4e8085000 con 0x7fd4ec069560 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.892+0000 7fd4f0c5e700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 0x7fd4d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.893+0000 7fd4f0c5e700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 0x7fd4d00697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0058d0 tx=0x7fd4dc0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:33.896+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4e8051c90 con 0x7fd4ec069560 2023-10-07T09:06:34.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.088+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4ec04c3c0 con 0x7fd4ec069560 2023-10-07T09:06:34.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.089+0000 7fd4e17fa700 1 -- 172.21.15.46:0/1863905120 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fd4e80552b0 con 0x7fd4ec069560 2023-10-07T09:06:34.330 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:34.330 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":153,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:20.936059+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:18.021534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:18.587494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.090+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 msgr2=0x7fd4d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 0x7fd4d00697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0058d0 tx=0x7fd4dc0079d0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 msgr2=0x7fd4ec0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800ec80 tx=0x7fd4e80091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 shutdown_connections 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd4d0067320 0x7fd4d00697d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4ec159c60 0x7fd4ec0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec069560 0x7fd4ec0b37a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 --2- 172.21.15.46:0/1863905120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4ec159890 0x7fd4ec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 >> 172.21.15.46:0/1863905120 conn(0x7fd4ec068e20 msgr2=0x7fd4ec149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 shutdown_connections 2023-10-07T09:06:34.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.091+0000 7fd4f36c3700 1 -- 172.21.15.46:0/1863905120 wait complete. 2023-10-07T09:06:34.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:06:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.556+0000 7fbc88b42700 1 Processor -- start 2023-10-07T09:06:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.556+0000 7fbc88b42700 1 -- start start 2023-10-07T09:06:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc88b42700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc84068550 0x7fbc84068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc88b42700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 0x7fbc8406f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc88b42700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8406ec70 con 0x7fbc8406f640 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc88b42700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840b3430 con 0x7fbc84068550 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc88b42700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b2e70 con 0x7fbc8415e010 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc84068550 0x7fbc84068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc82d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbc8406f640 0x7fbc8406a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33540/0 (socket says 172.21.15.46:33540) 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc82d9d700 1 -- 172.21.15.46:0/3340566392 learned_addr learned my addr 172.21.15.46:0/3340566392 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc81d9b700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 0x7fbc8406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 -- 172.21.15.46:0/3340566392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 msgr2=0x7fbc8406f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 0x7fbc8406f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 -- 172.21.15.46:0/3340566392 >> v1:172.21.15.46:6789/0 conn(0x7fbc8406f640 legacy=0x7fbc8406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 -- 172.21.15.46:0/3340566392 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840b3150 con 0x7fbc84068550 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8159a700 1 -- 172.21.15.46:0/3340566392 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924726871 0 0) 0x7fbc8406ec70 con 0x7fbc8406f640 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc81d9b700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 0x7fbc8406f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.557+0000 7fbc8259c700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc84068550 0x7fbc84068920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fbc740098e0 tx=0x7fbc740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e886f9ca4c6a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc8159a700 1 -- 172.21.15.46:0/3340566392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74009e80 con 0x7fbc84068550 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc8159a700 1 -- 172.21.15.46:0/3340566392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400b860 con 0x7fbc84068550 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc8159a700 1 -- 172.21.15.46:0/3340566392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400bbe0 con 0x7fbc84068550 2023-10-07T09:06:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 -- 172.21.15.46:0/3340566392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc84068550 msgr2=0x7fbc84068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc84068550 0x7fbc84068920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fbc740098e0 tx=0x7fbc740091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 -- 172.21.15.46:0/3340566392 shutdown_connections 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc84068550 0x7fbc84068920 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3340566392 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8415e010 0x7fbc8406f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 -- 172.21.15.46:0/3340566392 >> 172.21.15.46:0/3340566392 conn(0x7fbc840cd480 msgr2=0x7fbc840cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 -- 172.21.15.46:0/3340566392 shutdown_connections 2023-10-07T09:06:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.558+0000 7fbc88b42700 1 -- 172.21.15.46:0/3340566392 wait complete. 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.559+0000 7fbc88b42700 1 Processor -- start 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.559+0000 7fbc88b42700 1 -- start start 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc84068550 0x7fbc8414ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8406f640 0x7fbc8414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840aabf0 con 0x7fbc8415e010 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840aaeb0 con 0x7fbc84068550 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc88b42700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840ab190 con 0x7fbc8406f640 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50604/0 (socket says 172.21.15.46:50604) 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 -- 172.21.15.46:0/3022428051 learned_addr learned my addr 172.21.15.46:0/3022428051 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc81d9b700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8406f640 0x7fbc8414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc8259c700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc84068550 0x7fbc8414ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 -- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8406f640 msgr2=0x7fbc8414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8406f640 0x7fbc8414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 -- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc84068550 msgr2=0x7fbc8414ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc84068550 0x7fbc8414ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.560+0000 7fbc82d9d700 1 -- 172.21.15.46:0/3022428051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009420 con 0x7fbc8415e010 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc82d9d700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00cc90 tx=0x7fbc7c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00cea0 con 0x7fbc8415e010 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00ab70 con 0x7fbc8415e010 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc840ab470 con 0x7fbc8415e010 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0070f0 con 0x7fbc8415e010 2023-10-07T09:06:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.561+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8414a8e0 con 0x7fbc8415e010 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.562+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc840ab990 con 0x7fbc8415e010 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.562+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbc7c0074a0 con 0x7fbc8415e010 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.563+0000 7fbc7a7fc700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.563+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc7c0850e0 con 0x7fbc8415e010 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.563+0000 7fbc8259c700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.563+0000 7fbc8259c700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 0x7fbc640697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbc74003080 tx=0x7fbc74017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.567+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc840ab990 con 0x7fbc8415e010 2023-10-07T09:06:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.802+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbc840ab990 con 0x7fbc8415e010 2023-10-07T09:06:34.804 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:06:34.803+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:06:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.806+0000 7fbc7a7fc700 1 -- 172.21.15.46:0/3022428051 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v104) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbc840ab990 con 0x7fbc8415e010 2023-10-07T09:06:34.809 INFO:tasks.ceph.mds.d.smithi133.stderr: -614> 2023-10-07T09:06:25.941+0000 7f451adac700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:06:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 msgr2=0x7fbc640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 0x7fbc640697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbc74003080 tx=0x7fbc74017000 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 msgr2=0x7fbc840ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00cc90 tx=0x7fbc7c001a80 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 shutdown_connections 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc8415e010 0x7fbc840ae220 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc84068550 0x7fbc8414ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 --2- 172.21.15.46:0/3022428051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8406f640 0x7fbc8414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.808+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 >> 172.21.15.46:0/3022428051 conn(0x7fbc840cd480 msgr2=0x7fbc840b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.809+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 shutdown_connections 2023-10-07T09:06:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.809+0000 7fbc88b42700 1 -- 172.21.15.46:0/3022428051 wait complete. 2023-10-07T09:06:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:06:34.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:06:34.832 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:06:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.942+0000 7f8844eaf700 1 Processor -- start 2023-10-07T09:06:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.942+0000 7f8844eaf700 1 -- start start 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f8844eaf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88400b16d0 0x7f88400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f8844eaf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88400b33b0 0x7f88400b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f8844eaf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400b2080 con 0x7f88400b4e70 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f8844eaf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88400cfb00 con 0x7f88400b16d0 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f8844eaf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88400b5c40 con 0x7f88400b33b0 2023-10-07T09:06:34.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88400b16d0 0x7f88400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f88400b4e70 0x7f88400ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33548/0 (socket says 172.21.15.46:33548) 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883f7fe700 1 -- 172.21.15.46:0/4290286742 learned_addr learned my addr 172.21.15.46:0/4290286742 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883effd700 1 -- 172.21.15.46:0/4290286742 >> v2:172.21.15.133:3300/0 conn(0x7f88400b33b0 msgr2=0x7f88400b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883ffff700 1 --2- 172.21.15.46:0/4290286742 >> v2:172.21.15.133:3300/0 conn(0x7f88400b33b0 0x7f88400b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883effd700 1 --2- 172.21.15.46:0/4290286742 >> v2:172.21.15.133:3300/0 conn(0x7f88400b33b0 0x7f88400b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883effd700 1 -- 172.21.15.46:0/4290286742 >> v1:172.21.15.46:6789/0 conn(0x7f88400b4e70 legacy=0x7f88400ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883e7fc700 1 -- 172.21.15.46:0/4290286742 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167293923 0 0) 0x7f88400b2080 con 0x7f88400b4e70 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.943+0000 7f883effd700 1 -- 172.21.15.46:0/4290286742 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400b5f20 con 0x7f88400b16d0 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f883effd700 1 --2- 172.21.15.46:0/4290286742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400b1b40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8840071380 tx=0x7f88340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06274393e0ef2c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f883e7fc700 1 -- 172.21.15.46:0/4290286742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400b6b0 con 0x7f88400b16d0 2023-10-07T09:06:34.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f883e7fc700 1 -- 172.21.15.46:0/4290286742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400b810 con 0x7f88400b16d0 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f883e7fc700 1 -- 172.21.15.46:0/4290286742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400bbb0 con 0x7f88400b16d0 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 -- 172.21.15.46:0/4290286742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 msgr2=0x7f88400b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4290286742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400b1b40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8840071380 tx=0x7f88340091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 -- 172.21.15.46:0/4290286742 shutdown_connections 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4290286742 >> v2:172.21.15.133:3300/0 conn(0x7f88400b33b0 0x7f88400b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4290286742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400b1b40 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 -- 172.21.15.46:0/4290286742 >> 172.21.15.46:0/4290286742 conn(0x7f88400d10c0 msgr2=0x7f88400affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 -- 172.21.15.46:0/4290286742 shutdown_connections 2023-10-07T09:06:34.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.944+0000 7f8844eaf700 1 -- 172.21.15.46:0/4290286742 wait complete. 2023-10-07T09:06:34.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.945+0000 7f8844eaf700 1 Processor -- start 2023-10-07T09:06:34.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 -- start start 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88400b33b0 0x7f88400cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88400b4e70 0x7f88400cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400c8ed0 con 0x7f88400b16d0 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400cc0e0 con 0x7f88400b4e70 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f8844eaf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400ca360 con 0x7f88400b33b0 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f883f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f883f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50618/0 (socket says 172.21.15.46:50618) 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.946+0000 7f883f7fe700 1 -- 172.21.15.46:0/4242500212 learned_addr learned my addr 172.21.15.46:0/4242500212 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 -- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88400b33b0 msgr2=0x7f88400cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88400b33b0 0x7f88400cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883ffff700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88400b4e70 0x7f88400cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 -- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88400b4e70 msgr2=0x7f88400cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88400b4e70 0x7f88400cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 -- 172.21.15.46:0/4242500212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834009420 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f883f7fe700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f883000c7e0 tx=0x7f8830007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830005b30 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8830005c90 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88400ca640 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830007300 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.947+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88400cac00 con 0x7f88400b16d0 2023-10-07T09:06:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.948+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840088990 con 0x7f88400b16d0 2023-10-07T09:06:34.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.948+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f883001b400 con 0x7f88400b16d0 2023-10-07T09:06:34.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.949+0000 7f88277fe700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 0x7f882c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:34.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.949+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8830084670 con 0x7f88400b16d0 2023-10-07T09:06:34.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.949+0000 7f883effd700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 0x7f882c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:34.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.950+0000 7f883effd700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 0x7f882c0697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f88400694e0 tx=0x7f8834017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:34.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:34.953+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8830051430 con 0x7f88400b16d0 2023-10-07T09:06:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.193+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f88400cf4b0 con 0x7f88400b16d0 2023-10-07T09:06:35.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.807+0000 7f88277fe700 1 -- 172.21.15.46:0/4242500212 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v105) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8830054a50 con 0x7f88400b16d0 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 msgr2=0x7f882c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 0x7f882c0697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f88400694e0 tx=0x7f8834017000 comp rx=0 tx=0).stop 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 msgr2=0x7f88400cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f883000c7e0 tx=0x7f8830007df0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 shutdown_connections 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f882c067320 0x7f882c0697d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88400b4e70 0x7f88400cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88400b16d0 0x7f88400cb120 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 --2- 172.21.15.46:0/4242500212 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88400b33b0 0x7f88400cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 >> 172.21.15.46:0/4242500212 conn(0x7f88400d10c0 msgr2=0x7f884015c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:35.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 shutdown_connections 2023-10-07T09:06:35.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.810+0000 7f8844eaf700 1 -- 172.21.15.46:0/4242500212 wait complete. 2023-10-07T09:06:35.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:06:35.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.954+0000 7f4c6bf6a700 1 Processor -- start 2023-10-07T09:06:35.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.955+0000 7f4c6bf6a700 1 -- start start 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6bf6a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c6406ab40 0x7f4c640699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6bf6a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 0x7f4c640c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6bf6a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c64068900 con 0x7f4c640af8c0 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6bf6a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c64068be0 con 0x7f4c6406ab40 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6bf6a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64068ec0 con 0x7f4c64068390 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6a507700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4c640af8c0 0x7f4c64159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33554/0 (socket says 172.21.15.46:33554) 2023-10-07T09:06:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c6a507700 1 -- 172.21.15.46:0/4263379198 learned_addr learned my addr 172.21.15.46:0/4263379198 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69505700 1 --2- 172.21.15.46:0/4263379198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 0x7f4c640c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69d06700 1 --2- 172.21.15.46:0/4263379198 >> v2:172.21.15.133:3300/0 conn(0x7f4c6406ab40 0x7f4c640699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c68d04700 1 -- 172.21.15.46:0/4263379198 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945884824 0 0) 0x7f4c64068900 con 0x7f4c640af8c0 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c68d04700 1 -- 172.21.15.46:0/4263379198 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c50003570 con 0x7f4c640af8c0 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69505700 1 -- 172.21.15.46:0/4263379198 >> v2:172.21.15.133:3300/0 conn(0x7f4c6406ab40 msgr2=0x7f4c640699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69505700 1 --2- 172.21.15.46:0/4263379198 >> v2:172.21.15.133:3300/0 conn(0x7f4c6406ab40 0x7f4c640699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69505700 1 -- 172.21.15.46:0/4263379198 >> v1:172.21.15.46:6789/0 conn(0x7f4c640af8c0 legacy=0x7f4c64159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.956+0000 7f4c69505700 1 -- 172.21.15.46:0/4263379198 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640691a0 con 0x7f4c64068390 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.957+0000 7f4c69505700 1 --2- 172.21.15.46:0/4263379198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 0x7f4c640c10c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68bbb17e5247770 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.957+0000 7f4c68d04700 1 -- 172.21.15.46:0/4263379198 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011630 con 0x7f4c64068390 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.957+0000 7f4c68d04700 1 -- 172.21.15.46:0/4263379198 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54011790 con 0x7f4c64068390 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.957+0000 7f4c68d04700 1 -- 172.21.15.46:0/4263379198 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011b30 con 0x7f4c64068390 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/4263379198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 msgr2=0x7f4c640c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/4263379198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 0x7f4c640c10c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c540091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/4263379198 shutdown_connections 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/4263379198 >> v2:172.21.15.133:3300/0 conn(0x7f4c6406ab40 0x7f4c640699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/4263379198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c64068390 0x7f4c640c10c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/4263379198 >> 172.21.15.46:0/4263379198 conn(0x7f4c640cd640 msgr2=0x7f4c640cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/4263379198 shutdown_connections 2023-10-07T09:06:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.958+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/4263379198 wait complete. 2023-10-07T09:06:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.959+0000 7f4c6bf6a700 1 Processor -- start 2023-10-07T09:06:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.959+0000 7f4c6bf6a700 1 -- start start 2023-10-07T09:06:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 0x7f4c640c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 0x7f4c6414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6414f4d0 con 0x7f4c64068390 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6414e8c0 con 0x7f4c6406ab40 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6414eba0 con 0x7f4c640af8c0 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50630/0 (socket says 172.21.15.46:50630) 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 -- 172.21.15.46:0/547941424 learned_addr learned my addr 172.21.15.46:0/547941424 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6a507700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 0x7f4c6414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69505700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 0x7f4c640c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 -- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 msgr2=0x7f4c6414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 0x7f4c6414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 -- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 msgr2=0x7f4c640c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 0x7f4c640c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 -- 172.21.15.46:0/547941424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009420 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69505700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 0x7f4c640c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6a507700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 0x7f4c6414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c69d06700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ec80 tx=0x7f4c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000c9d0 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000cb30 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6414ee80 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.960+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60013470 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.961+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64150470 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.961+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c640718b0 con 0x7f4c64068390 2023-10-07T09:06:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.962+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4c60013820 con 0x7f4c64068390 2023-10-07T09:06:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.962+0000 7f4c59ffb700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 0x7f4c480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.962+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4c60085050 con 0x7f4c64068390 2023-10-07T09:06:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.963+0000 7f4c69505700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 0x7f4c480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.963+0000 7f4c69505700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 0x7f4c480697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4c540091e0 tx=0x7f4c54017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:35.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:35.967+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c60051c90 con 0x7f4c64068390 2023-10-07T09:06:36.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.160+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c64069480 con 0x7f4c64068390 2023-10-07T09:06:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.812+0000 7f4c59ffb700 1 -- 172.21.15.46:0/547941424 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4c600552b0 con 0x7f4c64068390 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 msgr2=0x7f4c480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 0x7f4c480697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4c540091e0 tx=0x7f4c54017000 comp rx=0 tx=0).stop 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 msgr2=0x7f4c6414ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ec80 tx=0x7f4c600091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 shutdown_connections 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4c48067320 0x7f4c480697d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c640af8c0 0x7f4c6414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c64068390 0x7f4c6414ff30 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 --2- 172.21.15.46:0/547941424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6406ab40 0x7f4c640c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 >> 172.21.15.46:0/547941424 conn(0x7f4c640cd640 msgr2=0x7f4c64158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 shutdown_connections 2023-10-07T09:06:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.816+0000 7f4c6bf6a700 1 -- 172.21.15.46:0/547941424 wait complete. 2023-10-07T09:06:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:06:36.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:06:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.960+0000 7f50e914b700 1 Processor -- start 2023-10-07T09:06:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e914b700 1 -- start start 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e914b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50e40cd910 0x7f50e40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e914b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40b5b00 con 0x7f50e40b55a0 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e914b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40b5da0 con 0x7f50e4159ec0 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e914b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b6080 con 0x7f50e40cd910 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.961+0000 7f50e359e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f50e40b55a0 0x7f50e40ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33556/0 (socket says 172.21.15.46:33556) 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e359e700 1 -- 172.21.15.46:0/1519141307 learned_addr learned my addr 172.21.15.46:0/1519141307 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e259c700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50e40cd910 0x7f50e40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830420689 0 0) 0x7f50e40b5b00 con 0x7f50e40b55a0 2023-10-07T09:06:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003570 con 0x7f50e40b55a0 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1608065716 0 0) 0x7f50cc003570 con 0x7f50e40b55a0 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50e40cd910 msgr2=0x7f50e40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50e40cd910 0x7f50e40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 >> v1:172.21.15.133:6789/0 conn(0x7f50e4159ec0 legacy=0x7f50e40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40cc100 con 0x7f50e40b55a0 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f50dc0017f0 con 0x7f50e40b55a0 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 >> v1:172.21.15.46:6789/0 conn(0x7f50e40b55a0 legacy=0x7f50e40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50cc003a90 0x7f50cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc004810 0x7f50cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50cc005180 0x7f50cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b6080 con 0x7f50cc003a90 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00bfa0 con 0x7f50cc005180 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00c130 con 0x7f50cc004810 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50cc003a90 0x7f50cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e259c700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc004810 0x7f50cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.962+0000 7f50e359e700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50cc005180 0x7f50cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 -- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc004810 msgr2=0x7f50cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc004810 0x7f50cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 -- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50cc005180 msgr2=0x7f50cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50cc005180 0x7f50cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 -- 172.21.15.46:0/1519141307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc003570 con 0x7f50cc003a90 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50cc003a90 0x7f50cc003ea0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f50d4001900 tx=0x7f50d4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4d619e8553ab42 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4001290 con 0x7f50cc003a90 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4012420 con 0x7f50cc003a90 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e1d9b700 1 -- 172.21.15.46:0/1519141307 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40127e0 con 0x7f50cc003a90 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 -- 172.21.15.46:0/1519141307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50cc003a90 msgr2=0x7f50cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 --2- 172.21.15.46:0/1519141307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50cc003a90 0x7f50cc003ea0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f50d4001900 tx=0x7f50d4007d80 comp rx=0 tx=0).stop 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e359e700 1 -- 172.21.15.46:0/1519141307 reap_dead start 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 -- 172.21.15.46:0/1519141307 shutdown_connections 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 -- 172.21.15.46:0/1519141307 >> 172.21.15.46:0/1519141307 conn(0x7f50e40999f0 msgr2=0x7f50e40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 -- 172.21.15.46:0/1519141307 shutdown_connections 2023-10-07T09:06:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.963+0000 7f50e914b700 1 -- 172.21.15.46:0/1519141307 wait complete. 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 Processor -- start 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 -- start start 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc003a90 0x7f50e4144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 0x7f50e40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40ceb40 con 0x7f50e409d3d0 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e409b030 con 0x7f50e40ce190 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e914b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e409dd80 con 0x7f50cc003a90 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50642/0 (socket says 172.21.15.46:50642) 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.965+0000 7f50e359e700 1 -- 172.21.15.46:0/3099093701 learned_addr learned my addr 172.21.15.46:0/3099093701 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc003a90 0x7f50e4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e259c700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 0x7f50e40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 -- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc003a90 msgr2=0x7f50e4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc003a90 0x7f50e4144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 -- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 msgr2=0x7f50e40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 0x7f50e40ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 -- 172.21.15.46:0/3099093701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e41584f0 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e259c700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 0x7f50e40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e359e700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f50e40d06d0 tx=0x7f50dc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00ae10 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0133f0 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40ced50 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0137b0 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.966+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e409a9e0 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.967+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e4063c90 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.967+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f50dc013b60 con 0x7f50e409d3d0 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.968+0000 7f50caffd700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 0x7f50d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.968+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f50dc0854e0 con 0x7f50e409d3d0 2023-10-07T09:06:36.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.968+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 0x7f50d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:36.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.969+0000 7f50e2d9d700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 0x7f50d00697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000ef0 tx=0x7f50d4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:36.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:36.972+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50dc0523d0 con 0x7f50e409d3d0 2023-10-07T09:06:37.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.168+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50e40718b0 con 0x7f50e409d3d0 2023-10-07T09:06:37.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.814+0000 7f50caffd700 1 -- 172.21.15.46:0/3099093701 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v156) v1 ==== 169+0+0 (secure 0 0 0) 0x7f50dc0559f0 con 0x7f50e409d3d0 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 msgr2=0x7f50d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 0x7f50d00697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000ef0 tx=0x7f50d4015000 comp rx=0 tx=0).stop 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 msgr2=0x7f50e409d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f50e40d06d0 tx=0x7f50dc0021d0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 shutdown_connections 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f50d0067320 0x7f50d00697d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50e409d3d0 0x7f50e409d840 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50cc003a90 0x7f50e4144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 --2- 172.21.15.46:0/3099093701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50e40ce190 0x7f50e40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 >> 172.21.15.46:0/3099093701 conn(0x7f50e40999f0 msgr2=0x7f50e4069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:37.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 shutdown_connections 2023-10-07T09:06:37.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.817+0000 7f50e914b700 1 -- 172.21.15.46:0/3099093701 wait complete. 2023-10-07T09:06:37.820 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:06:37.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:06:37.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 Processor -- start 2023-10-07T09:06:37.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 -- start start 2023-10-07T09:06:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f001c155eb0 0x7f001c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c06eb90 con 0x7f001c069e80 2023-10-07T09:06:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c06ee70 con 0x7f001c0c70b0 2023-10-07T09:06:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.960+0000 7f002301f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c06f150 con 0x7f001c155eb0 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f00215bc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f001c069e80 0x7f001c0ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33562/0 (socket says 172.21.15.46:33562) 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f00215bc700 1 -- 172.21.15.46:0/4008361478 learned_addr learned my addr 172.21.15.46:0/4008361478 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f0020dbb700 1 --2- 172.21.15.46:0/4008361478 >> v2:172.21.15.133:3300/0 conn(0x7f001c155eb0 0x7f001c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541464151 0 0) 0x7f001c06eb90 con 0x7f001c069e80 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0004003570 con 0x7f001c069e80 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1271505715 0 0) 0x7f0004003570 con 0x7f001c069e80 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 >> v2:172.21.15.133:3300/0 conn(0x7f001c155eb0 msgr2=0x7f001c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 --2- 172.21.15.46:0/4008361478 >> v2:172.21.15.133:3300/0 conn(0x7f001c155eb0 0x7f001c06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 >> v1:172.21.15.133:6789/0 conn(0x7f001c0c70b0 legacy=0x7f001c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c06f430 con 0x7f001c069e80 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f000c001470 con 0x7f001c069e80 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 >> v1:172.21.15.46:6789/0 conn(0x7f001c069e80 legacy=0x7f001c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0004003a60 0x7f0004003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f0004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040051c0 0x7f000400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c06f150 con 0x7f0004004810 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000400c050 con 0x7f00040051c0 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000400c210 con 0x7f0004003a60 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f001bfff700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f0004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f0020dbb700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0004003a60 0x7f0004003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.961+0000 7f00215bc700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040051c0 0x7f000400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 -- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0004003a60 msgr2=0x7f0004003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0004003a60 0x7f0004003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 -- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040051c0 msgr2=0x7f000400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040051c0 0x7f000400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f00215bc700 1 -- 172.21.15.46:0/4008361478 reap_dead start 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 -- 172.21.15.46:0/4008361478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004003570 con 0x7f0004004810 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001bfff700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f0004004c80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f00100019a0 tx=0x7f0010007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18f8b9467ee6bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000c5d0 con 0x7f0004004810 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000c730 con 0x7f0004004810 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.962+0000 7f001b7fe700 1 -- 172.21.15.46:0/4008361478 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000cad0 con 0x7f0004004810 2023-10-07T09:06:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 -- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 msgr2=0x7f0004004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f0004004c80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f00100019a0 tx=0x7f0010007d10 comp rx=0 tx=0).stop 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 -- 172.21.15.46:0/4008361478 shutdown_connections 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 --2- 172.21.15.46:0/4008361478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f0004004c80 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 -- 172.21.15.46:0/4008361478 >> 172.21.15.46:0/4008361478 conn(0x7f001c068e10 msgr2=0x7f001c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 -- 172.21.15.46:0/4008361478 shutdown_connections 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.963+0000 7f002301f700 1 -- 172.21.15.46:0/4008361478 wait complete. 2023-10-07T09:06:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.964+0000 7f002301f700 1 Processor -- start 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.964+0000 7f002301f700 1 -- start start 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c148cb0 0x7f001c149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c1428c0 0x7f001c142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c143fe0 con 0x7f0004004810 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1433d0 con 0x7f001c1428c0 2023-10-07T09:06:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1436b0 con 0x7f001c148cb0 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50670/0 (socket says 172.21.15.46:50670) 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 -- 172.21.15.46:0/3750990470 learned_addr learned my addr 172.21.15.46:0/3750990470 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f00215bc700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c1428c0 0x7f001c142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 -- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c148cb0 msgr2=0x7f001c149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c148cb0 0x7f001c149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 -- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c1428c0 msgr2=0x7f001c142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c1428c0 0x7f001c142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 -- 172.21.15.46:0/3750990470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c143990 con 0x7f0004004810 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0020dbb700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0014011f80 tx=0x7f001400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400e040 con 0x7f0004004810 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400f040 con 0x7f0004004810 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.965+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c143c70 con 0x7f0004004810 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.966+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014015430 con 0x7f0004004810 2023-10-07T09:06:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.966+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c141b60 con 0x7f0004004810 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.966+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c04c3c0 con 0x7f0004004810 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.967+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00140157e0 con 0x7f0004004810 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.967+0000 7f0018ff9700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 0x7f00080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.967+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0014085830 con 0x7f0004004810 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.968+0000 7f001bfff700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 0x7f00080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.968+0000 7f001bfff700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 0x7f00080697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f001c069d60 tx=0x7f0010015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:37.972+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0014056140 con 0x7f0004004810 2023-10-07T09:06:38.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.175+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f001c1442c0 con 0x7f0004004810 2023-10-07T09:06:38.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.178+0000 7f0018ff9700 1 -- 172.21.15.46:0/3750990470 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0014055cd0 con 0x7f0004004810 2023-10-07T09:06:38.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 msgr2=0x7f00080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 0x7f00080697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f001c069d60 tx=0x7f0010015000 comp rx=0 tx=0).stop 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 msgr2=0x7f001c141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0014011f80 tx=0x7f001400b040 comp rx=0 tx=0).stop 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 shutdown_connections 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0008067320 0x7f00080697d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c1428c0 0x7f001c142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0004004810 0x7f001c141620 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 --2- 172.21.15.46:0/3750990470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c148cb0 0x7f001c149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 >> 172.21.15.46:0/3750990470 conn(0x7f001c068e10 msgr2=0x7f001c14cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.180+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 shutdown_connections 2023-10-07T09:06:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.181+0000 7f002301f700 1 -- 172.21.15.46:0/3750990470 wait complete. 2023-10-07T09:06:38.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-07T09:06:38.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.313+0000 7f5b1bafd700 1 Processor -- start 2023-10-07T09:06:38.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.313+0000 7f5b1bafd700 1 -- start start 2023-10-07T09:06:38.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1bafd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b14159c60 0x7f5b1415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1bafd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415db10 0x7f5b14069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1bafd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1415a160 con 0x7f5b14159890 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1bafd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1415df50 con 0x7f5b14159c60 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1bafd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140d13a0 con 0x7f5b1415db10 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19899700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5b14159890 0x7f5b1415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33578/0 (socket says 172.21.15.46:33578) 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19899700 1 -- 172.21.15.46:0/3032719022 learned_addr learned my addr 172.21.15.46:0/3032719022 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19098700 1 --2- 172.21.15.46:0/3032719022 >> v2:172.21.15.46:3300/0 conn(0x7f5b14159c60 0x7f5b1415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b1a09a700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415db10 0x7f5b14069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b18897700 1 -- 172.21.15.46:0/3032719022 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199466740 0 0) 0x7f5b1415a160 con 0x7f5b14159890 2023-10-07T09:06:38.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b18897700 1 -- 172.21.15.46:0/3032719022 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc003570 con 0x7f5b14159890 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19098700 1 -- 172.21.15.46:0/3032719022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415db10 msgr2=0x7f5b14069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19098700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415db10 0x7f5b14069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19098700 1 -- 172.21.15.46:0/3032719022 >> v1:172.21.15.46:6789/0 conn(0x7f5b14159890 legacy=0x7f5b1415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.314+0000 7f5b19098700 1 -- 172.21.15.46:0/3032719022 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1415e140 con 0x7f5b14159c60 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b19098700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14159c60 0x7f5b1415d5d0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f5b080098e0 tx=0x7f5b080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f506f6eae4616e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b18897700 1 -- 172.21.15.46:0/3032719022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800b640 con 0x7f5b14159c60 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b18897700 1 -- 172.21.15.46:0/3032719022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800b7a0 con 0x7f5b14159c60 2023-10-07T09:06:38.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b18897700 1 -- 172.21.15.46:0/3032719022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800bb40 con 0x7f5b14159c60 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 -- 172.21.15.46:0/3032719022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14159c60 msgr2=0x7f5b1415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14159c60 0x7f5b1415d5d0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f5b080098e0 tx=0x7f5b080091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 -- 172.21.15.46:0/3032719022 shutdown_connections 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415db10 0x7f5b14069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/3032719022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14159c60 0x7f5b1415d5d0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 -- 172.21.15.46:0/3032719022 >> 172.21.15.46:0/3032719022 conn(0x7f5b14068e20 msgr2=0x7f5b140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 -- 172.21.15.46:0/3032719022 shutdown_connections 2023-10-07T09:06:38.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.315+0000 7f5b1bafd700 1 -- 172.21.15.46:0/3032719022 wait complete. 2023-10-07T09:06:38.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.316+0000 7f5b1bafd700 1 Processor -- start 2023-10-07T09:06:38.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.316+0000 7f5b1bafd700 1 -- start start 2023-10-07T09:06:38.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b14159890 0x7f5b1414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 0x7f5b140c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1415ced0 con 0x7f5b1415db10 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1414d020 con 0x7f5b14159c60 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1bafd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1415c2c0 con 0x7f5b14159890 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1a09a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1a09a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50684/0 (socket says 172.21.15.46:50684) 2023-10-07T09:06:38.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b1a09a700 1 -- 172.21.15.46:0/1407956660 learned_addr learned my addr 172.21.15.46:0/1407956660 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b19899700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b14159890 0x7f5b1414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.317+0000 7f5b19098700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 0x7f5b140c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 -- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b14159890 msgr2=0x7f5b1414cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b14159890 0x7f5b1414cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 -- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 msgr2=0x7f5b140c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 0x7f5b140c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 -- 172.21.15.46:0/1407956660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009420 con 0x7f5b1415db10 2023-10-07T09:06:38.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b19098700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 0x7f5b140c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1a09a700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d890 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0125f0 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c012770 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c012b30 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1415c5a0 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.318+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1415cb60 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.319+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1415d080 con 0x7f5b1415db10 2023-10-07T09:06:38.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.319+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5b0c01e460 con 0x7f5b1415db10 2023-10-07T09:06:38.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.320+0000 7f5b11ffb700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 0x7f5b000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.320+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5b0c084f10 con 0x7f5b1415db10 2023-10-07T09:06:38.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.320+0000 7f5b19899700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 0x7f5b000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.321+0000 7f5b19899700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 0x7f5b000697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b04005c50 tx=0x7f5b04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.324+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b1415d080 con 0x7f5b1415db10 2023-10-07T09:06:38.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.599+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f5b1415d080 con 0x7f5b1415db10 2023-10-07T09:06:38.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.817+0000 7f5b11ffb700 1 -- 172.21.15.46:0/1407956660 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v404) v1 ==== 167+0+0 (secure 0 0 0) 0x7f5b1415d080 con 0x7f5b1415db10 2023-10-07T09:06:38.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.819+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 msgr2=0x7f5b000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.819+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 0x7f5b000697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b04005c50 tx=0x7f5b04009040 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.819+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 msgr2=0x7f5b140c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.819+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d890 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 shutdown_connections 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b00067320 0x7f5b000697d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b1415db10 0x7f5b140c5ad0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b14159890 0x7f5b1414cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 --2- 172.21.15.46:0/1407956660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b14159c60 0x7f5b140c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 >> 172.21.15.46:0/1407956660 conn(0x7f5b14068e20 msgr2=0x7f5b14069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:38.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 shutdown_connections 2023-10-07T09:06:38.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.820+0000 7f5b1bafd700 1 -- 172.21.15.46:0/1407956660 wait complete. 2023-10-07T09:06:38.834 INFO:tasks.cephfs_test_runner:That renaming volume fails without --yes-i-really-mean-it flag. ... ok 2023-10-07T09:06:38.834 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) That renaming a volume with more than one data pool does not change 2023-10-07T09:06:38.834 INFO:tasks.cephfs_test_runner:test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:06:38.834 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-07T09:06:38.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.952+0000 7ff178b69700 1 Processor -- start 2023-10-07T09:06:38.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.952+0000 7ff178b69700 1 -- start start 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff178b69700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1740cd1e0 0x7ff1740c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff178b69700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17415c2a0 con 0x7ff174141500 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff178b69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17415b690 con 0x7ff17406bcd0 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff178b69700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17415b970 con 0x7ff1740cd1e0 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff172d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1740cd1e0 0x7ff1740c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff171d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff174141500 0x7ff1740c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33594/0 (socket says 172.21.15.46:33594) 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff171d9b700 1 -- 172.21.15.46:0/1615558653 learned_addr learned my addr 172.21.15.46:0/1615558653 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff172d9d700 1 -- 172.21.15.46:0/1615558653 >> v1:172.21.15.133:6789/0 conn(0x7ff17406bcd0 legacy=0x7ff174140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff172d9d700 1 -- 172.21.15.46:0/1615558653 >> v1:172.21.15.46:6789/0 conn(0x7ff174141500 legacy=0x7ff1740c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff172d9d700 1 -- 172.21.15.46:0/1615558653 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17415bc50 con 0x7ff1740cd1e0 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff17159a700 1 -- 172.21.15.46:0/1615558653 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534201894 0 0) 0x7ff17415c2a0 con 0x7ff174141500 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff172d9d700 1 --2- 172.21.15.46:0/1615558653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1740cd1e0 0x7ff1740c9510 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098e0 tx=0x7ff16c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0481e9c3c855eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.953+0000 7ff17159a700 1 -- 172.21.15.46:0/1615558653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c009e80 con 0x7ff1740cd1e0 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff17159a700 1 -- 172.21.15.46:0/1615558653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00b820 con 0x7ff1740cd1e0 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff17159a700 1 -- 172.21.15.46:0/1615558653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00bba0 con 0x7ff1740cd1e0 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 -- 172.21.15.46:0/1615558653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1740cd1e0 msgr2=0x7ff1740c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 --2- 172.21.15.46:0/1615558653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1740cd1e0 0x7ff1740c9510 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098e0 tx=0x7ff16c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 -- 172.21.15.46:0/1615558653 shutdown_connections 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 --2- 172.21.15.46:0/1615558653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1740cd1e0 0x7ff1740c9510 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 -- 172.21.15.46:0/1615558653 >> 172.21.15.46:0/1615558653 conn(0x7ff1740ce600 msgr2=0x7ff1740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:38.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 -- 172.21.15.46:0/1615558653 shutdown_connections 2023-10-07T09:06:38.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.954+0000 7ff178b69700 1 -- 172.21.15.46:0/1615558653 wait complete. 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.955+0000 7ff178b69700 1 Processor -- start 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.955+0000 7ff178b69700 1 -- start start 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff17406bcd0 0x7ff17413c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1740cd1e0 0x7ff174159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17415afd0 con 0x7ff174141500 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740b1c40 con 0x7ff17406bcd0 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff178b69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17415a3c0 con 0x7ff1740cd1e0 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50702/0 (socket says 172.21.15.46:50702) 2023-10-07T09:06:38.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 -- 172.21.15.46:0/2557565089 learned_addr learned my addr 172.21.15.46:0/2557565089 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 -- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1740cd1e0 msgr2=0x7ff174159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1740cd1e0 0x7ff174159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 -- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff17406bcd0 msgr2=0x7ff17413c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff17259c700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff17406bcd0 0x7ff17413c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff17406bcd0 0x7ff17413c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.956+0000 7ff172d9d700 1 -- 172.21.15.46:0/2557565089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009420 con 0x7ff174141500 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff172d9d700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0030c0 tx=0x7ff16c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c01b450 con 0x7ff174141500 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c020070 con 0x7ff174141500 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17415a6a0 con 0x7ff174141500 2023-10-07T09:06:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c01b7e0 con 0x7ff174141500 2023-10-07T09:06:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.957+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17415ac60 con 0x7ff174141500 2023-10-07T09:06:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.958+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17415b140 con 0x7ff174141500 2023-10-07T09:06:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.958+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff16c022030 con 0x7ff174141500 2023-10-07T09:06:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.959+0000 7ff16a7fc700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:38.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.959+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff16c086ad0 con 0x7ff174141500 2023-10-07T09:06:38.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.959+0000 7ff17259c700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:38.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.959+0000 7ff17259c700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 0x7ff1540697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff164007fd0 tx=0x7ff164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:38.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:38.963+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff16c053b70 con 0x7ff174141500 2023-10-07T09:06:39.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.235+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7ff17415b110 con 0x7ff174141500 2023-10-07T09:06:39.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.819+0000 7ff16a7fc700 1 -- 172.21.15.46:0/2557565089 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v405) v1 ==== 166+0+0 (secure 0 0 0) 0x7ff16c057190 con 0x7ff174141500 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 msgr2=0x7ff1540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 0x7ff1540697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff164007fd0 tx=0x7ff164009040 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 msgr2=0x7ff174159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0030c0 tx=0x7ff16c016000 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 shutdown_connections 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174141500 0x7ff174159d90 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff17406bcd0 0x7ff17413c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 --2- 172.21.15.46:0/2557565089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1740cd1e0 0x7ff174159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 >> 172.21.15.46:0/2557565089 conn(0x7ff1740ce600 msgr2=0x7ff1740cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 shutdown_connections 2023-10-07T09:06:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.822+0000 7ff178b69700 1 -- 172.21.15.46:0/2557565089 wait complete. 2023-10-07T09:06:39.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:06:39.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.962+0000 7fa85323f700 1 Processor -- start 2023-10-07T09:06:39.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.962+0000 7fa85323f700 1 -- start start 2023-10-07T09:06:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa85323f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa84c159890 0x7fa84c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa85323f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa84c159c60 0x7fa84c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa85323f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84c15a160 con 0x7fa84c15db10 2023-10-07T09:06:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa85323f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c15df50 con 0x7fa84c159890 2023-10-07T09:06:39.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa85323f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0d13a0 con 0x7fa84c159c60 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa84c159890 0x7fa84c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8517dc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa84c15db10 0x7fa84c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54176/0 (socket says 172.21.15.46:54176) 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8517dc700 1 -- 172.21.15.46:0/879090518 learned_addr learned my addr 172.21.15.46:0/879090518 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa843fff700 1 --2- 172.21.15.46:0/879090518 >> v2:172.21.15.133:3300/0 conn(0x7fa84c159c60 0x7fa84c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 -- 172.21.15.46:0/879090518 >> v2:172.21.15.133:3300/0 conn(0x7fa84c159c60 msgr2=0x7fa84c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 --2- 172.21.15.46:0/879090518 >> v2:172.21.15.133:3300/0 conn(0x7fa84c159c60 0x7fa84c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 -- 172.21.15.46:0/879090518 >> v1:172.21.15.46:6789/0 conn(0x7fa84c15db10 legacy=0x7fa84c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8437fe700 1 -- 172.21.15.46:0/879090518 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277153912 0 0) 0x7fa84c15a160 con 0x7fa84c15db10 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 -- 172.21.15.46:0/879090518 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c15e140 con 0x7fa84c159890 2023-10-07T09:06:39.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa850fdb700 1 --2- 172.21.15.46:0/879090518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c159890 0x7fa84c15abd0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b67f0 tx=0x7fa848009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499b8040d995a7e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8437fe700 1 -- 172.21.15.46:0/879090518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800e070 con 0x7fa84c159890 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8437fe700 1 -- 172.21.15.46:0/879090518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84800bc30 con 0x7fa84c159890 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.963+0000 7fa8437fe700 1 -- 172.21.15.46:0/879090518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848012430 con 0x7fa84c159890 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 -- 172.21.15.46:0/879090518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c159890 msgr2=0x7fa84c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 --2- 172.21.15.46:0/879090518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c159890 0x7fa84c15abd0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b67f0 tx=0x7fa848009780 comp rx=0 tx=0).stop 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 -- 172.21.15.46:0/879090518 shutdown_connections 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 --2- 172.21.15.46:0/879090518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c159890 0x7fa84c15abd0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 --2- 172.21.15.46:0/879090518 >> v2:172.21.15.133:3300/0 conn(0x7fa84c159c60 0x7fa84c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 -- 172.21.15.46:0/879090518 >> 172.21.15.46:0/879090518 conn(0x7fa84c068e20 msgr2=0x7fa84c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 -- 172.21.15.46:0/879090518 shutdown_connections 2023-10-07T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.964+0000 7fa85323f700 1 -- 172.21.15.46:0/879090518 wait complete. 2023-10-07T09:06:39.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.965+0000 7fa85323f700 1 Processor -- start 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.965+0000 7fa85323f700 1 -- start start 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84c159890 0x7fa84c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 0x7fa84c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0cdfb0 con 0x7fa84c15db10 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c14cf10 con 0x7fa84c159c60 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa85323f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0cd0c0 con 0x7fa84c159890 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55332/0 (socket says 172.21.15.46:55332) 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 -- 172.21.15.46:0/1683882159 learned_addr learned my addr 172.21.15.46:0/1683882159 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa843fff700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 0x7fa84c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa850fdb700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84c159890 0x7fa84c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 -- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84c159890 msgr2=0x7fa84c14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84c159890 0x7fa84c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 -- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 msgr2=0x7fa84c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 0x7fa84c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa8517dc700 1 -- 172.21.15.46:0/1683882159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848009a20 con 0x7fa84c15db10 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.966+0000 7fa843fff700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 0x7fa84c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa8517dc700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c530 tx=0x7fa844007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844005b30 con 0x7fa84c15db10 2023-10-07T09:06:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844005c90 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844007320 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c0cd3a0 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.967+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c0cd960 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.968+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c04c3c0 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.968+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa84401b3b0 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.969+0000 7fa840ff9700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 0x7fa8380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.969+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa844083e90 con 0x7fa84c15db10 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.969+0000 7fa850fdb700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 0x7fa8380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.970+0000 7fa850fdb700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 0x7fa8380697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b67f0 tx=0x7fa848019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:39.973+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa844050e20 con 0x7fa84c15db10 2023-10-07T09:06:40.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.164+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa84c0ce0f0 con 0x7fa84c15db10 2023-10-07T09:06:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.168+0000 7fa840ff9700 1 -- 172.21.15.46:0/1683882159 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8440170c0 con 0x7fa84c15db10 2023-10-07T09:06:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 msgr2=0x7fa8380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 0x7fa8380697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b67f0 tx=0x7fa848019000 comp rx=0 tx=0).stop 2023-10-07T09:06:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 msgr2=0x7fa84c1522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c530 tx=0x7fa844007f90 comp rx=0 tx=0).stop 2023-10-07T09:06:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 shutdown_connections 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa838067320 0x7fa8380697d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa84c15db10 0x7fa84c1522a0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84c159890 0x7fa84c14c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 --2- 172.21.15.46:0/1683882159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c159c60 0x7fa84c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 >> 172.21.15.46:0/1683882159 conn(0x7fa84c068e20 msgr2=0x7fa84c153720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 shutdown_connections 2023-10-07T09:06:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.170+0000 7fa85323f700 1 -- 172.21.15.46:0/1683882159 wait complete. 2023-10-07T09:06:40.184 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:06:40.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:40.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:06:40.264 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:06:40.264 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:06:40.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.381+0000 7fe96df01700 1 Processor -- start 2023-10-07T09:06:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 -- start start 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9680b1420 0x7fe9680ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680ccf90 0x7fe9680c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9680cc300 con 0x7fe9680cbf30 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe968156bf0 con 0x7fe9680b1420 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe96df01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9680ae950 con 0x7fe9680ccf90 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.382+0000 7fe966ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9680b1420 0x7fe9680ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9680b1420 0x7fe9680ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55334/0 (socket says 172.21.15.46:55334) 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 -- 172.21.15.46:0/1671139973 learned_addr learned my addr 172.21.15.46:0/1671139973 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe967fff700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680ccf90 0x7fe9680c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 -- 172.21.15.46:0/1671139973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680ccf90 msgr2=0x7fe9680c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680ccf90 0x7fe9680c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 -- 172.21.15.46:0/1671139973 >> v1:172.21.15.133:6789/0 conn(0x7fe9680cbf30 legacy=0x7fe9680b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 -- 172.21.15.46:0/1671139973 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9680ad370 con 0x7fe9680b1420 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe966ffd700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680b1420 0x7fe9680ae410 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0099e0 tx=0x7fe95c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6268bbbe8a5a6dc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe9667fc700 1 -- 172.21.15.46:0/1671139973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00b820 con 0x7fe9680b1420 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe9667fc700 1 -- 172.21.15.46:0/1671139973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00b980 con 0x7fe9680b1420 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.383+0000 7fe9667fc700 1 -- 172.21.15.46:0/1671139973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00bd20 con 0x7fe9680b1420 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 -- 172.21.15.46:0/1671139973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680b1420 msgr2=0x7fe9680ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680b1420 0x7fe9680ae410 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0099e0 tx=0x7fe95c009250 comp rx=0 tx=0).stop 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 -- 172.21.15.46:0/1671139973 shutdown_connections 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680ccf90 0x7fe9680c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 --2- 172.21.15.46:0/1671139973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680b1420 0x7fe9680ae410 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 -- 172.21.15.46:0/1671139973 >> 172.21.15.46:0/1671139973 conn(0x7fe96806a320 msgr2=0x7fe9680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 -- 172.21.15.46:0/1671139973 shutdown_connections 2023-10-07T09:06:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.384+0000 7fe96df01700 1 -- 172.21.15.46:0/1671139973 wait complete. 2023-10-07T09:06:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.385+0000 7fe96df01700 1 Processor -- start 2023-10-07T09:06:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.385+0000 7fe96df01700 1 -- start start 2023-10-07T09:06:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680b1420 0x7fe96814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9680ccf90 0x7fe968152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96814ebf0 con 0x7fe9680cbf30 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe968153150 con 0x7fe9680ccf90 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe96df01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96814e350 con 0x7fe9680b1420 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55348/0 (socket says 172.21.15.46:55348) 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 -- 172.21.15.46:0/2524605202 learned_addr learned my addr 172.21.15.46:0/2524605202 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe967fff700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9680ccf90 0x7fe968152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe9677fe700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680b1420 0x7fe96814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 -- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680b1420 msgr2=0x7fe96814fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680b1420 0x7fe96814fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 -- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9680ccf90 msgr2=0x7fe968152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9680ccf90 0x7fe968152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 -- 172.21.15.46:0/2524605202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0094f0 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.386+0000 7fe966ffd700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009290 tx=0x7fe95c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.387+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011d70 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.387+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c024440 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.387+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96814e630 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.387+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c024800 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.387+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe968150270 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.388+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96804c3c0 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.388+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe95c02d440 con 0x7fe9680cbf30 2023-10-07T09:06:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.388+0000 7fe94f7fe700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 0x7fe9540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.388+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe95c086200 con 0x7fe9680cbf30 2023-10-07T09:06:40.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.389+0000 7fe9677fe700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 0x7fe9540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.389+0000 7fe9677fe700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 0x7fe9540697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe958003a80 tx=0x7fe958007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.393+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe95c053190 con 0x7fe9680cbf30 2023-10-07T09:06:40.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.627+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9680ad650 con 0x7fe9680cbf30 2023-10-07T09:06:40.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.628+0000 7fe94f7fe700 1 -- 172.21.15.46:0/2524605202 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+3528 (secure 0 0 0) 0x7fe95c015de0 con 0x7fe9680cbf30 2023-10-07T09:06:40.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:40.630 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":105,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/249758831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":249758831},{"type":"v1","addr":"172.21.15.46:6835","nonce":249758831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/180706759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":180706759},{"type":"v1","addr":"172.21.15.133:6836","nonce":180706759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7405,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3068630267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3068630267},{"type":"v1","addr":"172.21.15.133:6837","nonce":3068630267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/769131343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":769131343},{"type":"v1","addr":"172.21.15.46:6834","nonce":769131343}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[]} 2023-10-07T09:06:40.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 msgr2=0x7fe9540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 0x7fe9540697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe958003a80 tx=0x7fe958007ec0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 msgr2=0x7fe968151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009290 tx=0x7fe95c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:40.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 shutdown_connections 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe954067320 0x7fe9540697d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9680ccf90 0x7fe968152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9680b1420 0x7fe96814fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 --2- 172.21.15.46:0/2524605202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9680cbf30 0x7fe968151bf0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 >> 172.21.15.46:0/2524605202 conn(0x7fe96806a320 msgr2=0x7fe968156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 shutdown_connections 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.630+0000 7fe96df01700 1 -- 172.21.15.46:0/2524605202 wait complete. 2023-10-07T09:06:40.633 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 105 2023-10-07T09:06:40.644 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:06:40.644 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:06:40.644 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:06:40.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:40.645 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:06:40.645 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:06:40.645 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:06:40.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:40.645 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:06:40.645 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:06:40.646 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:06:40.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:40.646 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:06:40.646 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:06:40.646 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:06:40.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:06:40.655 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:06:40.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:06:40.656 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:06:40.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:06:40.657 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:06:40.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:06:40.658 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:06:40.658 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:06:40.698 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:06:40.698 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:40.698 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:06:40.699 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:40.701 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:06:40.701 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:40.701 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:06:40.701 DEBUG:teuthology.parallel:result is None 2023-10-07T09:06:40.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:06:40.774 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:06:40.775 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:06:40.781 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:06:40.782 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:06:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.827+0000 7efc46501700 1 Processor -- start 2023-10-07T09:06:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.827+0000 7efc46501700 1 -- start start 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.827+0000 7efc46501700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc4006bcd0 0x7efc40140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc46501700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 0x7efc40141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc46501700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4015c2a0 con 0x7efc4006c0a0 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc46501700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc400c9900 con 0x7efc4006bcd0 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc46501700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4015b690 con 0x7efc400c9510 2023-10-07T09:06:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc4006bcd0 0x7efc40140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc4006bcd0 0x7efc40140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55394/0 (socket says 172.21.15.46:55394) 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 -- 172.21.15.46:0/3711193388 learned_addr learned my addr 172.21.15.46:0/3711193388 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc44a9e700 1 --2- 172.21.15.46:0/3711193388 >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 0x7efc40141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 -- 172.21.15.46:0/3711193388 >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 msgr2=0x7efc40141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 --2- 172.21.15.46:0/3711193388 >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 0x7efc40141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 -- 172.21.15.46:0/3711193388 >> v1:172.21.15.133:6789/0 conn(0x7efc4006c0a0 legacy=0x7efc400c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 -- 172.21.15.46:0/3711193388 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4015b970 con 0x7efc4006bcd0 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc44a9e700 1 --2- 172.21.15.46:0/3711193388 >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 0x7efc40141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:40.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.828+0000 7efc3ffff700 1 --2- 172.21.15.46:0/3711193388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc4006bcd0 0x7efc40140df0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7efc400ce190 tx=0x7efc30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d1f1dfa7780169 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.830+0000 7efc3effd700 1 -- 172.21.15.46:0/3711193388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000b860 con 0x7efc4006bcd0 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.830+0000 7efc3effd700 1 -- 172.21.15.46:0/3711193388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000b9c0 con 0x7efc4006bcd0 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.830+0000 7efc3effd700 1 -- 172.21.15.46:0/3711193388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000bd60 con 0x7efc4006bcd0 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 -- 172.21.15.46:0/3711193388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc4006bcd0 msgr2=0x7efc40140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 --2- 172.21.15.46:0/3711193388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc4006bcd0 0x7efc40140df0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7efc400ce190 tx=0x7efc30009250 comp rx=0 tx=0).stop 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 -- 172.21.15.46:0/3711193388 shutdown_connections 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 --2- 172.21.15.46:0/3711193388 >> v2:172.21.15.133:3300/0 conn(0x7efc400c9510 0x7efc40141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 --2- 172.21.15.46:0/3711193388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc4006bcd0 0x7efc40140df0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 -- 172.21.15.46:0/3711193388 >> 172.21.15.46:0/3711193388 conn(0x7efc400ce600 msgr2=0x7efc400cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 -- 172.21.15.46:0/3711193388 shutdown_connections 2023-10-07T09:06:40.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.831+0000 7efc46501700 1 -- 172.21.15.46:0/3711193388 wait complete. 2023-10-07T09:06:40.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.832+0000 7efc46501700 1 Processor -- start 2023-10-07T09:06:40.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.832+0000 7efc46501700 1 -- start start 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4006bcd0 0x7efc4013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc4006c0a0 0x7efc400a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c56b0 con 0x7efc400c9510 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c5990 con 0x7efc4006bcd0 2023-10-07T09:06:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc46501700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c5c70 con 0x7efc4006c0a0 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55400/0 (socket says 172.21.15.46:55400) 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 -- 172.21.15.46:0/812993726 learned_addr learned my addr 172.21.15.46:0/812993726 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc3f7fe700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc4006c0a0 0x7efc400a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc3ffff700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4006bcd0 0x7efc4013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 -- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc4006c0a0 msgr2=0x7efc400a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc4006c0a0 0x7efc400a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 -- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4006bcd0 msgr2=0x7efc4013f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4006bcd0 0x7efc4013f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.833+0000 7efc44a9e700 1 -- 172.21.15.46:0/812993726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300094f0 con 0x7efc400c9510 2023-10-07T09:06:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc44a9e700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7efc38009fc0 tx=0x7efc380099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800dbe0 con 0x7efc400c9510 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800f040 con 0x7efc400c9510 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc400c5f50 con 0x7efc400c9510 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38015440 con 0x7efc400c9510 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc400c6510 con 0x7efc400c9510 2023-10-07T09:06:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.835+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc400c6d60 con 0x7efc400c9510 2023-10-07T09:06:40.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.835+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efc3801e3b0 con 0x7efc400c9510 2023-10-07T09:06:40.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.835+0000 7efc27fff700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 0x7efc2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:40.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.836+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efc38084e60 con 0x7efc400c9510 2023-10-07T09:06:40.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.836+0000 7efc3ffff700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 0x7efc2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:40.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.836+0000 7efc3ffff700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 0x7efc2c0697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efc400ce190 tx=0x7efc30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:40.840+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc38051ce0 con 0x7efc400c9510 2023-10-07T09:06:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.049+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efc4004c3c0 con 0x7efc400c9510 2023-10-07T09:06:41.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.831+0000 7efc27fff700 1 -- 172.21.15.46:0/812993726 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) v1 ==== 97+0+0 (secure 0 0 0) 0x7efc3801a080 con 0x7efc400c9510 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 msgr2=0x7efc2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 0x7efc2c0697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efc400ce190 tx=0x7efc30017000 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 msgr2=0x7efc400a6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7efc38009fc0 tx=0x7efc380099b0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 shutdown_connections 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc2c067320 0x7efc2c0697d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc400c9510 0x7efc400a6a00 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4006bcd0 0x7efc4013f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 --2- 172.21.15.46:0/812993726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc4006c0a0 0x7efc400a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 >> 172.21.15.46:0/812993726 conn(0x7efc400ce600 msgr2=0x7efc400ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:41.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 shutdown_connections 2023-10-07T09:06:41.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.834+0000 7efc46501700 1 -- 172.21.15.46:0/812993726 wait complete. 2023-10-07T09:06:41.837 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:06:41.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:06:41.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.976+0000 7fac21784700 1 Processor -- start 2023-10-07T09:06:41.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.976+0000 7fac21784700 1 -- start start 2023-10-07T09:06:41.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac21784700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac1c159890 0x7fac1c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac21784700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac1c159c60 0x7fac1c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac21784700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c15a160 con 0x7fac1c15db10 2023-10-07T09:06:41.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac21784700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c15df50 con 0x7fac1c159c60 2023-10-07T09:06:41.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac21784700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0d13a0 con 0x7fac1c159890 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac1c159c60 0x7fac1c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac1c159c60 0x7fac1c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55414/0 (socket says 172.21.15.46:55414) 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1b7fe700 1 --1- 172.21.15.46:0/3965109590 >> v1:172.21.15.46:6789/0 conn(0x7fac1c15db10 0x7fac1c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54198/0 (socket says 172.21.15.46:54198) 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 -- 172.21.15.46:0/3965109590 learned_addr learned my addr 172.21.15.46:0/3965109590 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1affd700 1 --2- 172.21.15.46:0/3965109590 >> v2:172.21.15.133:3300/0 conn(0x7fac1c159890 0x7fac1c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 -- 172.21.15.46:0/3965109590 >> v2:172.21.15.133:3300/0 conn(0x7fac1c159890 msgr2=0x7fac1c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 --2- 172.21.15.46:0/3965109590 >> v2:172.21.15.133:3300/0 conn(0x7fac1c159890 0x7fac1c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 -- 172.21.15.46:0/3965109590 >> v1:172.21.15.46:6789/0 conn(0x7fac1c15db10 legacy=0x7fac1c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 -- 172.21.15.46:0/3965109590 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c15e140 con 0x7fac1c159c60 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac19ffb700 1 -- 172.21.15.46:0/3965109590 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650358493 0 0) 0x7fac1c15a160 con 0x7fac1c15db10 2023-10-07T09:06:41.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac1a7fc700 1 --2- 172.21.15.46:0/3965109590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c159c60 0x7fac1c15d5d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0d1090 tx=0x7fac04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132b89bed239193 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac19ffb700 1 -- 172.21.15.46:0/3965109590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04009e70 con 0x7fac1c159c60 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac19ffb700 1 -- 172.21.15.46:0/3965109590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0400b860 con 0x7fac1c159c60 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.977+0000 7fac19ffb700 1 -- 172.21.15.46:0/3965109590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400bc00 con 0x7fac1c159c60 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 -- 172.21.15.46:0/3965109590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c159c60 msgr2=0x7fac1c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 --2- 172.21.15.46:0/3965109590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c159c60 0x7fac1c15d5d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0d1090 tx=0x7fac04009250 comp rx=0 tx=0).stop 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 -- 172.21.15.46:0/3965109590 shutdown_connections 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 --2- 172.21.15.46:0/3965109590 >> v2:172.21.15.133:3300/0 conn(0x7fac1c159890 0x7fac1c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 --2- 172.21.15.46:0/3965109590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c159c60 0x7fac1c15d5d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 -- 172.21.15.46:0/3965109590 >> 172.21.15.46:0/3965109590 conn(0x7fac1c068e20 msgr2=0x7fac1c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:41.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 -- 172.21.15.46:0/3965109590 shutdown_connections 2023-10-07T09:06:41.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.978+0000 7fac21784700 1 -- 172.21.15.46:0/3965109590 wait complete. 2023-10-07T09:06:41.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.979+0000 7fac21784700 1 Processor -- start 2023-10-07T09:06:41.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.979+0000 7fac21784700 1 -- start start 2023-10-07T09:06:41.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 0x7fac1c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 0x7fac1c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c151ff0 con 0x7fac1c15db10 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0cdc20 con 0x7fac1c159890 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac21784700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0cdec0 con 0x7fac1c159c60 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55430/0 (socket says 172.21.15.46:55430) 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 -- 172.21.15.46:0/527687254 learned_addr learned my addr 172.21.15.46:0/527687254 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1affd700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 0x7fac1c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1a7fc700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 0x7fac1c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 -- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 msgr2=0x7fac1c14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 0x7fac1c14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 -- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 msgr2=0x7fac1c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 0x7fac1c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1b7fe700 1 -- 172.21.15.46:0/527687254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040094f0 con 0x7fac1c15db10 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1a7fc700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 0x7fac1c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.980+0000 7fac1affd700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 0x7fac1c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac1b7fe700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fac1400ccc0 tx=0x7fac14001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400ce00 con 0x7fac1c15db10 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14005df0 con 0x7fac1c15db10 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c152e50 con 0x7fac1c15db10 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400abb0 con 0x7fac1c15db10 2023-10-07T09:06:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.981+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c0ce720 con 0x7fac1c15db10 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.982+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c0ce080 con 0x7fac1c15db10 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.982+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fac140070f0 con 0x7fac1c15db10 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.982+0000 7fac12ffd700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 0x7fabfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.983+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fac14084a60 con 0x7fac1c15db10 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.983+0000 7fac1affd700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 0x7fabfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.983+0000 7fac1affd700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 0x7fabfc0697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d80 tx=0x7fac0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:41.987+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac14051ac0 con 0x7fac1c15db10 2023-10-07T09:06:42.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.258+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fac1c152130 con 0x7fac1c15db10 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.258+0000 7fac12ffd700 1 -- 172.21.15.46:0/527687254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fac140550e0 con 0x7fac1c15db10 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:06:42.260 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:06:42.261 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.263 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:06:42.264 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.265 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.266 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:06:42.267 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.268 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.269 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:06:42.274 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:06:42.275 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:06:42.275 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.275 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:42.275 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:06:42.275 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:06:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 msgr2=0x7fabfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 0x7fabfc0697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d80 tx=0x7fac0c008040 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 msgr2=0x7fac1c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fac1400ccc0 tx=0x7fac14001a70 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 shutdown_connections 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fabfc067320 0x7fabfc0697d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac1c15db10 0x7fac1c152300 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c159890 0x7fac1c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 --2- 172.21.15.46:0/527687254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac1c159c60 0x7fac1c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 >> 172.21.15.46:0/527687254 conn(0x7fac1c068e20 msgr2=0x7fac1c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 shutdown_connections 2023-10-07T09:06:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.260+0000 7fac21784700 1 -- 172.21.15.46:0/527687254 wait complete. 2023-10-07T09:06:42.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.395+0000 7f3e9e5d9700 1 Processor -- start 2023-10-07T09:06:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.395+0000 7f3e9e5d9700 1 -- start start 2023-10-07T09:06:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e9806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e980c8400 0x7f3e9806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e9806c120 0x7f3e9806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9806e8e0 con 0x7f3e9806c120 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9815a8f0 con 0x7f3e980c8400 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9e5d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815abd0 con 0x7f3e981597d0 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e9806c120 0x7f3e9806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e9806c120 0x7f3e9806f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55436/0 (socket says 172.21.15.46:55436) 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 -- 172.21.15.46:0/1014599060 learned_addr learned my addr 172.21.15.46:0/1014599060 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9cdd6700 1 --2- 172.21.15.46:0/1014599060 >> v2:172.21.15.133:3300/0 conn(0x7f3e980c8400 0x7f3e9806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9d5d7700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e9806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 -- 172.21.15.46:0/1014599060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 msgr2=0x7f3e9806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e9806bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 -- 172.21.15.46:0/1014599060 >> v2:172.21.15.133:3300/0 conn(0x7f3e980c8400 msgr2=0x7f3e9806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 --2- 172.21.15.46:0/1014599060 >> v2:172.21.15.133:3300/0 conn(0x7f3e980c8400 0x7f3e9806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.396+0000 7f3e9ddd8700 1 -- 172.21.15.46:0/1014599060 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9815aeb0 con 0x7f3e9806c120 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9ddd8700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e9806c120 0x7f3e9806f2b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3e9806dda0 tx=0x7f3e90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24370647201ecdf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e8ffff700 1 -- 172.21.15.46:0/1014599060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000e070 con 0x7f3e9806c120 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e8ffff700 1 -- 172.21.15.46:0/1014599060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9000b970 con 0x7f3e9806c120 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e8ffff700 1 -- 172.21.15.46:0/1014599060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900092e0 con 0x7f3e9806c120 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/1014599060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e9806c120 msgr2=0x7f3e9806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e9806c120 0x7f3e9806f2b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3e9806dda0 tx=0x7f3e90009840 comp rx=0 tx=0).stop 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/1014599060 shutdown_connections 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e9806c120 0x7f3e9806f2b0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/1014599060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e9806bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/1014599060 >> v2:172.21.15.133:3300/0 conn(0x7f3e980c8400 0x7f3e9806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/1014599060 >> 172.21.15.46:0/1014599060 conn(0x7f3e9806b450 msgr2=0x7f3e980cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/1014599060 shutdown_connections 2023-10-07T09:06:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.397+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/1014599060 wait complete. 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.399+0000 7f3e9e5d9700 1 Processor -- start 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.399+0000 7f3e9e5d9700 1 -- start start 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.399+0000 7f3e9e5d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e9806c120 0x7f3e98151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.399+0000 7f3e9e5d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e980c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815df90 con 0x7f3e980c8400 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815b5b0 con 0x7f3e9806c120 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98156d10 con 0x7f3e981597d0 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55450/0 (socket says 172.21.15.46:55450) 2023-10-07T09:06:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 -- 172.21.15.46:0/731949610 learned_addr learned my addr 172.21.15.46:0/731949610 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9d5d7700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e9806c120 0x7f3e98151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9ddd8700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e980c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 -- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 msgr2=0x7f3e980c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e980c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 -- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e9806c120 msgr2=0x7f3e98151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e9806c120 0x7f3e98151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 -- 172.21.15.46:0/731949610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009ae0 con 0x7f3e980c8400 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9cdd6700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ec50 tx=0x7f3e88009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800c850 con 0x7f3e980c8400 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800c9b0 con 0x7f3e980c8400 2023-10-07T09:06:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e98156ff0 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800cd30 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.400+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9815b240 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.401+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9815b740 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.402+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3e88013680 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.402+0000 7f3e8d7fa700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 0x7f3e7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.402+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e88084f00 con 0x7f3e980c8400 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.402+0000 7f3e9d5d7700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 0x7f3e7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.403+0000 7f3e9d5d7700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 0x7f3e7c0697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009d10 tx=0x7f3e940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.406+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e88051ee0 con 0x7f3e980c8400 2023-10-07T09:06:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.602+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e9804c3c0 con 0x7f3e980c8400 2023-10-07T09:06:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.602+0000 7f3e8d7fa700 1 -- 172.21.15.46:0/731949610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f3e88017090 con 0x7f3e980c8400 2023-10-07T09:06:42.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:42.604 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":161,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:41.829996+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 msgr2=0x7f3e7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 0x7f3e7c0697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009d10 tx=0x7f3e940091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 msgr2=0x7f3e98151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ec50 tx=0x7f3e88009120 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 shutdown_connections 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3e7c067320 0x7f3e7c0697d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e981597d0 0x7f3e980c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e9806c120 0x7f3e98151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 --2- 172.21.15.46:0/731949610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980c8400 0x7f3e98151200 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 >> 172.21.15.46:0/731949610 conn(0x7f3e9806b450 msgr2=0x7f3e980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:42.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 shutdown_connections 2023-10-07T09:06:42.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.605+0000 7f3e9e5d9700 1 -- 172.21.15.46:0/731949610 wait complete. 2023-10-07T09:06:42.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:06:42.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:06:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.739+0000 7fe4aeac2700 1 Processor -- start 2023-10-07T09:06:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.739+0000 7fe4aeac2700 1 -- start start 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4aeac2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4a8159c60 0x7fe4a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4aeac2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a815a160 con 0x7fe4a8159890 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4aeac2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a80d13a0 con 0x7fe4a815db10 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4aeac2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a815df50 con 0x7fe4a8159c60 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4ac85e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe4a8159890 0x7fe4a815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54200/0 (socket says 172.21.15.46:54200) 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.740+0000 7fe4ac85e700 1 -- 172.21.15.46:0/3958560197 learned_addr learned my addr 172.21.15.46:0/3958560197 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a7fff700 1 --2- 172.21.15.46:0/3958560197 >> v2:172.21.15.133:3300/0 conn(0x7fe4a8159c60 0x7fe4a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731395321 0 0) 0x7fe4a815a160 con 0x7fe4a8159890 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe490003570 con 0x7fe4a8159890 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a7fff700 1 -- 172.21.15.46:0/3958560197 >> v1:172.21.15.133:6789/0 conn(0x7fe4a815db10 legacy=0x7fe4a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385123525 0 0) 0x7fe490003570 con 0x7fe4a8159890 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a7fff700 1 -- 172.21.15.46:0/3958560197 >> v1:172.21.15.46:6789/0 conn(0x7fe4a8159890 legacy=0x7fe4a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a7fff700 1 -- 172.21.15.46:0/3958560197 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a815e140 con 0x7fe4a8159c60 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a7fff700 1 --2- 172.21.15.46:0/3958560197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a8159c60 0x7fe4a815d5d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098e0 tx=0x7fe49c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbb468dd13d27642 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498001470 con 0x7fe4a8159c60 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c011420 con 0x7fe4a8159c60 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.741+0000 7fe4a77fe700 1 -- 172.21.15.46:0/3958560197 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0117c0 con 0x7fe4a8159c60 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 -- 172.21.15.46:0/3958560197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a8159c60 msgr2=0x7fe4a815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/3958560197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a8159c60 0x7fe4a815d5d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098e0 tx=0x7fe49c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 -- 172.21.15.46:0/3958560197 shutdown_connections 2023-10-07T09:06:42.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/3958560197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a8159c60 0x7fe4a815d5d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 -- 172.21.15.46:0/3958560197 >> 172.21.15.46:0/3958560197 conn(0x7fe4a8068e20 msgr2=0x7fe4a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:42.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 -- 172.21.15.46:0/3958560197 shutdown_connections 2023-10-07T09:06:42.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.742+0000 7fe4aeac2700 1 -- 172.21.15.46:0/3958560197 wait complete. 2023-10-07T09:06:42.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.743+0000 7fe4aeac2700 1 Processor -- start 2023-10-07T09:06:42.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.743+0000 7fe4aeac2700 1 -- start start 2023-10-07T09:06:42.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4a8159890 0x7fe4a80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 0x7fe4a80cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a816a8d0 con 0x7fe4a8159c60 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80b1eb0 con 0x7fe4a815db10 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4aeac2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80b5090 con 0x7fe4a8159890 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55462/0 (socket says 172.21.15.46:55462) 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 -- 172.21.15.46:0/1655625424 learned_addr learned my addr 172.21.15.46:0/1655625424 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4ad05f700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 0x7fe4a80cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4ac85e700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4a8159890 0x7fe4a80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 -- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4a8159890 msgr2=0x7fe4a80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4a8159890 0x7fe4a80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 -- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 msgr2=0x7fe4a80cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 0x7fe4a80cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4a7fff700 1 -- 172.21.15.46:0/1655625424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009420 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.744+0000 7fe4ad05f700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 0x7fe4a80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4a7fff700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0091e0 tx=0x7fe49c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c01cc90 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c01cdf0 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a80cd640 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c01a6a0 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.745+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a80b5330 con 0x7fe4a8159c60 2023-10-07T09:06:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.746+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a80b24f0 con 0x7fe4a8159c60 2023-10-07T09:06:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.746+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe49c01aa50 con 0x7fe4a8159c60 2023-10-07T09:06:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.746+0000 7fe4a4ff9700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 0x7fe4940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.747+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe49c0863c0 con 0x7fe4a8159c60 2023-10-07T09:06:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.747+0000 7fe4ac85e700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 0x7fe4940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.747+0000 7fe4ac85e700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 0x7fe4940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe4980011e0 tx=0x7fe498000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.751+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4a80b24f0 con 0x7fe4a8159c60 2023-10-07T09:06:42.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:06:42.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:06:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.945+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4a80b4ef0 con 0x7fe4a8159c60 2023-10-07T09:06:42.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.945+0000 7fe4a4ff9700 1 -- 172.21.15.46:0/1655625424 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4a80b4ef0 con 0x7fe4a8159c60 2023-10-07T09:06:42.947 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 msgr2=0x7fe4940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 0x7fe4940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe4980011e0 tx=0x7fe498000bc0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 msgr2=0x7fe4a816a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0091e0 tx=0x7fe49c016000 comp rx=0 tx=0).stop 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 shutdown_connections 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe494067320 0x7fe4940697d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4a815db10 0x7fe4a80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4a8159890 0x7fe4a80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 --2- 172.21.15.46:0/1655625424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a8159c60 0x7fe4a816a390 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 >> 172.21.15.46:0/1655625424 conn(0x7fe4a8068e20 msgr2=0x7fe4a8158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 shutdown_connections 2023-10-07T09:06:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:42.947+0000 7fe4aeac2700 1 -- 172.21.15.46:0/1655625424 wait complete. 2023-10-07T09:06:42.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:06:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.077+0000 7f0dd1070700 1 Processor -- start 2023-10-07T09:06:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 -- start start 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc0cc300 con 0x7f0dcc15a270 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc156bf0 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dd1070700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0ae950 con 0x7f0dcc0cbf30 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.078+0000 7f0dca59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55472/0 (socket says 172.21.15.46:55472) 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dcb59e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0dcc15a270 0x7f0dcc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54210/0 (socket says 172.21.15.46:54210) 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 -- 172.21.15.46:0/2373341959 learned_addr learned my addr 172.21.15.46:0/2373341959 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 -- 172.21.15.46:0/2373341959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 msgr2=0x7f0dcc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 --2- 172.21.15.46:0/2373341959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 -- 172.21.15.46:0/2373341959 >> v1:172.21.15.46:6789/0 conn(0x7f0dcc15a270 legacy=0x7f0dcc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 -- 172.21.15.46:0/2373341959 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0ad370 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dc9d9b700 1 -- 172.21.15.46:0/2373341959 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456016711 0 0) 0x7f0dcc0cc300 con 0x7f0dcc15a270 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dca59c700 1 --2- 172.21.15.46:0/2373341959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0db40099e0 tx=0x7f0db4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4286452ef03815c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dc9d9b700 1 -- 172.21.15.46:0/2373341959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400b820 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dc9d9b700 1 -- 172.21.15.46:0/2373341959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400b980 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.079+0000 7f0dc9d9b700 1 -- 172.21.15.46:0/2373341959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400bd20 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 -- 172.21.15.46:0/2373341959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc0ccf90 msgr2=0x7f0dcc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 --2- 172.21.15.46:0/2373341959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0db40099e0 tx=0x7f0db4009250 comp rx=0 tx=0).stop 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 -- 172.21.15.46:0/2373341959 shutdown_connections 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 --2- 172.21.15.46:0/2373341959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 --2- 172.21.15.46:0/2373341959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc0b0d10 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 -- 172.21.15.46:0/2373341959 >> 172.21.15.46:0/2373341959 conn(0x7f0dcc06a320 msgr2=0x7f0dcc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 -- 172.21.15.46:0/2373341959 shutdown_connections 2023-10-07T09:06:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.080+0000 7f0dd1070700 1 -- 172.21.15.46:0/2373341959 wait complete. 2023-10-07T09:06:43.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.081+0000 7f0dd1070700 1 Processor -- start 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.081+0000 7f0dd1070700 1 -- start start 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc166a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc166f60 con 0x7f0dcc15a270 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0abf10 con 0x7f0dcc0ccf90 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc169410 con 0x7f0dcc0cbf30 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55478/0 (socket says 172.21.15.46:55478) 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 -- 172.21.15.46:0/590786737 learned_addr learned my addr 172.21.15.46:0/590786737 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcad9d700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 -- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 msgr2=0x7f0dcc0a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dca59c700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc166a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 -- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dcc0ccf90 msgr2=0x7f0dcc166a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc166a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 -- 172.21.15.46:0/590786737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40094f0 con 0x7f0dcc15a270 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dcb59e700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400ccf0 tx=0x7f0dc4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400ce30 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc4005df0 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc1670d0 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.082+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400ab10 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.083+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc0a7ed0 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.083+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc167260 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.084+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0dc40070f0 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.084+0000 7f0dc2ffd700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 0x7f0dac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.084+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0dc4084b50 con 0x7f0dcc15a270 2023-10-07T09:06:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.084+0000 7f0dcad9d700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 0x7f0dac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.085+0000 7f0dcad9d700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 0x7f0dac0697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006fd0 tx=0x7f0dbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.088+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dc4051c70 con 0x7f0dcc15a270 2023-10-07T09:06:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.284+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0dcc04c3c0 con 0x7f0dcc15a270 2023-10-07T09:06:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.284+0000 7f0dc2ffd700 1 -- 172.21.15.46:0/590786737 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0dc4055290 con 0x7f0dcc15a270 2023-10-07T09:06:43.286 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:43.286 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:43.286 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:43.286 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:06:43.287 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:06:43.287 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:43.287 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 msgr2=0x7f0dac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 0x7f0dac0697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006fd0 tx=0x7f0dbc008040 comp rx=0 tx=0).stop 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 msgr2=0x7f0dcc168ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400ccf0 tx=0x7f0dc4001a70 comp rx=0 tx=0).stop 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 shutdown_connections 2023-10-07T09:06:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0dac067320 0x7f0dac0697d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0dcc15a270 0x7f0dcc168ed0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0dcc0cbf30 0x7f0dcc0a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 --2- 172.21.15.46:0/590786737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dcc0ccf90 0x7f0dcc166a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 >> 172.21.15.46:0/590786737 conn(0x7f0dcc06a320 msgr2=0x7f0dcc0ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 shutdown_connections 2023-10-07T09:06:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.286+0000 7f0dd1070700 1 -- 172.21.15.46:0/590786737 wait complete. 2023-10-07T09:06:43.300 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:06:43.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:06:43.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.421+0000 7f65a8bb9700 1 Processor -- start 2023-10-07T09:06:43.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.421+0000 7f65a8bb9700 1 -- start start 2023-10-07T09:06:43.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.422+0000 7f65a8bb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.422+0000 7f65a8bb9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65a40af8c0 0x7f65a4159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.422+0000 7f65a8bb9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a4068900 con 0x7f65a4068390 2023-10-07T09:06:43.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.422+0000 7f65a8bb9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a4068be0 con 0x7f65a40af8c0 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.422+0000 7f65a8bb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4068ec0 con 0x7f65a406ab40 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65a40af8c0 0x7f65a4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:60088/0 (socket says 172.21.15.46:60088) 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a1d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f65a4068390 0x7f65a40c10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:58600/0 (socket says 172.21.15.46:58600) 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a259c700 1 -- 172.21.15.46:0/1042894149 learned_addr learned my addr 172.21.15.46:0/1042894149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65a40af8c0 0x7f65a4159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:44780/0 (socket says 172.21.15.46:44780) 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 -- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 msgr2=0x7f65a40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 -- 172.21.15.46:0/1042894149 >> v1:172.21.15.133:6789/0 conn(0x7f65a4068390 legacy=0x7f65a40c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 -- 172.21.15.46:0/1042894149 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40691a0 con 0x7f65a40af8c0 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a259c700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a2d9d700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a4159620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e60 tx=0x7f659c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fec186e2ac00e40 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.423+0000 7f65a159a700 1 -- 172.21.15.46:0/1042894149 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00e070 con 0x7f65a40af8c0 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a159a700 1 -- 172.21.15.46:0/1042894149 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00bb60 con 0x7f65a40af8c0 2023-10-07T09:06:43.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a159a700 1 -- 172.21.15.46:0/1042894149 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c012430 con 0x7f65a40af8c0 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 -- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 msgr2=0x7f65a4159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a4159620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e60 tx=0x7f659c009780 comp rx=0 tx=0).stop 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 -- 172.21.15.46:0/1042894149 shutdown_connections 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a4159620 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/1042894149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a406ab40 0x7f65a40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 -- 172.21.15.46:0/1042894149 >> 172.21.15.46:0/1042894149 conn(0x7f65a40cd640 msgr2=0x7f65a40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 -- 172.21.15.46:0/1042894149 shutdown_connections 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.424+0000 7f65a8bb9700 1 -- 172.21.15.46:0/1042894149 wait complete. 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.425+0000 7f65a8bb9700 1 Processor -- start 2023-10-07T09:06:43.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.425+0000 7f65a8bb9700 1 -- start start 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a4068390 0x7f65a416a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4159ae0 con 0x7f65a406ab40 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a416a8d0 con 0x7f65a40af8c0 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a8bb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4160140 con 0x7f65a4068390 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55490/0 (socket says 172.21.15.46:55490) 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 -- 172.21.15.46:0/4063007883 learned_addr learned my addr 172.21.15.46:0/4063007883 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a259c700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a4068390 0x7f65a416a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a2d9d700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 -- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a4068390 msgr2=0x7f65a416a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a4068390 0x7f65a416a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 -- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 msgr2=0x7f65a415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.426+0000 7f65a1d9b700 1 -- 172.21.15.46:0/4063007883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940094f0 con 0x7f65a406ab40 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65a1d9b700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f659800c7c0 tx=0x7f6598007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598005a70 con 0x7f65a406ab40 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598005bf0 con 0x7f65a406ab40 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980070f0 con 0x7f65a406ab40 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c009a20 con 0x7f65a406ab40 2023-10-07T09:06:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.427+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a4159490 con 0x7f65a406ab40 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.428+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a41592c0 con 0x7f65a406ab40 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.428+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6598007460 con 0x7f65a406ab40 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.428+0000 7f65927fc700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.429+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f65980842d0 con 0x7f65a406ab40 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.429+0000 7f65a259c700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.429+0000 7f65a259c700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 0x7f65840697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6594006d40 tx=0x7f6594008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.433+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6598051430 con 0x7f65a406ab40 2023-10-07T09:06:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.624+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f65a40718b0 con 0x7f65a406ab40 2023-10-07T09:06:43.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.847+0000 7f65927fc700 1 -- 172.21.15.46:0/4063007883 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6598054a50 con 0x7f65a406ab40 2023-10-07T09:06:43.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 msgr2=0x7f65840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 0x7f65840697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6594006d40 tx=0x7f6594008040 comp rx=0 tx=0).stop 2023-10-07T09:06:43.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 msgr2=0x7f65a415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f659800c7c0 tx=0x7f6598007f70 comp rx=0 tx=0).stop 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 shutdown_connections 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65a40af8c0 0x7f65a415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65a4068390 0x7f65a416a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 --2- 172.21.15.46:0/4063007883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65a406ab40 0x7f65a415d6a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.851+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 >> 172.21.15.46:0/4063007883 conn(0x7f65a40cd640 msgr2=0x7f65a406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:43.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.852+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 shutdown_connections 2023-10-07T09:06:43.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.852+0000 7f65a8bb9700 1 -- 172.21.15.46:0/4063007883 wait complete. 2023-10-07T09:06:43.855 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:06:43.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:06:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.993+0000 7fe6920ab700 1 Processor -- start 2023-10-07T09:06:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.993+0000 7fe6920ab700 1 -- start start 2023-10-07T09:06:43.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6920ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6920ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe68c15d930 0x7fe68c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6920ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0b10f0 con 0x7fe68c0cf480 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6920ab700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0cd530 con 0x7fe68c15d930 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6920ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c15e000 con 0x7fe68c1595d0 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe68c15d930 0x7fe68c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe68c15d930 0x7fe68c0b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55494/0 (socket says 172.21.15.46:55494) 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 -- 172.21.15.46:0/1532277942 learned_addr learned my addr 172.21.15.46:0/1532277942 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6910a9700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 -- 172.21.15.46:0/1532277942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 msgr2=0x7fe68c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 -- 172.21.15.46:0/1532277942 >> v1:172.21.15.133:6789/0 conn(0x7fe68c0cf480 legacy=0x7fe68c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe683fff700 1 -- 172.21.15.46:0/1532277942 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375634761 0 0) 0x7fe68c0b10f0 con 0x7fe68c0cf480 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.994+0000 7fe6918aa700 1 -- 172.21.15.46:0/1532277942 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0cf990 con 0x7fe68c15d930 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6918aa700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c0b1580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe684009f20 tx=0x7fe684009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500eb343a9fcb4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe683fff700 1 -- 172.21.15.46:0/1532277942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68400e070 con 0x7fe68c15d930 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe683fff700 1 -- 172.21.15.46:0/1532277942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400b9d0 con 0x7fe68c15d930 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe683fff700 1 -- 172.21.15.46:0/1532277942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840092e0 con 0x7fe68c15d930 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 -- 172.21.15.46:0/1532277942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 msgr2=0x7fe68c0b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c0b1580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe684009f20 tx=0x7fe684009840 comp rx=0 tx=0).stop 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 -- 172.21.15.46:0/1532277942 shutdown_connections 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c0b1580 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 --2- 172.21.15.46:0/1532277942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 -- 172.21.15.46:0/1532277942 >> 172.21.15.46:0/1532277942 conn(0x7fe68c0d05f0 msgr2=0x7fe68c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 -- 172.21.15.46:0/1532277942 shutdown_connections 2023-10-07T09:06:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.995+0000 7fe6920ab700 1 -- 172.21.15.46:0/1532277942 wait complete. 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.996+0000 7fe6920ab700 1 Processor -- start 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 -- start start 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68c0cf480 0x7fe68c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c151dc0 con 0x7fe68c15d930 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c153020 con 0x7fe68c0cf480 2023-10-07T09:06:44.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6920ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c1511b0 con 0x7fe68c1595d0 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.997+0000 7fe6918aa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55502/0 (socket says 172.21.15.46:55502) 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 -- 172.21.15.46:0/3380518988 learned_addr learned my addr 172.21.15.46:0/3380518988 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 -- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 msgr2=0x7fe68c14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 -- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68c0cf480 msgr2=0x7fe68c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68c0cf480 0x7fe68c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 -- 172.21.15.46:0/3380518988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684009ae0 con 0x7fe68c15d930 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6918aa700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe684012000 tx=0x7fe684018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684008c70 con 0x7fe68c15d930 2023-10-07T09:06:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684008e10 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c151490 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68401c660 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.998+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c151a50 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:43.999+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c04c3c0 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.000+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe684003040 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.000+0000 7fe6817fa700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 0x7fe6700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.000+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe684086400 con 0x7fe68c15d930 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.000+0000 7fe6910a9700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 0x7fe6700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.001+0000 7fe6910a9700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 0x7fe6700697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ba0 tx=0x7fe688009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.005+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe684053260 con 0x7fe68c15d930 2023-10-07T09:06:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.197+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe68c0b3860 con 0x7fe68c15d930 2023-10-07T09:06:44.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.853+0000 7fe6817fa700 1 -- 172.21.15.46:0/3380518988 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe684056880 con 0x7fe68c15d930 2023-10-07T09:06:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.863+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 msgr2=0x7fe6700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.863+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 0x7fe6700697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ba0 tx=0x7fe688009120 comp rx=0 tx=0).stop 2023-10-07T09:06:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.863+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 msgr2=0x7fe68c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.863+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe684012000 tx=0x7fe684018000 comp rx=0 tx=0).stop 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 shutdown_connections 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe670067320 0x7fe6700697d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe68c15d930 0x7fe68c15f1a0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68c0cf480 0x7fe68c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 --2- 172.21.15.46:0/3380518988 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe68c1595d0 0x7fe68c14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.864+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 >> 172.21.15.46:0/3380518988 conn(0x7fe68c0d05f0 msgr2=0x7fe68c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:44.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.865+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 shutdown_connections 2023-10-07T09:06:44.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:44.865+0000 7fe6920ab700 1 -- 172.21.15.46:0/3380518988 wait complete. 2023-10-07T09:06:44.873 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:06:44.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:06:45.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.011+0000 7fafa7262700 1 Processor -- start 2023-10-07T09:06:45.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.011+0000 7fafa7262700 1 -- start start 2023-10-07T09:06:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa7262700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 0x7fafa00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa7262700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa0069ee0 con 0x7fafa0159890 2023-10-07T09:06:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa7262700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa015a160 con 0x7fafa0159c60 2023-10-07T09:06:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa7262700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00d13a0 con 0x7fafa0069560 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa4ffe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fafa0159890 0x7fafa015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54212/0 (socket says 172.21.15.46:54212) 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa4ffe700 1 -- 172.21.15.46:0/267151569 learned_addr learned my addr 172.21.15.46:0/267151569 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa57ff700 1 --2- 172.21.15.46:0/267151569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 0x7fafa00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273249124 0 0) 0x7fafa0069ee0 con 0x7fafa0159890 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf88003570 con 0x7fafa0159890 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015072788 0 0) 0x7fafa015a160 con 0x7fafa0159c60 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa0069ee0 con 0x7fafa0159c60 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900054067 0 0) 0x7faf88003570 con 0x7fafa0159890 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa57ff700 1 -- 172.21.15.46:0/267151569 >> v1:172.21.15.133:6789/0 conn(0x7fafa0159c60 legacy=0x7fafa015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa57ff700 1 -- 172.21.15.46:0/267151569 >> v1:172.21.15.46:6789/0 conn(0x7fafa0159890 legacy=0x7fafa015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.012+0000 7fafa57ff700 1 -- 172.21.15.46:0/267151569 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa015e140 con 0x7fafa0069560 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa57ff700 1 --2- 172.21.15.46:0/267151569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 0x7fafa00699a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e90 tx=0x7faf98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bd29f3b7275800 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800e070 con 0x7fafa0069560 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9800b870 con 0x7fafa0069560 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7faf977fe700 1 -- 172.21.15.46:0/267151569 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c001470 con 0x7fafa0069560 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 -- 172.21.15.46:0/267151569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 msgr2=0x7fafa00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 --2- 172.21.15.46:0/267151569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 0x7fafa00699a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e90 tx=0x7faf98009780 comp rx=0 tx=0).stop 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 -- 172.21.15.46:0/267151569 shutdown_connections 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 --2- 172.21.15.46:0/267151569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0069560 0x7fafa00699a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 -- 172.21.15.46:0/267151569 >> 172.21.15.46:0/267151569 conn(0x7fafa0068e20 msgr2=0x7fafa00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 -- 172.21.15.46:0/267151569 shutdown_connections 2023-10-07T09:06:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.013+0000 7fafa7262700 1 -- 172.21.15.46:0/267151569 wait complete. 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.015+0000 7fafa7262700 1 Processor -- start 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.015+0000 7fafa7262700 1 -- start start 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.015+0000 7fafa7262700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 0x7fafa00b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 0x7fafa015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa015c510 con 0x7fafa0069560 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa015bf50 con 0x7fafa0159890 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa015c230 con 0x7fafa0159c60 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55516/0 (socket says 172.21.15.46:55516) 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 -- 172.21.15.46:0/3893603529 learned_addr learned my addr 172.21.15.46:0/3893603529 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7faf97fff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 0x7fafa00b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa57ff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 0x7fafa015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 -- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 msgr2=0x7fafa015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 0x7fafa015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 -- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 msgr2=0x7fafa00b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 0x7fafa00b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 -- 172.21.15.46:0/3893603529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009a20 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa57ff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 0x7fafa015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7faf97fff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 0x7fafa00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa4ffe700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00cb90 tx=0x7faf9c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c007360 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0074e0 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c004830 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa00ce7e0 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.016+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa015d460 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.017+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa00ced00 con 0x7fafa0069560 2023-10-07T09:06:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.018+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faf9c004ba0 con 0x7fafa0069560 2023-10-07T09:06:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.018+0000 7faf94ff9700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 0x7faf8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.018+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5605+0+0 (secure 0 0 0) 0x7faf9c084070 con 0x7fafa0069560 2023-10-07T09:06:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.018+0000 7faf97fff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 0x7faf8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.019+0000 7faf97fff700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 0x7faf8c0697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fafa00b2630 tx=0x7faf90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:45.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.023+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafa00ced00 con 0x7fafa0069560 2023-10-07T09:06:45.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.260+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fafa00ced00 con 0x7fafa0069560 2023-10-07T09:06:45.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.942+0000 7faf94ff9700 1 -- 172.21.15.46:0/3893603529 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v107) v1 ==== 174+0+0 (secure 0 0 0) 0x7faf9c018020 con 0x7fafa0069560 2023-10-07T09:06:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 msgr2=0x7faf8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 0x7faf8c0697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fafa00b2630 tx=0x7faf90009040 comp rx=0 tx=0).stop 2023-10-07T09:06:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 msgr2=0x7fafa01540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00cb90 tx=0x7faf9c001b50 comp rx=0 tx=0).stop 2023-10-07T09:06:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 shutdown_connections 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf8c067320 0x7faf8c0697d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafa0159c60 0x7fafa015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafa0069560 0x7fafa01540c0 secure :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00cb90 tx=0x7faf9c001b50 comp rx=0 tx=0).stop 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 --2- 172.21.15.46:0/3893603529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafa0159890 0x7fafa00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.947+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 >> 172.21.15.46:0/3893603529 conn(0x7fafa0068e20 msgr2=0x7fafa00c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.948+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 shutdown_connections 2023-10-07T09:06:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:45.948+0000 7fafa7262700 1 -- 172.21.15.46:0/3893603529 wait complete. 2023-10-07T09:06:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 28 and data pool 29 2023-10-07T09:06:45.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 Processor -- start 2023-10-07T09:06:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 -- start start 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d28159890 0x7f2d2815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d28159c60 0x7f2d2815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d2815db10 0x7f2d28069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2815a160 con 0x7f2d28159890 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d280d13a0 con 0x7f2d2815db10 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.089+0000 7f2d2f01c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2815e140 con 0x7f2d28159c60 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d28159890 0x7f2d2815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d28159890 0x7f2d2815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55526/0 (socket says 172.21.15.46:55526) 2023-10-07T09:06:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/3731140315 learned_addr learned my addr 172.21.15.46:0/3731140315 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d27fff700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d28159c60 0x7f2d2815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2d5b9700 1 --2- 172.21.15.46:0/3731140315 >> v2:172.21.15.133:3300/0 conn(0x7f2d2815db10 0x7f2d28069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/3731140315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d28159c60 msgr2=0x7f2d2815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d28159c60 0x7f2d2815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/3731140315 >> v2:172.21.15.133:3300/0 conn(0x7f2d2815db10 msgr2=0x7f2d28069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/3731140315 >> v2:172.21.15.133:3300/0 conn(0x7f2d2815db10 0x7f2d28069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/3731140315 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2815a3d0 con 0x7f2d28159890 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d2815abd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2d28089b50 tx=0x7f2d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6aa32d0c53619ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d277fe700 1 -- 172.21.15.46:0/3731140315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000b860 con 0x7f2d28159890 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d277fe700 1 -- 172.21.15.46:0/3731140315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000b9c0 con 0x7f2d28159890 2023-10-07T09:06:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.090+0000 7f2d277fe700 1 -- 172.21.15.46:0/3731140315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000bd60 con 0x7f2d28159890 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 -- 172.21.15.46:0/3731140315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 msgr2=0x7f2d2815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d2815abd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2d28089b50 tx=0x7f2d10009250 comp rx=0 tx=0).stop 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 -- 172.21.15.46:0/3731140315 shutdown_connections 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/3731140315 >> v2:172.21.15.133:3300/0 conn(0x7f2d2815db10 0x7f2d28069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d2815abd0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/3731140315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d28159c60 0x7f2d2815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 -- 172.21.15.46:0/3731140315 >> 172.21.15.46:0/3731140315 conn(0x7f2d28068e20 msgr2=0x7f2d280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 -- 172.21.15.46:0/3731140315 shutdown_connections 2023-10-07T09:06:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.091+0000 7f2d2f01c700 1 -- 172.21.15.46:0/3731140315 wait complete. 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.092+0000 7f2d2f01c700 1 Processor -- start 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.092+0000 7f2d2f01c700 1 -- start start 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d28159c60 0x7f2d2815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2815db10 0x7f2d2815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280cb6f0 con 0x7f2d28159890 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280c78a0 con 0x7f2d28159c60 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2f01c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280c8140 con 0x7f2d2815db10 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55532/0 (socket says 172.21.15.46:55532) 2023-10-07T09:06:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/1821133745 learned_addr learned my addr 172.21.15.46:0/1821133745 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d27fff700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d28159c60 0x7f2d2815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2d5b9700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2815db10 0x7f2d2815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2815db10 msgr2=0x7f2d2815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2815db10 0x7f2d2815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d28159c60 msgr2=0x7f2d2815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d28159c60 0x7f2d2815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 -- 172.21.15.46:0/1821133745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100094f0 con 0x7f2d28159890 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.093+0000 7f2d2cdb8700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2d28070e20 tx=0x7f2d10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.094+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011e70 con 0x7f2d28159890 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.094+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10024440 con 0x7f2d28159890 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.094+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d281477c0 con 0x7f2d28159890 2023-10-07T09:06:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.094+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10024800 con 0x7f2d28159890 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.094+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d280c7af0 con 0x7f2d28159890 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.095+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2804c3c0 con 0x7f2d28159890 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.095+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d1001a420 con 0x7f2d28159890 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.095+0000 7f2d24ff9700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 0x7f2d080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.096+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d10086c40 con 0x7f2d28159890 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.096+0000 7f2d27fff700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 0x7f2d080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.096+0000 7f2d27fff700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 0x7f2d080697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009fd0 tx=0x7f2d18009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.100+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d100538d0 con 0x7f2d28159890 2023-10-07T09:06:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.294+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d2806a5b0 con 0x7f2d28159890 2023-10-07T09:06:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.295+0000 7f2d24ff9700 1 -- 172.21.15.46:0/1821133745 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f2d10015090 con 0x7f2d28159890 2023-10-07T09:06:46.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:46.297 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":164,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:45.262437+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 msgr2=0x7f2d080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 0x7f2d080697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009fd0 tx=0x7f2d18009880 comp rx=0 tx=0).stop 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 msgr2=0x7f2d28147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2d28070e20 tx=0x7f2d10017000 comp rx=0 tx=0).stop 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 shutdown_connections 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d08067320 0x7f2d080697d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d2815db10 0x7f2d2815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d28159890 0x7f2d28147280 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 --2- 172.21.15.46:0/1821133745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d28159c60 0x7f2d2815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 >> 172.21.15.46:0/1821133745 conn(0x7f2d28068e20 msgr2=0x7f2d28069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 shutdown_connections 2023-10-07T09:06:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.297+0000 7f2d2f01c700 1 -- 172.21.15.46:0/1821133745 wait complete. 2023-10-07T09:06:46.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:46.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.428+0000 7efe4a00d700 1 Processor -- start 2023-10-07T09:06:46.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.428+0000 7efe4a00d700 1 -- start start 2023-10-07T09:06:46.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe4a00d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 0x7efe440caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe4a00d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe4406c0a0 0x7efe4415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe4a00d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4415d7e0 con 0x7efe4415df50 2023-10-07T09:06:46.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe4a00d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4415dac0 con 0x7efe4406c0a0 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe4a00d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4415aa30 con 0x7efe4406bcd0 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe42ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe4406c0a0 0x7efe4415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe42ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe4406c0a0 0x7efe4415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55538/0 (socket says 172.21.15.46:55538) 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe43fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efe4415df50 0x7efe440c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54226/0 (socket says 172.21.15.46:54226) 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe42ffd700 1 -- 172.21.15.46:0/3473536508 learned_addr learned my addr 172.21.15.46:0/3473536508 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.429+0000 7efe437fe700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 0x7efe440caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe42ffd700 1 -- 172.21.15.46:0/3473536508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 msgr2=0x7efe440caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe42ffd700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 0x7efe440caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe42ffd700 1 -- 172.21.15.46:0/3473536508 >> v1:172.21.15.46:6789/0 conn(0x7efe4415df50 legacy=0x7efe440c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe42ffd700 1 -- 172.21.15.46:0/3473536508 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4415ad10 con 0x7efe4406c0a0 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe437fe700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 0x7efe440caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe427fc700 1 -- 172.21.15.46:0/3473536508 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271656318 0 0) 0x7efe4415d7e0 con 0x7efe4415df50 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe42ffd700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406c0a0 0x7efe4415a1e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7efe380099b0 tx=0x7efe38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2ec9ca6acbc44e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe427fc700 1 -- 172.21.15.46:0/3473536508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800b860 con 0x7efe4406c0a0 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe427fc700 1 -- 172.21.15.46:0/3473536508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800b9c0 con 0x7efe4406c0a0 2023-10-07T09:06:46.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe427fc700 1 -- 172.21.15.46:0/3473536508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800bd80 con 0x7efe4406c0a0 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 -- 172.21.15.46:0/3473536508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406c0a0 msgr2=0x7efe4415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406c0a0 0x7efe4415a1e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7efe380099b0 tx=0x7efe38009250 comp rx=0 tx=0).stop 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 -- 172.21.15.46:0/3473536508 shutdown_connections 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406bcd0 0x7efe440caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 --2- 172.21.15.46:0/3473536508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406c0a0 0x7efe4415a1e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.430+0000 7efe4a00d700 1 -- 172.21.15.46:0/3473536508 >> 172.21.15.46:0/3473536508 conn(0x7efe440ce600 msgr2=0x7efe440cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.431+0000 7efe4a00d700 1 -- 172.21.15.46:0/3473536508 shutdown_connections 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.431+0000 7efe4a00d700 1 -- 172.21.15.46:0/3473536508 wait complete. 2023-10-07T09:06:46.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 Processor -- start 2023-10-07T09:06:46.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 -- start start 2023-10-07T09:06:46.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406c0a0 0x7efe4414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 0x7efe44157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe44158f10 con 0x7efe4406bcd0 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440b18b0 con 0x7efe4415df50 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.432+0000 7efe4a00d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe44159370 con 0x7efe4406c0a0 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55542/0 (socket says 172.21.15.46:55542) 2023-10-07T09:06:46.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 -- 172.21.15.46:0/1196220594 learned_addr learned my addr 172.21.15.46:0/1196220594 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe42ffd700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406c0a0 0x7efe4414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe43fff700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 0x7efe44157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 -- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406c0a0 msgr2=0x7efe4414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406c0a0 0x7efe4414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 -- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 msgr2=0x7efe44157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 0x7efe44157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 -- 172.21.15.46:0/1196220594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380094f0 con 0x7efe4406bcd0 2023-10-07T09:06:46.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe43fff700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 0x7efe44157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe437fe700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d890 tx=0x7efe34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400b600 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400b760 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe44158950 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400bb00 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.433+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe440b1540 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.434+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe440b13a0 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.435+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efe34014430 con 0x7efe4406bcd0 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.435+0000 7efe2b7fe700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 0x7efe300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.435+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe340850c0 con 0x7efe4406bcd0 2023-10-07T09:06:46.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.435+0000 7efe42ffd700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 0x7efe300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.436+0000 7efe42ffd700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 0x7efe300697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efe380099b0 tx=0x7efe38017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.439+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe440b13a0 con 0x7efe4406bcd0 2023-10-07T09:06:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.635+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe440b13a0 con 0x7efe4406bcd0 2023-10-07T09:06:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.636+0000 7efe2b7fe700 1 -- 172.21.15.46:0/1196220594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15377 (secure 0 0 0) 0x7efe440b13a0 con 0x7efe4406bcd0 2023-10-07T09:06:46.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:46.638 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":164,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:45.262437+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 msgr2=0x7efe300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 0x7efe300697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efe380099b0 tx=0x7efe38017000 comp rx=0 tx=0).stop 2023-10-07T09:06:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 msgr2=0x7efe4414c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d890 tx=0x7efe34008040 comp rx=0 tx=0).stop 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 shutdown_connections 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efe30067320 0x7efe300697d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe4415df50 0x7efe44157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe4406bcd0 0x7efe4414c1e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 --2- 172.21.15.46:0/1196220594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe4406c0a0 0x7efe4414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 >> 172.21.15.46:0/1196220594 conn(0x7efe440ce600 msgr2=0x7efe4406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 shutdown_connections 2023-10-07T09:06:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.638+0000 7efe4a00d700 1 -- 172.21.15.46:0/1196220594 wait complete. 2023-10-07T09:06:46.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:06:46.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.774+0000 7fc4394d2700 1 Processor -- start 2023-10-07T09:06:46.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.774+0000 7fc4394d2700 1 -- start start 2023-10-07T09:06:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 0x7fc4340b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4340cca60 0x7fc43415d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cd0f0 0x7fc43415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc434150b50 con 0x7fc4340cca60 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4340cede0 con 0x7fc4340cc690 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4394d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340b2260 con 0x7fc4340cd0f0 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4327fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4340cca60 0x7fc43415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4327fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4340cca60 0x7fc43415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55548/0 (socket says 172.21.15.46:55548) 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4327fc700 1 -- 172.21.15.46:0/3181467879 learned_addr learned my addr 172.21.15.46:0/3181467879 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc4337fe700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cd0f0 0x7fc43415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.775+0000 7fc432ffd700 1 --2- 172.21.15.46:0/3181467879 >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 0x7fc4340b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 -- 172.21.15.46:0/3181467879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cd0f0 msgr2=0x7fc43415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cd0f0 0x7fc43415d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 -- 172.21.15.46:0/3181467879 >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 msgr2=0x7fc4340b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3181467879 >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 0x7fc4340b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 -- 172.21.15.46:0/3181467879 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340b2540 con 0x7fc4340cca60 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc432ffd700 1 --2- 172.21.15.46:0/3181467879 >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 0x7fc4340b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43415d280 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc4340891a0 tx=0x7fc41c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122459c6d8731cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc431ffb700 1 -- 172.21.15.46:0/3181467879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c009e70 con 0x7fc4340cca60 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc431ffb700 1 -- 172.21.15.46:0/3181467879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00b860 con 0x7fc4340cca60 2023-10-07T09:06:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc431ffb700 1 -- 172.21.15.46:0/3181467879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00bc00 con 0x7fc4340cca60 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4394d2700 1 -- 172.21.15.46:0/3181467879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 msgr2=0x7fc43415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43415d280 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc4340891a0 tx=0x7fc41c009250 comp rx=0 tx=0).stop 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.776+0000 7fc4394d2700 1 -- 172.21.15.46:0/3181467879 shutdown_connections 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cd0f0 0x7fc43415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3181467879 >> v2:172.21.15.133:3300/0 conn(0x7fc4340cc690 0x7fc4340b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3181467879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43415d280 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 -- 172.21.15.46:0/3181467879 >> 172.21.15.46:0/3181467879 conn(0x7fc4340d0630 msgr2=0x7fc4340d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 -- 172.21.15.46:0/3181467879 shutdown_connections 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.777+0000 7fc4394d2700 1 -- 172.21.15.46:0/3181467879 wait complete. 2023-10-07T09:06:46.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.778+0000 7fc4394d2700 1 Processor -- start 2023-10-07T09:06:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.778+0000 7fc4394d2700 1 -- start start 2023-10-07T09:06:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.778+0000 7fc4394d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cc690 0x7fc434148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.778+0000 7fc4394d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.778+0000 7fc4394d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340cd0f0 0x7fc434148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4394d2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341487c0 con 0x7fc4340cca60 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4394d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434149a20 con 0x7fc4340cd0f0 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4394d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340b46c0 con 0x7fc4340cc690 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55556/0 (socket says 172.21.15.46:55556) 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 -- 172.21.15.46:0/3169056081 learned_addr learned my addr 172.21.15.46:0/3169056081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc432ffd700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cc690 0x7fc434148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4337fe700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340cd0f0 0x7fc434148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 -- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cc690 msgr2=0x7fc434148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cc690 0x7fc434148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 -- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340cd0f0 msgr2=0x7fc434148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340cd0f0 0x7fc434148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 -- 172.21.15.46:0/3169056081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0094f0 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4327fc700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0090b0 tx=0x7fc41c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00bbe0 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c01f070 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43414b780 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0266b0 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.779+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43414bdc0 con 0x7fc4340cca60 2023-10-07T09:06:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.780+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340889d0 con 0x7fc4340cca60 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.781+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc41c026a60 con 0x7fc4340cca60 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.781+0000 7fc42affd700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 0x7fc4140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.781+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc41c021070 con 0x7fc4340cca60 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.781+0000 7fc432ffd700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 0x7fc4140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.782+0000 7fc432ffd700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 0x7fc4140697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006f00 tx=0x7fc42c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:46.785+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc41c053640 con 0x7fc4340cca60 2023-10-07T09:06:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.028+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc43404bbb0 con 0x7fc4340cca60 2023-10-07T09:06:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.951+0000 7fc42affd700 1 -- 172.21.15.46:0/3169056081 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v110) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc41c0150b0 con 0x7fc4340cca60 2023-10-07T09:06:47.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.953+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 msgr2=0x7fc4140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:47.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.953+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 0x7fc4140697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006f00 tx=0x7fc42c008040 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.953+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 msgr2=0x7fc43414af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.953+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0090b0 tx=0x7fc41c017000 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 shutdown_connections 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc414067320 0x7fc4140697d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340cd0f0 0x7fc434148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340cc690 0x7fc434148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 --2- 172.21.15.46:0/3169056081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340cca60 0x7fc43414af10 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 >> 172.21.15.46:0/3169056081 conn(0x7fc4340d0630 msgr2=0x7fc4341500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 shutdown_connections 2023-10-07T09:06:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:47.954+0000 7fc4394d2700 1 -- 172.21.15.46:0/3169056081 wait complete. 2023-10-07T09:06:47.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:06:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.097+0000 7f58f2e53700 1 Processor -- start 2023-10-07T09:06:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.097+0000 7f58f2e53700 1 -- start start 2023-10-07T09:06:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f2e53700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159890 0x7f58ec15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f2e53700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58ec069560 0x7f58ec0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f2e53700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec15a160 con 0x7f58ec159c60 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f2e53700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec069f20 con 0x7f58ec069560 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f2e53700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0d13a0 con 0x7f58ec159890 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f13f0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58ec069560 0x7f58ec0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f13f0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58ec069560 0x7f58ec0699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55570/0 (socket says 172.21.15.46:55570) 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.098+0000 7f58f13f0700 1 -- 172.21.15.46:0/32461474 learned_addr learned my addr 172.21.15.46:0/32461474 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f0bef700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159890 0x7f58ec15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f13f0700 1 -- 172.21.15.46:0/32461474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159890 msgr2=0x7f58ec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f13f0700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159890 0x7f58ec15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f13f0700 1 -- 172.21.15.46:0/32461474 >> v1:172.21.15.133:6789/0 conn(0x7f58ec159c60 legacy=0x7f58ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f13f0700 1 -- 172.21.15.46:0/32461474 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec15e140 con 0x7f58ec069560 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58f13f0700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec0699e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0099b0 tx=0x7f58dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8294b93759c70062 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58eb7fe700 1 -- 172.21.15.46:0/32461474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00b860 con 0x7f58ec069560 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58eb7fe700 1 -- 172.21.15.46:0/32461474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00b9c0 con 0x7f58ec069560 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.099+0000 7f58eb7fe700 1 -- 172.21.15.46:0/32461474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00bd60 con 0x7f58ec069560 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 -- 172.21.15.46:0/32461474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 msgr2=0x7f58ec0699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec0699e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0099b0 tx=0x7f58dc009250 comp rx=0 tx=0).stop 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 -- 172.21.15.46:0/32461474 shutdown_connections 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec0699e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 --2- 172.21.15.46:0/32461474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159890 0x7f58ec15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 -- 172.21.15.46:0/32461474 >> 172.21.15.46:0/32461474 conn(0x7f58ec068e20 msgr2=0x7f58ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 -- 172.21.15.46:0/32461474 shutdown_connections 2023-10-07T09:06:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.100+0000 7f58f2e53700 1 -- 172.21.15.46:0/32461474 wait complete. 2023-10-07T09:06:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.101+0000 7f58f2e53700 1 Processor -- start 2023-10-07T09:06:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.101+0000 7f58f2e53700 1 -- start start 2023-10-07T09:06:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ec159890 0x7f58ec0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 0x7f58ec0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec155a00 con 0x7f58ec069560 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0cd470 con 0x7f58ec159890 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f2e53700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0cd750 con 0x7f58ec159c60 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55584/0 (socket says 172.21.15.46:55584) 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 -- 172.21.15.46:0/4267186947 learned_addr learned my addr 172.21.15.46:0/4267186947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f13f0700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 0x7f58ec0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58ebfff700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ec159890 0x7f58ec0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 -- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 msgr2=0x7f58ec0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 0x7f58ec0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 -- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ec159890 msgr2=0x7f58ec0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ec159890 0x7f58ec0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 -- 172.21.15.46:0/4267186947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0094f0 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f13f0700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 0x7f58ec0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58f0bef700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f58e400e190 tx=0x7f58e4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.102+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400ee30 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.103+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e4014420 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.103+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40147e0 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.103+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0cda30 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.103+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec0cdff0 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.103+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec064d80 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.104+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f58e4014b90 con 0x7f58ec069560 2023-10-07T09:06:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.104+0000 7f58e8ff9700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 0x7f58d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.104+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58e4085470 con 0x7f58ec069560 2023-10-07T09:06:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.104+0000 7f58ebfff700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 0x7f58d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.105+0000 7f58ebfff700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 0x7f58d80697d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0b3c40 tx=0x7f58e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.109+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58e4052100 con 0x7f58ec069560 2023-10-07T09:06:48.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.350+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58ec04c3c0 con 0x7f58ec069560 2023-10-07T09:06:48.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.959+0000 7f58e8ff9700 1 -- 172.21.15.46:0/4267186947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v111) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58e4009a60 con 0x7f58ec069560 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 msgr2=0x7f58d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 0x7f58d80697d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0b3c40 tx=0x7f58e0009040 comp rx=0 tx=0).stop 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 msgr2=0x7f58ec146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f58e400e190 tx=0x7f58e4009920 comp rx=0 tx=0).stop 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 shutdown_connections 2023-10-07T09:06:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f58d8067320 0x7f58d80697d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ec159c60 0x7f58ec0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ec069560 0x7f58ec146370 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 --2- 172.21.15.46:0/4267186947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ec159890 0x7f58ec0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.961+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 >> 172.21.15.46:0/4267186947 conn(0x7f58ec068e20 msgr2=0x7f58ec0c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.962+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 shutdown_connections 2023-10-07T09:06:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:48.962+0000 7f58f2e53700 1 -- 172.21.15.46:0/4267186947 wait complete. 2023-10-07T09:06:48.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.099+0000 7ff1614e4700 1 Processor -- start 2023-10-07T09:06:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.099+0000 7ff1614e4700 1 -- start start 2023-10-07T09:06:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff15c159890 0x7ff15c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff15c159c60 0x7ff15c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 0x7ff15c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c15df50 con 0x7ff15c159890 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c15a160 con 0x7ff15c159c60 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff1614e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0d13a0 con 0x7ff15c15db10 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff15c159890 0x7ff15c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff15c159890 0x7ff15c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55586/0 (socket says 172.21.15.46:55586) 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 -- 172.21.15.46:0/648435893 learned_addr learned my addr 172.21.15.46:0/648435893 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15a7fc700 1 --2- 172.21.15.46:0/648435893 >> v2:172.21.15.133:3300/0 conn(0x7ff15c159c60 0x7ff15c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15b7fe700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 0x7ff15c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 -- 172.21.15.46:0/648435893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 msgr2=0x7ff15c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 0x7ff15c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 -- 172.21.15.46:0/648435893 >> v2:172.21.15.133:3300/0 conn(0x7ff15c159c60 msgr2=0x7ff15c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 --2- 172.21.15.46:0/648435893 >> v2:172.21.15.133:3300/0 conn(0x7ff15c159c60 0x7ff15c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 -- 172.21.15.46:0/648435893 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c15e140 con 0x7ff15c159890 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15b7fe700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 0x7ff15c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.100+0000 7ff15affd700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c159890 0x7ff15c15abd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0b67f0 tx=0x7ff154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88a3c1a74baafd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff159ffb700 1 -- 172.21.15.46:0/648435893 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400b860 con 0x7ff15c159890 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff159ffb700 1 -- 172.21.15.46:0/648435893 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400b9c0 con 0x7ff15c159890 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff159ffb700 1 -- 172.21.15.46:0/648435893 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400bd60 con 0x7ff15c159890 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 -- 172.21.15.46:0/648435893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c159890 msgr2=0x7ff15c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c159890 0x7ff15c15abd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0b67f0 tx=0x7ff154009250 comp rx=0 tx=0).stop 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 -- 172.21.15.46:0/648435893 shutdown_connections 2023-10-07T09:06:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c15db10 0x7ff15c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 --2- 172.21.15.46:0/648435893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c159890 0x7ff15c15abd0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 --2- 172.21.15.46:0/648435893 >> v2:172.21.15.133:3300/0 conn(0x7ff15c159c60 0x7ff15c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 -- 172.21.15.46:0/648435893 >> 172.21.15.46:0/648435893 conn(0x7ff15c068e20 msgr2=0x7ff15c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 -- 172.21.15.46:0/648435893 shutdown_connections 2023-10-07T09:06:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.101+0000 7ff1614e4700 1 -- 172.21.15.46:0/648435893 wait complete. 2023-10-07T09:06:49.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.102+0000 7ff1614e4700 1 Processor -- start 2023-10-07T09:06:49.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.102+0000 7ff1614e4700 1 -- start start 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 0x7ff15c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c159c60 0x7ff15c0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0b4a30 con 0x7ff15c15db10 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0ce8a0 con 0x7ff15c159890 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff1614e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0ceb80 con 0x7ff15c159c60 2023-10-07T09:06:49.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff15b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff15b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55598/0 (socket says 172.21.15.46:55598) 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff15b7fe700 1 -- 172.21.15.46:0/734178376 learned_addr learned my addr 172.21.15.46:0/734178376 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff15affd700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 0x7ff15c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.103+0000 7ff15a7fc700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c159c60 0x7ff15c0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 -- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c159c60 msgr2=0x7ff15c0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c159c60 0x7ff15c0c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 -- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 msgr2=0x7ff15c152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 0x7ff15c152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 -- 172.21.15.46:0/734178376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540094f0 con 0x7ff15c15db10 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15affd700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 0x7ff15c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:49.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff15b7fe700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00a380 tx=0x7ff14c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00ae10 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00d650 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c0cee60 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00da10 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.104+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c0ce570 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.105+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c04c3c0 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.105+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff14c01e3b0 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.106+0000 7ff152ffd700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 0x7ff13c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.106+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff14c085680 con 0x7ff15c15db10 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.106+0000 7ff15affd700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 0x7ff13c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.106+0000 7ff15affd700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 0x7ff13c0697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0b67f0 tx=0x7ff154017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.110+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff14c052310 con 0x7ff15c15db10 2023-10-07T09:06:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.350+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff15c0cf050 con 0x7ff15c15db10 2023-10-07T09:06:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.350+0000 7ff152ffd700 1 -- 172.21.15.46:0/734178376 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4613 (secure 0 0 0) 0x7ff14c055930 con 0x7ff15c15db10 2023-10-07T09:06:49.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:49.352 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:06:48.950710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:06:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 msgr2=0x7ff13c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 0x7ff13c0697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0b67f0 tx=0x7ff154017000 comp rx=0 tx=0).stop 2023-10-07T09:06:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 msgr2=0x7ff15c0cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00a380 tx=0x7ff14c007900 comp rx=0 tx=0).stop 2023-10-07T09:06:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 shutdown_connections 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff13c067320 0x7ff13c0697d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff15c15db10 0x7ff15c0cf380 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff15c159890 0x7ff15c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 --2- 172.21.15.46:0/734178376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff15c159c60 0x7ff15c0c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 >> 172.21.15.46:0/734178376 conn(0x7ff15c068e20 msgr2=0x7ff15c153140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 shutdown_connections 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.352+0000 7ff1614e4700 1 -- 172.21.15.46:0/734178376 wait complete. 2023-10-07T09:06:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 111 2023-10-07T09:06:49.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.483+0000 7f62ce08a700 1 Processor -- start 2023-10-07T09:06:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.483+0000 7f62ce08a700 1 -- start start 2023-10-07T09:06:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62ce08a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62c8159420 0x7f62c80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62ce08a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80b2980 con 0x7f62c815d230 2023-10-07T09:06:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62ce08a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80b11d0 con 0x7f62c81597f0 2023-10-07T09:06:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62ce08a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c80b14b0 con 0x7f62c8159420 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62cd889700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f62c815d230 0x7f62c815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54232/0 (socket says 172.21.15.46:54232) 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62cd889700 1 -- 172.21.15.46:0/2443037354 learned_addr learned my addr 172.21.15.46:0/2443037354 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62cd088700 1 --2- 172.21.15.46:0/2443037354 >> v2:172.21.15.133:3300/0 conn(0x7f62c8159420 0x7f62c80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642292138 0 0) 0x7f62c80b2980 con 0x7f62c815d230 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4003570 con 0x7f62c815d230 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251538500 0 0) 0x7f62c80b11d0 con 0x7f62c81597f0 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.484+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c80b2980 con 0x7f62c81597f0 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360887055 0 0) 0x7f62b4003570 con 0x7f62c815d230 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62cd088700 1 -- 172.21.15.46:0/2443037354 >> v1:172.21.15.133:6789/0 conn(0x7f62c81597f0 legacy=0x7f62c80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62cd088700 1 -- 172.21.15.46:0/2443037354 >> v1:172.21.15.46:6789/0 conn(0x7f62c815d230 legacy=0x7f62c815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62cd088700 1 -- 172.21.15.46:0/2443037354 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80b1790 con 0x7f62c8159420 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62cd088700 1 --2- 172.21.15.46:0/2443037354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c80b5f40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f62c40098e0 tx=0x7f62c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0f9a6442862924 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00017f0 con 0x7f62c8159420 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c4011420 con 0x7f62c8159420 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62bffff700 1 -- 172.21.15.46:0/2443037354 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c40117c0 con 0x7f62c8159420 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62ce08a700 1 -- 172.21.15.46:0/2443037354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 msgr2=0x7f62c80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62ce08a700 1 --2- 172.21.15.46:0/2443037354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c80b5f40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f62c40098e0 tx=0x7f62c40091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62ce08a700 1 -- 172.21.15.46:0/2443037354 shutdown_connections 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.485+0000 7f62ce08a700 1 --2- 172.21.15.46:0/2443037354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c80b5f40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.486+0000 7f62ce08a700 1 -- 172.21.15.46:0/2443037354 >> 172.21.15.46:0/2443037354 conn(0x7f62c80d0660 msgr2=0x7f62c80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.486+0000 7f62ce08a700 1 -- 172.21.15.46:0/2443037354 shutdown_connections 2023-10-07T09:06:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.486+0000 7f62ce08a700 1 -- 172.21.15.46:0/2443037354 wait complete. 2023-10-07T09:06:49.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.487+0000 7f62ce08a700 1 Processor -- start 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.487+0000 7f62ce08a700 1 -- start start 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c815d230 0x7f62c8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c815a8b0 con 0x7f62c81597f0 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8159ca0 con 0x7f62c8159420 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8159f80 con 0x7f62c815d230 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55614/0 (socket says 172.21.15.46:55614) 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 -- 172.21.15.46:0/3205035174 learned_addr learned my addr 172.21.15.46:0/3205035174 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:49.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cd088700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cd889700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c815d230 0x7f62c8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 -- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c815d230 msgr2=0x7f62c8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c815d230 0x7f62c8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 -- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 msgr2=0x7f62c814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c814d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 -- 172.21.15.46:0/3205035174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4009420 con 0x7f62c81597f0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cd088700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62cc887700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f62b800c7c0 tx=0x7f62b8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8010510 con 0x7f62c81597f0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c815a260 con 0x7f62c81597f0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8002e90 con 0x7f62c81597f0 2023-10-07T09:06:49.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80108e0 con 0x7f62c81597f0 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.488+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c814db80 con 0x7f62c81597f0 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.489+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c804c3c0 con 0x7f62c81597f0 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.490+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f62b8010cd0 con 0x7f62c81597f0 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.490+0000 7f62bd7fa700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 0x7f62ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.490+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62b8084420 con 0x7f62c81597f0 2023-10-07T09:06:49.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.490+0000 7f62cd088700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 0x7f62ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.491+0000 7f62cd088700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 0x7f62ac0697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f62c40093f0 tx=0x7f62c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.494+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62b80510b0 con 0x7f62c81597f0 2023-10-07T09:06:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.688+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62c80b1a70 con 0x7f62c81597f0 2023-10-07T09:06:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.689+0000 7f62bd7fa700 1 -- 172.21.15.46:0/3205035174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f62b80546d0 con 0x7f62c81597f0 2023-10-07T09:06:49.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:49.691 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":165,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:46.854250+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 msgr2=0x7f62ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 0x7f62ac0697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f62c40093f0 tx=0x7f62c4016000 comp rx=0 tx=0).stop 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 msgr2=0x7f62c8153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f62b800c7c0 tx=0x7f62b8007de0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 shutdown_connections 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f62ac067320 0x7f62ac0697d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62c815d230 0x7f62c8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c8159420 0x7f62c814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 --2- 172.21.15.46:0/3205035174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62c81597f0 0x7f62c8153ec0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 >> 172.21.15.46:0/3205035174 conn(0x7f62c80d0660 msgr2=0x7f62c8158490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:49.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 shutdown_connections 2023-10-07T09:06:49.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.691+0000 7f62ce08a700 1 -- 172.21.15.46:0/3205035174 wait complete. 2023-10-07T09:06:49.705 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:06:49.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:06:49.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.823+0000 7f320ea06700 1 Processor -- start 2023-10-07T09:06:49.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.823+0000 7f320ea06700 1 -- start start 2023-10-07T09:06:49.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320ea06700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320ea06700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080b2980 con 0x7f32081597f0 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320ea06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320815dbb0 con 0x7f3208159420 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320ea06700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b11d0 con 0x7f320815d230 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320e205700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320e205700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:50532/0 (socket says 172.21.15.46:50532) 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320d203700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f32081597f0 0x7f32080b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59976/0 (socket says 172.21.15.46:59976) 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.824+0000 7f320e205700 1 -- 172.21.15.46:0/208850604 learned_addr learned my addr 172.21.15.46:0/208850604 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320e205700 1 -- 172.21.15.46:0/208850604 >> v1:172.21.15.133:6789/0 conn(0x7f3208159420 legacy=0x7f32080b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320ca02700 1 -- 172.21.15.46:0/208850604 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237409931 0 0) 0x7f32080b2980 con 0x7f32081597f0 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320e205700 1 -- 172.21.15.46:0/208850604 >> v1:172.21.15.46:6789/0 conn(0x7f32081597f0 legacy=0x7f32080b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320e205700 1 -- 172.21.15.46:0/208850604 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080b14b0 con 0x7f320815d230 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320e205700 1 --2- 172.21.15.46:0/208850604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099e0 tx=0x7f31f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e73cb368e7850fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320ca02700 1 -- 172.21.15.46:0/208850604 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800b860 con 0x7f320815d230 2023-10-07T09:06:49.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320ca02700 1 -- 172.21.15.46:0/208850604 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f800b9c0 con 0x7f320815d230 2023-10-07T09:06:49.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320ca02700 1 -- 172.21.15.46:0/208850604 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800bd60 con 0x7f320815d230 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.825+0000 7f320ea06700 1 -- 172.21.15.46:0/208850604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 msgr2=0x7f320815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 --2- 172.21.15.46:0/208850604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099e0 tx=0x7f31f8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 -- 172.21.15.46:0/208850604 shutdown_connections 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 --2- 172.21.15.46:0/208850604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f320815d670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 -- 172.21.15.46:0/208850604 >> 172.21.15.46:0/208850604 conn(0x7f32080d0660 msgr2=0x7f32080d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 -- 172.21.15.46:0/208850604 shutdown_connections 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.826+0000 7f320ea06700 1 -- 172.21.15.46:0/208850604 wait complete. 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.827+0000 7f320ea06700 1 Processor -- start 2023-10-07T09:06:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.827+0000 7f320ea06700 1 -- start start 2023-10-07T09:06:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 0x7f32081492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f3208169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320815aa50 con 0x7f32081597f0 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3208159e40 con 0x7f3208159420 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320815a120 con 0x7f320815d230 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59816/0 (socket says 172.21.15.46:59816) 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 -- 172.21.15.46:0/2465355657 learned_addr learned my addr 172.21.15.46:0/2465355657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320e205700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f3208169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320da04700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 0x7f32081492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 -- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 msgr2=0x7f3208169e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f3208169e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 -- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 msgr2=0x7f32081492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 0x7f32081492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 -- 172.21.15.46:0/2465355657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80094f0 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320da04700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 0x7f32081492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320d203700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c5e0 tx=0x7f31fc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc005a70 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc005bd0 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0070d0 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.828+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320815a400 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.829+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320815aee0 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.830+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320804c3c0 con 0x7f32081597f0 2023-10-07T09:06:49.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.830+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f31fc007440 con 0x7f32081597f0 2023-10-07T09:06:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.830+0000 7f3205ffb700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 0x7f31f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.830+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31fc084270 con 0x7f32081597f0 2023-10-07T09:06:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.830+0000 7f320da04700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 0x7f31f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:49.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.831+0000 7f320da04700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 0x7f31f40697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3200007fd0 tx=0x7f3200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:49.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:49.834+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31fc050ec0 con 0x7f32081597f0 2023-10-07T09:06:50.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.026+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f320815a290 con 0x7f31f4067320 2023-10-07T09:06:50.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.036+0000 7f3205ffb700 1 -- 172.21.15.46:0/2465355657 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289707 (secure 0 0 0) 0x7f320815a290 con 0x7f31f4067320 2023-10-07T09:06:50.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 msgr2=0x7f31f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 0x7f31f40697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3200007fd0 tx=0x7f3200009040 comp rx=0 tx=0).stop 2023-10-07T09:06:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 msgr2=0x7f3208169940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c5e0 tx=0x7f31fc007d60 comp rx=0 tx=0).stop 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 shutdown_connections 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31f4067320 0x7f31f40697d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f320815d230 0x7f3208169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3208159420 0x7f32081492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 --2- 172.21.15.46:0/2465355657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32081597f0 0x7f3208169940 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 >> 172.21.15.46:0/2465355657 conn(0x7f32080d0660 msgr2=0x7f3208157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 shutdown_connections 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.038+0000 7f320ea06700 1 -- 172.21.15.46:0/2465355657 wait complete. 2023-10-07T09:06:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:06:50.052 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2023-10-07T09:06:49.881809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428404,"kb_used_data":17332,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546316,"statfs":{"total":773094113280,"available":770607427584,"internally_reserved":0,"allocated":17747968,"data_stored":8539675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001370"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872808+0000","last_change":"2023-10-07T09:06:45.872808+0000","last_active":"2023-10-07T09:06:45.872808+0000","last_peered":"2023-10-07T09:06:45.872808+0000","last_clean":"2023-10-07T09:06:45.872808+0000","last_became_active":"2023-10-07T09:06:45.872543+0000","last_became_peered":"2023-10-07T09:06:45.872543+0000","last_unstale":"2023-10-07T09:06:45.872808+0000","last_undegraded":"2023-10-07T09:06:45.872808+0000","last_fullsized":"2023-10-07T09:06:45.872808+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:29.352190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875202+0000","last_change":"2023-10-07T09:06:45.875202+0000","last_active":"2023-10-07T09:06:45.875202+0000","last_peered":"2023-10-07T09:06:45.875202+0000","last_clean":"2023-10-07T09:06:45.875202+0000","last_became_active":"2023-10-07T09:06:45.874834+0000","last_became_peered":"2023-10-07T09:06:45.874834+0000","last_unstale":"2023-10-07T09:06:45.875202+0000","last_undegraded":"2023-10-07T09:06:45.875202+0000","last_fullsized":"2023-10-07T09:06:45.875202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:24.574865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873369+0000","last_change":"2023-10-07T09:06:45.873369+0000","last_active":"2023-10-07T09:06:45.873369+0000","last_peered":"2023-10-07T09:06:45.873369+0000","last_clean":"2023-10-07T09:06:45.873369+0000","last_became_active":"2023-10-07T09:06:45.872917+0000","last_became_peered":"2023-10-07T09:06:45.872917+0000","last_unstale":"2023-10-07T09:06:45.873369+0000","last_undegraded":"2023-10-07T09:06:45.873369+0000","last_fullsized":"2023-10-07T09:06:45.873369+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:32.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864137+0000","last_change":"2023-10-07T09:06:45.864137+0000","last_active":"2023-10-07T09:06:45.864137+0000","last_peered":"2023-10-07T09:06:45.864137+0000","last_clean":"2023-10-07T09:06:45.864137+0000","last_became_active":"2023-10-07T09:06:45.863885+0000","last_became_peered":"2023-10-07T09:06:45.863885+0000","last_unstale":"2023-10-07T09:06:45.864137+0000","last_undegraded":"2023-10-07T09:06:45.864137+0000","last_fullsized":"2023-10-07T09:06:45.864137+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:00:49.028771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864114+0000","last_change":"2023-10-07T09:06:45.864114+0000","last_active":"2023-10-07T09:06:45.864114+0000","last_peered":"2023-10-07T09:06:45.864114+0000","last_clean":"2023-10-07T09:06:45.864114+0000","last_became_active":"2023-10-07T09:06:45.863840+0000","last_became_peered":"2023-10-07T09:06:45.863840+0000","last_unstale":"2023-10-07T09:06:45.864114+0000","last_undegraded":"2023-10-07T09:06:45.864114+0000","last_fullsized":"2023-10-07T09:06:45.864114+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:58.219037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873299+0000","last_change":"2023-10-07T09:06:45.873299+0000","last_active":"2023-10-07T09:06:45.873299+0000","last_peered":"2023-10-07T09:06:45.873299+0000","last_clean":"2023-10-07T09:06:45.873299+0000","last_became_active":"2023-10-07T09:06:45.873026+0000","last_became_peered":"2023-10-07T09:06:45.873026+0000","last_unstale":"2023-10-07T09:06:45.873299+0000","last_undegraded":"2023-10-07T09:06:45.873299+0000","last_fullsized":"2023-10-07T09:06:45.873299+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:11.272925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872833+0000","last_change":"2023-10-07T09:06:45.872833+0000","last_active":"2023-10-07T09:06:45.872833+0000","last_peered":"2023-10-07T09:06:45.872833+0000","last_clean":"2023-10-07T09:06:45.872833+0000","last_became_active":"2023-10-07T09:06:45.872522+0000","last_became_peered":"2023-10-07T09:06:45.872522+0000","last_unstale":"2023-10-07T09:06:45.872833+0000","last_undegraded":"2023-10-07T09:06:45.872833+0000","last_fullsized":"2023-10-07T09:06:45.872833+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:50.419557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871172+0000","last_change":"2023-10-07T09:06:45.871172+0000","last_active":"2023-10-07T09:06:45.871172+0000","last_peered":"2023-10-07T09:06:45.871172+0000","last_clean":"2023-10-07T09:06:45.871172+0000","last_became_active":"2023-10-07T09:06:45.870915+0000","last_became_peered":"2023-10-07T09:06:45.870915+0000","last_unstale":"2023-10-07T09:06:45.871172+0000","last_undegraded":"2023-10-07T09:06:45.871172+0000","last_fullsized":"2023-10-07T09:06:45.871172+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.609943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878618+0000","last_change":"2023-10-07T09:06:45.878618+0000","last_active":"2023-10-07T09:06:45.878618+0000","last_peered":"2023-10-07T09:06:45.878618+0000","last_clean":"2023-10-07T09:06:45.878618+0000","last_became_active":"2023-10-07T09:06:45.878336+0000","last_became_peered":"2023-10-07T09:06:45.878336+0000","last_unstale":"2023-10-07T09:06:45.878618+0000","last_undegraded":"2023-10-07T09:06:45.878618+0000","last_fullsized":"2023-10-07T09:06:45.878618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:20.580046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867768+0000","last_change":"2023-10-07T09:06:45.867768+0000","last_active":"2023-10-07T09:06:45.867768+0000","last_peered":"2023-10-07T09:06:45.867768+0000","last_clean":"2023-10-07T09:06:45.867768+0000","last_became_active":"2023-10-07T09:06:45.867453+0000","last_became_peered":"2023-10-07T09:06:45.867453+0000","last_unstale":"2023-10-07T09:06:45.867768+0000","last_undegraded":"2023-10-07T09:06:45.867768+0000","last_fullsized":"2023-10-07T09:06:45.867768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:46.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867938+0000","last_change":"2023-10-07T09:06:45.867938+0000","last_active":"2023-10-07T09:06:45.867938+0000","last_peered":"2023-10-07T09:06:45.867938+0000","last_clean":"2023-10-07T09:06:45.867938+0000","last_became_active":"2023-10-07T09:06:45.867470+0000","last_became_peered":"2023-10-07T09:06:45.867470+0000","last_unstale":"2023-10-07T09:06:45.867938+0000","last_undegraded":"2023-10-07T09:06:45.867938+0000","last_fullsized":"2023-10-07T09:06:45.867938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:33.715111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870143+0000","last_change":"2023-10-07T09:06:45.870143+0000","last_active":"2023-10-07T09:06:45.870143+0000","last_peered":"2023-10-07T09:06:45.870143+0000","last_clean":"2023-10-07T09:06:45.870143+0000","last_became_active":"2023-10-07T09:06:45.869878+0000","last_became_peered":"2023-10-07T09:06:45.869878+0000","last_unstale":"2023-10-07T09:06:45.870143+0000","last_undegraded":"2023-10-07T09:06:45.870143+0000","last_fullsized":"2023-10-07T09:06:45.870143+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:47.827963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872154+0000","last_change":"2023-10-07T09:06:45.872154+0000","last_active":"2023-10-07T09:06:45.872154+0000","last_peered":"2023-10-07T09:06:45.872154+0000","last_clean":"2023-10-07T09:06:45.872154+0000","last_became_active":"2023-10-07T09:06:45.871876+0000","last_became_peered":"2023-10-07T09:06:45.871876+0000","last_unstale":"2023-10-07T09:06:45.872154+0000","last_undegraded":"2023-10-07T09:06:45.872154+0000","last_fullsized":"2023-10-07T09:06:45.872154+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:16.414279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875620+0000","last_change":"2023-10-07T09:06:45.875620+0000","last_active":"2023-10-07T09:06:45.875620+0000","last_peered":"2023-10-07T09:06:45.875620+0000","last_clean":"2023-10-07T09:06:45.875620+0000","last_became_active":"2023-10-07T09:06:45.875357+0000","last_became_peered":"2023-10-07T09:06:45.875357+0000","last_unstale":"2023-10-07T09:06:45.875620+0000","last_undegraded":"2023-10-07T09:06:45.875620+0000","last_fullsized":"2023-10-07T09:06:45.875620+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:19.207918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.880949+0000","last_change":"2023-10-07T09:06:45.880949+0000","last_active":"2023-10-07T09:06:45.880949+0000","last_peered":"2023-10-07T09:06:45.880949+0000","last_clean":"2023-10-07T09:06:45.880949+0000","last_became_active":"2023-10-07T09:06:45.880576+0000","last_became_peered":"2023-10-07T09:06:45.880576+0000","last_unstale":"2023-10-07T09:06:45.880949+0000","last_undegraded":"2023-10-07T09:06:45.880949+0000","last_fullsized":"2023-10-07T09:06:45.880949+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.821335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865902+0000","last_change":"2023-10-07T09:06:45.865902+0000","last_active":"2023-10-07T09:06:45.865902+0000","last_peered":"2023-10-07T09:06:45.865902+0000","last_clean":"2023-10-07T09:06:45.865902+0000","last_became_active":"2023-10-07T09:06:45.864628+0000","last_became_peered":"2023-10-07T09:06:45.864628+0000","last_unstale":"2023-10-07T09:06:45.865902+0000","last_undegraded":"2023-10-07T09:06:45.865902+0000","last_fullsized":"2023-10-07T09:06:45.865902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:15:20.202972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875312+0000","last_change":"2023-10-07T09:06:45.875312+0000","last_active":"2023-10-07T09:06:45.875312+0000","last_peered":"2023-10-07T09:06:45.875312+0000","last_clean":"2023-10-07T09:06:45.875312+0000","last_became_active":"2023-10-07T09:06:45.875004+0000","last_became_peered":"2023-10-07T09:06:45.875004+0000","last_unstale":"2023-10-07T09:06:45.875312+0000","last_undegraded":"2023-10-07T09:06:45.875312+0000","last_fullsized":"2023-10-07T09:06:45.875312+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:25.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878964+0000","last_change":"2023-10-07T09:06:45.878964+0000","last_active":"2023-10-07T09:06:45.878964+0000","last_peered":"2023-10-07T09:06:45.878964+0000","last_clean":"2023-10-07T09:06:45.878964+0000","last_became_active":"2023-10-07T09:06:45.878597+0000","last_became_peered":"2023-10-07T09:06:45.878597+0000","last_unstale":"2023-10-07T09:06:45.878964+0000","last_undegraded":"2023-10-07T09:06:45.878964+0000","last_fullsized":"2023-10-07T09:06:45.878964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:47.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865844+0000","last_change":"2023-10-07T09:06:45.865844+0000","last_active":"2023-10-07T09:06:45.865844+0000","last_peered":"2023-10-07T09:06:45.865844+0000","last_clean":"2023-10-07T09:06:45.865844+0000","last_became_active":"2023-10-07T09:06:45.865568+0000","last_became_peered":"2023-10-07T09:06:45.865568+0000","last_unstale":"2023-10-07T09:06:45.865844+0000","last_undegraded":"2023-10-07T09:06:45.865844+0000","last_fullsized":"2023-10-07T09:06:45.865844+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:06.671287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870533+0000","last_change":"2023-10-07T09:06:45.870533+0000","last_active":"2023-10-07T09:06:45.870533+0000","last_peered":"2023-10-07T09:06:45.870533+0000","last_clean":"2023-10-07T09:06:45.870533+0000","last_became_active":"2023-10-07T09:06:45.870244+0000","last_became_peered":"2023-10-07T09:06:45.870244+0000","last_unstale":"2023-10-07T09:06:45.870533+0000","last_undegraded":"2023-10-07T09:06:45.870533+0000","last_fullsized":"2023-10-07T09:06:45.870533+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:33.857998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.859406+0000","last_change":"2023-10-07T09:06:45.859406+0000","last_active":"2023-10-07T09:06:45.859406+0000","last_peered":"2023-10-07T09:06:45.859406+0000","last_clean":"2023-10-07T09:06:45.859406+0000","last_became_active":"2023-10-07T09:06:45.859130+0000","last_became_peered":"2023-10-07T09:06:45.859130+0000","last_unstale":"2023-10-07T09:06:45.859406+0000","last_undegraded":"2023-10-07T09:06:45.859406+0000","last_fullsized":"2023-10-07T09:06:45.859406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:20.580046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875498+0000","last_change":"2023-10-07T09:06:45.875498+0000","last_active":"2023-10-07T09:06:45.875498+0000","last_peered":"2023-10-07T09:06:45.875498+0000","last_clean":"2023-10-07T09:06:45.875498+0000","last_became_active":"2023-10-07T09:06:45.875170+0000","last_became_peered":"2023-10-07T09:06:45.875170+0000","last_unstale":"2023-10-07T09:06:45.875498+0000","last_undegraded":"2023-10-07T09:06:45.875498+0000","last_fullsized":"2023-10-07T09:06:45.875498+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:17:47.790412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867065+0000","last_change":"2023-10-07T09:06:45.867065+0000","last_active":"2023-10-07T09:06:45.867065+0000","last_peered":"2023-10-07T09:06:45.867065+0000","last_clean":"2023-10-07T09:06:45.867065+0000","last_became_active":"2023-10-07T09:06:45.864249+0000","last_became_peered":"2023-10-07T09:06:45.864249+0000","last_unstale":"2023-10-07T09:06:45.867065+0000","last_undegraded":"2023-10-07T09:06:45.867065+0000","last_fullsized":"2023-10-07T09:06:45.867065+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:06:25.560859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.869108+0000","last_change":"2023-10-07T09:06:45.869108+0000","last_active":"2023-10-07T09:06:45.869108+0000","last_peered":"2023-10-07T09:06:45.869108+0000","last_clean":"2023-10-07T09:06:45.869108+0000","last_became_active":"2023-10-07T09:06:45.868832+0000","last_became_peered":"2023-10-07T09:06:45.868832+0000","last_unstale":"2023-10-07T09:06:45.869108+0000","last_undegraded":"2023-10-07T09:06:45.869108+0000","last_fullsized":"2023-10-07T09:06:45.869108+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:47.005282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873538+0000","last_change":"2023-10-07T09:06:45.873538+0000","last_active":"2023-10-07T09:06:45.873538+0000","last_peered":"2023-10-07T09:06:45.873538+0000","last_clean":"2023-10-07T09:06:45.873538+0000","last_became_active":"2023-10-07T09:06:45.873261+0000","last_became_peered":"2023-10-07T09:06:45.873261+0000","last_unstale":"2023-10-07T09:06:45.873538+0000","last_undegraded":"2023-10-07T09:06:45.873538+0000","last_fullsized":"2023-10-07T09:06:45.873538+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:30.779777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872892+0000","last_change":"2023-10-07T09:06:45.872892+0000","last_active":"2023-10-07T09:06:45.872892+0000","last_peered":"2023-10-07T09:06:45.872892+0000","last_clean":"2023-10-07T09:06:45.872892+0000","last_became_active":"2023-10-07T09:06:45.872618+0000","last_became_peered":"2023-10-07T09:06:45.872618+0000","last_unstale":"2023-10-07T09:06:45.872892+0000","last_undegraded":"2023-10-07T09:06:45.872892+0000","last_fullsized":"2023-10-07T09:06:45.872892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:19.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867765+0000","last_change":"2023-10-07T09:06:45.867765+0000","last_active":"2023-10-07T09:06:45.867765+0000","last_peered":"2023-10-07T09:06:45.867765+0000","last_clean":"2023-10-07T09:06:45.867765+0000","last_became_active":"2023-10-07T09:06:45.867325+0000","last_became_peered":"2023-10-07T09:06:45.867325+0000","last_unstale":"2023-10-07T09:06:45.867765+0000","last_undegraded":"2023-10-07T09:06:45.867765+0000","last_fullsized":"2023-10-07T09:06:45.867765+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:20.489841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870028+0000","last_change":"2023-10-07T09:06:45.870028+0000","last_active":"2023-10-07T09:06:45.870028+0000","last_peered":"2023-10-07T09:06:45.870028+0000","last_clean":"2023-10-07T09:06:45.870028+0000","last_became_active":"2023-10-07T09:06:45.869739+0000","last_became_peered":"2023-10-07T09:06:45.869739+0000","last_unstale":"2023-10-07T09:06:45.870028+0000","last_undegraded":"2023-10-07T09:06:45.870028+0000","last_fullsized":"2023-10-07T09:06:45.870028+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:16.986795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881056+0000","last_change":"2023-10-07T09:06:45.881056+0000","last_active":"2023-10-07T09:06:45.881056+0000","last_peered":"2023-10-07T09:06:45.881056+0000","last_clean":"2023-10-07T09:06:45.881056+0000","last_became_active":"2023-10-07T09:06:45.880748+0000","last_became_peered":"2023-10-07T09:06:45.880748+0000","last_unstale":"2023-10-07T09:06:45.881056+0000","last_undegraded":"2023-10-07T09:06:45.881056+0000","last_fullsized":"2023-10-07T09:06:45.881056+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:32.130871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872665+0000","last_change":"2023-10-07T09:06:45.872665+0000","last_active":"2023-10-07T09:06:45.872665+0000","last_peered":"2023-10-07T09:06:45.872665+0000","last_clean":"2023-10-07T09:06:45.872665+0000","last_became_active":"2023-10-07T09:06:45.872240+0000","last_became_peered":"2023-10-07T09:06:45.872240+0000","last_unstale":"2023-10-07T09:06:45.872665+0000","last_undegraded":"2023-10-07T09:06:45.872665+0000","last_fullsized":"2023-10-07T09:06:45.872665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:37.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872759+0000","last_change":"2023-10-07T09:06:45.872759+0000","last_active":"2023-10-07T09:06:45.872759+0000","last_peered":"2023-10-07T09:06:45.872759+0000","last_clean":"2023-10-07T09:06:45.872759+0000","last_became_active":"2023-10-07T09:06:45.872475+0000","last_became_peered":"2023-10-07T09:06:45.872475+0000","last_unstale":"2023-10-07T09:06:45.872759+0000","last_undegraded":"2023-10-07T09:06:45.872759+0000","last_fullsized":"2023-10-07T09:06:45.872759+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:06.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.880896+0000","last_change":"2023-10-07T09:06:45.880896+0000","last_active":"2023-10-07T09:06:45.880896+0000","last_peered":"2023-10-07T09:06:45.880896+0000","last_clean":"2023-10-07T09:06:45.880896+0000","last_became_active":"2023-10-07T09:06:45.880618+0000","last_became_peered":"2023-10-07T09:06:45.880618+0000","last_unstale":"2023-10-07T09:06:45.880896+0000","last_undegraded":"2023-10-07T09:06:45.880896+0000","last_fullsized":"2023-10-07T09:06:45.880896+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:41:27.563599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878784+0000","last_change":"2023-10-07T09:06:45.878784+0000","last_active":"2023-10-07T09:06:45.878784+0000","last_peered":"2023-10-07T09:06:45.878784+0000","last_clean":"2023-10-07T09:06:45.878784+0000","last_became_active":"2023-10-07T09:06:45.878472+0000","last_became_peered":"2023-10-07T09:06:45.878472+0000","last_unstale":"2023-10-07T09:06:45.878784+0000","last_undegraded":"2023-10-07T09:06:45.878784+0000","last_fullsized":"2023-10-07T09:06:45.878784+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:37.070216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.869316+0000","last_change":"2023-10-07T09:06:44.868158+0000","last_active":"2023-10-07T09:06:44.869316+0000","last_peered":"2023-10-07T09:06:44.869316+0000","last_clean":"2023-10-07T09:06:44.869316+0000","last_became_active":"2023-10-07T09:06:44.867867+0000","last_became_peered":"2023-10-07T09:06:44.867867+0000","last_unstale":"2023-10-07T09:06:44.869316+0000","last_undegraded":"2023-10-07T09:06:44.869316+0000","last_fullsized":"2023-10-07T09:06:44.869316+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:53:46.136857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867558+0000","last_change":"2023-10-07T09:06:45.867558+0000","last_active":"2023-10-07T09:06:45.867558+0000","last_peered":"2023-10-07T09:06:45.867558+0000","last_clean":"2023-10-07T09:06:45.867558+0000","last_became_active":"2023-10-07T09:06:45.867234+0000","last_became_peered":"2023-10-07T09:06:45.867234+0000","last_unstale":"2023-10-07T09:06:45.867558+0000","last_undegraded":"2023-10-07T09:06:45.867558+0000","last_fullsized":"2023-10-07T09:06:45.867558+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:50.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877752+0000","last_change":"2023-10-07T09:06:44.872276+0000","last_active":"2023-10-07T09:06:44.877752+0000","last_peered":"2023-10-07T09:06:44.877752+0000","last_clean":"2023-10-07T09:06:44.877752+0000","last_became_active":"2023-10-07T09:06:44.872016+0000","last_became_peered":"2023-10-07T09:06:44.872016+0000","last_unstale":"2023-10-07T09:06:44.877752+0000","last_undegraded":"2023-10-07T09:06:44.877752+0000","last_fullsized":"2023-10-07T09:06:44.877752+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:27.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881046+0000","last_change":"2023-10-07T09:06:45.881046+0000","last_active":"2023-10-07T09:06:45.881046+0000","last_peered":"2023-10-07T09:06:45.881046+0000","last_clean":"2023-10-07T09:06:45.881046+0000","last_became_active":"2023-10-07T09:06:45.880807+0000","last_became_peered":"2023-10-07T09:06:45.880807+0000","last_unstale":"2023-10-07T09:06:45.881046+0000","last_undegraded":"2023-10-07T09:06:45.881046+0000","last_fullsized":"2023-10-07T09:06:45.881046+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:52.989184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.874691+0000","last_change":"2023-10-07T09:06:44.870632+0000","last_active":"2023-10-07T09:06:44.874691+0000","last_peered":"2023-10-07T09:06:44.874691+0000","last_clean":"2023-10-07T09:06:44.874691+0000","last_became_active":"2023-10-07T09:06:44.870387+0000","last_became_peered":"2023-10-07T09:06:44.870387+0000","last_unstale":"2023-10-07T09:06:44.874691+0000","last_undegraded":"2023-10-07T09:06:44.874691+0000","last_fullsized":"2023-10-07T09:06:44.874691+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:46.600038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872491+0000","last_change":"2023-10-07T09:06:45.872491+0000","last_active":"2023-10-07T09:06:45.872491+0000","last_peered":"2023-10-07T09:06:45.872491+0000","last_clean":"2023-10-07T09:06:45.872491+0000","last_became_active":"2023-10-07T09:06:45.871899+0000","last_became_peered":"2023-10-07T09:06:45.871899+0000","last_unstale":"2023-10-07T09:06:45.872491+0000","last_undegraded":"2023-10-07T09:06:45.872491+0000","last_fullsized":"2023-10-07T09:06:45.872491+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:18:28.143420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879759+0000","last_change":"2023-10-07T09:06:44.874327+0000","last_active":"2023-10-07T09:06:44.879759+0000","last_peered":"2023-10-07T09:06:44.879759+0000","last_clean":"2023-10-07T09:06:44.879759+0000","last_became_active":"2023-10-07T09:06:44.874055+0000","last_became_peered":"2023-10-07T09:06:44.874055+0000","last_unstale":"2023-10-07T09:06:44.879759+0000","last_undegraded":"2023-10-07T09:06:44.879759+0000","last_fullsized":"2023-10-07T09:06:44.879759+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:53.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873093+0000","last_change":"2023-10-07T09:06:45.873093+0000","last_active":"2023-10-07T09:06:45.873093+0000","last_peered":"2023-10-07T09:06:45.873093+0000","last_clean":"2023-10-07T09:06:45.873093+0000","last_became_active":"2023-10-07T09:06:45.872214+0000","last_became_peered":"2023-10-07T09:06:45.872214+0000","last_unstale":"2023-10-07T09:06:45.873093+0000","last_undegraded":"2023-10-07T09:06:45.873093+0000","last_fullsized":"2023-10-07T09:06:45.873093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:40.887434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867970+0000","last_change":"2023-10-07T09:06:44.871440+0000","last_active":"2023-10-07T09:06:45.867970+0000","last_peered":"2023-10-07T09:06:45.867970+0000","last_clean":"2023-10-07T09:06:45.867970+0000","last_became_active":"2023-10-07T09:06:44.871173+0000","last_became_peered":"2023-10-07T09:06:44.871173+0000","last_unstale":"2023-10-07T09:06:45.867970+0000","last_undegraded":"2023-10-07T09:06:45.867970+0000","last_fullsized":"2023-10-07T09:06:45.867970+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:24.997381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870192+0000","last_change":"2023-10-07T09:06:45.870192+0000","last_active":"2023-10-07T09:06:45.870192+0000","last_peered":"2023-10-07T09:06:45.870192+0000","last_clean":"2023-10-07T09:06:45.870192+0000","last_became_active":"2023-10-07T09:06:45.869916+0000","last_became_peered":"2023-10-07T09:06:45.869916+0000","last_unstale":"2023-10-07T09:06:45.870192+0000","last_undegraded":"2023-10-07T09:06:45.870192+0000","last_fullsized":"2023-10-07T09:06:45.870192+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:09.115510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875232+0000","last_change":"2023-10-07T09:06:44.871315+0000","last_active":"2023-10-07T09:06:44.875232+0000","last_peered":"2023-10-07T09:06:44.875232+0000","last_clean":"2023-10-07T09:06:44.875232+0000","last_became_active":"2023-10-07T09:06:44.869982+0000","last_became_peered":"2023-10-07T09:06:44.869982+0000","last_unstale":"2023-10-07T09:06:44.875232+0000","last_undegraded":"2023-10-07T09:06:44.875232+0000","last_fullsized":"2023-10-07T09:06:44.875232+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875240+0000","last_change":"2023-10-07T09:06:45.875240+0000","last_active":"2023-10-07T09:06:45.875240+0000","last_peered":"2023-10-07T09:06:45.875240+0000","last_clean":"2023-10-07T09:06:45.875240+0000","last_became_active":"2023-10-07T09:06:45.874912+0000","last_became_peered":"2023-10-07T09:06:45.874912+0000","last_unstale":"2023-10-07T09:06:45.875240+0000","last_undegraded":"2023-10-07T09:06:45.875240+0000","last_fullsized":"2023-10-07T09:06:45.875240+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.131542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877904+0000","last_change":"2023-10-07T09:06:44.870624+0000","last_active":"2023-10-07T09:06:44.877904+0000","last_peered":"2023-10-07T09:06:44.877904+0000","last_clean":"2023-10-07T09:06:44.877904+0000","last_became_active":"2023-10-07T09:06:44.870119+0000","last_became_peered":"2023-10-07T09:06:44.870119+0000","last_unstale":"2023-10-07T09:06:44.877904+0000","last_undegraded":"2023-10-07T09:06:44.877904+0000","last_fullsized":"2023-10-07T09:06:44.877904+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:05:29.389480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875076+0000","last_change":"2023-10-07T09:06:45.875076+0000","last_active":"2023-10-07T09:06:45.875076+0000","last_peered":"2023-10-07T09:06:45.875076+0000","last_clean":"2023-10-07T09:06:45.875076+0000","last_became_active":"2023-10-07T09:06:45.874718+0000","last_became_peered":"2023-10-07T09:06:45.874718+0000","last_unstale":"2023-10-07T09:06:45.875076+0000","last_undegraded":"2023-10-07T09:06:45.875076+0000","last_fullsized":"2023-10-07T09:06:45.875076+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:19.207918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.878572+0000","last_change":"2023-10-07T09:06:44.876397+0000","last_active":"2023-10-07T09:06:44.878572+0000","last_peered":"2023-10-07T09:06:44.878572+0000","last_clean":"2023-10-07T09:06:44.878572+0000","last_became_active":"2023-10-07T09:06:44.875996+0000","last_became_peered":"2023-10-07T09:06:44.875996+0000","last_unstale":"2023-10-07T09:06:44.878572+0000","last_undegraded":"2023-10-07T09:06:44.878572+0000","last_fullsized":"2023-10-07T09:06:44.878572+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:19.570141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865524+0000","last_change":"2023-10-07T09:06:45.865524+0000","last_active":"2023-10-07T09:06:45.865524+0000","last_peered":"2023-10-07T09:06:45.865524+0000","last_clean":"2023-10-07T09:06:45.865524+0000","last_became_active":"2023-10-07T09:06:45.865205+0000","last_became_peered":"2023-10-07T09:06:45.865205+0000","last_unstale":"2023-10-07T09:06:45.865524+0000","last_undegraded":"2023-10-07T09:06:45.865524+0000","last_fullsized":"2023-10-07T09:06:45.865524+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:00:57.785778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879384+0000","last_change":"2023-10-07T09:06:44.874602+0000","last_active":"2023-10-07T09:06:44.879384+0000","last_peered":"2023-10-07T09:06:44.879384+0000","last_clean":"2023-10-07T09:06:44.879384+0000","last_became_active":"2023-10-07T09:06:44.874298+0000","last_became_peered":"2023-10-07T09:06:44.874298+0000","last_unstale":"2023-10-07T09:06:44.879384+0000","last_undegraded":"2023-10-07T09:06:44.879384+0000","last_fullsized":"2023-10-07T09:06:44.879384+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:44.906572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881389+0000","last_change":"2023-10-07T09:06:45.881389+0000","last_active":"2023-10-07T09:06:45.881389+0000","last_peered":"2023-10-07T09:06:45.881389+0000","last_clean":"2023-10-07T09:06:45.881389+0000","last_became_active":"2023-10-07T09:06:45.881097+0000","last_became_peered":"2023-10-07T09:06:45.881097+0000","last_unstale":"2023-10-07T09:06:45.881389+0000","last_undegraded":"2023-10-07T09:06:45.881389+0000","last_fullsized":"2023-10-07T09:06:45.881389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:11.516707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875907+0000","last_change":"2023-10-07T09:06:44.870800+0000","last_active":"2023-10-07T09:06:44.875907+0000","last_peered":"2023-10-07T09:06:44.875907+0000","last_clean":"2023-10-07T09:06:44.875907+0000","last_became_active":"2023-10-07T09:06:44.870538+0000","last_became_peered":"2023-10-07T09:06:44.870538+0000","last_unstale":"2023-10-07T09:06:44.875907+0000","last_undegraded":"2023-10-07T09:06:44.875907+0000","last_fullsized":"2023-10-07T09:06:44.875907+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:15:19.193067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.866389+0000","last_change":"2023-10-07T09:06:45.866389+0000","last_active":"2023-10-07T09:06:45.866389+0000","last_peered":"2023-10-07T09:06:45.866389+0000","last_clean":"2023-10-07T09:06:45.866389+0000","last_became_active":"2023-10-07T09:06:45.866088+0000","last_became_peered":"2023-10-07T09:06:45.866088+0000","last_unstale":"2023-10-07T09:06:45.866389+0000","last_undegraded":"2023-10-07T09:06:45.866389+0000","last_fullsized":"2023-10-07T09:06:45.866389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:55.424651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879494+0000","last_change":"2023-10-07T09:06:44.877102+0000","last_active":"2023-10-07T09:06:44.879494+0000","last_peered":"2023-10-07T09:06:44.879494+0000","last_clean":"2023-10-07T09:06:44.879494+0000","last_became_active":"2023-10-07T09:06:44.876689+0000","last_became_peered":"2023-10-07T09:06:44.876689+0000","last_unstale":"2023-10-07T09:06:44.879494+0000","last_undegraded":"2023-10-07T09:06:44.879494+0000","last_fullsized":"2023-10-07T09:06:44.879494+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:41:04.021789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871009+0000","last_change":"2023-10-07T09:06:45.871009+0000","last_active":"2023-10-07T09:06:45.871009+0000","last_peered":"2023-10-07T09:06:45.871009+0000","last_clean":"2023-10-07T09:06:45.871009+0000","last_became_active":"2023-10-07T09:06:45.870739+0000","last_became_peered":"2023-10-07T09:06:45.870739+0000","last_unstale":"2023-10-07T09:06:45.871009+0000","last_undegraded":"2023-10-07T09:06:45.871009+0000","last_fullsized":"2023-10-07T09:06:45.871009+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:47.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879925+0000","last_change":"2023-10-07T09:06:44.875982+0000","last_active":"2023-10-07T09:06:44.879925+0000","last_peered":"2023-10-07T09:06:44.879925+0000","last_clean":"2023-10-07T09:06:44.879925+0000","last_became_active":"2023-10-07T09:06:44.875736+0000","last_became_peered":"2023-10-07T09:06:44.875736+0000","last_unstale":"2023-10-07T09:06:44.879925+0000","last_undegraded":"2023-10-07T09:06:44.879925+0000","last_fullsized":"2023-10-07T09:06:44.879925+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:49.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.877263+0000","last_change":"2023-10-07T09:06:45.877263+0000","last_active":"2023-10-07T09:06:45.877263+0000","last_peered":"2023-10-07T09:06:45.877263+0000","last_clean":"2023-10-07T09:06:45.877263+0000","last_became_active":"2023-10-07T09:06:45.876951+0000","last_became_peered":"2023-10-07T09:06:45.876951+0000","last_unstale":"2023-10-07T09:06:45.877263+0000","last_undegraded":"2023-10-07T09:06:45.877263+0000","last_fullsized":"2023-10-07T09:06:45.877263+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:03.909210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879387+0000","last_change":"2023-10-07T09:06:44.876453+0000","last_active":"2023-10-07T09:06:44.879387+0000","last_peered":"2023-10-07T09:06:44.879387+0000","last_clean":"2023-10-07T09:06:44.879387+0000","last_became_active":"2023-10-07T09:06:44.876191+0000","last_became_peered":"2023-10-07T09:06:44.876191+0000","last_unstale":"2023-10-07T09:06:44.879387+0000","last_undegraded":"2023-10-07T09:06:44.879387+0000","last_fullsized":"2023-10-07T09:06:44.879387+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:57:40.946180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872563+0000","last_change":"2023-10-07T09:06:45.872563+0000","last_active":"2023-10-07T09:06:45.872563+0000","last_peered":"2023-10-07T09:06:45.872563+0000","last_clean":"2023-10-07T09:06:45.872563+0000","last_became_active":"2023-10-07T09:06:45.872281+0000","last_became_peered":"2023-10-07T09:06:45.872281+0000","last_unstale":"2023-10-07T09:06:45.872563+0000","last_undegraded":"2023-10-07T09:06:45.872563+0000","last_fullsized":"2023-10-07T09:06:45.872563+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:09:46.222892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.868690+0000","last_change":"2023-10-07T09:06:44.867666+0000","last_active":"2023-10-07T09:06:44.868690+0000","last_peered":"2023-10-07T09:06:44.868690+0000","last_clean":"2023-10-07T09:06:44.868690+0000","last_became_active":"2023-10-07T09:06:44.867373+0000","last_became_peered":"2023-10-07T09:06:44.867373+0000","last_unstale":"2023-10-07T09:06:44.868690+0000","last_undegraded":"2023-10-07T09:06:44.868690+0000","last_fullsized":"2023-10-07T09:06:44.868690+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:46.818057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872194+0000","last_change":"2023-10-07T09:06:45.872194+0000","last_active":"2023-10-07T09:06:45.872194+0000","last_peered":"2023-10-07T09:06:45.872194+0000","last_clean":"2023-10-07T09:06:45.872194+0000","last_became_active":"2023-10-07T09:06:45.871925+0000","last_became_peered":"2023-10-07T09:06:45.871925+0000","last_unstale":"2023-10-07T09:06:45.872194+0000","last_undegraded":"2023-10-07T09:06:45.872194+0000","last_fullsized":"2023-10-07T09:06:45.872194+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:23:17.814925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.874433+0000","last_change":"2023-10-07T09:06:44.869212+0000","last_active":"2023-10-07T09:06:44.874433+0000","last_peered":"2023-10-07T09:06:44.874433+0000","last_clean":"2023-10-07T09:06:44.874433+0000","last_became_active":"2023-10-07T09:06:44.868697+0000","last_became_peered":"2023-10-07T09:06:44.868697+0000","last_unstale":"2023-10-07T09:06:44.874433+0000","last_undegraded":"2023-10-07T09:06:44.874433+0000","last_fullsized":"2023-10-07T09:06:44.874433+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867200+0000","last_change":"2023-10-07T09:06:45.867200+0000","last_active":"2023-10-07T09:06:45.867200+0000","last_peered":"2023-10-07T09:06:45.867200+0000","last_clean":"2023-10-07T09:06:45.867200+0000","last_became_active":"2023-10-07T09:06:45.866845+0000","last_became_peered":"2023-10-07T09:06:45.866845+0000","last_unstale":"2023-10-07T09:06:45.867200+0000","last_undegraded":"2023-10-07T09:06:45.867200+0000","last_fullsized":"2023-10-07T09:06:45.867200+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:52.989184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.869069+0000","last_change":"2023-10-07T09:06:44.872401+0000","last_active":"2023-10-07T09:06:45.869069+0000","last_peered":"2023-10-07T09:06:45.869069+0000","last_clean":"2023-10-07T09:06:45.869069+0000","last_became_active":"2023-10-07T09:06:44.872101+0000","last_became_peered":"2023-10-07T09:06:44.872101+0000","last_unstale":"2023-10-07T09:06:45.869069+0000","last_undegraded":"2023-10-07T09:06:45.869069+0000","last_fullsized":"2023-10-07T09:06:45.869069+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:46.600038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881036+0000","last_change":"2023-10-07T09:06:45.881036+0000","last_active":"2023-10-07T09:06:45.881036+0000","last_peered":"2023-10-07T09:06:45.881036+0000","last_clean":"2023-10-07T09:06:45.881036+0000","last_became_active":"2023-10-07T09:06:45.880764+0000","last_became_peered":"2023-10-07T09:06:45.880764+0000","last_unstale":"2023-10-07T09:06:45.881036+0000","last_undegraded":"2023-10-07T09:06:45.881036+0000","last_fullsized":"2023-10-07T09:06:45.881036+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:47.229188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.869281+0000","last_change":"2023-10-07T09:06:44.868080+0000","last_active":"2023-10-07T09:06:44.869281+0000","last_peered":"2023-10-07T09:06:44.869281+0000","last_clean":"2023-10-07T09:06:44.869281+0000","last_became_active":"2023-10-07T09:06:44.867797+0000","last_became_peered":"2023-10-07T09:06:44.867797+0000","last_unstale":"2023-10-07T09:06:44.869281+0000","last_undegraded":"2023-10-07T09:06:44.869281+0000","last_fullsized":"2023-10-07T09:06:44.869281+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:52.443940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.876664+0000","last_change":"2023-10-07T09:06:45.876664+0000","last_active":"2023-10-07T09:06:45.876664+0000","last_peered":"2023-10-07T09:06:45.876664+0000","last_clean":"2023-10-07T09:06:45.876664+0000","last_became_active":"2023-10-07T09:06:45.876186+0000","last_became_peered":"2023-10-07T09:06:45.876186+0000","last_unstale":"2023-10-07T09:06:45.876664+0000","last_undegraded":"2023-10-07T09:06:45.876664+0000","last_fullsized":"2023-10-07T09:06:45.876664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:07:02.398407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875484+0000","last_change":"2023-10-07T09:06:44.871739+0000","last_active":"2023-10-07T09:06:44.875484+0000","last_peered":"2023-10-07T09:06:44.875484+0000","last_clean":"2023-10-07T09:06:44.875484+0000","last_became_active":"2023-10-07T09:06:44.871484+0000","last_became_peered":"2023-10-07T09:06:44.871484+0000","last_unstale":"2023-10-07T09:06:44.875484+0000","last_undegraded":"2023-10-07T09:06:44.875484+0000","last_fullsized":"2023-10-07T09:06:44.875484+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:36.060311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873801+0000","last_change":"2023-10-07T09:06:45.873801+0000","last_active":"2023-10-07T09:06:45.873801+0000","last_peered":"2023-10-07T09:06:45.873801+0000","last_clean":"2023-10-07T09:06:45.873801+0000","last_became_active":"2023-10-07T09:06:45.873522+0000","last_became_peered":"2023-10-07T09:06:45.873522+0000","last_unstale":"2023-10-07T09:06:45.873801+0000","last_undegraded":"2023-10-07T09:06:45.873801+0000","last_fullsized":"2023-10-07T09:06:45.873801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:19.127660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877224+0000","last_change":"2023-10-07T09:06:44.869866+0000","last_active":"2023-10-07T09:06:44.877224+0000","last_peered":"2023-10-07T09:06:44.877224+0000","last_clean":"2023-10-07T09:06:44.877224+0000","last_became_active":"2023-10-07T09:06:44.869307+0000","last_became_peered":"2023-10-07T09:06:44.869307+0000","last_unstale":"2023-10-07T09:06:44.877224+0000","last_undegraded":"2023-10-07T09:06:44.877224+0000","last_fullsized":"2023-10-07T09:06:44.877224+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:01.290669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872992+0000","last_change":"2023-10-07T09:06:45.872992+0000","last_active":"2023-10-07T09:06:45.872992+0000","last_peered":"2023-10-07T09:06:45.872992+0000","last_clean":"2023-10-07T09:06:45.872992+0000","last_became_active":"2023-10-07T09:06:45.872711+0000","last_became_peered":"2023-10-07T09:06:45.872711+0000","last_unstale":"2023-10-07T09:06:45.872992+0000","last_undegraded":"2023-10-07T09:06:45.872992+0000","last_fullsized":"2023-10-07T09:06:45.872992+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:15.697632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.952353+0000","last_change":"2023-10-07T09:06:44.875315+0000","last_active":"2023-10-07T09:06:45.952353+0000","last_peered":"2023-10-07T09:06:45.952353+0000","last_clean":"2023-10-07T09:06:45.952353+0000","last_became_active":"2023-10-07T09:06:44.875005+0000","last_became_peered":"2023-10-07T09:06:44.875005+0000","last_unstale":"2023-10-07T09:06:45.952353+0000","last_undegraded":"2023-10-07T09:06:45.952353+0000","last_fullsized":"2023-10-07T09:06:45.952353+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878910+0000","last_change":"2023-10-07T09:06:45.878910+0000","last_active":"2023-10-07T09:06:45.878910+0000","last_peered":"2023-10-07T09:06:45.878910+0000","last_clean":"2023-10-07T09:06:45.878910+0000","last_became_active":"2023-10-07T09:06:45.877955+0000","last_became_peered":"2023-10-07T09:06:45.877955+0000","last_unstale":"2023-10-07T09:06:45.878910+0000","last_undegraded":"2023-10-07T09:06:45.878910+0000","last_fullsized":"2023-10-07T09:06:45.878910+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:06.671287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875890+0000","last_change":"2023-10-07T09:06:44.873929+0000","last_active":"2023-10-07T09:06:44.875890+0000","last_peered":"2023-10-07T09:06:44.875890+0000","last_clean":"2023-10-07T09:06:44.875890+0000","last_became_active":"2023-10-07T09:06:44.873623+0000","last_became_peered":"2023-10-07T09:06:44.873623+0000","last_unstale":"2023-10-07T09:06:44.875890+0000","last_undegraded":"2023-10-07T09:06:44.875890+0000","last_fullsized":"2023-10-07T09:06:44.875890+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:53.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864582+0000","last_change":"2023-10-07T09:06:45.864582+0000","last_active":"2023-10-07T09:06:45.864582+0000","last_peered":"2023-10-07T09:06:45.864582+0000","last_clean":"2023-10-07T09:06:45.864582+0000","last_became_active":"2023-10-07T09:06:45.864255+0000","last_became_peered":"2023-10-07T09:06:45.864255+0000","last_unstale":"2023-10-07T09:06:45.864582+0000","last_undegraded":"2023-10-07T09:06:45.864582+0000","last_fullsized":"2023-10-07T09:06:45.864582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:49.924955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.880907+0000","last_change":"2023-10-07T09:06:44.877107+0000","last_active":"2023-10-07T09:06:44.880907+0000","last_peered":"2023-10-07T09:06:44.880907+0000","last_clean":"2023-10-07T09:06:44.880907+0000","last_became_active":"2023-10-07T09:06:44.876761+0000","last_became_peered":"2023-10-07T09:06:44.876761+0000","last_unstale":"2023-10-07T09:06:44.880907+0000","last_undegraded":"2023-10-07T09:06:44.880907+0000","last_fullsized":"2023-10-07T09:06:44.880907+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:49.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865073+0000","last_change":"2023-10-07T09:06:45.865073+0000","last_active":"2023-10-07T09:06:45.865073+0000","last_peered":"2023-10-07T09:06:45.865073+0000","last_clean":"2023-10-07T09:06:45.865073+0000","last_became_active":"2023-10-07T09:06:45.864520+0000","last_became_peered":"2023-10-07T09:06:45.864520+0000","last_unstale":"2023-10-07T09:06:45.865073+0000","last_undegraded":"2023-10-07T09:06:45.865073+0000","last_fullsized":"2023-10-07T09:06:45.865073+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:31:01.739486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.876925+0000","last_change":"2023-10-07T09:06:44.872289+0000","last_active":"2023-10-07T09:06:44.876925+0000","last_peered":"2023-10-07T09:06:44.876925+0000","last_clean":"2023-10-07T09:06:44.876925+0000","last_became_active":"2023-10-07T09:06:44.871273+0000","last_became_peered":"2023-10-07T09:06:44.871273+0000","last_unstale":"2023-10-07T09:06:44.876925+0000","last_undegraded":"2023-10-07T09:06:44.876925+0000","last_fullsized":"2023-10-07T09:06:44.876925+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:49.962280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865266+0000","last_change":"2023-10-07T09:06:45.865266+0000","last_active":"2023-10-07T09:06:45.865266+0000","last_peered":"2023-10-07T09:06:45.865266+0000","last_clean":"2023-10-07T09:06:45.865266+0000","last_became_active":"2023-10-07T09:06:45.864986+0000","last_became_peered":"2023-10-07T09:06:45.864986+0000","last_unstale":"2023-10-07T09:06:45.865266+0000","last_undegraded":"2023-10-07T09:06:45.865266+0000","last_fullsized":"2023-10-07T09:06:45.865266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:25.251979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875805+0000","last_change":"2023-10-07T09:06:44.870103+0000","last_active":"2023-10-07T09:06:44.875805+0000","last_peered":"2023-10-07T09:06:44.875805+0000","last_clean":"2023-10-07T09:06:44.875805+0000","last_became_active":"2023-10-07T09:06:44.869720+0000","last_became_peered":"2023-10-07T09:06:44.869720+0000","last_unstale":"2023-10-07T09:06:44.875805+0000","last_undegraded":"2023-10-07T09:06:44.875805+0000","last_fullsized":"2023-10-07T09:06:44.875805+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:15.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873096+0000","last_change":"2023-10-07T09:06:45.873096+0000","last_active":"2023-10-07T09:06:45.873096+0000","last_peered":"2023-10-07T09:06:45.873096+0000","last_clean":"2023-10-07T09:06:45.873096+0000","last_became_active":"2023-10-07T09:06:45.872811+0000","last_became_peered":"2023-10-07T09:06:45.872811+0000","last_unstale":"2023-10-07T09:06:45.873096+0000","last_undegraded":"2023-10-07T09:06:45.873096+0000","last_fullsized":"2023-10-07T09:06:45.873096+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:21.587581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875746+0000","last_change":"2023-10-07T09:06:44.874551+0000","last_active":"2023-10-07T09:06:44.875746+0000","last_peered":"2023-10-07T09:06:44.875746+0000","last_clean":"2023-10-07T09:06:44.875746+0000","last_became_active":"2023-10-07T09:06:44.874270+0000","last_became_peered":"2023-10-07T09:06:44.874270+0000","last_unstale":"2023-10-07T09:06:44.875746+0000","last_undegraded":"2023-10-07T09:06:44.875746+0000","last_fullsized":"2023-10-07T09:06:44.875746+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:02.899305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.876171+0000","last_change":"2023-10-07T09:06:45.876171+0000","last_active":"2023-10-07T09:06:45.876171+0000","last_peered":"2023-10-07T09:06:45.876171+0000","last_clean":"2023-10-07T09:06:45.876171+0000","last_became_active":"2023-10-07T09:06:45.875881+0000","last_became_peered":"2023-10-07T09:06:45.875881+0000","last_unstale":"2023-10-07T09:06:45.876171+0000","last_undegraded":"2023-10-07T09:06:45.876171+0000","last_fullsized":"2023-10-07T09:06:45.876171+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:33.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875562+0000","last_change":"2023-10-07T09:06:44.874570+0000","last_active":"2023-10-07T09:06:44.875562+0000","last_peered":"2023-10-07T09:06:44.875562+0000","last_clean":"2023-10-07T09:06:44.875562+0000","last_became_active":"2023-10-07T09:06:44.874269+0000","last_became_peered":"2023-10-07T09:06:44.874269+0000","last_unstale":"2023-10-07T09:06:44.875562+0000","last_undegraded":"2023-10-07T09:06:44.875562+0000","last_fullsized":"2023-10-07T09:06:44.875562+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:32.612629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871633+0000","last_change":"2023-10-07T09:06:45.871633+0000","last_active":"2023-10-07T09:06:45.871633+0000","last_peered":"2023-10-07T09:06:45.871633+0000","last_clean":"2023-10-07T09:06:45.871633+0000","last_became_active":"2023-10-07T09:06:45.871373+0000","last_became_peered":"2023-10-07T09:06:45.871373+0000","last_unstale":"2023-10-07T09:06:45.871633+0000","last_undegraded":"2023-10-07T09:06:45.871633+0000","last_fullsized":"2023-10-07T09:06:45.871633+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:19.127660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877686+0000","last_change":"2023-10-07T09:06:44.875021+0000","last_active":"2023-10-07T09:06:44.877686+0000","last_peered":"2023-10-07T09:06:44.877686+0000","last_clean":"2023-10-07T09:06:44.877686+0000","last_became_active":"2023-10-07T09:06:44.874753+0000","last_became_peered":"2023-10-07T09:06:44.874753+0000","last_unstale":"2023-10-07T09:06:44.877686+0000","last_undegraded":"2023-10-07T09:06:44.877686+0000","last_fullsized":"2023-10-07T09:06:44.877686+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:50:29.343067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870880+0000","last_change":"2023-10-07T09:06:45.870880+0000","last_active":"2023-10-07T09:06:45.870880+0000","last_peered":"2023-10-07T09:06:45.870880+0000","last_clean":"2023-10-07T09:06:45.870880+0000","last_became_active":"2023-10-07T09:06:45.870558+0000","last_became_peered":"2023-10-07T09:06:45.870558+0000","last_unstale":"2023-10-07T09:06:45.870880+0000","last_undegraded":"2023-10-07T09:06:45.870880+0000","last_fullsized":"2023-10-07T09:06:45.870880+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:32.130871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875192+0000","last_change":"2023-10-07T09:06:44.870885+0000","last_active":"2023-10-07T09:06:44.875192+0000","last_peered":"2023-10-07T09:06:44.875192+0000","last_clean":"2023-10-07T09:06:44.875192+0000","last_became_active":"2023-10-07T09:06:44.870601+0000","last_became_peered":"2023-10-07T09:06:44.870601+0000","last_unstale":"2023-10-07T09:06:44.875192+0000","last_undegraded":"2023-10-07T09:06:44.875192+0000","last_fullsized":"2023-10-07T09:06:44.875192+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:59.320596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.879401+0000","last_change":"2023-10-07T09:06:45.879401+0000","last_active":"2023-10-07T09:06:45.879401+0000","last_peered":"2023-10-07T09:06:45.879401+0000","last_clean":"2023-10-07T09:06:45.879401+0000","last_became_active":"2023-10-07T09:06:45.878958+0000","last_became_peered":"2023-10-07T09:06:45.878958+0000","last_unstale":"2023-10-07T09:06:45.879401+0000","last_undegraded":"2023-10-07T09:06:45.879401+0000","last_fullsized":"2023-10-07T09:06:45.879401+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:40.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879362+0000","last_change":"2023-10-07T09:06:44.874868+0000","last_active":"2023-10-07T09:06:44.879362+0000","last_peered":"2023-10-07T09:06:44.879362+0000","last_clean":"2023-10-07T09:06:44.879362+0000","last_became_active":"2023-10-07T09:06:44.874446+0000","last_became_peered":"2023-10-07T09:06:44.874446+0000","last_unstale":"2023-10-07T09:06:44.879362+0000","last_undegraded":"2023-10-07T09:06:44.879362+0000","last_fullsized":"2023-10-07T09:06:44.879362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:29.245218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.879419+0000","last_change":"2023-10-07T09:06:45.879419+0000","last_active":"2023-10-07T09:06:45.879419+0000","last_peered":"2023-10-07T09:06:45.879419+0000","last_clean":"2023-10-07T09:06:45.879419+0000","last_became_active":"2023-10-07T09:06:45.876090+0000","last_became_peered":"2023-10-07T09:06:45.876090+0000","last_unstale":"2023-10-07T09:06:45.879419+0000","last_undegraded":"2023-10-07T09:06:45.879419+0000","last_fullsized":"2023-10-07T09:06:45.879419+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:11.839160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875855+0000","last_change":"2023-10-07T09:06:44.870027+0000","last_active":"2023-10-07T09:06:44.875855+0000","last_peered":"2023-10-07T09:06:44.875855+0000","last_clean":"2023-10-07T09:06:44.875855+0000","last_became_active":"2023-10-07T09:06:44.869740+0000","last_became_peered":"2023-10-07T09:06:44.869740+0000","last_unstale":"2023-10-07T09:06:44.875855+0000","last_undegraded":"2023-10-07T09:06:44.875855+0000","last_fullsized":"2023-10-07T09:06:44.875855+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:47.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871312+0000","last_change":"2023-10-07T09:06:45.871312+0000","last_active":"2023-10-07T09:06:45.871312+0000","last_peered":"2023-10-07T09:06:45.871312+0000","last_clean":"2023-10-07T09:06:45.871312+0000","last_became_active":"2023-10-07T09:06:45.871020+0000","last_became_peered":"2023-10-07T09:06:45.871020+0000","last_unstale":"2023-10-07T09:06:45.871312+0000","last_undegraded":"2023-10-07T09:06:45.871312+0000","last_fullsized":"2023-10-07T09:06:45.871312+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:24.345429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.876947+0000","last_change":"2023-10-07T09:06:44.872341+0000","last_active":"2023-10-07T09:06:44.876947+0000","last_peered":"2023-10-07T09:06:44.876947+0000","last_clean":"2023-10-07T09:06:44.876947+0000","last_became_active":"2023-10-07T09:06:44.871093+0000","last_became_peered":"2023-10-07T09:06:44.871093+0000","last_unstale":"2023-10-07T09:06:44.876947+0000","last_undegraded":"2023-10-07T09:06:44.876947+0000","last_fullsized":"2023-10-07T09:06:44.876947+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:18.054109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.866708+0000","last_change":"2023-10-07T09:06:45.866708+0000","last_active":"2023-10-07T09:06:45.866708+0000","last_peered":"2023-10-07T09:06:45.866708+0000","last_clean":"2023-10-07T09:06:45.866708+0000","last_became_active":"2023-10-07T09:06:45.866450+0000","last_became_peered":"2023-10-07T09:06:45.866450+0000","last_unstale":"2023-10-07T09:06:45.866708+0000","last_undegraded":"2023-10-07T09:06:45.866708+0000","last_fullsized":"2023-10-07T09:06:45.866708+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:35:38.040401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.880872+0000","last_change":"2023-10-07T09:06:44.877044+0000","last_active":"2023-10-07T09:06:44.880872+0000","last_peered":"2023-10-07T09:06:44.880872+0000","last_clean":"2023-10-07T09:06:44.880872+0000","last_became_active":"2023-10-07T09:06:44.876727+0000","last_became_peered":"2023-10-07T09:06:44.876727+0000","last_unstale":"2023-10-07T09:06:44.880872+0000","last_undegraded":"2023-10-07T09:06:44.880872+0000","last_fullsized":"2023-10-07T09:06:44.880872+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:35.908012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":291,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.858289+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:06:44.858289+0000","last_peered":"2023-10-07T09:06:44.858289+0000","last_clean":"2023-10-07T09:06:44.858289+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:06:44.858289+0000","last_undegraded":"2023-10-07T09:06:44.858289+0000","last_fullsized":"2023-10-07T09:06:44.858289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067856,"statfs":{"total":96636764160,"available":96325484544,"internally_reserved":0,"allocated":2662400,"data_stored":1509390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.85799999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.442}]},{"osd":1,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.505},"min":{"1min":0.40200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.50900000000000001},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.53800000000000003},"min":{"1min":0.33300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.76000000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":925785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70699999999999996,"5min":0.748,"15min":0.81399999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73999999999999999,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.439,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63800000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51500000000000001,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":1.29},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55500000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":4.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.499,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54200000000000004,"15min":0.58299999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.62},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35599999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.438},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.315}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.498}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067856,"statfs":{"total":96636764160,"available":96325484544,"internally_reserved":0,"allocated":2662400,"data_stored":1509390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.21299999999999999},"max":{"1min":0.44,"5min":0.501,"15min":0.54500000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.34899999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.218,"15min":0.191},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.374,"15min":0.38700000000000001},"min":{"1min":0.29699999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":0.53400000000000003,"15min":0.625},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.22},"max":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.34699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.63500000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.95399999999999996},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86399999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":1.006},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80800000000000005,"5min":0.879,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.55800000000000005},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":10.214},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.218,"15min":0.214},"max":{"1min":0.5,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.22,"15min":0.22},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.755},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.61899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48699999999999999,"5min":0.66100000000000003,"15min":10.144},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.66900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54700000000000004,"5min":0.68700000000000006,"15min":10.071},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41499999999999998,"15min":0.68600000000000005},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.54000000000000004,"5min":0.70399999999999996,"15min":10.183},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.0620000000000001},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.87,"15min":1.0880000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":4.391,"15min":4.391},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.253},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.438},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.42999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.495,"15min":0.78000000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.83399999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.311},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.86499999999999999},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.378}]},{"osd":2,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.83599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":10.01},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":5.569},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.83699999999999997},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.93500000000000005,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.51300000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.435},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54500000000000004,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.373}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:06:50.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:06:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.210+0000 7ff19be40700 1 Processor -- start 2023-10-07T09:06:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.210+0000 7ff19be40700 1 -- start start 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19be40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff19415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19be40700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff19415db10 0x7ff194069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19be40700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19415a160 con 0x7ff194159890 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19be40700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1940d13a0 con 0x7ff19415db10 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19be40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19415e140 con 0x7ff194159c60 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff19415db10 0x7ff194069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff199bdc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff194159890 0x7ff19415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59984/0 (socket says 172.21.15.46:59984) 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff199bdc700 1 -- 172.21.15.46:0/662757170 learned_addr learned my addr 172.21.15.46:0/662757170 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff1993db700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff19415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 -- 172.21.15.46:0/662757170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 msgr2=0x7ff19415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff19415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 -- 172.21.15.46:0/662757170 >> v1:172.21.15.46:6789/0 conn(0x7ff194159890 legacy=0x7ff19415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 -- 172.21.15.46:0/662757170 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19415a3d0 con 0x7ff19415db10 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff1993db700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff19415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff198bda700 1 -- 172.21.15.46:0/662757170 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895763307 0 0) 0x7ff19415a160 con 0x7ff194159890 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff19a3dd700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff19415db10 0x7ff194069560 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009e60 tx=0x7ff18c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3513b69e6e52fc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff198bda700 1 -- 172.21.15.46:0/662757170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00e070 con 0x7ff19415db10 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.211+0000 7ff198bda700 1 -- 172.21.15.46:0/662757170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00bc30 con 0x7ff19415db10 2023-10-07T09:06:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff198bda700 1 -- 172.21.15.46:0/662757170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c012430 con 0x7ff19415db10 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 -- 172.21.15.46:0/662757170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff19415db10 msgr2=0x7ff194069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff19415db10 0x7ff194069560 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009e60 tx=0x7ff18c009780 comp rx=0 tx=0).stop 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 -- 172.21.15.46:0/662757170 shutdown_connections 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff19415db10 0x7ff194069560 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 --2- 172.21.15.46:0/662757170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff19415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 -- 172.21.15.46:0/662757170 >> 172.21.15.46:0/662757170 conn(0x7ff194068e20 msgr2=0x7ff1940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 -- 172.21.15.46:0/662757170 shutdown_connections 2023-10-07T09:06:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.212+0000 7ff19be40700 1 -- 172.21.15.46:0/662757170 wait complete. 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.213+0000 7ff19be40700 1 Processor -- start 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.213+0000 7ff19be40700 1 -- start start 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff194153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff19415db10 0x7ff194153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1940cd0c0 con 0x7ff194159890 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194154310 con 0x7ff19415db10 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19be40700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1941545f0 con 0x7ff194159c60 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59828/0 (socket says 172.21.15.46:59828) 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 -- 172.21.15.46:0/2998840448 learned_addr learned my addr 172.21.15.46:0/2998840448 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff1993db700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff194153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff19a3dd700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff19415db10 0x7ff194153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 -- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 msgr2=0x7ff194153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff194153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 -- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff19415db10 msgr2=0x7ff194153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.214+0000 7ff199bdc700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff19415db10 0x7ff194153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff199bdc700 1 -- 172.21.15.46:0/2998840448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009a20 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff199bdc700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7ff19000c7e0 tx=0x7ff190007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190005b30 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190005c90 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1941548d0 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190007300 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.215+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1940b5890 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.216+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff194154d70 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.216+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff19001b3b0 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.217+0000 7ff189ffb700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.217+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff190084190 con 0x7ff194159890 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.217+0000 7ff1993db700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.217+0000 7ff1993db700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff1940b5490 tx=0x7ff184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.221+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff194154d70 con 0x7ff194159890 2023-10-07T09:06:50.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.409+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff194154d70 con 0x7ff178067320 2023-10-07T09:06:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.418+0000 7ff189ffb700 1 -- 172.21.15.46:0/2998840448 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289707 (secure 0 0 0) 0x7ff194154d70 con 0x7ff178067320 2023-10-07T09:06:50.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:50.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 msgr2=0x7ff1780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff1940b5490 tx=0x7ff184008040 comp rx=0 tx=0).stop 2023-10-07T09:06:50.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 msgr2=0x7ff194151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7ff19000c7e0 tx=0x7ff190007df0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 shutdown_connections 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff19415db10 0x7ff194153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff194159890 0x7ff194151c40 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 --2- 172.21.15.46:0/2998840448 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff194159c60 0x7ff194153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 >> 172.21.15.46:0/2998840448 conn(0x7ff194068e20 msgr2=0x7ff1940c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:50.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 shutdown_connections 2023-10-07T09:06:50.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.422+0000 7ff19be40700 1 -- 172.21.15.46:0/2998840448 wait complete. 2023-10-07T09:06:50.429 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:06:50.435 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2023-10-07T09:06:49.881809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428404,"kb_used_data":17332,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546316,"statfs":{"total":773094113280,"available":770607427584,"internally_reserved":0,"allocated":17747968,"data_stored":8539675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001370"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872808+0000","last_change":"2023-10-07T09:06:45.872808+0000","last_active":"2023-10-07T09:06:45.872808+0000","last_peered":"2023-10-07T09:06:45.872808+0000","last_clean":"2023-10-07T09:06:45.872808+0000","last_became_active":"2023-10-07T09:06:45.872543+0000","last_became_peered":"2023-10-07T09:06:45.872543+0000","last_unstale":"2023-10-07T09:06:45.872808+0000","last_undegraded":"2023-10-07T09:06:45.872808+0000","last_fullsized":"2023-10-07T09:06:45.872808+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:29.352190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875202+0000","last_change":"2023-10-07T09:06:45.875202+0000","last_active":"2023-10-07T09:06:45.875202+0000","last_peered":"2023-10-07T09:06:45.875202+0000","last_clean":"2023-10-07T09:06:45.875202+0000","last_became_active":"2023-10-07T09:06:45.874834+0000","last_became_peered":"2023-10-07T09:06:45.874834+0000","last_unstale":"2023-10-07T09:06:45.875202+0000","last_undegraded":"2023-10-07T09:06:45.875202+0000","last_fullsized":"2023-10-07T09:06:45.875202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:24.574865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873369+0000","last_change":"2023-10-07T09:06:45.873369+0000","last_active":"2023-10-07T09:06:45.873369+0000","last_peered":"2023-10-07T09:06:45.873369+0000","last_clean":"2023-10-07T09:06:45.873369+0000","last_became_active":"2023-10-07T09:06:45.872917+0000","last_became_peered":"2023-10-07T09:06:45.872917+0000","last_unstale":"2023-10-07T09:06:45.873369+0000","last_undegraded":"2023-10-07T09:06:45.873369+0000","last_fullsized":"2023-10-07T09:06:45.873369+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:32.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864137+0000","last_change":"2023-10-07T09:06:45.864137+0000","last_active":"2023-10-07T09:06:45.864137+0000","last_peered":"2023-10-07T09:06:45.864137+0000","last_clean":"2023-10-07T09:06:45.864137+0000","last_became_active":"2023-10-07T09:06:45.863885+0000","last_became_peered":"2023-10-07T09:06:45.863885+0000","last_unstale":"2023-10-07T09:06:45.864137+0000","last_undegraded":"2023-10-07T09:06:45.864137+0000","last_fullsized":"2023-10-07T09:06:45.864137+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:00:49.028771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864114+0000","last_change":"2023-10-07T09:06:45.864114+0000","last_active":"2023-10-07T09:06:45.864114+0000","last_peered":"2023-10-07T09:06:45.864114+0000","last_clean":"2023-10-07T09:06:45.864114+0000","last_became_active":"2023-10-07T09:06:45.863840+0000","last_became_peered":"2023-10-07T09:06:45.863840+0000","last_unstale":"2023-10-07T09:06:45.864114+0000","last_undegraded":"2023-10-07T09:06:45.864114+0000","last_fullsized":"2023-10-07T09:06:45.864114+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:58.219037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873299+0000","last_change":"2023-10-07T09:06:45.873299+0000","last_active":"2023-10-07T09:06:45.873299+0000","last_peered":"2023-10-07T09:06:45.873299+0000","last_clean":"2023-10-07T09:06:45.873299+0000","last_became_active":"2023-10-07T09:06:45.873026+0000","last_became_peered":"2023-10-07T09:06:45.873026+0000","last_unstale":"2023-10-07T09:06:45.873299+0000","last_undegraded":"2023-10-07T09:06:45.873299+0000","last_fullsized":"2023-10-07T09:06:45.873299+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:11.272925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872833+0000","last_change":"2023-10-07T09:06:45.872833+0000","last_active":"2023-10-07T09:06:45.872833+0000","last_peered":"2023-10-07T09:06:45.872833+0000","last_clean":"2023-10-07T09:06:45.872833+0000","last_became_active":"2023-10-07T09:06:45.872522+0000","last_became_peered":"2023-10-07T09:06:45.872522+0000","last_unstale":"2023-10-07T09:06:45.872833+0000","last_undegraded":"2023-10-07T09:06:45.872833+0000","last_fullsized":"2023-10-07T09:06:45.872833+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:50.419557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871172+0000","last_change":"2023-10-07T09:06:45.871172+0000","last_active":"2023-10-07T09:06:45.871172+0000","last_peered":"2023-10-07T09:06:45.871172+0000","last_clean":"2023-10-07T09:06:45.871172+0000","last_became_active":"2023-10-07T09:06:45.870915+0000","last_became_peered":"2023-10-07T09:06:45.870915+0000","last_unstale":"2023-10-07T09:06:45.871172+0000","last_undegraded":"2023-10-07T09:06:45.871172+0000","last_fullsized":"2023-10-07T09:06:45.871172+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.609943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878618+0000","last_change":"2023-10-07T09:06:45.878618+0000","last_active":"2023-10-07T09:06:45.878618+0000","last_peered":"2023-10-07T09:06:45.878618+0000","last_clean":"2023-10-07T09:06:45.878618+0000","last_became_active":"2023-10-07T09:06:45.878336+0000","last_became_peered":"2023-10-07T09:06:45.878336+0000","last_unstale":"2023-10-07T09:06:45.878618+0000","last_undegraded":"2023-10-07T09:06:45.878618+0000","last_fullsized":"2023-10-07T09:06:45.878618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:20.580046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867768+0000","last_change":"2023-10-07T09:06:45.867768+0000","last_active":"2023-10-07T09:06:45.867768+0000","last_peered":"2023-10-07T09:06:45.867768+0000","last_clean":"2023-10-07T09:06:45.867768+0000","last_became_active":"2023-10-07T09:06:45.867453+0000","last_became_peered":"2023-10-07T09:06:45.867453+0000","last_unstale":"2023-10-07T09:06:45.867768+0000","last_undegraded":"2023-10-07T09:06:45.867768+0000","last_fullsized":"2023-10-07T09:06:45.867768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:51:46.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867938+0000","last_change":"2023-10-07T09:06:45.867938+0000","last_active":"2023-10-07T09:06:45.867938+0000","last_peered":"2023-10-07T09:06:45.867938+0000","last_clean":"2023-10-07T09:06:45.867938+0000","last_became_active":"2023-10-07T09:06:45.867470+0000","last_became_peered":"2023-10-07T09:06:45.867470+0000","last_unstale":"2023-10-07T09:06:45.867938+0000","last_undegraded":"2023-10-07T09:06:45.867938+0000","last_fullsized":"2023-10-07T09:06:45.867938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:33.715111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870143+0000","last_change":"2023-10-07T09:06:45.870143+0000","last_active":"2023-10-07T09:06:45.870143+0000","last_peered":"2023-10-07T09:06:45.870143+0000","last_clean":"2023-10-07T09:06:45.870143+0000","last_became_active":"2023-10-07T09:06:45.869878+0000","last_became_peered":"2023-10-07T09:06:45.869878+0000","last_unstale":"2023-10-07T09:06:45.870143+0000","last_undegraded":"2023-10-07T09:06:45.870143+0000","last_fullsized":"2023-10-07T09:06:45.870143+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:47.827963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872154+0000","last_change":"2023-10-07T09:06:45.872154+0000","last_active":"2023-10-07T09:06:45.872154+0000","last_peered":"2023-10-07T09:06:45.872154+0000","last_clean":"2023-10-07T09:06:45.872154+0000","last_became_active":"2023-10-07T09:06:45.871876+0000","last_became_peered":"2023-10-07T09:06:45.871876+0000","last_unstale":"2023-10-07T09:06:45.872154+0000","last_undegraded":"2023-10-07T09:06:45.872154+0000","last_fullsized":"2023-10-07T09:06:45.872154+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:16.414279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875620+0000","last_change":"2023-10-07T09:06:45.875620+0000","last_active":"2023-10-07T09:06:45.875620+0000","last_peered":"2023-10-07T09:06:45.875620+0000","last_clean":"2023-10-07T09:06:45.875620+0000","last_became_active":"2023-10-07T09:06:45.875357+0000","last_became_peered":"2023-10-07T09:06:45.875357+0000","last_unstale":"2023-10-07T09:06:45.875620+0000","last_undegraded":"2023-10-07T09:06:45.875620+0000","last_fullsized":"2023-10-07T09:06:45.875620+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:19.207918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.880949+0000","last_change":"2023-10-07T09:06:45.880949+0000","last_active":"2023-10-07T09:06:45.880949+0000","last_peered":"2023-10-07T09:06:45.880949+0000","last_clean":"2023-10-07T09:06:45.880949+0000","last_became_active":"2023-10-07T09:06:45.880576+0000","last_became_peered":"2023-10-07T09:06:45.880576+0000","last_unstale":"2023-10-07T09:06:45.880949+0000","last_undegraded":"2023-10-07T09:06:45.880949+0000","last_fullsized":"2023-10-07T09:06:45.880949+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.821335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865902+0000","last_change":"2023-10-07T09:06:45.865902+0000","last_active":"2023-10-07T09:06:45.865902+0000","last_peered":"2023-10-07T09:06:45.865902+0000","last_clean":"2023-10-07T09:06:45.865902+0000","last_became_active":"2023-10-07T09:06:45.864628+0000","last_became_peered":"2023-10-07T09:06:45.864628+0000","last_unstale":"2023-10-07T09:06:45.865902+0000","last_undegraded":"2023-10-07T09:06:45.865902+0000","last_fullsized":"2023-10-07T09:06:45.865902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:15:20.202972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875312+0000","last_change":"2023-10-07T09:06:45.875312+0000","last_active":"2023-10-07T09:06:45.875312+0000","last_peered":"2023-10-07T09:06:45.875312+0000","last_clean":"2023-10-07T09:06:45.875312+0000","last_became_active":"2023-10-07T09:06:45.875004+0000","last_became_peered":"2023-10-07T09:06:45.875004+0000","last_unstale":"2023-10-07T09:06:45.875312+0000","last_undegraded":"2023-10-07T09:06:45.875312+0000","last_fullsized":"2023-10-07T09:06:45.875312+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:25.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878964+0000","last_change":"2023-10-07T09:06:45.878964+0000","last_active":"2023-10-07T09:06:45.878964+0000","last_peered":"2023-10-07T09:06:45.878964+0000","last_clean":"2023-10-07T09:06:45.878964+0000","last_became_active":"2023-10-07T09:06:45.878597+0000","last_became_peered":"2023-10-07T09:06:45.878597+0000","last_unstale":"2023-10-07T09:06:45.878964+0000","last_undegraded":"2023-10-07T09:06:45.878964+0000","last_fullsized":"2023-10-07T09:06:45.878964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:47.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865844+0000","last_change":"2023-10-07T09:06:45.865844+0000","last_active":"2023-10-07T09:06:45.865844+0000","last_peered":"2023-10-07T09:06:45.865844+0000","last_clean":"2023-10-07T09:06:45.865844+0000","last_became_active":"2023-10-07T09:06:45.865568+0000","last_became_peered":"2023-10-07T09:06:45.865568+0000","last_unstale":"2023-10-07T09:06:45.865844+0000","last_undegraded":"2023-10-07T09:06:45.865844+0000","last_fullsized":"2023-10-07T09:06:45.865844+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:06.671287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870533+0000","last_change":"2023-10-07T09:06:45.870533+0000","last_active":"2023-10-07T09:06:45.870533+0000","last_peered":"2023-10-07T09:06:45.870533+0000","last_clean":"2023-10-07T09:06:45.870533+0000","last_became_active":"2023-10-07T09:06:45.870244+0000","last_became_peered":"2023-10-07T09:06:45.870244+0000","last_unstale":"2023-10-07T09:06:45.870533+0000","last_undegraded":"2023-10-07T09:06:45.870533+0000","last_fullsized":"2023-10-07T09:06:45.870533+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:58:33.857998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.859406+0000","last_change":"2023-10-07T09:06:45.859406+0000","last_active":"2023-10-07T09:06:45.859406+0000","last_peered":"2023-10-07T09:06:45.859406+0000","last_clean":"2023-10-07T09:06:45.859406+0000","last_became_active":"2023-10-07T09:06:45.859130+0000","last_became_peered":"2023-10-07T09:06:45.859130+0000","last_unstale":"2023-10-07T09:06:45.859406+0000","last_undegraded":"2023-10-07T09:06:45.859406+0000","last_fullsized":"2023-10-07T09:06:45.859406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:20.580046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875498+0000","last_change":"2023-10-07T09:06:45.875498+0000","last_active":"2023-10-07T09:06:45.875498+0000","last_peered":"2023-10-07T09:06:45.875498+0000","last_clean":"2023-10-07T09:06:45.875498+0000","last_became_active":"2023-10-07T09:06:45.875170+0000","last_became_peered":"2023-10-07T09:06:45.875170+0000","last_unstale":"2023-10-07T09:06:45.875498+0000","last_undegraded":"2023-10-07T09:06:45.875498+0000","last_fullsized":"2023-10-07T09:06:45.875498+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:17:47.790412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867065+0000","last_change":"2023-10-07T09:06:45.867065+0000","last_active":"2023-10-07T09:06:45.867065+0000","last_peered":"2023-10-07T09:06:45.867065+0000","last_clean":"2023-10-07T09:06:45.867065+0000","last_became_active":"2023-10-07T09:06:45.864249+0000","last_became_peered":"2023-10-07T09:06:45.864249+0000","last_unstale":"2023-10-07T09:06:45.867065+0000","last_undegraded":"2023-10-07T09:06:45.867065+0000","last_fullsized":"2023-10-07T09:06:45.867065+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:06:25.560859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.869108+0000","last_change":"2023-10-07T09:06:45.869108+0000","last_active":"2023-10-07T09:06:45.869108+0000","last_peered":"2023-10-07T09:06:45.869108+0000","last_clean":"2023-10-07T09:06:45.869108+0000","last_became_active":"2023-10-07T09:06:45.868832+0000","last_became_peered":"2023-10-07T09:06:45.868832+0000","last_unstale":"2023-10-07T09:06:45.869108+0000","last_undegraded":"2023-10-07T09:06:45.869108+0000","last_fullsized":"2023-10-07T09:06:45.869108+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:47.005282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873538+0000","last_change":"2023-10-07T09:06:45.873538+0000","last_active":"2023-10-07T09:06:45.873538+0000","last_peered":"2023-10-07T09:06:45.873538+0000","last_clean":"2023-10-07T09:06:45.873538+0000","last_became_active":"2023-10-07T09:06:45.873261+0000","last_became_peered":"2023-10-07T09:06:45.873261+0000","last_unstale":"2023-10-07T09:06:45.873538+0000","last_undegraded":"2023-10-07T09:06:45.873538+0000","last_fullsized":"2023-10-07T09:06:45.873538+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:45:30.779777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872892+0000","last_change":"2023-10-07T09:06:45.872892+0000","last_active":"2023-10-07T09:06:45.872892+0000","last_peered":"2023-10-07T09:06:45.872892+0000","last_clean":"2023-10-07T09:06:45.872892+0000","last_became_active":"2023-10-07T09:06:45.872618+0000","last_became_peered":"2023-10-07T09:06:45.872618+0000","last_unstale":"2023-10-07T09:06:45.872892+0000","last_undegraded":"2023-10-07T09:06:45.872892+0000","last_fullsized":"2023-10-07T09:06:45.872892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:19.064014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867765+0000","last_change":"2023-10-07T09:06:45.867765+0000","last_active":"2023-10-07T09:06:45.867765+0000","last_peered":"2023-10-07T09:06:45.867765+0000","last_clean":"2023-10-07T09:06:45.867765+0000","last_became_active":"2023-10-07T09:06:45.867325+0000","last_became_peered":"2023-10-07T09:06:45.867325+0000","last_unstale":"2023-10-07T09:06:45.867765+0000","last_undegraded":"2023-10-07T09:06:45.867765+0000","last_fullsized":"2023-10-07T09:06:45.867765+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:20.489841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870028+0000","last_change":"2023-10-07T09:06:45.870028+0000","last_active":"2023-10-07T09:06:45.870028+0000","last_peered":"2023-10-07T09:06:45.870028+0000","last_clean":"2023-10-07T09:06:45.870028+0000","last_became_active":"2023-10-07T09:06:45.869739+0000","last_became_peered":"2023-10-07T09:06:45.869739+0000","last_unstale":"2023-10-07T09:06:45.870028+0000","last_undegraded":"2023-10-07T09:06:45.870028+0000","last_fullsized":"2023-10-07T09:06:45.870028+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:16.986795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881056+0000","last_change":"2023-10-07T09:06:45.881056+0000","last_active":"2023-10-07T09:06:45.881056+0000","last_peered":"2023-10-07T09:06:45.881056+0000","last_clean":"2023-10-07T09:06:45.881056+0000","last_became_active":"2023-10-07T09:06:45.880748+0000","last_became_peered":"2023-10-07T09:06:45.880748+0000","last_unstale":"2023-10-07T09:06:45.881056+0000","last_undegraded":"2023-10-07T09:06:45.881056+0000","last_fullsized":"2023-10-07T09:06:45.881056+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:32.130871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872665+0000","last_change":"2023-10-07T09:06:45.872665+0000","last_active":"2023-10-07T09:06:45.872665+0000","last_peered":"2023-10-07T09:06:45.872665+0000","last_clean":"2023-10-07T09:06:45.872665+0000","last_became_active":"2023-10-07T09:06:45.872240+0000","last_became_peered":"2023-10-07T09:06:45.872240+0000","last_unstale":"2023-10-07T09:06:45.872665+0000","last_undegraded":"2023-10-07T09:06:45.872665+0000","last_fullsized":"2023-10-07T09:06:45.872665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:37.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872759+0000","last_change":"2023-10-07T09:06:45.872759+0000","last_active":"2023-10-07T09:06:45.872759+0000","last_peered":"2023-10-07T09:06:45.872759+0000","last_clean":"2023-10-07T09:06:45.872759+0000","last_became_active":"2023-10-07T09:06:45.872475+0000","last_became_peered":"2023-10-07T09:06:45.872475+0000","last_unstale":"2023-10-07T09:06:45.872759+0000","last_undegraded":"2023-10-07T09:06:45.872759+0000","last_fullsized":"2023-10-07T09:06:45.872759+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:06.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.880896+0000","last_change":"2023-10-07T09:06:45.880896+0000","last_active":"2023-10-07T09:06:45.880896+0000","last_peered":"2023-10-07T09:06:45.880896+0000","last_clean":"2023-10-07T09:06:45.880896+0000","last_became_active":"2023-10-07T09:06:45.880618+0000","last_became_peered":"2023-10-07T09:06:45.880618+0000","last_unstale":"2023-10-07T09:06:45.880896+0000","last_undegraded":"2023-10-07T09:06:45.880896+0000","last_fullsized":"2023-10-07T09:06:45.880896+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:41:27.563599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878784+0000","last_change":"2023-10-07T09:06:45.878784+0000","last_active":"2023-10-07T09:06:45.878784+0000","last_peered":"2023-10-07T09:06:45.878784+0000","last_clean":"2023-10-07T09:06:45.878784+0000","last_became_active":"2023-10-07T09:06:45.878472+0000","last_became_peered":"2023-10-07T09:06:45.878472+0000","last_unstale":"2023-10-07T09:06:45.878784+0000","last_undegraded":"2023-10-07T09:06:45.878784+0000","last_fullsized":"2023-10-07T09:06:45.878784+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:37.070216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.869316+0000","last_change":"2023-10-07T09:06:44.868158+0000","last_active":"2023-10-07T09:06:44.869316+0000","last_peered":"2023-10-07T09:06:44.869316+0000","last_clean":"2023-10-07T09:06:44.869316+0000","last_became_active":"2023-10-07T09:06:44.867867+0000","last_became_peered":"2023-10-07T09:06:44.867867+0000","last_unstale":"2023-10-07T09:06:44.869316+0000","last_undegraded":"2023-10-07T09:06:44.869316+0000","last_fullsized":"2023-10-07T09:06:44.869316+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:53:46.136857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867558+0000","last_change":"2023-10-07T09:06:45.867558+0000","last_active":"2023-10-07T09:06:45.867558+0000","last_peered":"2023-10-07T09:06:45.867558+0000","last_clean":"2023-10-07T09:06:45.867558+0000","last_became_active":"2023-10-07T09:06:45.867234+0000","last_became_peered":"2023-10-07T09:06:45.867234+0000","last_unstale":"2023-10-07T09:06:45.867558+0000","last_undegraded":"2023-10-07T09:06:45.867558+0000","last_fullsized":"2023-10-07T09:06:45.867558+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:50.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877752+0000","last_change":"2023-10-07T09:06:44.872276+0000","last_active":"2023-10-07T09:06:44.877752+0000","last_peered":"2023-10-07T09:06:44.877752+0000","last_clean":"2023-10-07T09:06:44.877752+0000","last_became_active":"2023-10-07T09:06:44.872016+0000","last_became_peered":"2023-10-07T09:06:44.872016+0000","last_unstale":"2023-10-07T09:06:44.877752+0000","last_undegraded":"2023-10-07T09:06:44.877752+0000","last_fullsized":"2023-10-07T09:06:44.877752+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:27.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881046+0000","last_change":"2023-10-07T09:06:45.881046+0000","last_active":"2023-10-07T09:06:45.881046+0000","last_peered":"2023-10-07T09:06:45.881046+0000","last_clean":"2023-10-07T09:06:45.881046+0000","last_became_active":"2023-10-07T09:06:45.880807+0000","last_became_peered":"2023-10-07T09:06:45.880807+0000","last_unstale":"2023-10-07T09:06:45.881046+0000","last_undegraded":"2023-10-07T09:06:45.881046+0000","last_fullsized":"2023-10-07T09:06:45.881046+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:52.989184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.874691+0000","last_change":"2023-10-07T09:06:44.870632+0000","last_active":"2023-10-07T09:06:44.874691+0000","last_peered":"2023-10-07T09:06:44.874691+0000","last_clean":"2023-10-07T09:06:44.874691+0000","last_became_active":"2023-10-07T09:06:44.870387+0000","last_became_peered":"2023-10-07T09:06:44.870387+0000","last_unstale":"2023-10-07T09:06:44.874691+0000","last_undegraded":"2023-10-07T09:06:44.874691+0000","last_fullsized":"2023-10-07T09:06:44.874691+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:46.600038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872491+0000","last_change":"2023-10-07T09:06:45.872491+0000","last_active":"2023-10-07T09:06:45.872491+0000","last_peered":"2023-10-07T09:06:45.872491+0000","last_clean":"2023-10-07T09:06:45.872491+0000","last_became_active":"2023-10-07T09:06:45.871899+0000","last_became_peered":"2023-10-07T09:06:45.871899+0000","last_unstale":"2023-10-07T09:06:45.872491+0000","last_undegraded":"2023-10-07T09:06:45.872491+0000","last_fullsized":"2023-10-07T09:06:45.872491+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:18:28.143420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879759+0000","last_change":"2023-10-07T09:06:44.874327+0000","last_active":"2023-10-07T09:06:44.879759+0000","last_peered":"2023-10-07T09:06:44.879759+0000","last_clean":"2023-10-07T09:06:44.879759+0000","last_became_active":"2023-10-07T09:06:44.874055+0000","last_became_peered":"2023-10-07T09:06:44.874055+0000","last_unstale":"2023-10-07T09:06:44.879759+0000","last_undegraded":"2023-10-07T09:06:44.879759+0000","last_fullsized":"2023-10-07T09:06:44.879759+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:53.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873093+0000","last_change":"2023-10-07T09:06:45.873093+0000","last_active":"2023-10-07T09:06:45.873093+0000","last_peered":"2023-10-07T09:06:45.873093+0000","last_clean":"2023-10-07T09:06:45.873093+0000","last_became_active":"2023-10-07T09:06:45.872214+0000","last_became_peered":"2023-10-07T09:06:45.872214+0000","last_unstale":"2023-10-07T09:06:45.873093+0000","last_undegraded":"2023-10-07T09:06:45.873093+0000","last_fullsized":"2023-10-07T09:06:45.873093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:40.887434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867970+0000","last_change":"2023-10-07T09:06:44.871440+0000","last_active":"2023-10-07T09:06:45.867970+0000","last_peered":"2023-10-07T09:06:45.867970+0000","last_clean":"2023-10-07T09:06:45.867970+0000","last_became_active":"2023-10-07T09:06:44.871173+0000","last_became_peered":"2023-10-07T09:06:44.871173+0000","last_unstale":"2023-10-07T09:06:45.867970+0000","last_undegraded":"2023-10-07T09:06:45.867970+0000","last_fullsized":"2023-10-07T09:06:45.867970+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:24.997381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870192+0000","last_change":"2023-10-07T09:06:45.870192+0000","last_active":"2023-10-07T09:06:45.870192+0000","last_peered":"2023-10-07T09:06:45.870192+0000","last_clean":"2023-10-07T09:06:45.870192+0000","last_became_active":"2023-10-07T09:06:45.869916+0000","last_became_peered":"2023-10-07T09:06:45.869916+0000","last_unstale":"2023-10-07T09:06:45.870192+0000","last_undegraded":"2023-10-07T09:06:45.870192+0000","last_fullsized":"2023-10-07T09:06:45.870192+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:09.115510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875232+0000","last_change":"2023-10-07T09:06:44.871315+0000","last_active":"2023-10-07T09:06:44.875232+0000","last_peered":"2023-10-07T09:06:44.875232+0000","last_clean":"2023-10-07T09:06:44.875232+0000","last_became_active":"2023-10-07T09:06:44.869982+0000","last_became_peered":"2023-10-07T09:06:44.869982+0000","last_unstale":"2023-10-07T09:06:44.875232+0000","last_undegraded":"2023-10-07T09:06:44.875232+0000","last_fullsized":"2023-10-07T09:06:44.875232+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875240+0000","last_change":"2023-10-07T09:06:45.875240+0000","last_active":"2023-10-07T09:06:45.875240+0000","last_peered":"2023-10-07T09:06:45.875240+0000","last_clean":"2023-10-07T09:06:45.875240+0000","last_became_active":"2023-10-07T09:06:45.874912+0000","last_became_peered":"2023-10-07T09:06:45.874912+0000","last_unstale":"2023-10-07T09:06:45.875240+0000","last_undegraded":"2023-10-07T09:06:45.875240+0000","last_fullsized":"2023-10-07T09:06:45.875240+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.131542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877904+0000","last_change":"2023-10-07T09:06:44.870624+0000","last_active":"2023-10-07T09:06:44.877904+0000","last_peered":"2023-10-07T09:06:44.877904+0000","last_clean":"2023-10-07T09:06:44.877904+0000","last_became_active":"2023-10-07T09:06:44.870119+0000","last_became_peered":"2023-10-07T09:06:44.870119+0000","last_unstale":"2023-10-07T09:06:44.877904+0000","last_undegraded":"2023-10-07T09:06:44.877904+0000","last_fullsized":"2023-10-07T09:06:44.877904+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:05:29.389480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.875076+0000","last_change":"2023-10-07T09:06:45.875076+0000","last_active":"2023-10-07T09:06:45.875076+0000","last_peered":"2023-10-07T09:06:45.875076+0000","last_clean":"2023-10-07T09:06:45.875076+0000","last_became_active":"2023-10-07T09:06:45.874718+0000","last_became_peered":"2023-10-07T09:06:45.874718+0000","last_unstale":"2023-10-07T09:06:45.875076+0000","last_undegraded":"2023-10-07T09:06:45.875076+0000","last_fullsized":"2023-10-07T09:06:45.875076+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:19.207918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.878572+0000","last_change":"2023-10-07T09:06:44.876397+0000","last_active":"2023-10-07T09:06:44.878572+0000","last_peered":"2023-10-07T09:06:44.878572+0000","last_clean":"2023-10-07T09:06:44.878572+0000","last_became_active":"2023-10-07T09:06:44.875996+0000","last_became_peered":"2023-10-07T09:06:44.875996+0000","last_unstale":"2023-10-07T09:06:44.878572+0000","last_undegraded":"2023-10-07T09:06:44.878572+0000","last_fullsized":"2023-10-07T09:06:44.878572+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:19.570141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865524+0000","last_change":"2023-10-07T09:06:45.865524+0000","last_active":"2023-10-07T09:06:45.865524+0000","last_peered":"2023-10-07T09:06:45.865524+0000","last_clean":"2023-10-07T09:06:45.865524+0000","last_became_active":"2023-10-07T09:06:45.865205+0000","last_became_peered":"2023-10-07T09:06:45.865205+0000","last_unstale":"2023-10-07T09:06:45.865524+0000","last_undegraded":"2023-10-07T09:06:45.865524+0000","last_fullsized":"2023-10-07T09:06:45.865524+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:00:57.785778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879384+0000","last_change":"2023-10-07T09:06:44.874602+0000","last_active":"2023-10-07T09:06:44.879384+0000","last_peered":"2023-10-07T09:06:44.879384+0000","last_clean":"2023-10-07T09:06:44.879384+0000","last_became_active":"2023-10-07T09:06:44.874298+0000","last_became_peered":"2023-10-07T09:06:44.874298+0000","last_unstale":"2023-10-07T09:06:44.879384+0000","last_undegraded":"2023-10-07T09:06:44.879384+0000","last_fullsized":"2023-10-07T09:06:44.879384+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:44.906572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881389+0000","last_change":"2023-10-07T09:06:45.881389+0000","last_active":"2023-10-07T09:06:45.881389+0000","last_peered":"2023-10-07T09:06:45.881389+0000","last_clean":"2023-10-07T09:06:45.881389+0000","last_became_active":"2023-10-07T09:06:45.881097+0000","last_became_peered":"2023-10-07T09:06:45.881097+0000","last_unstale":"2023-10-07T09:06:45.881389+0000","last_undegraded":"2023-10-07T09:06:45.881389+0000","last_fullsized":"2023-10-07T09:06:45.881389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:11.516707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875907+0000","last_change":"2023-10-07T09:06:44.870800+0000","last_active":"2023-10-07T09:06:44.875907+0000","last_peered":"2023-10-07T09:06:44.875907+0000","last_clean":"2023-10-07T09:06:44.875907+0000","last_became_active":"2023-10-07T09:06:44.870538+0000","last_became_peered":"2023-10-07T09:06:44.870538+0000","last_unstale":"2023-10-07T09:06:44.875907+0000","last_undegraded":"2023-10-07T09:06:44.875907+0000","last_fullsized":"2023-10-07T09:06:44.875907+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:15:19.193067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.866389+0000","last_change":"2023-10-07T09:06:45.866389+0000","last_active":"2023-10-07T09:06:45.866389+0000","last_peered":"2023-10-07T09:06:45.866389+0000","last_clean":"2023-10-07T09:06:45.866389+0000","last_became_active":"2023-10-07T09:06:45.866088+0000","last_became_peered":"2023-10-07T09:06:45.866088+0000","last_unstale":"2023-10-07T09:06:45.866389+0000","last_undegraded":"2023-10-07T09:06:45.866389+0000","last_fullsized":"2023-10-07T09:06:45.866389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:55.424651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879494+0000","last_change":"2023-10-07T09:06:44.877102+0000","last_active":"2023-10-07T09:06:44.879494+0000","last_peered":"2023-10-07T09:06:44.879494+0000","last_clean":"2023-10-07T09:06:44.879494+0000","last_became_active":"2023-10-07T09:06:44.876689+0000","last_became_peered":"2023-10-07T09:06:44.876689+0000","last_unstale":"2023-10-07T09:06:44.879494+0000","last_undegraded":"2023-10-07T09:06:44.879494+0000","last_fullsized":"2023-10-07T09:06:44.879494+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:41:04.021789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871009+0000","last_change":"2023-10-07T09:06:45.871009+0000","last_active":"2023-10-07T09:06:45.871009+0000","last_peered":"2023-10-07T09:06:45.871009+0000","last_clean":"2023-10-07T09:06:45.871009+0000","last_became_active":"2023-10-07T09:06:45.870739+0000","last_became_peered":"2023-10-07T09:06:45.870739+0000","last_unstale":"2023-10-07T09:06:45.871009+0000","last_undegraded":"2023-10-07T09:06:45.871009+0000","last_fullsized":"2023-10-07T09:06:45.871009+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:47.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879925+0000","last_change":"2023-10-07T09:06:44.875982+0000","last_active":"2023-10-07T09:06:44.879925+0000","last_peered":"2023-10-07T09:06:44.879925+0000","last_clean":"2023-10-07T09:06:44.879925+0000","last_became_active":"2023-10-07T09:06:44.875736+0000","last_became_peered":"2023-10-07T09:06:44.875736+0000","last_unstale":"2023-10-07T09:06:44.879925+0000","last_undegraded":"2023-10-07T09:06:44.879925+0000","last_fullsized":"2023-10-07T09:06:44.879925+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:49.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.877263+0000","last_change":"2023-10-07T09:06:45.877263+0000","last_active":"2023-10-07T09:06:45.877263+0000","last_peered":"2023-10-07T09:06:45.877263+0000","last_clean":"2023-10-07T09:06:45.877263+0000","last_became_active":"2023-10-07T09:06:45.876951+0000","last_became_peered":"2023-10-07T09:06:45.876951+0000","last_unstale":"2023-10-07T09:06:45.877263+0000","last_undegraded":"2023-10-07T09:06:45.877263+0000","last_fullsized":"2023-10-07T09:06:45.877263+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:03.909210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879387+0000","last_change":"2023-10-07T09:06:44.876453+0000","last_active":"2023-10-07T09:06:44.879387+0000","last_peered":"2023-10-07T09:06:44.879387+0000","last_clean":"2023-10-07T09:06:44.879387+0000","last_became_active":"2023-10-07T09:06:44.876191+0000","last_became_peered":"2023-10-07T09:06:44.876191+0000","last_unstale":"2023-10-07T09:06:44.879387+0000","last_undegraded":"2023-10-07T09:06:44.879387+0000","last_fullsized":"2023-10-07T09:06:44.879387+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:57:40.946180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872563+0000","last_change":"2023-10-07T09:06:45.872563+0000","last_active":"2023-10-07T09:06:45.872563+0000","last_peered":"2023-10-07T09:06:45.872563+0000","last_clean":"2023-10-07T09:06:45.872563+0000","last_became_active":"2023-10-07T09:06:45.872281+0000","last_became_peered":"2023-10-07T09:06:45.872281+0000","last_unstale":"2023-10-07T09:06:45.872563+0000","last_undegraded":"2023-10-07T09:06:45.872563+0000","last_fullsized":"2023-10-07T09:06:45.872563+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:09:46.222892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.868690+0000","last_change":"2023-10-07T09:06:44.867666+0000","last_active":"2023-10-07T09:06:44.868690+0000","last_peered":"2023-10-07T09:06:44.868690+0000","last_clean":"2023-10-07T09:06:44.868690+0000","last_became_active":"2023-10-07T09:06:44.867373+0000","last_became_peered":"2023-10-07T09:06:44.867373+0000","last_unstale":"2023-10-07T09:06:44.868690+0000","last_undegraded":"2023-10-07T09:06:44.868690+0000","last_fullsized":"2023-10-07T09:06:44.868690+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:46.818057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872194+0000","last_change":"2023-10-07T09:06:45.872194+0000","last_active":"2023-10-07T09:06:45.872194+0000","last_peered":"2023-10-07T09:06:45.872194+0000","last_clean":"2023-10-07T09:06:45.872194+0000","last_became_active":"2023-10-07T09:06:45.871925+0000","last_became_peered":"2023-10-07T09:06:45.871925+0000","last_unstale":"2023-10-07T09:06:45.872194+0000","last_undegraded":"2023-10-07T09:06:45.872194+0000","last_fullsized":"2023-10-07T09:06:45.872194+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:23:17.814925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.874433+0000","last_change":"2023-10-07T09:06:44.869212+0000","last_active":"2023-10-07T09:06:44.874433+0000","last_peered":"2023-10-07T09:06:44.874433+0000","last_clean":"2023-10-07T09:06:44.874433+0000","last_became_active":"2023-10-07T09:06:44.868697+0000","last_became_peered":"2023-10-07T09:06:44.868697+0000","last_unstale":"2023-10-07T09:06:44.874433+0000","last_undegraded":"2023-10-07T09:06:44.874433+0000","last_fullsized":"2023-10-07T09:06:44.874433+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.867200+0000","last_change":"2023-10-07T09:06:45.867200+0000","last_active":"2023-10-07T09:06:45.867200+0000","last_peered":"2023-10-07T09:06:45.867200+0000","last_clean":"2023-10-07T09:06:45.867200+0000","last_became_active":"2023-10-07T09:06:45.866845+0000","last_became_peered":"2023-10-07T09:06:45.866845+0000","last_unstale":"2023-10-07T09:06:45.867200+0000","last_undegraded":"2023-10-07T09:06:45.867200+0000","last_fullsized":"2023-10-07T09:06:45.867200+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:52.989184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.869069+0000","last_change":"2023-10-07T09:06:44.872401+0000","last_active":"2023-10-07T09:06:45.869069+0000","last_peered":"2023-10-07T09:06:45.869069+0000","last_clean":"2023-10-07T09:06:45.869069+0000","last_became_active":"2023-10-07T09:06:44.872101+0000","last_became_peered":"2023-10-07T09:06:44.872101+0000","last_unstale":"2023-10-07T09:06:45.869069+0000","last_undegraded":"2023-10-07T09:06:45.869069+0000","last_fullsized":"2023-10-07T09:06:45.869069+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:46.600038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.881036+0000","last_change":"2023-10-07T09:06:45.881036+0000","last_active":"2023-10-07T09:06:45.881036+0000","last_peered":"2023-10-07T09:06:45.881036+0000","last_clean":"2023-10-07T09:06:45.881036+0000","last_became_active":"2023-10-07T09:06:45.880764+0000","last_became_peered":"2023-10-07T09:06:45.880764+0000","last_unstale":"2023-10-07T09:06:45.881036+0000","last_undegraded":"2023-10-07T09:06:45.881036+0000","last_fullsized":"2023-10-07T09:06:45.881036+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:47.229188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.869281+0000","last_change":"2023-10-07T09:06:44.868080+0000","last_active":"2023-10-07T09:06:44.869281+0000","last_peered":"2023-10-07T09:06:44.869281+0000","last_clean":"2023-10-07T09:06:44.869281+0000","last_became_active":"2023-10-07T09:06:44.867797+0000","last_became_peered":"2023-10-07T09:06:44.867797+0000","last_unstale":"2023-10-07T09:06:44.869281+0000","last_undegraded":"2023-10-07T09:06:44.869281+0000","last_fullsized":"2023-10-07T09:06:44.869281+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:52.443940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.876664+0000","last_change":"2023-10-07T09:06:45.876664+0000","last_active":"2023-10-07T09:06:45.876664+0000","last_peered":"2023-10-07T09:06:45.876664+0000","last_clean":"2023-10-07T09:06:45.876664+0000","last_became_active":"2023-10-07T09:06:45.876186+0000","last_became_peered":"2023-10-07T09:06:45.876186+0000","last_unstale":"2023-10-07T09:06:45.876664+0000","last_undegraded":"2023-10-07T09:06:45.876664+0000","last_fullsized":"2023-10-07T09:06:45.876664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:07:02.398407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875484+0000","last_change":"2023-10-07T09:06:44.871739+0000","last_active":"2023-10-07T09:06:44.875484+0000","last_peered":"2023-10-07T09:06:44.875484+0000","last_clean":"2023-10-07T09:06:44.875484+0000","last_became_active":"2023-10-07T09:06:44.871484+0000","last_became_peered":"2023-10-07T09:06:44.871484+0000","last_unstale":"2023-10-07T09:06:44.875484+0000","last_undegraded":"2023-10-07T09:06:44.875484+0000","last_fullsized":"2023-10-07T09:06:44.875484+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:36.060311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873801+0000","last_change":"2023-10-07T09:06:45.873801+0000","last_active":"2023-10-07T09:06:45.873801+0000","last_peered":"2023-10-07T09:06:45.873801+0000","last_clean":"2023-10-07T09:06:45.873801+0000","last_became_active":"2023-10-07T09:06:45.873522+0000","last_became_peered":"2023-10-07T09:06:45.873522+0000","last_unstale":"2023-10-07T09:06:45.873801+0000","last_undegraded":"2023-10-07T09:06:45.873801+0000","last_fullsized":"2023-10-07T09:06:45.873801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:19.127660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877224+0000","last_change":"2023-10-07T09:06:44.869866+0000","last_active":"2023-10-07T09:06:44.877224+0000","last_peered":"2023-10-07T09:06:44.877224+0000","last_clean":"2023-10-07T09:06:44.877224+0000","last_became_active":"2023-10-07T09:06:44.869307+0000","last_became_peered":"2023-10-07T09:06:44.869307+0000","last_unstale":"2023-10-07T09:06:44.877224+0000","last_undegraded":"2023-10-07T09:06:44.877224+0000","last_fullsized":"2023-10-07T09:06:44.877224+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:01.290669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.872992+0000","last_change":"2023-10-07T09:06:45.872992+0000","last_active":"2023-10-07T09:06:45.872992+0000","last_peered":"2023-10-07T09:06:45.872992+0000","last_clean":"2023-10-07T09:06:45.872992+0000","last_became_active":"2023-10-07T09:06:45.872711+0000","last_became_peered":"2023-10-07T09:06:45.872711+0000","last_unstale":"2023-10-07T09:06:45.872992+0000","last_undegraded":"2023-10-07T09:06:45.872992+0000","last_fullsized":"2023-10-07T09:06:45.872992+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:15.697632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.952353+0000","last_change":"2023-10-07T09:06:44.875315+0000","last_active":"2023-10-07T09:06:45.952353+0000","last_peered":"2023-10-07T09:06:45.952353+0000","last_clean":"2023-10-07T09:06:45.952353+0000","last_became_active":"2023-10-07T09:06:44.875005+0000","last_became_peered":"2023-10-07T09:06:44.875005+0000","last_unstale":"2023-10-07T09:06:45.952353+0000","last_undegraded":"2023-10-07T09:06:45.952353+0000","last_fullsized":"2023-10-07T09:06:45.952353+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:31.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.878910+0000","last_change":"2023-10-07T09:06:45.878910+0000","last_active":"2023-10-07T09:06:45.878910+0000","last_peered":"2023-10-07T09:06:45.878910+0000","last_clean":"2023-10-07T09:06:45.878910+0000","last_became_active":"2023-10-07T09:06:45.877955+0000","last_became_peered":"2023-10-07T09:06:45.877955+0000","last_unstale":"2023-10-07T09:06:45.878910+0000","last_undegraded":"2023-10-07T09:06:45.878910+0000","last_fullsized":"2023-10-07T09:06:45.878910+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:06.671287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875890+0000","last_change":"2023-10-07T09:06:44.873929+0000","last_active":"2023-10-07T09:06:44.875890+0000","last_peered":"2023-10-07T09:06:44.875890+0000","last_clean":"2023-10-07T09:06:44.875890+0000","last_became_active":"2023-10-07T09:06:44.873623+0000","last_became_peered":"2023-10-07T09:06:44.873623+0000","last_unstale":"2023-10-07T09:06:44.875890+0000","last_undegraded":"2023-10-07T09:06:44.875890+0000","last_fullsized":"2023-10-07T09:06:44.875890+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:53.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.864582+0000","last_change":"2023-10-07T09:06:45.864582+0000","last_active":"2023-10-07T09:06:45.864582+0000","last_peered":"2023-10-07T09:06:45.864582+0000","last_clean":"2023-10-07T09:06:45.864582+0000","last_became_active":"2023-10-07T09:06:45.864255+0000","last_became_peered":"2023-10-07T09:06:45.864255+0000","last_unstale":"2023-10-07T09:06:45.864582+0000","last_undegraded":"2023-10-07T09:06:45.864582+0000","last_fullsized":"2023-10-07T09:06:45.864582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:03:49.924955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.880907+0000","last_change":"2023-10-07T09:06:44.877107+0000","last_active":"2023-10-07T09:06:44.880907+0000","last_peered":"2023-10-07T09:06:44.880907+0000","last_clean":"2023-10-07T09:06:44.880907+0000","last_became_active":"2023-10-07T09:06:44.876761+0000","last_became_peered":"2023-10-07T09:06:44.876761+0000","last_unstale":"2023-10-07T09:06:44.880907+0000","last_undegraded":"2023-10-07T09:06:44.880907+0000","last_fullsized":"2023-10-07T09:06:44.880907+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:49.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865073+0000","last_change":"2023-10-07T09:06:45.865073+0000","last_active":"2023-10-07T09:06:45.865073+0000","last_peered":"2023-10-07T09:06:45.865073+0000","last_clean":"2023-10-07T09:06:45.865073+0000","last_became_active":"2023-10-07T09:06:45.864520+0000","last_became_peered":"2023-10-07T09:06:45.864520+0000","last_unstale":"2023-10-07T09:06:45.865073+0000","last_undegraded":"2023-10-07T09:06:45.865073+0000","last_fullsized":"2023-10-07T09:06:45.865073+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:31:01.739486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.876925+0000","last_change":"2023-10-07T09:06:44.872289+0000","last_active":"2023-10-07T09:06:44.876925+0000","last_peered":"2023-10-07T09:06:44.876925+0000","last_clean":"2023-10-07T09:06:44.876925+0000","last_became_active":"2023-10-07T09:06:44.871273+0000","last_became_peered":"2023-10-07T09:06:44.871273+0000","last_unstale":"2023-10-07T09:06:44.876925+0000","last_undegraded":"2023-10-07T09:06:44.876925+0000","last_fullsized":"2023-10-07T09:06:44.876925+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:49.962280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.865266+0000","last_change":"2023-10-07T09:06:45.865266+0000","last_active":"2023-10-07T09:06:45.865266+0000","last_peered":"2023-10-07T09:06:45.865266+0000","last_clean":"2023-10-07T09:06:45.865266+0000","last_became_active":"2023-10-07T09:06:45.864986+0000","last_became_peered":"2023-10-07T09:06:45.864986+0000","last_unstale":"2023-10-07T09:06:45.865266+0000","last_undegraded":"2023-10-07T09:06:45.865266+0000","last_fullsized":"2023-10-07T09:06:45.865266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:25.251979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875805+0000","last_change":"2023-10-07T09:06:44.870103+0000","last_active":"2023-10-07T09:06:44.875805+0000","last_peered":"2023-10-07T09:06:44.875805+0000","last_clean":"2023-10-07T09:06:44.875805+0000","last_became_active":"2023-10-07T09:06:44.869720+0000","last_became_peered":"2023-10-07T09:06:44.869720+0000","last_unstale":"2023-10-07T09:06:44.875805+0000","last_undegraded":"2023-10-07T09:06:44.875805+0000","last_fullsized":"2023-10-07T09:06:44.875805+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:15.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.873096+0000","last_change":"2023-10-07T09:06:45.873096+0000","last_active":"2023-10-07T09:06:45.873096+0000","last_peered":"2023-10-07T09:06:45.873096+0000","last_clean":"2023-10-07T09:06:45.873096+0000","last_became_active":"2023-10-07T09:06:45.872811+0000","last_became_peered":"2023-10-07T09:06:45.872811+0000","last_unstale":"2023-10-07T09:06:45.873096+0000","last_undegraded":"2023-10-07T09:06:45.873096+0000","last_fullsized":"2023-10-07T09:06:45.873096+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:21.587581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875746+0000","last_change":"2023-10-07T09:06:44.874551+0000","last_active":"2023-10-07T09:06:44.875746+0000","last_peered":"2023-10-07T09:06:44.875746+0000","last_clean":"2023-10-07T09:06:44.875746+0000","last_became_active":"2023-10-07T09:06:44.874270+0000","last_became_peered":"2023-10-07T09:06:44.874270+0000","last_unstale":"2023-10-07T09:06:44.875746+0000","last_undegraded":"2023-10-07T09:06:44.875746+0000","last_fullsized":"2023-10-07T09:06:44.875746+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:02.899305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.876171+0000","last_change":"2023-10-07T09:06:45.876171+0000","last_active":"2023-10-07T09:06:45.876171+0000","last_peered":"2023-10-07T09:06:45.876171+0000","last_clean":"2023-10-07T09:06:45.876171+0000","last_became_active":"2023-10-07T09:06:45.875881+0000","last_became_peered":"2023-10-07T09:06:45.875881+0000","last_unstale":"2023-10-07T09:06:45.876171+0000","last_undegraded":"2023-10-07T09:06:45.876171+0000","last_fullsized":"2023-10-07T09:06:45.876171+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:33.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875562+0000","last_change":"2023-10-07T09:06:44.874570+0000","last_active":"2023-10-07T09:06:44.875562+0000","last_peered":"2023-10-07T09:06:44.875562+0000","last_clean":"2023-10-07T09:06:44.875562+0000","last_became_active":"2023-10-07T09:06:44.874269+0000","last_became_peered":"2023-10-07T09:06:44.874269+0000","last_unstale":"2023-10-07T09:06:44.875562+0000","last_undegraded":"2023-10-07T09:06:44.875562+0000","last_fullsized":"2023-10-07T09:06:44.875562+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:32.612629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871633+0000","last_change":"2023-10-07T09:06:45.871633+0000","last_active":"2023-10-07T09:06:45.871633+0000","last_peered":"2023-10-07T09:06:45.871633+0000","last_clean":"2023-10-07T09:06:45.871633+0000","last_became_active":"2023-10-07T09:06:45.871373+0000","last_became_peered":"2023-10-07T09:06:45.871373+0000","last_unstale":"2023-10-07T09:06:45.871633+0000","last_undegraded":"2023-10-07T09:06:45.871633+0000","last_fullsized":"2023-10-07T09:06:45.871633+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:23:19.127660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.877686+0000","last_change":"2023-10-07T09:06:44.875021+0000","last_active":"2023-10-07T09:06:44.877686+0000","last_peered":"2023-10-07T09:06:44.877686+0000","last_clean":"2023-10-07T09:06:44.877686+0000","last_became_active":"2023-10-07T09:06:44.874753+0000","last_became_peered":"2023-10-07T09:06:44.874753+0000","last_unstale":"2023-10-07T09:06:44.877686+0000","last_undegraded":"2023-10-07T09:06:44.877686+0000","last_fullsized":"2023-10-07T09:06:44.877686+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:50:29.343067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.870880+0000","last_change":"2023-10-07T09:06:45.870880+0000","last_active":"2023-10-07T09:06:45.870880+0000","last_peered":"2023-10-07T09:06:45.870880+0000","last_clean":"2023-10-07T09:06:45.870880+0000","last_became_active":"2023-10-07T09:06:45.870558+0000","last_became_peered":"2023-10-07T09:06:45.870558+0000","last_unstale":"2023-10-07T09:06:45.870880+0000","last_undegraded":"2023-10-07T09:06:45.870880+0000","last_fullsized":"2023-10-07T09:06:45.870880+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:32.130871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875192+0000","last_change":"2023-10-07T09:06:44.870885+0000","last_active":"2023-10-07T09:06:44.875192+0000","last_peered":"2023-10-07T09:06:44.875192+0000","last_clean":"2023-10-07T09:06:44.875192+0000","last_became_active":"2023-10-07T09:06:44.870601+0000","last_became_peered":"2023-10-07T09:06:44.870601+0000","last_unstale":"2023-10-07T09:06:44.875192+0000","last_undegraded":"2023-10-07T09:06:44.875192+0000","last_fullsized":"2023-10-07T09:06:44.875192+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:59.320596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.879401+0000","last_change":"2023-10-07T09:06:45.879401+0000","last_active":"2023-10-07T09:06:45.879401+0000","last_peered":"2023-10-07T09:06:45.879401+0000","last_clean":"2023-10-07T09:06:45.879401+0000","last_became_active":"2023-10-07T09:06:45.878958+0000","last_became_peered":"2023-10-07T09:06:45.878958+0000","last_unstale":"2023-10-07T09:06:45.879401+0000","last_undegraded":"2023-10-07T09:06:45.879401+0000","last_fullsized":"2023-10-07T09:06:45.879401+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:40.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.879362+0000","last_change":"2023-10-07T09:06:44.874868+0000","last_active":"2023-10-07T09:06:44.879362+0000","last_peered":"2023-10-07T09:06:44.879362+0000","last_clean":"2023-10-07T09:06:44.879362+0000","last_became_active":"2023-10-07T09:06:44.874446+0000","last_became_peered":"2023-10-07T09:06:44.874446+0000","last_unstale":"2023-10-07T09:06:44.879362+0000","last_undegraded":"2023-10-07T09:06:44.879362+0000","last_fullsized":"2023-10-07T09:06:44.879362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:29.245218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.879419+0000","last_change":"2023-10-07T09:06:45.879419+0000","last_active":"2023-10-07T09:06:45.879419+0000","last_peered":"2023-10-07T09:06:45.879419+0000","last_clean":"2023-10-07T09:06:45.879419+0000","last_became_active":"2023-10-07T09:06:45.876090+0000","last_became_peered":"2023-10-07T09:06:45.876090+0000","last_unstale":"2023-10-07T09:06:45.879419+0000","last_undegraded":"2023-10-07T09:06:45.879419+0000","last_fullsized":"2023-10-07T09:06:45.879419+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:11.839160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.875855+0000","last_change":"2023-10-07T09:06:44.870027+0000","last_active":"2023-10-07T09:06:44.875855+0000","last_peered":"2023-10-07T09:06:44.875855+0000","last_clean":"2023-10-07T09:06:44.875855+0000","last_became_active":"2023-10-07T09:06:44.869740+0000","last_became_peered":"2023-10-07T09:06:44.869740+0000","last_unstale":"2023-10-07T09:06:44.875855+0000","last_undegraded":"2023-10-07T09:06:44.875855+0000","last_fullsized":"2023-10-07T09:06:44.875855+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:47.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.871312+0000","last_change":"2023-10-07T09:06:45.871312+0000","last_active":"2023-10-07T09:06:45.871312+0000","last_peered":"2023-10-07T09:06:45.871312+0000","last_clean":"2023-10-07T09:06:45.871312+0000","last_became_active":"2023-10-07T09:06:45.871020+0000","last_became_peered":"2023-10-07T09:06:45.871020+0000","last_unstale":"2023-10-07T09:06:45.871312+0000","last_undegraded":"2023-10-07T09:06:45.871312+0000","last_fullsized":"2023-10-07T09:06:45.871312+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:00:24.345429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.876947+0000","last_change":"2023-10-07T09:06:44.872341+0000","last_active":"2023-10-07T09:06:44.876947+0000","last_peered":"2023-10-07T09:06:44.876947+0000","last_clean":"2023-10-07T09:06:44.876947+0000","last_became_active":"2023-10-07T09:06:44.871093+0000","last_became_peered":"2023-10-07T09:06:44.871093+0000","last_unstale":"2023-10-07T09:06:44.876947+0000","last_undegraded":"2023-10-07T09:06:44.876947+0000","last_fullsized":"2023-10-07T09:06:44.876947+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:18.054109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-07T09:06:45.866708+0000","last_change":"2023-10-07T09:06:45.866708+0000","last_active":"2023-10-07T09:06:45.866708+0000","last_peered":"2023-10-07T09:06:45.866708+0000","last_clean":"2023-10-07T09:06:45.866708+0000","last_became_active":"2023-10-07T09:06:45.866450+0000","last_became_peered":"2023-10-07T09:06:45.866450+0000","last_unstale":"2023-10-07T09:06:45.866708+0000","last_undegraded":"2023-10-07T09:06:45.866708+0000","last_fullsized":"2023-10-07T09:06:45.866708+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:44.847846+0000","last_clean_scrub_stamp":"2023-10-07T09:06:44.847846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:35:38.040401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.880872+0000","last_change":"2023-10-07T09:06:44.877044+0000","last_active":"2023-10-07T09:06:44.880872+0000","last_peered":"2023-10-07T09:06:44.880872+0000","last_clean":"2023-10-07T09:06:44.880872+0000","last_became_active":"2023-10-07T09:06:44.876727+0000","last_became_peered":"2023-10-07T09:06:44.876727+0000","last_unstale":"2023-10-07T09:06:44.880872+0000","last_undegraded":"2023-10-07T09:06:44.880872+0000","last_fullsized":"2023-10-07T09:06:44.880872+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:06:43.837941+0000","last_clean_scrub_stamp":"2023-10-07T09:06:43.837941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:35.908012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":291,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-07T09:06:44.858289+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:06:44.858289+0000","last_peered":"2023-10-07T09:06:44.858289+0000","last_clean":"2023-10-07T09:06:44.858289+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:06:44.858289+0000","last_undegraded":"2023-10-07T09:06:44.858289+0000","last_fullsized":"2023-10-07T09:06:44.858289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067856,"statfs":{"total":96636764160,"available":96325484544,"internally_reserved":0,"allocated":2662400,"data_stored":1509390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.85799999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.442}]},{"osd":1,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.505},"min":{"1min":0.40200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.50900000000000001},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.53800000000000003},"min":{"1min":0.33300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.76000000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":925785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70699999999999996,"5min":0.748,"15min":0.81399999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73999999999999999,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.439,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63800000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51500000000000001,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":1.29},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55500000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":4.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.499,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54200000000000004,"15min":0.58299999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.62},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35599999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.438},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33700000000000002},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.40500000000000003},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.376,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.75},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.379,"15min":0.77200000000000002},"min":{"1min":0.309,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":11.880000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.315}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.66600000000000004,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.376},"max":{"1min":7.6509999999999998,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.60299999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64700000000000002,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.80900000000000005},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.498}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59799999999999998,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067856,"statfs":{"total":96636764160,"available":96325484544,"internally_reserved":0,"allocated":2662400,"data_stored":1509390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.21299999999999999},"max":{"1min":0.44,"5min":0.501,"15min":0.54500000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.34899999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.218,"15min":0.191},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.374,"15min":0.38700000000000001},"min":{"1min":0.29699999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":0.53400000000000003,"15min":0.625},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.22},"max":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.34699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.63500000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.95399999999999996},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86399999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":1.006},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80800000000000005,"5min":0.879,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.55800000000000005},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":10.214},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.218,"15min":0.214},"max":{"1min":0.5,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.22,"15min":0.22},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.755},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.61899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48699999999999999,"5min":0.66100000000000003,"15min":10.144},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.66900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54700000000000004,"5min":0.68700000000000006,"15min":10.071},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41499999999999998,"15min":0.68600000000000005},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.54000000000000004,"5min":0.70399999999999996,"15min":10.183},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.0620000000000001},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.87,"15min":1.0880000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":4.391,"15min":4.391},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.41999999999999998},"min":{"1min":0.23000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":5.5709999999999997},"last":0.253},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.71199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.71199999999999997,"15min":12.038},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.21299999999999999},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":2.3450000000000002},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":2.3380000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.58099999999999996},"min":{"1min":0.28100000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":6.1230000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.46200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":1.2330000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.89000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":2.081},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.438},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.65300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.85099999999999998,"15min":2.1960000000000002},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.94299999999999995},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":12.007},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.71099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.69599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.96199999999999997},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":11.973000000000001},"last":0.42999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.495,"15min":0.78000000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.83399999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.311},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.86499999999999999},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.378}]},{"osd":2,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.83599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":10.01},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":5.569},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.83699999999999997},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.93500000000000005,"15min":10.131},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.51300000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.435},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54500000000000004,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303404,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068436,"statfs":{"total":96636764160,"available":96326078464,"internally_reserved":0,"allocated":2068480,"data_stored":919022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.78800000000000003,"5min":1.127,"15min":1.127},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74099999999999999,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.373}]},{"osd":3,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.871,"5min":1.478,"15min":1.478},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:06:50.441 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:06:50.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:06:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.600+0000 7f6a1a443700 1 Processor -- start 2023-10-07T09:06:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.600+0000 7f6a1a443700 1 -- start start 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a1a443700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a1a443700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a141414c0 0x7f6a140cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a1a443700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1415b790 con 0x7f6a14158d40 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a1a443700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1415ba70 con 0x7f6a141414c0 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a1a443700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1415bd50 con 0x7f6a1406bcd0 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:50562/0 (socket says 172.21.15.46:50562) 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 -- 172.21.15.46:0/3147793968 learned_addr learned my addr 172.21.15.46:0/3147793968 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a189e0700 1 --2- 172.21.15.46:0/3147793968 >> v2:172.21.15.133:3300/0 conn(0x7f6a141414c0 0x7f6a140cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 -- 172.21.15.46:0/3147793968 >> v2:172.21.15.133:3300/0 conn(0x7f6a141414c0 msgr2=0x7f6a140cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 --2- 172.21.15.46:0/3147793968 >> v2:172.21.15.133:3300/0 conn(0x7f6a141414c0 0x7f6a140cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 -- 172.21.15.46:0/3147793968 >> v1:172.21.15.133:6789/0 conn(0x7f6a14158d40 legacy=0x7f6a14140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a13fff700 1 -- 172.21.15.46:0/3147793968 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1415c030 con 0x7f6a1406bcd0 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.601+0000 7f6a12ffd700 1 -- 172.21.15.46:0/3147793968 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002735422 0 0) 0x7f6a1415b790 con 0x7f6a14158d40 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a13fff700 1 --2- 172.21.15.46:0/3147793968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3067ad448ba2d840 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a12ffd700 1 -- 172.21.15.46:0/3147793968 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04009ea0 con 0x7f6a1406bcd0 2023-10-07T09:06:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a12ffd700 1 -- 172.21.15.46:0/3147793968 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400b860 con 0x7f6a1406bcd0 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a12ffd700 1 -- 172.21.15.46:0/3147793968 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400bc00 con 0x7f6a1406bcd0 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 -- 172.21.15.46:0/3147793968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 msgr2=0x7f6a140c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 --2- 172.21.15.46:0/3147793968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04009250 comp rx=0 tx=0).stop 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 -- 172.21.15.46:0/3147793968 shutdown_connections 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 --2- 172.21.15.46:0/3147793968 >> v2:172.21.15.133:3300/0 conn(0x7f6a141414c0 0x7f6a140cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 --2- 172.21.15.46:0/3147793968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a140c9230 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 -- 172.21.15.46:0/3147793968 >> 172.21.15.46:0/3147793968 conn(0x7f6a140ce5c0 msgr2=0x7f6a140ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 -- 172.21.15.46:0/3147793968 shutdown_connections 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.602+0000 7f6a1a443700 1 -- 172.21.15.46:0/3147793968 wait complete. 2023-10-07T09:06:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 Processor -- start 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 -- start start 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a14140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 0x7f6a14158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141407a0 con 0x7f6a141414c0 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1416bc60 con 0x7f6a14158d40 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.604+0000 7f6a1a443700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14156710 con 0x7f6a1406bcd0 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59842/0 (socket says 172.21.15.46:59842) 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 -- 172.21.15.46:0/702137501 learned_addr learned my addr 172.21.15.46:0/702137501 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a13fff700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a14140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a189e0700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 0x7f6a14158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 -- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 msgr2=0x7f6a14140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a14140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 -- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 msgr2=0x7f6a14158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 0x7f6a14158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 -- 172.21.15.46:0/702137501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040094f0 con 0x7f6a141414c0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a189e0700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 0x7f6a14158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a137fe700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c560 tx=0x7f6a08007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08011590 con 0x7f6a141414c0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08011710 con 0x7f6a141414c0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1416b330 con 0x7f6a141414c0 2023-10-07T09:06:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08011ad0 con 0x7f6a141414c0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.605+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1416b8f0 con 0x7f6a141414c0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.606+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a140c8d30 con 0x7f6a141414c0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.607+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a0801b3b0 con 0x7f6a141414c0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.607+0000 7f69fbfff700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 0x7f6a000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.607+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a08084160 con 0x7f6a141414c0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.607+0000 7f6a13fff700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 0x7f6a000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.608+0000 7f6a13fff700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 0x7f6a000697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:50.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.611+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a08050df0 con 0x7f6a141414c0 2023-10-07T09:06:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.883+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6a140718b0 con 0x7f6a141414c0 2023-10-07T09:06:50.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.886+0000 7f69fbfff700 1 -- 172.21.15.46:0/702137501 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6a080170e0 con 0x7f6a141414c0 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 msgr2=0x7f6a000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 0x7f6a000697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04017000 comp rx=0 tx=0).stop 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 msgr2=0x7f6a141561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c560 tx=0x7f6a08007f50 comp rx=0 tx=0).stop 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 shutdown_connections 2023-10-07T09:06:50.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6a00067320 0x7f6a000697d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a14158d40 0x7f6a14158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a1406bcd0 0x7f6a14140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 --2- 172.21.15.46:0/702137501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a141414c0 0x7f6a141561d0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 >> 172.21.15.46:0/702137501 conn(0x7f6a140ce5c0 msgr2=0x7f6a140c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 shutdown_connections 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:50.888+0000 7f6a1a443700 1 -- 172.21.15.46:0/702137501 wait complete. 2023-10-07T09:06:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:06:50.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:51.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.020+0000 7fcaf0889700 1 Processor -- start 2023-10-07T09:06:51.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.020+0000 7fcaf0889700 1 -- start start 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 0x7fcaec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcaec1597f0 0x7fcaec0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec15d230 0x7fcaec15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec15dbb0 con 0x7fcaec1597f0 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0b11d0 con 0x7fcaec159420 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaf0889700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0b14b0 con 0x7fcaec15d230 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcaec1597f0 0x7fcaec0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcaec1597f0 0x7fcaec0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59850/0 (socket says 172.21.15.46:59850) 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 -- 172.21.15.46:0/2398491198 learned_addr learned my addr 172.21.15.46:0/2398491198 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeb7fe700 1 --2- 172.21.15.46:0/2398491198 >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 0x7fcaec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaebfff700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec15d230 0x7fcaec15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 -- 172.21.15.46:0/2398491198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec15d230 msgr2=0x7fcaec15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec15d230 0x7fcaec15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 -- 172.21.15.46:0/2398491198 >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 msgr2=0x7fcaec0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/2398491198 >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 0x7fcaec0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeaffd700 1 -- 172.21.15.46:0/2398491198 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0b1790 con 0x7fcaec1597f0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.021+0000 7fcaeb7fe700 1 --2- 172.21.15.46:0/2398491198 >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 0x7fcaec0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2270 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b2f20 tx=0x7fcae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549c41b2eacaf421 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaea7fc700 1 -- 172.21.15.46:0/2398491198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000b860 con 0x7fcaec1597f0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaea7fc700 1 -- 172.21.15.46:0/2398491198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000b9c0 con 0x7fcaec1597f0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaea7fc700 1 -- 172.21.15.46:0/2398491198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000bd60 con 0x7fcaec1597f0 2023-10-07T09:06:51.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 -- 172.21.15.46:0/2398491198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 msgr2=0x7fcaec0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2270 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b2f20 tx=0x7fcae0009250 comp rx=0 tx=0).stop 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 -- 172.21.15.46:0/2398491198 shutdown_connections 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec15d230 0x7fcaec15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 --2- 172.21.15.46:0/2398491198 >> v2:172.21.15.133:3300/0 conn(0x7fcaec159420 0x7fcaec0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 --2- 172.21.15.46:0/2398491198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2270 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 -- 172.21.15.46:0/2398491198 >> 172.21.15.46:0/2398491198 conn(0x7fcaec0d0660 msgr2=0x7fcaec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 -- 172.21.15.46:0/2398491198 shutdown_connections 2023-10-07T09:06:51.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.022+0000 7fcaf0889700 1 -- 172.21.15.46:0/2398491198 wait complete. 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 Processor -- start 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 -- start start 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec159420 0x7fcaec155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcaec15d230 0x7fcaec0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c8750 con 0x7fcaec1597f0 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c6bb0 con 0x7fcaec15d230 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaf0889700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c6e90 con 0x7fcaec159420 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaeaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaeaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59866/0 (socket says 172.21.15.46:59866) 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.024+0000 7fcaeaffd700 1 -- 172.21.15.46:0/4108370951 learned_addr learned my addr 172.21.15.46:0/4108370951 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaebfff700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcaec15d230 0x7fcaec0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeb7fe700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec159420 0x7fcaec155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 -- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec159420 msgr2=0x7fcaec155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec159420 0x7fcaec155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 -- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcaec15d230 msgr2=0x7fcaec0b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcaec15d230 0x7fcaec0b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 -- 172.21.15.46:0/4108370951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00094f0 con 0x7fcaec1597f0 2023-10-07T09:06:51.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaeaffd700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fcaec089340 tx=0x7fcae0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0024440 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00245a0 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec0c7170 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0024960 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.025+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec155660 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.026+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec04c3c0 con 0x7fcaec1597f0 2023-10-07T09:06:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.026+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcae001a420 con 0x7fcaec1597f0 2023-10-07T09:06:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.027+0000 7fcad37fe700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 0x7fcad80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.027+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcae0086a90 con 0x7fcaec1597f0 2023-10-07T09:06:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.027+0000 7fcaeb7fe700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 0x7fcad80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.027+0000 7fcaeb7fe700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 0x7fcad80697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00ac00 tx=0x7fcadc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.031+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcae0053720 con 0x7fcaec1597f0 2023-10-07T09:06:51.175 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-10-07T09:06:51.173+0000 7f25ef245700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:06:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.270+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaec0b1a70 con 0x7fcaec1597f0 2023-10-07T09:06:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.270+0000 7fcad37fe700 1 -- 172.21.15.46:0/4108370951 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4613 (secure 0 0 0) 0x7fcae0056d40 con 0x7fcaec1597f0 2023-10-07T09:06:51.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:51.272 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:06:48.950710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:06:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 msgr2=0x7fcad80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 0x7fcad80697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00ac00 tx=0x7fcadc006f90 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 msgr2=0x7fcaec0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fcaec089340 tx=0x7fcae0017000 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 shutdown_connections 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcad8067320 0x7fcad80697d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcaec15d230 0x7fcaec0b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcaec159420 0x7fcaec155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 --2- 172.21.15.46:0/4108370951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcaec1597f0 0x7fcaec0b2170 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 >> 172.21.15.46:0/4108370951 conn(0x7fcaec0d0660 msgr2=0x7fcaec156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.272+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 shutdown_connections 2023-10-07T09:06:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.273+0000 7fcaf0889700 1 -- 172.21.15.46:0/4108370951 wait complete. 2023-10-07T09:06:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 111 2023-10-07T09:06:51.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:06:45.262830+0000', 'modified': '2023-10-07T09:06:48.950710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8244': {'gid': 8244, 'name': 'a', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/1247947515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6833', 'nonce': 1247947515}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1247947515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:06:51.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:06:51.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T09:06:51.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 Processor -- start 2023-10-07T09:06:51.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 -- start start 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159890 0x7f48ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48ac159c60 0x7f48ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48ac15db10 0x7f48ac069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac15a160 con 0x7f48ac15db10 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac0d13a0 con 0x7f48ac159c60 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.811+0000 7f48b1443700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac15e140 con 0x7f48ac159890 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48ac15db10 0x7f48ac069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48ac15db10 0x7f48ac069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59868/0 (socket says 172.21.15.46:59868) 2023-10-07T09:06:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2504751854 learned_addr learned my addr 172.21.15.46:0/2504751854 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48aaffd700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159890 0x7f48ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/2504751854 >> v2:172.21.15.133:3300/0 conn(0x7f48ac159c60 0x7f48ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2504751854 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159890 msgr2=0x7f48ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159890 0x7f48ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2504751854 >> v2:172.21.15.133:3300/0 conn(0x7f48ac159c60 msgr2=0x7f48ac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2504751854 >> v2:172.21.15.133:3300/0 conn(0x7f48ac159c60 0x7f48ac15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2504751854 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac15a3d0 con 0x7f48ac15db10 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac15db10 0x7f48ac069560 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0650f0 tx=0x7f489c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09e2ededfb9205a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48a9ffb700 1 -- 172.21.15.46:0/2504751854 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00e070 con 0x7f48ac15db10 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48a9ffb700 1 -- 172.21.15.46:0/2504751854 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00b970 con 0x7f48ac15db10 2023-10-07T09:06:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.812+0000 7f48a9ffb700 1 -- 172.21.15.46:0/2504751854 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0092e0 con 0x7f48ac15db10 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 -- 172.21.15.46:0/2504751854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac15db10 msgr2=0x7f48ac069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac15db10 0x7f48ac069560 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0650f0 tx=0x7f489c009840 comp rx=0 tx=0).stop 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 -- 172.21.15.46:0/2504751854 shutdown_connections 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac15db10 0x7f48ac069560 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 --2- 172.21.15.46:0/2504751854 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159890 0x7f48ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 --2- 172.21.15.46:0/2504751854 >> v2:172.21.15.133:3300/0 conn(0x7f48ac159c60 0x7f48ac15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 -- 172.21.15.46:0/2504751854 >> 172.21.15.46:0/2504751854 conn(0x7f48ac068e20 msgr2=0x7f48ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 -- 172.21.15.46:0/2504751854 shutdown_connections 2023-10-07T09:06:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.813+0000 7f48b1443700 1 -- 172.21.15.46:0/2504751854 wait complete. 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.814+0000 7f48b1443700 1 Processor -- start 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.814+0000 7f48b1443700 1 -- start start 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159c60 0x7f48ac0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48ac15db10 0x7f48ac0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b2d80 con 0x7f48ac159890 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b28f0 con 0x7f48ac15db10 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48b1443700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b1fc0 con 0x7f48ac159c60 2023-10-07T09:06:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59884/0 (socket says 172.21.15.46:59884) 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 -- 172.21.15.46:0/3861496460 learned_addr learned my addr 172.21.15.46:0/3861496460 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48ac15db10 0x7f48ac0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159c60 0x7f48ac0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 -- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159c60 msgr2=0x7f48ac0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159c60 0x7f48ac0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 -- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48ac15db10 msgr2=0x7f48ac0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48ac15db10 0x7f48ac0b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.815+0000 7f48aaffd700 1 -- 172.21.15.46:0/3861496460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c009ae0 con 0x7f48ac159890 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48aaffd700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f48a400ec80 tx=0x7f48a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48a2ffd700 1 -- 172.21.15.46:0/3861496460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400c850 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48a2ffd700 1 -- 172.21.15.46:0/3861496460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400c9b0 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48a2ffd700 1 -- 172.21.15.46:0/3861496460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400cd50 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac0b22a0 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.816+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac0b1cb0 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.817+0000 7f48a2ffd700 1 -- 172.21.15.46:0/3861496460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f48a4013680 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.818+0000 7f48a2ffd700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 0x7f488c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.818+0000 7f48a2ffd700 1 -- 172.21.15.46:0/3861496460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48a4084ed0 con 0x7f48ac159890 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.818+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 0x7f488c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.818+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 0x7f488c0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f48ac16ceb0 tx=0x7f48940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.819+0000 7f48ba73bb80 1 Processor -- start 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 -- start start 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 0x55a3d0e72e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e9ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0dc9a70 con 0x55a3d0e9bf60 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0dc7270 con 0x55a3d0e72a50 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0dc3060 con 0x55a3d0ebcd00 2023-10-07T09:06:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59886/0 (socket says 172.21.15.46:59886) 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.820+0000 7f48ab7fe700 1 -- 172.21.15.46:0/4202325334 learned_addr learned my addr 172.21.15.46:0/4202325334 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e9ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48aaffd700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 0x55a3d0e72e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 -- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 msgr2=0x55a3d0e9ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e9ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 -- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 msgr2=0x55a3d0e72e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 0x55a3d0e72e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 -- 172.21.15.46:0/4202325334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3d0c5d270 con 0x55a3d0e9bf60 2023-10-07T09:06:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48aaffd700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 0x55a3d0e72e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f489c00bfc0 tx=0x7f489c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47032868a4987725 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f488bfff700 1 -- 172.21.15.46:0/4202325334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00bae0 con 0x55a3d0e9bf60 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f488bfff700 1 -- 172.21.15.46:0/4202325334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c01c410 con 0x55a3d0e9bf60 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.821+0000 7f488bfff700 1 -- 172.21.15.46:0/4202325334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c01c7d0 con 0x55a3d0e9bf60 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4202325334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 msgr2=0x55a3d0e6ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f489c00bfc0 tx=0x7f489c018000 comp rx=0 tx=0).stop 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4202325334 shutdown_connections 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e9bf60 0x55a3d0e6ecf0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e72a50 0x55a3d0e72e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4202325334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e9ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4202325334 >> 172.21.15.46:0/4202325334 conn(0x55a3d0e74370 msgr2=0x55a3d0e74740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4202325334 shutdown_connections 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4202325334 wait complete. 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.822+0000 7f48ba73bb80 1 -- start start 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 Processor -- start 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0ec9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0d6e890 con 0x55a3d0e72a50 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0d89ea0 con 0x55a3d0e9bf60 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.823+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0c45e30 con 0x55a3d0ebcd00 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 10 client.0 _ll_register_callbacks cb 0x55a3d0e36110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:06:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59896/0 (socket says 172.21.15.46:59896) 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 -- 172.21.15.46:0/4076260598 learned_addr learned my addr 172.21.15.46:0/4076260598 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 -- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 msgr2=0x55a3d0e6dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 -- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 msgr2=0x55a3d0ec9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0ec9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 -- 172.21.15.46:0/4076260598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac15a3d0 con 0x55a3d0e72a50 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48aaffd700 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f48a4051d20 tx=0x7f48a40097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0076e404f93f3f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4058a70 con 0x55a3d0e72a50 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48a406be40 con 0x55a3d0e72a50 2023-10-07T09:06:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3d0e67b70 con 0x55a3d0e72a50 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48a405c7c0 con 0x55a3d0e72a50 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 10 client.8382 fetch_fsmap learned FSMap version 111 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55a3d0bfffe0 con 0x55a3d0e72a50 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3d0e67b70 con 0x55a3d0e72a50 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 111) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f48a4071260 con 0x55a3d0e72a50 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 10 client.8382 fetch_fsmap finished waiting for FSMap version 111 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.824+0000 7f48ba73bb80 10 client.8382 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48ba73bb80 20 client.8382 populate_metadata read hostname 'smithi046' 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0eb2c30 0x55a3d0eb3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48ba73bb80 4 client.8382 mds_command: new command op to 8244 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 --> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3d0e44aa0 con 0x55a3d0eb2c30 2023-10-07T09:06:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0eb2c30 0x55a3d0eb3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0eb2c30 0x55a3d0eb3000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5955e3edc6780f08 server_cookie=86a6cc3dc6bcd7f0 in_seq=0 out_seq=0 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48897fa700 10 client.8382 ms_handle_connect on v2:172.21.15.46:6833/1247947515 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.825+0000 7f48897fa700 1 -- 172.21.15.46:0/4076260598 <== mds.0 v2:172.21.15.46:6833/1247947515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a3d0e44aa0 con 0x55a3d0eb2c30 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48897fa700 10 client.8382 handle_command_reply: tid=0 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 client.8382 shutdown 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 msgr2=0x55a3d0ebc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f48a4051d20 tx=0x7f48a40097d0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 shutdown_connections 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0eb2c30 0x55a3d0eb3000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0ebcd00 0x55a3d0e6dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0e72a50 0x55a3d0ebc7b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/4076260598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0ec9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48897fa700 0 client.8382 ms_handle_reset on v2:172.21.15.46:6833/1247947515 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 >> 172.21.15.46:0/4076260598 conn(0x55a3d0e74370 msgr2=0x55a3d0eb8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 shutdown_connections 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 1 -- 172.21.15.46:0/4076260598 wait complete. 2023-10-07T09:06:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.826+0000 7f48ba73bb80 20 client.8382 trim_cache size 0 max 16384 2023-10-07T09:06:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 Processor -- start 2023-10-07T09:06:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 -- start start 2023-10-07T09:06:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0eb7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0eb80a0 con 0x55a3d0ebcd00 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0e73d00 con 0x55a3d0e9bf60 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.843+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0e6f390 con 0x55a3d0e72a50 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59902/0 (socket says 172.21.15.46:59902) 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 -- 172.21.15.46:0/410277342 learned_addr learned my addr 172.21.15.46:0/410277342 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 -- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 msgr2=0x55a3d0eb7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0eb7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 -- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 msgr2=0x55a3d0eb1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 -- 172.21.15.46:0/410277342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3d0d91780 con 0x55a3d0ebcd00 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f489c00a000 tx=0x7f489c01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efdeeb9a690f3ae server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48a0ff9700 1 -- 172.21.15.46:0/410277342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00bb60 con 0x55a3d0ebcd00 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48a0ff9700 1 -- 172.21.15.46:0/410277342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c0090d0 con 0x55a3d0ebcd00 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.844+0000 7f48a0ff9700 1 -- 172.21.15.46:0/410277342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c01c580 con 0x55a3d0ebcd00 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- 172.21.15.46:0/410277342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 msgr2=0x55a3d0ea1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f489c00a000 tx=0x7f489c01f040 comp rx=0 tx=0).stop 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- 172.21.15.46:0/410277342 shutdown_connections 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0ea1830 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0eb7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/410277342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- 172.21.15.46:0/410277342 >> 172.21.15.46:0/410277342 conn(0x55a3d0e74370 msgr2=0x55a3d0eb5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- 172.21.15.46:0/410277342 shutdown_connections 2023-10-07T09:06:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- 172.21.15.46:0/410277342 wait complete. 2023-10-07T09:06:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 -- start start 2023-10-07T09:06:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.845+0000 7f48ba73bb80 1 Processor -- start 2023-10-07T09:06:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0f07cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0f08210 con 0x55a3d0ebcd00 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0ec6460 con 0x55a3d0e9bf60 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3d0ebbc30 con 0x55a3d0e72a50 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ba73bb80 10 client.0 _ll_register_callbacks cb 0x55a3d0e36110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59908/0 (socket says 172.21.15.46:59908) 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2986685779 learned_addr learned my addr 172.21.15.46:0/2986685779 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48aa7fc700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.846+0000 7f48aaffd700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0f07cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 msgr2=0x55a3d0f07cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0f07cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 msgr2=0x55a3d0eb3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 -- 172.21.15.46:0/2986685779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3d0c5d270 con 0x55a3d0ebcd00 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ab7fe700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x55a3d0eb1260 tx=0x7f489c029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaabe2672ae6d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c001080 con 0x55a3d0ebcd00 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f489c03ab00 con 0x55a3d0ebcd00 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f489c01c410 con 0x55a3d0ebcd00 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f489c030480 con 0x55a3d0ebcd00 2023-10-07T09:06:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 10 client.8388 fetch_fsmap learned FSMap version 111 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55a3d0d78470 con 0x55a3d0ebcd00 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c01c410 con 0x55a3d0ebcd00 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 111) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f489c00b050 con 0x55a3d0ebcd00 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 10 client.8388 fetch_fsmap finished waiting for FSMap version 111 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 10 client.8388 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 20 client.8388 populate_metadata read hostname 'smithi046' 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0ea1910 0x55a3d0ec55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 4 client.8388 mds_command: new command op to 8244 tid=0[{"prefix": "status"}] 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.847+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 --> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a3d0d65e00 con 0x55a3d0ea1910 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48aaffd700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0ea1910 0x55a3d0ec55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48897fa700 10 client.8388 ms_handle_connect on v2:172.21.15.46:6833/1247947515 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48aaffd700 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0ea1910 0x55a3d0ec55b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e55ed0925226bd9d server_cookie=fcd4208f21fead75 in_seq=0 out_seq=0 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48897fa700 1 -- 172.21.15.46:0/2986685779 <== mds.0 v2:172.21.15.46:6833/1247947515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a3d0d65e00 con 0x55a3d0ea1910 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48897fa700 10 client.8388 handle_command_reply: tid=0 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 client.8388 shutdown 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 msgr2=0x55a3d0eb3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x55a3d0eb1260 tx=0x7f489c029040 comp rx=0 tx=0).stop 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 shutdown_connections 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a3d0ebcd00 0x55a3d0eb3540 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.46:6833/1247947515,v1:172.21.15.46:6835/1247947515] conn(0x55a3d0ea1910 0x55a3d0ec55b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55a3d0e72a50 0x55a3d0f07cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48897fa700 0 client.8388 ms_handle_reset on v2:172.21.15.46:6833/1247947515 2023-10-07T09:06:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 --2- 172.21.15.46:0/2986685779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a3d0e9bf60 0x55a3d0eb3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 >> 172.21.15.46:0/2986685779 conn(0x55a3d0e74370 msgr2=0x55a3d0e6f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 shutdown_connections 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 1 -- 172.21.15.46:0/2986685779 wait complete. 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.848+0000 7f48ba73bb80 20 client.8388 trim_cache size 0 max 16384 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 8244, 2023-10-07T09:06:51.858 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9073422920000001, 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 111, 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 165, 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 165, 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 11.07365074 2023-10-07T09:06:51.859 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 msgr2=0x7f488c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 0x7f488c0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f48ac16ceb0 tx=0x7f48940091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 msgr2=0x7f48ac158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f48a400ec80 tx=0x7f48a40091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 shutdown_connections 2023-10-07T09:06:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f488c067320 0x7f488c0697d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48ac15db10 0x7f48ac0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48ac159890 0x7f48ac158900 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 --2- 172.21.15.46:0/3861496460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48ac159c60 0x7f48ac0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 >> 172.21.15.46:0/3861496460 conn(0x7f48ac068e20 msgr2=0x7f48ac15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 shutdown_connections 2023-10-07T09:06:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.849+0000 7f48b1443700 1 -- 172.21.15.46:0/3861496460 wait complete. 2023-10-07T09:06:51.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:06:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.981+0000 7fc6f7f42700 1 Processor -- start 2023-10-07T09:06:51.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.981+0000 7fc6f7f42700 1 -- start start 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 0x7fc6f015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f0159c60 0x7fc6f015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6f015db10 0x7fc6f0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f015a160 con 0x7fc6f015db10 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00d13a0 con 0x7fc6f0159890 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f7f42700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f015e140 con 0x7fc6f0159c60 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6f015db10 0x7fc6f0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6f015db10 0x7fc6f0069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59924/0 (socket says 172.21.15.46:59924) 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 -- 172.21.15.46:0/867216654 learned_addr learned my addr 172.21.15.46:0/867216654 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f5cde700 1 --2- 172.21.15.46:0/867216654 >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 0x7fc6f015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f54dd700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f0159c60 0x7fc6f015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 -- 172.21.15.46:0/867216654 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f0159c60 msgr2=0x7fc6f015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f0159c60 0x7fc6f015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 -- 172.21.15.46:0/867216654 >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 msgr2=0x7fc6f015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 --2- 172.21.15.46:0/867216654 >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 0x7fc6f015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 -- 172.21.15.46:0/867216654 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f015a3d0 con 0x7fc6f015db10 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f5cde700 1 --2- 172.21.15.46:0/867216654 >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 0x7fc6f015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f64df700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f015db10 0x7fc6f0069560 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00d1090 tx=0x7fc6e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbd55af1194a6e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.982+0000 7fc6f4cdc700 1 -- 172.21.15.46:0/867216654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800e070 con 0x7fc6f015db10 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f4cdc700 1 -- 172.21.15.46:0/867216654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800ba50 con 0x7fc6f015db10 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f4cdc700 1 -- 172.21.15.46:0/867216654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80092e0 con 0x7fc6f015db10 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 -- 172.21.15.46:0/867216654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f015db10 msgr2=0x7fc6f0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f015db10 0x7fc6f0069560 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00d1090 tx=0x7fc6e8009840 comp rx=0 tx=0).stop 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 -- 172.21.15.46:0/867216654 shutdown_connections 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f015db10 0x7fc6f0069560 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/867216654 >> v2:172.21.15.133:3300/0 conn(0x7fc6f0159890 0x7fc6f015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/867216654 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f0159c60 0x7fc6f015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 -- 172.21.15.46:0/867216654 >> 172.21.15.46:0/867216654 conn(0x7fc6f0068e20 msgr2=0x7fc6f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 -- 172.21.15.46:0/867216654 shutdown_connections 2023-10-07T09:06:51.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.983+0000 7fc6f7f42700 1 -- 172.21.15.46:0/867216654 wait complete. 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.984+0000 7fc6f7f42700 1 Processor -- start 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.984+0000 7fc6f7f42700 1 -- start start 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6f0159c60 0x7fc6f0153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f015db10 0x7fc6f0142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0153e50 con 0x7fc6f0159890 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f014f540 con 0x7fc6f0159c60 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f7f42700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0154060 con 0x7fc6f015db10 2023-10-07T09:06:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59934/0 (socket says 172.21.15.46:59934) 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 -- 172.21.15.46:0/3656124058 learned_addr learned my addr 172.21.15.46:0/3656124058 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f64df700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f015db10 0x7fc6f0142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f54dd700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6f0159c60 0x7fc6f0153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 -- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f015db10 msgr2=0x7fc6f0142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f015db10 0x7fc6f0142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 -- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6f0159c60 msgr2=0x7fc6f0153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6f0159c60 0x7fc6f0153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.985+0000 7fc6f5cde700 1 -- 172.21.15.46:0/3656124058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8009ae0 con 0x7fc6f0159890 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6f5cde700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c830 tx=0x7fc6ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011600 con 0x7fc6f0159890 2023-10-07T09:06:51.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec011760 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f0154340 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011b20 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.986+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f014f1d0 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.987+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f004c3c0 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.987+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc6ec00a3e0 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.988+0000 7fc6e5ffb700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 0x7fc6d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.988+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6ec085290 con 0x7fc6f0159890 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.988+0000 7fc6f54dd700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 0x7fc6d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.988+0000 7fc6f54dd700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 0x7fc6d40697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00d16f0 tx=0x7fc6e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:51.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:51.992+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6ec051e10 con 0x7fc6f0159890 2023-10-07T09:06:52.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.237+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc6f00b0120 con 0x7fc6f0159890 2023-10-07T09:06:52.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.237+0000 7fc6e5ffb700 1 -- 172.21.15.46:0/3656124058 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v111) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6ec055430 con 0x7fc6f0159890 2023-10-07T09:06:52.239 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:06:52.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 msgr2=0x7fc6d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:52.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 0x7fc6d40697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00d16f0 tx=0x7fc6e0008040 comp rx=0 tx=0).stop 2023-10-07T09:06:52.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 msgr2=0x7fc6f016a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c830 tx=0x7fc6ec008040 comp rx=0 tx=0).stop 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 shutdown_connections 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6d4067320 0x7fc6d40697d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6f015db10 0x7fc6f0142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0159890 0x7fc6f016a390 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 --2- 172.21.15.46:0/3656124058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6f0159c60 0x7fc6f0153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 >> 172.21.15.46:0/3656124058 conn(0x7fc6f0068e20 msgr2=0x7fc6f00cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.239+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 shutdown_connections 2023-10-07T09:06:52.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:52.240+0000 7fc6f7f42700 1 -- 172.21.15.46:0/3656124058 wait complete. 2023-10-07T09:06:52.253 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:06:52.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:06:52.253 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:06:52.253 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:06:52.254 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:52.254 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:06:52.254 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:06:52.254 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:06:52.254 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:52.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.254 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:52.270 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42001sec preferred_lft 42001sec 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:52.271 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:52.272 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:06:52.273 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:06:52.273 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:52.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.273 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:06:52.334 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:06:52.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.335 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:06:52.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:06:52.392 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:06:52.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:06:52.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:06:52.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:06:52.393 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:06:52.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.495 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:06:52.509 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:06:52.509 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:06:52.510 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:52.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:06:52.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:52.575 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:52.629 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:06:52.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:52.630 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:52.684 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:06:52.684 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:06:52.684 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:52.765 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:52.765 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:06:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:06:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:06:52.807 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:06:52.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:52.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:52.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:06:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.033+0000 7f2d91f70700 1 Processor -- start 2023-10-07T09:06:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.033+0000 7f2d91f70700 1 -- start start 2023-10-07T09:06:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d91f70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c159c60 0x7f2d8c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d91f70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d91f70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c15a160 con 0x7f2d8c159890 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d91f70700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c15df50 con 0x7f2d8c159c60 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d91f70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0d13a0 con 0x7f2d8c15db10 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c159c60 0x7f2d8c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c159c60 0x7f2d8c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:33208/0 (socket says 172.21.15.46:33208) 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:50682/0 (socket says 172.21.15.46:50682) 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2d8c159890 0x7f2d8c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:53338/0 (socket says 172.21.15.46:53338) 2023-10-07T09:06:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 -- 172.21.15.46:0/779487726 learned_addr learned my addr 172.21.15.46:0/779487726 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 -- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 msgr2=0x7f2d8c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 -- 172.21.15.46:0/779487726 >> v1:172.21.15.133:6789/0 conn(0x7f2d8c159890 legacy=0x7f2d8c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8affd700 1 -- 172.21.15.46:0/779487726 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c15e140 con 0x7f2d8c159c60 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.034+0000 7f2d8bfff700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:06:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d8affd700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159c60 0x7f2d8c15d5d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2d800099b0 tx=0x7f2d80009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88333ee7983df7d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d8a7fc700 1 -- 172.21.15.46:0/779487726 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80009ea0 con 0x7f2d8c159c60 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d8a7fc700 1 -- 172.21.15.46:0/779487726 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000b860 con 0x7f2d8c159c60 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d8a7fc700 1 -- 172.21.15.46:0/779487726 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000bc00 con 0x7f2d8c159c60 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 -- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159c60 msgr2=0x7f2d8c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159c60 0x7f2d8c15d5d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2d800099b0 tx=0x7f2d80009250 comp rx=0 tx=0).stop 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 -- 172.21.15.46:0/779487726 shutdown_connections 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 --2- 172.21.15.46:0/779487726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159c60 0x7f2d8c15d5d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 -- 172.21.15.46:0/779487726 >> 172.21.15.46:0/779487726 conn(0x7f2d8c068e20 msgr2=0x7f2d8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 -- 172.21.15.46:0/779487726 shutdown_connections 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.035+0000 7f2d91f70700 1 -- 172.21.15.46:0/779487726 wait complete. 2023-10-07T09:06:53.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.036+0000 7f2d91f70700 1 Processor -- start 2023-10-07T09:06:53.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 -- start start 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159890 0x7f2d8c14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0ce510 con 0x7f2d8c159c60 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0cd980 con 0x7f2d8c159890 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d91f70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0cdc60 con 0x7f2d8c15db10 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d8affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d8affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59950/0 (socket says 172.21.15.46:59950) 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d8affd700 1 -- 172.21.15.46:0/2817883883 learned_addr learned my addr 172.21.15.46:0/2817883883 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d8bfff700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.037+0000 7f2d8b7fe700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159890 0x7f2d8c14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 -- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 msgr2=0x7f2d8c15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 -- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159890 msgr2=0x7f2d8c14cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159890 0x7f2d8c14cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 -- 172.21.15.46:0/2817883883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009a20 con 0x7f2d8c159c60 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d8affd700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0899c0 tx=0x7f2d80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000bbe0 con 0x7f2d8c159c60 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80011420 con 0x7f2d8c159c60 2023-10-07T09:06:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d800094f0 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800117c0 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.038+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c0ce760 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.039+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c0ce980 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.040+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d80011bf0 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.040+0000 7f2d737fe700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 0x7f2d780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.040+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d80086400 con 0x7f2d8c159c60 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.040+0000 7f2d8b7fe700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 0x7f2d780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.041+0000 7f2d8b7fe700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 0x7f2d780697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c004fd0 tx=0x7f2d7c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:53.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.044+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d80053150 con 0x7f2d8c159c60 2023-10-07T09:06:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.284+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d8c04c3c0 con 0x7f2d8c159c60 2023-10-07T09:06:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.285+0000 7f2d737fe700 1 -- 172.21.15.46:0/2817883883 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v111) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d80056770 con 0x7f2d8c159c60 2023-10-07T09:06:53.287 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 msgr2=0x7f2d780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 0x7f2d780697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c004fd0 tx=0x7f2d7c007eb0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 msgr2=0x7f2d8c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0899c0 tx=0x7f2d80017000 comp rx=0 tx=0).stop 2023-10-07T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 shutdown_connections 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2d78067320 0x7f2d780697d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c15db10 0x7f2d8c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c159890 0x7f2d8c14cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 --2- 172.21.15.46:0/2817883883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d8c159c60 0x7f2d8c0cd0c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 >> 172.21.15.46:0/2817883883 conn(0x7f2d8c068e20 msgr2=0x7f2d8c158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 shutdown_connections 2023-10-07T09:06:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:53.287+0000 7f2d91f70700 1 -- 172.21.15.46:0/2817883883 wait complete. 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:06:53.302 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:53.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.303 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:06:53.321 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:53.322 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41993sec preferred_lft 41993sec 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:06:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:06:53.324 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:06:53.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.325 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:06:53.389 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:06:53.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.391 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:06:53.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:06:53.450 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:06:53.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.554 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:06:53.570 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:53.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:06:53.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:53.635 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:06:53.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:06:53.690 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:53.744 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:06:53.744 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:06:53.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:53.824 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:53.824 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:53.843 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:53.844 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:06:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:06:53.868 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:06:53.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:53.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:53.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:06:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.061+0000 7f8ecd8c1700 1 Processor -- start 2023-10-07T09:06:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.061+0000 7f8ecd8c1700 1 -- start start 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8ec80b03c0 0x7f8ec80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ec80b0790 0x7f8ec80b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec81591e0 0x7f8ec8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80cfa00 con 0x7f8ec80b03c0 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80cb580 con 0x7f8ec80b0790 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd8c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80b2de0 con 0x7f8ec81591e0 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecc8bf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8ec80b03c0 0x7f8ec80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecc8bf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8ec80b03c0 0x7f8ec80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59952/0 (socket says 172.21.15.46:59952) 2023-10-07T09:06:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/4197792743 learned_addr learned my addr 172.21.15.46:0/4197792743 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ecd0c0700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec81591e0 0x7f8ec8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.062+0000 7f8ec7fff700 1 --2- 172.21.15.46:0/4197792743 >> v2:172.21.15.133:3300/0 conn(0x7f8ec80b0790 0x7f8ec80b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/4197792743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec81591e0 msgr2=0x7f8ec8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec81591e0 0x7f8ec8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/4197792743 >> v2:172.21.15.133:3300/0 conn(0x7f8ec80b0790 msgr2=0x7f8ec80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/4197792743 >> v2:172.21.15.133:3300/0 conn(0x7f8ec80b0790 0x7f8ec80b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/4197792743 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80cf160 con 0x7f8ec80b03c0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80cea70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80099b0 tx=0x7f8eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9082322965501c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ec77fe700 1 -- 172.21.15.46:0/4197792743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800b640 con 0x7f8ec80b03c0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ec77fe700 1 -- 172.21.15.46:0/4197792743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800b7a0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ec77fe700 1 -- 172.21.15.46:0/4197792743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800bb40 con 0x7f8ec80b03c0 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/4197792743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 msgr2=0x7f8ec80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80cea70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80099b0 tx=0x7f8eb8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/4197792743 shutdown_connections 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec81591e0 0x7f8ec8159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/4197792743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80cea70 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/4197792743 >> v2:172.21.15.133:3300/0 conn(0x7f8ec80b0790 0x7f8ec80b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/4197792743 >> 172.21.15.46:0/4197792743 conn(0x7f8ec8063230 msgr2=0x7f8ec8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.063+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/4197792743 shutdown_connections 2023-10-07T09:06:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.064+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/4197792743 wait complete. 2023-10-07T09:06:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 Processor -- start 2023-10-07T09:06:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 -- start start 2023-10-07T09:06:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec80b0790 0x7f8ec80c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec81591e0 0x7f8ec80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81597c0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8151fa0 con 0x7f8ec81591e0 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.065+0000 7f8ecd8c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8152280 con 0x7f8ec80b0790 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59964/0 (socket says 172.21.15.46:59964) 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/2228325109 learned_addr learned my addr 172.21.15.46:0/2228325109 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecd0c0700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec81591e0 0x7f8ec80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ec7fff700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec80b0790 0x7f8ec80c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec80b0790 msgr2=0x7f8ec80c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec80b0790 0x7f8ec80c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec81591e0 msgr2=0x7f8ec80c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec81591e0 0x7f8ec80c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 -- 172.21.15.46:0/2228325109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80094f0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecc8bf700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009fd0 tx=0x7f8eb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800bb20 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8000c90 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec8152560 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8011630 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.066+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec80c86a0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.067+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec804c3c0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.068+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8eb8011a60 con 0x7f8ec80b03c0 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.068+0000 7f8ec4ff9700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 0x7f8eb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:54.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.068+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8eb80860c0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.068+0000 7f8ec7fff700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 0x7f8eb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.069+0000 7f8ec7fff700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 0x7f8eb40697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ec81511b0 tx=0x7f8ebc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.073+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8eb8052d50 con 0x7f8ec80b03c0 2023-10-07T09:06:54.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.310+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ec80cfed0 con 0x7f8ec80b03c0 2023-10-07T09:06:54.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.977+0000 7f8ec4ff9700 1 -- 172.21.15.46:0/2228325109 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v112) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8eb8056370 con 0x7f8ec80b03c0 2023-10-07T09:06:54.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 msgr2=0x7f8eb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:54.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 0x7f8eb40697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ec81511b0 tx=0x7f8ebc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 msgr2=0x7f8ec80c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009fd0 tx=0x7f8eb8017000 comp rx=0 tx=0).stop 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 shutdown_connections 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8eb4067320 0x7f8eb40697d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec81591e0 0x7f8ec80c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ec80b03c0 0x7f8ec80c8160 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 --2- 172.21.15.46:0/2228325109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ec80b0790 0x7f8ec80c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 >> 172.21.15.46:0/2228325109 conn(0x7f8ec8063230 msgr2=0x7f8ec8069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 shutdown_connections 2023-10-07T09:06:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:54.980+0000 7f8ecd8c1700 1 -- 172.21.15.46:0/2228325109 wait complete. 2023-10-07T09:06:54.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:06:55.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.122+0000 7fd139d68700 1 Processor -- start 2023-10-07T09:06:55.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.122+0000 7fd139d68700 1 -- start start 2023-10-07T09:06:55.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd139d68700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd134069560 0x7fd1340699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd139d68700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd134069ee0 con 0x7fd134159890 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd139d68700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13415a160 con 0x7fd134159c60 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd139d68700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340d13a0 con 0x7fd134069560 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd133fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd134069560 0x7fd1340699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd1337fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd134159890 0x7fd13415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60000/0 (socket says 172.21.15.46:60000) 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.123+0000 7fd1337fe700 1 -- 172.21.15.46:0/1632143557 learned_addr learned my addr 172.21.15.46:0/1632143557 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd133fff700 1 -- 172.21.15.46:0/1632143557 >> v1:172.21.15.133:6789/0 conn(0x7fd134159c60 legacy=0x7fd13415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd133fff700 1 -- 172.21.15.46:0/1632143557 >> v1:172.21.15.46:6789/0 conn(0x7fd134159890 legacy=0x7fd13415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd1327fc700 1 -- 172.21.15.46:0/1632143557 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768969512 0 0) 0x7fd134069ee0 con 0x7fd134159890 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd133fff700 1 -- 172.21.15.46:0/1632143557 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13415e140 con 0x7fd134069560 2023-10-07T09:06:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd133fff700 1 --2- 172.21.15.46:0/1632143557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd1340699a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009e60 tx=0x7fd12c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649bf8f7657e0bd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd1327fc700 1 -- 172.21.15.46:0/1632143557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00e070 con 0x7fd134069560 2023-10-07T09:06:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd1327fc700 1 -- 172.21.15.46:0/1632143557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00bc30 con 0x7fd134069560 2023-10-07T09:06:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd1327fc700 1 -- 172.21.15.46:0/1632143557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c012430 con 0x7fd134069560 2023-10-07T09:06:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.124+0000 7fd139d68700 1 -- 172.21.15.46:0/1632143557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 msgr2=0x7fd1340699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 --2- 172.21.15.46:0/1632143557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd1340699a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009e60 tx=0x7fd12c009780 comp rx=0 tx=0).stop 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 -- 172.21.15.46:0/1632143557 shutdown_connections 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 --2- 172.21.15.46:0/1632143557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd1340699a0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 -- 172.21.15.46:0/1632143557 >> 172.21.15.46:0/1632143557 conn(0x7fd134068e20 msgr2=0x7fd1340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 -- 172.21.15.46:0/1632143557 shutdown_connections 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.125+0000 7fd139d68700 1 -- 172.21.15.46:0/1632143557 wait complete. 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.126+0000 7fd139d68700 1 Processor -- start 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.126+0000 7fd139d68700 1 -- start start 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 0x7fd1340c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd134159c60 0x7fd1340cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cde50 con 0x7fd134069560 2023-10-07T09:06:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd134149850 con 0x7fd134159c60 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cd240 con 0x7fd134159890 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59990/0 (socket says 172.21.15.46:59990) 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 -- 172.21.15.46:0/1978804707 learned_addr learned my addr 172.21.15.46:0/1978804707 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd133fff700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd134159c60 0x7fd1340cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd132ffd700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 0x7fd1340c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 -- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 msgr2=0x7fd1340c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 0x7fd1340c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 -- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd134159c60 msgr2=0x7fd1340cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd134159c60 0x7fd1340cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 -- 172.21.15.46:0/1978804707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009a20 con 0x7fd134069560 2023-10-07T09:06:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd132ffd700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 0x7fd1340c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd1337fe700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c7e0 tx=0x7fd124007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124005b30 con 0x7fd134069560 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124005c90 con 0x7fd134069560 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124007300 con 0x7fd134069560 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.127+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1340cd520 con 0x7fd134069560 2023-10-07T09:06:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.128+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340cdae0 con 0x7fd134069560 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.128+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1340b2e40 con 0x7fd134069560 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.129+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1240076b0 con 0x7fd134069560 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.129+0000 7fd11b7fe700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 0x7fd1200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.129+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1240841d0 con 0x7fd134069560 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.130+0000 7fd132ffd700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 0x7fd1200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.130+0000 7fd132ffd700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 0x7fd1200697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ca3b0 tx=0x7fd128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.134+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd124050e60 con 0x7fd134069560 2023-10-07T09:06:55.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.355+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1340cdf90 con 0x7fd120067320 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.358+0000 7fd11b7fe700 1 -- 172.21.15.46:0/1978804707 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd1280014e0 con 0x7fd120067320 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:06:55.359 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:06:55.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 msgr2=0x7fd1200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 0x7fd1200697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ca3b0 tx=0x7fd128009040 comp rx=0 tx=0).stop 2023-10-07T09:06:55.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 msgr2=0x7fd134149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c7e0 tx=0x7fd124007df0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 shutdown_connections 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd120067320 0x7fd1200697d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd134159c60 0x7fd1340cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd134069560 0x7fd134149310 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 --2- 172.21.15.46:0/1978804707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd134159890 0x7fd1340c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 >> 172.21.15.46:0/1978804707 conn(0x7fd134068e20 msgr2=0x7fd134155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.359+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 shutdown_connections 2023-10-07T09:06:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.360+0000 7fd139d68700 1 -- 172.21.15.46:0/1978804707 wait complete. 2023-10-07T09:06:55.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:06:55.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.493+0000 7f0f87cb1700 1 Processor -- start 2023-10-07T09:06:55.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 -- start start 2023-10-07T09:06:55.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f80159c60 0x7f0f8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f8015db10 0x7f0f80069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8015a160 con 0x7f0f80159890 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8015df50 con 0x7f0f8015db10 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.494+0000 7f0f87cb1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800d13a0 con 0x7f0f80159c60 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f8015db10 0x7f0f80069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f8015db10 0x7f0f80069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60002/0 (socket says 172.21.15.46:60002) 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 -- 172.21.15.46:0/108708656 learned_addr learned my addr 172.21.15.46:0/108708656 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8524c700 1 --2- 172.21.15.46:0/108708656 >> v2:172.21.15.133:3300/0 conn(0x7f0f80159c60 0x7f0f8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 -- 172.21.15.46:0/108708656 >> v2:172.21.15.133:3300/0 conn(0x7f0f80159c60 msgr2=0x7f0f8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 --2- 172.21.15.46:0/108708656 >> v2:172.21.15.133:3300/0 conn(0x7f0f80159c60 0x7f0f8015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 -- 172.21.15.46:0/108708656 >> v1:172.21.15.133:6789/0 conn(0x7f0f80159890 legacy=0x7f0f8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 -- 172.21.15.46:0/108708656 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8015e140 con 0x7f0f8015db10 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f8624e700 1 --2- 172.21.15.46:0/108708656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f8015db10 0x7f0f80069560 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0f800b67f0 tx=0x7f0f78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba5d7dd1b6a92cb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f84a4b700 1 -- 172.21.15.46:0/108708656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800e070 con 0x7f0f8015db10 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f84a4b700 1 -- 172.21.15.46:0/108708656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800ba10 con 0x7f0f8015db10 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.495+0000 7f0f84a4b700 1 -- 172.21.15.46:0/108708656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f780092e0 con 0x7f0f8015db10 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 -- 172.21.15.46:0/108708656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f8015db10 msgr2=0x7f0f80069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/108708656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f8015db10 0x7f0f80069560 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0f800b67f0 tx=0x7f0f78009840 comp rx=0 tx=0).stop 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 -- 172.21.15.46:0/108708656 shutdown_connections 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/108708656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f8015db10 0x7f0f80069560 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/108708656 >> v2:172.21.15.133:3300/0 conn(0x7f0f80159c60 0x7f0f8015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 -- 172.21.15.46:0/108708656 >> 172.21.15.46:0/108708656 conn(0x7f0f80068e20 msgr2=0x7f0f800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 -- 172.21.15.46:0/108708656 shutdown_connections 2023-10-07T09:06:55.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.496+0000 7f0f87cb1700 1 -- 172.21.15.46:0/108708656 wait complete. 2023-10-07T09:06:55.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.497+0000 7f0f87cb1700 1 Processor -- start 2023-10-07T09:06:55.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.497+0000 7f0f87cb1700 1 -- start start 2023-10-07T09:06:55.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 0x7f0f80168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8015db10 0x7f0f8016d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8014cba0 con 0x7f0f80159890 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800b0670 con 0x7f0f8015db10 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80169510 con 0x7f0f80159c60 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60006/0 (socket says 172.21.15.46:60006) 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 -- 172.21.15.46:0/1892294967 learned_addr learned my addr 172.21.15.46:0/1892294967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f8524c700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 0x7f0f80168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f8624e700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8015db10 0x7f0f8016d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 -- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 msgr2=0x7f0f80168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 0x7f0f80168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 -- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8015db10 msgr2=0x7f0f8016d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8015db10 0x7f0f8016d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 -- 172.21.15.46:0/1892294967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78009ae0 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f8524c700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 0x7f0f80168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f85a4d700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c600 tx=0x7f0f70007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70011590 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70011710 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8016dad0 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.498+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70011ad0 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.499+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f800b2800 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.500+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8004c3c0 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.500+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f7001c460 con 0x7f0f80159890 2023-10-07T09:06:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.500+0000 7f0f7dffb700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 0x7f0f6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:55.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.500+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f70084a20 con 0x7f0f80159890 2023-10-07T09:06:55.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.501+0000 7f0f8524c700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 0x7f0f6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:55.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.501+0000 7f0f8524c700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 0x7f0f6c0697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0f80157af0 tx=0x7f0f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:55.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.505+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f700516b0 con 0x7f0f80159890 2023-10-07T09:06:55.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.698+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0f8006a5b0 con 0x7f0f80159890 2023-10-07T09:06:55.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.698+0000 7f0f7dffb700 1 -- 172.21.15.46:0/1892294967 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f70054cd0 con 0x7f0f80159890 2023-10-07T09:06:55.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 msgr2=0x7f0f6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 0x7f0f6c0697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0f80157af0 tx=0x7f0f74008040 comp rx=0 tx=0).stop 2023-10-07T09:06:55.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 msgr2=0x7f0f800b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c600 tx=0x7f0f70007f60 comp rx=0 tx=0).stop 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 shutdown_connections 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f6c067320 0x7f0f6c0697d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8015db10 0x7f0f8016d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f80159890 0x7f0f800b2140 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 --2- 172.21.15.46:0/1892294967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f80159c60 0x7f0f80168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 >> 172.21.15.46:0/1892294967 conn(0x7f0f80068e20 msgr2=0x7f0f80154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 shutdown_connections 2023-10-07T09:06:55.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:55.700+0000 7f0f87cb1700 1 -- 172.21.15.46:0/1892294967 wait complete. 2023-10-07T09:06:55.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:06:55.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:55.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:06:55.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:06:55.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:55.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:06:55.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:06:55.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:06:55.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:06:55.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:06:55.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:55.854 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:06:55.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:06:55.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:55.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T09:06:55.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:06:55.887 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-07T09:06:55.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:06:55.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:06:55.888 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T09:06:55.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:06:55.927 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-07T09:06:55.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create another-data-pool --pg_num_min 64 2023-10-07T09:06:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.049+0000 7f6217fff700 1 Processor -- start 2023-10-07T09:06:56.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.049+0000 7f6217fff700 1 -- start start 2023-10-07T09:06:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f6217fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 0x7f62180cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f6217fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180cfa00 con 0x7f62181591e0 2023-10-07T09:06:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f6217fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180cb580 con 0x7f62180b0790 2023-10-07T09:06:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f6217fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180cf160 con 0x7f62180b03c0 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f62177fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f62181591e0 0x7f6218159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60006/0 (socket says 172.21.15.46:60006) 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f62177fe700 1 -- 172.21.15.46:0/526502612 learned_addr learned my addr 172.21.15.46:0/526502612 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.050+0000 7f6216ffd700 1 --2- 172.21.15.46:0/526502612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 0x7f62180cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44362295 0 0) 0x7f62180cfa00 con 0x7f62181591e0 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6204003570 con 0x7f62181591e0 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630366054 0 0) 0x7f62180cb580 con 0x7f62180b0790 2023-10-07T09:06:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62180cfa00 con 0x7f62180b0790 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6216ffd700 1 -- 172.21.15.46:0/526502612 >> v1:172.21.15.133:6789/0 conn(0x7f62180b0790 legacy=0x7f62180b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442812547 0 0) 0x7f6204003570 con 0x7f62181591e0 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6216ffd700 1 -- 172.21.15.46:0/526502612 >> v1:172.21.15.46:6789/0 conn(0x7f62181591e0 legacy=0x7f6218159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6216ffd700 1 -- 172.21.15.46:0/526502612 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180cf440 con 0x7f62180b03c0 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6216ffd700 1 --2- 172.21.15.46:0/526502612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 0x7f62180cea70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6208009e90 tx=0x7f6208009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47af6db1fdd91b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800e070 con 0x7f62180b03c0 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800b870 con 0x7f62180b03c0 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.051+0000 7f6215ffb700 1 -- 172.21.15.46:0/526502612 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210001470 con 0x7f62180b03c0 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 -- 172.21.15.46:0/526502612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 msgr2=0x7f62180cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 --2- 172.21.15.46:0/526502612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 0x7f62180cea70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6208009e90 tx=0x7f6208009780 comp rx=0 tx=0).stop 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 -- 172.21.15.46:0/526502612 shutdown_connections 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 --2- 172.21.15.46:0/526502612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62180b03c0 0x7f62180cea70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 -- 172.21.15.46:0/526502612 >> 172.21.15.46:0/526502612 conn(0x7f6218063230 msgr2=0x7f6218063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 -- 172.21.15.46:0/526502612 shutdown_connections 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.052+0000 7f6217fff700 1 -- 172.21.15.46:0/526502612 wait complete. 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.053+0000 7f6217fff700 1 Processor -- start 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.053+0000 7f6217fff700 1 -- start start 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62180b03c0 0x7f62180c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62181591e0 0x7f621815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218158070 con 0x7f62180b0790 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180c8840 con 0x7f62180b03c0 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6217fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621815b0a0 con 0x7f62181591e0 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60016/0 (socket says 172.21.15.46:60016) 2023-10-07T09:06:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 -- 172.21.15.46:0/2573355549 learned_addr learned my addr 172.21.15.46:0/2573355549 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62177fe700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62181591e0 0x7f621815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f6216ffd700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62180b03c0 0x7f62180c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 -- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62181591e0 msgr2=0x7f621815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62181591e0 0x7f621815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 -- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62180b03c0 msgr2=0x7f62180c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62180b03c0 0x7f62180c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 -- 172.21.15.46:0/2573355549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009a20 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f62167fc700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f620000c790 tx=0x7f6200007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.054+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200010510 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.055+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200010670 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.055+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62180c7c30 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.055+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200010a10 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.055+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180c81f0 con 0x7f62180b0790 2023-10-07T09:06:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.055+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62180c89f0 con 0x7f62180b0790 2023-10-07T09:06:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.056+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f620001b400 con 0x7f62180b0790 2023-10-07T09:06:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.056+0000 7f620effd700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 0x7f61f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.057+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6200084ae0 con 0x7f62180b0790 2023-10-07T09:06:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.057+0000 7f6216ffd700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 0x7f61f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.057+0000 7f6216ffd700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 0x7f61f80697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62080097c0 tx=0x7f6208017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.061+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62180c89f0 con 0x7f62180b0790 2023-10-07T09:06:56.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.253+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64} v 0) v1 -- 0x7f62180c89b0 con 0x7f62180b0790 2023-10-07T09:06:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.989+0000 7f620effd700 1 -- 172.21.15.46:0/2573355549 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64}]=0 pool 'another-data-pool' created v166) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6200055200 con 0x7f62180b0790 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 msgr2=0x7f61f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 0x7f61f80697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62080097c0 tx=0x7f6208017000 comp rx=0 tx=0).stop 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 msgr2=0x7f6218157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f620000c790 tx=0x7f6200007e10 comp rx=0 tx=0).stop 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 shutdown_connections 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f61f8067320 0x7f61f80697d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62181591e0 0x7f621815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62180b03c0 0x7f62180c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 --2- 172.21.15.46:0/2573355549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62180b0790 0x7f6218157b30 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:56.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.996+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 >> 172.21.15.46:0/2573355549 conn(0x7f6218063230 msgr2=0x7f62181588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:56.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.997+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 shutdown_connections 2023-10-07T09:06:56.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:56.997+0000 7f6217fff700 1 -- 172.21.15.46:0/2573355549 wait complete. 2023-10-07T09:06:56.999 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'another-data-pool' created 2023-10-07T09:06:57.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs another-data-pool 2023-10-07T09:06:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.139+0000 7f059226b700 1 Processor -- start 2023-10-07T09:06:57.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.139+0000 7f059226b700 1 -- start start 2023-10-07T09:06:57.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f059226b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f058c06bcd0 0x7f058c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:57.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f059226b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c15d7e0 con 0x7f058c06c0a0 2023-10-07T09:06:57.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f059226b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c15dac0 con 0x7f058c15df50 2023-10-07T09:06:57.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f059226b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c15aa30 con 0x7f058c06bcd0 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f058b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f058c06c0a0 0x7f058c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60020/0 (socket says 172.21.15.46:60020) 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.140+0000 7f058b7fe700 1 -- 172.21.15.46:0/3564910390 learned_addr learned my addr 172.21.15.46:0/3564910390 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058bfff700 1 --2- 172.21.15.46:0/3564910390 >> v2:172.21.15.133:3300/0 conn(0x7f058c06bcd0 0x7f058c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885809124 0 0) 0x7f058c15d7e0 con 0x7f058c06c0a0 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003570 con 0x7f058c06c0a0 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555472368 0 0) 0x7f058c15dac0 con 0x7f058c15df50 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c15d7e0 con 0x7f058c15df50 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058bfff700 1 -- 172.21.15.46:0/3564910390 >> v1:172.21.15.133:6789/0 conn(0x7f058c15df50 legacy=0x7f058c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402562406 0 0) 0x7f0578003570 con 0x7f058c06c0a0 2023-10-07T09:06:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058bfff700 1 -- 172.21.15.46:0/3564910390 >> v1:172.21.15.46:6789/0 conn(0x7f058c06c0a0 legacy=0x7f058c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058bfff700 1 -- 172.21.15.46:0/3564910390 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c15ad10 con 0x7f058c06bcd0 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058bfff700 1 --2- 172.21.15.46:0/3564910390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06bcd0 0x7f058c0caa90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05740098e0 tx=0x7f05740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5a31b79785a421 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c001470 con 0x7f058c06bcd0 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0574011420 con 0x7f058c06bcd0 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.141+0000 7f058affd700 1 -- 172.21.15.46:0/3564910390 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05740117c0 con 0x7f058c06bcd0 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 -- 172.21.15.46:0/3564910390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06bcd0 msgr2=0x7f058c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 --2- 172.21.15.46:0/3564910390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06bcd0 0x7f058c0caa90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05740098e0 tx=0x7f05740091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 -- 172.21.15.46:0/3564910390 shutdown_connections 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 --2- 172.21.15.46:0/3564910390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06bcd0 0x7f058c0caa90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 -- 172.21.15.46:0/3564910390 >> 172.21.15.46:0/3564910390 conn(0x7f058c0ce600 msgr2=0x7f058c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 -- 172.21.15.46:0/3564910390 shutdown_connections 2023-10-07T09:06:57.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.142+0000 7f059226b700 1 -- 172.21.15.46:0/3564910390 wait complete. 2023-10-07T09:06:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.143+0000 7f059226b700 1 Processor -- start 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.143+0000 7f059226b700 1 -- start start 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06c0a0 0x7f058c160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f058c15df50 0x7f058c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b2fa0 con 0x7f058c06bcd0 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b2390 con 0x7f058c06c0a0 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f059226b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b2670 con 0x7f058c15df50 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f058bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f058bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60028/0 (socket says 172.21.15.46:60028) 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f058bfff700 1 -- 172.21.15.46:0/3388649673 learned_addr learned my addr 172.21.15.46:0/3388649673 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f058b7fe700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06c0a0 0x7f058c160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f0590808700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f058c15df50 0x7f058c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.144+0000 7f058bfff700 1 -- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f058c15df50 msgr2=0x7f058c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f058bfff700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f058c15df50 0x7f058c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f058bfff700 1 -- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06c0a0 msgr2=0x7f058c160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f058bfff700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06c0a0 0x7f058c160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f058bfff700 1 -- 172.21.15.46:0/3388649673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009420 con 0x7f058c06bcd0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f058bfff700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f058c069220 tx=0x7f0574016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574000d10 con 0x7f058c06bcd0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057401cb30 con 0x7f058c06bcd0 2023-10-07T09:06:57.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c0b2950 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057401a450 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.145+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c1606a0 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.146+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0c9e10 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.146+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f057401a880 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.147+0000 7f0583fff700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.147+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f0574086430 con 0x7f058c06bcd0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.147+0000 7f058b7fe700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:57.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.147+0000 7f058b7fe700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 0x7f056c0697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f058c16dbd0 tx=0x7f057c000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:57.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.151+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0574052f50 con 0x7f058c06bcd0 2023-10-07T09:06:57.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:57.393+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"} v 0) v1 -- 0x7f058c04c3c0 con 0x7f058c06bcd0 2023-10-07T09:06:58.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.009+0000 7f0583fff700 1 -- 172.21.15.46:0/3388649673 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"}]=0 added data pool 30 to fsmap v113) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0574056570 con 0x7f058c06bcd0 2023-10-07T09:06:58.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.016+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 msgr2=0x7f056c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.016+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 0x7f056c0697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f058c16dbd0 tx=0x7f057c000bc0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.016+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 msgr2=0x7f058c0b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.016+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f058c069220 tx=0x7f0574016000 comp rx=0 tx=0).stop 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 shutdown_connections 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f058c15df50 0x7f058c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f058c06bcd0 0x7f058c0b1d50 secure :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f058c069220 tx=0x7f0574016000 comp rx=0 tx=0).stop 2023-10-07T09:06:58.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 --2- 172.21.15.46:0/3388649673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c06c0a0 0x7f058c160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 >> 172.21.15.46:0/3388649673 conn(0x7f058c0ce600 msgr2=0x7f058c158970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.017+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 shutdown_connections 2023-10-07T09:06:58.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.019+0000 7f059226b700 1 -- 172.21.15.46:0/3388649673 wait complete. 2023-10-07T09:06:58.021 INFO:teuthology.orchestra.run.smithi046.stderr:added data pool 30 to fsmap 2023-10-07T09:06:58.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:58.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.156+0000 7f92d9fcf700 1 Processor -- start 2023-10-07T09:06:58.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 -- start start 2023-10-07T09:06:58.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92d406bcd0 0x7f92d40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92d406c0a0 0x7f92d415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d415d7e0 con 0x7f92d415df50 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d415dac0 con 0x7f92d406c0a0 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d9fcf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d415aa30 con 0x7f92d406bcd0 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.157+0000 7f92d2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92d406c0a0 0x7f92d415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92d406c0a0 0x7f92d415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60036/0 (socket says 172.21.15.46:60036) 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 -- 172.21.15.46:0/80546933 learned_addr learned my addr 172.21.15.46:0/80546933 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d37fe700 1 --2- 172.21.15.46:0/80546933 >> v2:172.21.15.133:3300/0 conn(0x7f92d406bcd0 0x7f92d40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 -- 172.21.15.46:0/80546933 >> v2:172.21.15.133:3300/0 conn(0x7f92d406bcd0 msgr2=0x7f92d40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/80546933 >> v2:172.21.15.133:3300/0 conn(0x7f92d406bcd0 0x7f92d40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 -- 172.21.15.46:0/80546933 >> v1:172.21.15.133:6789/0 conn(0x7f92d415df50 legacy=0x7f92d40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:58.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 -- 172.21.15.46:0/80546933 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d415ad10 con 0x7f92d406c0a0 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/80546933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406c0a0 0x7f92d415a1e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f92d40691a0 tx=0x7f92c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfca8a86b5acfd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d27fc700 1 -- 172.21.15.46:0/80546933 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800b820 con 0x7f92d406c0a0 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d27fc700 1 -- 172.21.15.46:0/80546933 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800b980 con 0x7f92d406c0a0 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.158+0000 7f92d27fc700 1 -- 172.21.15.46:0/80546933 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800bd40 con 0x7f92d406c0a0 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 -- 172.21.15.46:0/80546933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406c0a0 msgr2=0x7f92d415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/80546933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406c0a0 0x7f92d415a1e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f92d40691a0 tx=0x7f92c8009250 comp rx=0 tx=0).stop 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 -- 172.21.15.46:0/80546933 shutdown_connections 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/80546933 >> v2:172.21.15.133:3300/0 conn(0x7f92d406bcd0 0x7f92d40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/80546933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406c0a0 0x7f92d415a1e0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 -- 172.21.15.46:0/80546933 >> 172.21.15.46:0/80546933 conn(0x7f92d40ce600 msgr2=0x7f92d40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 -- 172.21.15.46:0/80546933 shutdown_connections 2023-10-07T09:06:58.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.159+0000 7f92d9fcf700 1 -- 172.21.15.46:0/80546933 wait complete. 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.160+0000 7f92d9fcf700 1 Processor -- start 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.160+0000 7f92d9fcf700 1 -- start start 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 0x7f92d4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92d415df50 0x7f92d4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c8ef0 con 0x7f92d406bcd0 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c82e0 con 0x7f92d406c0a0 2023-10-07T09:06:58.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c85c0 con 0x7f92d415df50 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60052/0 (socket says 172.21.15.46:60052) 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 -- 172.21.15.46:0/1085942620 learned_addr learned my addr 172.21.15.46:0/1085942620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 0x7f92d4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d3fff700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92d415df50 0x7f92d4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 -- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92d415df50 msgr2=0x7f92d4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92d415df50 0x7f92d4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 -- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 msgr2=0x7f92d4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 0x7f92d4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 -- 172.21.15.46:0/1085942620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80094f0 con 0x7f92d406bcd0 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 0x7f92d4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d37fe700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f92c400d860 tx=0x7f92c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4009610 con 0x7f92d406bcd0 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4009770 con 0x7f92d406bcd0 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40c88a0 con 0x7f92d406bcd0 2023-10-07T09:06:58.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4009b30 con 0x7f92d406bcd0 2023-10-07T09:06:58.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.161+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40c98c0 con 0x7f92d406bcd0 2023-10-07T09:06:58.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.162+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d40c91d0 con 0x7f92d406bcd0 2023-10-07T09:06:58.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.163+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f92c401e460 con 0x7f92d406bcd0 2023-10-07T09:06:58.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.163+0000 7f92bb7fe700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 0x7f92c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.163+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f92c4085460 con 0x7f92d406bcd0 2023-10-07T09:06:58.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.164+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 0x7f92c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.164+0000 7f92d2ffd700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 0x7f92c00697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f92d40691a0 tx=0x7f92c8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.168+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92c4051f60 con 0x7f92d406bcd0 2023-10-07T09:06:58.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.408+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92d404c3c0 con 0x7f92d406bcd0 2023-10-07T09:06:58.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.408+0000 7f92bb7fe700 1 -- 172.21.15.46:0/1085942620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4616 (secure 0 0 0) 0x7f92c4055580 con 0x7f92d406bcd0 2023-10-07T09:06:58.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:58.410 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":113,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:06:57.999187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:06:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 msgr2=0x7f92c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 0x7f92c00697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f92d40691a0 tx=0x7f92c8016000 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 msgr2=0x7f92d40c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f92c400d860 tx=0x7f92c4008040 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 shutdown_connections 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92c0067320 0x7f92c00697d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92d415df50 0x7f92d4156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d406bcd0 0x7f92d40c9380 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 --2- 172.21.15.46:0/1085942620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92d406c0a0 0x7f92d4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 >> 172.21.15.46:0/1085942620 conn(0x7f92d40ce600 msgr2=0x7f92d415c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 shutdown_connections 2023-10-07T09:06:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.410+0000 7f92d9fcf700 1 -- 172.21.15.46:0/1085942620 wait complete. 2023-10-07T09:06:58.414 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 113 2023-10-07T09:06:58.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:58.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 Processor -- start 2023-10-07T09:06:58.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 -- start start 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 0x7fb3e0159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3e00b1e50 0x7fb3e00b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00b6570 con 0x7fb3e00ceaa0 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00cfe20 con 0x7fb3e00b1e50 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e54f3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00cf210 con 0x7fb3e01593b0 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3e00b1e50 0x7fb3e00b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3e00b1e50 0x7fb3e00b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2023-10-07T09:06:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3df7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb3e00ceaa0 0x7fb3e00b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60022/0 (socket says 172.21.15.46:60022) 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 -- 172.21.15.46:0/2385767757 learned_addr learned my addr 172.21.15.46:0/2385767757 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3dffff700 1 --2- 172.21.15.46:0/2385767757 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 0x7fb3e0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 -- 172.21.15.46:0/2385767757 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 msgr2=0x7fb3e0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 --2- 172.21.15.46:0/2385767757 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 0x7fb3e0159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 -- 172.21.15.46:0/2385767757 >> v1:172.21.15.46:6789/0 conn(0x7fb3e00ceaa0 legacy=0x7fb3e00b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 -- 172.21.15.46:0/2385767757 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00cf4f0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3deffd700 1 -- 172.21.15.46:0/2385767757 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289887853 0 0) 0x7fb3d4001110 con 0x7fb3e00ceaa0 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3dffff700 1 --2- 172.21.15.46:0/2385767757 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 0x7fb3e0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3e4cf2700 1 --2- 172.21.15.46:0/2385767757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e00b6030 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0070d60 tx=0x7fb3d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c825a8369ff9e10b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3deffd700 1 -- 172.21.15.46:0/2385767757 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800e070 con 0x7fb3e00b1e50 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3deffd700 1 -- 172.21.15.46:0/2385767757 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800ba50 con 0x7fb3e00b1e50 2023-10-07T09:06:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.542+0000 7fb3deffd700 1 -- 172.21.15.46:0/2385767757 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80092e0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 -- 172.21.15.46:0/2385767757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 msgr2=0x7fb3e00b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/2385767757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e00b6030 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0070d60 tx=0x7fb3d8009840 comp rx=0 tx=0).stop 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 -- 172.21.15.46:0/2385767757 shutdown_connections 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/2385767757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e00b6030 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/2385767757 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01593b0 0x7fb3e0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 -- 172.21.15.46:0/2385767757 >> 172.21.15.46:0/2385767757 conn(0x7fb3e00d1130 msgr2=0x7fb3e00b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 -- 172.21.15.46:0/2385767757 shutdown_connections 2023-10-07T09:06:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.543+0000 7fb3e54f3700 1 -- 172.21.15.46:0/2385767757 wait complete. 2023-10-07T09:06:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 Processor -- start 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 -- start start 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e00ceaa0 0x7fb3e0153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 0x7fb3e0151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0153590 con 0x7fb3e00b1e50 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e014e710 con 0x7fb3e01593b0 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0152980 con 0x7fb3e00ceaa0 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60064/0 (socket says 172.21.15.46:60064) 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 -- 172.21.15.46:0/3100302328 learned_addr learned my addr 172.21.15.46:0/3100302328 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 -- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e00ceaa0 msgr2=0x7fb3e0153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e00ceaa0 0x7fb3e0153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e4cf2700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 0x7fb3e0151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 -- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 msgr2=0x7fb3e0151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 0x7fb3e0151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 -- 172.21.15.46:0/3100302328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8009ae0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e4cf2700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 0x7fb3e0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3dffff700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000d860 tx=0x7fb3d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d00125f0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0012750 con 0x7fb3e00b1e50 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.545+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e0152c60 con 0x7fb3e00b1e50 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.546+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0012ad0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.546+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e0153220 con 0x7fb3e00b1e50 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.547+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e004c3c0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.547+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb3d0014430 con 0x7fb3e00b1e50 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.547+0000 7fb3c7fff700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 0x7fb3cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.548+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fb3d0085210 con 0x7fb3e00b1e50 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.548+0000 7fb3df7fe700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 0x7fb3cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.548+0000 7fb3df7fe700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 0x7fb3cc0697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb3e015be70 tx=0x7fb3d4001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.552+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3d00557a0 con 0x7fb3e00b1e50 2023-10-07T09:06:58.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.746+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3e0153870 con 0x7fb3e00b1e50 2023-10-07T09:06:58.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.747+0000 7fb3c7fff700 1 -- 172.21.15.46:0/3100302328 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16947 (secure 0 0 0) 0x7fb3d0055330 con 0x7fb3e00b1e50 2023-10-07T09:06:58.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:58.748 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":167,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:57.395415+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:58.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 msgr2=0x7fb3cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 0x7fb3cc0697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb3e015be70 tx=0x7fb3d4001330 comp rx=0 tx=0).stop 2023-10-07T09:06:58.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 msgr2=0x7fb3e014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000d860 tx=0x7fb3d0008040 comp rx=0 tx=0).stop 2023-10-07T09:06:58.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 shutdown_connections 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb3cc067320 0x7fb3cc0697d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01593b0 0x7fb3e0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3e00b1e50 0x7fb3e014e1d0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 --2- 172.21.15.46:0/3100302328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e00ceaa0 0x7fb3e0153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 >> 172.21.15.46:0/3100302328 conn(0x7fb3e00d1130 msgr2=0x7fb3e00af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 shutdown_connections 2023-10-07T09:06:58.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.749+0000 7fb3e54f3700 1 -- 172.21.15.46:0/3100302328 wait complete. 2023-10-07T09:06:58.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:06:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.880+0000 7f2e78d76700 1 Processor -- start 2023-10-07T09:06:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.880+0000 7f2e78d76700 1 -- start start 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e78d76700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e740b5ea0 0x7f2e74068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e78d76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74068bb0 0x7f2e7415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e78d76700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7415c480 con 0x7f2e74159c10 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e78d76700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740b2a40 con 0x7f2e740b5ea0 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e78d76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415b870 con 0x7f2e74068bb0 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e740b5ea0 0x7f2e74068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2e74159c10 0x7f2e7415b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60032/0 (socket says 172.21.15.46:60032) 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7259c700 1 -- 172.21.15.46:0/2622466366 learned_addr learned my addr 172.21.15.46:0/2622466366 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e72d9d700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74068bb0 0x7f2e7415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 -- 172.21.15.46:0/2622466366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74068bb0 msgr2=0x7f2e7415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74068bb0 0x7f2e7415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 -- 172.21.15.46:0/2622466366 >> v1:172.21.15.46:6789/0 conn(0x7f2e74159c10 legacy=0x7f2e7415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 -- 172.21.15.46:0/2622466366 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7415bb50 con 0x7f2e740b5ea0 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7159a700 1 -- 172.21.15.46:0/2622466366 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148993430 0 0) 0x7f2e7415c480 con 0x7f2e74159c10 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e71d9b700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e74068670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208e214f2421b287 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7159a700 1 -- 172.21.15.46:0/2622466366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68009e80 con 0x7f2e740b5ea0 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7159a700 1 -- 172.21.15.46:0/2622466366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800b860 con 0x7f2e740b5ea0 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.881+0000 7f2e7159a700 1 -- 172.21.15.46:0/2622466366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800bbe0 con 0x7f2e740b5ea0 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 -- 172.21.15.46:0/2622466366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 msgr2=0x7f2e74068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e74068670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 -- 172.21.15.46:0/2622466366 shutdown_connections 2023-10-07T09:06:58.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74068bb0 0x7f2e7415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 --2- 172.21.15.46:0/2622466366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e74068670 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 -- 172.21.15.46:0/2622466366 >> 172.21.15.46:0/2622466366 conn(0x7f2e74099a20 msgr2=0x7f2e740af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:58.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 -- 172.21.15.46:0/2622466366 shutdown_connections 2023-10-07T09:06:58.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.882+0000 7f2e78d76700 1 -- 172.21.15.46:0/2622466366 wait complete. 2023-10-07T09:06:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.883+0000 7f2e78d76700 1 Processor -- start 2023-10-07T09:06:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.883+0000 7f2e78d76700 1 -- start start 2023-10-07T09:06:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e74068bb0 0x7f2e740c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74159c10 0x7f2e740b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740c9450 con 0x7f2e740b5ea0 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741696b0 con 0x7f2e74068bb0 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e78d76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740c7ae0 con 0x7f2e74159c10 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60078/0 (socket says 172.21.15.46:60078) 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 -- 172.21.15.46:0/344138485 learned_addr learned my addr 172.21.15.46:0/344138485 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e7259c700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e74068bb0 0x7f2e740c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e72d9d700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74159c10 0x7f2e740b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 -- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74159c10 msgr2=0x7f2e740b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74159c10 0x7f2e740b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 -- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e74068bb0 msgr2=0x7f2e740c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e74068bb0 0x7f2e740c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.884+0000 7f2e71d9b700 1 -- 172.21.15.46:0/344138485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009420 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e71d9b700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2e74063db0 tx=0x7f2e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800b9d0 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800bb30 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e74169950 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011670 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.885+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740c7520 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.886+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e74169ae0 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.886+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2e68011a20 con 0x7f2e740b5ea0 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.887+0000 7f2e627fc700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 0x7f2e540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:58.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.887+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f2e680866a0 con 0x7f2e740b5ea0 2023-10-07T09:06:58.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.887+0000 7f2e7259c700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 0x7f2e540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:58.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.887+0000 7f2e7259c700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 0x7f2e540697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007160 tx=0x7f2e64007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:58.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:58.891+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e680531a0 con 0x7f2e740b5ea0 2023-10-07T09:06:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.130+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e7404c3c0 con 0x7f2e740b5ea0 2023-10-07T09:06:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.130+0000 7f2e627fc700 1 -- 172.21.15.46:0/344138485 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4616 (secure 0 0 0) 0x7f2e680567c0 con 0x7f2e740b5ea0 2023-10-07T09:06:59.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:59.131 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":113,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:06:57.999187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 msgr2=0x7f2e540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 0x7f2e540697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007160 tx=0x7f2e64007f50 comp rx=0 tx=0).stop 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 msgr2=0x7f2e740c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2e74063db0 tx=0x7f2e68017000 comp rx=0 tx=0).stop 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 shutdown_connections 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e54067320 0x7f2e540697d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e74159c10 0x7f2e740b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e74068bb0 0x7f2e740c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 --2- 172.21.15.46:0/344138485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e740b5ea0 0x7f2e740c6810 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 >> 172.21.15.46:0/344138485 conn(0x7f2e74099a20 msgr2=0x7f2e7409b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 shutdown_connections 2023-10-07T09:06:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.132+0000 7f2e78d76700 1 -- 172.21.15.46:0/344138485 wait complete. 2023-10-07T09:06:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 113 2023-10-07T09:06:59.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:06:59.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.264+0000 7f74248ca700 1 Processor -- start 2023-10-07T09:06:59.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.264+0000 7f74248ca700 1 -- start start 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.265+0000 7f74248ca700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74200aca80 0x7f742006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.265+0000 7f74248ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7420069d60 0x7f74200c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.265+0000 7f74248ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742006bdb0 con 0x7f74200c81f0 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.265+0000 7f74248ca700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200cb370 con 0x7f74200aca80 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.265+0000 7f74248ca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7420159f60 con 0x7f7420069d60 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74200aca80 0x7f742006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74200aca80 0x7f742006aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60084/0 (socket says 172.21.15.46:60084) 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 -- 172.21.15.46:0/2485724129 learned_addr learned my addr 172.21.15.46:0/2485724129 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741dd9b700 1 --2- 172.21.15.46:0/2485724129 >> v2:172.21.15.133:3300/0 conn(0x7f7420069d60 0x7f74200c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 -- 172.21.15.46:0/2485724129 >> v2:172.21.15.133:3300/0 conn(0x7f7420069d60 msgr2=0x7f74200c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 --2- 172.21.15.46:0/2485724129 >> v2:172.21.15.133:3300/0 conn(0x7f7420069d60 0x7f74200c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 -- 172.21.15.46:0/2485724129 >> v1:172.21.15.133:6789/0 conn(0x7f74200c81f0 legacy=0x7f7420068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 -- 172.21.15.46:0/2485724129 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200c8610 con 0x7f74200aca80 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741e59c700 1 --2- 172.21.15.46:0/2485724129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200aca80 0x7f742006aba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f742006e540 tx=0x7f7410009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76685bff213fd669 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741d59a700 1 -- 172.21.15.46:0/2485724129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410005c10 con 0x7f74200aca80 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741d59a700 1 -- 172.21.15.46:0/2485724129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410005d70 con 0x7f74200aca80 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.266+0000 7f741d59a700 1 -- 172.21.15.46:0/2485724129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000b840 con 0x7f74200aca80 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 -- 172.21.15.46:0/2485724129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200aca80 msgr2=0x7f742006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 --2- 172.21.15.46:0/2485724129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200aca80 0x7f742006aba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f742006e540 tx=0x7f7410009220 comp rx=0 tx=0).stop 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 -- 172.21.15.46:0/2485724129 shutdown_connections 2023-10-07T09:06:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 --2- 172.21.15.46:0/2485724129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200aca80 0x7f742006aba0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 --2- 172.21.15.46:0/2485724129 >> v2:172.21.15.133:3300/0 conn(0x7f7420069d60 0x7f74200c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 -- 172.21.15.46:0/2485724129 >> 172.21.15.46:0/2485724129 conn(0x7f74200cd670 msgr2=0x7f74200cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 -- 172.21.15.46:0/2485724129 shutdown_connections 2023-10-07T09:06:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.267+0000 7f74248ca700 1 -- 172.21.15.46:0/2485724129 wait complete. 2023-10-07T09:06:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.268+0000 7f74248ca700 1 Processor -- start 2023-10-07T09:06:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.268+0000 7f74248ca700 1 -- start start 2023-10-07T09:06:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7420069d60 0x7f7420152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74200aca80 0x7f742016d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7420153930 con 0x7f74200c81f0 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742016df80 con 0x7f7420069d60 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742016e260 con 0x7f74200aca80 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60098/0 (socket says 172.21.15.46:60098) 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 -- 172.21.15.46:0/2392720635 learned_addr learned my addr 172.21.15.46:0/2392720635 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741e59c700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7420069d60 0x7f7420152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741dd9b700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74200aca80 0x7f742016d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 -- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74200aca80 msgr2=0x7f742016d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74200aca80 0x7f742016d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 -- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7420069d60 msgr2=0x7f7420152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7420069d60 0x7f7420152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 -- 172.21.15.46:0/2392720635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009480 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f741ed9d700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f741800bc30 tx=0x7f7418009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800c840 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741800c9e0 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74201535c0 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.269+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800cda0 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.270+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742016db20 con 0x7f74200c81f0 2023-10-07T09:06:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.270+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742016dd10 con 0x7f74200c81f0 2023-10-07T09:06:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.271+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7418014620 con 0x7f74200c81f0 2023-10-07T09:06:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.271+0000 7f740e7fc700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 0x7f74000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.271+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f7418084d70 con 0x7f74200c81f0 2023-10-07T09:06:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.271+0000 7f741e59c700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 0x7f74000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.272+0000 7f741e59c700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 0x7f74000697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7410003080 tx=0x7f7410015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.275+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7418051830 con 0x7f74200c81f0 2023-10-07T09:06:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.468+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f742004c3c0 con 0x7f74200c81f0 2023-10-07T09:06:59.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.469+0000 7f740e7fc700 1 -- 172.21.15.46:0/2392720635 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16934 (secure 0 0 0) 0x7f7418054e50 con 0x7f74200c81f0 2023-10-07T09:06:59.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:06:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":168,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:06:59.006393+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:06:59.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 msgr2=0x7f74000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 0x7f74000697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7410003080 tx=0x7f7410015000 comp rx=0 tx=0).stop 2023-10-07T09:06:59.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 msgr2=0x7f7420153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f741800bc30 tx=0x7f7418009820 comp rx=0 tx=0).stop 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 shutdown_connections 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7400067320 0x7f74000697d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74200c81f0 0x7f7420153dc0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7420069d60 0x7f7420152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 --2- 172.21.15.46:0/2392720635 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74200aca80 0x7f742016d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 >> 172.21.15.46:0/2392720635 conn(0x7f74200cd670 msgr2=0x7f7420157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 shutdown_connections 2023-10-07T09:06:59.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.471+0000 7f74248ca700 1 -- 172.21.15.46:0/2392720635 wait complete. 2023-10-07T09:06:59.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000308651 --yes-i-really-mean-it 2023-10-07T09:06:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.607+0000 7fa80e281700 1 Processor -- start 2023-10-07T09:06:59.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.607+0000 7fa80e281700 1 -- start start 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 0x7fa8080b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080b53d0 0x7fa8080cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8080cce40 0x7fa8080cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080b5b00 con 0x7fa8080cce40 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080b5850 con 0x7fa808159ec0 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80e281700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080b5da0 con 0x7fa8080b53d0 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8080cce40 0x7fa8080cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8080cce40 0x7fa8080cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60104/0 (socket says 172.21.15.46:60104) 2023-10-07T09:06:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 -- 172.21.15.46:0/2693667381 learned_addr learned my addr 172.21.15.46:0/2693667381 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa8077fe700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080b53d0 0x7fa8080cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa807fff700 1 --2- 172.21.15.46:0/2693667381 >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 0x7fa8080b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 -- 172.21.15.46:0/2693667381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080b53d0 msgr2=0x7fa8080cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080b53d0 0x7fa8080cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 -- 172.21.15.46:0/2693667381 >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 msgr2=0x7fa8080b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 --2- 172.21.15.46:0/2693667381 >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 0x7fa8080b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 -- 172.21.15.46:0/2693667381 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080b6080 con 0x7fa8080cce40 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa807fff700 1 --2- 172.21.15.46:0/2693667381 >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 0x7fa8080b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.608+0000 7fa80c81e700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080cce40 0x7fa8080cd2a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa808089120 tx=0x7fa800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e512c58cd28bd7a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa806ffd700 1 -- 172.21.15.46:0/2693667381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80000e070 con 0x7fa8080cce40 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa806ffd700 1 -- 172.21.15.46:0/2693667381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80000ba50 con 0x7fa8080cce40 2023-10-07T09:06:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa806ffd700 1 -- 172.21.15.46:0/2693667381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000092e0 con 0x7fa8080cce40 2023-10-07T09:06:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 -- 172.21.15.46:0/2693667381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080cce40 msgr2=0x7fa8080cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080cce40 0x7fa8080cd2a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa808089120 tx=0x7fa800009840 comp rx=0 tx=0).stop 2023-10-07T09:06:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 -- 172.21.15.46:0/2693667381 shutdown_connections 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080cce40 0x7fa8080cd2a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 --2- 172.21.15.46:0/2693667381 >> v2:172.21.15.133:3300/0 conn(0x7fa808159ec0 0x7fa8080b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 --2- 172.21.15.46:0/2693667381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080b53d0 0x7fa8080cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 -- 172.21.15.46:0/2693667381 >> 172.21.15.46:0/2693667381 conn(0x7fa8080999f0 msgr2=0x7fa8080b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 -- 172.21.15.46:0/2693667381 shutdown_connections 2023-10-07T09:06:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.609+0000 7fa80e281700 1 -- 172.21.15.46:0/2693667381 wait complete. 2023-10-07T09:06:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.610+0000 7fa80e281700 1 Processor -- start 2023-10-07T09:06:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.610+0000 7fa80e281700 1 -- start start 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080cce40 0x7fa8081474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa808159ec0 0x7fa80806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081575e0 con 0x7fa8080b53d0 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808157150 con 0x7fa808159ec0 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80e281700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa808156540 con 0x7fa8080cce40 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60108/0 (socket says 172.21.15.46:60108) 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa807fff700 1 -- 172.21.15.46:0/3807755650 learned_addr learned my addr 172.21.15.46:0/3807755650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa8077fe700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080cce40 0x7fa8081474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.611+0000 7fa80c81e700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa808159ec0 0x7fa80806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 -- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080cce40 msgr2=0x7fa8081474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080cce40 0x7fa8081474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 -- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa808159ec0 msgr2=0x7fa80806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa808159ec0 0x7fa80806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 -- 172.21.15.46:0/3807755650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800009ae0 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa807fff700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c830 tx=0x7fa7f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8005a00 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8005b60 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa808156820 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8011600 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.612+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa808156de0 con 0x7fa8080b53d0 2023-10-07T09:06:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.613+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808063c90 con 0x7fa8080b53d0 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.613+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7f8011970 con 0x7fa8080b53d0 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.614+0000 7fa7fffff700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 0x7fa7e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.614+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fa7f8084c40 con 0x7fa8080b53d0 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.614+0000 7fa8077fe700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 0x7fa7e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.614+0000 7fa8077fe700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 0x7fa7e80697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa80809e500 tx=0x7fa7f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:06:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.618+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f80550c0 con 0x7fa8080b53d0 2023-10-07T09:06:59.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:06:59.838+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000308651", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa8080718b0 con 0x7fa7e8067320 2023-10-07T09:07:01.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.021+0000 7fa7fffff700 1 -- 172.21.15.46:0/3807755650 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+127 (secure 0 0 0) 0x7fa8080718b0 con 0x7fa7e8067320 2023-10-07T09:07:01.022 INFO:teuthology.orchestra.run.smithi046.stdout:FS volume 'cephfs' renamed to 'volume_0000000000308651'. But failed to rename data pools as more than one data pool was found. 2023-10-07T09:07:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 msgr2=0x7fa7e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 0x7fa7e80697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa80809e500 tx=0x7fa7f0008040 comp rx=0 tx=0).stop 2023-10-07T09:07:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 msgr2=0x7fa808155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c830 tx=0x7fa7f8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 shutdown_connections 2023-10-07T09:07:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa7e8067320 0x7fa7e80697d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa808159ec0 0x7fa80806ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8080b53d0 0x7fa808155f60 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 --2- 172.21.15.46:0/3807755650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8080cce40 0x7fa8081474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 >> 172.21.15.46:0/3807755650 conn(0x7fa8080999f0 msgr2=0x7fa808155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 shutdown_connections 2023-10-07T09:07:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.024+0000 7fa80e281700 1 -- 172.21.15.46:0/3807755650 wait complete. 2023-10-07T09:07:01.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:07:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.166+0000 7ff23de07700 1 Processor -- start 2023-10-07T09:07:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.166+0000 7ff23de07700 1 -- start start 2023-10-07T09:07:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff23de07700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff238159c60 0x7ff23815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff23de07700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23815a160 con 0x7ff23815db10 2023-10-07T09:07:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff23de07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2380d13a0 con 0x7ff238159890 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff23de07700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23815df50 con 0x7ff238159c60 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff236ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff238159c60 0x7ff23815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff237fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff23815db10 0x7ff238069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36192/0 (socket says 172.21.15.46:36192) 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.167+0000 7ff237fff700 1 -- 172.21.15.46:0/2844954198 learned_addr learned my addr 172.21.15.46:0/2844954198 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff236ffd700 1 -- 172.21.15.46:0/2844954198 >> v1:172.21.15.133:6789/0 conn(0x7ff238159890 legacy=0x7ff23815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff236ffd700 1 -- 172.21.15.46:0/2844954198 >> v1:172.21.15.46:6789/0 conn(0x7ff23815db10 legacy=0x7ff238069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff236ffd700 1 -- 172.21.15.46:0/2844954198 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23815e140 con 0x7ff238159c60 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff2367fc700 1 -- 172.21.15.46:0/2844954198 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795485320 0 0) 0x7ff23815a160 con 0x7ff23815db10 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff236ffd700 1 --2- 172.21.15.46:0/2844954198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159c60 0x7ff23815d5d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098e0 tx=0x7ff22c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ca9d4e99136eee server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff2367fc700 1 -- 172.21.15.46:0/2844954198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c009e80 con 0x7ff238159c60 2023-10-07T09:07:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff2367fc700 1 -- 172.21.15.46:0/2844954198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00b860 con 0x7ff238159c60 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff2367fc700 1 -- 172.21.15.46:0/2844954198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00bbe0 con 0x7ff238159c60 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff23de07700 1 -- 172.21.15.46:0/2844954198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159c60 msgr2=0x7ff23815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff23de07700 1 --2- 172.21.15.46:0/2844954198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159c60 0x7ff23815d5d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098e0 tx=0x7ff22c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.168+0000 7ff23de07700 1 -- 172.21.15.46:0/2844954198 shutdown_connections 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.169+0000 7ff23de07700 1 --2- 172.21.15.46:0/2844954198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159c60 0x7ff23815d5d0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.169+0000 7ff23de07700 1 -- 172.21.15.46:0/2844954198 >> 172.21.15.46:0/2844954198 conn(0x7ff238068e20 msgr2=0x7ff2380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.169+0000 7ff23de07700 1 -- 172.21.15.46:0/2844954198 shutdown_connections 2023-10-07T09:07:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.169+0000 7ff23de07700 1 -- 172.21.15.46:0/2844954198 wait complete. 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.170+0000 7ff23de07700 1 Processor -- start 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.170+0000 7ff23de07700 1 -- start start 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff238159c60 0x7ff23816b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 0x7ff238169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23816aea0 con 0x7ff238159890 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23816a8e0 con 0x7ff23815db10 2023-10-07T09:07:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23816abc0 con 0x7ff238159c60 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50524/0 (socket says 172.21.15.46:50524) 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 -- 172.21.15.46:0/2931443564 learned_addr learned my addr 172.21.15.46:0/2931443564 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff237fff700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 0x7ff238169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 -- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff238159c60 msgr2=0x7ff23816b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff236ffd700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff238159c60 0x7ff23816b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff238159c60 0x7ff23816b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 -- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 msgr2=0x7ff238169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 0x7ff238169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 -- 172.21.15.46:0/2931443564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009420 con 0x7ff238159890 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff237fff700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 0x7ff238169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff2377fe700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff22800c590 tx=0x7ff22800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228011590 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280116f0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2380b36c0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228011ab0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.171+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2380b5330 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.172+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2380b54f0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.173+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff22801b3b0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.173+0000 7ff21f7fe700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.173+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ff2280843e0 con 0x7ff238159890 2023-10-07T09:07:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.174+0000 7ff236ffd700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.174+0000 7ff236ffd700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 0x7ff2240697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff2380c6ee0 tx=0x7ff22c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.178+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff228050e90 con 0x7ff238159890 2023-10-07T09:07:01.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.397+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff23804c3c0 con 0x7ff224067320 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.399+0000 7ff21f7fe700 1 -- 172.21.15.46:0/2931443564 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7ff23804c3c0 con 0x7ff224067320 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000308651" 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:01.400 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:01.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 msgr2=0x7ff2240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 0x7ff2240697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff2380c6ee0 tx=0x7ff22c017000 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 msgr2=0x7ff23816ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff22800c590 tx=0x7ff22800c950 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 shutdown_connections 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff23815db10 0x7ff238169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff238159890 0x7ff23816ce10 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 --2- 172.21.15.46:0/2931443564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff238159c60 0x7ff23816b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 >> 172.21.15.46:0/2931443564 conn(0x7ff238068e20 msgr2=0x7ff2380c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 shutdown_connections 2023-10-07T09:07:01.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.401+0000 7ff23de07700 1 -- 172.21.15.46:0/2931443564 wait complete. 2023-10-07T09:07:01.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:01.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.532+0000 7fb0660f5700 1 Processor -- start 2023-10-07T09:07:01.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.532+0000 7fb0660f5700 1 -- start start 2023-10-07T09:07:01.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0660f5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb06015d230 0x7fb06015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0660f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0600b2980 con 0x7fb060159420 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0660f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06015db70 con 0x7fb0601597f0 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0660f5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600b11d0 con 0x7fb06015d230 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb06015d230 0x7fb06015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0650f3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb060159420 0x7fb0600b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36198/0 (socket says 172.21.15.46:36198) 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb06015d230 0x7fb06015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50530/0 (socket says 172.21.15.46:50530) 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 -- 172.21.15.46:0/4195728654 learned_addr learned my addr 172.21.15.46:0/4195728654 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 -- 172.21.15.46:0/4195728654 >> v1:172.21.15.133:6789/0 conn(0x7fb0601597f0 legacy=0x7fb0600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 -- 172.21.15.46:0/4195728654 >> v1:172.21.15.46:6789/0 conn(0x7fb060159420 legacy=0x7fb0600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb057fff700 1 -- 172.21.15.46:0/4195728654 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287317081 0 0) 0x7fb0600b2980 con 0x7fb060159420 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.533+0000 7fb0658f4700 1 -- 172.21.15.46:0/4195728654 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600b14b0 con 0x7fb06015d230 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0658f4700 1 --2- 172.21.15.46:0/4195728654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb06015d630 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb058009f20 tx=0x7fb058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d83b42eed468283 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb057fff700 1 -- 172.21.15.46:0/4195728654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800e070 con 0x7fb06015d230 2023-10-07T09:07:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb057fff700 1 -- 172.21.15.46:0/4195728654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800ba80 con 0x7fb06015d230 2023-10-07T09:07:01.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb057fff700 1 -- 172.21.15.46:0/4195728654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580092e0 con 0x7fb06015d230 2023-10-07T09:07:01.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 -- 172.21.15.46:0/4195728654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 msgr2=0x7fb06015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 --2- 172.21.15.46:0/4195728654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb06015d630 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb058009f20 tx=0x7fb058009840 comp rx=0 tx=0).stop 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 -- 172.21.15.46:0/4195728654 shutdown_connections 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 --2- 172.21.15.46:0/4195728654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb06015d630 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 -- 172.21.15.46:0/4195728654 >> 172.21.15.46:0/4195728654 conn(0x7fb0600d0660 msgr2=0x7fb0600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 -- 172.21.15.46:0/4195728654 shutdown_connections 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.534+0000 7fb0660f5700 1 -- 172.21.15.46:0/4195728654 wait complete. 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.535+0000 7fb0660f5700 1 Processor -- start 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.535+0000 7fb0660f5700 1 -- start start 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb060159420 0x7fb06015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0601597f0 0x7fb06014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015b690 con 0x7fb06015d230 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015aa80 con 0x7fb0601597f0 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0660f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015ad60 con 0x7fb060159420 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0658f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0658f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50540/0 (socket says 172.21.15.46:50540) 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.536+0000 7fb0658f4700 1 -- 172.21.15.46:0/294086174 learned_addr learned my addr 172.21.15.46:0/294086174 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0648f2700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0601597f0 0x7fb06014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0650f3700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb060159420 0x7fb06015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 -- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb060159420 msgr2=0x7fb06015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb060159420 0x7fb06015bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 -- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0601597f0 msgr2=0x7fb06014f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0601597f0 0x7fb06014f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 -- 172.21.15.46:0/294086174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009ae0 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0658f4700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b6c0 tx=0x7fb058018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058007d40 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05801c410 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06015b040 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05801c7d0 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.537+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06014f9f0 con 0x7fb06015d230 2023-10-07T09:07:01.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.538+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06015b840 con 0x7fb06015d230 2023-10-07T09:07:01.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.538+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb05801cb80 con 0x7fb06015d230 2023-10-07T09:07:01.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.539+0000 7fb0557fa700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 0x7fb0440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.539+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb0580867d0 con 0x7fb06015d230 2023-10-07T09:07:01.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.539+0000 7fb0650f3700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 0x7fb0440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.540+0000 7fb0650f3700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 0x7fb0440697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb05c007fd0 tx=0x7fb05c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.543+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb058053270 con 0x7fb06015d230 2023-10-07T09:07:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.778+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb06004c3c0 con 0x7fb06015d230 2023-10-07T09:07:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.778+0000 7fb0557fa700 1 -- 172.21.15.46:0/294086174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4633 (secure 0 0 0) 0x7fb058056890 con 0x7fb06015d230 2023-10-07T09:07:01.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:01.779 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:07:00.012549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000308651","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:07:01.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 msgr2=0x7fb0440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 0x7fb0440697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb05c007fd0 tx=0x7fb05c007d30 comp rx=0 tx=0).stop 2023-10-07T09:07:01.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 msgr2=0x7fb060154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b6c0 tx=0x7fb058018000 comp rx=0 tx=0).stop 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 shutdown_connections 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb044067320 0x7fb0440697d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb06015d230 0x7fb060154480 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb060159420 0x7fb06015bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 --2- 172.21.15.46:0/294086174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0601597f0 0x7fb06014f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 >> 172.21.15.46:0/294086174 conn(0x7fb0600d0660 msgr2=0x7fb060157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 shutdown_connections 2023-10-07T09:07:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.780+0000 7fb0660f5700 1 -- 172.21.15.46:0/294086174 wait complete. 2023-10-07T09:07:01.783 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 114 2023-10-07T09:07:01.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:01.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.913+0000 7fe96a959700 1 Processor -- start 2023-10-07T09:07:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.913+0000 7fe96a959700 1 -- start start 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe96a959700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe964159c60 0x7fe96415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe96a959700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe96415db10 0x7fe964069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe96a959700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96415a160 con 0x7fe964159890 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe96a959700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96415df50 con 0x7fe964159c60 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe96a959700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640d13a0 con 0x7fe96415db10 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe964159c60 0x7fe96415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe963fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe964159890 0x7fe96415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36214/0 (socket says 172.21.15.46:36214) 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe963fff700 1 -- 172.21.15.46:0/497226676 learned_addr learned my addr 172.21.15.46:0/497226676 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe968ef6700 1 --2- 172.21.15.46:0/497226676 >> v2:172.21.15.133:3300/0 conn(0x7fe96415db10 0x7fe964069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 -- 172.21.15.46:0/497226676 >> v2:172.21.15.133:3300/0 conn(0x7fe96415db10 msgr2=0x7fe964069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 --2- 172.21.15.46:0/497226676 >> v2:172.21.15.133:3300/0 conn(0x7fe96415db10 0x7fe964069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 -- 172.21.15.46:0/497226676 >> v1:172.21.15.46:6789/0 conn(0x7fe964159890 legacy=0x7fe96415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 -- 172.21.15.46:0/497226676 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96415e140 con 0x7fe964159c60 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe9637fe700 1 --2- 172.21.15.46:0/497226676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159c60 0x7fe96415d5d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe96406a890 tx=0x7fe9580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a22b61711372694 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe962ffd700 1 -- 172.21.15.46:0/497226676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800b6b0 con 0x7fe964159c60 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe962ffd700 1 -- 172.21.15.46:0/497226676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800b810 con 0x7fe964159c60 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.914+0000 7fe962ffd700 1 -- 172.21.15.46:0/497226676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800bbb0 con 0x7fe964159c60 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 -- 172.21.15.46:0/497226676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159c60 msgr2=0x7fe96415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 --2- 172.21.15.46:0/497226676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159c60 0x7fe96415d5d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe96406a890 tx=0x7fe9580091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 -- 172.21.15.46:0/497226676 shutdown_connections 2023-10-07T09:07:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 --2- 172.21.15.46:0/497226676 >> v2:172.21.15.133:3300/0 conn(0x7fe96415db10 0x7fe964069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 --2- 172.21.15.46:0/497226676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159c60 0x7fe96415d5d0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 -- 172.21.15.46:0/497226676 >> 172.21.15.46:0/497226676 conn(0x7fe964068e20 msgr2=0x7fe9640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 -- 172.21.15.46:0/497226676 shutdown_connections 2023-10-07T09:07:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.915+0000 7fe96a959700 1 -- 172.21.15.46:0/497226676 wait complete. 2023-10-07T09:07:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.916+0000 7fe96a959700 1 Processor -- start 2023-10-07T09:07:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.916+0000 7fe96a959700 1 -- start start 2023-10-07T09:07:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 0x7fe9640b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe96415db10 0x7fe9640b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964141300 con 0x7fe964159890 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640cd6d0 con 0x7fe964159c60 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe96a959700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640cd9b0 con 0x7fe96415db10 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50558/0 (socket says 172.21.15.46:50558) 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 -- 172.21.15.46:0/1932898950 learned_addr learned my addr 172.21.15.46:0/1932898950 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe9637fe700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 0x7fe9640b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe968ef6700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe96415db10 0x7fe9640b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 -- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe96415db10 msgr2=0x7fe9640b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe96415db10 0x7fe9640b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 -- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 msgr2=0x7fe9640b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 0x7fe9640b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe963fff700 1 -- 172.21.15.46:0/1932898950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009420 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.917+0000 7fe9637fe700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 0x7fe9640b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe963fff700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c7c0 tx=0x7fe954007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954005b30 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954005cb0 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954004a80 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9640cdc90 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.918+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9640ce250 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.919+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9640ce440 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.919+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe9540070f0 con 0x7fe964159890 2023-10-07T09:07:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.919+0000 7fe94bfff700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 0x7fe9500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.920+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fe9540842d0 con 0x7fe964159890 2023-10-07T09:07:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.920+0000 7fe9637fe700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 0x7fe9500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.920+0000 7fe9637fe700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 0x7fe9500697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9580093f0 tx=0x7fe958017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:01.924+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe954050e00 con 0x7fe964159890 2023-10-07T09:07:02.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.116+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe96404c3c0 con 0x7fe964159890 2023-10-07T09:07:02.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.117+0000 7fe94bfff700 1 -- 172.21.15.46:0/1932898950 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17005 (secure 0 0 0) 0x7fe954018090 con 0x7fe964159890 2023-10-07T09:07:02.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:02.118 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":170,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:01.016493+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000308651.meta","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000308651"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 msgr2=0x7fe9500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 0x7fe9500697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9580093f0 tx=0x7fe958017000 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 msgr2=0x7fe964140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c7c0 tx=0x7fe954007f70 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 shutdown_connections 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe950067320 0x7fe9500697d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe96415db10 0x7fe9640b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964159890 0x7fe964140dc0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 --2- 172.21.15.46:0/1932898950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe964159c60 0x7fe9640b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 >> 172.21.15.46:0/1932898950 conn(0x7fe964068e20 msgr2=0x7fe964157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 shutdown_connections 2023-10-07T09:07:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.119+0000 7fe96a959700 1 -- 172.21.15.46:0/1932898950 wait complete. 2023-10-07T09:07:02.132 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:07:02.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:02.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:02.215 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:07:02.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.334+0000 7fc438bf2700 1 Processor -- start 2023-10-07T09:07:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.334+0000 7fc438bf2700 1 -- start start 2023-10-07T09:07:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc438bf2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4341593b0 0x7fc434159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc438bf2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340b1e50 0x7fc4340b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc438bf2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4340b6570 con 0x7fc4340ceaa0 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc438bf2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4340cfe20 con 0x7fc4341593b0 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc438bf2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340cf210 con 0x7fc4340b1e50 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4337fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4341593b0 0x7fc434159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc432ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc4340ceaa0 0x7fc4340b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36226/0 (socket says 172.21.15.46:36226) 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc432ffd700 1 -- 172.21.15.46:0/667639758 learned_addr learned my addr 172.21.15.46:0/667639758 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc433fff700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340b1e50 0x7fc4340b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4337fe700 1 -- 172.21.15.46:0/667639758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340b1e50 msgr2=0x7fc4340b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4337fe700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340b1e50 0x7fc4340b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4337fe700 1 -- 172.21.15.46:0/667639758 >> v1:172.21.15.46:6789/0 conn(0x7fc4340ceaa0 legacy=0x7fc4340b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4337fe700 1 -- 172.21.15.46:0/667639758 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340cf4f0 con 0x7fc4341593b0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.335+0000 7fc4327fc700 1 -- 172.21.15.46:0/667639758 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513980562 0 0) 0x7fc428001110 con 0x7fc4340ceaa0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc4337fe700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4341593b0 0x7fc434159780 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098e0 tx=0x7fc4240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95217b29bdb67ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc4327fc700 1 -- 172.21.15.46:0/667639758 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424009e80 con 0x7fc4341593b0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc4327fc700 1 -- 172.21.15.46:0/667639758 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42400b860 con 0x7fc4341593b0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc4327fc700 1 -- 172.21.15.46:0/667639758 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400bbe0 con 0x7fc4341593b0 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 -- 172.21.15.46:0/667639758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4341593b0 msgr2=0x7fc434159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4341593b0 0x7fc434159780 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098e0 tx=0x7fc4240091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 -- 172.21.15.46:0/667639758 shutdown_connections 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4340b1e50 0x7fc4340b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 --2- 172.21.15.46:0/667639758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4341593b0 0x7fc434159780 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 -- 172.21.15.46:0/667639758 >> 172.21.15.46:0/667639758 conn(0x7fc4340d1130 msgr2=0x7fc4340b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:02.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 -- 172.21.15.46:0/667639758 shutdown_connections 2023-10-07T09:07:02.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.336+0000 7fc438bf2700 1 -- 172.21.15.46:0/667639758 wait complete. 2023-10-07T09:07:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 Processor -- start 2023-10-07T09:07:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 -- start start 2023-10-07T09:07:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 0x7fc4340c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4341593b0 0x7fc4340c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340c9fa0 con 0x7fc4340b1e50 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434169de0 con 0x7fc4340ceaa0 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.338+0000 7fc438bf2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43416a0c0 con 0x7fc4341593b0 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50564/0 (socket says 172.21.15.46:50564) 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 -- 172.21.15.46:0/1927905145 learned_addr learned my addr 172.21.15.46:0/1927905145 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc433fff700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4341593b0 0x7fc4340c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc432ffd700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 0x7fc4340c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 -- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4341593b0 msgr2=0x7fc4340c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4341593b0 0x7fc4340c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 -- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 msgr2=0x7fc4340c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 0x7fc4340c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 -- 172.21.15.46:0/1927905145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009420 con 0x7fc4340b1e50 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc432ffd700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 0x7fc4340c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc4337fe700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc43406fe00 tx=0x7fc424017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400bbe0 con 0x7fc4340b1e50 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424011420 con 0x7fc4340b1e50 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43416a3a0 con 0x7fc4340b1e50 2023-10-07T09:07:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240117e0 con 0x7fc4340b1e50 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.339+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43416a960 con 0x7fc4340b1e50 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.340+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43416ab80 con 0x7fc4340b1e50 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.341+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc424011c10 con 0x7fc4340b1e50 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.341+0000 7fc41b7fe700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 0x7fc4200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.341+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fc424086350 con 0x7fc4340b1e50 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.341+0000 7fc432ffd700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 0x7fc4200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.342+0000 7fc432ffd700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 0x7fc4200697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc4340c9360 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.345+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc424052ef0 con 0x7fc4340b1e50 2023-10-07T09:07:02.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.583+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc43404c3c0 con 0x7fc4340b1e50 2023-10-07T09:07:02.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.584+0000 7fc41b7fe700 1 -- 172.21.15.46:0/1927905145 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4633 (secure 0 0 0) 0x7fc424056510 con 0x7fc4340b1e50 2023-10-07T09:07:02.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:02.585 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:07:00.012549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000308651","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 msgr2=0x7fc4200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 0x7fc4200697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc4340c9360 tx=0x7fc428009040 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 msgr2=0x7fc4340b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc43406fe00 tx=0x7fc424017000 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 shutdown_connections 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc420067320 0x7fc4200697d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4341593b0 0x7fc4340c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4340b1e50 0x7fc4340b4550 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 --2- 172.21.15.46:0/1927905145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340ceaa0 0x7fc4340c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 >> 172.21.15.46:0/1927905145 conn(0x7fc4340d1130 msgr2=0x7fc43415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:02.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 shutdown_connections 2023-10-07T09:07:02.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.586+0000 7fc438bf2700 1 -- 172.21.15.46:0/1927905145 wait complete. 2023-10-07T09:07:02.588 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 114 2023-10-07T09:07:02.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.717+0000 7f5a0fb07700 1 Processor -- start 2023-10-07T09:07:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.717+0000 7f5a0fb07700 1 -- start start 2023-10-07T09:07:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0fb07700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a08159890 0x7f5a0815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0fb07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 0x7f5a080699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0fb07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a08069ee0 con 0x7f5a08159c60 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0fb07700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0815a160 con 0x7f5a08159890 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0fb07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080d13a0 con 0x7f5a08069560 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0d8a3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a08159890 0x7f5a0815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0d8a3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a08159890 0x7f5a0815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50568/0 (socket says 172.21.15.46:50568) 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.718+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/1973548780 learned_addr learned my addr 172.21.15.46:0/1973548780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0e0a4700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 0x7f5a080699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/1973548780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 msgr2=0x7f5a080699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0d8a3700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 0x7f5a080699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/1973548780 >> v1:172.21.15.133:6789/0 conn(0x7f5a08159c60 legacy=0x7f5a0815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/1973548780 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0815e140 con 0x7f5a08159890 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0e0a4700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 0x7f5a080699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0d8a3700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08159890 0x7f5a0815abd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f59f80099b0 tx=0x7f59f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617f7676e8788e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0c8a1700 1 -- 172.21.15.46:0/1973548780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800b860 con 0x7f5a08159890 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0c8a1700 1 -- 172.21.15.46:0/1973548780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800b9c0 con 0x7f5a08159890 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.719+0000 7f5a0c8a1700 1 -- 172.21.15.46:0/1973548780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800bd60 con 0x7f5a08159890 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 -- 172.21.15.46:0/1973548780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08159890 msgr2=0x7f5a0815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08159890 0x7f5a0815abd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f59f80099b0 tx=0x7f59f8009250 comp rx=0 tx=0).stop 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 -- 172.21.15.46:0/1973548780 shutdown_connections 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08069560 0x7f5a080699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/1973548780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08159890 0x7f5a0815abd0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 -- 172.21.15.46:0/1973548780 >> 172.21.15.46:0/1973548780 conn(0x7f5a08068e20 msgr2=0x7f5a080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 -- 172.21.15.46:0/1973548780 shutdown_connections 2023-10-07T09:07:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.720+0000 7f5a0fb07700 1 -- 172.21.15.46:0/1973548780 wait complete. 2023-10-07T09:07:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.721+0000 7f5a0fb07700 1 Processor -- start 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.721+0000 7f5a0fb07700 1 -- start start 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a08159890 0x7f5a0816d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 0x7f5a08148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0816def0 con 0x7f5a08069560 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080b39a0 con 0x7f5a08159890 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080cefe0 con 0x7f5a08159c60 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50576/0 (socket says 172.21.15.46:50576) 2023-10-07T09:07:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/3200346560 learned_addr learned my addr 172.21.15.46:0/3200346560 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0e0a4700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 0x7f5a08148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d0a2700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a08159890 0x7f5a0816d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 msgr2=0x7f5a08148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 0x7f5a08148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a08159890 msgr2=0x7f5a0816d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a08159890 0x7f5a0816d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 -- 172.21.15.46:0/3200346560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80094f0 con 0x7f5a08069560 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0e0a4700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 0x7f5a08148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0d8a3700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009290 tx=0x7f59f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8026480 con 0x7f5a08069560 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f801f070 con 0x7f5a08069560 2023-10-07T09:07:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a080cea20 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.722+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8026830 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.723+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a080b3630 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.724+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0804c3c0 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.724+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59f8026ba0 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.724+0000 7f5a05ffb700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 0x7f59f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.725+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f59f8021070 con 0x7f5a08069560 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.725+0000 7f5a0d0a2700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 0x7f59f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.725+0000 7f5a0d0a2700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 0x7f59f40697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5a0815d130 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.729+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59f80537f0 con 0x7f5a08069560 2023-10-07T09:07:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.923+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0806a5b0 con 0x7f5a08069560 2023-10-07T09:07:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.924+0000 7f5a05ffb700 1 -- 172.21.15.46:0/3200346560 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17005 (secure 0 0 0) 0x7f59f8056e10 con 0x7f5a08069560 2023-10-07T09:07:02.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:02.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":170,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:01.016493+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000308651.meta","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000308651"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 msgr2=0x7f59f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 0x7f59f40697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5a0815d130 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2023-10-07T09:07:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 msgr2=0x7f5a08153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009290 tx=0x7f59f8017000 comp rx=0 tx=0).stop 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 shutdown_connections 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f59f4067320 0x7f59f40697d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a08159c60 0x7f5a08148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a08069560 0x7f5a08153860 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 --2- 172.21.15.46:0/3200346560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a08159890 0x7f5a0816d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 >> 172.21.15.46:0/3200346560 conn(0x7f5a08068e20 msgr2=0x7f5a08154200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 shutdown_connections 2023-10-07T09:07:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:02.926+0000 7f5a0fb07700 1 -- 172.21.15.46:0/3200346560 wait complete. 2023-10-07T09:07:02.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 28, 'pool_name': 'cephfs.volume_0000000000308651.meta', 'create_time': '2023-10-07T09:06:43.656247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000308651'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:06:44.229421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000308651'}}}, {'pool': 30, 'pool_name': 'another-data-pool', 'create_time': '2023-10-07T09:06:56.285093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000308651'}}}] 2023-10-07T09:07:02.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:07:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.061+0000 7fb619468700 1 Processor -- start 2023-10-07T09:07:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.061+0000 7fb619468700 1 -- start start 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb619468700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb6140b16d0 0x7fb6140b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb619468700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6140b33b0 0x7fb6140b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb619468700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140b2080 con 0x7fb6140b4e70 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb619468700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140cfb00 con 0x7fb6140b16d0 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb619468700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140b5c40 con 0x7fb6140b33b0 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb613fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6140b4e70 0x7fb6140ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36240/0 (socket says 172.21.15.46:36240) 2023-10-07T09:07:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb6140b16d0 0x7fb6140b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb613fff700 1 -- 172.21.15.46:0/673209745 learned_addr learned my addr 172.21.15.46:0/673209745 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb618c67700 1 --2- 172.21.15.46:0/673209745 >> v2:172.21.15.133:3300/0 conn(0x7fb6140b33b0 0x7fb6140b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 -- 172.21.15.46:0/673209745 >> v2:172.21.15.133:3300/0 conn(0x7fb6140b33b0 msgr2=0x7fb6140b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 --2- 172.21.15.46:0/673209745 >> v2:172.21.15.133:3300/0 conn(0x7fb6140b33b0 0x7fb6140b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 -- 172.21.15.46:0/673209745 >> v1:172.21.15.46:6789/0 conn(0x7fb6140b4e70 legacy=0x7fb6140ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 -- 172.21.15.46:0/673209745 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140b5f20 con 0x7fb6140b16d0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb612ffd700 1 -- 172.21.15.46:0/673209745 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672043287 0 0) 0x7fb6140b2080 con 0x7fb6140b4e70 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.062+0000 7fb6137fe700 1 --2- 172.21.15.46:0/673209745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b16d0 0x7fb6140b1b40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fb614071380 tx=0x7fb6080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02a79020836b8a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb612ffd700 1 -- 172.21.15.46:0/673209745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800b6b0 con 0x7fb6140b16d0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb612ffd700 1 -- 172.21.15.46:0/673209745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60800b810 con 0x7fb6140b16d0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb612ffd700 1 -- 172.21.15.46:0/673209745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800bbb0 con 0x7fb6140b16d0 2023-10-07T09:07:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 -- 172.21.15.46:0/673209745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b16d0 msgr2=0x7fb6140b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 --2- 172.21.15.46:0/673209745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b16d0 0x7fb6140b1b40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fb614071380 tx=0x7fb6080091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 -- 172.21.15.46:0/673209745 shutdown_connections 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 --2- 172.21.15.46:0/673209745 >> v2:172.21.15.133:3300/0 conn(0x7fb6140b33b0 0x7fb6140b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 --2- 172.21.15.46:0/673209745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b16d0 0x7fb6140b1b40 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 -- 172.21.15.46:0/673209745 >> 172.21.15.46:0/673209745 conn(0x7fb6140d10c0 msgr2=0x7fb6140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 -- 172.21.15.46:0/673209745 shutdown_connections 2023-10-07T09:07:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.063+0000 7fb619468700 1 -- 172.21.15.46:0/673209745 wait complete. 2023-10-07T09:07:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.064+0000 7fb619468700 1 Processor -- start 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.064+0000 7fb619468700 1 -- start start 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 0x7fb61416d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 0x7fb6141699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c7020 con 0x7fb6140b4e70 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c7270 con 0x7fb6140b33b0 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb619468700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c7550 con 0x7fb6140b16d0 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb618c67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb618c67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50598/0 (socket says 172.21.15.46:50598) 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.065+0000 7fb618c67700 1 -- 172.21.15.46:0/3644465833 learned_addr learned my addr 172.21.15.46:0/3644465833 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb613fff700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 0x7fb61416d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb6137fe700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 0x7fb6141699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 -- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 msgr2=0x7fb61416d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 0x7fb61416d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 -- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 msgr2=0x7fb6141699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 0x7fb6141699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 -- 172.21.15.46:0/3644465833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608009420 con 0x7fb6140b4e70 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb613fff700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 0x7fb61416d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb6137fe700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 0x7fb6141699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb618c67700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009fa0 tx=0x7fb60c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00ed20 con 0x7fb6140b4e70 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00ee80 con 0x7fb6140b4e70 2023-10-07T09:07:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c014670 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140c7830 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.066+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140c7e70 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.067+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb614088990 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.067+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb60c0149e0 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.068+0000 7fb5fbfff700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 0x7fb6000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.068+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb60c0855f0 con 0x7fb6140b4e70 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.068+0000 7fb613fff700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 0x7fb6000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.069+0000 7fb613fff700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 0x7fb6000697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb6040018d0 tx=0x7fb604009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.072+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb60c0520a0 con 0x7fb6140b4e70 2023-10-07T09:07:03.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.265+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb61404bb80 con 0x7fb6140b4e70 2023-10-07T09:07:03.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.265+0000 7fb5fbfff700 1 -- 172.21.15.46:0/3644465833 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb60c0556c0 con 0x7fb6140b4e70 2023-10-07T09:07:03.266 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:07:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 msgr2=0x7fb6000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 0x7fb6000697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb6040018d0 tx=0x7fb604009040 comp rx=0 tx=0).stop 2023-10-07T09:07:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 msgr2=0x7fb6140cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009fa0 tx=0x7fb60c009900 comp rx=0 tx=0).stop 2023-10-07T09:07:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 shutdown_connections 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb600067320 0x7fb6000697d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6140b4e70 0x7fb6140cb430 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6140b16d0 0x7fb61416d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 --2- 172.21.15.46:0/3644465833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140b33b0 0x7fb6141699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 >> 172.21.15.46:0/3644465833 conn(0x7fb6140d10c0 msgr2=0x7fb614069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 shutdown_connections 2023-10-07T09:07:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.267+0000 7fb619468700 1 -- 172.21.15.46:0/3644465833 wait complete. 2023-10-07T09:07:03.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000308651.meta pg_num 2023-10-07T09:07:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.401+0000 7fead0e44700 1 Processor -- start 2023-10-07T09:07:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.401+0000 7fead0e44700 1 -- start start 2023-10-07T09:07:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.402+0000 7fead0e44700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feacc069d60 0x7feacc0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.402+0000 7fead0e44700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feacc0c81f0 0x7feacc0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.402+0000 7fead0e44700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc06bdb0 con 0x7feacc0aca80 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.402+0000 7fead0e44700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc0cb370 con 0x7feacc069d60 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.402+0000 7fead0e44700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc159f60 con 0x7feacc0c81f0 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feacc069d60 0x7feacc0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feaca59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feacc0aca80 0x7feacc06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36248/0 (socket says 172.21.15.46:36248) 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feaca59c700 1 -- 172.21.15.46:0/2497421429 learned_addr learned my addr 172.21.15.46:0/2497421429 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 --2- 172.21.15.46:0/2497421429 >> v2:172.21.15.46:3300/0 conn(0x7feacc069d60 0x7feacc0c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50612/0 (socket says 172.21.15.46:50612) 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feacad9d700 1 --2- 172.21.15.46:0/2497421429 >> v2:172.21.15.133:3300/0 conn(0x7feacc0c81f0 0x7feacc0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 -- 172.21.15.46:0/2497421429 >> v2:172.21.15.133:3300/0 conn(0x7feacc0c81f0 msgr2=0x7feacc0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 --2- 172.21.15.46:0/2497421429 >> v2:172.21.15.133:3300/0 conn(0x7feacc0c81f0 0x7feacc0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 -- 172.21.15.46:0/2497421429 >> v1:172.21.15.46:6789/0 conn(0x7feacc0aca80 legacy=0x7feacc06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 -- 172.21.15.46:0/2497421429 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc06b2b0 con 0x7feacc069d60 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac959a700 1 -- 172.21.15.46:0/2497421429 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451591310 0 0) 0x7feacc06bdb0 con 0x7feacc0aca80 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac9d9b700 1 --2- 172.21.15.46:0/2497421429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc069d60 0x7feacc0c7cb0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feacc0b0190 tx=0x7feab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9058f9e3c19a4784 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac959a700 1 -- 172.21.15.46:0/2497421429 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400b6b0 con 0x7feacc069d60 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac959a700 1 -- 172.21.15.46:0/2497421429 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400b810 con 0x7feacc069d60 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.403+0000 7feac959a700 1 -- 172.21.15.46:0/2497421429 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400bbb0 con 0x7feacc069d60 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 -- 172.21.15.46:0/2497421429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc069d60 msgr2=0x7feacc0c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 --2- 172.21.15.46:0/2497421429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc069d60 0x7feacc0c7cb0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feacc0b0190 tx=0x7feab40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 -- 172.21.15.46:0/2497421429 shutdown_connections 2023-10-07T09:07:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 --2- 172.21.15.46:0/2497421429 >> v2:172.21.15.133:3300/0 conn(0x7feacc0c81f0 0x7feacc0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 --2- 172.21.15.46:0/2497421429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc069d60 0x7feacc0c7cb0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 -- 172.21.15.46:0/2497421429 >> 172.21.15.46:0/2497421429 conn(0x7feacc0cd670 msgr2=0x7feacc0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 -- 172.21.15.46:0/2497421429 shutdown_connections 2023-10-07T09:07:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.404+0000 7fead0e44700 1 -- 172.21.15.46:0/2497421429 wait complete. 2023-10-07T09:07:03.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.405+0000 7fead0e44700 1 Processor -- start 2023-10-07T09:07:03.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.405+0000 7fead0e44700 1 -- start start 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 0x7feacc0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feacc0aca80 0x7feacc0b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0afd40 con 0x7feacc0c81f0 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0acfb0 con 0x7feacc0aca80 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0ad250 con 0x7feacc069d60 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50624/0 (socket says 172.21.15.46:50624) 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 -- 172.21.15.46:0/10983651 learned_addr learned my addr 172.21.15.46:0/10983651 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feaca59c700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 0x7feacc0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feac9d9b700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feacc0aca80 0x7feacc0b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 -- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 msgr2=0x7feacc0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 0x7feacc0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 -- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feacc0aca80 msgr2=0x7feacc0b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feacc0aca80 0x7feacc0b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 -- 172.21.15.46:0/10983651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009420 con 0x7feacc0c81f0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feaca59c700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 0x7feacc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feacad9d700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7feabc00d860 tx=0x7feabc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0125f0 con 0x7feacc0c81f0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc012750 con 0x7feacc0c81f0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc0ad530 con 0x7feacc0c81f0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.406+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc012b10 con 0x7feacc0c81f0 2023-10-07T09:07:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.407+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc0b2d60 con 0x7feacc0c81f0 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.407+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc04c3c0 con 0x7feacc0c81f0 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.408+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feabc01e460 con 0x7feacc0c81f0 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.408+0000 7feac27fc700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 0x7feaac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.408+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7feabc0854a0 con 0x7feacc0c81f0 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.408+0000 7feaca59c700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 0x7feaac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.409+0000 7feaca59c700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 0x7feaac0697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feac4001fa0 tx=0x7feac4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.412+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feabc0559e0 con 0x7feacc0c81f0 2023-10-07T09:07:03.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.603+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000308651.meta", "var": "pg_num"} v 0) v1 -- 0x7feacc0678d0 con 0x7feacc0c81f0 2023-10-07T09:07:03.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.604+0000 7feac27fc700 1 -- 172.21.15.46:0/10983651 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000308651.meta", "var": "pg_num"}]=0 v170) v1 ==== 124+0+11 (secure 0 0 0) 0x7feabc055570 con 0x7feacc0c81f0 2023-10-07T09:07:03.604 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:07:03.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 msgr2=0x7feaac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 0x7feaac0697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feac4001fa0 tx=0x7feac4009040 comp rx=0 tx=0).stop 2023-10-07T09:07:03.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 msgr2=0x7feacc15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7feabc00d860 tx=0x7feabc008040 comp rx=0 tx=0).stop 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 shutdown_connections 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feaac067320 0x7feaac0697d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feacc0c81f0 0x7feacc15ade0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feacc069d60 0x7feacc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 --2- 172.21.15.46:0/10983651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feacc0aca80 0x7feacc0b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 >> 172.21.15.46:0/10983651 conn(0x7feacc0cd670 msgr2=0x7feacc0ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 shutdown_connections 2023-10-07T09:07:03.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.606+0000 7fead0e44700 1 -- 172.21.15.46:0/10983651 wait complete. 2023-10-07T09:07:03.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:07:03.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.740+0000 7f8f5345d700 1 Processor -- start 2023-10-07T09:07:03.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.740+0000 7f8f5345d700 1 -- start start 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f5345d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f4c0aca80 0x7f8f4c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f5345d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f5345d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c06bdb0 con 0x7f8f4c069d60 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f5345d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c0cb370 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f5345d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c159f60 con 0x7f8f4c0aca80 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f519fa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f509f8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8f4c069d60 0x7f8f4c0c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36262/0 (socket says 172.21.15.46:36262) 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f519fa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50632/0 (socket says 172.21.15.46:50632) 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f509f8700 1 -- 172.21.15.46:0/1979679395 learned_addr learned my addr 172.21.15.46:0/1979679395 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.741+0000 7f8f511f9700 1 --2- 172.21.15.46:0/1979679395 >> v2:172.21.15.133:3300/0 conn(0x7f8f4c0aca80 0x7f8f4c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f519fa700 1 -- 172.21.15.46:0/1979679395 >> v2:172.21.15.133:3300/0 conn(0x7f8f4c0aca80 msgr2=0x7f8f4c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f519fa700 1 --2- 172.21.15.46:0/1979679395 >> v2:172.21.15.133:3300/0 conn(0x7f8f4c0aca80 0x7f8f4c06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f519fa700 1 -- 172.21.15.46:0/1979679395 >> v1:172.21.15.46:6789/0 conn(0x7f8f4c069d60 legacy=0x7f8f4c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f519fa700 1 -- 172.21.15.46:0/1979679395 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c06b510 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f4bfff700 1 -- 172.21.15.46:0/1979679395 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314189882 0 0) 0x7f8f4c06bdb0 con 0x7f8f4c069d60 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f519fa700 1 --2- 172.21.15.46:0/1979679395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c06e570 tx=0x7f8f44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209b60d7ef78e989 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f4bfff700 1 -- 172.21.15.46:0/1979679395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400e070 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f4bfff700 1 -- 172.21.15.46:0/1979679395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400bb60 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.742+0000 7f8f4bfff700 1 -- 172.21.15.46:0/1979679395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44012430 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 -- 172.21.15.46:0/1979679395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c0c83c0 msgr2=0x7f8f4c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 --2- 172.21.15.46:0/1979679395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c06e570 tx=0x7f8f44009780 comp rx=0 tx=0).stop 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 -- 172.21.15.46:0/1979679395 shutdown_connections 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 --2- 172.21.15.46:0/1979679395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c0cb800 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 --2- 172.21.15.46:0/1979679395 >> v2:172.21.15.133:3300/0 conn(0x7f8f4c0aca80 0x7f8f4c06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 -- 172.21.15.46:0/1979679395 >> 172.21.15.46:0/1979679395 conn(0x7f8f4c0cd670 msgr2=0x7f8f4c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 -- 172.21.15.46:0/1979679395 shutdown_connections 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.743+0000 7f8f5345d700 1 -- 172.21.15.46:0/1979679395 wait complete. 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.744+0000 7f8f5345d700 1 Processor -- start 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.744+0000 7f8f5345d700 1 -- start start 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 0x7f8f4c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0ae820 con 0x7f8f4c069d60 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15dba0 con 0x7f8f4c0c83c0 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f5345d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0ae210 con 0x7f8f4c0aca80 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50644/0 (socket says 172.21.15.46:50644) 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 -- 172.21.15.46:0/3235342752 learned_addr learned my addr 172.21.15.46:0/3235342752 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f519fa700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f509f8700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 0x7f8f4c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 -- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 msgr2=0x7f8f4c15ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 0x7f8f4c15ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 -- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c0c83c0 msgr2=0x7f8f4c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c1577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 -- 172.21.15.46:0/3235342752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44009a20 con 0x7f8f4c069d60 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f509f8700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 0x7f8f4c15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f511f9700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00ec80 tx=0x7f8f3c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00c850 con 0x7f8f4c069d60 2023-10-07T09:07:03.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.745+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00c9b0 con 0x7f8f4c069d60 2023-10-07T09:07:03.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.746+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c0b3430 con 0x7f8f4c069d60 2023-10-07T09:07:03.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.746+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00cd30 con 0x7f8f4c069d60 2023-10-07T09:07:03.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.746+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c15d8c0 con 0x7f8f4c069d60 2023-10-07T09:07:03.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.746+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c04c3c0 con 0x7f8f4c069d60 2023-10-07T09:07:03.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.747+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f3c013680 con 0x7f8f4c069d60 2023-10-07T09:07:03.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.747+0000 7f8f497fa700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 0x7f8f380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:03.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.747+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f8f3c0854d0 con 0x7f8f4c069d60 2023-10-07T09:07:03.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.747+0000 7f8f509f8700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 0x7f8f380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:03.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.748+0000 7f8f509f8700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 0x7f8f380697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0c8390 tx=0x7f8f40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:03.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.751+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f3c051f80 con 0x7f8f4c069d60 2023-10-07T09:07:03.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.944+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f4c06b7f0 con 0x7f8f4c069d60 2023-10-07T09:07:03.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.945+0000 7f8f497fa700 1 -- 172.21.15.46:0/3235342752 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f3c0555a0 con 0x7f8f4c069d60 2023-10-07T09:07:03.946 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 msgr2=0x7f8f380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 0x7f8f380697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0c8390 tx=0x7f8f40009040 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 msgr2=0x7f8f4c0b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00ec80 tx=0x7f8f3c009120 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 shutdown_connections 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8f38067320 0x7f8f380697d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c0c83c0 0x7f8f4c1577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f4c069d60 0x7f8f4c0b2ef0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 --2- 172.21.15.46:0/3235342752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f4c0aca80 0x7f8f4c15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 >> 172.21.15.46:0/3235342752 conn(0x7f8f4c0cd670 msgr2=0x7f8f4c068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 shutdown_connections 2023-10-07T09:07:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:03.947+0000 7f8f5345d700 1 -- 172.21.15.46:0/3235342752 wait complete. 2023-10-07T09:07:03.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get another-data-pool pg_num 2023-10-07T09:07:04.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.081+0000 7fcb35764700 1 Processor -- start 2023-10-07T09:07:04.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.081+0000 7fcb35764700 1 -- start start 2023-10-07T09:07:04.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159c60 0x7fcb3015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb3015db10 0x7fcb30069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3015a160 con 0x7fcb30159890 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300d13a0 con 0x7fcb3015db10 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb35764700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3015e140 con 0x7fcb30159c60 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb2effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb2effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50652/0 (socket says 172.21.15.46:50652) 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.082+0000 7fcb2effd700 1 -- 172.21.15.46:0/574282372 learned_addr learned my addr 172.21.15.46:0/574282372 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2f7fe700 1 --2- 172.21.15.46:0/574282372 >> v2:172.21.15.133:3300/0 conn(0x7fcb3015db10 0x7fcb30069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2e7fc700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159c60 0x7fcb3015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 -- 172.21.15.46:0/574282372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159c60 msgr2=0x7fcb3015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159c60 0x7fcb3015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 -- 172.21.15.46:0/574282372 >> v2:172.21.15.133:3300/0 conn(0x7fcb3015db10 msgr2=0x7fcb30069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 --2- 172.21.15.46:0/574282372 >> v2:172.21.15.133:3300/0 conn(0x7fcb3015db10 0x7fcb30069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 -- 172.21.15.46:0/574282372 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3015a3d0 con 0x7fcb30159890 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2effd700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159890 0x7fcb3015abd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fcb30089b50 tx=0x7fcb28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a297bc00a8cbfa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2dffb700 1 -- 172.21.15.46:0/574282372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800b860 con 0x7fcb30159890 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2dffb700 1 -- 172.21.15.46:0/574282372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800b9c0 con 0x7fcb30159890 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb2dffb700 1 -- 172.21.15.46:0/574282372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800bd60 con 0x7fcb30159890 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 -- 172.21.15.46:0/574282372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159890 msgr2=0x7fcb3015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159890 0x7fcb3015abd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fcb30089b50 tx=0x7fcb28009250 comp rx=0 tx=0).stop 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 -- 172.21.15.46:0/574282372 shutdown_connections 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 --2- 172.21.15.46:0/574282372 >> v2:172.21.15.133:3300/0 conn(0x7fcb3015db10 0x7fcb30069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159890 0x7fcb3015abd0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 --2- 172.21.15.46:0/574282372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb30159c60 0x7fcb3015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.083+0000 7fcb35764700 1 -- 172.21.15.46:0/574282372 >> 172.21.15.46:0/574282372 conn(0x7fcb30068e20 msgr2=0x7fcb300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.084+0000 7fcb35764700 1 -- 172.21.15.46:0/574282372 shutdown_connections 2023-10-07T09:07:04.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.084+0000 7fcb35764700 1 -- 172.21.15.46:0/574282372 wait complete. 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.085+0000 7fcb35764700 1 Processor -- start 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.085+0000 7fcb35764700 1 -- start start 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159890 0x7fcb300b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3015db10 0x7fcb3015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30169c20 con 0x7fcb30159c60 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3016e100 con 0x7fcb30159890 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300b5940 con 0x7fcb3015db10 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50666/0 (socket says 172.21.15.46:50666) 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 -- 172.21.15.46:0/2035731434 learned_addr learned my addr 172.21.15.46:0/2035731434 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2f7fe700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3015db10 0x7fcb3015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2effd700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159890 0x7fcb300b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 -- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3015db10 msgr2=0x7fcb3015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3015db10 0x7fcb3015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 -- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159890 msgr2=0x7fcb300b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159890 0x7fcb300b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 -- 172.21.15.46:0/2035731434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280094f0 con 0x7fcb30159c60 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb2e7fc700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8b0 tx=0x7fcb18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011600 con 0x7fcb30159c60 2023-10-07T09:07:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18011780 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3016d210 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011b40 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.086+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3016d7d0 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.087+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3004c3c0 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.088+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb18021350 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.088+0000 7fcb26ffd700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 0x7fcb100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.088+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fcb18084b50 con 0x7fcb30159c60 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.088+0000 7fcb2effd700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 0x7fcb100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.089+0000 7fcb2effd700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 0x7fcb100697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcb30089b50 tx=0x7fcb28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.093+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb180514f0 con 0x7fcb30159c60 2023-10-07T09:07:04.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.283+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"} v 0) v1 -- 0x7fcb3006a5b0 con 0x7fcb30159c60 2023-10-07T09:07:04.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.284+0000 7fcb26ffd700 1 -- 172.21.15.46:0/2035731434 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"}]=0 v170) v1 ==== 106+0+11 (secure 0 0 0) 0x7fcb1801e020 con 0x7fcb30159c60 2023-10-07T09:07:04.284 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 msgr2=0x7fcb100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 0x7fcb100697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcb30089b50 tx=0x7fcb28017000 comp rx=0 tx=0).stop 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 msgr2=0x7fcb30147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8b0 tx=0x7fcb18008040 comp rx=0 tx=0).stop 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 shutdown_connections 2023-10-07T09:07:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcb10067320 0x7fcb100697d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3015db10 0x7fcb3015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb30159890 0x7fcb300b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 --2- 172.21.15.46:0/2035731434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb30159c60 0x7fcb30147160 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 >> 172.21.15.46:0/2035731434 conn(0x7fcb30068e20 msgr2=0x7fcb30152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 shutdown_connections 2023-10-07T09:07:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.286+0000 7fcb35764700 1 -- 172.21.15.46:0/2035731434 wait complete. 2023-10-07T09:07:04.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 Processor -- start 2023-10-07T09:07:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 -- start start 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4e0159890 0x7fc4e015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4e0069560 0x7fc4e00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e0069ee0 con 0x7fc4e0159c60 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e015a160 con 0x7fc4e0069560 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.417+0000 7fc4e56f5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00d13a0 con 0x7fc4e0159890 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4e0069560 0x7fc4e00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4de7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc4e0159c60 0x7fc4e015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36266/0 (socket says 172.21.15.46:36266) 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4de7fc700 1 -- 172.21.15.46:0/2421816090 learned_addr learned my addr 172.21.15.46:0/2421816090 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:04.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4deffd700 1 --2- 172.21.15.46:0/2421816090 >> v2:172.21.15.133:3300/0 conn(0x7fc4e0159890 0x7fc4e015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4ddffb700 1 -- 172.21.15.46:0/2421816090 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590189777 0 0) 0x7fc4e0069ee0 con 0x7fc4e0159c60 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4ddffb700 1 -- 172.21.15.46:0/2421816090 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4cc003570 con 0x7fc4e0159c60 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 -- 172.21.15.46:0/2421816090 >> v2:172.21.15.133:3300/0 conn(0x7fc4e0159890 msgr2=0x7fc4e015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 --2- 172.21.15.46:0/2421816090 >> v2:172.21.15.133:3300/0 conn(0x7fc4e0159890 0x7fc4e015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 -- 172.21.15.46:0/2421816090 >> v1:172.21.15.46:6789/0 conn(0x7fc4e0159c60 legacy=0x7fc4e015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 -- 172.21.15.46:0/2421816090 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e015e140 con 0x7fc4e0069560 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4df7fe700 1 --2- 172.21.15.46:0/2421816090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00699a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00d1090 tx=0x7fc4d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c796c5e9d8fb863 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4ddffb700 1 -- 172.21.15.46:0/2421816090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011630 con 0x7fc4e0069560 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4ddffb700 1 -- 172.21.15.46:0/2421816090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d8011790 con 0x7fc4e0069560 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.418+0000 7fc4ddffb700 1 -- 172.21.15.46:0/2421816090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011b30 con 0x7fc4e0069560 2023-10-07T09:07:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 -- 172.21.15.46:0/2421816090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 msgr2=0x7fc4e00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/2421816090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00699a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00d1090 tx=0x7fc4d80091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 -- 172.21.15.46:0/2421816090 shutdown_connections 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/2421816090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00699a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/2421816090 >> v2:172.21.15.133:3300/0 conn(0x7fc4e0159890 0x7fc4e015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 -- 172.21.15.46:0/2421816090 >> 172.21.15.46:0/2421816090 conn(0x7fc4e0068e20 msgr2=0x7fc4e00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 -- 172.21.15.46:0/2421816090 shutdown_connections 2023-10-07T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.419+0000 7fc4e56f5700 1 -- 172.21.15.46:0/2421816090 wait complete. 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.420+0000 7fc4e56f5700 1 Processor -- start 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.420+0000 7fc4e56f5700 1 -- start start 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 0x7fc4e015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4e0159c60 0x7fc4e00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00ce4b0 con 0x7fc4e0069560 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cdb60 con 0x7fc4e0159890 2023-10-07T09:07:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cde40 con 0x7fc4e0159c60 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50680/0 (socket says 172.21.15.46:50680) 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 -- 172.21.15.46:0/1390465081 learned_addr learned my addr 172.21.15.46:0/1390465081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4de7fc700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 0x7fc4e015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4df7fe700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4e0159c60 0x7fc4e00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 -- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4e0159c60 msgr2=0x7fc4e00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4e0159c60 0x7fc4e00cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 -- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 msgr2=0x7fc4e015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 0x7fc4e015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 -- 172.21.15.46:0/1390465081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8009420 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4de7fc700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 0x7fc4e015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4deffd700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000e190 tx=0x7fc4d0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000ee30 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0014420 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00ce750 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.421+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00147e0 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.422+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e016d650 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.423+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00d1560 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.423+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc4d0014b90 con 0x7fc4e0069560 2023-10-07T09:07:04.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.423+0000 7fc4d6ffd700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 0x7fc4c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.423+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fc4d00856c0 con 0x7fc4e0069560 2023-10-07T09:07:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.423+0000 7fc4de7fc700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 0x7fc4c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.424+0000 7fc4de7fc700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 0x7fc4c00697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc4e015d340 tx=0x7fc4c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.427+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4d0052170 con 0x7fc4e0069560 2023-10-07T09:07:04.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.667+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4e004c3c0 con 0x7fc4e0069560 2023-10-07T09:07:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.667+0000 7fc4d6ffd700 1 -- 172.21.15.46:0/1390465081 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4633 (secure 0 0 0) 0x7fc4d0009a60 con 0x7fc4e0069560 2023-10-07T09:07:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:04.668 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:07:00.012549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000308651","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:07:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 msgr2=0x7fc4c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 0x7fc4c00697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc4e015d340 tx=0x7fc4c8009040 comp rx=0 tx=0).stop 2023-10-07T09:07:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 msgr2=0x7fc4e00b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000e190 tx=0x7fc4d0009920 comp rx=0 tx=0).stop 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 shutdown_connections 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc4c0067320 0x7fc4c00697d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4e0159c60 0x7fc4e00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4e0069560 0x7fc4e00b37a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 --2- 172.21.15.46:0/1390465081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4e0159890 0x7fc4e015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 >> 172.21.15.46:0/1390465081 conn(0x7fc4e0068e20 msgr2=0x7fc4e0149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 shutdown_connections 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.669+0000 7fc4e56f5700 1 -- 172.21.15.46:0/1390465081 wait complete. 2023-10-07T09:07:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 114 2023-10-07T09:07:04.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.800+0000 7f2a42cb5700 1 Processor -- start 2023-10-07T09:07:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.800+0000 7f2a42cb5700 1 -- start start 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a42cb5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a3c06c0a0 0x7f2a3c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a42cb5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c15d7e0 con 0x7f2a3c15df50 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a42cb5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c15dac0 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a42cb5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c15aa30 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a41252700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2a3c15df50 0x7f2a3c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36270/0 (socket says 172.21.15.46:36270) 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a41252700 1 -- 172.21.15.46:0/3349812261 learned_addr learned my addr 172.21.15.46:0/3349812261 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.801+0000 7f2a3bfff700 1 --2- 172.21.15.46:0/3349812261 >> v2:172.21.15.133:3300/0 conn(0x7f2a3c06c0a0 0x7f2a3c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140349692 0 0) 0x7f2a3c15d7e0 con 0x7f2a3c15df50 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a24003570 con 0x7f2a3c15df50 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796998777 0 0) 0x7f2a3c15dac0 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c15d7e0 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3bfff700 1 -- 172.21.15.46:0/3349812261 >> v1:172.21.15.133:6789/0 conn(0x7f2a3c06bcd0 legacy=0x7f2a3c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3bfff700 1 -- 172.21.15.46:0/3349812261 >> v1:172.21.15.46:6789/0 conn(0x7f2a3c15df50 legacy=0x7f2a3c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3bfff700 1 -- 172.21.15.46:0/3349812261 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c15ad10 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3bfff700 1 --2- 172.21.15.46:0/3349812261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c06c0a0 0x7f2a3c0caa90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2a300098e0 tx=0x7f2a300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba94de941d3079 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011630 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30011790 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.802+0000 7f2a3b7fe700 1 -- 172.21.15.46:0/3349812261 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011b30 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 -- 172.21.15.46:0/3349812261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c06c0a0 msgr2=0x7f2a3c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/3349812261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c06c0a0 0x7f2a3c0caa90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2a300098e0 tx=0x7f2a300091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 -- 172.21.15.46:0/3349812261 shutdown_connections 2023-10-07T09:07:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/3349812261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c06c0a0 0x7f2a3c0caa90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 -- 172.21.15.46:0/3349812261 >> 172.21.15.46:0/3349812261 conn(0x7f2a3c0ce600 msgr2=0x7f2a3c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 -- 172.21.15.46:0/3349812261 shutdown_connections 2023-10-07T09:07:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.803+0000 7f2a42cb5700 1 -- 172.21.15.46:0/3349812261 wait complete. 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.804+0000 7f2a42cb5700 1 Processor -- start 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.804+0000 7f2a42cb5700 1 -- start start 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a3c06c0a0 0x7f2a3c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 0x7f2a3c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b18b0 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c83a0 con 0x7f2a3c15df50 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a42cb5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c8680 con 0x7f2a3c06c0a0 2023-10-07T09:07:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50694/0 (socket says 172.21.15.46:50694) 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 -- 172.21.15.46:0/1071512245 learned_addr learned my addr 172.21.15.46:0/1071512245 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a41252700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 0x7f2a3c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a3bfff700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a3c06c0a0 0x7f2a3c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 -- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a3c06c0a0 msgr2=0x7f2a3c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a3c06c0a0 0x7f2a3c0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 -- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 msgr2=0x7f2a3c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 0x7f2a3c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 -- 172.21.15.46:0/1071512245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30009420 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a41252700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 0x7f2a3c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.805+0000 7f2a40a51700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00c580 tx=0x7f2a2c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.806+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c010510 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.806+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c010670 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.806+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c0b1540 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.806+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c010a30 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.806+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c14f810 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.807+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0b13a0 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.807+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2a2c01b400 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.807+0000 7f2a38ff9700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 0x7f2a280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.807+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f2a2c084b70 con 0x7f2a3c06bcd0 2023-10-07T09:07:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.808+0000 7f2a3bfff700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 0x7f2a280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.808+0000 7f2a3bfff700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 0x7f2a280697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2a300093f0 tx=0x7f2a30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:04.812+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a3c0b13a0 con 0x7f2a3c06bcd0 2023-10-07T09:07:05.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.007+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a3c0b13a0 con 0x7f2a3c06bcd0 2023-10-07T09:07:05.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.008+0000 7f2a38ff9700 1 -- 172.21.15.46:0/1071512245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17005 (secure 0 0 0) 0x7f2a3c0b13a0 con 0x7f2a3c06bcd0 2023-10-07T09:07:05.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:05.009 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":170,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:01.016493+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000308651.meta","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000308651"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 msgr2=0x7f2a280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 0x7f2a280697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2a300093f0 tx=0x7f2a30017000 comp rx=0 tx=0).stop 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 msgr2=0x7f2a3c0c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00c580 tx=0x7f2a2c007e10 comp rx=0 tx=0).stop 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 shutdown_connections 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a28067320 0x7f2a280697d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15df50 0x7f2a3c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a3c06bcd0 0x7f2a3c0c7da0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 --2- 172.21.15.46:0/1071512245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a3c06c0a0 0x7f2a3c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 >> 172.21.15.46:0/1071512245 conn(0x7f2a3c0ce600 msgr2=0x7f2a3c15a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 shutdown_connections 2023-10-07T09:07:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.010+0000 7f2a42cb5700 1 -- 172.21.15.46:0/1071512245 wait complete. 2023-10-07T09:07:05.023 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000308651 and related pools 2023-10-07T09:07:05.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:05.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.142+0000 7f92c9f38700 1 Processor -- start 2023-10-07T09:07:05.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.142+0000 7f92c9f38700 1 -- start start 2023-10-07T09:07:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 0x7f92c4063230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92c406e8c0 0x7f92c40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 0x7f92c415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40c8ac0 con 0x7f92c406e8c0 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c415aa30 con 0x7f92c40c8660 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9f38700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415a100 con 0x7f92c4153df0 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92c406e8c0 0x7f92c40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f92c406e8c0 0x7f92c40c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50704/0 (socket says 172.21.15.46:50704) 2023-10-07T09:07:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 -- 172.21.15.46:0/1821471560 learned_addr learned my addr 172.21.15.46:0/1821471560 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9737700 1 --2- 172.21.15.46:0/1821471560 >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 0x7f92c415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c8f36700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 0x7f92c4063230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 -- 172.21.15.46:0/1821471560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 msgr2=0x7f92c4063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 0x7f92c4063230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 -- 172.21.15.46:0/1821471560 >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 msgr2=0x7f92c415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 --2- 172.21.15.46:0/1821471560 >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 0x7f92c415d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c3fff700 1 -- 172.21.15.46:0/1821471560 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c415a3e0 con 0x7f92c406e8c0 2023-10-07T09:07:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c8f36700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 0x7f92c4063230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.143+0000 7f92c9737700 1 --2- 172.21.15.46:0/1821471560 >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 0x7f92c415d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c3fff700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c406e8c0 0x7f92c40c8120 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f92c40c8e50 tx=0x7f92b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481dbdb790af0e1d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c37fe700 1 -- 172.21.15.46:0/1821471560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800b860 con 0x7f92c406e8c0 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c37fe700 1 -- 172.21.15.46:0/1821471560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800b9c0 con 0x7f92c406e8c0 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c37fe700 1 -- 172.21.15.46:0/1821471560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800bd60 con 0x7f92c406e8c0 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 -- 172.21.15.46:0/1821471560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c406e8c0 msgr2=0x7f92c40c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c406e8c0 0x7f92c40c8120 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f92c40c8e50 tx=0x7f92b8009250 comp rx=0 tx=0).stop 2023-10-07T09:07:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 -- 172.21.15.46:0/1821471560 shutdown_connections 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 --2- 172.21.15.46:0/1821471560 >> v2:172.21.15.133:3300/0 conn(0x7f92c40c8660 0x7f92c415d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c4153df0 0x7f92c4063230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 --2- 172.21.15.46:0/1821471560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c406e8c0 0x7f92c40c8120 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 -- 172.21.15.46:0/1821471560 >> 172.21.15.46:0/1821471560 conn(0x7f92c406ddb0 msgr2=0x7f92c406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 -- 172.21.15.46:0/1821471560 shutdown_connections 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.144+0000 7f92c9f38700 1 -- 172.21.15.46:0/1821471560 wait complete. 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.145+0000 7f92c9f38700 1 Processor -- start 2023-10-07T09:07:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 -- start start 2023-10-07T09:07:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c406e8c0 0x7f92c414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c4153df0 0x7f92c41699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4150920 con 0x7f92c40c8660 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4140ae0 con 0x7f92c4153df0 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c9f38700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41541c0 con 0x7f92c406e8c0 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.146+0000 7f92c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50718/0 (socket says 172.21.15.46:50718) 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 -- 172.21.15.46:0/3690154003 learned_addr learned my addr 172.21.15.46:0/3690154003 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c8f36700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c406e8c0 0x7f92c414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c9737700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c4153df0 0x7f92c41699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 -- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c406e8c0 msgr2=0x7f92c414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c406e8c0 0x7f92c414c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 -- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c4153df0 msgr2=0x7f92c41699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c4153df0 0x7f92c41699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 -- 172.21.15.46:0/3690154003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80094f0 con 0x7f92c40c8660 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c3fff700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f92c406c7f0 tx=0x7f92b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8011dc0 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8024440 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8024800 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c41544a0 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.147+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c416a4b0 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.148+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4154630 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.149+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f92b801a420 con 0x7f92c40c8660 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.149+0000 7f92c0ff9700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 0x7f92b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.149+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f92b8086d60 con 0x7f92c40c8660 2023-10-07T09:07:05.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.149+0000 7f92c8f36700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 0x7f92b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.150+0000 7f92c8f36700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 0x7f92b00697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00f600 tx=0x7f92bc0077b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.153+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92b8053810 con 0x7f92c40c8660 2023-10-07T09:07:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.388+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92c415a6c0 con 0x7f92c40c8660 2023-10-07T09:07:05.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.389+0000 7f92c0ff9700 1 -- 172.21.15.46:0/3690154003 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4633 (secure 0 0 0) 0x7f92b8056e30 con 0x7f92c40c8660 2023-10-07T09:07:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:05.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:07:00.012549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000308651","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 msgr2=0x7f92b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 0x7f92b00697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00f600 tx=0x7f92bc0077b0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 msgr2=0x7f92c41405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f92c406c7f0 tx=0x7f92b8017000 comp rx=0 tx=0).stop 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 shutdown_connections 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f92b0067320 0x7f92b00697d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c4153df0 0x7f92c41699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92c406e8c0 0x7f92c414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 --2- 172.21.15.46:0/3690154003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92c40c8660 0x7f92c41405a0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 >> 172.21.15.46:0/3690154003 conn(0x7f92c406ddb0 msgr2=0x7f92c414e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 shutdown_connections 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.391+0000 7f92c9f38700 1 -- 172.21.15.46:0/3690154003 wait complete. 2023-10-07T09:07:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 114 2023-10-07T09:07:05.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.523+0000 7f6c5abf9700 1 Processor -- start 2023-10-07T09:07:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.523+0000 7f6c5abf9700 1 -- start start 2023-10-07T09:07:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c5abf9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c54159420 0x7f6c540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c5abf9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540b2980 con 0x7f6c5415d230 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c5abf9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540b11d0 con 0x7f6c541597f0 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c5abf9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540b14b0 con 0x7f6c54159420 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c59bf7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c54159420 0x7f6c540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c59bf7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c54159420 0x7f6c540b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50728/0 (socket says 172.21.15.46:50728) 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c59bf7700 1 -- 172.21.15.46:0/213727780 learned_addr learned my addr 172.21.15.46:0/213727780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c5a3f8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6c5415d230 0x7f6c5415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36286/0 (socket says 172.21.15.46:36286) 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c59bf7700 1 -- 172.21.15.46:0/213727780 >> v1:172.21.15.133:6789/0 conn(0x7f6c541597f0 legacy=0x7f6c540b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.524+0000 7f6c59bf7700 1 -- 172.21.15.46:0/213727780 >> v1:172.21.15.46:6789/0 conn(0x7f6c5415d230 legacy=0x7f6c5415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c59bf7700 1 -- 172.21.15.46:0/213727780 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b1790 con 0x7f6c54159420 2023-10-07T09:07:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c59bf7700 1 --2- 172.21.15.46:0/213727780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540b5f40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009f20 tx=0x7f6c44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef79f1221fa7e19b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c58bf5700 1 -- 172.21.15.46:0/213727780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400e070 con 0x7f6c54159420 2023-10-07T09:07:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c58bf5700 1 -- 172.21.15.46:0/213727780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400ba80 con 0x7f6c54159420 2023-10-07T09:07:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c58bf5700 1 -- 172.21.15.46:0/213727780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440092e0 con 0x7f6c54159420 2023-10-07T09:07:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 -- 172.21.15.46:0/213727780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 msgr2=0x7f6c540b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/213727780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540b5f40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009f20 tx=0x7f6c44009840 comp rx=0 tx=0).stop 2023-10-07T09:07:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 -- 172.21.15.46:0/213727780 shutdown_connections 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/213727780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540b5f40 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 -- 172.21.15.46:0/213727780 >> 172.21.15.46:0/213727780 conn(0x7f6c540d0660 msgr2=0x7f6c540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.525+0000 7f6c5abf9700 1 -- 172.21.15.46:0/213727780 shutdown_connections 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.526+0000 7f6c5abf9700 1 -- 172.21.15.46:0/213727780 wait complete. 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 Processor -- start 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 -- start start 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c541597f0 0x7f6c541552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c5415d230 0x7f6c54158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c6bc0 con 0x7f6c54159420 2023-10-07T09:07:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540cbb00 con 0x7f6c541597f0 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c5abf9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c5fb0 con 0x7f6c5415d230 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c59bf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c59bf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50730/0 (socket says 172.21.15.46:50730) 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.527+0000 7f6c59bf7700 1 -- 172.21.15.46:0/3395522771 learned_addr learned my addr 172.21.15.46:0/3395522771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c593f6700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c541597f0 0x7f6c541552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c5a3f8700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c5415d230 0x7f6c54158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 -- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c5415d230 msgr2=0x7f6c54158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c5415d230 0x7f6c54158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 -- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c541597f0 msgr2=0x7f6c541552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c541597f0 0x7f6c541552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 -- 172.21.15.46:0/3395522771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44009ae0 con 0x7f6c54159420 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c59bf7700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6c54089340 tx=0x7f6c44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44008bb0 con 0x7f6c54159420 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44008d10 con 0x7f6c54159420 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540c6290 con 0x7f6c54159420 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440266b0 con 0x7f6c54159420 2023-10-07T09:07:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.528+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540c6850 con 0x7f6c54159420 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.529+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540c69e0 con 0x7f6c54159420 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.530+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6c44003040 con 0x7f6c54159420 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.530+0000 7f6c51ffb700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 0x7f6c400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.530+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f6c44086890 con 0x7f6c54159420 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.530+0000 7f6c593f6700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 0x7f6c400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.531+0000 7f6c593f6700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 0x7f6c400697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406a1b0 tx=0x7f6c48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.534+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c44053230 con 0x7f6c54159420 2023-10-07T09:07:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.773+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c5404c3c0 con 0x7f6c54159420 2023-10-07T09:07:05.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.773+0000 7f6c51ffb700 1 -- 172.21.15.46:0/3395522771 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4633 (secure 0 0 0) 0x7f6c44056850 con 0x7f6c54159420 2023-10-07T09:07:05.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:05.774 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:06:45.262830+0000","modified":"2023-10-07T09:07:00.012549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1247947515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1247947515},{"type":"v1","addr":"172.21.15.46:6835","nonce":1247947515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000308651","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 msgr2=0x7f6c400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 0x7f6c400697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406a1b0 tx=0x7f6c48009040 comp rx=0 tx=0).stop 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 msgr2=0x7f6c540cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6c54089340 tx=0x7f6c44018000 comp rx=0 tx=0).stop 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 shutdown_connections 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f6c40067320 0x7f6c400697d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c5415d230 0x7f6c54158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c54159420 0x7f6c540cb5c0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 --2- 172.21.15.46:0/3395522771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c541597f0 0x7f6c541552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 >> 172.21.15.46:0/3395522771 conn(0x7f6c540d0660 msgr2=0x7f6c540b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 shutdown_connections 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.775+0000 7f6c5abf9700 1 -- 172.21.15.46:0/3395522771 wait complete. 2023-10-07T09:07:05.777 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 114 2023-10-07T09:07:05.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.906+0000 7ff92412c700 1 Processor -- start 2023-10-07T09:07:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.906+0000 7ff92412c700 1 -- start start 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff91c159890 0x7ff91c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159c60 0x7ff91c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff91c15db10 0x7ff91c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c15a160 con 0x7ff91c15db10 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c0d13a0 con 0x7ff91c159890 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff92412c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c15e140 con 0x7ff91c159c60 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff9226c9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff91c15db10 0x7ff91c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff9216c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159c60 0x7ff91c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff9226c9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff91c15db10 0x7ff91c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50746/0 (socket says 172.21.15.46:50746) 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff9226c9700 1 -- 172.21.15.46:0/3374759149 learned_addr learned my addr 172.21.15.46:0/3374759149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.907+0000 7ff921ec8700 1 --2- 172.21.15.46:0/3374759149 >> v2:172.21.15.133:3300/0 conn(0x7ff91c159890 0x7ff91c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 -- 172.21.15.46:0/3374759149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159c60 msgr2=0x7ff91c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 --2- 172.21.15.46:0/3374759149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159c60 0x7ff91c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 -- 172.21.15.46:0/3374759149 >> v2:172.21.15.133:3300/0 conn(0x7ff91c159890 msgr2=0x7ff91c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 --2- 172.21.15.46:0/3374759149 >> v2:172.21.15.133:3300/0 conn(0x7ff91c159890 0x7ff91c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 -- 172.21.15.46:0/3374759149 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c15a3d0 con 0x7ff91c15db10 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff9226c9700 1 --2- 172.21.15.46:0/3374759149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c15db10 0x7ff91c069560 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0d1090 tx=0x7ff90c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cff6e585772197 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff920ec6700 1 -- 172.21.15.46:0/3374759149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00e070 con 0x7ff91c15db10 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff920ec6700 1 -- 172.21.15.46:0/3374759149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00b970 con 0x7ff91c15db10 2023-10-07T09:07:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.908+0000 7ff920ec6700 1 -- 172.21.15.46:0/3374759149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0092e0 con 0x7ff91c15db10 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 -- 172.21.15.46:0/3374759149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c15db10 msgr2=0x7ff91c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 --2- 172.21.15.46:0/3374759149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c15db10 0x7ff91c069560 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0d1090 tx=0x7ff90c009840 comp rx=0 tx=0).stop 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 -- 172.21.15.46:0/3374759149 shutdown_connections 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 --2- 172.21.15.46:0/3374759149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c15db10 0x7ff91c069560 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 --2- 172.21.15.46:0/3374759149 >> v2:172.21.15.133:3300/0 conn(0x7ff91c159890 0x7ff91c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 --2- 172.21.15.46:0/3374759149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159c60 0x7ff91c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 -- 172.21.15.46:0/3374759149 >> 172.21.15.46:0/3374759149 conn(0x7ff91c068e20 msgr2=0x7ff91c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 -- 172.21.15.46:0/3374759149 shutdown_connections 2023-10-07T09:07:05.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.909+0000 7ff92412c700 1 -- 172.21.15.46:0/3374759149 wait complete. 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.910+0000 7ff92412c700 1 Processor -- start 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.910+0000 7ff92412c700 1 -- start start 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159890 0x7ff91c0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91c15db10 0x7ff91c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c153e70 con 0x7ff91c159c60 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c153860 con 0x7ff91c15db10 2023-10-07T09:07:05.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c0cfbc0 con 0x7ff91c159890 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50760/0 (socket says 172.21.15.46:50760) 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 -- 172.21.15.46:0/141602003 learned_addr learned my addr 172.21.15.46:0/141602003 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff921ec8700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159890 0x7ff91c0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 -- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159890 msgr2=0x7ff91c0b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9226c9700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91c15db10 0x7ff91c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159890 0x7ff91c0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 -- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91c15db10 msgr2=0x7ff91c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91c15db10 0x7ff91c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 -- 172.21.15.46:0/141602003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009ae0 con 0x7ff91c159c60 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff9216c7700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ec50 tx=0x7ff9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000c9d0 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000cb30 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c153b00 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.911+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910013470 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.912+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c151010 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.913+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c04c3c0 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.913+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff910013860 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.913+0000 7ff919ffb700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 0x7ff9080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.913+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ff910085210 con 0x7ff91c159c60 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.914+0000 7ff921ec8700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 0x7ff9080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:05.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.914+0000 7ff921ec8700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 0x7ff9080697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9140093f0 tx=0x7ff914008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:05.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:05.918+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff910051cc0 con 0x7ff91c159c60 2023-10-07T09:07:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.114+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff91c153fb0 con 0x7ff91c159c60 2023-10-07T09:07:06.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.115+0000 7ff919ffb700 1 -- 172.21.15.46:0/141602003 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17005 (secure 0 0 0) 0x7ff9100552e0 con 0x7ff91c159c60 2023-10-07T09:07:06.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:06.116 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":170,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:01.016493+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000308651.meta","create_time":"2023-10-07T09:06:43.656247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000308651"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-07T09:06:44.229421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-07T09:06:56.285093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000308651"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:06.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 msgr2=0x7ff9080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 0x7ff9080697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9140093f0 tx=0x7ff914008040 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 msgr2=0x7ff91c0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ec50 tx=0x7ff9100091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 shutdown_connections 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff908067320 0x7ff9080697d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91c15db10 0x7ff91c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff91c159890 0x7ff91c0b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 --2- 172.21.15.46:0/141602003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff91c159c60 0x7ff91c0cf0b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 >> 172.21.15.46:0/141602003 conn(0x7ff91c068e20 msgr2=0x7ff91c152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 shutdown_connections 2023-10-07T09:07:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.117+0000 7ff92412c700 1 -- 172.21.15.46:0/141602003 wait complete. 2023-10-07T09:07:06.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000308651 2023-10-07T09:07:06.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.250+0000 7f2c8359e700 1 Processor -- start 2023-10-07T09:07:06.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.250+0000 7f2c8359e700 1 -- start start 2023-10-07T09:07:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c8359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c841597f0 0x7f2c840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c8359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c8415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c8359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8415dbb0 con 0x7f2c84159420 2023-10-07T09:07:06.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c8359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c840b11d0 con 0x7f2c841597f0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c8359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b14b0 con 0x7f2c8415d230 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c841597f0 0x7f2c840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c841597f0 0x7f2c840b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50770/0 (socket says 172.21.15.46:50770) 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 -- 172.21.15.46:0/3259516817 learned_addr learned my addr 172.21.15.46:0/3259516817 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c82d9d700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c8415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 -- 172.21.15.46:0/3259516817 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 msgr2=0x7f2c8415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c8415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 -- 172.21.15.46:0/3259516817 >> v1:172.21.15.133:6789/0 conn(0x7f2c84159420 legacy=0x7f2c840b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 -- 172.21.15.46:0/3259516817 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840b1790 con 0x7f2c841597f0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.251+0000 7f2c81d9b700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c840b2270 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2c780099b0 tx=0x7f2c78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1995f77b23271fe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8159a700 1 -- 172.21.15.46:0/3259516817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78009ea0 con 0x7f2c841597f0 2023-10-07T09:07:06.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8159a700 1 -- 172.21.15.46:0/3259516817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7800b860 con 0x7f2c841597f0 2023-10-07T09:07:06.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8159a700 1 -- 172.21.15.46:0/3259516817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800bc00 con 0x7f2c841597f0 2023-10-07T09:07:06.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 -- 172.21.15.46:0/3259516817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 msgr2=0x7f2c840b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c840b2270 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2c780099b0 tx=0x7f2c78009250 comp rx=0 tx=0).stop 2023-10-07T09:07:06.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 -- 172.21.15.46:0/3259516817 shutdown_connections 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c8415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 --2- 172.21.15.46:0/3259516817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c840b2270 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 -- 172.21.15.46:0/3259516817 >> 172.21.15.46:0/3259516817 conn(0x7f2c840d0660 msgr2=0x7f2c840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 -- 172.21.15.46:0/3259516817 shutdown_connections 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.252+0000 7f2c8359e700 1 -- 172.21.15.46:0/3259516817 wait complete. 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.253+0000 7f2c8359e700 1 Processor -- start 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.253+0000 7f2c8359e700 1 -- start start 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c84159420 0x7f2c840c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c84155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c9120 con 0x7f2c841597f0 2023-10-07T09:07:06.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c5950 con 0x7f2c84159420 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c5c30 con 0x7f2c8415d230 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c81d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c81d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50780/0 (socket says 172.21.15.46:50780) 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c81d9b700 1 -- 172.21.15.46:0/2214393926 learned_addr learned my addr 172.21.15.46:0/2214393926 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c82d9d700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c84155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.254+0000 7f2c8259c700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c84159420 0x7f2c840c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 -- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 msgr2=0x7f2c84155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c84155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 -- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c84159420 msgr2=0x7f2c840c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c84159420 0x7f2c840c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 -- 172.21.15.46:0/2214393926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780094f0 con 0x7f2c841597f0 2023-10-07T09:07:06.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c81d9b700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2c84089340 tx=0x7f2c78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78000d10 con 0x7f2c841597f0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7800bbe0 con 0x7f2c841597f0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840c5f10 con 0x7f2c841597f0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78011670 con 0x7f2c841597f0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.255+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c840c7ab0 con 0x7f2c841597f0 2023-10-07T09:07:06.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.256+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c840c9290 con 0x7f2c841597f0 2023-10-07T09:07:06.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.256+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2c78011aa0 con 0x7f2c841597f0 2023-10-07T09:07:06.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.257+0000 7f2c727fc700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 0x7f2c640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.257+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f2c780866f0 con 0x7f2c841597f0 2023-10-07T09:07:06.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.257+0000 7f2c8259c700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 0x7f2c640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.257+0000 7f2c8259c700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 0x7f2c640697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2c74003a80 tx=0x7f2c74007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.261+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c78053160 con 0x7f2c841597f0 2023-10-07T09:07:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.501+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000308651"} v 0) v1 -- 0x7f2c8404c3c0 con 0x7f2c841597f0 2023-10-07T09:07:06.502 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:07:06.502+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:07:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.506+0000 7f2c727fc700 1 -- 172.21.15.46:0/2214393926 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000308651"}]=0 volume_0000000000308651 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) v1 ==== 195+0+0 (secure 0 0 0) 0x7f2c78056780 con 0x7f2c841597f0 2023-10-07T09:07:06.508 INFO:tasks.ceph.mds.a.smithi046.stderr: -839> 2023-10-07T09:06:51.173+0000 7f25ef245700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:07:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 msgr2=0x7f2c640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 0x7f2c640697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2c74003a80 tx=0x7f2c74007ec0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 msgr2=0x7f2c84154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2c84089340 tx=0x7f2c78017000 comp rx=0 tx=0).stop 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 shutdown_connections 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2c64067320 0x7f2c640697d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c8415d230 0x7f2c84155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c84159420 0x7f2c840c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 --2- 172.21.15.46:0/2214393926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c841597f0 0x7f2c84154360 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 >> 172.21.15.46:0/2214393926 conn(0x7f2c840d0660 msgr2=0x7f2c840b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 shutdown_connections 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.509+0000 7f2c8359e700 1 -- 172.21.15.46:0/2214393926 wait complete. 2023-10-07T09:07:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:volume_0000000000308651 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:07:06.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000308651 --yes-i-really-mean-it 2023-10-07T09:07:06.529 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:07:06.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.645+0000 7fafc3640700 1 Processor -- start 2023-10-07T09:07:06.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.645+0000 7fafc3640700 1 -- start start 2023-10-07T09:07:06.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc3640700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fafbc0c8410 0x7fafbc06b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc3640700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 0x7fafbc15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc3640700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc15d610 con 0x7fafbc0c8040 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc3640700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc15ae60 con 0x7fafbc0c8410 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc3640700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc15d860 con 0x7fafbc15a0f0 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc13dc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fafbc0c8040 0x7fafbc06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36304/0 (socket says 172.21.15.46:36304) 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc13dc700 1 -- 172.21.15.46:0/2784754053 learned_addr learned my addr 172.21.15.46:0/2784754053 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.646+0000 7fafc1bdd700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 0x7fafbc15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 --2- 172.21.15.46:0/2784754053 >> v2:172.21.15.133:3300/0 conn(0x7fafbc0c8410 0x7fafbc06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafbbfff700 1 -- 172.21.15.46:0/2784754053 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204318431 0 0) 0x7fafbc15d610 con 0x7fafbc0c8040 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafbbfff700 1 -- 172.21.15.46:0/2784754053 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa4003570 con 0x7fafbc0c8040 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 -- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 msgr2=0x7fafbc15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 0x7fafbc15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 -- 172.21.15.46:0/2784754053 >> v1:172.21.15.46:6789/0 conn(0x7fafbc0c8040 legacy=0x7fafbc06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 -- 172.21.15.46:0/2784754053 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc15db40 con 0x7fafbc0c8410 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc1bdd700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 0x7fafbc15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafc0bdb700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8410 0x7fafbc06b230 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fafb00098e0 tx=0x7fafb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245c574a435cc1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafbbfff700 1 -- 172.21.15.46:0/2784754053 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011630 con 0x7fafbc0c8410 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafbbfff700 1 -- 172.21.15.46:0/2784754053 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0011790 con 0x7fafbc0c8410 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.647+0000 7fafbbfff700 1 -- 172.21.15.46:0/2784754053 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011b10 con 0x7fafbc0c8410 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 -- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8410 msgr2=0x7fafbc06b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8410 0x7fafbc06b230 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fafb00098e0 tx=0x7fafb00091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 -- 172.21.15.46:0/2784754053 shutdown_connections 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc15a0f0 0x7fafbc15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 --2- 172.21.15.46:0/2784754053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8410 0x7fafbc06b230 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 -- 172.21.15.46:0/2784754053 >> 172.21.15.46:0/2784754053 conn(0x7fafbc0cd640 msgr2=0x7fafbc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:06.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 -- 172.21.15.46:0/2784754053 shutdown_connections 2023-10-07T09:07:06.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.648+0000 7fafc3640700 1 -- 172.21.15.46:0/2784754053 wait complete. 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.649+0000 7fafc3640700 1 Processor -- start 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.649+0000 7fafc3640700 1 -- start start 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8040 0x7fafbc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 0x7fafbc0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c7790 con 0x7fafbc15a0f0 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c4b50 con 0x7fafbc0c8040 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc3640700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c4e30 con 0x7fafbc0c8410 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50806/0 (socket says 172.21.15.46:50806) 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 -- 172.21.15.46:0/395509952 learned_addr learned my addr 172.21.15.46:0/395509952 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc0bdb700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 0x7fafbc0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc13dc700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8040 0x7fafbc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 -- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 msgr2=0x7fafbc0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 0x7fafbc0adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 -- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8040 msgr2=0x7fafbc0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:06.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8040 0x7fafbc0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc1bdd700 1 -- 172.21.15.46:0/395509952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009420 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.650+0000 7fafc0bdb700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 0x7fafbc0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafc1bdd700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fafb400ea20 tx=0x7fafb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400c850 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400c9b0 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400cd70 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb0009420 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.651+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc0c53f0 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.652+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc15cc90 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.652+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fafb4013680 con 0x7fafbc15a0f0 2023-10-07T09:07:06.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.653+0000 7fafb97fa700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:06.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.653+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fafb4084f30 con 0x7fafbc15a0f0 2023-10-07T09:07:06.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.653+0000 7fafc13dc700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:06.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.653+0000 7fafc13dc700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 0x7fafa80697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fafac005c50 tx=0x7fafac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:06.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.657+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafb4051990 con 0x7fafbc15a0f0 2023-10-07T09:07:06.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:06.896+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000308651", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fafbc15de20 con 0x7fafbc15a0f0 2023-10-07T09:07:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.505+0000 7fafb97fa700 1 -- 172.21.15.46:0/395509952 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000308651", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 121+0+0 (secure 0 0 0) 0x7fafb40170c0 con 0x7fafbc15a0f0 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 msgr2=0x7fafa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 0x7fafa80697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fafac005c50 tx=0x7fafac009040 comp rx=0 tx=0).stop 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 msgr2=0x7fafbc0c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fafb400ea20 tx=0x7fafb40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 shutdown_connections 2023-10-07T09:07:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafbc15a0f0 0x7fafbc0c2eb0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafbc0c8040 0x7fafbc0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 --2- 172.21.15.46:0/395509952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafbc0c8410 0x7fafbc0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 >> 172.21.15.46:0/395509952 conn(0x7fafbc0cd640 msgr2=0x7fafbc06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 shutdown_connections 2023-10-07T09:07:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.508+0000 7fafc3640700 1 -- 172.21.15.46:0/395509952 wait complete. 2023-10-07T09:07:07.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000308651.meta cephfs.volume_0000000000308651.meta --yes-i-really-really-mean-it 2023-10-07T09:07:07.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.686+0000 7ff6b1d17700 1 Processor -- start 2023-10-07T09:07:07.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.686+0000 7ff6b1d17700 1 -- start start 2023-10-07T09:07:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6b1d17700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6b1d17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6b1d17700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac0ccee0 con 0x7ff6ac1430c0 2023-10-07T09:07:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6b1d17700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cf410 con 0x7ff6ac0b4580 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6b1d17700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cf6f0 con 0x7ff6ac143490 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6abfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6ab7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff6ac1430c0 0x7ff6ac0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:58530/0 (socket says 172.21.15.46:58530) 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6ab7fe700 1 -- 172.21.15.46:0/4187281883 learned_addr learned my addr 172.21.15.46:0/4187281883 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6abfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:39170/0 (socket says 172.21.15.46:39170) 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.687+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39158/0 (socket says 172.21.15.46:39158) 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aa7fc700 1 -- 172.21.15.46:0/4187281883 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275468327 0 0) 0x7ff6ac0ccee0 con 0x7ff6ac1430c0 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aa7fc700 1 -- 172.21.15.46:0/4187281883 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003570 con 0x7ff6ac1430c0 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aaffd700 1 -- 172.21.15.46:0/4187281883 >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 msgr2=0x7ff6ac0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aaffd700 1 --2- 172.21.15.46:0/4187281883 >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aaffd700 1 -- 172.21.15.46:0/4187281883 >> v1:172.21.15.133:6789/0 conn(0x7ff6ac1430c0 legacy=0x7ff6ac0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aaffd700 1 -- 172.21.15.46:0/4187281883 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0cf9d0 con 0x7ff6ac143490 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6abfff700 1 --2- 172.21.15.46:0/4187281883 >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aaffd700 1 --2- 172.21.15.46:0/4187281883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00098e0 tx=0x7ff6a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85945ee989aa070 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aa7fc700 1 -- 172.21.15.46:0/4187281883 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0011630 con 0x7ff6ac143490 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aa7fc700 1 -- 172.21.15.46:0/4187281883 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0011790 con 0x7ff6ac143490 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.688+0000 7ff6aa7fc700 1 -- 172.21.15.46:0/4187281883 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0011b10 con 0x7ff6ac143490 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 -- 172.21.15.46:0/4187281883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 msgr2=0x7ff6ac0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/4187281883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00098e0 tx=0x7ff6a00091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 -- 172.21.15.46:0/4187281883 shutdown_connections 2023-10-07T09:07:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/4187281883 >> v2:172.21.15.133:3300/0 conn(0x7ff6ac0b4580 0x7ff6ac0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/4187281883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0694a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 -- 172.21.15.46:0/4187281883 >> 172.21.15.46:0/4187281883 conn(0x7ff6ac068e60 msgr2=0x7ff6ac0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 -- 172.21.15.46:0/4187281883 shutdown_connections 2023-10-07T09:07:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.689+0000 7ff6b1d17700 1 -- 172.21.15.46:0/4187281883 wait complete. 2023-10-07T09:07:07.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.690+0000 7ff6b1d17700 1 Processor -- start 2023-10-07T09:07:07.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.690+0000 7ff6b1d17700 1 -- start start 2023-10-07T09:07:07.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ac0b4580 0x7ff6ac159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cadb0 con 0x7ff6ac1430c0 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cb090 con 0x7ff6ac0b4580 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cb370 con 0x7ff6ac143490 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50808/0 (socket says 172.21.15.46:50808) 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 -- 172.21.15.46:0/30025866 learned_addr learned my addr 172.21.15.46:0/30025866 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6abfff700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6ab7fe700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ac0b4580 0x7ff6ac159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 -- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 msgr2=0x7ff6ac0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 -- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ac0b4580 msgr2=0x7ff6ac159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ac0b4580 0x7ff6ac159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 -- 172.21.15.46:0/30025866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009a20 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6aaffd700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0cf830 tx=0x7ff6a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0011b10 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0000c90 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a0009420 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a001a660 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.691+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac0cb930 con 0x7ff6ac1430c0 2023-10-07T09:07:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.692+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac064550 con 0x7ff6ac1430c0 2023-10-07T09:07:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.693+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff6a001aa50 con 0x7ff6ac1430c0 2023-10-07T09:07:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.693+0000 7ff6937fe700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 0x7ff6980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.693+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7ff6a0086a40 con 0x7ff6ac1430c0 2023-10-07T09:07:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.693+0000 7ff6ab7fe700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 0x7ff6980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:07.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.694+0000 7ff6ab7fe700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 0x7ff6980697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007fd0 tx=0x7ff69c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:07.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.697+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a0053560 con 0x7ff6ac1430c0 2023-10-07T09:07:07.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:07.891+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000308651.meta", "pool2": "cephfs.volume_0000000000308651.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6ac04c3c0 con 0x7ff6ac1430c0 2023-10-07T09:07:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.510+0000 7ff6937fe700 1 -- 172.21.15.46:0/30025866 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000308651.meta", "pool2": "cephfs.volume_0000000000308651.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000308651.meta' removed v172) v1 ==== 241+0+0 (secure 0 0 0) 0x7ff6a0015100 con 0x7ff6ac1430c0 2023-10-07T09:07:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 msgr2=0x7ff6980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 0x7ff6980697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007fd0 tx=0x7ff69c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 msgr2=0x7ff6ac0b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0cf830 tx=0x7ff6a0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 shutdown_connections 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff698067320 0x7ff6980697d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6ac143490 0x7ff6ac0b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ac0b4580 0x7ff6ac159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 --2- 172.21.15.46:0/30025866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ac1430c0 0x7ff6ac0b4a40 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 >> 172.21.15.46:0/30025866 conn(0x7ff6ac068e60 msgr2=0x7ff6ac0694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 shutdown_connections 2023-10-07T09:07:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.518+0000 7ff6b1d17700 1 -- 172.21.15.46:0/30025866 wait complete. 2023-10-07T09:07:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000000308651.meta' removed 2023-10-07T09:07:08.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:07:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.660+0000 7fdcb3655700 1 Processor -- start 2023-10-07T09:07:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 -- start start 2023-10-07T09:07:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcac0ceb60 0x7fdcac0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac15c320 con 0x7fdcac155360 2023-10-07T09:07:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0cefc0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.661+0000 7fdcb3655700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15b710 con 0x7fdcac0b42c0 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb13f1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdcac155360 0x7fdcac0b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:58542/0 (socket says 172.21.15.46:58542) 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:39168/0 (socket says 172.21.15.46:39168) 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb13f1700 1 -- 172.21.15.46:0/2517201347 learned_addr learned my addr 172.21.15.46:0/2517201347 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb1bf2700 1 --2- 172.21.15.46:0/2517201347 >> v2:172.21.15.133:3300/0 conn(0x7fdcac0ceb60 0x7fdcac0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcabfff700 1 -- 172.21.15.46:0/2517201347 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716875229 0 0) 0x7fdcac15c320 con 0x7fdcac155360 2023-10-07T09:07:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcabfff700 1 -- 172.21.15.46:0/2517201347 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc94003570 con 0x7fdcac155360 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/2517201347 >> v2:172.21.15.133:3300/0 conn(0x7fdcac0ceb60 msgr2=0x7fdcac0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 --2- 172.21.15.46:0/2517201347 >> v2:172.21.15.133:3300/0 conn(0x7fdcac0ceb60 0x7fdcac0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/2517201347 >> v1:172.21.15.133:6789/0 conn(0x7fdcac155360 legacy=0x7fdcac0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/2517201347 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac15b9f0 con 0x7fdcac0b42c0 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcb0bf0700 1 --2- 172.21.15.46:0/2517201347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098e0 tx=0x7fdca00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1db7adc39531cde server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.662+0000 7fdcabfff700 1 -- 172.21.15.46:0/2517201347 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0011630 con 0x7fdcac0b42c0 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcabfff700 1 -- 172.21.15.46:0/2517201347 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0011790 con 0x7fdcac0b42c0 2023-10-07T09:07:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcabfff700 1 -- 172.21.15.46:0/2517201347 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0011b30 con 0x7fdcac0b42c0 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 -- 172.21.15.46:0/2517201347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 msgr2=0x7fdcac0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 --2- 172.21.15.46:0/2517201347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098e0 tx=0x7fdca00091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 -- 172.21.15.46:0/2517201347 shutdown_connections 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 --2- 172.21.15.46:0/2517201347 >> v2:172.21.15.133:3300/0 conn(0x7fdcac0ceb60 0x7fdcac0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 --2- 172.21.15.46:0/2517201347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac0ce620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 -- 172.21.15.46:0/2517201347 >> 172.21.15.46:0/2517201347 conn(0x7fdcac06baf0 msgr2=0x7fdcac06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 -- 172.21.15.46:0/2517201347 shutdown_connections 2023-10-07T09:07:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.663+0000 7fdcb3655700 1 -- 172.21.15.46:0/2517201347 wait complete. 2023-10-07T09:07:08.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.664+0000 7fdcb3655700 1 Processor -- start 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.664+0000 7fdcb3655700 1 -- start start 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac155360 0x7fdcac0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c48e0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c4bc0 con 0x7fdcac155360 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb3655700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c4ea0 con 0x7fdcac0b42c0 2023-10-07T09:07:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb0bf0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb13f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb0bf0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50818/0 (socket says 172.21.15.46:50818) 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb1bf2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac155360 0x7fdcac0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.665+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/683964936 learned_addr learned my addr 172.21.15.46:0/683964936 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 msgr2=0x7fdcac153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac155360 msgr2=0x7fdcac0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac155360 0x7fdcac0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 -- 172.21.15.46:0/683964936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009420 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb0bf0700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15b850 tx=0x7fdca0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0011900 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0011a60 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0c5180 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0025640 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.666+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac1538c0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.667+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0718b0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.667+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdca0025a30 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.668+0000 7fdca97fa700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 0x7fdc980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.668+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdca00863b0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.668+0000 7fdcb13f1700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 0x7fdc980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:08.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.668+0000 7fdcb13f1700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 0x7fdc980697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c005c50 tx=0x7fdc9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:08.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.672+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdca0052ff0 con 0x7fdcac0ceb60 2023-10-07T09:07:08.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:08.868+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdcac0c8050 con 0x7fdcac0ceb60 2023-10-07T09:07:09.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.512+0000 7fdca97fa700 1 -- 172.21.15.46:0/683964936 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdca0056610 con 0x7fdcac0ceb60 2023-10-07T09:07:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 msgr2=0x7fdc980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 0x7fdc980697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c005c50 tx=0x7fdc9c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 msgr2=0x7fdcac0b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15b850 tx=0x7fdca0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 shutdown_connections 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdc98067320 0x7fdc980697d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac155360 0x7fdcac0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcac0b42c0 0x7fdcac153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 --2- 172.21.15.46:0/683964936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcac0ceb60 0x7fdcac0b2ba0 secure :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15b850 tx=0x7fdca0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.517+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 >> 172.21.15.46:0/683964936 conn(0x7fdcac06baf0 msgr2=0x7fdcac154510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:09.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.519+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 shutdown_connections 2023-10-07T09:07:09.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.519+0000 7fdcb3655700 1 -- 172.21.15.46:0/683964936 wait complete. 2023-10-07T09:07:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:07:09.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm another-data-pool another-data-pool --yes-i-really-really-mean-it 2023-10-07T09:07:09.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.666+0000 7fd5840d0700 1 Processor -- start 2023-10-07T09:07:09.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 -- start start 2023-10-07T09:07:09.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd57c0b53d0 0x7fd57c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 0x7fd57c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b5b00 con 0x7fd57c0b53d0 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b5da0 con 0x7fd57c0cce40 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.667+0000 7fd5840d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0b6080 con 0x7fd57c159ec0 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd57c0b53d0 0x7fd57c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd57c0b53d0 0x7fd57c0cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35806/0 (socket says 172.21.15.46:35806) 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 -- 172.21.15.46:0/3228347604 learned_addr learned my addr 172.21.15.46:0/3228347604 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:09.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd581e6c700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58266d700 1 --2- 172.21.15.46:0/3228347604 >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 0x7fd57c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 -- 172.21.15.46:0/3228347604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 msgr2=0x7fd57c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 -- 172.21.15.46:0/3228347604 >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 msgr2=0x7fd57c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 --2- 172.21.15.46:0/3228347604 >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 0x7fd57c0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 -- 172.21.15.46:0/3228347604 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0cc100 con 0x7fd57c0b53d0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58266d700 1 --2- 172.21.15.46:0/3228347604 >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 0x7fd57c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd58166b700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0b53d0 0x7fd57c0cc900 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd57c09e530 tx=0x7fd570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516ecce13cdff7d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd580e6a700 1 -- 172.21.15.46:0/3228347604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000b860 con 0x7fd57c0b53d0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd580e6a700 1 -- 172.21.15.46:0/3228347604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000b9c0 con 0x7fd57c0b53d0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.668+0000 7fd580e6a700 1 -- 172.21.15.46:0/3228347604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000bd60 con 0x7fd57c0b53d0 2023-10-07T09:07:09.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 -- 172.21.15.46:0/3228347604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0b53d0 msgr2=0x7fd57c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0b53d0 0x7fd57c0cc900 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd57c09e530 tx=0x7fd570009250 comp rx=0 tx=0).stop 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 -- 172.21.15.46:0/3228347604 shutdown_connections 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 --2- 172.21.15.46:0/3228347604 >> v2:172.21.15.133:3300/0 conn(0x7fd57c0cce40 0x7fd57c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 --2- 172.21.15.46:0/3228347604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0b53d0 0x7fd57c0cc900 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 -- 172.21.15.46:0/3228347604 >> 172.21.15.46:0/3228347604 conn(0x7fd57c0999f0 msgr2=0x7fd57c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 -- 172.21.15.46:0/3228347604 shutdown_connections 2023-10-07T09:07:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.669+0000 7fd5840d0700 1 -- 172.21.15.46:0/3228347604 wait complete. 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.670+0000 7fd5840d0700 1 Processor -- start 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.670+0000 7fd5840d0700 1 -- start start 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 0x7fd57c16ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c16b2a0 con 0x7fd57c0cce40 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c09d460 con 0x7fd57c0b53d0 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c09d180 con 0x7fd57c159ec0 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35820/0 (socket says 172.21.15.46:35820) 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 -- 172.21.15.46:0/2552813216 learned_addr learned my addr 172.21.15.46:0/2552813216 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd581e6c700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 0x7fd57c16ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 -- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 msgr2=0x7fd57c09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 -- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 msgr2=0x7fd57c16ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 0x7fd57c16ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 -- 172.21.15.46:0/2552813216 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700094f0 con 0x7fd57c0cce40 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd581e6c700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 0x7fd57c16ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd58166b700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd57c089390 tx=0x7fd570017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570024440 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5700245a0 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570024960 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.671+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c09a600 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.672+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c09abc0 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.673+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c09a460 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.673+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd57001a420 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.673+0000 7fd579ffb700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 0x7fd5680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.673+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5360+0+0 (secure 0 0 0) 0x7fd570086a20 con 0x7fd57c0cce40 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.674+0000 7fd581e6c700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 0x7fd5680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.674+0000 7fd581e6c700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 0x7fd5680697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5740089d0 tx=0x7fd574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:09.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.678+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd57c09a460 con 0x7fd57c0cce40 2023-10-07T09:07:09.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:09.874+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd57c09a460 con 0x7fd57c0cce40 2023-10-07T09:07:10.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.517+0000 7fd579ffb700 1 -- 172.21.15.46:0/2552813216 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true}]=0 pool 'another-data-pool' removed v174) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd57c09a460 con 0x7fd57c0cce40 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 msgr2=0x7fd5680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 0x7fd5680697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5740089d0 tx=0x7fd574008040 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 msgr2=0x7fd57c1573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd57c089390 tx=0x7fd570017000 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 shutdown_connections 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd568067320 0x7fd5680697d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd57c159ec0 0x7fd57c09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd57c0b53d0 0x7fd57c16ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 --2- 172.21.15.46:0/2552813216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c0cce40 0x7fd57c1573d0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 >> 172.21.15.46:0/2552813216 conn(0x7fd57c0999f0 msgr2=0x7fd57c159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 shutdown_connections 2023-10-07T09:07:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.521+0000 7fd5840d0700 1 -- 172.21.15.46:0/2552813216 wait complete. 2023-10-07T09:07:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'another-data-pool' removed 2023-10-07T09:07:10.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:07:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.660+0000 7f71da239700 1 Processor -- start 2023-10-07T09:07:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.660+0000 7f71da239700 1 -- start start 2023-10-07T09:07:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71da239700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71d40ccee0 0x7f71d41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71da239700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c87c0 0x7f71d4156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71da239700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d415b0d0 con 0x7f71d40c83f0 2023-10-07T09:07:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71da239700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d4156c50 con 0x7f71d40ccee0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71da239700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415a4c0 con 0x7f71d40c87c0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71d40ccee0 0x7f71d41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f71d40c83f0 0x7f71d40c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55122/0 (socket says 172.21.15.46:55122) 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d37fe700 1 -- 172.21.15.46:0/4111317044 learned_addr learned my addr 172.21.15.46:0/4111317044 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71d40ccee0 0x7f71d41561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35834/0 (socket says 172.21.15.46:35834) 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d3fff700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c87c0 0x7f71d4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 -- 172.21.15.46:0/4111317044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c87c0 msgr2=0x7f71d4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c87c0 0x7f71d4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 -- 172.21.15.46:0/4111317044 >> v1:172.21.15.46:6789/0 conn(0x7f71d40c83f0 legacy=0x7f71d40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 -- 172.21.15.46:0/4111317044 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d415a7a0 con 0x7f71d40ccee0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.661+0000 7f71d2ffd700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d41561d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f71c40098e0 tx=0x7f71c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26bfd9a3600d6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71d27fc700 1 -- 172.21.15.46:0/4111317044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4009e80 con 0x7f71d40ccee0 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71d27fc700 1 -- 172.21.15.46:0/4111317044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b860 con 0x7f71d40ccee0 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71d27fc700 1 -- 172.21.15.46:0/4111317044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400bbe0 con 0x7f71d40ccee0 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 -- 172.21.15.46:0/4111317044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 msgr2=0x7f71d41561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d41561d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f71c40098e0 tx=0x7f71c40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 -- 172.21.15.46:0/4111317044 shutdown_connections 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c87c0 0x7f71d4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 --2- 172.21.15.46:0/4111317044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d41561d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 -- 172.21.15.46:0/4111317044 >> 172.21.15.46:0/4111317044 conn(0x7f71d4068e10 msgr2=0x7f71d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 -- 172.21.15.46:0/4111317044 shutdown_connections 2023-10-07T09:07:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.662+0000 7f71da239700 1 -- 172.21.15.46:0/4111317044 wait complete. 2023-10-07T09:07:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.663+0000 7f71da239700 1 Processor -- start 2023-10-07T09:07:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.663+0000 7f71da239700 1 -- start start 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 0x7f71d413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d40c87c0 0x7f71d4156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4158380 con 0x7f71d40ccee0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d413dda0 con 0x7f71d40c87c0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71da239700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4157770 con 0x7f71d40c83f0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35838/0 (socket says 172.21.15.46:35838) 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 -- 172.21.15.46:0/785749358 learned_addr learned my addr 172.21.15.46:0/785749358 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d37fe700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 0x7f71d413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d2ffd700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d40c87c0 0x7f71d4156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 -- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 msgr2=0x7f71d413d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 0x7f71d413d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 -- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d40c87c0 msgr2=0x7f71d4156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.664+0000 7f71d3fff700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d40c87c0 0x7f71d4156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71d3fff700 1 -- 172.21.15.46:0/785749358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009420 con 0x7f71d40ccee0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71d37fe700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 0x7f71d413d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71d3fff700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009fd0 tx=0x7f71cc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00ed50 con 0x7f71d40ccee0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00eeb0 con 0x7f71d40ccee0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d4157a50 con 0x7f71d40ccee0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc014650 con 0x7f71d40ccee0 2023-10-07T09:07:10.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.665+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d4158010 con 0x7f71d40ccee0 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.666+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4158530 con 0x7f71d40ccee0 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.666+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f71cc0149c0 con 0x7f71d40ccee0 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.667+0000 7f71bb7fe700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 0x7f71c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.667+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f71cc085170 con 0x7f71d40ccee0 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.667+0000 7f71d37fe700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 0x7f71c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.667+0000 7f71d37fe700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 0x7f71c00697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f71d40c71a0 tx=0x7f71c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.671+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71d4158530 con 0x7f71d40ccee0 2023-10-07T09:07:10.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.864+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f71d4158530 con 0x7f71d40ccee0 2023-10-07T09:07:10.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.867+0000 7f71bb7fe700 1 -- 172.21.15.46:0/785749358 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71d4158530 con 0x7f71d40ccee0 2023-10-07T09:07:10.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 msgr2=0x7f71c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 0x7f71c00697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f71d40c71a0 tx=0x7f71c8009040 comp rx=0 tx=0).stop 2023-10-07T09:07:10.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 msgr2=0x7f71d40c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:10.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009fd0 tx=0x7f71cc009900 comp rx=0 tx=0).stop 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 shutdown_connections 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f71c0067320 0x7f71c00697d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71d40ccee0 0x7f71d40c8ce0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71d40c83f0 0x7f71d413d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 --2- 172.21.15.46:0/785749358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d40c87c0 0x7f71d4156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.869+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 >> 172.21.15.46:0/785749358 conn(0x7f71d4068e10 msgr2=0x7f71d40cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.870+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 shutdown_connections 2023-10-07T09:07:10.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:10.870+0000 7f71da239700 1 -- 172.21.15.46:0/785749358 wait complete. 2023-10-07T09:07:10.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-07T09:07:11.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.001+0000 7f3346ef9700 1 Processor -- start 2023-10-07T09:07:11.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 -- start start 2023-10-07T09:07:11.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f3340159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33400ceaa0 0x7f33400b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400b6570 con 0x7f33400b1740 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400cfe20 con 0x7f33400ceaa0 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f3346ef9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400cf210 con 0x7f33401593b0 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.002+0000 7f33456f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33400ceaa0 0x7f33400b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33400ceaa0 0x7f33400b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35842/0 (socket says 172.21.15.46:35842) 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 -- 172.21.15.46:0/2951954904 learned_addr learned my addr 172.21.15.46:0/2951954904 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f3345ef7700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f3340159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 -- 172.21.15.46:0/2951954904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 msgr2=0x7f3340159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f3340159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 -- 172.21.15.46:0/2951954904 >> v1:172.21.15.133:6789/0 conn(0x7f33400b1740 legacy=0x7f334015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 -- 172.21.15.46:0/2951954904 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400cf4f0 con 0x7f33400ceaa0 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f33456f6700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f33400b6030 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f33340099b0 tx=0x7f3334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e3a06630e24d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f3344ef5700 1 -- 172.21.15.46:0/2951954904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334009ea0 con 0x7f33400ceaa0 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f3344ef5700 1 -- 172.21.15.46:0/2951954904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400b860 con 0x7f33400ceaa0 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.003+0000 7f3344ef5700 1 -- 172.21.15.46:0/2951954904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400bc00 con 0x7f33400ceaa0 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 -- 172.21.15.46:0/2951954904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 msgr2=0x7f33400b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f33400b6030 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f33340099b0 tx=0x7f3334009250 comp rx=0 tx=0).stop 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 -- 172.21.15.46:0/2951954904 shutdown_connections 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f3340159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 --2- 172.21.15.46:0/2951954904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f33400b6030 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 -- 172.21.15.46:0/2951954904 >> 172.21.15.46:0/2951954904 conn(0x7f33400d1130 msgr2=0x7f33400b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:11.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 -- 172.21.15.46:0/2951954904 shutdown_connections 2023-10-07T09:07:11.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.004+0000 7f3346ef9700 1 -- 172.21.15.46:0/2951954904 wait complete. 2023-10-07T09:07:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.005+0000 7f3346ef9700 1 Processor -- start 2023-10-07T09:07:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.005+0000 7f3346ef9700 1 -- start start 2023-10-07T09:07:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33400b1740 0x7f3340150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f334014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340150a10 con 0x7f33400ceaa0 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401513e0 con 0x7f33400b1740 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3346ef9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334014fe00 con 0x7f33401593b0 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35858/0 (socket says 172.21.15.46:35858) 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 -- 172.21.15.46:0/3931865902 learned_addr learned my addr 172.21.15.46:0/3931865902 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33466f8700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f334014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f3345ef7700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33400b1740 0x7f3340150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 -- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 msgr2=0x7f334014e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f334014e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 -- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33400b1740 msgr2=0x7f3340150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33400b1740 0x7f3340150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 -- 172.21.15.46:0/3931865902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340094f0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.006+0000 7f33456f6700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f334006fe00 tx=0x7f3334017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.007+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400bbe0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.007+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334011420 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.007+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33401500e0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.007+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340117c0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.007+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33401506a0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.008+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340150bc0 con 0x7f33400ceaa0 2023-10-07T09:07:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.008+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3334011bf0 con 0x7f33400ceaa0 2023-10-07T09:07:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.009+0000 7f333dffb700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 0x7f332c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.009+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3334086270 con 0x7f33400ceaa0 2023-10-07T09:07:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.009+0000 7f3345ef7700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 0x7f332c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.009+0000 7f3345ef7700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 0x7f332c0697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ca0 tx=0x7f3330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.013+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3340150bc0 con 0x7f33400ceaa0 2023-10-07T09:07:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.289+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7f334004c3c0 con 0x7f33400ceaa0 2023-10-07T09:07:11.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.519+0000 7f333dffb700 1 -- 172.21.15.46:0/3931865902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v436) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3334053200 con 0x7f33400ceaa0 2023-10-07T09:07:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 msgr2=0x7f332c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 0x7f332c0697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ca0 tx=0x7f3330008040 comp rx=0 tx=0).stop 2023-10-07T09:07:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 msgr2=0x7f334014f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f334006fe00 tx=0x7f3334017000 comp rx=0 tx=0).stop 2023-10-07T09:07:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 shutdown_connections 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f332c067320 0x7f332c0697d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33401593b0 0x7f334014e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33400b1740 0x7f3340150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 --2- 172.21.15.46:0/3931865902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33400ceaa0 0x7f334014f4e0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 >> 172.21.15.46:0/3931865902 conn(0x7f33400d1130 msgr2=0x7f334015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 shutdown_connections 2023-10-07T09:07:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.521+0000 7f3346ef9700 1 -- 172.21.15.46:0/3931865902 wait complete. 2023-10-07T09:07:11.535 INFO:tasks.cephfs_test_runner:That renaming a volume with more than one data pool does not change ... ok 2023-10-07T09:07:11.535 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) That volume rename is idempotent. 2023-10-07T09:07:11.535 INFO:tasks.cephfs_test_runner:test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:07:11.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-07T09:07:11.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.658+0000 7f8659020700 1 Processor -- start 2023-10-07T09:07:11.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.658+0000 7f8659020700 1 -- start start 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.658+0000 7f8659020700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f865406ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.658+0000 7f8659020700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540c74b0 con 0x7f865415d730 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f8659020700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540c8700 con 0x7f8654159b10 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f8659020700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86540c9070 con 0x7f865415dba0 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f864a59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f865415d730 0x7f865406a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55132/0 (socket says 172.21.15.46:55132) 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f864a59c700 1 -- 172.21.15.46:0/2379608732 learned_addr learned my addr 172.21.15.46:0/2379608732 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865359e700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f865406ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277147014 0 0) 0x7f86540c74b0 con 0x7f865415d730 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8640003570 con 0x7f865415d730 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225334274 0 0) 0x7f8640003570 con 0x7f865415d730 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 msgr2=0x7f865406ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f865406ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 >> v1:172.21.15.133:6789/0 conn(0x7f8654159b10 legacy=0x7f86540cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540c80f0 con 0x7f865415d730 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f863c001470 con 0x7f865415d730 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 >> v1:172.21.15.46:6789/0 conn(0x7f865415d730 legacy=0x7f865406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640003a90 0x7f8640003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8640004810 0x7f8640004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f86400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540c9070 con 0x7f8640004810 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864000bb10 con 0x7f8640003a90 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864000bcd0 con 0x7f865415dba0 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.659+0000 7f864a59c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8640004810 0x7f8640004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f865359e700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f86400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f8652d9d700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640003a90 0x7f8640003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 -- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 msgr2=0x7f86400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f865415dba0 0x7f86400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 -- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640003a90 msgr2=0x7f8640003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640003a90 0x7f8640003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 -- 172.21.15.46:0/2379608732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640003570 con 0x7f8640004810 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f8652d9d700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640003a90 0x7f8640003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f864a59c700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8640004810 0x7f8640004c80 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c390 tx=0x7f86540c8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9874532898302b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00cc60 con 0x7f8640004810 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00ce00 con 0x7f8640004810 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f865259c700 1 -- 172.21.15.46:0/2379608732 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c005b70 con 0x7f8640004810 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f8659020700 1 -- 172.21.15.46:0/2379608732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8640004810 msgr2=0x7f8640004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.660+0000 7f8659020700 1 --2- 172.21.15.46:0/2379608732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8640004810 0x7f8640004c80 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c390 tx=0x7f86540c8670 comp rx=0 tx=0).stop 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.661+0000 7f865359e700 1 -- 172.21.15.46:0/2379608732 reap_dead start 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.661+0000 7f8659020700 1 -- 172.21.15.46:0/2379608732 shutdown_connections 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.661+0000 7f8659020700 1 -- 172.21.15.46:0/2379608732 >> 172.21.15.46:0/2379608732 conn(0x7f86540c9870 msgr2=0x7f86540c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.661+0000 7f8659020700 1 -- 172.21.15.46:0/2379608732 shutdown_connections 2023-10-07T09:07:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.661+0000 7f8659020700 1 -- 172.21.15.46:0/2379608732 wait complete. 2023-10-07T09:07:11.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.662+0000 7f8659020700 1 Processor -- start 2023-10-07T09:07:11.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.662+0000 7f8659020700 1 -- start start 2023-10-07T09:07:11.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640004810 0x7f865413f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86540afc80 0x7f86540b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865406b990 con 0x7f865406afe0 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540b0660 con 0x7f8640004810 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865415a3d0 con 0x7f86540afc80 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35874/0 (socket says 172.21.15.46:35874) 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 -- 172.21.15.46:0/2329850650 learned_addr learned my addr 172.21.15.46:0/2329850650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 -- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86540afc80 msgr2=0x7f86540b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8652d9d700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640004810 0x7f865413f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f865359e700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86540afc80 0x7f86540b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86540afc80 0x7f86540b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 -- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640004810 msgr2=0x7f865413f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640004810 0x7f865413f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 -- 172.21.15.46:0/2329850650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865415a670 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864a59c700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f8640004770 tx=0x7f863c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00cc60 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c000ed0 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c007510 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865415a950 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.663+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865415af10 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.664+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865404c3c0 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.665+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f863c019070 con 0x7f865406afe0 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.665+0000 7f864b7fe700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 0x7f86340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:11.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.665+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f863c085850 con 0x7f865406afe0 2023-10-07T09:07:11.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.665+0000 7f8652d9d700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 0x7f86340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:11.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.666+0000 7f8652d9d700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 0x7f86340697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8644007a60 tx=0x7f8644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:11.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.669+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f863c0527e0 con 0x7f865406afe0 2023-10-07T09:07:11.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:11.942+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f86540633e0 con 0x7f865406afe0 2023-10-07T09:07:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.524+0000 7f864b7fe700 1 -- 172.21.15.46:0/2329850650 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v437) v1 ==== 150+0+0 (secure 0 0 0) 0x7f863c026e90 con 0x7f865406afe0 2023-10-07T09:07:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 msgr2=0x7f86340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 0x7f86340697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8644007a60 tx=0x7f8644009040 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 msgr2=0x7f865406b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f8640004770 tx=0x7f863c015000 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 shutdown_connections 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8634067320 0x7f86340697d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86540afc80 0x7f86540b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8640004810 0x7f865413f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 --2- 172.21.15.46:0/2329850650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f865406afe0 0x7f865406b450 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 >> 172.21.15.46:0/2329850650 conn(0x7f86540c9870 msgr2=0x7f86541581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 shutdown_connections 2023-10-07T09:07:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.527+0000 7f8659020700 1 -- 172.21.15.46:0/2329850650 wait complete. 2023-10-07T09:07:12.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:07:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.666+0000 7f94032d1700 1 Processor -- start 2023-10-07T09:07:12.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.666+0000 7f94032d1700 1 -- start start 2023-10-07T09:07:12.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f94032d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159890 0x7f93fc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f94032d1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93fc159c60 0x7f93fc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f94032d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc15a160 con 0x7f93fc15db10 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f94032d1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0d13a0 con 0x7f93fc159c60 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f94032d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc15e140 con 0x7f93fc159890 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f940086c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93fc159c60 0x7f93fc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f940086c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93fc159c60 0x7f93fc15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35878/0 (socket says 172.21.15.46:35878) 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f940086c700 1 -- 172.21.15.46:0/1367329090 learned_addr learned my addr 172.21.15.46:0/1367329090 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.667+0000 7f940106d700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159890 0x7f93fc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f940086c700 1 -- 172.21.15.46:0/1367329090 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159890 msgr2=0x7f93fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f940086c700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159890 0x7f93fc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f940086c700 1 -- 172.21.15.46:0/1367329090 >> v1:172.21.15.133:6789/0 conn(0x7f93fc15db10 legacy=0x7f93fc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f940086c700 1 -- 172.21.15.46:0/1367329090 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc15a3d0 con 0x7f93fc159c60 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f940086c700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159c60 0x7f93fc15d5d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f93f00099b0 tx=0x7f93f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc5508fc94565fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f93fbfff700 1 -- 172.21.15.46:0/1367329090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000b860 con 0x7f93fc159c60 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f93fbfff700 1 -- 172.21.15.46:0/1367329090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f000b9c0 con 0x7f93fc159c60 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f93fbfff700 1 -- 172.21.15.46:0/1367329090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000bd60 con 0x7f93fc159c60 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f94032d1700 1 -- 172.21.15.46:0/1367329090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159c60 msgr2=0x7f93fc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.668+0000 7f94032d1700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159c60 0x7f93fc15d5d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f93f00099b0 tx=0x7f93f0009250 comp rx=0 tx=0).stop 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 -- 172.21.15.46:0/1367329090 shutdown_connections 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159890 0x7f93fc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 --2- 172.21.15.46:0/1367329090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159c60 0x7f93fc15d5d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 -- 172.21.15.46:0/1367329090 >> 172.21.15.46:0/1367329090 conn(0x7f93fc068e20 msgr2=0x7f93fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 -- 172.21.15.46:0/1367329090 shutdown_connections 2023-10-07T09:07:12.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.669+0000 7f94032d1700 1 -- 172.21.15.46:0/1367329090 wait complete. 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.670+0000 7f94032d1700 1 Processor -- start 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.670+0000 7f94032d1700 1 -- start start 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159c60 0x7f93fc0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93fc15db10 0x7f93fc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc153770 con 0x7f93fc159890 2023-10-07T09:07:12.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc16a310 con 0x7f93fc15db10 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0b62d0 con 0x7f93fc159c60 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35892/0 (socket says 172.21.15.46:35892) 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 -- 172.21.15.46:0/112003484 learned_addr learned my addr 172.21.15.46:0/112003484 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940086c700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159c60 0x7f93fc0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940186e700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93fc15db10 0x7f93fc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 -- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159c60 msgr2=0x7f93fc0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159c60 0x7f93fc0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 -- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93fc15db10 msgr2=0x7f93fc0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93fc15db10 0x7f93fc0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 -- 172.21.15.46:0/112003484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00094f0 con 0x7f93fc159890 2023-10-07T09:07:12.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f940106d700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e190 tx=0x7f93f4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:12.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f400ed80 con 0x7f93fc159890 2023-10-07T09:07:12.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4014420 con 0x7f93fc159890 2023-10-07T09:07:12.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40147e0 con 0x7f93fc159890 2023-10-07T09:07:12.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc169cc0 con 0x7f93fc159890 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.671+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc1699b0 con 0x7f93fc159890 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.672+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc04c3c0 con 0x7f93fc159890 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.673+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f93f4014b90 con 0x7f93fc159890 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.673+0000 7f93f97fa700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 0x7f93e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.673+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f93f4085120 con 0x7f93fc159890 2023-10-07T09:07:12.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.673+0000 7f940086c700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 0x7f93e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:12.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.674+0000 7f940086c700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 0x7f93e80697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f93f00099b0 tx=0x7f93f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:12.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.677+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93f40520b0 con 0x7f93fc159890 2023-10-07T09:07:12.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:07:12.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:07:12.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.870+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f93fc06a5b0 con 0x7f93fc159890 2023-10-07T09:07:12.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.873+0000 7f93f97fa700 1 -- 172.21.15.46:0/112003484 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93f4009a60 con 0x7f93fc159890 2023-10-07T09:07:12.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 msgr2=0x7f93e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 0x7f93e80697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f93f00099b0 tx=0x7f93f0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:12.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 msgr2=0x7f93fc148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:12.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e190 tx=0x7f93f4009920 comp rx=0 tx=0).stop 2023-10-07T09:07:12.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 shutdown_connections 2023-10-07T09:07:12.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f93e8067320 0x7f93e80697d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93fc15db10 0x7f93fc0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93fc159890 0x7f93fc148160 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 --2- 172.21.15.46:0/112003484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f93fc159c60 0x7f93fc0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:12.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 >> 172.21.15.46:0/112003484 conn(0x7f93fc068e20 msgr2=0x7f93fc154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:12.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 shutdown_connections 2023-10-07T09:07:12.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:12.876+0000 7f94032d1700 1 -- 172.21.15.46:0/112003484 wait complete. 2023-10-07T09:07:12.889 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:07:12.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:12.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:13.011 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:07:13.011 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:07:13.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.129+0000 7fbeb10fe700 1 Processor -- start 2023-10-07T09:07:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.129+0000 7fbeb10fe700 1 -- start start 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb10fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 0x7fbeac0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb10fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb10fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0b11d0 con 0x7fbeac15d230 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb10fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac0b14b0 con 0x7fbeac1597f0 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb10fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0b1790 con 0x7fbeac159420 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeab7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeab7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:34554/0 (socket says 172.21.15.46:34554) 2023-10-07T09:07:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeb08fd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbeac15d230 0x7fbeac0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:60126/0 (socket says 172.21.15.46:60126) 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeab7fe700 1 -- 172.21.15.46:0/1870909193 learned_addr learned my addr 172.21.15.46:0/1870909193 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.130+0000 7fbeabfff700 1 --2- 172.21.15.46:0/1870909193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 0x7fbeac0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeabfff700 1 -- 172.21.15.46:0/1870909193 >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 msgr2=0x7fbeac0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeabfff700 1 --2- 172.21.15.46:0/1870909193 >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeabfff700 1 -- 172.21.15.46:0/1870909193 >> v1:172.21.15.133:6789/0 conn(0x7fbeac15d230 legacy=0x7fbeac0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeabfff700 1 -- 172.21.15.46:0/1870909193 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0b1a70 con 0x7fbeac159420 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeab7fe700 1 --2- 172.21.15.46:0/1870909193 >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeabfff700 1 --2- 172.21.15.46:0/1870909193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 0x7fbeac0b5f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098e0 tx=0x7fbe9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de62af964864399b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeaaffd700 1 -- 172.21.15.46:0/1870909193 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b640 con 0x7fbeac159420 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeaaffd700 1 -- 172.21.15.46:0/1870909193 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b7a0 con 0x7fbeac159420 2023-10-07T09:07:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.131+0000 7fbeaaffd700 1 -- 172.21.15.46:0/1870909193 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00bb40 con 0x7fbeac159420 2023-10-07T09:07:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 -- 172.21.15.46:0/1870909193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 msgr2=0x7fbeac0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/1870909193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 0x7fbeac0b5f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098e0 tx=0x7fbe9c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 -- 172.21.15.46:0/1870909193 shutdown_connections 2023-10-07T09:07:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/1870909193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac159420 0x7fbeac0b5f40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/1870909193 >> v2:172.21.15.133:3300/0 conn(0x7fbeac1597f0 0x7fbeac0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 -- 172.21.15.46:0/1870909193 >> 172.21.15.46:0/1870909193 conn(0x7fbeac0d0660 msgr2=0x7fbeac0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 -- 172.21.15.46:0/1870909193 shutdown_connections 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.132+0000 7fbeb10fe700 1 -- 172.21.15.46:0/1870909193 wait complete. 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.133+0000 7fbeb10fe700 1 Processor -- start 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.133+0000 7fbeb10fe700 1 -- start start 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac1597f0 0x7fbeac14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeac15d230 0x7fbeac14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac152a00 con 0x7fbeac159420 2023-10-07T09:07:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac15c8a0 con 0x7fbeac15d230 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb10fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac14f240 con 0x7fbeac1597f0 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35904/0 (socket says 172.21.15.46:35904) 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 -- 172.21.15.46:0/2138765065 learned_addr learned my addr 172.21.15.46:0/2138765065 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeab7fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac1597f0 0x7fbeac14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeb08fd700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeac15d230 0x7fbeac14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 -- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac1597f0 msgr2=0x7fbeac14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac1597f0 0x7fbeac14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 -- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeac15d230 msgr2=0x7fbeac14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeac15d230 0x7fbeac14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.134+0000 7fbeabfff700 1 -- 172.21.15.46:0/2138765065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00094f0 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbeabfff700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0b18d0 tx=0x7fbe9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c01bc40 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c01bdc0 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c009420 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c011670 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.135+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac14f800 con 0x7fbeac159420 2023-10-07T09:07:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.136+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04c3c0 con 0x7fbeac159420 2023-10-07T09:07:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.136+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbe9c011a20 con 0x7fbeac159420 2023-10-07T09:07:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.137+0000 7fbe93fff700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 0x7fbe98069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.137+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbe9c085eb0 con 0x7fbeac159420 2023-10-07T09:07:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.137+0000 7fbeab7fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 0x7fbe98069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.137+0000 7fbeab7fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 0x7fbe98069800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbeac14e5b0 tx=0x7fbea0009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.141+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe9c052e40 con 0x7fbeac159420 2023-10-07T09:07:13.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.378+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeac0b1d50 con 0x7fbeac159420 2023-10-07T09:07:13.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.378+0000 7fbe93fff700 1 -- 172.21.15.46:0/2138765065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+3537 (secure 0 0 0) 0x7fbe9c015df0 con 0x7fbeac159420 2023-10-07T09:07:13.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":116,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1491588871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1491588871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1491588871}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1680597404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1680597404},{"type":"v1","addr":"172.21.15.133:6837","nonce":1680597404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/4087981447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4087981447},{"type":"v1","addr":"172.21.15.46:6834","nonce":4087981447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/221025604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":221025604},{"type":"v1","addr":"172.21.15.46:6835","nonce":221025604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[]} 2023-10-07T09:07:13.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 msgr2=0x7fbe98069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 0x7fbe98069800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbeac14e5b0 tx=0x7fbea0009250 comp rx=0 tx=0).stop 2023-10-07T09:07:13.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 msgr2=0x7fbeac14d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0b18d0 tx=0x7fbe9c017000 comp rx=0 tx=0).stop 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 shutdown_connections 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbe98067350 0x7fbe98069800 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeac15d230 0x7fbeac14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbeac159420 0x7fbeac14d380 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 --2- 172.21.15.46:0/2138765065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbeac1597f0 0x7fbeac14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 >> 172.21.15.46:0/2138765065 conn(0x7fbeac0d0660 msgr2=0x7fbeac0b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 shutdown_connections 2023-10-07T09:07:13.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.380+0000 7fbeb10fe700 1 -- 172.21.15.46:0/2138765065 wait complete. 2023-10-07T09:07:13.383 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 116 2023-10-07T09:07:13.393 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:07:13.394 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:07:13.394 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:07:13.394 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:13.394 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:07:13.394 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:07:13.394 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:07:13.394 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:13.395 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:07:13.395 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:07:13.395 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:07:13.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:13.395 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:07:13.395 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:07:13.396 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:07:13.396 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:13.402 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:07:13.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:07:13.403 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:07:13.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:07:13.405 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:07:13.406 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:07:13.406 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:07:13.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:07:13.445 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:07:13.446 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:13.446 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:07:13.446 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:13.448 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:07:13.448 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:13.449 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:07:13.449 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:13.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:07:13.520 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:07:13.521 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:07:13.528 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:07:13.528 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:07:13.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.575+0000 7fd049706700 1 Processor -- start 2023-10-07T09:07:13.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.575+0000 7fd049706700 1 -- start start 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd049706700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd04415dba0 0x7fd04406ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd049706700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0440c74b0 con 0x7fd044159b10 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd049706700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0440c8700 con 0x7fd04415d730 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd049706700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440c9070 con 0x7fd04415dba0 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd042ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd044159b10 0x7fd0440cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55156/0 (socket says 172.21.15.46:55156) 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.576+0000 7fd042ffd700 1 -- 172.21.15.46:0/308362387 learned_addr learned my addr 172.21.15.46:0/308362387 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:13.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986198649 0 0) 0x7fd0440c74b0 con 0x7fd044159b10 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd030003570 con 0x7fd044159b10 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd0437fe700 1 --2- 172.21.15.46:0/308362387 >> v2:172.21.15.133:3300/0 conn(0x7fd04415dba0 0x7fd04406ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2055821369 0 0) 0x7fd030003570 con 0x7fd044159b10 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 >> v2:172.21.15.133:3300/0 conn(0x7fd04415dba0 msgr2=0x7fd04406ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 --2- 172.21.15.46:0/308362387 >> v2:172.21.15.133:3300/0 conn(0x7fd04415dba0 0x7fd04406ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 >> v1:172.21.15.133:6789/0 conn(0x7fd04415d730 legacy=0x7fd04406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440c80f0 con 0x7fd044159b10 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd03c0017f0 con 0x7fd044159b10 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 >> v1:172.21.15.46:6789/0 conn(0x7fd044159b10 legacy=0x7fd0440cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd030003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd030004810 0x7fd030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd030005210 0x7fd03000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440c9070 con 0x7fd030003ab0 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03000c130 con 0x7fd030005210 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03000c2f0 con 0x7fd030004810 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd042ffd700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd030003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd0437fe700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd030005210 0x7fd03000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.577+0000 7fd0427fc700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd030004810 0x7fd030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 -- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd030004810 msgr2=0x7fd030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd030004810 0x7fd030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 -- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd030005210 msgr2=0x7fd03000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd030005210 0x7fd03000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 -- 172.21.15.46:0/308362387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030003570 con 0x7fd030003ab0 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd0437fe700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd030005210 0x7fd03000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd0437fe700 1 -- 172.21.15.46:0/308362387 reap_dead start 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd042ffd700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd030003ec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00a830 tx=0x7fd0440c8280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987bd73f72f41ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0070f0 con 0x7fd030003ab0 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c007250 con 0x7fd030003ab0 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd041ffb700 1 -- 172.21.15.46:0/308362387 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c007610 con 0x7fd030003ab0 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 -- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 msgr2=0x7fd030003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd030003ec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00a830 tx=0x7fd0440c8280 comp rx=0 tx=0).stop 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 -- 172.21.15.46:0/308362387 shutdown_connections 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 --2- 172.21.15.46:0/308362387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd030003ec0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 -- 172.21.15.46:0/308362387 >> 172.21.15.46:0/308362387 conn(0x7fd0440c9870 msgr2=0x7fd0440c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 -- 172.21.15.46:0/308362387 shutdown_connections 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.578+0000 7fd049706700 1 -- 172.21.15.46:0/308362387 wait complete. 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 Processor -- start 2023-10-07T09:07:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 -- start start 2023-10-07T09:07:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 0x7fd04415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 0x7fd044153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044154430 con 0x7fd030003ab0 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04416aa00 con 0x7fd044153a80 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.580+0000 7fd049706700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04416ace0 con 0x7fd04416a140 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35960/0 (socket says 172.21.15.46:35960) 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 -- 172.21.15.46:0/4248319076 learned_addr learned my addr 172.21.15.46:0/4248319076 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd0427fc700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 0x7fd04415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd0437fe700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 0x7fd044153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 -- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 msgr2=0x7fd04415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 0x7fd04415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 -- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 msgr2=0x7fd044153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 0x7fd044153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 -- 172.21.15.46:0/4248319076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04416afc0 con 0x7fd030003ab0 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd0427fc700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 0x7fd04415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd0437fe700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 0x7fd044153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd042ffd700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd03c012000 tx=0x7fd03c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0016f0 con 0x7fd030003ab0 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c022070 con 0x7fd030003ab0 2023-10-07T09:07:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04416b310 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c000f40 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.581+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04415cb60 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.582+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04416b830 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.583+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd03c0073c0 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.583+0000 7fd03affd700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 0x7fd0240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.583+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd03c086ba0 con 0x7fd030003ab0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.583+0000 7fd0427fc700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 0x7fd0240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.584+0000 7fd0427fc700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 0x7fd0240697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd02c000c00 tx=0x7fd02c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:13.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.588+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd04416b830 con 0x7fd030003ab0 2023-10-07T09:07:13.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:13.796+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd04416b830 con 0x7fd030003ab0 2023-10-07T09:07:14.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.536+0000 7fd03affd700 1 -- 172.21.15.46:0/4248319076 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd04416b830 con 0x7fd030003ab0 2023-10-07T09:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 msgr2=0x7fd0240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 0x7fd0240697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd02c000c00 tx=0x7fd02c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 msgr2=0x7fd0440b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd03c012000 tx=0x7fd03c016000 comp rx=0 tx=0).stop 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 shutdown_connections 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd024067320 0x7fd0240697d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044153a80 0x7fd044153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030003ab0 0x7fd0440b2220 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 --2- 172.21.15.46:0/4248319076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd04416a140 0x7fd04415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 >> 172.21.15.46:0/4248319076 conn(0x7fd0440c9870 msgr2=0x7fd0441565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 shutdown_connections 2023-10-07T09:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.539+0000 7fd049706700 1 -- 172.21.15.46:0/4248319076 wait complete. 2023-10-07T09:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:07:14.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:07:14.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.678+0000 7fc860e87700 1 Processor -- start 2023-10-07T09:07:14.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.678+0000 7fc860e87700 1 -- start start 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc860e87700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c06bcd0 0x7fc85c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc860e87700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c15c2a0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc860e87700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c15b690 con 0x7fc85c0c9510 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc860e87700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0c9900 con 0x7fc85c06bcd0 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc85a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c06bcd0 0x7fc85c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.679+0000 7fc859d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc85c06c0a0 0x7fc85c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55168/0 (socket says 172.21.15.46:55168) 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc859d9b700 1 -- 172.21.15.46:0/2143418391 learned_addr learned my addr 172.21.15.46:0/2143418391 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c06bcd0 0x7fc85c140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35972/0 (socket says 172.21.15.46:35972) 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85a59c700 1 -- 172.21.15.46:0/2143418391 >> v1:172.21.15.133:6789/0 conn(0x7fc85c0c9510 legacy=0x7fc85c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85a59c700 1 -- 172.21.15.46:0/2143418391 >> v1:172.21.15.46:6789/0 conn(0x7fc85c06c0a0 legacy=0x7fc85c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85a59c700 1 -- 172.21.15.46:0/2143418391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c15b970 con 0x7fc85c06bcd0 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85959a700 1 -- 172.21.15.46:0/2143418391 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212312429 0 0) 0x7fc85c15c2a0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85a59c700 1 --2- 172.21.15.46:0/2143418391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06bcd0 0x7fc85c140df0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e60 tx=0x7fc854009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20baabd5fbe49115 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85959a700 1 -- 172.21.15.46:0/2143418391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400e070 con 0x7fc85c06bcd0 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85959a700 1 -- 172.21.15.46:0/2143418391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400bc30 con 0x7fc85c06bcd0 2023-10-07T09:07:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.680+0000 7fc85959a700 1 -- 172.21.15.46:0/2143418391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854012430 con 0x7fc85c06bcd0 2023-10-07T09:07:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 -- 172.21.15.46:0/2143418391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06bcd0 msgr2=0x7fc85c140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 --2- 172.21.15.46:0/2143418391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06bcd0 0x7fc85c140df0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e60 tx=0x7fc854009780 comp rx=0 tx=0).stop 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 -- 172.21.15.46:0/2143418391 shutdown_connections 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 --2- 172.21.15.46:0/2143418391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06bcd0 0x7fc85c140df0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 -- 172.21.15.46:0/2143418391 >> 172.21.15.46:0/2143418391 conn(0x7fc85c0ce600 msgr2=0x7fc85c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 -- 172.21.15.46:0/2143418391 shutdown_connections 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.681+0000 7fc860e87700 1 -- 172.21.15.46:0/2143418391 wait complete. 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.682+0000 7fc860e87700 1 Processor -- start 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.682+0000 7fc860e87700 1 -- start start 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 0x7fc85c13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc85c0c9510 0x7fc85c13bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c13e720 con 0x7fc85c06c0a0 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c13ea00 con 0x7fc85c06bcd0 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c13ece0 con 0x7fc85c0c9510 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35988/0 (socket says 172.21.15.46:35988) 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 -- 172.21.15.46:0/3524187003 learned_addr learned my addr 172.21.15.46:0/3524187003 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc85a59c700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 0x7fc85c13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc85ad9d700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc85c0c9510 0x7fc85c13bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 -- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc85c0c9510 msgr2=0x7fc85c13bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc85c0c9510 0x7fc85c13bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 -- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 msgr2=0x7fc85c13fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 0x7fc85c13fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 -- 172.21.15.46:0/3524187003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009a20 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc85a59c700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 0x7fc85c13fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc859d9b700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc84400c7e0 tx=0x7fc844007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844005b30 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844005c90 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c13efc0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.683+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844007300 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.684+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c140120 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.684+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c13f4e0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.685+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc84401b400 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.685+0000 7fc8527fc700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 0x7fc83c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.685+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc8440843b0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.685+0000 7fc85a59c700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 0x7fc83c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:14.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.686+0000 7fc85a59c700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 0x7fc83c0697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e60 tx=0x7fc854018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:14.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.689+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc85c13f4e0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.962+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc85c1403a0 con 0x7fc85c06c0a0 2023-10-07T09:07:14.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.963+0000 7fc8527fc700 1 -- 172.21.15.46:0/3524187003 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc844051490 con 0x7fc85c06c0a0 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:14.965 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.966 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.967 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.968 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.970 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.971 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:07:14.973 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.974 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.975 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:14.976 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:14.978 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:07:14.979 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:07:14.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 msgr2=0x7fc83c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 0x7fc83c0697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e60 tx=0x7fc854018000 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 msgr2=0x7fc85c0c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc84400c7e0 tx=0x7fc844007df0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 shutdown_connections 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc83c067320 0x7fc83c0697d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc85c0c9510 0x7fc85c13bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c06bcd0 0x7fc85c13fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 --2- 172.21.15.46:0/3524187003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c06c0a0 0x7fc85c0c6210 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 >> 172.21.15.46:0/3524187003 conn(0x7fc85c0ce600 msgr2=0x7fc85c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 shutdown_connections 2023-10-07T09:07:14.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:14.965+0000 7fc860e87700 1 -- 172.21.15.46:0/3524187003 wait complete. 2023-10-07T09:07:14.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:15.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.100+0000 7fb68f59e700 1 Processor -- start 2023-10-07T09:07:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.100+0000 7fb68f59e700 1 -- start start 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb690159cc0 0x7fb6900b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6900cf6c0 0x7fb690163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68f59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900b5b40 con 0x7fb6900b2920 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900ce260 con 0x7fb690159cc0 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900b5e20 con 0x7fb6900cf6c0 2023-10-07T09:07:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb690159cc0 0x7fb6900b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68dd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6900b2920 0x7fb69015a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55172/0 (socket says 172.21.15.46:55172) 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68dd9b700 1 -- 172.21.15.46:0/1150828312 learned_addr learned my addr 172.21.15.46:0/1150828312 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68ed9d700 1 --2- 172.21.15.46:0/1150828312 >> v2:172.21.15.133:3300/0 conn(0x7fb6900cf6c0 0x7fb690163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68e59c700 1 -- 172.21.15.46:0/1150828312 >> v2:172.21.15.133:3300/0 conn(0x7fb6900cf6c0 msgr2=0x7fb690163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68e59c700 1 --2- 172.21.15.46:0/1150828312 >> v2:172.21.15.133:3300/0 conn(0x7fb6900cf6c0 0x7fb690163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68e59c700 1 -- 172.21.15.46:0/1150828312 >> v1:172.21.15.46:6789/0 conn(0x7fb6900b2920 legacy=0x7fb69015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68e59c700 1 -- 172.21.15.46:0/1150828312 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900b6100 con 0x7fb690159cc0 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.101+0000 7fb68d59a700 1 -- 172.21.15.46:0/1150828312 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365780890 0 0) 0x7fb6900b5b40 con 0x7fb6900b2920 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68e59c700 1 --2- 172.21.15.46:0/1150828312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb690159cc0 0x7fb6900b5530 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb6900af3c0 tx=0x7fb680009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96196e9de6f7392e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68d59a700 1 -- 172.21.15.46:0/1150828312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000e070 con 0x7fb690159cc0 2023-10-07T09:07:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68d59a700 1 -- 172.21.15.46:0/1150828312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68000bc30 con 0x7fb690159cc0 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68d59a700 1 -- 172.21.15.46:0/1150828312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680012430 con 0x7fb690159cc0 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 -- 172.21.15.46:0/1150828312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb690159cc0 msgr2=0x7fb6900b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 --2- 172.21.15.46:0/1150828312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb690159cc0 0x7fb6900b5530 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb6900af3c0 tx=0x7fb680009780 comp rx=0 tx=0).stop 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 -- 172.21.15.46:0/1150828312 shutdown_connections 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 --2- 172.21.15.46:0/1150828312 >> v2:172.21.15.133:3300/0 conn(0x7fb6900cf6c0 0x7fb690163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 --2- 172.21.15.46:0/1150828312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb690159cc0 0x7fb6900b5530 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 -- 172.21.15.46:0/1150828312 >> 172.21.15.46:0/1150828312 conn(0x7fb6900d0560 msgr2=0x7fb6900d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 -- 172.21.15.46:0/1150828312 shutdown_connections 2023-10-07T09:07:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.102+0000 7fb68f59e700 1 -- 172.21.15.46:0/1150828312 wait complete. 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.103+0000 7fb68f59e700 1 Processor -- start 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.103+0000 7fb68f59e700 1 -- start start 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 0x7fb690152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb690159cc0 0x7fb69016d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69016cfa0 con 0x7fb6900cf6c0 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015d750 con 0x7fb690159cc0 2023-10-07T09:07:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015da30 con 0x7fb6900b2920 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35996/0 (socket says 172.21.15.46:35996) 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.104+0000 7fb68dd9b700 1 -- 172.21.15.46:0/2080300880 learned_addr learned my addr 172.21.15.46:0/2080300880 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68ed9d700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb690159cc0 0x7fb69016d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68e59c700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 0x7fb690152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 -- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 msgr2=0x7fb690152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 0x7fb690152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 -- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb690159cc0 msgr2=0x7fb69016d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb690159cc0 0x7fb69016d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 -- 172.21.15.46:0/2080300880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009a20 con 0x7fb6900cf6c0 2023-10-07T09:07:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68e59c700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 0x7fb690152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68dd9b700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c5b0 tx=0x7fb678001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678005b30 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678005c90 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69015dd10 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678007300 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.105+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6901531c0 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.106+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69016d150 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.106+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb67801b3b0 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.107+0000 7fb6867fc700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 0x7fb6700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.107+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb678083e60 con 0x7fb6900cf6c0 2023-10-07T09:07:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.107+0000 7fb68e59c700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 0x7fb6700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.108+0000 7fb68e59c700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 0x7fb6700697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb6900af3c0 tx=0x7fb680019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.111+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb69016d150 con 0x7fb6900cf6c0 2023-10-07T09:07:15.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.304+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb69016cd70 con 0x7fb6900cf6c0 2023-10-07T09:07:15.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.305+0000 7fb6867fc700 1 -- 172.21.15.46:0/2080300880 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+12144 (secure 0 0 0) 0x7fb678017090 con 0x7fb6900cf6c0 2023-10-07T09:07:15.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:15.306 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":178,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:14.541188+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:15.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 msgr2=0x7fb6700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 0x7fb6700697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb6900af3c0 tx=0x7fb680019000 comp rx=0 tx=0).stop 2023-10-07T09:07:15.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 msgr2=0x7fb69013e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c5b0 tx=0x7fb678001070 comp rx=0 tx=0).stop 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 shutdown_connections 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb670067320 0x7fb6700697d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb690159cc0 0x7fb69016d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6900b2920 0x7fb690152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 --2- 172.21.15.46:0/2080300880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6900cf6c0 0x7fb69013e080 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 >> 172.21.15.46:0/2080300880 conn(0x7fb6900d0560 msgr2=0x7fb6900d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 shutdown_connections 2023-10-07T09:07:15.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.307+0000 7fb68f59e700 1 -- 172.21.15.46:0/2080300880 wait complete. 2023-10-07T09:07:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:07:15.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:07:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.442+0000 7fa32d44d700 1 Processor -- start 2023-10-07T09:07:15.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.442+0000 7fa32d44d700 1 -- start start 2023-10-07T09:07:15.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa32d44d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3280b0a70 0x7fa3281625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa32d44d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280af2f0 con 0x7fa328069e80 2023-10-07T09:07:15.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa32d44d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280af5d0 con 0x7fa32815ac80 2023-10-07T09:07:15.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa32d44d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280c8660 con 0x7fa3280b0a70 2023-10-07T09:07:15.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3277fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3280b0a70 0x7fa3281625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3267fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa328069e80 0x7fa3280c6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55184/0 (socket says 172.21.15.46:55184) 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3267fc700 1 -- 172.21.15.46:0/1550379553 learned_addr learned my addr 172.21.15.46:0/1550379553 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3277fe700 1 -- 172.21.15.46:0/1550379553 >> v1:172.21.15.133:6789/0 conn(0x7fa32815ac80 legacy=0x7fa328069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3277fe700 1 -- 172.21.15.46:0/1550379553 >> v1:172.21.15.46:6789/0 conn(0x7fa328069e80 legacy=0x7fa3280c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3277fe700 1 -- 172.21.15.46:0/1550379553 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280c8940 con 0x7fa3280b0a70 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa325ffb700 1 -- 172.21.15.46:0/1550379553 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246262860 0 0) 0x7fa3280af2f0 con 0x7fa328069e80 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa3277fe700 1 --2- 172.21.15.46:0/1550379553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3280b0a70 0x7fa3281625e0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e60 tx=0x7fa320009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d088c74a4598cca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa325ffb700 1 -- 172.21.15.46:0/1550379553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000e070 con 0x7fa3280b0a70 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa325ffb700 1 -- 172.21.15.46:0/1550379553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000bbf0 con 0x7fa3280b0a70 2023-10-07T09:07:15.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.443+0000 7fa325ffb700 1 -- 172.21.15.46:0/1550379553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320012430 con 0x7fa3280b0a70 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 -- 172.21.15.46:0/1550379553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3280b0a70 msgr2=0x7fa3281625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 --2- 172.21.15.46:0/1550379553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3280b0a70 0x7fa3281625e0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e60 tx=0x7fa320009780 comp rx=0 tx=0).stop 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 -- 172.21.15.46:0/1550379553 shutdown_connections 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 --2- 172.21.15.46:0/1550379553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3280b0a70 0x7fa3281625e0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 -- 172.21.15.46:0/1550379553 >> 172.21.15.46:0/1550379553 conn(0x7fa328068e10 msgr2=0x7fa3280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 -- 172.21.15.46:0/1550379553 shutdown_connections 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.444+0000 7fa32d44d700 1 -- 172.21.15.46:0/1550379553 wait complete. 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.445+0000 7fa32d44d700 1 Processor -- start 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.445+0000 7fa32d44d700 1 -- start start 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 0x7fa3281682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa32815ac80 0x7fa32816a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280ad380 con 0x7fa328069e80 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa328168810 con 0x7fa3280b0a70 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa32d44d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32815d3c0 con 0x7fa32815ac80 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36004/0 (socket says 172.21.15.46:36004) 2023-10-07T09:07:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 -- 172.21.15.46:0/815870575 learned_addr learned my addr 172.21.15.46:0/815870575 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa3267fc700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 0x7fa3281682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa3277fe700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa32815ac80 0x7fa32816a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 -- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa32815ac80 msgr2=0x7fa32816a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa32815ac80 0x7fa32816a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 -- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 msgr2=0x7fa3281682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 0x7fa3281682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa326ffd700 1 -- 172.21.15.46:0/815870575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009a20 con 0x7fa328069e80 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.446+0000 7fa3267fc700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 0x7fa3281682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa326ffd700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b5e0 tx=0x7fa318009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800f510 con 0x7fa328069e80 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800f670 con 0x7fa328069e80 2023-10-07T09:07:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32815d6a0 con 0x7fa328069e80 2023-10-07T09:07:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800fa30 con 0x7fa328069e80 2023-10-07T09:07:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.447+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32815dc60 con 0x7fa328069e80 2023-10-07T09:07:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.448+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32804c3c0 con 0x7fa328069e80 2023-10-07T09:07:15.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.448+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa31801a400 con 0x7fa328069e80 2023-10-07T09:07:15.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.449+0000 7fa30effd700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 0x7fa3140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.449+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa318084320 con 0x7fa328069e80 2023-10-07T09:07:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.449+0000 7fa3267fc700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 0x7fa3140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.449+0000 7fa3267fc700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 0x7fa3140697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa32806da80 tx=0x7fa31c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.453+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa318051480 con 0x7fa328069e80 2023-10-07T09:07:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.647+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3280ab7d0 con 0x7fa328069e80 2023-10-07T09:07:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.648+0000 7fa30effd700 1 -- 172.21.15.46:0/815870575 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa318054aa0 con 0x7fa328069e80 2023-10-07T09:07:15.649 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 msgr2=0x7fa3140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 0x7fa3140697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa32806da80 tx=0x7fa31c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 msgr2=0x7fa328168a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b5e0 tx=0x7fa318009120 comp rx=0 tx=0).stop 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 shutdown_connections 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa314067320 0x7fa3140697d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa32815ac80 0x7fa32816a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa328069e80 0x7fa328168a80 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 --2- 172.21.15.46:0/815870575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3280b0a70 0x7fa3281682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 >> 172.21.15.46:0/815870575 conn(0x7fa328068e10 msgr2=0x7fa328069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 shutdown_connections 2023-10-07T09:07:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.650+0000 7fa32d44d700 1 -- 172.21.15.46:0/815870575 wait complete. 2023-10-07T09:07:15.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:07:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.781+0000 7f84d5cf1700 1 Processor -- start 2023-10-07T09:07:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.781+0000 7f84d5cf1700 1 -- start start 2023-10-07T09:07:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84d5cf1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 0x7f84d015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84d5cf1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f84d0069560 0x7f84d00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84d5cf1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d0069ee0 con 0x7f84d0159c60 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84d5cf1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d015a160 con 0x7f84d0069560 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84d5cf1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d00d13a0 con 0x7f84d0159890 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f84d0069560 0x7f84d00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84ceffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f84d0159c60 0x7f84d015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55190/0 (socket says 172.21.15.46:55190) 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84ceffd700 1 -- 172.21.15.46:0/343307529 learned_addr learned my addr 172.21.15.46:0/343307529 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cf7fe700 1 --2- 172.21.15.46:0/343307529 >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 0x7f84d015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 -- 172.21.15.46:0/343307529 >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 msgr2=0x7f84d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 --2- 172.21.15.46:0/343307529 >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 0x7f84d015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 -- 172.21.15.46:0/343307529 >> v1:172.21.15.46:6789/0 conn(0x7f84d0159c60 legacy=0x7f84d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 -- 172.21.15.46:0/343307529 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d015e140 con 0x7f84d0069560 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cf7fe700 1 --2- 172.21.15.46:0/343307529 >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 0x7f84d015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.782+0000 7f84cffff700 1 --2- 172.21.15.46:0/343307529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0069560 0x7f84d00699a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f84d00d1090 tx=0x7f84c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bc5536540d4437 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84ce7fc700 1 -- 172.21.15.46:0/343307529 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800e070 con 0x7f84d0069560 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84ce7fc700 1 -- 172.21.15.46:0/343307529 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800bc30 con 0x7f84d0069560 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84ce7fc700 1 -- 172.21.15.46:0/343307529 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8012430 con 0x7f84d0069560 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 -- 172.21.15.46:0/343307529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0069560 msgr2=0x7f84d00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/343307529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0069560 0x7f84d00699a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f84d00d1090 tx=0x7f84c8009780 comp rx=0 tx=0).stop 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 -- 172.21.15.46:0/343307529 shutdown_connections 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/343307529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0069560 0x7f84d00699a0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/343307529 >> v2:172.21.15.133:3300/0 conn(0x7f84d0159890 0x7f84d015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 -- 172.21.15.46:0/343307529 >> 172.21.15.46:0/343307529 conn(0x7f84d0068e20 msgr2=0x7f84d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 -- 172.21.15.46:0/343307529 shutdown_connections 2023-10-07T09:07:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.783+0000 7f84d5cf1700 1 -- 172.21.15.46:0/343307529 wait complete. 2023-10-07T09:07:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.784+0000 7f84d5cf1700 1 Processor -- start 2023-10-07T09:07:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 -- start start 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84d0069560 0x7f84d00c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 0x7f84d00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b4340 con 0x7f84d0159890 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b3730 con 0x7f84d0069560 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84d5cf1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b3a10 con 0x7f84d0159c60 2023-10-07T09:07:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84ceffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84ceffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36020/0 (socket says 172.21.15.46:36020) 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.785+0000 7f84ceffd700 1 -- 172.21.15.46:0/1031770975 learned_addr learned my addr 172.21.15.46:0/1031770975 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84cf7fe700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84d0069560 0x7f84d00c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84cffff700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 0x7f84d00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 -- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 msgr2=0x7f84d00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 0x7f84d00ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 -- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84d0069560 msgr2=0x7f84d00c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84d0069560 0x7f84d00c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 -- 172.21.15.46:0/1031770975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009a20 con 0x7f84d0159890 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84cffff700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 0x7f84d00ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84ceffd700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c560 tx=0x7f84c4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4005b30 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4005cb0 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00b3cf0 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4007320 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.786+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d0154890 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.787+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d004c3c0 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.787+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f84c401b3b0 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.788+0000 7f84b77fe700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 0x7f84bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.788+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f84c4083e40 con 0x7f84d0159890 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.788+0000 7f84cf7fe700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 0x7f84bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.789+0000 7f84cf7fe700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 0x7f84bc0697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f84c0006f00 tx=0x7f84c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.792+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84c4050e20 con 0x7f84d0159890 2023-10-07T09:07:15.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.987+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84d006a5b0 con 0x7f84d0159890 2023-10-07T09:07:15.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.988+0000 7f84b77fe700 1 -- 172.21.15.46:0/1031770975 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v178) v1 ==== 84+0+65 (secure 0 0 0) 0x7f84c4017020 con 0x7f84d0159890 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:15.989 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 msgr2=0x7f84bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 0x7f84bc0697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f84c0006f00 tx=0x7f84c0008040 comp rx=0 tx=0).stop 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 msgr2=0x7f84d0154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c560 tx=0x7f84c4001020 comp rx=0 tx=0).stop 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 shutdown_connections 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f84bc067320 0x7f84bc0697d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84d0159c60 0x7f84d00ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84d0069560 0x7f84d00c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 --2- 172.21.15.46:0/1031770975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84d0159890 0x7f84d0154350 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 >> 172.21.15.46:0/1031770975 conn(0x7f84d0068e20 msgr2=0x7f84d00c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 shutdown_connections 2023-10-07T09:07:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:15.990+0000 7f84d5cf1700 1 -- 172.21.15.46:0/1031770975 wait complete. 2023-10-07T09:07:16.003 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:07:16.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:07:16.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.125+0000 7f0461146700 1 Processor -- start 2023-10-07T09:07:16.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.125+0000 7f0461146700 1 -- start start 2023-10-07T09:07:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f0461146700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f045c159ec0 0x7f045c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f0461146700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0b5b00 con 0x7f045c0b53d0 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f0461146700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0b5850 con 0x7f045c0cf350 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f0461146700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c0b5da0 con 0x7f045c159ec0 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f045a59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f045c0b53d0 0x7f045c0cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55198/0 (socket says 172.21.15.46:55198) 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f045a59c700 1 -- 172.21.15.46:0/772406071 learned_addr learned my addr 172.21.15.46:0/772406071 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.126+0000 7f045ad9d700 1 --2- 172.21.15.46:0/772406071 >> v2:172.21.15.133:3300/0 conn(0x7f045c159ec0 0x7f045c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185028802 0 0) 0x7f045c0b5b00 con 0x7f045c0b53d0 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0448003570 con 0x7f045c0b53d0 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832878839 0 0) 0x7f045c0b5850 con 0x7f045c0cf350 2023-10-07T09:07:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c0b5b00 con 0x7f045c0cf350 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321493000 0 0) 0x7f0448003570 con 0x7f045c0b53d0 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 >> v2:172.21.15.133:3300/0 conn(0x7f045c159ec0 msgr2=0x7f045c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 --2- 172.21.15.46:0/772406071 >> v2:172.21.15.133:3300/0 conn(0x7f045c159ec0 0x7f045c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 >> v1:172.21.15.133:6789/0 conn(0x7f045c0cf350 legacy=0x7f045c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0b6080 con 0x7f045c0b53d0 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f0444001470 con 0x7f045c0b53d0 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 >> v1:172.21.15.46:6789/0 conn(0x7f045c0b53d0 legacy=0x7f045c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 0x7f0448003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04480051c0 0x7f044800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0b5da0 con 0x7f0448003bf0 2023-10-07T09:07:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044800c0b0 con 0x7f04480051c0 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044800c270 con 0x7f0448004810 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 0x7f0448003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045b59e700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04480051c0 0x7f044800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045a59c700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 -- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448004810 msgr2=0x7f0448004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 -- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04480051c0 msgr2=0x7f044800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04480051c0 0x7f044800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045b59e700 1 -- 172.21.15.46:0/772406071 reap_dead start 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045ad9d700 1 -- 172.21.15.46:0/772406071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448003570 con 0x7f0448003bf0 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.127+0000 7f045a59c700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f045ad9d700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 0x7f0448003fe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f044c009bf0 tx=0x7f044c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f3046f7f85a307 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c005a00 con 0x7f0448003bf0 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c005b60 con 0x7f0448003bf0 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0459d9b700 1 -- 172.21.15.46:0/772406071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00e710 con 0x7f0448003bf0 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 -- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 msgr2=0x7f0448003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 0x7f0448003fe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f044c009bf0 tx=0x7f044c009120 comp rx=0 tx=0).stop 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 -- 172.21.15.46:0/772406071 shutdown_connections 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 --2- 172.21.15.46:0/772406071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0448003bf0 0x7f0448003fe0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 -- 172.21.15.46:0/772406071 >> 172.21.15.46:0/772406071 conn(0x7f045c0999f0 msgr2=0x7f045c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 -- 172.21.15.46:0/772406071 shutdown_connections 2023-10-07T09:07:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.128+0000 7f0461146700 1 -- 172.21.15.46:0/772406071 wait complete. 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 Processor -- start 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 -- start start 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 0x7f045c068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 0x7f045c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c1544b0 con 0x7f045c153200 2023-10-07T09:07:16.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c069720 con 0x7f045c14f020 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f0461146700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c153670 con 0x7f0448003bf0 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f045a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f045a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36038/0 (socket says 172.21.15.46:36038) 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.130+0000 7f045a59c700 1 -- 172.21.15.46:0/3891568297 learned_addr learned my addr 172.21.15.46:0/3891568297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045ad9d700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 0x7f045c068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045b59e700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 0x7f045c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 -- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 msgr2=0x7f045c068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 0x7f045c068ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 -- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 msgr2=0x7f045c14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 0x7f045c14f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 -- 172.21.15.46:0/3891568297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c153930 con 0x7f045c153200 2023-10-07T09:07:16.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045ad9d700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 0x7f045c068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045b59e700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 0x7f045c14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f045a59c700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f04440010e0 tx=0x7f0444001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444012590 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440126f0 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c153c10 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444012ab0 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.131+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c1541d0 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.132+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c069890 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.132+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f044401d460 con 0x7f045c153200 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.133+0000 7f0452ffd700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 0x7f043c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.133+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0444084790 con 0x7f045c153200 2023-10-07T09:07:16.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.133+0000 7f045ad9d700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 0x7f043c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.133+0000 7f045ad9d700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 0x7f043c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f044c009bf0 tx=0x7f044c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.137+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f045c069890 con 0x7f045c153200 2023-10-07T09:07:16.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.330+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f045c069890 con 0x7f045c153200 2023-10-07T09:07:16.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.540+0000 7f0452ffd700 1 -- 172.21.15.46:0/3891568297 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v179) v1 ==== 138+0+0 (secure 0 0 0) 0x7f045c069890 con 0x7f045c153200 2023-10-07T09:07:16.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.544+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 msgr2=0x7f043c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.544+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 0x7f043c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f044c009bf0 tx=0x7f044c019000 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.544+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 msgr2=0x7f045c0d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.544+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f04440010e0 tx=0x7f0444001500 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 shutdown_connections 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f043c067320 0x7f043c0697d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c14f020 0x7f045c14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0448003bf0 0x7f045c068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 --2- 172.21.15.46:0/3891568297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045c153200 0x7f045c0d0950 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 >> 172.21.15.46:0/3891568297 conn(0x7f045c0999f0 msgr2=0x7f045c1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 shutdown_connections 2023-10-07T09:07:16.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.545+0000 7f0461146700 1 -- 172.21.15.46:0/3891568297 wait complete. 2023-10-07T09:07:16.548 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:07:16.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:07:16.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.686+0000 7ff571d4a700 1 Processor -- start 2023-10-07T09:07:16.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.686+0000 7ff571d4a700 1 -- start start 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff571d4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff56c069c70 0x7ff56c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff571d4a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff56c0af320 0x7ff56c0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff571d4a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0ce380 con 0x7ff56c159950 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff571d4a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0cec20 con 0x7ff56c0af320 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff571d4a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0afa90 con 0x7ff56c069c70 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff56c0af320 0x7ff56c0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff56c0af320 0x7ff56c0cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36054/0 (socket says 172.21.15.46:36054) 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 -- 172.21.15.46:0/421571962 learned_addr learned my addr 172.21.15.46:0/421571962 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff563fff700 1 --2- 172.21.15.46:0/421571962 >> v2:172.21.15.133:3300/0 conn(0x7ff56c069c70 0x7ff56c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 -- 172.21.15.46:0/421571962 >> v2:172.21.15.133:3300/0 conn(0x7ff56c069c70 msgr2=0x7ff56c0cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 --2- 172.21.15.46:0/421571962 >> v2:172.21.15.133:3300/0 conn(0x7ff56c069c70 0x7ff56c0cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 -- 172.21.15.46:0/421571962 >> v1:172.21.15.133:6789/0 conn(0x7ff56c159950 legacy=0x7ff56c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 -- 172.21.15.46:0/421571962 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0ce5d0 con 0x7ff56c0af320 2023-10-07T09:07:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56bfff700 1 --2- 172.21.15.46:0/421571962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c0af320 0x7ff56c0cf0b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff56c15d450 tx=0x7ff564009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e993a94994534d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.687+0000 7ff56affd700 1 -- 172.21.15.46:0/421571962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400e070 con 0x7ff56c0af320 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff56affd700 1 -- 172.21.15.46:0/421571962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400ba10 con 0x7ff56c0af320 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff56affd700 1 -- 172.21.15.46:0/421571962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640092e0 con 0x7ff56c0af320 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 -- 172.21.15.46:0/421571962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c0af320 msgr2=0x7ff56c0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 --2- 172.21.15.46:0/421571962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c0af320 0x7ff56c0cf0b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff56c15d450 tx=0x7ff564009840 comp rx=0 tx=0).stop 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 -- 172.21.15.46:0/421571962 shutdown_connections 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 --2- 172.21.15.46:0/421571962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c0af320 0x7ff56c0cf0b0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 --2- 172.21.15.46:0/421571962 >> v2:172.21.15.133:3300/0 conn(0x7ff56c069c70 0x7ff56c0cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 -- 172.21.15.46:0/421571962 >> 172.21.15.46:0/421571962 conn(0x7ff56c068e00 msgr2=0x7ff56c0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 -- 172.21.15.46:0/421571962 shutdown_connections 2023-10-07T09:07:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.688+0000 7ff571d4a700 1 -- 172.21.15.46:0/421571962 wait complete. 2023-10-07T09:07:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.689+0000 7ff571d4a700 1 Processor -- start 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.689+0000 7ff571d4a700 1 -- start start 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 0x7ff56c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff56c159950 0x7ff56c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b1c50 con 0x7ff56c069c70 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b1f30 con 0x7ff56c0af320 2023-10-07T09:07:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff571d4a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b2210 con 0x7ff56c159950 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36058/0 (socket says 172.21.15.46:36058) 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 -- 172.21.15.46:0/1426340742 learned_addr learned my addr 172.21.15.46:0/1426340742 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56bfff700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff56c159950 0x7ff56c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff563fff700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 0x7ff56c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 -- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff56c159950 msgr2=0x7ff56c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff56c159950 0x7ff56c0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 -- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 msgr2=0x7ff56c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 0x7ff56c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff56b7fe700 1 -- 172.21.15.46:0/1426340742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009ae0 con 0x7ff56c069c70 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.690+0000 7ff563fff700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 0x7ff56c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff56b7fe700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00b5e0 tx=0x7ff55c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00f510 con 0x7ff56c069c70 2023-10-07T09:07:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00f670 con 0x7ff56c069c70 2023-10-07T09:07:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c0b24f0 con 0x7ff56c069c70 2023-10-07T09:07:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00fa30 con 0x7ff56c069c70 2023-10-07T09:07:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.691+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c0b1890 con 0x7ff56c069c70 2023-10-07T09:07:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.692+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c0718b0 con 0x7ff56c069c70 2023-10-07T09:07:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.692+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff55c01a400 con 0x7ff56c069c70 2023-10-07T09:07:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.693+0000 7ff5637fe700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 0x7ff54c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.693+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff55c084430 con 0x7ff56c069c70 2023-10-07T09:07:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.693+0000 7ff563fff700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 0x7ff54c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.694+0000 7ff563fff700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 0x7ff54c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff554006fd0 tx=0x7ff554008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.697+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff55c051420 con 0x7ff56c069c70 2023-10-07T09:07:16.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:16.890+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff56c0ce8b0 con 0x7ff56c069c70 2023-10-07T09:07:17.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.544+0000 7ff5637fe700 1 -- 172.21.15.46:0/1426340742 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v180) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff55c054a40 con 0x7ff56c069c70 2023-10-07T09:07:17.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.553+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 msgr2=0x7ff54c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.553+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 0x7ff54c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff554006fd0 tx=0x7ff554008040 comp rx=0 tx=0).stop 2023-10-07T09:07:17.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.553+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 msgr2=0x7ff56c0b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.553+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00b5e0 tx=0x7ff55c009120 comp rx=0 tx=0).stop 2023-10-07T09:07:17.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 shutdown_connections 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff54c067320 0x7ff54c0697d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff56c159950 0x7ff56c0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c069c70 0x7ff56c0b5c00 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 --2- 172.21.15.46:0/1426340742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff56c0af320 0x7ff56c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.554+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 >> 172.21.15.46:0/1426340742 conn(0x7ff56c068e00 msgr2=0x7ff56c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.555+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 shutdown_connections 2023-10-07T09:07:17.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.555+0000 7ff571d4a700 1 -- 172.21.15.46:0/1426340742 wait complete. 2023-10-07T09:07:17.564 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:07:17.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:07:17.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.702+0000 7f274759e700 1 Processor -- start 2023-10-07T09:07:17.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.702+0000 7f274759e700 1 -- start start 2023-10-07T09:07:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27480b4e70 0x7f27480ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27480b16d0 0x7f27480b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480b2080 con 0x7f274815d240 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480cfb00 con 0x7f27480b16d0 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480b5c40 con 0x7f27480b4e70 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f2745d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27480b16d0 0x7f27480b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f2745d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27480b16d0 0x7f27480b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36062/0 (socket says 172.21.15.46:36062) 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f2745d9b700 1 -- 172.21.15.46:0/1978469514 learned_addr learned my addr 172.21.15.46:0/1978469514 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.703+0000 7f274659c700 1 --2- 172.21.15.46:0/1978469514 >> v2:172.21.15.133:3300/0 conn(0x7f27480b4e70 0x7f27480ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f2745d9b700 1 -- 172.21.15.46:0/1978469514 >> v2:172.21.15.133:3300/0 conn(0x7f27480b4e70 msgr2=0x7f27480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f2745d9b700 1 --2- 172.21.15.46:0/1978469514 >> v2:172.21.15.133:3300/0 conn(0x7f27480b4e70 0x7f27480ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f2745d9b700 1 -- 172.21.15.46:0/1978469514 >> v1:172.21.15.133:6789/0 conn(0x7f274815d240 legacy=0x7f274815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f2745d9b700 1 -- 172.21.15.46:0/1978469514 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480b5f20 con 0x7f27480b16d0 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f2745d9b700 1 --2- 172.21.15.46:0/1978469514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27480b16d0 0x7f27480b1b40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2748064910 tx=0x7f2730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1664ebef9de81a5a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274559a700 1 -- 172.21.15.46:0/1978469514 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000b860 con 0x7f27480b16d0 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274559a700 1 -- 172.21.15.46:0/1978469514 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000b9c0 con 0x7f27480b16d0 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274559a700 1 -- 172.21.15.46:0/1978469514 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000bd60 con 0x7f27480b16d0 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 -- 172.21.15.46:0/1978469514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27480b16d0 msgr2=0x7f27480b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 --2- 172.21.15.46:0/1978469514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27480b16d0 0x7f27480b1b40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2748064910 tx=0x7f2730009250 comp rx=0 tx=0).stop 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 -- 172.21.15.46:0/1978469514 shutdown_connections 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 --2- 172.21.15.46:0/1978469514 >> v2:172.21.15.133:3300/0 conn(0x7f27480b4e70 0x7f27480ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 --2- 172.21.15.46:0/1978469514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27480b16d0 0x7f27480b1b40 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.704+0000 7f274759e700 1 -- 172.21.15.46:0/1978469514 >> 172.21.15.46:0/1978469514 conn(0x7f27480d10c0 msgr2=0x7f27480affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.705+0000 7f274759e700 1 -- 172.21.15.46:0/1978469514 shutdown_connections 2023-10-07T09:07:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.705+0000 7f274759e700 1 -- 172.21.15.46:0/1978469514 wait complete. 2023-10-07T09:07:17.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 Processor -- start 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 -- start start 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27480b16d0 0x7f274814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27480b4e70 0x7f274815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480c6280 con 0x7f274815d240 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274814b690 con 0x7f27480b16d0 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f274759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274815c1c0 con 0x7f27480b4e70 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f2746d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f2746d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36074/0 (socket says 172.21.15.46:36074) 2023-10-07T09:07:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.706+0000 7f2746d9d700 1 -- 172.21.15.46:0/49322505 learned_addr learned my addr 172.21.15.46:0/49322505 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2745d9b700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27480b4e70 0x7f274815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 -- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27480b4e70 msgr2=0x7f274815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f274659c700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27480b16d0 0x7f274814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27480b4e70 0x7f274815c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 -- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27480b16d0 msgr2=0x7f274814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27480b16d0 0x7f274814b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 -- 172.21.15.46:0/49322505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300094f0 con 0x7f274815d240 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f2746d9d700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f273800c4f0 tx=0x7f2738007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011590 con 0x7f274815d240 2023-10-07T09:07:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738011710 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274815b5b0 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011ad0 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.707+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274815b940 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.708+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274815bf40 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.708+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f273801b3b0 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.709+0000 7f273e7fc700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 0x7f27280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.709+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2738084000 con 0x7f274815d240 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.709+0000 7f274659c700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 0x7f27280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.710+0000 7f274659c700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 0x7f27280697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2740007460 tx=0x7f274000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.713+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2738050cf0 con 0x7f274815d240 2023-10-07T09:07:17.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:17.956+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27480cf780 con 0x7f274815d240 2023-10-07T09:07:18.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.575+0000 7f273e7fc700 1 -- 172.21.15.46:0/49322505 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v119) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2738017020 con 0x7f274815d240 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.591+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 msgr2=0x7f27280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.591+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 0x7f27280697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2740007460 tx=0x7f274000b040 comp rx=0 tx=0).stop 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.591+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 msgr2=0x7f274815cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.591+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f273800c4f0 tx=0x7f2738007f50 comp rx=0 tx=0).stop 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 shutdown_connections 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2728067320 0x7f27280697d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f274815d240 0x7f274815cb90 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27480b16d0 0x7f274814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 --2- 172.21.15.46:0/49322505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f27480b4e70 0x7f274815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 >> 172.21.15.46:0/49322505 conn(0x7f27480d10c0 msgr2=0x7f2748158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:18.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 shutdown_connections 2023-10-07T09:07:18.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.592+0000 7f274759e700 1 -- 172.21.15.46:0/49322505 wait complete. 2023-10-07T09:07:18.596 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 31 and data pool 32 2023-10-07T09:07:18.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:18.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.734+0000 7fbb8fad0700 1 Processor -- start 2023-10-07T09:07:18.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.734+0000 7fbb8fad0700 1 -- start start 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb88159890 0x7fbb8815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb88159c60 0x7fbb8815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb8815db10 0x7fbb88069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8815a160 con 0x7fbb8815db10 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880d13a0 con 0x7fbb88159890 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8fad0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8815e140 con 0x7fbb88159c60 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb8815db10 0x7fbb88069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb8815db10 0x7fbb88069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36090/0 (socket says 172.21.15.46:36090) 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 -- 172.21.15.46:0/2511802177 learned_addr learned my addr 172.21.15.46:0/2511802177 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8d86c700 1 --2- 172.21.15.46:0/2511802177 >> v2:172.21.15.133:3300/0 conn(0x7fbb88159890 0x7fbb8815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8d06b700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb88159c60 0x7fbb8815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 -- 172.21.15.46:0/2511802177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb88159c60 msgr2=0x7fbb8815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb88159c60 0x7fbb8815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 -- 172.21.15.46:0/2511802177 >> v2:172.21.15.133:3300/0 conn(0x7fbb88159890 msgr2=0x7fbb8815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 --2- 172.21.15.46:0/2511802177 >> v2:172.21.15.133:3300/0 conn(0x7fbb88159890 0x7fbb8815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 -- 172.21.15.46:0/2511802177 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8815a3d0 con 0x7fbb8815db10 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.735+0000 7fbb8e06d700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb8815db10 0x7fbb88069560 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbb880d1090 tx=0x7fbb80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98bd79811c2dba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8c86a700 1 -- 172.21.15.46:0/2511802177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000e070 con 0x7fbb8815db10 2023-10-07T09:07:18.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8c86a700 1 -- 172.21.15.46:0/2511802177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000ba20 con 0x7fbb8815db10 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8c86a700 1 -- 172.21.15.46:0/2511802177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800092e0 con 0x7fbb8815db10 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 -- 172.21.15.46:0/2511802177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb8815db10 msgr2=0x7fbb88069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb8815db10 0x7fbb88069560 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbb880d1090 tx=0x7fbb80009840 comp rx=0 tx=0).stop 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 -- 172.21.15.46:0/2511802177 shutdown_connections 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb8815db10 0x7fbb88069560 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/2511802177 >> v2:172.21.15.133:3300/0 conn(0x7fbb88159890 0x7fbb8815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/2511802177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb88159c60 0x7fbb8815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 -- 172.21.15.46:0/2511802177 >> 172.21.15.46:0/2511802177 conn(0x7fbb88068e20 msgr2=0x7fbb880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 -- 172.21.15.46:0/2511802177 shutdown_connections 2023-10-07T09:07:18.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.736+0000 7fbb8fad0700 1 -- 172.21.15.46:0/2511802177 wait complete. 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.737+0000 7fbb8fad0700 1 Processor -- start 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.737+0000 7fbb8fad0700 1 -- start start 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 0x7fbb880b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8815db10 0x7fbb880cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88153e70 con 0x7fbb88159c60 2023-10-07T09:07:18.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88153860 con 0x7fbb88159890 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8fad0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880cfbc0 con 0x7fbb8815db10 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36106/0 (socket says 172.21.15.46:36106) 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 -- 172.21.15.46:0/423974053 learned_addr learned my addr 172.21.15.46:0/423974053 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d86c700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 0x7fbb880b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8e06d700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8815db10 0x7fbb880cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 -- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8815db10 msgr2=0x7fbb880cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8815db10 0x7fbb880cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 -- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 msgr2=0x7fbb880b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 0x7fbb880b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d06b700 1 -- 172.21.15.46:0/423974053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009ae0 con 0x7fbb88159c60 2023-10-07T09:07:18.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.738+0000 7fbb8d86c700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 0x7fbb880b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb8d06b700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d860 tx=0x7fbb78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780125f0 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78012750 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb88153b00 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78012af0 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.739+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88151010 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.740+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8804c3c0 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.740+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbb78013480 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.741+0000 7fbb7dffb700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 0x7fbb6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.741+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb78084fd0 con 0x7fbb88159c60 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.741+0000 7fbb8d86c700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 0x7fbb6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.741+0000 7fbb8d86c700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 0x7fbb6c0697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbb8816cab0 tx=0x7fbb840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:18.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.745+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb780556f0 con 0x7fbb88159c60 2023-10-07T09:07:18.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.937+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb88153fb0 con 0x7fbb88159c60 2023-10-07T09:07:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.938+0000 7fbb7dffb700 1 -- 172.21.15.46:0/423974053 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fbb78055280 con 0x7fbb88159c60 2023-10-07T09:07:18.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:18.939 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":181,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:17.957000+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:16.921910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 msgr2=0x7fbb6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 0x7fbb6c0697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbb8816cab0 tx=0x7fbb840091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 msgr2=0x7fbb880cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d860 tx=0x7fbb78008040 comp rx=0 tx=0).stop 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 shutdown_connections 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbb6c067320 0x7fbb6c0697d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8815db10 0x7fbb880cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb88159890 0x7fbb880b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 --2- 172.21.15.46:0/423974053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb88159c60 0x7fbb880cf0b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.940+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 >> 172.21.15.46:0/423974053 conn(0x7fbb88068e20 msgr2=0x7fbb88152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.941+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 shutdown_connections 2023-10-07T09:07:18.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:18.941+0000 7fbb8fad0700 1 -- 172.21.15.46:0/423974053 wait complete. 2023-10-07T09:07:18.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:19.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.072+0000 7fa64ca18700 1 Processor -- start 2023-10-07T09:07:19.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.072+0000 7fa64ca18700 1 -- start start 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.073+0000 7fa64ca18700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa648159890 0x7fa64815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.073+0000 7fa64ca18700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa648159c60 0x7fa64815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.073+0000 7fa64ca18700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64815a160 con 0x7fa64815db10 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.073+0000 7fa64ca18700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6480d13a0 con 0x7fa648159890 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.073+0000 7fa64ca18700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64815e140 con 0x7fa648159c60 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa648159890 0x7fa64815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa646d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa64815db10 0x7fa648069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55204/0 (socket says 172.21.15.46:55204) 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa646d9d700 1 -- 172.21.15.46:0/29832778 learned_addr learned my addr 172.21.15.46:0/29832778 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:19.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa645d9b700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa648159c60 0x7fa64815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 -- 172.21.15.46:0/29832778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa648159c60 msgr2=0x7fa64815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa648159c60 0x7fa64815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 -- 172.21.15.46:0/29832778 >> v1:172.21.15.46:6789/0 conn(0x7fa64815db10 legacy=0x7fa648069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 -- 172.21.15.46:0/29832778 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64815a3d0 con 0x7fa648159890 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64559a700 1 -- 172.21.15.46:0/29832778 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110157686 0 0) 0x7fa64815a160 con 0x7fa64815db10 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64659c700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159890 0x7fa64815abd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fa640009e60 tx=0x7fa640009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfcb2090627c89d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64559a700 1 -- 172.21.15.46:0/29832778 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64000e070 con 0x7fa648159890 2023-10-07T09:07:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64559a700 1 -- 172.21.15.46:0/29832778 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64000bb60 con 0x7fa648159890 2023-10-07T09:07:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.074+0000 7fa64559a700 1 -- 172.21.15.46:0/29832778 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640012430 con 0x7fa648159890 2023-10-07T09:07:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 -- 172.21.15.46:0/29832778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159890 msgr2=0x7fa64815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159890 0x7fa64815abd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fa640009e60 tx=0x7fa640009780 comp rx=0 tx=0).stop 2023-10-07T09:07:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 -- 172.21.15.46:0/29832778 shutdown_connections 2023-10-07T09:07:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159890 0x7fa64815abd0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 --2- 172.21.15.46:0/29832778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa648159c60 0x7fa64815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 -- 172.21.15.46:0/29832778 >> 172.21.15.46:0/29832778 conn(0x7fa648068e20 msgr2=0x7fa6480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 -- 172.21.15.46:0/29832778 shutdown_connections 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.075+0000 7fa64ca18700 1 -- 172.21.15.46:0/29832778 wait complete. 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.076+0000 7fa64ca18700 1 Processor -- start 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.076+0000 7fa64ca18700 1 -- start start 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa648159890 0x7fa6480cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa64815db10 0x7fa6480cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6480ce140 con 0x7fa648159c60 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6480b36c0 con 0x7fa648159890 2023-10-07T09:07:19.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64ca18700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6480cd600 con 0x7fa64815db10 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36136/0 (socket says 172.21.15.46:36136) 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 -- 172.21.15.46:0/2707223581 learned_addr learned my addr 172.21.15.46:0/2707223581 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 -- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa64815db10 msgr2=0x7fa6480cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa64815db10 0x7fa6480cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 -- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa648159890 msgr2=0x7fa6480cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa64659c700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa648159890 0x7fa6480cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa648159890 0x7fa6480cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 -- 172.21.15.46:0/2707223581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640009a20 con 0x7fa648159c60 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa645d9b700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fa63000ec80 tx=0x7fa6300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000c9d0 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.077+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000cb30 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.078+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630013470 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.078+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6480cd8a0 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.078+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6480cde60 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.079+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64804c3c0 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.079+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa630013860 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.079+0000 7fa63e7fc700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 0x7fa6280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.080+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa630084ff0 con 0x7fa648159c60 2023-10-07T09:07:19.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.080+0000 7fa64659c700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 0x7fa6280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.080+0000 7fa64659c700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 0x7fa6280697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa6400097c0 tx=0x7fa640019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.084+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa630051c80 con 0x7fa648159c60 2023-10-07T09:07:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.279+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6480b3800 con 0x7fa648159c60 2023-10-07T09:07:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.280+0000 7fa63e7fc700 1 -- 172.21.15.46:0/2707223581 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fa6300552a0 con 0x7fa648159c60 2023-10-07T09:07:19.281 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:19.281 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":181,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:17.957000+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:16.921910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 msgr2=0x7fa6280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 0x7fa6280697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa6400097c0 tx=0x7fa640019000 comp rx=0 tx=0).stop 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 msgr2=0x7fa6480c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fa63000ec80 tx=0x7fa6300091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 shutdown_connections 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa628067320 0x7fa6280697d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa64815db10 0x7fa6480cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa648159890 0x7fa6480cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 --2- 172.21.15.46:0/2707223581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa648159c60 0x7fa6480c7df0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 >> 172.21.15.46:0/2707223581 conn(0x7fa648068e20 msgr2=0x7fa64814d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 shutdown_connections 2023-10-07T09:07:19.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.282+0000 7fa64ca18700 1 -- 172.21.15.46:0/2707223581 wait complete. 2023-10-07T09:07:19.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:07:19.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.416+0000 7f0b8f59e700 1 Processor -- start 2023-10-07T09:07:19.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.416+0000 7f0b8f59e700 1 -- start start 2023-10-07T09:07:19.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b90159a60 0x7f0b900c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900c9cb0 con 0x7f0b900ccc00 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b900cbbd0 con 0x7f0b90159a60 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9006dfc0 con 0x7f0b900cb230 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b90159a60 0x7f0b900c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b90159a60 0x7f0b900c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36142/0 (socket says 172.21.15.46:36142) 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 -- 172.21.15.46:0/2066279381 learned_addr learned my addr 172.21.15.46:0/2066279381 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8ed9d700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 -- 172.21.15.46:0/2066279381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 msgr2=0x7f0b900cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 -- 172.21.15.46:0/2066279381 >> v1:172.21.15.133:6789/0 conn(0x7f0b900ccc00 legacy=0x7f0b90069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.417+0000 7f0b8e59c700 1 -- 172.21.15.46:0/2066279381 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900c9f30 con 0x7f0b90159a60 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8e59c700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b90159a60 0x7f0b900c9770 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0b880099e0 tx=0x7f0b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f555d5a3d73b40c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8d59a700 1 -- 172.21.15.46:0/2066279381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800b8b0 con 0x7f0b90159a60 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8d59a700 1 -- 172.21.15.46:0/2066279381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800ba10 con 0x7f0b90159a60 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8d59a700 1 -- 172.21.15.46:0/2066279381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800bdb0 con 0x7f0b90159a60 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 -- 172.21.15.46:0/2066279381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b90159a60 msgr2=0x7f0b900c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b90159a60 0x7f0b900c9770 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0b880099e0 tx=0x7f0b88009250 comp rx=0 tx=0).stop 2023-10-07T09:07:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 -- 172.21.15.46:0/2066279381 shutdown_connections 2023-10-07T09:07:19.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/2066279381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b90159a60 0x7f0b900c9770 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 -- 172.21.15.46:0/2066279381 >> 172.21.15.46:0/2066279381 conn(0x7f0b9006baa0 msgr2=0x7f0b9006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:19.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 -- 172.21.15.46:0/2066279381 shutdown_connections 2023-10-07T09:07:19.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.418+0000 7f0b8f59e700 1 -- 172.21.15.46:0/2066279381 wait complete. 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.419+0000 7f0b8f59e700 1 Processor -- start 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 -- start start 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 0x7f0b9016d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900c5ca0 con 0x7f0b900ccc00 2023-10-07T09:07:19.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900b37f0 con 0x7f0b90159a60 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900b3ad0 con 0x7f0b900cb230 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36150/0 (socket says 172.21.15.46:36150) 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8dd9b700 1 -- 172.21.15.46:0/196234890 learned_addr learned my addr 172.21.15.46:0/196234890 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8ed9d700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 0x7f0b9016d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.420+0000 7f0b8e59c700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 -- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 msgr2=0x7f0b900b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 -- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 msgr2=0x7f0b9016d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 0x7f0b9016d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 -- 172.21.15.46:0/196234890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880094f0 con 0x7f0b900ccc00 2023-10-07T09:07:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8ed9d700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 0x7f0b9016d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8dd9b700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c590 tx=0x7f0b7800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011590 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b780116f0 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011ab0 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b900b3db0 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.421+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b90155290 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.422+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b900c5e10 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.422+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0b7801b3b0 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.423+0000 7f0b867fc700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 0x7f0b700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.423+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b78084220 con 0x7f0b900ccc00 2023-10-07T09:07:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.423+0000 7f0b8e59c700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 0x7f0b700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:19.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.423+0000 7f0b8e59c700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 0x7f0b700697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0b880099e0 tx=0x7f0b88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:19.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.427+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b78050eb0 con 0x7f0b900ccc00 2023-10-07T09:07:19.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:19.667+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b900ca470 con 0x7f0b900ccc00 2023-10-07T09:07:20.538 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-10-07T09:07:20.537+0000 7fce4f881700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:07:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.582+0000 7f0b867fc700 1 -- 172.21.15.46:0/196234890 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v122) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b780544d0 con 0x7f0b900ccc00 2023-10-07T09:07:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.585+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 msgr2=0x7f0b700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.585+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 0x7f0b700697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0b880099e0 tx=0x7f0b88017000 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.585+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 msgr2=0x7f0b9016d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.585+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c590 tx=0x7f0b7800c950 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 shutdown_connections 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0b70067320 0x7f0b700697d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b90159a60 0x7f0b9016d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0b900cb230 0x7f0b900b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 --2- 172.21.15.46:0/196234890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b900ccc00 0x7f0b9016d0e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 >> 172.21.15.46:0/196234890 conn(0x7f0b9006baa0 msgr2=0x7f0b9006ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 shutdown_connections 2023-10-07T09:07:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.586+0000 7f0b8f59e700 1 -- 172.21.15.46:0/196234890 wait complete. 2023-10-07T09:07:20.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:07:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.729+0000 7f0eaffef700 1 Processor -- start 2023-10-07T09:07:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eaffef700 1 -- start start 2023-10-07T09:07:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eaffef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eaffef700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea8069ee0 con 0x7f0ea8159890 2023-10-07T09:07:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eaffef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea815a160 con 0x7f0ea8159c60 2023-10-07T09:07:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eaffef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80d13a0 con 0x7f0ea8069560 2023-10-07T09:07:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eadd8b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0ea8159890 0x7f0ea815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53752/0 (socket says 172.21.15.46:53752) 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.730+0000 7f0eadd8b700 1 -- 172.21.15.46:0/1988717347 learned_addr learned my addr 172.21.15.46:0/1988717347 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eae58c700 1 --2- 172.21.15.46:0/1988717347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565891938 0 0) 0x7f0ea8069ee0 con 0x7f0ea8159890 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e90003570 con 0x7f0ea8159890 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752225016 0 0) 0x7f0ea815a160 con 0x7f0ea8159c60 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8069ee0 con 0x7f0ea8159c60 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424508797 0 0) 0x7f0e90003570 con 0x7f0ea8159890 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eae58c700 1 -- 172.21.15.46:0/1988717347 >> v1:172.21.15.133:6789/0 conn(0x7f0ea8159c60 legacy=0x7f0ea815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eae58c700 1 -- 172.21.15.46:0/1988717347 >> v1:172.21.15.46:6789/0 conn(0x7f0ea8159890 legacy=0x7f0ea815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eae58c700 1 -- 172.21.15.46:0/1988717347 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea815e140 con 0x7f0ea8069560 2023-10-07T09:07:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eae58c700 1 --2- 172.21.15.46:0/1988717347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea80699a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009e90 tx=0x7f0e98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b6a860e8f8a4c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.731+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800e070 con 0x7f0ea8069560 2023-10-07T09:07:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800b870 con 0x7f0ea8069560 2023-10-07T09:07:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eacd89700 1 -- 172.21.15.46:0/1988717347 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0001470 con 0x7f0ea8069560 2023-10-07T09:07:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 -- 172.21.15.46:0/1988717347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 msgr2=0x7f0ea80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 --2- 172.21.15.46:0/1988717347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea80699a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009e90 tx=0x7f0e98009780 comp rx=0 tx=0).stop 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 -- 172.21.15.46:0/1988717347 shutdown_connections 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 --2- 172.21.15.46:0/1988717347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea80699a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 -- 172.21.15.46:0/1988717347 >> 172.21.15.46:0/1988717347 conn(0x7f0ea8068e20 msgr2=0x7f0ea80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 -- 172.21.15.46:0/1988717347 shutdown_connections 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.732+0000 7f0eaffef700 1 -- 172.21.15.46:0/1988717347 wait complete. 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.733+0000 7f0eaffef700 1 Processor -- start 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.733+0000 7f0eaffef700 1 -- start start 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea8159890 0x7f0ea80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8149850 con 0x7f0ea8159c60 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80b18b0 con 0x7f0ea8159890 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eaffef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80b2430 con 0x7f0ea8069560 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49638/0 (socket says 172.21.15.46:49638) 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 -- 172.21.15.46:0/956810147 learned_addr learned my addr 172.21.15.46:0/956810147 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0ead58a700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea8159890 0x7f0ea80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eadd8b700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 -- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 msgr2=0x7f0ea8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 -- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea8159890 msgr2=0x7f0ea80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea8159890 0x7f0ea80cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.734+0000 7f0eae58c700 1 -- 172.21.15.46:0/956810147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009a20 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0eae58c700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80899c0 tx=0x7f0e98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98012bb0 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98012d30 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea80b1b00 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98012ea0 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.735+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80b20c0 con 0x7f0ea8159c60 2023-10-07T09:07:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.736+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea804c3c0 con 0x7f0ea8159c60 2023-10-07T09:07:20.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.736+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0e9801e8b0 con 0x7f0ea8159c60 2023-10-07T09:07:20.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.737+0000 7f0ea5ffb700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 0x7f0e940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:20.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.737+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e98087140 con 0x7f0ea8159c60 2023-10-07T09:07:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.737+0000 7f0eadd8b700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 0x7f0e940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.737+0000 7f0eadd8b700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 0x7f0e940697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0001ed0 tx=0x7f0ea0000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:20.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.741+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e98053cc0 con 0x7f0ea8159c60 2023-10-07T09:07:20.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:20.979+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ea80b27c0 con 0x7f0ea8159c60 2023-10-07T09:07:21.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.583+0000 7f0ea5ffb700 1 -- 172.21.15.46:0/956810147 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v123) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e980572e0 con 0x7f0ea8159c60 2023-10-07T09:07:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 msgr2=0x7f0e940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 0x7f0e940697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0001ed0 tx=0x7f0ea0000bc0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 msgr2=0x7f0ea80cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80899c0 tx=0x7f0e98017000 comp rx=0 tx=0).stop 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 shutdown_connections 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0e94067320 0x7f0e940697d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea8159c60 0x7f0ea80cfa70 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea8069560 0x7f0ea8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 --2- 172.21.15.46:0/956810147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea8159890 0x7f0ea80cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 >> 172.21.15.46:0/956810147 conn(0x7f0ea8068e20 msgr2=0x7f0ea8155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.586+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 shutdown_connections 2023-10-07T09:07:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.587+0000 7f0eaffef700 1 -- 172.21.15.46:0/956810147 wait complete. 2023-10-07T09:07:21.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:21.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.727+0000 7fa9d882a700 1 Processor -- start 2023-10-07T09:07:21.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.727+0000 7fa9d882a700 1 -- start start 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.728+0000 7fa9d882a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 0x7fa9d40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.728+0000 7fa9d882a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9d40699e0 0x7fa9d40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.728+0000 7fa9d882a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4069e40 con 0x7fa9d4159840 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.728+0000 7fa9d882a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40cfb30 con 0x7fa9d40699e0 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.728+0000 7fa9d882a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40cbc40 con 0x7fa9d4159c10 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9d40699e0 0x7fa9d40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9d40699e0 0x7fa9d40b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49644/0 (socket says 172.21.15.46:49644) 2023-10-07T09:07:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 -- 172.21.15.46:0/961213770 learned_addr learned my addr 172.21.15.46:0/961213770 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/961213770 >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 0x7fa9d40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 -- 172.21.15.46:0/961213770 >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 msgr2=0x7fa9d40694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 --2- 172.21.15.46:0/961213770 >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 0x7fa9d40694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 -- 172.21.15.46:0/961213770 >> v1:172.21.15.133:6789/0 conn(0x7fa9d4159840 legacy=0x7fa9d40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 -- 172.21.15.46:0/961213770 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40cbf10 con 0x7fa9d40699e0 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/961213770 >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 0x7fa9d40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d2d9d700 1 --2- 172.21.15.46:0/961213770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b05e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40cad30 tx=0x7fa9cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc7c9fdce1f25a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d159a700 1 -- 172.21.15.46:0/961213770 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00e070 con 0x7fa9d40699e0 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d159a700 1 -- 172.21.15.46:0/961213770 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00ba50 con 0x7fa9d40699e0 2023-10-07T09:07:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.729+0000 7fa9d159a700 1 -- 172.21.15.46:0/961213770 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0092e0 con 0x7fa9d40699e0 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 -- 172.21.15.46:0/961213770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 msgr2=0x7fa9d40b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 --2- 172.21.15.46:0/961213770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b05e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40cad30 tx=0x7fa9cc009840 comp rx=0 tx=0).stop 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 -- 172.21.15.46:0/961213770 shutdown_connections 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 --2- 172.21.15.46:0/961213770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b05e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 --2- 172.21.15.46:0/961213770 >> v2:172.21.15.133:3300/0 conn(0x7fa9d4159c10 0x7fa9d40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 -- 172.21.15.46:0/961213770 >> 172.21.15.46:0/961213770 conn(0x7fa9d4068e10 msgr2=0x7fa9d40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 -- 172.21.15.46:0/961213770 shutdown_connections 2023-10-07T09:07:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.730+0000 7fa9d882a700 1 -- 172.21.15.46:0/961213770 wait complete. 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.731+0000 7fa9d882a700 1 Processor -- start 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.731+0000 7fa9d882a700 1 -- start start 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 0x7fa9d416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 0x7fa9d4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d416a8a0 con 0x7fa9d40699e0 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415f070 con 0x7fa9d4159c10 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40b36a0 con 0x7fa9d4159840 2023-10-07T09:07:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49646/0 (socket says 172.21.15.46:49646) 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 -- 172.21.15.46:0/3915076038 learned_addr learned my addr 172.21.15.46:0/3915076038 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 0x7fa9d416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d2d9d700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 0x7fa9d4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 -- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 msgr2=0x7fa9d416a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 0x7fa9d416a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 -- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 msgr2=0x7fa9d4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 0x7fa9d4153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 -- 172.21.15.46:0/3915076038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc009ae0 con 0x7fa9d40699e0 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d2d9d700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 0x7fa9d4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 0x7fa9d416a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:21.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d259c700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c5c0 tx=0x7fa9c400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011590 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4011710 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.732+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d40b3980 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.733+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011ad0 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.733+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d40b3f40 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.733+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d4064550 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.734+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa9c401b3b0 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.734+0000 7fa9c27fc700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 0x7fa9b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.734+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9c4084090 con 0x7fa9d40699e0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.734+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 0x7fa9b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:21.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.735+0000 7fa9d1d9b700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 0x7fa9b40697d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006f00 tx=0x7fa9c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:21.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.738+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9c4050d20 con 0x7fa9d40699e0 2023-10-07T09:07:21.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.976+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9d4069e40 con 0x7fa9d40699e0 2023-10-07T09:07:21.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.977+0000 7fa9c27fc700 1 -- 172.21.15.46:0/3915076038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fa9d4069e40 con 0x7fa9d40699e0 2023-10-07T09:07:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:21.581896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 msgr2=0x7fa9b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 0x7fa9b40697d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006f00 tx=0x7fa9c8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 msgr2=0x7fa9d40b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c5c0 tx=0x7fa9c400c980 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 shutdown_connections 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa9b4067320 0x7fa9b40697d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9d4159c10 0x7fa9d4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d40699e0 0x7fa9d40b4740 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 --2- 172.21.15.46:0/3915076038 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa9d4159840 0x7fa9d416a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 >> 172.21.15.46:0/3915076038 conn(0x7fa9d4068e10 msgr2=0x7fa9d40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 shutdown_connections 2023-10-07T09:07:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:21.979+0000 7fa9d882a700 1 -- 172.21.15.46:0/3915076038 wait complete. 2023-10-07T09:07:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 123 2023-10-07T09:07:21.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.110+0000 7f4bbc8b3700 1 Processor -- start 2023-10-07T09:07:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.110+0000 7f4bbc8b3700 1 -- start start 2023-10-07T09:07:22.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bbc8b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4bb80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bbc8b3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb806a220 con 0x7f4bb81599c0 2023-10-07T09:07:22.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bbc8b3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb80cbf60 con 0x7f4bb80cbb30 2023-10-07T09:07:22.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bbc8b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb8069c70 con 0x7f4bb815ab90 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bb659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4bb81599c0 0x7f4bb8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53768/0 (socket says 172.21.15.46:53768) 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bb659c700 1 -- 172.21.15.46:0/733154771 learned_addr learned my addr 172.21.15.46:0/733154771 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250269466 0 0) 0x7f4bb806a220 con 0x7f4bb81599c0 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bb5d9b700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4bb80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.111+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba4003570 con 0x7f4bb81599c0 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651177225 0 0) 0x7f4ba4003570 con 0x7f4bb81599c0 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 msgr2=0x7f4bb80cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4bb80cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 >> v1:172.21.15.133:6789/0 conn(0x7f4bb80cbb30 legacy=0x7f4bb80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8069f40 con 0x7f4bb81599c0 2023-10-07T09:07:22.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f4bb0001470 con 0x7f4bb81599c0 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 >> v1:172.21.15.46:6789/0 conn(0x7f4bb81599c0 legacy=0x7f4bb8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba4003a90 0x7f4ba4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4ba4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba4004d50 0x7f4ba40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb8069c70 con 0x7f4ba4004d50 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba400bbf0 con 0x7f4ba4003a90 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba400bdb0 con 0x7f4bb815ab90 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba4004d50 0x7f4ba40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb5d9b700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4ba4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb659c700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba4003a90 0x7f4ba4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 msgr2=0x7f4ba4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:22.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb815ab90 0x7f4ba4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba4003a90 msgr2=0x7f4ba4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba4003a90 0x7f4ba4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/733154771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4003570 con 0x7f4ba4004d50 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba4004d50 0x7f4ba40051c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8001fc0 tx=0x7f4ba8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aef4a6ebc42ae5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8001950 con 0x7f4ba4004d50 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800c8b0 con 0x7f4ba4004d50 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.112+0000 7f4bb559a700 1 -- 172.21.15.46:0/733154771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cc50 con 0x7f4ba4004d50 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/733154771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba4004d50 msgr2=0x7f4ba40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/733154771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba4004d50 0x7f4ba40051c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8001fc0 tx=0x7f4ba8001640 comp rx=0 tx=0).stop 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/733154771 reap_dead start 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/733154771 shutdown_connections 2023-10-07T09:07:22.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/733154771 >> 172.21.15.46:0/733154771 conn(0x7f4bb8068e10 msgr2=0x7f4bb80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:22.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/733154771 shutdown_connections 2023-10-07T09:07:22.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.113+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/733154771 wait complete. 2023-10-07T09:07:22.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.114+0000 7f4bbc8b3700 1 Processor -- start 2023-10-07T09:07:22.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.114+0000 7f4bbc8b3700 1 -- start start 2023-10-07T09:07:22.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 0x7f4bb80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb815d550 0x7f4bb80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80b0f40 con 0x7f4bb80b4390 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80b4d50 con 0x7f4bb815d550 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bbc8b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80b0610 con 0x7f4ba4004d50 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49664/0 (socket says 172.21.15.46:49664) 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/3015555778 learned_addr learned my addr 172.21.15.46:0/3015555778 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb5d9b700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb815d550 0x7f4bb80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb659c700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 0x7f4bb80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 msgr2=0x7f4bb80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 0x7f4bb80c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb815d550 msgr2=0x7f4bb80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb815d550 0x7f4bb80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb6d9d700 1 -- 172.21.15.46:0/3015555778 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80b08f0 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.115+0000 7f4bb659c700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 0x7f4bb80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bb6d9d700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40057f0 tx=0x7f4ba8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cc30 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba80011c0 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80b0bd0 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8006dd0 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.116+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb80b5ee0 con 0x7f4bb80b4390 2023-10-07T09:07:22.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.117+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb80b6100 con 0x7f4bb80b4390 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.117+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4ba801f620 con 0x7f4bb80b4390 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.118+0000 7f4bae7fc700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 0x7f4b980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.118+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ba8085ec0 con 0x7f4bb80b4390 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.118+0000 7f4bb659c700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 0x7f4b980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.118+0000 7f4bb659c700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 0x7f4b980697d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0001ed0 tx=0x7f4bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.122+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ba8052b50 con 0x7f4bb80b4390 2023-10-07T09:07:22.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.318+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb8064550 con 0x7f4bb80b4390 2023-10-07T09:07:22.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.319+0000 7f4bae7fc700 1 -- 172.21.15.46:0/3015555778 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f4ba8024090 con 0x7f4bb80b4390 2023-10-07T09:07:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:22.320 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":182,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:19.559609+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:16.921910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:22.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 msgr2=0x7f4b980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 0x7f4b980697d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0001ed0 tx=0x7f4bb0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 msgr2=0x7f4bb8155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40057f0 tx=0x7f4ba8015000 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 shutdown_connections 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4b98067320 0x7f4b980697d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb80b4390 0x7f4bb8155110 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ba4004d50 0x7f4bb80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 --2- 172.21.15.46:0/3015555778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb815d550 0x7f4bb80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 >> 172.21.15.46:0/3015555778 conn(0x7f4bb8068e10 msgr2=0x7f4bb80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 shutdown_connections 2023-10-07T09:07:22.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.321+0000 7f4bbc8b3700 1 -- 172.21.15.46:0/3015555778 wait complete. 2023-10-07T09:07:22.334 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:07:22.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:07:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.452+0000 7f7ea37ba700 1 Processor -- start 2023-10-07T09:07:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.453+0000 7f7ea37ba700 1 -- start start 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.453+0000 7f7ea37ba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e9c159c60 0x7f7e9c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.453+0000 7f7ea37ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e9c15db10 0x7f7e9c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea37ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c15a160 con 0x7f7e9c159890 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea37ba700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c15df50 con 0x7f7e9c159c60 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea37ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d13a0 con 0x7f7e9c15db10 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e9c159c60 0x7f7e9c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea1556700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7e9c159890 0x7f7e9c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53778/0 (socket says 172.21.15.46:53778) 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea1556700 1 -- 172.21.15.46:0/932736467 learned_addr learned my addr 172.21.15.46:0/932736467 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea1d57700 1 --2- 172.21.15.46:0/932736467 >> v2:172.21.15.133:3300/0 conn(0x7f7e9c15db10 0x7f7e9c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 -- 172.21.15.46:0/932736467 >> v2:172.21.15.133:3300/0 conn(0x7f7e9c15db10 msgr2=0x7f7e9c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 --2- 172.21.15.46:0/932736467 >> v2:172.21.15.133:3300/0 conn(0x7f7e9c15db10 0x7f7e9c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 -- 172.21.15.46:0/932736467 >> v1:172.21.15.46:6789/0 conn(0x7f7e9c159890 legacy=0x7f7e9c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 -- 172.21.15.46:0/932736467 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c15e140 con 0x7f7e9c159c60 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7e9bfff700 1 -- 172.21.15.46:0/932736467 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401406569 0 0) 0x7f7e9c15a160 con 0x7f7e9c159890 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7ea0d55700 1 --2- 172.21.15.46:0/932736467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c15d5d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c06a890 tx=0x7f7e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46cff3c0e20d551 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7e9bfff700 1 -- 172.21.15.46:0/932736467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000b6b0 con 0x7f7e9c159c60 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7e9bfff700 1 -- 172.21.15.46:0/932736467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9000b810 con 0x7f7e9c159c60 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.454+0000 7f7e9bfff700 1 -- 172.21.15.46:0/932736467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000bbb0 con 0x7f7e9c159c60 2023-10-07T09:07:22.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 -- 172.21.15.46:0/932736467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 msgr2=0x7f7e9c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/932736467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c15d5d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c06a890 tx=0x7f7e900091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 -- 172.21.15.46:0/932736467 shutdown_connections 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/932736467 >> v2:172.21.15.133:3300/0 conn(0x7f7e9c15db10 0x7f7e9c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/932736467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c15d5d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 -- 172.21.15.46:0/932736467 >> 172.21.15.46:0/932736467 conn(0x7f7e9c068e20 msgr2=0x7f7e9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 -- 172.21.15.46:0/932736467 shutdown_connections 2023-10-07T09:07:22.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.455+0000 7f7ea37ba700 1 -- 172.21.15.46:0/932736467 wait complete. 2023-10-07T09:07:22.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.456+0000 7f7ea37ba700 1 Processor -- start 2023-10-07T09:07:22.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.456+0000 7f7ea37ba700 1 -- start start 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 0x7f7e9c14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 0x7f7e9c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0b1fb0 con 0x7f7e9c159c60 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c5ff0 con 0x7f7e9c159890 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea37ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c56c0 con 0x7f7e9c15db10 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49676/0 (socket says 172.21.15.46:49676) 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 -- 172.21.15.46:0/1820470828 learned_addr learned my addr 172.21.15.46:0/1820470828 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea1556700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 0x7f7e9c14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea1d57700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 0x7f7e9c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 -- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 msgr2=0x7f7e9c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 0x7f7e9c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 -- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 msgr2=0x7f7e9c14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 0x7f7e9c14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea0d55700 1 -- 172.21.15.46:0/1820470828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009420 con 0x7f7e9c159c60 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea1d57700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 0x7f7e9c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.457+0000 7f7ea1556700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 0x7f7e9c14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7ea0d55700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c070e20 tx=0x7f7e90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90011420 con 0x7f7e9c159c60 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90011580 con 0x7f7e9c159c60 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0c59a0 con 0x7f7e9c159c60 2023-10-07T09:07:22.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90011940 con 0x7f7e9c159c60 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.458+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c14bdd0 con 0x7f7e9c159c60 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.459+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0c6160 con 0x7f7e9c159c60 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.459+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7e90011d30 con 0x7f7e9c159c60 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.460+0000 7f7e997fa700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 0x7f7e880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.460+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e900861a0 con 0x7f7e9c159c60 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.460+0000 7f7ea1556700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 0x7f7e880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.460+0000 7f7ea1556700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 0x7f7e880697d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e940011e0 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.464+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e90052e30 con 0x7f7e9c159c60 2023-10-07T09:07:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.654+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e9c04c3c0 con 0x7f7e88067320 2023-10-07T09:07:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.663+0000 7f7e997fa700 1 -- 172.21.15.46:0/1820470828 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289986 (secure 0 0 0) 0x7f7e9c04c3c0 con 0x7f7e88067320 2023-10-07T09:07:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 msgr2=0x7f7e880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 0x7f7e880697d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e940011e0 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 msgr2=0x7f7e9c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c070e20 tx=0x7f7e90017000 comp rx=0 tx=0).stop 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 shutdown_connections 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e88067320 0x7f7e880697d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e9c15db10 0x7f7e9c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e9c159890 0x7f7e9c14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 --2- 172.21.15.46:0/1820470828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9c159c60 0x7f7e9c0cd610 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 >> 172.21.15.46:0/1820470828 conn(0x7f7e9c068e20 msgr2=0x7f7e9c1573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 shutdown_connections 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.666+0000 7f7ea37ba700 1 -- 172.21.15.46:0/1820470828 wait complete. 2023-10-07T09:07:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:07:22.680 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2023-10-07T09:07:21.888788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434412,"kb_used_data":19244,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540308,"statfs":{"total":773094113280,"available":770601275392,"internally_reserved":0,"allocated":19705856,"data_stored":9443228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349210"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589188+0000","last_change":"2023-10-07T09:07:18.589188+0000","last_active":"2023-10-07T09:07:18.589188+0000","last_peered":"2023-10-07T09:07:18.589188+0000","last_clean":"2023-10-07T09:07:18.589188+0000","last_became_active":"2023-10-07T09:07:18.588847+0000","last_became_peered":"2023-10-07T09:07:18.588847+0000","last_unstale":"2023-10-07T09:07:18.589188+0000","last_undegraded":"2023-10-07T09:07:18.589188+0000","last_fullsized":"2023-10-07T09:07:18.589188+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:05.200186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581891+0000","last_change":"2023-10-07T09:07:18.581891+0000","last_active":"2023-10-07T09:07:18.581891+0000","last_peered":"2023-10-07T09:07:18.581891+0000","last_clean":"2023-10-07T09:07:18.581891+0000","last_became_active":"2023-10-07T09:07:18.581344+0000","last_became_peered":"2023-10-07T09:07:18.581344+0000","last_unstale":"2023-10-07T09:07:18.581891+0000","last_undegraded":"2023-10-07T09:07:18.581891+0000","last_fullsized":"2023-10-07T09:07:18.581891+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:41.806488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580408+0000","last_change":"2023-10-07T09:07:18.576533+0000","last_active":"2023-10-07T09:07:18.580408+0000","last_peered":"2023-10-07T09:07:18.580408+0000","last_clean":"2023-10-07T09:07:18.580408+0000","last_became_active":"2023-10-07T09:07:18.576259+0000","last_became_peered":"2023-10-07T09:07:18.576259+0000","last_unstale":"2023-10-07T09:07:18.580408+0000","last_undegraded":"2023-10-07T09:07:18.580408+0000","last_fullsized":"2023-10-07T09:07:18.580408+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:53.020616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571811+0000","last_change":"2023-10-07T09:07:18.569718+0000","last_active":"2023-10-07T09:07:18.571811+0000","last_peered":"2023-10-07T09:07:18.571811+0000","last_clean":"2023-10-07T09:07:18.571811+0000","last_became_active":"2023-10-07T09:07:18.569449+0000","last_became_peered":"2023-10-07T09:07:18.569449+0000","last_unstale":"2023-10-07T09:07:18.571811+0000","last_undegraded":"2023-10-07T09:07:18.571811+0000","last_fullsized":"2023-10-07T09:07:18.571811+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578120+0000","last_change":"2023-10-07T09:07:18.578120+0000","last_active":"2023-10-07T09:07:18.578120+0000","last_peered":"2023-10-07T09:07:18.578120+0000","last_clean":"2023-10-07T09:07:18.578120+0000","last_became_active":"2023-10-07T09:07:18.577867+0000","last_became_peered":"2023-10-07T09:07:18.577867+0000","last_unstale":"2023-10-07T09:07:18.578120+0000","last_undegraded":"2023-10-07T09:07:18.578120+0000","last_fullsized":"2023-10-07T09:07:18.578120+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589741+0000","last_change":"2023-10-07T09:07:18.589741+0000","last_active":"2023-10-07T09:07:18.589741+0000","last_peered":"2023-10-07T09:07:18.589741+0000","last_clean":"2023-10-07T09:07:18.589741+0000","last_became_active":"2023-10-07T09:07:18.589359+0000","last_became_peered":"2023-10-07T09:07:18.589359+0000","last_unstale":"2023-10-07T09:07:18.589741+0000","last_undegraded":"2023-10-07T09:07:18.589741+0000","last_fullsized":"2023-10-07T09:07:18.589741+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:35:07.849497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571360+0000","last_change":"2023-10-07T09:07:18.571360+0000","last_active":"2023-10-07T09:07:18.571360+0000","last_peered":"2023-10-07T09:07:18.571360+0000","last_clean":"2023-10-07T09:07:18.571360+0000","last_became_active":"2023-10-07T09:07:18.571070+0000","last_became_peered":"2023-10-07T09:07:18.571070+0000","last_unstale":"2023-10-07T09:07:18.571360+0000","last_undegraded":"2023-10-07T09:07:18.571360+0000","last_fullsized":"2023-10-07T09:07:18.571360+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:41.806488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594726+0000","last_change":"2023-10-07T09:07:18.594726+0000","last_active":"2023-10-07T09:07:18.594726+0000","last_peered":"2023-10-07T09:07:18.594726+0000","last_clean":"2023-10-07T09:07:18.594726+0000","last_became_active":"2023-10-07T09:07:18.594493+0000","last_became_peered":"2023-10-07T09:07:18.594493+0000","last_unstale":"2023-10-07T09:07:18.594726+0000","last_undegraded":"2023-10-07T09:07:18.594726+0000","last_fullsized":"2023-10-07T09:07:18.594726+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:31.800203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.588845+0000","last_change":"2023-10-07T09:07:18.588845+0000","last_active":"2023-10-07T09:07:18.588845+0000","last_peered":"2023-10-07T09:07:18.588845+0000","last_clean":"2023-10-07T09:07:18.588845+0000","last_became_active":"2023-10-07T09:07:18.588428+0000","last_became_peered":"2023-10-07T09:07:18.588428+0000","last_unstale":"2023-10-07T09:07:18.588845+0000","last_undegraded":"2023-10-07T09:07:18.588845+0000","last_fullsized":"2023-10-07T09:07:18.588845+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:25.946755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580118+0000","last_change":"2023-10-07T09:07:18.574961+0000","last_active":"2023-10-07T09:07:18.580118+0000","last_peered":"2023-10-07T09:07:18.580118+0000","last_clean":"2023-10-07T09:07:18.580118+0000","last_became_active":"2023-10-07T09:07:18.574671+0000","last_became_peered":"2023-10-07T09:07:18.574671+0000","last_unstale":"2023-10-07T09:07:18.580118+0000","last_undegraded":"2023-10-07T09:07:18.580118+0000","last_fullsized":"2023-10-07T09:07:18.580118+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:50.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580390+0000","last_change":"2023-10-07T09:07:18.574463+0000","last_active":"2023-10-07T09:07:18.580390+0000","last_peered":"2023-10-07T09:07:18.580390+0000","last_clean":"2023-10-07T09:07:18.580390+0000","last_became_active":"2023-10-07T09:07:18.574172+0000","last_became_peered":"2023-10-07T09:07:18.574172+0000","last_unstale":"2023-10-07T09:07:18.580390+0000","last_undegraded":"2023-10-07T09:07:18.580390+0000","last_fullsized":"2023-10-07T09:07:18.580390+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589156+0000","last_change":"2023-10-07T09:07:18.589156+0000","last_active":"2023-10-07T09:07:18.589156+0000","last_peered":"2023-10-07T09:07:18.589156+0000","last_clean":"2023-10-07T09:07:18.589156+0000","last_became_active":"2023-10-07T09:07:18.588920+0000","last_became_peered":"2023-10-07T09:07:18.588920+0000","last_unstale":"2023-10-07T09:07:18.589156+0000","last_undegraded":"2023-10-07T09:07:18.589156+0000","last_fullsized":"2023-10-07T09:07:18.589156+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:43.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576927+0000","last_change":"2023-10-07T09:07:18.569610+0000","last_active":"2023-10-07T09:07:18.576927+0000","last_peered":"2023-10-07T09:07:18.576927+0000","last_clean":"2023-10-07T09:07:18.576927+0000","last_became_active":"2023-10-07T09:07:18.569341+0000","last_became_peered":"2023-10-07T09:07:18.569341+0000","last_unstale":"2023-10-07T09:07:18.576927+0000","last_undegraded":"2023-10-07T09:07:18.576927+0000","last_fullsized":"2023-10-07T09:07:18.576927+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:16.318264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582708+0000","last_change":"2023-10-07T09:07:18.582708+0000","last_active":"2023-10-07T09:07:18.582708+0000","last_peered":"2023-10-07T09:07:18.582708+0000","last_clean":"2023-10-07T09:07:18.582708+0000","last_became_active":"2023-10-07T09:07:18.582281+0000","last_became_peered":"2023-10-07T09:07:18.582281+0000","last_unstale":"2023-10-07T09:07:18.582708+0000","last_undegraded":"2023-10-07T09:07:18.582708+0000","last_fullsized":"2023-10-07T09:07:18.582708+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:10:31.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579331+0000","last_change":"2023-10-07T09:07:18.577822+0000","last_active":"2023-10-07T09:07:18.579331+0000","last_peered":"2023-10-07T09:07:18.579331+0000","last_clean":"2023-10-07T09:07:18.579331+0000","last_became_active":"2023-10-07T09:07:18.577561+0000","last_became_peered":"2023-10-07T09:07:18.577561+0000","last_unstale":"2023-10-07T09:07:18.579331+0000","last_undegraded":"2023-10-07T09:07:18.579331+0000","last_fullsized":"2023-10-07T09:07:18.579331+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571263+0000","last_change":"2023-10-07T09:07:18.568418+0000","last_active":"2023-10-07T09:07:18.571263+0000","last_peered":"2023-10-07T09:07:18.571263+0000","last_clean":"2023-10-07T09:07:18.571263+0000","last_became_active":"2023-10-07T09:07:18.568014+0000","last_became_peered":"2023-10-07T09:07:18.568014+0000","last_unstale":"2023-10-07T09:07:18.571263+0000","last_undegraded":"2023-10-07T09:07:18.571263+0000","last_fullsized":"2023-10-07T09:07:18.571263+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:55.202546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577942+0000","last_change":"2023-10-07T09:07:18.575759+0000","last_active":"2023-10-07T09:07:18.577942+0000","last_peered":"2023-10-07T09:07:18.577942+0000","last_clean":"2023-10-07T09:07:18.577942+0000","last_became_active":"2023-10-07T09:07:18.575454+0000","last_became_peered":"2023-10-07T09:07:18.575454+0000","last_unstale":"2023-10-07T09:07:18.577942+0000","last_undegraded":"2023-10-07T09:07:18.577942+0000","last_fullsized":"2023-10-07T09:07:18.577942+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:37.234087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580317+0000","last_change":"2023-10-07T09:07:18.577318+0000","last_active":"2023-10-07T09:07:18.580317+0000","last_peered":"2023-10-07T09:07:18.580317+0000","last_clean":"2023-10-07T09:07:18.580317+0000","last_became_active":"2023-10-07T09:07:18.577048+0000","last_became_peered":"2023-10-07T09:07:18.577048+0000","last_unstale":"2023-10-07T09:07:18.580317+0000","last_undegraded":"2023-10-07T09:07:18.580317+0000","last_fullsized":"2023-10-07T09:07:18.580317+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:43:29.248559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574715+0000","last_change":"2023-10-07T09:07:18.570372+0000","last_active":"2023-10-07T09:07:18.574715+0000","last_peered":"2023-10-07T09:07:18.574715+0000","last_clean":"2023-10-07T09:07:18.574715+0000","last_became_active":"2023-10-07T09:07:18.570093+0000","last_became_peered":"2023-10-07T09:07:18.570093+0000","last_unstale":"2023-10-07T09:07:18.574715+0000","last_undegraded":"2023-10-07T09:07:18.574715+0000","last_fullsized":"2023-10-07T09:07:18.574715+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:50.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573587+0000","last_change":"2023-10-07T09:07:18.573587+0000","last_active":"2023-10-07T09:07:18.573587+0000","last_peered":"2023-10-07T09:07:18.573587+0000","last_clean":"2023-10-07T09:07:18.573587+0000","last_became_active":"2023-10-07T09:07:18.573051+0000","last_became_peered":"2023-10-07T09:07:18.573051+0000","last_unstale":"2023-10-07T09:07:18.573587+0000","last_undegraded":"2023-10-07T09:07:18.573587+0000","last_fullsized":"2023-10-07T09:07:18.573587+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:18.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574403+0000","last_change":"2023-10-07T09:07:18.574403+0000","last_active":"2023-10-07T09:07:18.574403+0000","last_peered":"2023-10-07T09:07:18.574403+0000","last_clean":"2023-10-07T09:07:18.574403+0000","last_became_active":"2023-10-07T09:07:18.574130+0000","last_became_peered":"2023-10-07T09:07:18.574130+0000","last_unstale":"2023-10-07T09:07:18.574403+0000","last_undegraded":"2023-10-07T09:07:18.574403+0000","last_fullsized":"2023-10-07T09:07:18.574403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:19.920166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589603+0000","last_change":"2023-10-07T09:07:18.588988+0000","last_active":"2023-10-07T09:07:18.589603+0000","last_peered":"2023-10-07T09:07:18.589603+0000","last_clean":"2023-10-07T09:07:18.589603+0000","last_became_active":"2023-10-07T09:07:18.588704+0000","last_became_peered":"2023-10-07T09:07:18.588704+0000","last_unstale":"2023-10-07T09:07:18.589603+0000","last_undegraded":"2023-10-07T09:07:18.589603+0000","last_fullsized":"2023-10-07T09:07:18.589603+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:19.781339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574755+0000","last_change":"2023-10-07T09:07:18.570966+0000","last_active":"2023-10-07T09:07:18.574755+0000","last_peered":"2023-10-07T09:07:18.574755+0000","last_clean":"2023-10-07T09:07:18.574755+0000","last_became_active":"2023-10-07T09:07:18.570540+0000","last_became_peered":"2023-10-07T09:07:18.570540+0000","last_unstale":"2023-10-07T09:07:18.574755+0000","last_undegraded":"2023-10-07T09:07:18.574755+0000","last_fullsized":"2023-10-07T09:07:18.574755+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:34.139856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576666+0000","last_change":"2023-10-07T09:07:18.570867+0000","last_active":"2023-10-07T09:07:18.576666+0000","last_peered":"2023-10-07T09:07:18.576666+0000","last_clean":"2023-10-07T09:07:18.576666+0000","last_became_active":"2023-10-07T09:07:18.570604+0000","last_became_peered":"2023-10-07T09:07:18.570604+0000","last_unstale":"2023-10-07T09:07:18.576666+0000","last_undegraded":"2023-10-07T09:07:18.576666+0000","last_fullsized":"2023-10-07T09:07:18.576666+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.254578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577333+0000","last_change":"2023-10-07T09:07:18.577333+0000","last_active":"2023-10-07T09:07:18.577333+0000","last_peered":"2023-10-07T09:07:18.577333+0000","last_clean":"2023-10-07T09:07:18.577333+0000","last_became_active":"2023-10-07T09:07:18.577095+0000","last_became_peered":"2023-10-07T09:07:18.577095+0000","last_unstale":"2023-10-07T09:07:18.577333+0000","last_undegraded":"2023-10-07T09:07:18.577333+0000","last_fullsized":"2023-10-07T09:07:18.577333+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:33.512313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576916+0000","last_change":"2023-10-07T09:07:18.576916+0000","last_active":"2023-10-07T09:07:18.576916+0000","last_peered":"2023-10-07T09:07:18.576916+0000","last_clean":"2023-10-07T09:07:18.576916+0000","last_became_active":"2023-10-07T09:07:18.576668+0000","last_became_peered":"2023-10-07T09:07:18.576668+0000","last_unstale":"2023-10-07T09:07:18.576916+0000","last_undegraded":"2023-10-07T09:07:18.576916+0000","last_fullsized":"2023-10-07T09:07:18.576916+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:20.574402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.575855+0000","last_change":"2023-10-07T09:07:18.575855+0000","last_active":"2023-10-07T09:07:18.575855+0000","last_peered":"2023-10-07T09:07:18.575855+0000","last_clean":"2023-10-07T09:07:18.575855+0000","last_became_active":"2023-10-07T09:07:18.575673+0000","last_became_peered":"2023-10-07T09:07:18.575673+0000","last_unstale":"2023-10-07T09:07:18.575855+0000","last_undegraded":"2023-10-07T09:07:18.575855+0000","last_fullsized":"2023-10-07T09:07:18.575855+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:55.680377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.587992+0000","last_change":"2023-10-07T09:07:18.587992+0000","last_active":"2023-10-07T09:07:18.587992+0000","last_peered":"2023-10-07T09:07:18.587992+0000","last_clean":"2023-10-07T09:07:18.587992+0000","last_became_active":"2023-10-07T09:07:18.587477+0000","last_became_peered":"2023-10-07T09:07:18.587477+0000","last_unstale":"2023-10-07T09:07:18.587992+0000","last_undegraded":"2023-10-07T09:07:18.587992+0000","last_fullsized":"2023-10-07T09:07:18.587992+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:30:47.174504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578119+0000","last_change":"2023-10-07T09:07:18.578119+0000","last_active":"2023-10-07T09:07:18.578119+0000","last_peered":"2023-10-07T09:07:18.578119+0000","last_clean":"2023-10-07T09:07:18.578119+0000","last_became_active":"2023-10-07T09:07:18.577849+0000","last_became_peered":"2023-10-07T09:07:18.577849+0000","last_unstale":"2023-10-07T09:07:18.578119+0000","last_undegraded":"2023-10-07T09:07:18.578119+0000","last_fullsized":"2023-10-07T09:07:18.578119+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:30.318874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582374+0000","last_change":"2023-10-07T09:07:18.582374+0000","last_active":"2023-10-07T09:07:18.582374+0000","last_peered":"2023-10-07T09:07:18.582374+0000","last_clean":"2023-10-07T09:07:18.582374+0000","last_became_active":"2023-10-07T09:07:18.581916+0000","last_became_peered":"2023-10-07T09:07:18.581916+0000","last_unstale":"2023-10-07T09:07:18.582374+0000","last_undegraded":"2023-10-07T09:07:18.582374+0000","last_fullsized":"2023-10-07T09:07:18.582374+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:11:25.805404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.568119+0000","last_change":"2023-10-07T09:07:18.568119+0000","last_active":"2023-10-07T09:07:18.568119+0000","last_peered":"2023-10-07T09:07:18.568119+0000","last_clean":"2023-10-07T09:07:18.568119+0000","last_became_active":"2023-10-07T09:07:18.567151+0000","last_became_peered":"2023-10-07T09:07:18.567151+0000","last_unstale":"2023-10-07T09:07:18.568119+0000","last_undegraded":"2023-10-07T09:07:18.568119+0000","last_fullsized":"2023-10-07T09:07:18.568119+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.254578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590122+0000","last_change":"2023-10-07T09:07:18.590122+0000","last_active":"2023-10-07T09:07:18.590122+0000","last_peered":"2023-10-07T09:07:18.590122+0000","last_clean":"2023-10-07T09:07:18.590122+0000","last_became_active":"2023-10-07T09:07:18.589853+0000","last_became_peered":"2023-10-07T09:07:18.589853+0000","last_unstale":"2023-10-07T09:07:18.590122+0000","last_undegraded":"2023-10-07T09:07:18.590122+0000","last_fullsized":"2023-10-07T09:07:18.590122+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:37:23.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590777+0000","last_change":"2023-10-07T09:07:18.590777+0000","last_active":"2023-10-07T09:07:18.590777+0000","last_peered":"2023-10-07T09:07:18.590777+0000","last_clean":"2023-10-07T09:07:18.590777+0000","last_became_active":"2023-10-07T09:07:18.590444+0000","last_became_peered":"2023-10-07T09:07:18.590444+0000","last_unstale":"2023-10-07T09:07:18.590777+0000","last_undegraded":"2023-10-07T09:07:18.590777+0000","last_fullsized":"2023-10-07T09:07:18.590777+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:43.963904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"181'4","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.596128+0000","last_change":"2023-10-07T09:07:17.561676+0000","last_active":"2023-10-07T09:07:18.596128+0000","last_peered":"2023-10-07T09:07:18.596128+0000","last_clean":"2023-10-07T09:07:18.596128+0000","last_became_active":"2023-10-07T09:07:17.561334+0000","last_became_peered":"2023-10-07T09:07:17.561334+0000","last_unstale":"2023-10-07T09:07:18.596128+0000","last_undegraded":"2023-10-07T09:07:18.596128+0000","last_fullsized":"2023-10-07T09:07:18.596128+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:05.912551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579300+0000","last_change":"2023-10-07T09:07:18.575903+0000","last_active":"2023-10-07T09:07:18.579300+0000","last_peered":"2023-10-07T09:07:18.579300+0000","last_clean":"2023-10-07T09:07:18.579300+0000","last_became_active":"2023-10-07T09:07:18.575658+0000","last_became_peered":"2023-10-07T09:07:18.575658+0000","last_unstale":"2023-10-07T09:07:18.579300+0000","last_undegraded":"2023-10-07T09:07:18.579300+0000","last_fullsized":"2023-10-07T09:07:18.579300+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:51.029479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592809+0000","last_change":"2023-10-07T09:07:17.559015+0000","last_active":"2023-10-07T09:07:18.592809+0000","last_peered":"2023-10-07T09:07:18.592809+0000","last_clean":"2023-10-07T09:07:18.592809+0000","last_became_active":"2023-10-07T09:07:17.558583+0000","last_became_peered":"2023-10-07T09:07:17.558583+0000","last_unstale":"2023-10-07T09:07:18.592809+0000","last_undegraded":"2023-10-07T09:07:18.592809+0000","last_fullsized":"2023-10-07T09:07:18.592809+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:42.958759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.584808+0000","last_change":"2023-10-07T09:07:18.584808+0000","last_active":"2023-10-07T09:07:18.584808+0000","last_peered":"2023-10-07T09:07:18.584808+0000","last_clean":"2023-10-07T09:07:18.584808+0000","last_became_active":"2023-10-07T09:07:18.584507+0000","last_became_peered":"2023-10-07T09:07:18.584507+0000","last_unstale":"2023-10-07T09:07:18.584808+0000","last_undegraded":"2023-10-07T09:07:18.584808+0000","last_fullsized":"2023-10-07T09:07:18.584808+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:35.361244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"181'2","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594880+0000","last_change":"2023-10-07T09:07:17.562352+0000","last_active":"2023-10-07T09:07:18.594880+0000","last_peered":"2023-10-07T09:07:18.594880+0000","last_clean":"2023-10-07T09:07:18.594880+0000","last_became_active":"2023-10-07T09:07:17.562101+0000","last_became_peered":"2023-10-07T09:07:17.562101+0000","last_unstale":"2023-10-07T09:07:18.594880+0000","last_undegraded":"2023-10-07T09:07:18.594880+0000","last_fullsized":"2023-10-07T09:07:18.594880+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:26.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577295+0000","last_change":"2023-10-07T09:07:18.577295+0000","last_active":"2023-10-07T09:07:18.577295+0000","last_peered":"2023-10-07T09:07:18.577295+0000","last_clean":"2023-10-07T09:07:18.577295+0000","last_became_active":"2023-10-07T09:07:18.577014+0000","last_became_peered":"2023-10-07T09:07:18.577014+0000","last_unstale":"2023-10-07T09:07:18.577295+0000","last_undegraded":"2023-10-07T09:07:18.577295+0000","last_fullsized":"2023-10-07T09:07:18.577295+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:59.296038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"181'1","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589833+0000","last_change":"2023-10-07T09:07:17.563086+0000","last_active":"2023-10-07T09:07:18.589833+0000","last_peered":"2023-10-07T09:07:18.589833+0000","last_clean":"2023-10-07T09:07:18.589833+0000","last_became_active":"2023-10-07T09:07:17.562844+0000","last_became_peered":"2023-10-07T09:07:17.562844+0000","last_unstale":"2023-10-07T09:07:18.589833+0000","last_undegraded":"2023-10-07T09:07:18.589833+0000","last_fullsized":"2023-10-07T09:07:18.589833+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:27.245519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574823+0000","last_change":"2023-10-07T09:07:18.574823+0000","last_active":"2023-10-07T09:07:18.574823+0000","last_peered":"2023-10-07T09:07:18.574823+0000","last_clean":"2023-10-07T09:07:18.574823+0000","last_became_active":"2023-10-07T09:07:18.574642+0000","last_became_peered":"2023-10-07T09:07:18.574642+0000","last_unstale":"2023-10-07T09:07:18.574823+0000","last_undegraded":"2023-10-07T09:07:18.574823+0000","last_fullsized":"2023-10-07T09:07:18.574823+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:49.677773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.575337+0000","last_change":"2023-10-07T09:07:17.559178+0000","last_active":"2023-10-07T09:07:18.575337+0000","last_peered":"2023-10-07T09:07:18.575337+0000","last_clean":"2023-10-07T09:07:18.575337+0000","last_became_active":"2023-10-07T09:07:17.558804+0000","last_became_peered":"2023-10-07T09:07:17.558804+0000","last_unstale":"2023-10-07T09:07:18.575337+0000","last_undegraded":"2023-10-07T09:07:18.575337+0000","last_fullsized":"2023-10-07T09:07:18.575337+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:43.280754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571424+0000","last_change":"2023-10-07T09:07:18.569192+0000","last_active":"2023-10-07T09:07:18.571424+0000","last_peered":"2023-10-07T09:07:18.571424+0000","last_clean":"2023-10-07T09:07:18.571424+0000","last_became_active":"2023-10-07T09:07:18.568933+0000","last_became_peered":"2023-10-07T09:07:18.568933+0000","last_unstale":"2023-10-07T09:07:18.571424+0000","last_undegraded":"2023-10-07T09:07:18.571424+0000","last_fullsized":"2023-10-07T09:07:18.571424+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:34.139856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.561607+0000","last_change":"2023-10-07T09:07:17.562690+0000","last_active":"2023-10-07T09:07:18.561607+0000","last_peered":"2023-10-07T09:07:18.561607+0000","last_clean":"2023-10-07T09:07:18.561607+0000","last_became_active":"2023-10-07T09:07:17.561892+0000","last_became_peered":"2023-10-07T09:07:17.561892+0000","last_unstale":"2023-10-07T09:07:18.561607+0000","last_undegraded":"2023-10-07T09:07:18.561607+0000","last_fullsized":"2023-10-07T09:07:18.561607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:33.610231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573016+0000","last_change":"2023-10-07T09:07:18.573016+0000","last_active":"2023-10-07T09:07:18.573016+0000","last_peered":"2023-10-07T09:07:18.573016+0000","last_clean":"2023-10-07T09:07:18.573016+0000","last_became_active":"2023-10-07T09:07:18.572765+0000","last_became_peered":"2023-10-07T09:07:18.572765+0000","last_unstale":"2023-10-07T09:07:18.573016+0000","last_undegraded":"2023-10-07T09:07:18.573016+0000","last_fullsized":"2023-10-07T09:07:18.573016+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:36.426513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.563497+0000","last_change":"2023-10-07T09:07:17.561601+0000","last_active":"2023-10-07T09:07:17.563497+0000","last_peered":"2023-10-07T09:07:17.563497+0000","last_clean":"2023-10-07T09:07:17.563497+0000","last_became_active":"2023-10-07T09:07:17.561263+0000","last_became_peered":"2023-10-07T09:07:17.561263+0000","last_unstale":"2023-10-07T09:07:17.563497+0000","last_undegraded":"2023-10-07T09:07:17.563497+0000","last_fullsized":"2023-10-07T09:07:17.563497+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:26.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573623+0000","last_change":"2023-10-07T09:07:18.573623+0000","last_active":"2023-10-07T09:07:18.573623+0000","last_peered":"2023-10-07T09:07:18.573623+0000","last_clean":"2023-10-07T09:07:18.573623+0000","last_became_active":"2023-10-07T09:07:18.573345+0000","last_became_peered":"2023-10-07T09:07:18.573345+0000","last_unstale":"2023-10-07T09:07:18.573623+0000","last_undegraded":"2023-10-07T09:07:18.573623+0000","last_fullsized":"2023-10-07T09:07:18.573623+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:18.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562664+0000","last_change":"2023-10-07T09:07:17.557699+0000","last_active":"2023-10-07T09:07:17.562664+0000","last_peered":"2023-10-07T09:07:17.562664+0000","last_clean":"2023-10-07T09:07:17.562664+0000","last_became_active":"2023-10-07T09:07:17.557389+0000","last_became_peered":"2023-10-07T09:07:17.557389+0000","last_unstale":"2023-10-07T09:07:17.562664+0000","last_undegraded":"2023-10-07T09:07:17.562664+0000","last_fullsized":"2023-10-07T09:07:17.562664+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:00:15.673360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589399+0000","last_change":"2023-10-07T09:07:18.588928+0000","last_active":"2023-10-07T09:07:18.589399+0000","last_peered":"2023-10-07T09:07:18.589399+0000","last_clean":"2023-10-07T09:07:18.589399+0000","last_became_active":"2023-10-07T09:07:18.588643+0000","last_became_peered":"2023-10-07T09:07:18.588643+0000","last_unstale":"2023-10-07T09:07:18.589399+0000","last_undegraded":"2023-10-07T09:07:18.589399+0000","last_fullsized":"2023-10-07T09:07:18.589399+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:12:53.658651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563947+0000","last_change":"2023-10-07T09:07:17.558344+0000","last_active":"2023-10-07T09:07:18.563947+0000","last_peered":"2023-10-07T09:07:18.563947+0000","last_clean":"2023-10-07T09:07:18.563947+0000","last_became_active":"2023-10-07T09:07:17.558050+0000","last_became_peered":"2023-10-07T09:07:17.558050+0000","last_unstale":"2023-10-07T09:07:18.563947+0000","last_undegraded":"2023-10-07T09:07:18.563947+0000","last_fullsized":"2023-10-07T09:07:18.563947+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:43.451948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581888+0000","last_change":"2023-10-07T09:07:18.578507+0000","last_active":"2023-10-07T09:07:18.581888+0000","last_peered":"2023-10-07T09:07:18.581888+0000","last_clean":"2023-10-07T09:07:18.581888+0000","last_became_active":"2023-10-07T09:07:18.578235+0000","last_became_peered":"2023-10-07T09:07:18.578235+0000","last_unstale":"2023-10-07T09:07:18.581888+0000","last_undegraded":"2023-10-07T09:07:18.581888+0000","last_fullsized":"2023-10-07T09:07:18.581888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:52.797060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"181'3","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582877+0000","last_change":"2023-10-07T09:07:17.554044+0000","last_active":"2023-10-07T09:07:18.582877+0000","last_peered":"2023-10-07T09:07:18.582877+0000","last_clean":"2023-10-07T09:07:18.582877+0000","last_became_active":"2023-10-07T09:07:17.553756+0000","last_became_peered":"2023-10-07T09:07:17.553756+0000","last_unstale":"2023-10-07T09:07:18.582877+0000","last_undegraded":"2023-10-07T09:07:18.582877+0000","last_fullsized":"2023-10-07T09:07:18.582877+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:33.610231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594699+0000","last_change":"2023-10-07T09:07:18.594699+0000","last_active":"2023-10-07T09:07:18.594699+0000","last_peered":"2023-10-07T09:07:18.594699+0000","last_clean":"2023-10-07T09:07:18.594699+0000","last_became_active":"2023-10-07T09:07:18.594371+0000","last_became_peered":"2023-10-07T09:07:18.594371+0000","last_unstale":"2023-10-07T09:07:18.594699+0000","last_undegraded":"2023-10-07T09:07:18.594699+0000","last_fullsized":"2023-10-07T09:07:18.594699+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:14.647063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"181'6","reported_seq":15,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.596211+0000","last_change":"2023-10-07T09:07:17.560817+0000","last_active":"2023-10-07T09:07:18.596211+0000","last_peered":"2023-10-07T09:07:18.596211+0000","last_clean":"2023-10-07T09:07:18.596211+0000","last_became_active":"2023-10-07T09:07:17.560547+0000","last_became_peered":"2023-10-07T09:07:17.560547+0000","last_unstale":"2023-10-07T09:07:18.596211+0000","last_undegraded":"2023-10-07T09:07:18.596211+0000","last_fullsized":"2023-10-07T09:07:18.596211+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:56:38.398940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573345+0000","last_change":"2023-10-07T09:07:18.573345+0000","last_active":"2023-10-07T09:07:18.573345+0000","last_peered":"2023-10-07T09:07:18.573345+0000","last_clean":"2023-10-07T09:07:18.573345+0000","last_became_active":"2023-10-07T09:07:18.572676+0000","last_became_peered":"2023-10-07T09:07:18.572676+0000","last_unstale":"2023-10-07T09:07:18.573345+0000","last_undegraded":"2023-10-07T09:07:18.573345+0000","last_fullsized":"2023-10-07T09:07:18.573345+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:19.920166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.595738+0000","last_change":"2023-10-07T09:07:17.561694+0000","last_active":"2023-10-07T09:07:18.595738+0000","last_peered":"2023-10-07T09:07:18.595738+0000","last_clean":"2023-10-07T09:07:18.595738+0000","last_became_active":"2023-10-07T09:07:17.561394+0000","last_became_peered":"2023-10-07T09:07:17.561394+0000","last_unstale":"2023-10-07T09:07:18.595738+0000","last_undegraded":"2023-10-07T09:07:18.595738+0000","last_fullsized":"2023-10-07T09:07:18.595738+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:29:59.595773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579318+0000","last_change":"2023-10-07T09:07:18.579318+0000","last_active":"2023-10-07T09:07:18.579318+0000","last_peered":"2023-10-07T09:07:18.579318+0000","last_clean":"2023-10-07T09:07:18.579318+0000","last_became_active":"2023-10-07T09:07:18.577486+0000","last_became_peered":"2023-10-07T09:07:18.577486+0000","last_unstale":"2023-10-07T09:07:18.579318+0000","last_undegraded":"2023-10-07T09:07:18.579318+0000","last_fullsized":"2023-10-07T09:07:18.579318+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:43.963904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.556345+0000","last_change":"2023-10-07T09:07:17.555276+0000","last_active":"2023-10-07T09:07:17.556345+0000","last_peered":"2023-10-07T09:07:17.556345+0000","last_clean":"2023-10-07T09:07:17.556345+0000","last_became_active":"2023-10-07T09:07:17.554961+0000","last_became_peered":"2023-10-07T09:07:17.554961+0000","last_unstale":"2023-10-07T09:07:17.556345+0000","last_undegraded":"2023-10-07T09:07:17.556345+0000","last_fullsized":"2023-10-07T09:07:17.556345+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.572866+0000","last_change":"2023-10-07T09:07:18.568533+0000","last_active":"2023-10-07T09:07:18.572866+0000","last_peered":"2023-10-07T09:07:18.572866+0000","last_clean":"2023-10-07T09:07:18.572866+0000","last_became_active":"2023-10-07T09:07:18.568278+0000","last_became_peered":"2023-10-07T09:07:18.568278+0000","last_unstale":"2023-10-07T09:07:18.572866+0000","last_undegraded":"2023-10-07T09:07:18.572866+0000","last_fullsized":"2023-10-07T09:07:18.572866+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.563937+0000","last_change":"2023-10-07T09:07:17.559219+0000","last_active":"2023-10-07T09:07:17.563937+0000","last_peered":"2023-10-07T09:07:17.563937+0000","last_clean":"2023-10-07T09:07:17.563937+0000","last_became_active":"2023-10-07T09:07:17.558900+0000","last_became_peered":"2023-10-07T09:07:17.558900+0000","last_unstale":"2023-10-07T09:07:17.563937+0000","last_undegraded":"2023-10-07T09:07:17.563937+0000","last_fullsized":"2023-10-07T09:07:17.563937+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:43.451948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578935+0000","last_change":"2023-10-07T09:07:18.578935+0000","last_active":"2023-10-07T09:07:18.578935+0000","last_peered":"2023-10-07T09:07:18.578935+0000","last_clean":"2023-10-07T09:07:18.578935+0000","last_became_active":"2023-10-07T09:07:18.578642+0000","last_became_peered":"2023-10-07T09:07:18.578642+0000","last_unstale":"2023-10-07T09:07:18.578935+0000","last_undegraded":"2023-10-07T09:07:18.578935+0000","last_fullsized":"2023-10-07T09:07:18.578935+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:51.029479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"181'8","reported_seq":17,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.593508+0000","last_change":"2023-10-07T09:07:17.559864+0000","last_active":"2023-10-07T09:07:18.593508+0000","last_peered":"2023-10-07T09:07:18.593508+0000","last_clean":"2023-10-07T09:07:18.593508+0000","last_became_active":"2023-10-07T09:07:17.559589+0000","last_became_peered":"2023-10-07T09:07:17.559589+0000","last_unstale":"2023-10-07T09:07:18.593508+0000","last_undegraded":"2023-10-07T09:07:18.593508+0000","last_fullsized":"2023-10-07T09:07:18.593508+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:41:36.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578258+0000","last_change":"2023-10-07T09:07:18.578258+0000","last_active":"2023-10-07T09:07:18.578258+0000","last_peered":"2023-10-07T09:07:18.578258+0000","last_clean":"2023-10-07T09:07:18.578258+0000","last_became_active":"2023-10-07T09:07:18.578001+0000","last_became_peered":"2023-10-07T09:07:18.578001+0000","last_unstale":"2023-10-07T09:07:18.578258+0000","last_undegraded":"2023-10-07T09:07:18.578258+0000","last_fullsized":"2023-10-07T09:07:18.578258+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:53.020616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.586607+0000","last_change":"2023-10-07T09:07:17.553473+0000","last_active":"2023-10-07T09:07:18.586607+0000","last_peered":"2023-10-07T09:07:18.586607+0000","last_clean":"2023-10-07T09:07:18.586607+0000","last_became_active":"2023-10-07T09:07:17.553209+0000","last_became_peered":"2023-10-07T09:07:17.553209+0000","last_unstale":"2023-10-07T09:07:18.586607+0000","last_undegraded":"2023-10-07T09:07:18.586607+0000","last_fullsized":"2023-10-07T09:07:18.586607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:53.337081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578667+0000","last_change":"2023-10-07T09:07:18.578667+0000","last_active":"2023-10-07T09:07:18.578667+0000","last_peered":"2023-10-07T09:07:18.578667+0000","last_clean":"2023-10-07T09:07:18.578667+0000","last_became_active":"2023-10-07T09:07:18.577835+0000","last_became_peered":"2023-10-07T09:07:18.577835+0000","last_unstale":"2023-10-07T09:07:18.578667+0000","last_undegraded":"2023-10-07T09:07:18.578667+0000","last_fullsized":"2023-10-07T09:07:18.578667+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"181'2","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592361+0000","last_change":"2023-10-07T09:07:17.549092+0000","last_active":"2023-10-07T09:07:18.592361+0000","last_peered":"2023-10-07T09:07:18.592361+0000","last_clean":"2023-10-07T09:07:18.592361+0000","last_became_active":"2023-10-07T09:07:17.548518+0000","last_became_peered":"2023-10-07T09:07:17.548518+0000","last_unstale":"2023-10-07T09:07:18.592361+0000","last_undegraded":"2023-10-07T09:07:18.592361+0000","last_fullsized":"2023-10-07T09:07:18.592361+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:33.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576685+0000","last_change":"2023-10-07T09:07:18.576685+0000","last_active":"2023-10-07T09:07:18.576685+0000","last_peered":"2023-10-07T09:07:18.576685+0000","last_clean":"2023-10-07T09:07:18.576685+0000","last_became_active":"2023-10-07T09:07:18.576365+0000","last_became_peered":"2023-10-07T09:07:18.576365+0000","last_unstale":"2023-10-07T09:07:18.576685+0000","last_undegraded":"2023-10-07T09:07:18.576685+0000","last_fullsized":"2023-10-07T09:07:18.576685+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:49.677773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"181'1","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592796+0000","last_change":"2023-10-07T09:07:17.558838+0000","last_active":"2023-10-07T09:07:18.592796+0000","last_peered":"2023-10-07T09:07:18.592796+0000","last_clean":"2023-10-07T09:07:18.592796+0000","last_became_active":"2023-10-07T09:07:17.558236+0000","last_became_peered":"2023-10-07T09:07:17.558236+0000","last_unstale":"2023-10-07T09:07:18.592796+0000","last_undegraded":"2023-10-07T09:07:18.592796+0000","last_fullsized":"2023-10-07T09:07:18.592796+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:18.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582041+0000","last_change":"2023-10-07T09:07:18.578901+0000","last_active":"2023-10-07T09:07:18.582041+0000","last_peered":"2023-10-07T09:07:18.582041+0000","last_clean":"2023-10-07T09:07:18.582041+0000","last_became_active":"2023-10-07T09:07:18.578606+0000","last_became_peered":"2023-10-07T09:07:18.578606+0000","last_unstale":"2023-10-07T09:07:18.582041+0000","last_undegraded":"2023-10-07T09:07:18.582041+0000","last_fullsized":"2023-10-07T09:07:18.582041+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:19.350190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563230+0000","last_change":"2023-10-07T09:07:17.560674+0000","last_active":"2023-10-07T09:07:18.563230+0000","last_peered":"2023-10-07T09:07:18.563230+0000","last_clean":"2023-10-07T09:07:18.563230+0000","last_became_active":"2023-10-07T09:07:17.560422+0000","last_became_peered":"2023-10-07T09:07:17.560422+0000","last_unstale":"2023-10-07T09:07:18.563230+0000","last_undegraded":"2023-10-07T09:07:18.563230+0000","last_fullsized":"2023-10-07T09:07:18.563230+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:54.197401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580148+0000","last_change":"2023-10-07T09:07:18.574362+0000","last_active":"2023-10-07T09:07:18.580148+0000","last_peered":"2023-10-07T09:07:18.580148+0000","last_clean":"2023-10-07T09:07:18.580148+0000","last_became_active":"2023-10-07T09:07:18.573900+0000","last_became_peered":"2023-10-07T09:07:18.573900+0000","last_unstale":"2023-10-07T09:07:18.580148+0000","last_undegraded":"2023-10-07T09:07:18.580148+0000","last_fullsized":"2023-10-07T09:07:18.580148+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:12.715858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.587709+0000","last_change":"2023-10-07T09:07:17.562243+0000","last_active":"2023-10-07T09:07:18.587709+0000","last_peered":"2023-10-07T09:07:18.587709+0000","last_clean":"2023-10-07T09:07:18.587709+0000","last_became_active":"2023-10-07T09:07:17.561919+0000","last_became_peered":"2023-10-07T09:07:17.561919+0000","last_unstale":"2023-10-07T09:07:18.587709+0000","last_undegraded":"2023-10-07T09:07:18.587709+0000","last_fullsized":"2023-10-07T09:07:18.587709+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:43.796883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580757+0000","last_change":"2023-10-07T09:07:18.580757+0000","last_active":"2023-10-07T09:07:18.580757+0000","last_peered":"2023-10-07T09:07:18.580757+0000","last_clean":"2023-10-07T09:07:18.580757+0000","last_became_active":"2023-10-07T09:07:18.580442+0000","last_became_peered":"2023-10-07T09:07:18.580442+0000","last_unstale":"2023-10-07T09:07:18.580757+0000","last_undegraded":"2023-10-07T09:07:18.580757+0000","last_fullsized":"2023-10-07T09:07:18.580757+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:18:20.481390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.565899+0000","last_change":"2023-10-07T09:07:17.560451+0000","last_active":"2023-10-07T09:07:18.565899+0000","last_peered":"2023-10-07T09:07:18.565899+0000","last_clean":"2023-10-07T09:07:18.565899+0000","last_became_active":"2023-10-07T09:07:17.560183+0000","last_became_peered":"2023-10-07T09:07:17.560183+0000","last_unstale":"2023-10-07T09:07:18.565899+0000","last_undegraded":"2023-10-07T09:07:18.565899+0000","last_fullsized":"2023-10-07T09:07:18.565899+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:13.641919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579851+0000","last_change":"2023-10-07T09:07:18.576431+0000","last_active":"2023-10-07T09:07:18.579851+0000","last_peered":"2023-10-07T09:07:18.579851+0000","last_clean":"2023-10-07T09:07:18.579851+0000","last_became_active":"2023-10-07T09:07:18.576113+0000","last_became_peered":"2023-10-07T09:07:18.576113+0000","last_unstale":"2023-10-07T09:07:18.579851+0000","last_undegraded":"2023-10-07T09:07:18.579851+0000","last_fullsized":"2023-10-07T09:07:18.579851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:32.141771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563027+0000","last_change":"2023-10-07T09:07:17.557044+0000","last_active":"2023-10-07T09:07:18.563027+0000","last_peered":"2023-10-07T09:07:18.563027+0000","last_clean":"2023-10-07T09:07:18.563027+0000","last_became_active":"2023-10-07T09:07:17.556726+0000","last_became_peered":"2023-10-07T09:07:17.556726+0000","last_unstale":"2023-10-07T09:07:18.563027+0000","last_undegraded":"2023-10-07T09:07:18.563027+0000","last_fullsized":"2023-10-07T09:07:18.563027+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:17.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576546+0000","last_change":"2023-10-07T09:07:18.567992+0000","last_active":"2023-10-07T09:07:18.576546+0000","last_peered":"2023-10-07T09:07:18.576546+0000","last_clean":"2023-10-07T09:07:18.576546+0000","last_became_active":"2023-10-07T09:07:18.567710+0000","last_became_peered":"2023-10-07T09:07:18.567710+0000","last_unstale":"2023-10-07T09:07:18.576546+0000","last_undegraded":"2023-10-07T09:07:18.576546+0000","last_fullsized":"2023-10-07T09:07:18.576546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:41:46.851205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562607+0000","last_change":"2023-10-07T09:07:17.556788+0000","last_active":"2023-10-07T09:07:17.562607+0000","last_peered":"2023-10-07T09:07:17.562607+0000","last_clean":"2023-10-07T09:07:17.562607+0000","last_became_active":"2023-10-07T09:07:17.556530+0000","last_became_peered":"2023-10-07T09:07:17.556530+0000","last_unstale":"2023-10-07T09:07:17.562607+0000","last_undegraded":"2023-10-07T09:07:17.562607+0000","last_fullsized":"2023-10-07T09:07:17.562607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:57:43.627093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573084+0000","last_change":"2023-10-07T09:07:18.573084+0000","last_active":"2023-10-07T09:07:18.573084+0000","last_peered":"2023-10-07T09:07:18.573084+0000","last_clean":"2023-10-07T09:07:18.573084+0000","last_became_active":"2023-10-07T09:07:18.572513+0000","last_became_peered":"2023-10-07T09:07:18.572513+0000","last_unstale":"2023-10-07T09:07:18.573084+0000","last_undegraded":"2023-10-07T09:07:18.573084+0000","last_fullsized":"2023-10-07T09:07:18.573084+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:06.548976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.588894+0000","last_change":"2023-10-07T09:07:17.558531+0000","last_active":"2023-10-07T09:07:18.588894+0000","last_peered":"2023-10-07T09:07:18.588894+0000","last_clean":"2023-10-07T09:07:18.588894+0000","last_became_active":"2023-10-07T09:07:17.558250+0000","last_became_peered":"2023-10-07T09:07:17.558250+0000","last_unstale":"2023-10-07T09:07:18.588894+0000","last_undegraded":"2023-10-07T09:07:18.588894+0000","last_fullsized":"2023-10-07T09:07:18.588894+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:29:57.877895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574739+0000","last_change":"2023-10-07T09:07:18.570795+0000","last_active":"2023-10-07T09:07:18.574739+0000","last_peered":"2023-10-07T09:07:18.574739+0000","last_clean":"2023-10-07T09:07:18.574739+0000","last_became_active":"2023-10-07T09:07:18.570201+0000","last_became_peered":"2023-10-07T09:07:18.570201+0000","last_unstale":"2023-10-07T09:07:18.574739+0000","last_undegraded":"2023-10-07T09:07:18.574739+0000","last_fullsized":"2023-10-07T09:07:18.574739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:12.715858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.556219+0000","last_change":"2023-10-07T09:07:17.553530+0000","last_active":"2023-10-07T09:07:17.556219+0000","last_peered":"2023-10-07T09:07:17.556219+0000","last_clean":"2023-10-07T09:07:17.556219+0000","last_became_active":"2023-10-07T09:07:17.553259+0000","last_became_peered":"2023-10-07T09:07:17.553259+0000","last_unstale":"2023-10-07T09:07:17.556219+0000","last_undegraded":"2023-10-07T09:07:17.556219+0000","last_fullsized":"2023-10-07T09:07:17.556219+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:32.807035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581871+0000","last_change":"2023-10-07T09:07:18.575007+0000","last_active":"2023-10-07T09:07:18.581871+0000","last_peered":"2023-10-07T09:07:18.581871+0000","last_clean":"2023-10-07T09:07:18.581871+0000","last_became_active":"2023-10-07T09:07:18.574732+0000","last_became_peered":"2023-10-07T09:07:18.574732+0000","last_unstale":"2023-10-07T09:07:18.581871+0000","last_undegraded":"2023-10-07T09:07:18.581871+0000","last_fullsized":"2023-10-07T09:07:18.581871+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:35:42.086197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562694+0000","last_change":"2023-10-07T09:07:17.557720+0000","last_active":"2023-10-07T09:07:17.562694+0000","last_peered":"2023-10-07T09:07:17.562694+0000","last_clean":"2023-10-07T09:07:17.562694+0000","last_became_active":"2023-10-07T09:07:17.557399+0000","last_became_peered":"2023-10-07T09:07:17.557399+0000","last_unstale":"2023-10-07T09:07:17.562694+0000","last_undegraded":"2023-10-07T09:07:17.562694+0000","last_fullsized":"2023-10-07T09:07:17.562694+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:12.760564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574896+0000","last_change":"2023-10-07T09:07:18.574896+0000","last_active":"2023-10-07T09:07:18.574896+0000","last_peered":"2023-10-07T09:07:18.574896+0000","last_clean":"2023-10-07T09:07:18.574896+0000","last_became_active":"2023-10-07T09:07:18.574640+0000","last_became_peered":"2023-10-07T09:07:18.574640+0000","last_unstale":"2023-10-07T09:07:18.574896+0000","last_undegraded":"2023-10-07T09:07:18.574896+0000","last_fullsized":"2023-10-07T09:07:18.574896+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:50.778081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562728+0000","last_change":"2023-10-07T09:07:17.556750+0000","last_active":"2023-10-07T09:07:17.562728+0000","last_peered":"2023-10-07T09:07:17.562728+0000","last_clean":"2023-10-07T09:07:17.562728+0000","last_became_active":"2023-10-07T09:07:17.556496+0000","last_became_peered":"2023-10-07T09:07:17.556496+0000","last_unstale":"2023-10-07T09:07:17.562728+0000","last_undegraded":"2023-10-07T09:07:17.562728+0000","last_fullsized":"2023-10-07T09:07:17.562728+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:02.048746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582736+0000","last_change":"2023-10-07T09:07:18.582736+0000","last_active":"2023-10-07T09:07:18.582736+0000","last_peered":"2023-10-07T09:07:18.582736+0000","last_clean":"2023-10-07T09:07:18.582736+0000","last_became_active":"2023-10-07T09:07:18.581798+0000","last_became_peered":"2023-10-07T09:07:18.581798+0000","last_unstale":"2023-10-07T09:07:18.582736+0000","last_undegraded":"2023-10-07T09:07:18.582736+0000","last_fullsized":"2023-10-07T09:07:18.582736+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:48.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.564885+0000","last_change":"2023-10-07T09:07:17.557781+0000","last_active":"2023-10-07T09:07:18.564885+0000","last_peered":"2023-10-07T09:07:18.564885+0000","last_clean":"2023-10-07T09:07:18.564885+0000","last_became_active":"2023-10-07T09:07:17.557519+0000","last_became_peered":"2023-10-07T09:07:17.557519+0000","last_unstale":"2023-10-07T09:07:18.564885+0000","last_undegraded":"2023-10-07T09:07:18.564885+0000","last_fullsized":"2023-10-07T09:07:18.564885+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:05.543832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.586446+0000","last_change":"2023-10-07T09:07:18.586446+0000","last_active":"2023-10-07T09:07:18.586446+0000","last_peered":"2023-10-07T09:07:18.586446+0000","last_clean":"2023-10-07T09:07:18.586446+0000","last_became_active":"2023-10-07T09:07:18.586136+0000","last_became_peered":"2023-10-07T09:07:18.586136+0000","last_unstale":"2023-10-07T09:07:18.586446+0000","last_undegraded":"2023-10-07T09:07:18.586446+0000","last_fullsized":"2023-10-07T09:07:18.586446+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:36.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.559220+0000","last_change":"2023-10-07T09:07:17.557705+0000","last_active":"2023-10-07T09:07:17.559220+0000","last_peered":"2023-10-07T09:07:17.559220+0000","last_clean":"2023-10-07T09:07:17.559220+0000","last_became_active":"2023-10-07T09:07:17.557436+0000","last_became_peered":"2023-10-07T09:07:17.557436+0000","last_unstale":"2023-10-07T09:07:17.559220+0000","last_undegraded":"2023-10-07T09:07:17.559220+0000","last_fullsized":"2023-10-07T09:07:17.559220+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:29:57.877895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590654+0000","last_change":"2023-10-07T09:07:18.590654+0000","last_active":"2023-10-07T09:07:18.590654+0000","last_peered":"2023-10-07T09:07:18.590654+0000","last_clean":"2023-10-07T09:07:18.590654+0000","last_became_active":"2023-10-07T09:07:18.590355+0000","last_became_peered":"2023-10-07T09:07:18.590355+0000","last_unstale":"2023-10-07T09:07:18.590654+0000","last_undegraded":"2023-10-07T09:07:18.590654+0000","last_fullsized":"2023-10-07T09:07:18.590654+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:20.574402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.561740+0000","last_change":"2023-10-07T09:07:17.560184+0000","last_active":"2023-10-07T09:07:18.561740+0000","last_peered":"2023-10-07T09:07:18.561740+0000","last_clean":"2023-10-07T09:07:18.561740+0000","last_became_active":"2023-10-07T09:07:17.559996+0000","last_became_peered":"2023-10-07T09:07:17.559996+0000","last_unstale":"2023-10-07T09:07:18.561740+0000","last_undegraded":"2023-10-07T09:07:18.561740+0000","last_fullsized":"2023-10-07T09:07:18.561740+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:32.807035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.591827+0000","last_change":"2023-10-07T09:07:18.591395+0000","last_active":"2023-10-07T09:07:18.591827+0000","last_peered":"2023-10-07T09:07:18.591827+0000","last_clean":"2023-10-07T09:07:18.591827+0000","last_became_active":"2023-10-07T09:07:18.591144+0000","last_became_peered":"2023-10-07T09:07:18.591144+0000","last_unstale":"2023-10-07T09:07:18.591827+0000","last_undegraded":"2023-10-07T09:07:18.591827+0000","last_fullsized":"2023-10-07T09:07:18.591827+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:07.035033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.562780+0000","last_change":"2023-10-07T09:07:17.555143+0000","last_active":"2023-10-07T09:07:18.562780+0000","last_peered":"2023-10-07T09:07:18.562780+0000","last_clean":"2023-10-07T09:07:18.562780+0000","last_became_active":"2023-10-07T09:07:17.554791+0000","last_became_peered":"2023-10-07T09:07:17.554791+0000","last_unstale":"2023-10-07T09:07:18.562780+0000","last_undegraded":"2023-10-07T09:07:18.562780+0000","last_fullsized":"2023-10-07T09:07:18.562780+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.801344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578693+0000","last_change":"2023-10-07T09:07:18.578693+0000","last_active":"2023-10-07T09:07:18.578693+0000","last_peered":"2023-10-07T09:07:18.578693+0000","last_clean":"2023-10-07T09:07:18.578693+0000","last_became_active":"2023-10-07T09:07:18.577916+0000","last_became_peered":"2023-10-07T09:07:18.577916+0000","last_unstale":"2023-10-07T09:07:18.578693+0000","last_undegraded":"2023-10-07T09:07:18.578693+0000","last_fullsized":"2023-10-07T09:07:18.578693+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:48.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.568237+0000","last_change":"2023-10-07T09:07:17.559106+0000","last_active":"2023-10-07T09:07:18.568237+0000","last_peered":"2023-10-07T09:07:18.568237+0000","last_clean":"2023-10-07T09:07:18.568237+0000","last_became_active":"2023-10-07T09:07:17.558837+0000","last_became_peered":"2023-10-07T09:07:17.558837+0000","last_unstale":"2023-10-07T09:07:18.568237+0000","last_undegraded":"2023-10-07T09:07:18.568237+0000","last_fullsized":"2023-10-07T09:07:18.568237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:33.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.562454+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:07:18.562454+0000","last_peered":"2023-10-07T09:07:18.562454+0000","last_clean":"2023-10-07T09:07:18.562454+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:07:18.562454+0000","last_undegraded":"2023-10-07T09:07:18.562454+0000","last_fullsized":"2023-10-07T09:07:18.562454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304232,"kb_used_data":2848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067608,"statfs":{"total":96636764160,"available":96325230592,"internally_reserved":0,"allocated":2916352,"data_stored":1626657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.746,"15min":0.85799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60299999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.26700000000000002},"max":{"1min":0.58999999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.40500000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.77100000000000002,"15min":0.86299999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.53600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.443}]},{"osd":5,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.432},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.88400000000000001},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1029989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.752,"15min":0.79800000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71499999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":1.29},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":4.0880000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.434},{"interface":"front","average":{"1min":0.625,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.60199999999999998},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.40899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1036165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":0.42399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.39800000000000002},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.221},"max":{"1min":0.48799999999999999,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.314}]},{"osd":2,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.39500000000000002},"min":{"1min":0.27700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.51400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.377,"15min":0.70799999999999996},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.53100000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.378}]},{"osd":3,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.72699999999999998},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.44900000000000001,"5min":1.077,"15min":11.880000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.39000000000000001},"min":{"1min":0.27900000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59199999999999997,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.41599999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.77700000000000002},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.79200000000000004},"min":{"1min":0.498,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.40400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304224,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067616,"statfs":{"total":96636764160,"available":96325238784,"internally_reserved":0,"allocated":2908160,"data_stored":1621781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.21299999999999999},"max":{"1min":0.44,"5min":0.501,"15min":0.54500000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.34899999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.218,"15min":0.191},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.374,"15min":0.38700000000000001},"min":{"1min":0.29699999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":0.53400000000000003,"15min":0.625},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.22},"max":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.34699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.63500000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.95399999999999996},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86399999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":1.006},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80800000000000005,"5min":0.879,"15min":1.0389999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.41899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1030501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.55800000000000005},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":10.214},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.218,"15min":0.214},"max":{"1min":0.5,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.22,"15min":0.22},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.755},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.61899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48699999999999999,"5min":0.66100000000000003,"15min":10.144},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.66900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54700000000000004,"5min":0.68700000000000006,"15min":10.071},"last":0.38},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41499999999999998,"15min":0.68600000000000005},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.54000000000000004,"5min":0.70399999999999996,"15min":10.183},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.0620000000000001},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.87,"15min":1.0880000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":4.391,"15min":4.391},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1032023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.41299999999999998},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.67400000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53400000000000003,"5min":0.71199999999999997,"15min":12.038},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.41599999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":2.3450000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.45100000000000001},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":2.3380000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.55900000000000005},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.1230000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":1.2330000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.85399999999999998},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56599999999999995,"15min":0.65200000000000002},"min":{"1min":0.40400000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":2.081},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56799999999999995,"15min":0.64600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.82099999999999995,"15min":2.1960000000000002},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.90600000000000003},"min":{"1min":0.45000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76600000000000001,"5min":1.135,"15min":12.007},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.70299999999999996},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.92300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":1.179,"15min":11.973000000000001},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068192,"statfs":{"total":96636764160,"available":96325828608,"internally_reserved":0,"allocated":2318336,"data_stored":1036235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.495,"15min":0.78000000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.83399999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.311},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.86499999999999999},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.83599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":10.01},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":5.569},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.83699999999999997},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.93500000000000005,"15min":10.131},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.51300000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54500000000000004,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.503},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1029877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67900000000000005,"5min":1.127,"15min":1.127},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.31},"max":{"1min":0.73599999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.65000000000000002,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.432}]},{"osd":2,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.73099999999999998,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60899999999999999,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.496}]},{"osd":3,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":1.478,"15min":1.478},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67200000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.379},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66100000000000003,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.73599999999999999,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:07:22.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:07:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.839+0000 7f9252d4e700 1 Processor -- start 2023-10-07T09:07:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.839+0000 7f9252d4e700 1 -- start start 2023-10-07T09:07:22.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9252d4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 0x7f924c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9252d4e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f924c06c0a0 0x7f924c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9252d4e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c15d7e0 con 0x7f924c15df50 2023-10-07T09:07:22.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9252d4e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c15dac0 con 0x7f924c06c0a0 2023-10-07T09:07:22.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9252d4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c15aa30 con 0x7f924c06bcd0 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f924c06c0a0 0x7f924c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f92512eb700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f924c15df50 0x7f924c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53794/0 (socket says 172.21.15.46:53794) 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f92512eb700 1 -- 172.21.15.46:0/2809196798 learned_addr learned my addr 172.21.15.46:0/2809196798 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 -- 172.21.15.46:0/2809196798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 msgr2=0x7f924c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9250aea700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 0x7f924c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 0x7f924c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924b7fe700 1 -- 172.21.15.46:0/2809196798 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170443666 0 0) 0x7f924c15d7e0 con 0x7f924c15df50 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 -- 172.21.15.46:0/2809196798 >> v1:172.21.15.46:6789/0 conn(0x7f924c15df50 legacy=0x7f924c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 -- 172.21.15.46:0/2809196798 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c15ad10 con 0x7f924c06c0a0 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f9250aea700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 0x7f924c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.840+0000 7f924bfff700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c06c0a0 0x7f924c15a1e0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f92380098e0 tx=0x7f92380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42d3b689a7d61e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f924b7fe700 1 -- 172.21.15.46:0/2809196798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238009e80 con 0x7f924c06c0a0 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f924b7fe700 1 -- 172.21.15.46:0/2809196798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800b860 con 0x7f924c06c0a0 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f924b7fe700 1 -- 172.21.15.46:0/2809196798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800bbe0 con 0x7f924c06c0a0 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 -- 172.21.15.46:0/2809196798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c06c0a0 msgr2=0x7f924c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c06c0a0 0x7f924c15a1e0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f92380098e0 tx=0x7f92380091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 -- 172.21.15.46:0/2809196798 shutdown_connections 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06bcd0 0x7f924c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 --2- 172.21.15.46:0/2809196798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c06c0a0 0x7f924c15a1e0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 -- 172.21.15.46:0/2809196798 >> 172.21.15.46:0/2809196798 conn(0x7f924c0ce600 msgr2=0x7f924c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 -- 172.21.15.46:0/2809196798 shutdown_connections 2023-10-07T09:07:22.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.841+0000 7f9252d4e700 1 -- 172.21.15.46:0/2809196798 wait complete. 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.842+0000 7f9252d4e700 1 Processor -- start 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.842+0000 7f9252d4e700 1 -- start start 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 0x7f924c16a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 0x7f924c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c16ae10 con 0x7f924c15df50 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0b20d0 con 0x7f924c06bcd0 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9252d4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0b23b0 con 0x7f924c06c0a0 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f92512eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f92512eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49688/0 (socket says 172.21.15.46:49688) 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f92512eb700 1 -- 172.21.15.46:0/298036534 learned_addr learned my addr 172.21.15.46:0/298036534 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f9250aea700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 0x7f924c16a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.843+0000 7f924bfff700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 0x7f924c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 -- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 msgr2=0x7f924c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 0x7f924c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 -- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 msgr2=0x7f924c16a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 0x7f924c16a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 -- 172.21.15.46:0/298036534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009420 con 0x7f924c15df50 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9250aea700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 0x7f924c16a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f924bfff700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 0x7f924c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f92512eb700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f924400cc90 tx=0x7f9244001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400cea0 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400ab70 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c0b2690 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440070f0 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.844+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c0b2c50 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.845+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c04c3c0 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.845+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f92440074a0 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.846+0000 7f9248ff9700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 0x7f92300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.846+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92440850f0 con 0x7f924c15df50 2023-10-07T09:07:22.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.846+0000 7f9250aea700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 0x7f92300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:22.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.847+0000 7f9250aea700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 0x7f92300697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9240006fd0 tx=0x7f9240008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:22.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:22.850+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9244051e00 con 0x7f924c15df50 2023-10-07T09:07:23.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.041+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f924c15aff0 con 0x7f9230067320 2023-10-07T09:07:23.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.050+0000 7f9248ff9700 1 -- 172.21.15.46:0/298036534 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289986 (secure 0 0 0) 0x7f924c15aff0 con 0x7f9230067320 2023-10-07T09:07:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 msgr2=0x7f92300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 0x7f92300697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9240006fd0 tx=0x7f9240008040 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 msgr2=0x7f924c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f924400cc90 tx=0x7f9244001a80 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 shutdown_connections 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9230067320 0x7f92300697d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f924c15df50 0x7f924c0c4760 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924c06bcd0 0x7f924c16a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 --2- 172.21.15.46:0/298036534 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f924c06c0a0 0x7f924c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 >> 172.21.15.46:0/298036534 conn(0x7f924c0ce600 msgr2=0x7f924c1556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 shutdown_connections 2023-10-07T09:07:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.053+0000 7f9252d4e700 1 -- 172.21.15.46:0/298036534 wait complete. 2023-10-07T09:07:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:07:23.065 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2023-10-07T09:07:21.888788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434412,"kb_used_data":19244,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540308,"statfs":{"total":773094113280,"available":770601275392,"internally_reserved":0,"allocated":19705856,"data_stored":9443228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349210"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589188+0000","last_change":"2023-10-07T09:07:18.589188+0000","last_active":"2023-10-07T09:07:18.589188+0000","last_peered":"2023-10-07T09:07:18.589188+0000","last_clean":"2023-10-07T09:07:18.589188+0000","last_became_active":"2023-10-07T09:07:18.588847+0000","last_became_peered":"2023-10-07T09:07:18.588847+0000","last_unstale":"2023-10-07T09:07:18.589188+0000","last_undegraded":"2023-10-07T09:07:18.589188+0000","last_fullsized":"2023-10-07T09:07:18.589188+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:05.200186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581891+0000","last_change":"2023-10-07T09:07:18.581891+0000","last_active":"2023-10-07T09:07:18.581891+0000","last_peered":"2023-10-07T09:07:18.581891+0000","last_clean":"2023-10-07T09:07:18.581891+0000","last_became_active":"2023-10-07T09:07:18.581344+0000","last_became_peered":"2023-10-07T09:07:18.581344+0000","last_unstale":"2023-10-07T09:07:18.581891+0000","last_undegraded":"2023-10-07T09:07:18.581891+0000","last_fullsized":"2023-10-07T09:07:18.581891+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:41.806488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580408+0000","last_change":"2023-10-07T09:07:18.576533+0000","last_active":"2023-10-07T09:07:18.580408+0000","last_peered":"2023-10-07T09:07:18.580408+0000","last_clean":"2023-10-07T09:07:18.580408+0000","last_became_active":"2023-10-07T09:07:18.576259+0000","last_became_peered":"2023-10-07T09:07:18.576259+0000","last_unstale":"2023-10-07T09:07:18.580408+0000","last_undegraded":"2023-10-07T09:07:18.580408+0000","last_fullsized":"2023-10-07T09:07:18.580408+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:53.020616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571811+0000","last_change":"2023-10-07T09:07:18.569718+0000","last_active":"2023-10-07T09:07:18.571811+0000","last_peered":"2023-10-07T09:07:18.571811+0000","last_clean":"2023-10-07T09:07:18.571811+0000","last_became_active":"2023-10-07T09:07:18.569449+0000","last_became_peered":"2023-10-07T09:07:18.569449+0000","last_unstale":"2023-10-07T09:07:18.571811+0000","last_undegraded":"2023-10-07T09:07:18.571811+0000","last_fullsized":"2023-10-07T09:07:18.571811+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578120+0000","last_change":"2023-10-07T09:07:18.578120+0000","last_active":"2023-10-07T09:07:18.578120+0000","last_peered":"2023-10-07T09:07:18.578120+0000","last_clean":"2023-10-07T09:07:18.578120+0000","last_became_active":"2023-10-07T09:07:18.577867+0000","last_became_peered":"2023-10-07T09:07:18.577867+0000","last_unstale":"2023-10-07T09:07:18.578120+0000","last_undegraded":"2023-10-07T09:07:18.578120+0000","last_fullsized":"2023-10-07T09:07:18.578120+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589741+0000","last_change":"2023-10-07T09:07:18.589741+0000","last_active":"2023-10-07T09:07:18.589741+0000","last_peered":"2023-10-07T09:07:18.589741+0000","last_clean":"2023-10-07T09:07:18.589741+0000","last_became_active":"2023-10-07T09:07:18.589359+0000","last_became_peered":"2023-10-07T09:07:18.589359+0000","last_unstale":"2023-10-07T09:07:18.589741+0000","last_undegraded":"2023-10-07T09:07:18.589741+0000","last_fullsized":"2023-10-07T09:07:18.589741+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:35:07.849497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571360+0000","last_change":"2023-10-07T09:07:18.571360+0000","last_active":"2023-10-07T09:07:18.571360+0000","last_peered":"2023-10-07T09:07:18.571360+0000","last_clean":"2023-10-07T09:07:18.571360+0000","last_became_active":"2023-10-07T09:07:18.571070+0000","last_became_peered":"2023-10-07T09:07:18.571070+0000","last_unstale":"2023-10-07T09:07:18.571360+0000","last_undegraded":"2023-10-07T09:07:18.571360+0000","last_fullsized":"2023-10-07T09:07:18.571360+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:41.806488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594726+0000","last_change":"2023-10-07T09:07:18.594726+0000","last_active":"2023-10-07T09:07:18.594726+0000","last_peered":"2023-10-07T09:07:18.594726+0000","last_clean":"2023-10-07T09:07:18.594726+0000","last_became_active":"2023-10-07T09:07:18.594493+0000","last_became_peered":"2023-10-07T09:07:18.594493+0000","last_unstale":"2023-10-07T09:07:18.594726+0000","last_undegraded":"2023-10-07T09:07:18.594726+0000","last_fullsized":"2023-10-07T09:07:18.594726+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:31.800203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.588845+0000","last_change":"2023-10-07T09:07:18.588845+0000","last_active":"2023-10-07T09:07:18.588845+0000","last_peered":"2023-10-07T09:07:18.588845+0000","last_clean":"2023-10-07T09:07:18.588845+0000","last_became_active":"2023-10-07T09:07:18.588428+0000","last_became_peered":"2023-10-07T09:07:18.588428+0000","last_unstale":"2023-10-07T09:07:18.588845+0000","last_undegraded":"2023-10-07T09:07:18.588845+0000","last_fullsized":"2023-10-07T09:07:18.588845+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:25.946755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580118+0000","last_change":"2023-10-07T09:07:18.574961+0000","last_active":"2023-10-07T09:07:18.580118+0000","last_peered":"2023-10-07T09:07:18.580118+0000","last_clean":"2023-10-07T09:07:18.580118+0000","last_became_active":"2023-10-07T09:07:18.574671+0000","last_became_peered":"2023-10-07T09:07:18.574671+0000","last_unstale":"2023-10-07T09:07:18.580118+0000","last_undegraded":"2023-10-07T09:07:18.580118+0000","last_fullsized":"2023-10-07T09:07:18.580118+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:50.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580390+0000","last_change":"2023-10-07T09:07:18.574463+0000","last_active":"2023-10-07T09:07:18.580390+0000","last_peered":"2023-10-07T09:07:18.580390+0000","last_clean":"2023-10-07T09:07:18.580390+0000","last_became_active":"2023-10-07T09:07:18.574172+0000","last_became_peered":"2023-10-07T09:07:18.574172+0000","last_unstale":"2023-10-07T09:07:18.580390+0000","last_undegraded":"2023-10-07T09:07:18.580390+0000","last_fullsized":"2023-10-07T09:07:18.580390+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589156+0000","last_change":"2023-10-07T09:07:18.589156+0000","last_active":"2023-10-07T09:07:18.589156+0000","last_peered":"2023-10-07T09:07:18.589156+0000","last_clean":"2023-10-07T09:07:18.589156+0000","last_became_active":"2023-10-07T09:07:18.588920+0000","last_became_peered":"2023-10-07T09:07:18.588920+0000","last_unstale":"2023-10-07T09:07:18.589156+0000","last_undegraded":"2023-10-07T09:07:18.589156+0000","last_fullsized":"2023-10-07T09:07:18.589156+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:43.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576927+0000","last_change":"2023-10-07T09:07:18.569610+0000","last_active":"2023-10-07T09:07:18.576927+0000","last_peered":"2023-10-07T09:07:18.576927+0000","last_clean":"2023-10-07T09:07:18.576927+0000","last_became_active":"2023-10-07T09:07:18.569341+0000","last_became_peered":"2023-10-07T09:07:18.569341+0000","last_unstale":"2023-10-07T09:07:18.576927+0000","last_undegraded":"2023-10-07T09:07:18.576927+0000","last_fullsized":"2023-10-07T09:07:18.576927+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:16.318264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582708+0000","last_change":"2023-10-07T09:07:18.582708+0000","last_active":"2023-10-07T09:07:18.582708+0000","last_peered":"2023-10-07T09:07:18.582708+0000","last_clean":"2023-10-07T09:07:18.582708+0000","last_became_active":"2023-10-07T09:07:18.582281+0000","last_became_peered":"2023-10-07T09:07:18.582281+0000","last_unstale":"2023-10-07T09:07:18.582708+0000","last_undegraded":"2023-10-07T09:07:18.582708+0000","last_fullsized":"2023-10-07T09:07:18.582708+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:10:31.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579331+0000","last_change":"2023-10-07T09:07:18.577822+0000","last_active":"2023-10-07T09:07:18.579331+0000","last_peered":"2023-10-07T09:07:18.579331+0000","last_clean":"2023-10-07T09:07:18.579331+0000","last_became_active":"2023-10-07T09:07:18.577561+0000","last_became_peered":"2023-10-07T09:07:18.577561+0000","last_unstale":"2023-10-07T09:07:18.579331+0000","last_undegraded":"2023-10-07T09:07:18.579331+0000","last_fullsized":"2023-10-07T09:07:18.579331+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:36:49.808898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571263+0000","last_change":"2023-10-07T09:07:18.568418+0000","last_active":"2023-10-07T09:07:18.571263+0000","last_peered":"2023-10-07T09:07:18.571263+0000","last_clean":"2023-10-07T09:07:18.571263+0000","last_became_active":"2023-10-07T09:07:18.568014+0000","last_became_peered":"2023-10-07T09:07:18.568014+0000","last_unstale":"2023-10-07T09:07:18.571263+0000","last_undegraded":"2023-10-07T09:07:18.571263+0000","last_fullsized":"2023-10-07T09:07:18.571263+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:55.202546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577942+0000","last_change":"2023-10-07T09:07:18.575759+0000","last_active":"2023-10-07T09:07:18.577942+0000","last_peered":"2023-10-07T09:07:18.577942+0000","last_clean":"2023-10-07T09:07:18.577942+0000","last_became_active":"2023-10-07T09:07:18.575454+0000","last_became_peered":"2023-10-07T09:07:18.575454+0000","last_unstale":"2023-10-07T09:07:18.577942+0000","last_undegraded":"2023-10-07T09:07:18.577942+0000","last_fullsized":"2023-10-07T09:07:18.577942+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:37.234087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580317+0000","last_change":"2023-10-07T09:07:18.577318+0000","last_active":"2023-10-07T09:07:18.580317+0000","last_peered":"2023-10-07T09:07:18.580317+0000","last_clean":"2023-10-07T09:07:18.580317+0000","last_became_active":"2023-10-07T09:07:18.577048+0000","last_became_peered":"2023-10-07T09:07:18.577048+0000","last_unstale":"2023-10-07T09:07:18.580317+0000","last_undegraded":"2023-10-07T09:07:18.580317+0000","last_fullsized":"2023-10-07T09:07:18.580317+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:43:29.248559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574715+0000","last_change":"2023-10-07T09:07:18.570372+0000","last_active":"2023-10-07T09:07:18.574715+0000","last_peered":"2023-10-07T09:07:18.574715+0000","last_clean":"2023-10-07T09:07:18.574715+0000","last_became_active":"2023-10-07T09:07:18.570093+0000","last_became_peered":"2023-10-07T09:07:18.570093+0000","last_unstale":"2023-10-07T09:07:18.574715+0000","last_undegraded":"2023-10-07T09:07:18.574715+0000","last_fullsized":"2023-10-07T09:07:18.574715+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:50.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573587+0000","last_change":"2023-10-07T09:07:18.573587+0000","last_active":"2023-10-07T09:07:18.573587+0000","last_peered":"2023-10-07T09:07:18.573587+0000","last_clean":"2023-10-07T09:07:18.573587+0000","last_became_active":"2023-10-07T09:07:18.573051+0000","last_became_peered":"2023-10-07T09:07:18.573051+0000","last_unstale":"2023-10-07T09:07:18.573587+0000","last_undegraded":"2023-10-07T09:07:18.573587+0000","last_fullsized":"2023-10-07T09:07:18.573587+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:18.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574403+0000","last_change":"2023-10-07T09:07:18.574403+0000","last_active":"2023-10-07T09:07:18.574403+0000","last_peered":"2023-10-07T09:07:18.574403+0000","last_clean":"2023-10-07T09:07:18.574403+0000","last_became_active":"2023-10-07T09:07:18.574130+0000","last_became_peered":"2023-10-07T09:07:18.574130+0000","last_unstale":"2023-10-07T09:07:18.574403+0000","last_undegraded":"2023-10-07T09:07:18.574403+0000","last_fullsized":"2023-10-07T09:07:18.574403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:19.920166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589603+0000","last_change":"2023-10-07T09:07:18.588988+0000","last_active":"2023-10-07T09:07:18.589603+0000","last_peered":"2023-10-07T09:07:18.589603+0000","last_clean":"2023-10-07T09:07:18.589603+0000","last_became_active":"2023-10-07T09:07:18.588704+0000","last_became_peered":"2023-10-07T09:07:18.588704+0000","last_unstale":"2023-10-07T09:07:18.589603+0000","last_undegraded":"2023-10-07T09:07:18.589603+0000","last_fullsized":"2023-10-07T09:07:18.589603+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:58:19.781339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574755+0000","last_change":"2023-10-07T09:07:18.570966+0000","last_active":"2023-10-07T09:07:18.574755+0000","last_peered":"2023-10-07T09:07:18.574755+0000","last_clean":"2023-10-07T09:07:18.574755+0000","last_became_active":"2023-10-07T09:07:18.570540+0000","last_became_peered":"2023-10-07T09:07:18.570540+0000","last_unstale":"2023-10-07T09:07:18.574755+0000","last_undegraded":"2023-10-07T09:07:18.574755+0000","last_fullsized":"2023-10-07T09:07:18.574755+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:34.139856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576666+0000","last_change":"2023-10-07T09:07:18.570867+0000","last_active":"2023-10-07T09:07:18.576666+0000","last_peered":"2023-10-07T09:07:18.576666+0000","last_clean":"2023-10-07T09:07:18.576666+0000","last_became_active":"2023-10-07T09:07:18.570604+0000","last_became_peered":"2023-10-07T09:07:18.570604+0000","last_unstale":"2023-10-07T09:07:18.576666+0000","last_undegraded":"2023-10-07T09:07:18.576666+0000","last_fullsized":"2023-10-07T09:07:18.576666+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.254578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577333+0000","last_change":"2023-10-07T09:07:18.577333+0000","last_active":"2023-10-07T09:07:18.577333+0000","last_peered":"2023-10-07T09:07:18.577333+0000","last_clean":"2023-10-07T09:07:18.577333+0000","last_became_active":"2023-10-07T09:07:18.577095+0000","last_became_peered":"2023-10-07T09:07:18.577095+0000","last_unstale":"2023-10-07T09:07:18.577333+0000","last_undegraded":"2023-10-07T09:07:18.577333+0000","last_fullsized":"2023-10-07T09:07:18.577333+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:33.512313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576916+0000","last_change":"2023-10-07T09:07:18.576916+0000","last_active":"2023-10-07T09:07:18.576916+0000","last_peered":"2023-10-07T09:07:18.576916+0000","last_clean":"2023-10-07T09:07:18.576916+0000","last_became_active":"2023-10-07T09:07:18.576668+0000","last_became_peered":"2023-10-07T09:07:18.576668+0000","last_unstale":"2023-10-07T09:07:18.576916+0000","last_undegraded":"2023-10-07T09:07:18.576916+0000","last_fullsized":"2023-10-07T09:07:18.576916+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:20.574402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.575855+0000","last_change":"2023-10-07T09:07:18.575855+0000","last_active":"2023-10-07T09:07:18.575855+0000","last_peered":"2023-10-07T09:07:18.575855+0000","last_clean":"2023-10-07T09:07:18.575855+0000","last_became_active":"2023-10-07T09:07:18.575673+0000","last_became_peered":"2023-10-07T09:07:18.575673+0000","last_unstale":"2023-10-07T09:07:18.575855+0000","last_undegraded":"2023-10-07T09:07:18.575855+0000","last_fullsized":"2023-10-07T09:07:18.575855+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:22:55.680377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.587992+0000","last_change":"2023-10-07T09:07:18.587992+0000","last_active":"2023-10-07T09:07:18.587992+0000","last_peered":"2023-10-07T09:07:18.587992+0000","last_clean":"2023-10-07T09:07:18.587992+0000","last_became_active":"2023-10-07T09:07:18.587477+0000","last_became_peered":"2023-10-07T09:07:18.587477+0000","last_unstale":"2023-10-07T09:07:18.587992+0000","last_undegraded":"2023-10-07T09:07:18.587992+0000","last_fullsized":"2023-10-07T09:07:18.587992+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:30:47.174504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578119+0000","last_change":"2023-10-07T09:07:18.578119+0000","last_active":"2023-10-07T09:07:18.578119+0000","last_peered":"2023-10-07T09:07:18.578119+0000","last_clean":"2023-10-07T09:07:18.578119+0000","last_became_active":"2023-10-07T09:07:18.577849+0000","last_became_peered":"2023-10-07T09:07:18.577849+0000","last_unstale":"2023-10-07T09:07:18.578119+0000","last_undegraded":"2023-10-07T09:07:18.578119+0000","last_fullsized":"2023-10-07T09:07:18.578119+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:30.318874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582374+0000","last_change":"2023-10-07T09:07:18.582374+0000","last_active":"2023-10-07T09:07:18.582374+0000","last_peered":"2023-10-07T09:07:18.582374+0000","last_clean":"2023-10-07T09:07:18.582374+0000","last_became_active":"2023-10-07T09:07:18.581916+0000","last_became_peered":"2023-10-07T09:07:18.581916+0000","last_unstale":"2023-10-07T09:07:18.582374+0000","last_undegraded":"2023-10-07T09:07:18.582374+0000","last_fullsized":"2023-10-07T09:07:18.582374+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:11:25.805404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.568119+0000","last_change":"2023-10-07T09:07:18.568119+0000","last_active":"2023-10-07T09:07:18.568119+0000","last_peered":"2023-10-07T09:07:18.568119+0000","last_clean":"2023-10-07T09:07:18.568119+0000","last_became_active":"2023-10-07T09:07:18.567151+0000","last_became_peered":"2023-10-07T09:07:18.567151+0000","last_unstale":"2023-10-07T09:07:18.568119+0000","last_undegraded":"2023-10-07T09:07:18.568119+0000","last_fullsized":"2023-10-07T09:07:18.568119+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:00.254578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590122+0000","last_change":"2023-10-07T09:07:18.590122+0000","last_active":"2023-10-07T09:07:18.590122+0000","last_peered":"2023-10-07T09:07:18.590122+0000","last_clean":"2023-10-07T09:07:18.590122+0000","last_became_active":"2023-10-07T09:07:18.589853+0000","last_became_peered":"2023-10-07T09:07:18.589853+0000","last_unstale":"2023-10-07T09:07:18.590122+0000","last_undegraded":"2023-10-07T09:07:18.590122+0000","last_fullsized":"2023-10-07T09:07:18.590122+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:37:23.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590777+0000","last_change":"2023-10-07T09:07:18.590777+0000","last_active":"2023-10-07T09:07:18.590777+0000","last_peered":"2023-10-07T09:07:18.590777+0000","last_clean":"2023-10-07T09:07:18.590777+0000","last_became_active":"2023-10-07T09:07:18.590444+0000","last_became_peered":"2023-10-07T09:07:18.590444+0000","last_unstale":"2023-10-07T09:07:18.590777+0000","last_undegraded":"2023-10-07T09:07:18.590777+0000","last_fullsized":"2023-10-07T09:07:18.590777+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:43.963904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"181'4","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.596128+0000","last_change":"2023-10-07T09:07:17.561676+0000","last_active":"2023-10-07T09:07:18.596128+0000","last_peered":"2023-10-07T09:07:18.596128+0000","last_clean":"2023-10-07T09:07:18.596128+0000","last_became_active":"2023-10-07T09:07:17.561334+0000","last_became_peered":"2023-10-07T09:07:17.561334+0000","last_unstale":"2023-10-07T09:07:18.596128+0000","last_undegraded":"2023-10-07T09:07:18.596128+0000","last_fullsized":"2023-10-07T09:07:18.596128+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:05.912551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579300+0000","last_change":"2023-10-07T09:07:18.575903+0000","last_active":"2023-10-07T09:07:18.579300+0000","last_peered":"2023-10-07T09:07:18.579300+0000","last_clean":"2023-10-07T09:07:18.579300+0000","last_became_active":"2023-10-07T09:07:18.575658+0000","last_became_peered":"2023-10-07T09:07:18.575658+0000","last_unstale":"2023-10-07T09:07:18.579300+0000","last_undegraded":"2023-10-07T09:07:18.579300+0000","last_fullsized":"2023-10-07T09:07:18.579300+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:51.029479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592809+0000","last_change":"2023-10-07T09:07:17.559015+0000","last_active":"2023-10-07T09:07:18.592809+0000","last_peered":"2023-10-07T09:07:18.592809+0000","last_clean":"2023-10-07T09:07:18.592809+0000","last_became_active":"2023-10-07T09:07:17.558583+0000","last_became_peered":"2023-10-07T09:07:17.558583+0000","last_unstale":"2023-10-07T09:07:18.592809+0000","last_undegraded":"2023-10-07T09:07:18.592809+0000","last_fullsized":"2023-10-07T09:07:18.592809+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:42.958759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.584808+0000","last_change":"2023-10-07T09:07:18.584808+0000","last_active":"2023-10-07T09:07:18.584808+0000","last_peered":"2023-10-07T09:07:18.584808+0000","last_clean":"2023-10-07T09:07:18.584808+0000","last_became_active":"2023-10-07T09:07:18.584507+0000","last_became_peered":"2023-10-07T09:07:18.584507+0000","last_unstale":"2023-10-07T09:07:18.584808+0000","last_undegraded":"2023-10-07T09:07:18.584808+0000","last_fullsized":"2023-10-07T09:07:18.584808+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:35.361244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"181'2","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594880+0000","last_change":"2023-10-07T09:07:17.562352+0000","last_active":"2023-10-07T09:07:18.594880+0000","last_peered":"2023-10-07T09:07:18.594880+0000","last_clean":"2023-10-07T09:07:18.594880+0000","last_became_active":"2023-10-07T09:07:17.562101+0000","last_became_peered":"2023-10-07T09:07:17.562101+0000","last_unstale":"2023-10-07T09:07:18.594880+0000","last_undegraded":"2023-10-07T09:07:18.594880+0000","last_fullsized":"2023-10-07T09:07:18.594880+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:26.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.577295+0000","last_change":"2023-10-07T09:07:18.577295+0000","last_active":"2023-10-07T09:07:18.577295+0000","last_peered":"2023-10-07T09:07:18.577295+0000","last_clean":"2023-10-07T09:07:18.577295+0000","last_became_active":"2023-10-07T09:07:18.577014+0000","last_became_peered":"2023-10-07T09:07:18.577014+0000","last_unstale":"2023-10-07T09:07:18.577295+0000","last_undegraded":"2023-10-07T09:07:18.577295+0000","last_fullsized":"2023-10-07T09:07:18.577295+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:59.296038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"181'1","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589833+0000","last_change":"2023-10-07T09:07:17.563086+0000","last_active":"2023-10-07T09:07:18.589833+0000","last_peered":"2023-10-07T09:07:18.589833+0000","last_clean":"2023-10-07T09:07:18.589833+0000","last_became_active":"2023-10-07T09:07:17.562844+0000","last_became_peered":"2023-10-07T09:07:17.562844+0000","last_unstale":"2023-10-07T09:07:18.589833+0000","last_undegraded":"2023-10-07T09:07:18.589833+0000","last_fullsized":"2023-10-07T09:07:18.589833+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:27.245519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574823+0000","last_change":"2023-10-07T09:07:18.574823+0000","last_active":"2023-10-07T09:07:18.574823+0000","last_peered":"2023-10-07T09:07:18.574823+0000","last_clean":"2023-10-07T09:07:18.574823+0000","last_became_active":"2023-10-07T09:07:18.574642+0000","last_became_peered":"2023-10-07T09:07:18.574642+0000","last_unstale":"2023-10-07T09:07:18.574823+0000","last_undegraded":"2023-10-07T09:07:18.574823+0000","last_fullsized":"2023-10-07T09:07:18.574823+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:49.677773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.575337+0000","last_change":"2023-10-07T09:07:17.559178+0000","last_active":"2023-10-07T09:07:18.575337+0000","last_peered":"2023-10-07T09:07:18.575337+0000","last_clean":"2023-10-07T09:07:18.575337+0000","last_became_active":"2023-10-07T09:07:17.558804+0000","last_became_peered":"2023-10-07T09:07:17.558804+0000","last_unstale":"2023-10-07T09:07:18.575337+0000","last_undegraded":"2023-10-07T09:07:18.575337+0000","last_fullsized":"2023-10-07T09:07:18.575337+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:43.280754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.571424+0000","last_change":"2023-10-07T09:07:18.569192+0000","last_active":"2023-10-07T09:07:18.571424+0000","last_peered":"2023-10-07T09:07:18.571424+0000","last_clean":"2023-10-07T09:07:18.571424+0000","last_became_active":"2023-10-07T09:07:18.568933+0000","last_became_peered":"2023-10-07T09:07:18.568933+0000","last_unstale":"2023-10-07T09:07:18.571424+0000","last_undegraded":"2023-10-07T09:07:18.571424+0000","last_fullsized":"2023-10-07T09:07:18.571424+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:34.139856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.561607+0000","last_change":"2023-10-07T09:07:17.562690+0000","last_active":"2023-10-07T09:07:18.561607+0000","last_peered":"2023-10-07T09:07:18.561607+0000","last_clean":"2023-10-07T09:07:18.561607+0000","last_became_active":"2023-10-07T09:07:17.561892+0000","last_became_peered":"2023-10-07T09:07:17.561892+0000","last_unstale":"2023-10-07T09:07:18.561607+0000","last_undegraded":"2023-10-07T09:07:18.561607+0000","last_fullsized":"2023-10-07T09:07:18.561607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:33.610231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573016+0000","last_change":"2023-10-07T09:07:18.573016+0000","last_active":"2023-10-07T09:07:18.573016+0000","last_peered":"2023-10-07T09:07:18.573016+0000","last_clean":"2023-10-07T09:07:18.573016+0000","last_became_active":"2023-10-07T09:07:18.572765+0000","last_became_peered":"2023-10-07T09:07:18.572765+0000","last_unstale":"2023-10-07T09:07:18.573016+0000","last_undegraded":"2023-10-07T09:07:18.573016+0000","last_fullsized":"2023-10-07T09:07:18.573016+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:36.426513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.563497+0000","last_change":"2023-10-07T09:07:17.561601+0000","last_active":"2023-10-07T09:07:17.563497+0000","last_peered":"2023-10-07T09:07:17.563497+0000","last_clean":"2023-10-07T09:07:17.563497+0000","last_became_active":"2023-10-07T09:07:17.561263+0000","last_became_peered":"2023-10-07T09:07:17.561263+0000","last_unstale":"2023-10-07T09:07:17.563497+0000","last_undegraded":"2023-10-07T09:07:17.563497+0000","last_fullsized":"2023-10-07T09:07:17.563497+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:26.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573623+0000","last_change":"2023-10-07T09:07:18.573623+0000","last_active":"2023-10-07T09:07:18.573623+0000","last_peered":"2023-10-07T09:07:18.573623+0000","last_clean":"2023-10-07T09:07:18.573623+0000","last_became_active":"2023-10-07T09:07:18.573345+0000","last_became_peered":"2023-10-07T09:07:18.573345+0000","last_unstale":"2023-10-07T09:07:18.573623+0000","last_undegraded":"2023-10-07T09:07:18.573623+0000","last_fullsized":"2023-10-07T09:07:18.573623+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:18.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562664+0000","last_change":"2023-10-07T09:07:17.557699+0000","last_active":"2023-10-07T09:07:17.562664+0000","last_peered":"2023-10-07T09:07:17.562664+0000","last_clean":"2023-10-07T09:07:17.562664+0000","last_became_active":"2023-10-07T09:07:17.557389+0000","last_became_peered":"2023-10-07T09:07:17.557389+0000","last_unstale":"2023-10-07T09:07:17.562664+0000","last_undegraded":"2023-10-07T09:07:17.562664+0000","last_fullsized":"2023-10-07T09:07:17.562664+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:00:15.673360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.589399+0000","last_change":"2023-10-07T09:07:18.588928+0000","last_active":"2023-10-07T09:07:18.589399+0000","last_peered":"2023-10-07T09:07:18.589399+0000","last_clean":"2023-10-07T09:07:18.589399+0000","last_became_active":"2023-10-07T09:07:18.588643+0000","last_became_peered":"2023-10-07T09:07:18.588643+0000","last_unstale":"2023-10-07T09:07:18.589399+0000","last_undegraded":"2023-10-07T09:07:18.589399+0000","last_fullsized":"2023-10-07T09:07:18.589399+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:12:53.658651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563947+0000","last_change":"2023-10-07T09:07:17.558344+0000","last_active":"2023-10-07T09:07:18.563947+0000","last_peered":"2023-10-07T09:07:18.563947+0000","last_clean":"2023-10-07T09:07:18.563947+0000","last_became_active":"2023-10-07T09:07:17.558050+0000","last_became_peered":"2023-10-07T09:07:17.558050+0000","last_unstale":"2023-10-07T09:07:18.563947+0000","last_undegraded":"2023-10-07T09:07:18.563947+0000","last_fullsized":"2023-10-07T09:07:18.563947+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:43.451948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581888+0000","last_change":"2023-10-07T09:07:18.578507+0000","last_active":"2023-10-07T09:07:18.581888+0000","last_peered":"2023-10-07T09:07:18.581888+0000","last_clean":"2023-10-07T09:07:18.581888+0000","last_became_active":"2023-10-07T09:07:18.578235+0000","last_became_peered":"2023-10-07T09:07:18.578235+0000","last_unstale":"2023-10-07T09:07:18.581888+0000","last_undegraded":"2023-10-07T09:07:18.581888+0000","last_fullsized":"2023-10-07T09:07:18.581888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:52.797060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"181'3","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582877+0000","last_change":"2023-10-07T09:07:17.554044+0000","last_active":"2023-10-07T09:07:18.582877+0000","last_peered":"2023-10-07T09:07:18.582877+0000","last_clean":"2023-10-07T09:07:18.582877+0000","last_became_active":"2023-10-07T09:07:17.553756+0000","last_became_peered":"2023-10-07T09:07:17.553756+0000","last_unstale":"2023-10-07T09:07:18.582877+0000","last_undegraded":"2023-10-07T09:07:18.582877+0000","last_fullsized":"2023-10-07T09:07:18.582877+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:33.610231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.594699+0000","last_change":"2023-10-07T09:07:18.594699+0000","last_active":"2023-10-07T09:07:18.594699+0000","last_peered":"2023-10-07T09:07:18.594699+0000","last_clean":"2023-10-07T09:07:18.594699+0000","last_became_active":"2023-10-07T09:07:18.594371+0000","last_became_peered":"2023-10-07T09:07:18.594371+0000","last_unstale":"2023-10-07T09:07:18.594699+0000","last_undegraded":"2023-10-07T09:07:18.594699+0000","last_fullsized":"2023-10-07T09:07:18.594699+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:14.647063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"181'6","reported_seq":15,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.596211+0000","last_change":"2023-10-07T09:07:17.560817+0000","last_active":"2023-10-07T09:07:18.596211+0000","last_peered":"2023-10-07T09:07:18.596211+0000","last_clean":"2023-10-07T09:07:18.596211+0000","last_became_active":"2023-10-07T09:07:17.560547+0000","last_became_peered":"2023-10-07T09:07:17.560547+0000","last_unstale":"2023-10-07T09:07:18.596211+0000","last_undegraded":"2023-10-07T09:07:18.596211+0000","last_fullsized":"2023-10-07T09:07:18.596211+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:56:38.398940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573345+0000","last_change":"2023-10-07T09:07:18.573345+0000","last_active":"2023-10-07T09:07:18.573345+0000","last_peered":"2023-10-07T09:07:18.573345+0000","last_clean":"2023-10-07T09:07:18.573345+0000","last_became_active":"2023-10-07T09:07:18.572676+0000","last_became_peered":"2023-10-07T09:07:18.572676+0000","last_unstale":"2023-10-07T09:07:18.573345+0000","last_undegraded":"2023-10-07T09:07:18.573345+0000","last_fullsized":"2023-10-07T09:07:18.573345+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:19.920166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.595738+0000","last_change":"2023-10-07T09:07:17.561694+0000","last_active":"2023-10-07T09:07:18.595738+0000","last_peered":"2023-10-07T09:07:18.595738+0000","last_clean":"2023-10-07T09:07:18.595738+0000","last_became_active":"2023-10-07T09:07:17.561394+0000","last_became_peered":"2023-10-07T09:07:17.561394+0000","last_unstale":"2023-10-07T09:07:18.595738+0000","last_undegraded":"2023-10-07T09:07:18.595738+0000","last_fullsized":"2023-10-07T09:07:18.595738+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:29:59.595773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579318+0000","last_change":"2023-10-07T09:07:18.579318+0000","last_active":"2023-10-07T09:07:18.579318+0000","last_peered":"2023-10-07T09:07:18.579318+0000","last_clean":"2023-10-07T09:07:18.579318+0000","last_became_active":"2023-10-07T09:07:18.577486+0000","last_became_peered":"2023-10-07T09:07:18.577486+0000","last_unstale":"2023-10-07T09:07:18.579318+0000","last_undegraded":"2023-10-07T09:07:18.579318+0000","last_fullsized":"2023-10-07T09:07:18.579318+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:37:43.963904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.556345+0000","last_change":"2023-10-07T09:07:17.555276+0000","last_active":"2023-10-07T09:07:17.556345+0000","last_peered":"2023-10-07T09:07:17.556345+0000","last_clean":"2023-10-07T09:07:17.556345+0000","last_became_active":"2023-10-07T09:07:17.554961+0000","last_became_peered":"2023-10-07T09:07:17.554961+0000","last_unstale":"2023-10-07T09:07:17.556345+0000","last_undegraded":"2023-10-07T09:07:17.556345+0000","last_fullsized":"2023-10-07T09:07:17.556345+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.572866+0000","last_change":"2023-10-07T09:07:18.568533+0000","last_active":"2023-10-07T09:07:18.572866+0000","last_peered":"2023-10-07T09:07:18.572866+0000","last_clean":"2023-10-07T09:07:18.572866+0000","last_became_active":"2023-10-07T09:07:18.568278+0000","last_became_peered":"2023-10-07T09:07:18.568278+0000","last_unstale":"2023-10-07T09:07:18.572866+0000","last_undegraded":"2023-10-07T09:07:18.572866+0000","last_fullsized":"2023-10-07T09:07:18.572866+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.563937+0000","last_change":"2023-10-07T09:07:17.559219+0000","last_active":"2023-10-07T09:07:17.563937+0000","last_peered":"2023-10-07T09:07:17.563937+0000","last_clean":"2023-10-07T09:07:17.563937+0000","last_became_active":"2023-10-07T09:07:17.558900+0000","last_became_peered":"2023-10-07T09:07:17.558900+0000","last_unstale":"2023-10-07T09:07:17.563937+0000","last_undegraded":"2023-10-07T09:07:17.563937+0000","last_fullsized":"2023-10-07T09:07:17.563937+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T21:05:43.451948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578935+0000","last_change":"2023-10-07T09:07:18.578935+0000","last_active":"2023-10-07T09:07:18.578935+0000","last_peered":"2023-10-07T09:07:18.578935+0000","last_clean":"2023-10-07T09:07:18.578935+0000","last_became_active":"2023-10-07T09:07:18.578642+0000","last_became_peered":"2023-10-07T09:07:18.578642+0000","last_unstale":"2023-10-07T09:07:18.578935+0000","last_undegraded":"2023-10-07T09:07:18.578935+0000","last_fullsized":"2023-10-07T09:07:18.578935+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:51.029479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"181'8","reported_seq":17,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.593508+0000","last_change":"2023-10-07T09:07:17.559864+0000","last_active":"2023-10-07T09:07:18.593508+0000","last_peered":"2023-10-07T09:07:18.593508+0000","last_clean":"2023-10-07T09:07:18.593508+0000","last_became_active":"2023-10-07T09:07:17.559589+0000","last_became_peered":"2023-10-07T09:07:17.559589+0000","last_unstale":"2023-10-07T09:07:18.593508+0000","last_undegraded":"2023-10-07T09:07:18.593508+0000","last_fullsized":"2023-10-07T09:07:18.593508+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:41:36.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578258+0000","last_change":"2023-10-07T09:07:18.578258+0000","last_active":"2023-10-07T09:07:18.578258+0000","last_peered":"2023-10-07T09:07:18.578258+0000","last_clean":"2023-10-07T09:07:18.578258+0000","last_became_active":"2023-10-07T09:07:18.578001+0000","last_became_peered":"2023-10-07T09:07:18.578001+0000","last_unstale":"2023-10-07T09:07:18.578258+0000","last_undegraded":"2023-10-07T09:07:18.578258+0000","last_fullsized":"2023-10-07T09:07:18.578258+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:53.020616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.586607+0000","last_change":"2023-10-07T09:07:17.553473+0000","last_active":"2023-10-07T09:07:18.586607+0000","last_peered":"2023-10-07T09:07:18.586607+0000","last_clean":"2023-10-07T09:07:18.586607+0000","last_became_active":"2023-10-07T09:07:17.553209+0000","last_became_peered":"2023-10-07T09:07:17.553209+0000","last_unstale":"2023-10-07T09:07:18.586607+0000","last_undegraded":"2023-10-07T09:07:18.586607+0000","last_fullsized":"2023-10-07T09:07:18.586607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:53.337081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578667+0000","last_change":"2023-10-07T09:07:18.578667+0000","last_active":"2023-10-07T09:07:18.578667+0000","last_peered":"2023-10-07T09:07:18.578667+0000","last_clean":"2023-10-07T09:07:18.578667+0000","last_became_active":"2023-10-07T09:07:18.577835+0000","last_became_peered":"2023-10-07T09:07:18.577835+0000","last_unstale":"2023-10-07T09:07:18.578667+0000","last_undegraded":"2023-10-07T09:07:18.578667+0000","last_fullsized":"2023-10-07T09:07:18.578667+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:01.112564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"181'2","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592361+0000","last_change":"2023-10-07T09:07:17.549092+0000","last_active":"2023-10-07T09:07:18.592361+0000","last_peered":"2023-10-07T09:07:18.592361+0000","last_clean":"2023-10-07T09:07:18.592361+0000","last_became_active":"2023-10-07T09:07:17.548518+0000","last_became_peered":"2023-10-07T09:07:17.548518+0000","last_unstale":"2023-10-07T09:07:18.592361+0000","last_undegraded":"2023-10-07T09:07:18.592361+0000","last_fullsized":"2023-10-07T09:07:18.592361+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:33.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576685+0000","last_change":"2023-10-07T09:07:18.576685+0000","last_active":"2023-10-07T09:07:18.576685+0000","last_peered":"2023-10-07T09:07:18.576685+0000","last_clean":"2023-10-07T09:07:18.576685+0000","last_became_active":"2023-10-07T09:07:18.576365+0000","last_became_peered":"2023-10-07T09:07:18.576365+0000","last_unstale":"2023-10-07T09:07:18.576685+0000","last_undegraded":"2023-10-07T09:07:18.576685+0000","last_fullsized":"2023-10-07T09:07:18.576685+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:49.677773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"181'1","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.592796+0000","last_change":"2023-10-07T09:07:17.558838+0000","last_active":"2023-10-07T09:07:18.592796+0000","last_peered":"2023-10-07T09:07:18.592796+0000","last_clean":"2023-10-07T09:07:18.592796+0000","last_became_active":"2023-10-07T09:07:17.558236+0000","last_became_peered":"2023-10-07T09:07:17.558236+0000","last_unstale":"2023-10-07T09:07:18.592796+0000","last_undegraded":"2023-10-07T09:07:18.592796+0000","last_fullsized":"2023-10-07T09:07:18.592796+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:19:18.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582041+0000","last_change":"2023-10-07T09:07:18.578901+0000","last_active":"2023-10-07T09:07:18.582041+0000","last_peered":"2023-10-07T09:07:18.582041+0000","last_clean":"2023-10-07T09:07:18.582041+0000","last_became_active":"2023-10-07T09:07:18.578606+0000","last_became_peered":"2023-10-07T09:07:18.578606+0000","last_unstale":"2023-10-07T09:07:18.582041+0000","last_undegraded":"2023-10-07T09:07:18.582041+0000","last_fullsized":"2023-10-07T09:07:18.582041+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:19.350190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563230+0000","last_change":"2023-10-07T09:07:17.560674+0000","last_active":"2023-10-07T09:07:18.563230+0000","last_peered":"2023-10-07T09:07:18.563230+0000","last_clean":"2023-10-07T09:07:18.563230+0000","last_became_active":"2023-10-07T09:07:17.560422+0000","last_became_peered":"2023-10-07T09:07:17.560422+0000","last_unstale":"2023-10-07T09:07:18.563230+0000","last_undegraded":"2023-10-07T09:07:18.563230+0000","last_fullsized":"2023-10-07T09:07:18.563230+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:45:54.197401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580148+0000","last_change":"2023-10-07T09:07:18.574362+0000","last_active":"2023-10-07T09:07:18.580148+0000","last_peered":"2023-10-07T09:07:18.580148+0000","last_clean":"2023-10-07T09:07:18.580148+0000","last_became_active":"2023-10-07T09:07:18.573900+0000","last_became_peered":"2023-10-07T09:07:18.573900+0000","last_unstale":"2023-10-07T09:07:18.580148+0000","last_undegraded":"2023-10-07T09:07:18.580148+0000","last_fullsized":"2023-10-07T09:07:18.580148+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:12.715858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.587709+0000","last_change":"2023-10-07T09:07:17.562243+0000","last_active":"2023-10-07T09:07:18.587709+0000","last_peered":"2023-10-07T09:07:18.587709+0000","last_clean":"2023-10-07T09:07:18.587709+0000","last_became_active":"2023-10-07T09:07:17.561919+0000","last_became_peered":"2023-10-07T09:07:17.561919+0000","last_unstale":"2023-10-07T09:07:18.587709+0000","last_undegraded":"2023-10-07T09:07:18.587709+0000","last_fullsized":"2023-10-07T09:07:18.587709+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:43.796883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.580757+0000","last_change":"2023-10-07T09:07:18.580757+0000","last_active":"2023-10-07T09:07:18.580757+0000","last_peered":"2023-10-07T09:07:18.580757+0000","last_clean":"2023-10-07T09:07:18.580757+0000","last_became_active":"2023-10-07T09:07:18.580442+0000","last_became_peered":"2023-10-07T09:07:18.580442+0000","last_unstale":"2023-10-07T09:07:18.580757+0000","last_undegraded":"2023-10-07T09:07:18.580757+0000","last_fullsized":"2023-10-07T09:07:18.580757+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:18:20.481390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.565899+0000","last_change":"2023-10-07T09:07:17.560451+0000","last_active":"2023-10-07T09:07:18.565899+0000","last_peered":"2023-10-07T09:07:18.565899+0000","last_clean":"2023-10-07T09:07:18.565899+0000","last_became_active":"2023-10-07T09:07:17.560183+0000","last_became_peered":"2023-10-07T09:07:17.560183+0000","last_unstale":"2023-10-07T09:07:18.565899+0000","last_undegraded":"2023-10-07T09:07:18.565899+0000","last_fullsized":"2023-10-07T09:07:18.565899+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:13.641919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.579851+0000","last_change":"2023-10-07T09:07:18.576431+0000","last_active":"2023-10-07T09:07:18.579851+0000","last_peered":"2023-10-07T09:07:18.579851+0000","last_clean":"2023-10-07T09:07:18.579851+0000","last_became_active":"2023-10-07T09:07:18.576113+0000","last_became_peered":"2023-10-07T09:07:18.576113+0000","last_unstale":"2023-10-07T09:07:18.579851+0000","last_undegraded":"2023-10-07T09:07:18.579851+0000","last_fullsized":"2023-10-07T09:07:18.579851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:32.141771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.563027+0000","last_change":"2023-10-07T09:07:17.557044+0000","last_active":"2023-10-07T09:07:18.563027+0000","last_peered":"2023-10-07T09:07:18.563027+0000","last_clean":"2023-10-07T09:07:18.563027+0000","last_became_active":"2023-10-07T09:07:17.556726+0000","last_became_peered":"2023-10-07T09:07:17.556726+0000","last_unstale":"2023-10-07T09:07:18.563027+0000","last_undegraded":"2023-10-07T09:07:18.563027+0000","last_fullsized":"2023-10-07T09:07:18.563027+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:52:17.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.576546+0000","last_change":"2023-10-07T09:07:18.567992+0000","last_active":"2023-10-07T09:07:18.576546+0000","last_peered":"2023-10-07T09:07:18.576546+0000","last_clean":"2023-10-07T09:07:18.576546+0000","last_became_active":"2023-10-07T09:07:18.567710+0000","last_became_peered":"2023-10-07T09:07:18.567710+0000","last_unstale":"2023-10-07T09:07:18.576546+0000","last_undegraded":"2023-10-07T09:07:18.576546+0000","last_fullsized":"2023-10-07T09:07:18.576546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:41:46.851205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562607+0000","last_change":"2023-10-07T09:07:17.556788+0000","last_active":"2023-10-07T09:07:17.562607+0000","last_peered":"2023-10-07T09:07:17.562607+0000","last_clean":"2023-10-07T09:07:17.562607+0000","last_became_active":"2023-10-07T09:07:17.556530+0000","last_became_peered":"2023-10-07T09:07:17.556530+0000","last_unstale":"2023-10-07T09:07:17.562607+0000","last_undegraded":"2023-10-07T09:07:17.562607+0000","last_fullsized":"2023-10-07T09:07:17.562607+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:57:43.627093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.573084+0000","last_change":"2023-10-07T09:07:18.573084+0000","last_active":"2023-10-07T09:07:18.573084+0000","last_peered":"2023-10-07T09:07:18.573084+0000","last_clean":"2023-10-07T09:07:18.573084+0000","last_became_active":"2023-10-07T09:07:18.572513+0000","last_became_peered":"2023-10-07T09:07:18.572513+0000","last_unstale":"2023-10-07T09:07:18.573084+0000","last_undegraded":"2023-10-07T09:07:18.573084+0000","last_fullsized":"2023-10-07T09:07:18.573084+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:06.548976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.588894+0000","last_change":"2023-10-07T09:07:17.558531+0000","last_active":"2023-10-07T09:07:18.588894+0000","last_peered":"2023-10-07T09:07:18.588894+0000","last_clean":"2023-10-07T09:07:18.588894+0000","last_became_active":"2023-10-07T09:07:17.558250+0000","last_became_peered":"2023-10-07T09:07:17.558250+0000","last_unstale":"2023-10-07T09:07:18.588894+0000","last_undegraded":"2023-10-07T09:07:18.588894+0000","last_fullsized":"2023-10-07T09:07:18.588894+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:29:57.877895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574739+0000","last_change":"2023-10-07T09:07:18.570795+0000","last_active":"2023-10-07T09:07:18.574739+0000","last_peered":"2023-10-07T09:07:18.574739+0000","last_clean":"2023-10-07T09:07:18.574739+0000","last_became_active":"2023-10-07T09:07:18.570201+0000","last_became_peered":"2023-10-07T09:07:18.570201+0000","last_unstale":"2023-10-07T09:07:18.574739+0000","last_undegraded":"2023-10-07T09:07:18.574739+0000","last_fullsized":"2023-10-07T09:07:18.574739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:12.715858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.556219+0000","last_change":"2023-10-07T09:07:17.553530+0000","last_active":"2023-10-07T09:07:17.556219+0000","last_peered":"2023-10-07T09:07:17.556219+0000","last_clean":"2023-10-07T09:07:17.556219+0000","last_became_active":"2023-10-07T09:07:17.553259+0000","last_became_peered":"2023-10-07T09:07:17.553259+0000","last_unstale":"2023-10-07T09:07:17.556219+0000","last_undegraded":"2023-10-07T09:07:17.556219+0000","last_fullsized":"2023-10-07T09:07:17.556219+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:32.807035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.581871+0000","last_change":"2023-10-07T09:07:18.575007+0000","last_active":"2023-10-07T09:07:18.581871+0000","last_peered":"2023-10-07T09:07:18.581871+0000","last_clean":"2023-10-07T09:07:18.581871+0000","last_became_active":"2023-10-07T09:07:18.574732+0000","last_became_peered":"2023-10-07T09:07:18.574732+0000","last_unstale":"2023-10-07T09:07:18.581871+0000","last_undegraded":"2023-10-07T09:07:18.581871+0000","last_fullsized":"2023-10-07T09:07:18.581871+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:35:42.086197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562694+0000","last_change":"2023-10-07T09:07:17.557720+0000","last_active":"2023-10-07T09:07:17.562694+0000","last_peered":"2023-10-07T09:07:17.562694+0000","last_clean":"2023-10-07T09:07:17.562694+0000","last_became_active":"2023-10-07T09:07:17.557399+0000","last_became_peered":"2023-10-07T09:07:17.557399+0000","last_unstale":"2023-10-07T09:07:17.562694+0000","last_undegraded":"2023-10-07T09:07:17.562694+0000","last_fullsized":"2023-10-07T09:07:17.562694+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:37:12.760564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.574896+0000","last_change":"2023-10-07T09:07:18.574896+0000","last_active":"2023-10-07T09:07:18.574896+0000","last_peered":"2023-10-07T09:07:18.574896+0000","last_clean":"2023-10-07T09:07:18.574896+0000","last_became_active":"2023-10-07T09:07:18.574640+0000","last_became_peered":"2023-10-07T09:07:18.574640+0000","last_unstale":"2023-10-07T09:07:18.574896+0000","last_undegraded":"2023-10-07T09:07:18.574896+0000","last_fullsized":"2023-10-07T09:07:18.574896+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:34:50.778081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.562728+0000","last_change":"2023-10-07T09:07:17.556750+0000","last_active":"2023-10-07T09:07:17.562728+0000","last_peered":"2023-10-07T09:07:17.562728+0000","last_clean":"2023-10-07T09:07:17.562728+0000","last_became_active":"2023-10-07T09:07:17.556496+0000","last_became_peered":"2023-10-07T09:07:17.556496+0000","last_unstale":"2023-10-07T09:07:17.562728+0000","last_undegraded":"2023-10-07T09:07:17.562728+0000","last_fullsized":"2023-10-07T09:07:17.562728+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:02.048746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.582736+0000","last_change":"2023-10-07T09:07:18.582736+0000","last_active":"2023-10-07T09:07:18.582736+0000","last_peered":"2023-10-07T09:07:18.582736+0000","last_clean":"2023-10-07T09:07:18.582736+0000","last_became_active":"2023-10-07T09:07:18.581798+0000","last_became_peered":"2023-10-07T09:07:18.581798+0000","last_unstale":"2023-10-07T09:07:18.582736+0000","last_undegraded":"2023-10-07T09:07:18.582736+0000","last_fullsized":"2023-10-07T09:07:18.582736+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:48.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.564885+0000","last_change":"2023-10-07T09:07:17.557781+0000","last_active":"2023-10-07T09:07:18.564885+0000","last_peered":"2023-10-07T09:07:18.564885+0000","last_clean":"2023-10-07T09:07:18.564885+0000","last_became_active":"2023-10-07T09:07:17.557519+0000","last_became_peered":"2023-10-07T09:07:17.557519+0000","last_unstale":"2023-10-07T09:07:18.564885+0000","last_undegraded":"2023-10-07T09:07:18.564885+0000","last_fullsized":"2023-10-07T09:07:18.564885+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:05.543832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.586446+0000","last_change":"2023-10-07T09:07:18.586446+0000","last_active":"2023-10-07T09:07:18.586446+0000","last_peered":"2023-10-07T09:07:18.586446+0000","last_clean":"2023-10-07T09:07:18.586446+0000","last_became_active":"2023-10-07T09:07:18.586136+0000","last_became_peered":"2023-10-07T09:07:18.586136+0000","last_unstale":"2023-10-07T09:07:18.586446+0000","last_undegraded":"2023-10-07T09:07:18.586446+0000","last_fullsized":"2023-10-07T09:07:18.586446+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:36.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-07T09:07:17.559220+0000","last_change":"2023-10-07T09:07:17.557705+0000","last_active":"2023-10-07T09:07:17.559220+0000","last_peered":"2023-10-07T09:07:17.559220+0000","last_clean":"2023-10-07T09:07:17.559220+0000","last_became_active":"2023-10-07T09:07:17.557436+0000","last_became_peered":"2023-10-07T09:07:17.557436+0000","last_unstale":"2023-10-07T09:07:17.559220+0000","last_undegraded":"2023-10-07T09:07:17.559220+0000","last_fullsized":"2023-10-07T09:07:17.559220+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:29:57.877895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.590654+0000","last_change":"2023-10-07T09:07:18.590654+0000","last_active":"2023-10-07T09:07:18.590654+0000","last_peered":"2023-10-07T09:07:18.590654+0000","last_clean":"2023-10-07T09:07:18.590654+0000","last_became_active":"2023-10-07T09:07:18.590355+0000","last_became_peered":"2023-10-07T09:07:18.590355+0000","last_unstale":"2023-10-07T09:07:18.590654+0000","last_undegraded":"2023-10-07T09:07:18.590654+0000","last_fullsized":"2023-10-07T09:07:18.590654+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:20.574402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.561740+0000","last_change":"2023-10-07T09:07:17.560184+0000","last_active":"2023-10-07T09:07:18.561740+0000","last_peered":"2023-10-07T09:07:18.561740+0000","last_clean":"2023-10-07T09:07:18.561740+0000","last_became_active":"2023-10-07T09:07:17.559996+0000","last_became_peered":"2023-10-07T09:07:17.559996+0000","last_unstale":"2023-10-07T09:07:18.561740+0000","last_undegraded":"2023-10-07T09:07:18.561740+0000","last_fullsized":"2023-10-07T09:07:18.561740+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:17:32.807035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.591827+0000","last_change":"2023-10-07T09:07:18.591395+0000","last_active":"2023-10-07T09:07:18.591827+0000","last_peered":"2023-10-07T09:07:18.591827+0000","last_clean":"2023-10-07T09:07:18.591827+0000","last_became_active":"2023-10-07T09:07:18.591144+0000","last_became_peered":"2023-10-07T09:07:18.591144+0000","last_unstale":"2023-10-07T09:07:18.591827+0000","last_undegraded":"2023-10-07T09:07:18.591827+0000","last_fullsized":"2023-10-07T09:07:18.591827+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:07.035033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.562780+0000","last_change":"2023-10-07T09:07:17.555143+0000","last_active":"2023-10-07T09:07:18.562780+0000","last_peered":"2023-10-07T09:07:18.562780+0000","last_clean":"2023-10-07T09:07:18.562780+0000","last_became_active":"2023-10-07T09:07:17.554791+0000","last_became_peered":"2023-10-07T09:07:17.554791+0000","last_unstale":"2023-10-07T09:07:18.562780+0000","last_undegraded":"2023-10-07T09:07:18.562780+0000","last_fullsized":"2023-10-07T09:07:18.562780+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.801344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.578693+0000","last_change":"2023-10-07T09:07:18.578693+0000","last_active":"2023-10-07T09:07:18.578693+0000","last_peered":"2023-10-07T09:07:18.578693+0000","last_clean":"2023-10-07T09:07:18.578693+0000","last_became_active":"2023-10-07T09:07:18.577916+0000","last_became_peered":"2023-10-07T09:07:18.577916+0000","last_unstale":"2023-10-07T09:07:18.578693+0000","last_undegraded":"2023-10-07T09:07:18.578693+0000","last_fullsized":"2023-10-07T09:07:18.578693+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:17.538825+0000","last_clean_scrub_stamp":"2023-10-07T09:07:17.538825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:48.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"181'1","reported_seq":10,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.568237+0000","last_change":"2023-10-07T09:07:17.559106+0000","last_active":"2023-10-07T09:07:18.568237+0000","last_peered":"2023-10-07T09:07:18.568237+0000","last_clean":"2023-10-07T09:07:18.568237+0000","last_became_active":"2023-10-07T09:07:17.558837+0000","last_became_peered":"2023-10-07T09:07:17.558837+0000","last_unstale":"2023-10-07T09:07:18.568237+0000","last_undegraded":"2023-10-07T09:07:18.568237+0000","last_fullsized":"2023-10-07T09:07:18.568237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:16.533681+0000","last_clean_scrub_stamp":"2023-10-07T09:07:16.533681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:21:33.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-07T09:07:18.562454+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:07:18.562454+0000","last_peered":"2023-10-07T09:07:18.562454+0000","last_clean":"2023-10-07T09:07:18.562454+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:07:18.562454+0000","last_undegraded":"2023-10-07T09:07:18.562454+0000","last_fullsized":"2023-10-07T09:07:18.562454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304232,"kb_used_data":2848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067608,"statfs":{"total":96636764160,"available":96325230592,"internally_reserved":0,"allocated":2916352,"data_stored":1626657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.746,"15min":0.85799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60299999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.26700000000000002},"max":{"1min":0.58999999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.40500000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.77100000000000002,"15min":0.86299999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.53600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.443}]},{"osd":5,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.432},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.88400000000000001},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1029989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.752,"15min":0.79800000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71499999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":1.29},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":4.0880000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.434},{"interface":"front","average":{"1min":0.625,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.60199999999999998},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.40899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1036165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":0.42399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.39800000000000002},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.221},"max":{"1min":0.48799999999999999,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.314}]},{"osd":2,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.39500000000000002},"min":{"1min":0.27700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.51400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.377,"15min":0.70799999999999996},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.53100000000000003,"5min":0.90400000000000003,"15min":11.32},"last":0.378}]},{"osd":3,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.72699999999999998},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.44900000000000001,"5min":1.077,"15min":11.880000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.39000000000000001},"min":{"1min":0.27900000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59199999999999997,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.41599999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.77700000000000002},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.79200000000000004},"min":{"1min":0.498,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":1.2310000000000001,"15min":4.5209999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.40400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304224,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067616,"statfs":{"total":96636764160,"available":96325238784,"internally_reserved":0,"allocated":2908160,"data_stored":1621781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.21299999999999999},"max":{"1min":0.44,"5min":0.501,"15min":0.54500000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.34899999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.218,"15min":0.191},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":0.56299999999999994},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.61199999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.374,"15min":0.38700000000000001},"min":{"1min":0.29699999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":0.53400000000000003,"15min":0.625},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.22},"max":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.57899999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.34699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.63500000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.88400000000000001,"15min":0.95399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.95399999999999996},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86399999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":1.0249999999999999},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":1.006},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80800000000000005,"5min":0.879,"15min":1.0389999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.95599999999999996},"last":0.41899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1030501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.55800000000000005},"min":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":10.214},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.218,"15min":0.214},"max":{"1min":0.5,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.22,"15min":0.22},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.755},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.61899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48699999999999999,"5min":0.66100000000000003,"15min":10.144},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.66900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54700000000000004,"5min":0.68700000000000006,"15min":10.071},"last":0.38},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41499999999999998,"15min":0.68600000000000005},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.54000000000000004,"5min":0.70399999999999996,"15min":10.183},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.0620000000000001},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.87,"15min":1.0880000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:06:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":4.391,"15min":4.391},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1032023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.41299999999999998},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.67400000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53400000000000003,"5min":0.71199999999999997,"15min":12.038},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.41599999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":2.3450000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.45100000000000001},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":2.3380000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.55900000000000005},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.1230000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":1.2330000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.85399999999999998},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56599999999999995,"15min":0.65200000000000002},"min":{"1min":0.40400000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":2.081},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":2.1099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56799999999999995,"15min":0.64600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.82099999999999995,"15min":2.1960000000000002},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.90600000000000003},"min":{"1min":0.45000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76600000000000001,"5min":1.135,"15min":12.007},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.70299999999999996},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":2.0459999999999998},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.92300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":1.179,"15min":11.973000000000001},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068192,"statfs":{"total":96636764160,"available":96325828608,"internally_reserved":0,"allocated":2318336,"data_stored":1036235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.495,"15min":0.78000000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.83399999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.311},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.86499999999999999},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.83599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":10.01},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":5.569},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.83699999999999997},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.93500000000000005,"15min":10.131},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.51300000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27800000000000002},"max":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54500000000000004,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.503},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1029877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67900000000000005,"5min":1.127,"15min":1.127},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.31},"max":{"1min":0.73599999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.65000000000000002,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.432}]},{"osd":2,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.73099999999999998,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60899999999999999,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.496}]},{"osd":3,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":1.478,"15min":1.478},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67200000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.379},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66100000000000003,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.73599999999999999,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:06:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:07:23.073 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:07:23.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:07:23.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.231+0000 7fee81d6c700 1 Processor -- start 2023-10-07T09:07:23.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.231+0000 7fee81d6c700 1 -- start start 2023-10-07T09:07:23.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee81d6c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee7c1595d0 0x7fee7c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee81d6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee7c15d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee81d6c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c15dbc0 con 0x7fee7c15d760 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee81d6c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0b10f0 con 0x7fee7c1595d0 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee81d6c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0cd530 con 0x7fee7c0cf480 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee8156b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fee7c15d760 0x7fee7c1599a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53796/0 (socket says 172.21.15.46:53796) 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee8156b700 1 -- 172.21.15.46:0/181753058 learned_addr learned my addr 172.21.15.46:0/181753058 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104564318 0 0) 0x7fee64001110 con 0x7fee7c15d760 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee80d6a700 1 --2- 172.21.15.46:0/181753058 >> v2:172.21.15.133:3300/0 conn(0x7fee7c1595d0 0x7fee7c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee68003570 con 0x7fee7c15d760 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.232+0000 7fee7bfff700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee7c15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154065954 0 0) 0x7fee68003570 con 0x7fee7c15d760 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 msgr2=0x7fee7c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee7c15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 >> v2:172.21.15.133:3300/0 conn(0x7fee7c1595d0 msgr2=0x7fee7c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 --2- 172.21.15.46:0/181753058 >> v2:172.21.15.133:3300/0 conn(0x7fee7c1595d0 0x7fee7c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c15e000 con 0x7fee7c15d760 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fee64001600 con 0x7fee7c15d760 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 >> v1:172.21.15.46:6789/0 conn(0x7fee7c15d760 legacy=0x7fee7c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee68003a60 0x7fee68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b10f0 con 0x7fee68004810 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0cd530 con 0x7fee68003a60 2023-10-07T09:07:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6800ba60 con 0x7fee7c0cf480 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee80d6a700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee68003a60 0x7fee68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee8156b700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 -- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 msgr2=0x7fee680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c0cf480 0x7fee680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 -- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee68003a60 msgr2=0x7fee68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee68003a60 0x7fee68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 -- 172.21.15.46:0/181753058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68003570 con 0x7fee68004810 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.233+0000 7fee7bfff700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee68004c80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00e240 tx=0x7fee6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5383a12f7f89427e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00eaf0 con 0x7fee68004810 2023-10-07T09:07:23.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c00f040 con 0x7fee68004810 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee7b7fe700 1 -- 172.21.15.46:0/181753058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00eea0 con 0x7fee68004810 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 -- 172.21.15.46:0/181753058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 msgr2=0x7fee68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 --2- 172.21.15.46:0/181753058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee68004c80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00e240 tx=0x7fee6c00b040 comp rx=0 tx=0).stop 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee8156b700 1 -- 172.21.15.46:0/181753058 reap_dead start 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 -- 172.21.15.46:0/181753058 shutdown_connections 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 -- 172.21.15.46:0/181753058 >> 172.21.15.46:0/181753058 conn(0x7fee7c0d05f0 msgr2=0x7fee7c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 -- 172.21.15.46:0/181753058 shutdown_connections 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.234+0000 7fee81d6c700 1 -- 172.21.15.46:0/181753058 wait complete. 2023-10-07T09:07:23.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.235+0000 7fee81d6c700 1 Processor -- start 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.235+0000 7fee81d6c700 1 -- start start 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee7c1507b0 0x7fee7c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c150c20 0x7fee7c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b60f0 con 0x7fee68004810 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b5600 con 0x7fee7c1507b0 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee81d6c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c158280 con 0x7fee7c150c20 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee80d6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee80d6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49710/0 (socket says 172.21.15.46:49710) 2023-10-07T09:07:23.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee80d6a700 1 -- 172.21.15.46:0/2468692794 learned_addr learned my addr 172.21.15.46:0/2468692794 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee8156b700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c150c20 0x7fee7c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.236+0000 7fee7bfff700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee7c1507b0 0x7fee7c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 -- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c150c20 msgr2=0x7fee7c14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c150c20 0x7fee7c14e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 -- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee7c1507b0 msgr2=0x7fee7c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee7c1507b0 0x7fee7c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 -- 172.21.15.46:0/2468692794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0b49f0 con 0x7fee68004810 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee80d6a700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fee74011b90 tx=0x7fee74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74005c10 con 0x7fee68004810 2023-10-07T09:07:23.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74005d70 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c0b4cd0 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400fa50 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.237+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c0b5290 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.238+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c04c3c0 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.238+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fee74006050 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.239+0000 7fee78ff9700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 0x7fee5c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.239+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee740853d0 con 0x7fee68004810 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.239+0000 7fee7bfff700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 0x7fee5c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.240+0000 7fee7bfff700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 0x7fee5c0697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15d0e0 tx=0x7fee6c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.243+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee74052120 con 0x7fee68004810 2023-10-07T09:07:23.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.517+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fee7c0b6470 con 0x7fee68004810 2023-10-07T09:07:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.521+0000 7fee78ff9700 1 -- 172.21.15.46:0/2468692794 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fee74055740 con 0x7fee68004810 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 msgr2=0x7fee5c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 0x7fee5c0697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15d0e0 tx=0x7fee6c01a000 comp rx=0 tx=0).stop 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 msgr2=0x7fee7c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fee74011b90 tx=0x7fee74009120 comp rx=0 tx=0).stop 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 shutdown_connections 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fee5c067320 0x7fee5c0697d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee7c150c20 0x7fee7c14e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68004810 0x7fee7c157d40 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 --2- 172.21.15.46:0/2468692794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee7c1507b0 0x7fee7c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 >> 172.21.15.46:0/2468692794 conn(0x7fee7c0d05f0 msgr2=0x7fee7c15f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 shutdown_connections 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.523+0000 7fee81d6c700 1 -- 172.21.15.46:0/2468692794 wait complete. 2023-10-07T09:07:23.525 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:07:23.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.655+0000 7fd776e1b700 1 Processor -- start 2023-10-07T09:07:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.655+0000 7fd776e1b700 1 -- start start 2023-10-07T09:07:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd776e1b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7700b1e50 0x7fd770159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd776e1b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 0x7fd7700b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd776e1b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700b6570 con 0x7fd7701593b0 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd776e1b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700cfe20 con 0x7fd7700b1e50 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd776e1b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700cf210 con 0x7fd7700ceaa0 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775618700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7700b1e50 0x7fd770159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775e19700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd7701593b0 0x7fd7700b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53810/0 (socket says 172.21.15.46:53810) 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775e19700 1 -- 172.21.15.46:0/1248266907 learned_addr learned my addr 172.21.15.46:0/1248266907 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd77661a700 1 --2- 172.21.15.46:0/1248266907 >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 0x7fd7700b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775618700 1 -- 172.21.15.46:0/1248266907 >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 msgr2=0x7fd7700b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775618700 1 --2- 172.21.15.46:0/1248266907 >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 0x7fd7700b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775618700 1 -- 172.21.15.46:0/1248266907 >> v1:172.21.15.46:6789/0 conn(0x7fd7701593b0 legacy=0x7fd7700b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd775618700 1 -- 172.21.15.46:0/1248266907 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700cf4f0 con 0x7fd7700b1e50 2023-10-07T09:07:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.656+0000 7fd77661a700 1 --2- 172.21.15.46:0/1248266907 >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 0x7fd7700b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd775618700 1 --2- 172.21.15.46:0/1248266907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700b1e50 0x7fd770159780 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd7700d1730 tx=0x7fd7640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569dbb07c04e87c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd774e17700 1 -- 172.21.15.46:0/1248266907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400b6b0 con 0x7fd7700b1e50 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd774e17700 1 -- 172.21.15.46:0/1248266907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400b810 con 0x7fd7700b1e50 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd774e17700 1 -- 172.21.15.46:0/1248266907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400bbb0 con 0x7fd7700b1e50 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 -- 172.21.15.46:0/1248266907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700b1e50 msgr2=0x7fd770159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1248266907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700b1e50 0x7fd770159780 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd7700d1730 tx=0x7fd7640091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 -- 172.21.15.46:0/1248266907 shutdown_connections 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1248266907 >> v2:172.21.15.133:3300/0 conn(0x7fd7700ceaa0 0x7fd7700b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1248266907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700b1e50 0x7fd770159780 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 -- 172.21.15.46:0/1248266907 >> 172.21.15.46:0/1248266907 conn(0x7fd7700d1130 msgr2=0x7fd7700b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 -- 172.21.15.46:0/1248266907 shutdown_connections 2023-10-07T09:07:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.657+0000 7fd776e1b700 1 -- 172.21.15.46:0/1248266907 wait complete. 2023-10-07T09:07:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 Processor -- start 2023-10-07T09:07:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 -- start start 2023-10-07T09:07:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7700b1e50 0x7fd77015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7701593b0 0x7fd770153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd770169ac0 con 0x7fd7700ceaa0 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77015ab00 con 0x7fd7700b1e50 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd776e1b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77015ade0 con 0x7fd7701593b0 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd775618700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd775618700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49724/0 (socket says 172.21.15.46:49724) 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.659+0000 7fd775618700 1 -- 172.21.15.46:0/1489338445 learned_addr learned my addr 172.21.15.46:0/1489338445 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775e19700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7700b1e50 0x7fd77015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd77661a700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7701593b0 0x7fd770153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 -- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7701593b0 msgr2=0x7fd770153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7701593b0 0x7fd770153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 -- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7700b1e50 msgr2=0x7fd77015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7700b1e50 0x7fd77015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 -- 172.21.15.46:0/1489338445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764009420 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd775618700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd7640097b0 tx=0x7fd764017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400bad0 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764026430 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77015b0c0 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640267f0 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.660+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77015a810 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.661+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770169c70 con 0x7fd7700ceaa0 2023-10-07T09:07:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.662+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd764023030 con 0x7fd7700ceaa0 2023-10-07T09:07:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.662+0000 7fd76dffb700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 0x7fd75c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.662+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd764086600 con 0x7fd7700ceaa0 2023-10-07T09:07:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.662+0000 7fd775e19700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 0x7fd75c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.663+0000 7fd775e19700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 0x7fd75c0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd768001780 tx=0x7fd768009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:23.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.666+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd770169c70 con 0x7fd7700ceaa0 2023-10-07T09:07:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.904+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd77004c3c0 con 0x7fd7700ceaa0 2023-10-07T09:07:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.905+0000 7fd76dffb700 1 -- 172.21.15.46:0/1489338445 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fd764053310 con 0x7fd7700ceaa0 2023-10-07T09:07:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:23.906 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:21.581896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 msgr2=0x7fd75c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 0x7fd75c0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd768001780 tx=0x7fd768009040 comp rx=0 tx=0).stop 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 msgr2=0x7fd77015a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd7640097b0 tx=0x7fd764017000 comp rx=0 tx=0).stop 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 shutdown_connections 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd75c067320 0x7fd75c0697d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7701593b0 0x7fd770153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7700b1e50 0x7fd77015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 --2- 172.21.15.46:0/1489338445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7700ceaa0 0x7fd77015a2d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 >> 172.21.15.46:0/1489338445 conn(0x7fd7700d1130 msgr2=0x7fd770157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 shutdown_connections 2023-10-07T09:07:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:23.907+0000 7fd776e1b700 1 -- 172.21.15.46:0/1489338445 wait complete. 2023-10-07T09:07:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 123 2023-10-07T09:07:24.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 123, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:07:17.957309+0000', 'modified': '2023-10-07T09:07:21.581896+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8655': {'gid': 8655, 'name': 'a', 'rank': 0, 'incarnation': 119, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6834/1456001101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 1456001101}, {'type': 'v1', 'addr': '172.21.15.46:6834', 'nonce': 1456001101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:07:24.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:07:24.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T09:07:24.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.444+0000 7f74cf1a3700 1 Processor -- start 2023-10-07T09:07:24.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.444+0000 7f74cf1a3700 1 -- start start 2023-10-07T09:07:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74cf1a3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74c80b5ea0 0x7f74c8068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74cf1a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c815c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74cf1a3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c815c480 con 0x7f74c8159c10 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74cf1a3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80b2a40 con 0x7f74c80b5ea0 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74cf1a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c815b870 con 0x7f74c8068bb0 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74c7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74c80b5ea0 0x7f74c8068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74ccf3f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74c8159c10 0x7f74c815b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53826/0 (socket says 172.21.15.46:53826) 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.445+0000 7f74ccf3f700 1 -- 172.21.15.46:0/3245667464 learned_addr learned my addr 172.21.15.46:0/3245667464 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74cd740700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c7fff700 1 -- 172.21.15.46:0/3245667464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 msgr2=0x7f74c815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c7fff700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c815c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c7fff700 1 -- 172.21.15.46:0/3245667464 >> v1:172.21.15.46:6789/0 conn(0x7f74c8159c10 legacy=0x7f74c815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c7fff700 1 -- 172.21.15.46:0/3245667464 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c815bb50 con 0x7f74c80b5ea0 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74cd740700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c77fe700 1 -- 172.21.15.46:0/3245667464 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072906128 0 0) 0x7f74c815c480 con 0x7f74c8159c10 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c7fff700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c8068670 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f74b80098e0 tx=0x7f74b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc5bb15bde77a53 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c77fe700 1 -- 172.21.15.46:0/3245667464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8009e80 con 0x7f74c80b5ea0 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c77fe700 1 -- 172.21.15.46:0/3245667464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800b860 con 0x7f74c80b5ea0 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.446+0000 7f74c77fe700 1 -- 172.21.15.46:0/3245667464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800bbe0 con 0x7f74c80b5ea0 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3245667464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 msgr2=0x7f74c8068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c8068670 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f74b80098e0 tx=0x7f74b80091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3245667464 shutdown_connections 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3245667464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c8068670 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3245667464 >> 172.21.15.46:0/3245667464 conn(0x7f74c8099a20 msgr2=0x7f74c80af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3245667464 shutdown_connections 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.447+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3245667464 wait complete. 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.448+0000 7f74cf1a3700 1 Processor -- start 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.448+0000 7f74cf1a3700 1 -- start start 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c809c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8159c10 0x7f74c815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80af990 con 0x7f74c80b5ea0 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80aed80 con 0x7f74c8159c10 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cf1a3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80af060 con 0x7f74c8068bb0 2023-10-07T09:07:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49750/0 (socket says 172.21.15.46:49750) 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 -- 172.21.15.46:0/3450663586 learned_addr learned my addr 172.21.15.46:0/3450663586 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74cd740700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8159c10 0x7f74c815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c809c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 -- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 msgr2=0x7f74c809c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c809c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 -- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8159c10 msgr2=0x7f74c815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8159c10 0x7f74c815ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 -- 172.21.15.46:0/3450663586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009420 con 0x7f74c80b5ea0 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c7fff700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f74c8063db0 tx=0x7f74b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c4ff9700 1 -- 172.21.15.46:0/3450663586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800bbe0 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c4ff9700 1 -- 172.21.15.46:0/3450663586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8011420 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.449+0000 7f74c4ff9700 1 -- 172.21.15.46:0/3450663586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80117a0 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.450+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80af340 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.450+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80ae9e0 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.451+0000 7f74c4ff9700 1 -- 172.21.15.46:0/3450663586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f74b8011bd0 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.451+0000 7f74c4ff9700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 0x7f74a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.451+0000 7f74c4ff9700 1 -- 172.21.15.46:0/3450663586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74b8086630 con 0x7f74c80b5ea0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.451+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 0x7f74a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.452+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 0x7f74a80697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74c0002230 tx=0x7f74c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.453+0000 7f74d849bb80 1 Processor -- start 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.453+0000 7f74d849bb80 1 -- start start 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71203a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 0x557a711d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a71131a70 con 0x557a711daa50 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7112f270 con 0x557a71203f60 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a7112b060 con 0x557a71224d00 2023-10-07T09:07:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49752/0 (socket says 172.21.15.46:49752) 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 -- 172.21.15.46:0/1693658595 learned_addr learned my addr 172.21.15.46:0/1693658595 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74c7fff700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71203a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74cd740700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 0x557a711d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 -- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 msgr2=0x557a71203a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71203a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 -- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 msgr2=0x557a711d6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 0x557a711d6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 -- 172.21.15.46:0/1693658595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a70fc5270 con 0x557a711daa50 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74cd740700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 0x557a711d6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.454+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f74c000efd0 tx=0x7f74c0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4e389f13997227 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74bdffb700 1 -- 172.21.15.46:0/1693658595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0007b00 con 0x557a711daa50 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74bdffb700 1 -- 172.21.15.46:0/1693658595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0022420 con 0x557a711daa50 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74bdffb700 1 -- 172.21.15.46:0/1693658595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00227a0 con 0x557a711daa50 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 -- 172.21.15.46:0/1693658595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 msgr2=0x557a711dae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f74c000efd0 tx=0x7f74c0013000 comp rx=0 tx=0).stop 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 -- 172.21.15.46:0/1693658595 shutdown_connections 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a71203f60 0x557a711d6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a711daa50 0x557a711dae20 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 --2- 172.21.15.46:0/1693658595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71203a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 -- 172.21.15.46:0/1693658595 >> 172.21.15.46:0/1693658595 conn(0x557a711dc370 msgr2=0x557a711dc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 -- 172.21.15.46:0/1693658595 shutdown_connections 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.455+0000 7f74d849bb80 1 -- 172.21.15.46:0/1693658595 wait complete. 2023-10-07T09:07:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.456+0000 7f74d849bb80 1 -- start start 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.456+0000 7f74d849bb80 1 Processor -- start 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a7121f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a7121da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a710d6890 con 0x557a71224d00 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a710f1ea0 con 0x557a711daa50 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a70fade30 con 0x557a71203f60 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74d849bb80 10 client.0 _ll_register_callbacks cb 0x557a7119e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49764/0 (socket says 172.21.15.46:49764) 2023-10-07T09:07:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 -- 172.21.15.46:0/2210367254 learned_addr learned my addr 172.21.15.46:0/2210367254 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a7121f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74c7fff700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a7121da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 -- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 msgr2=0x557a7121da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a7121da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 -- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 msgr2=0x557a7121f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a7121f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.457+0000 7f74cd740700 1 -- 172.21.15.46:0/2210367254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c000f040 con 0x557a71224d00 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74cd740700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f74b0012750 tx=0x7f74b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de63c21bd52de4b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0014420 con 0x557a71224d00 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74b0014580 con 0x557a71224d00 2023-10-07T09:07:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a711cfb70 con 0x557a71224d00 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74b0014950 con 0x557a71224d00 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 10 client.8811 fetch_fsmap learned FSMap version 123 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) v3 -- 0x557a70f67fe0 con 0x557a71224d00 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a711cfb70 con 0x557a71224d00 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 123) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f74b0014ab0 con 0x557a71224d00 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 10 client.8811 fetch_fsmap finished waiting for FSMap version 123 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 10 client.8811 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 20 client.8811 populate_metadata read hostname 'smithi046' 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a711d5cf0 0x557a711d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 4 client.8811 mds_command: new command op to 8655 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 --> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a711acaa0 con 0x557a711d5cf0 2023-10-07T09:07:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.458+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a711d5cf0 0x557a711d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a711d5cf0 0x557a711d60c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5418673e4be4306d server_cookie=68008a6ed700425d in_seq=0 out_seq=0 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74a6ffd700 10 client.8811 ms_handle_connect on v2:172.21.15.46:6832/1456001101 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2210367254 <== mds.0 v2:172.21.15.46:6832/1456001101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557a711acaa0 con 0x557a711d5cf0 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74a6ffd700 10 client.8811 handle_command_reply: tid=0 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 client.8811 shutdown 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 msgr2=0x557a711ff030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f74b0012750 tx=0x7f74b0008040 comp rx=0 tx=0).stop 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 shutdown_connections 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a711d5cf0 0x557a711d60c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711ff030 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a7121f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2210367254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a7121da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74a6ffd700 0 client.8811 ms_handle_reset on v2:172.21.15.46:6832/1456001101 2023-10-07T09:07:24.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 >> 172.21.15.46:0/2210367254 conn(0x557a711dc370 msgr2=0x557a711d7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 shutdown_connections 2023-10-07T09:07:24.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.459+0000 7f74d849bb80 1 -- 172.21.15.46:0/2210367254 wait complete. 2023-10-07T09:07:24.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.460+0000 7f74d849bb80 20 client.8811 trim_cache size 0 max 16384 2023-10-07T09:07:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.476+0000 7f74d849bb80 1 Processor -- start 2023-10-07T09:07:24.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.476+0000 7f74d849bb80 1 -- start start 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a711fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a711d5610 con 0x557a71224d00 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7121ead0 con 0x557a711daa50 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a711d5830 con 0x557a71203f60 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49780/0 (socket says 172.21.15.46:49780) 2023-10-07T09:07:24.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 -- 172.21.15.46:0/3423924126 learned_addr learned my addr 172.21.15.46:0/3423924126 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 -- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 msgr2=0x557a711fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a711fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 -- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 msgr2=0x557a712309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74cd740700 1 -- 172.21.15.46:0/3423924126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a710f9780 con 0x557a71224d00 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.477+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74cd740700 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f74b00126c0 tx=0x7f74b001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab77f057f0ce1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74be7fc700 1 -- 172.21.15.46:0/3423924126 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0006b30 con 0x557a71224d00 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74be7fc700 1 -- 172.21.15.46:0/3423924126 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b000c070 con 0x557a71224d00 2023-10-07T09:07:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74be7fc700 1 -- 172.21.15.46:0/3423924126 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0009620 con 0x557a71224d00 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 -- 172.21.15.46:0/3423924126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 msgr2=0x557a711d6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f74b00126c0 tx=0x7f74b001d000 comp rx=0 tx=0).stop 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 -- 172.21.15.46:0/3423924126 shutdown_connections 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71224d00 0x557a711d6680 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 --2- 172.21.15.46:0/3423924126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71203f60 0x557a711fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 -- 172.21.15.46:0/3423924126 >> 172.21.15.46:0/3423924126 conn(0x557a711dc370 msgr2=0x557a711dc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 -- 172.21.15.46:0/3423924126 shutdown_connections 2023-10-07T09:07:24.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.478+0000 7f74d849bb80 1 -- 172.21.15.46:0/3423924126 wait complete. 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.479+0000 7f74d849bb80 1 -- start start 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.479+0000 7f74d849bb80 1 Processor -- start 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71240ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a71224b40 con 0x557a71203f60 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a71241ba0 con 0x557a711daa50 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a711d9150 con 0x557a71224d00 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74d849bb80 10 client.0 _ll_register_callbacks cb 0x557a7119e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:07:24.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49796/0 (socket says 172.21.15.46:49796) 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 -- 172.21.15.46:0/2380142660 learned_addr learned my addr 172.21.15.46:0/2380142660 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74cd740700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71240ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 -- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 msgr2=0x557a71240ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71240ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 -- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 msgr2=0x557a712202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 -- 172.21.15.46:0/2380142660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a70f67fe0 con 0x557a71203f60 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74c7fff700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f74b80091e0 tx=0x7f74b8059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5962f72dfb195f95 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.480+0000 7f74a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80568e0 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74c0022420 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74b8057680 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74b8056f80 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 10 client.8817 fetch_fsmap learned FSMap version 123 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) v3 -- 0x557a710e0470 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8082080 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 123) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f74b806d210 con 0x557a71203f60 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 10 client.8817 fetch_fsmap finished waiting for FSMap version 123 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 10 client.8817 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:07:24.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 20 client.8817 populate_metadata read hostname 'smithi046' 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a712410e0 0x557a71217560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 4 client.8817 mds_command: new command op to 8655 tid=0[{"prefix": "status"}] 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 --> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a710cde00 con 0x557a712410e0 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a712410e0 0x557a71217560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74a6ffd700 10 client.8817 ms_handle_connect on v2:172.21.15.46:6832/1456001101 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.481+0000 7f74ccf3f700 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a712410e0 0x557a71217560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1161794deb7e6 server_cookie=aad5eacfd9010c8d in_seq=0 out_seq=0 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74a6ffd700 1 -- 172.21.15.46:0/2380142660 <== mds.0 v2:172.21.15.46:6832/1456001101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x557a710cde00 con 0x557a712410e0 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74a6ffd700 10 client.8817 handle_command_reply: tid=0 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 client.8817 shutdown 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 msgr2=0x557a71220820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f74b80091e0 tx=0x7f74b8059040 comp rx=0 tx=0).stop 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 shutdown_connections 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:6832/1456001101,v1:172.21.15.46:6834/1456001101] conn(0x557a712410e0 0x557a71217560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557a71224d00 0x557a71240ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74a6ffd700 0 client.8817 ms_handle_reset on v2:172.21.15.46:6832/1456001101 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a711daa50 0x557a712202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 --2- 172.21.15.46:0/2380142660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a71203f60 0x557a71220820 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 >> 172.21.15.46:0/2380142660 conn(0x557a711dc370 msgr2=0x557a711d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 shutdown_connections 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 1 -- 172.21.15.46:0/2380142660 wait complete. 2023-10-07T09:07:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.482+0000 7f74d849bb80 20 client.8817 trim_cache size 0 max 16384 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 8655, 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.912724527, 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 123, 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 182, 2023-10-07T09:07:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 182, 2023-10-07T09:07:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.960459596 2023-10-07T09:07:24.491 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:07:24.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 msgr2=0x7f74a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 0x7f74a80697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74c0002230 tx=0x7f74c0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 msgr2=0x7f74c815e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f74c8063db0 tx=0x7f74b8017000 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 shutdown_connections 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f74a8067320 0x7f74a80697d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c8159c10 0x7f74c815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c8068bb0 0x7f74c809c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 --2- 172.21.15.46:0/3450663586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c80b5ea0 0x7f74c815e810 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 >> 172.21.15.46:0/3450663586 conn(0x7f74c8099a20 msgr2=0x7f74c80b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 shutdown_connections 2023-10-07T09:07:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.483+0000 7f74cf1a3700 1 -- 172.21.15.46:0/3450663586 wait complete. 2023-10-07T09:07:24.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:07:24.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.616+0000 7fa278415700 1 Processor -- start 2023-10-07T09:07:24.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.616+0000 7fa278415700 1 -- start start 2023-10-07T09:07:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa278415700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa27006bcd0 0x7fa2700caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa278415700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa27015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa278415700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27015d7e0 con 0x7fa27006c0a0 2023-10-07T09:07:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa278415700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27015dac0 con 0x7fa27006bcd0 2023-10-07T09:07:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa278415700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27015aa30 con 0x7fa27015df50 2023-10-07T09:07:24.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2759b0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa27006c0a0 0x7fa27015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53838/0 (socket says 172.21.15.46:53838) 2023-10-07T09:07:24.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2759b0700 1 -- 172.21.15.46:0/120187521 learned_addr learned my addr 172.21.15.46:0/120187521 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2761b1700 1 --2- 172.21.15.46:0/120187521 >> v2:172.21.15.133:3300/0 conn(0x7fa27006bcd0 0x7fa2700caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2769b2700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa27015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706203227 0 0) 0x7fa27015d7e0 con 0x7fa27006c0a0 2023-10-07T09:07:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.617+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa258003570 con 0x7fa27006c0a0 2023-10-07T09:07:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202368775 0 0) 0x7fa258003570 con 0x7fa27006c0a0 2023-10-07T09:07:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 msgr2=0x7fa27015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa27015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 >> v2:172.21.15.133:3300/0 conn(0x7fa27006bcd0 msgr2=0x7fa2700caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 --2- 172.21.15.46:0/120187521 >> v2:172.21.15.133:3300/0 conn(0x7fa27006bcd0 0x7fa2700caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27015ad10 con 0x7fa27006c0a0 2023-10-07T09:07:24.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fa264001470 con 0x7fa27006c0a0 2023-10-07T09:07:24.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 >> v1:172.21.15.46:6789/0 conn(0x7fa27006c0a0 legacy=0x7fa27015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa258003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa258003fe0 0x7fa258004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258004d50 0x7fa2580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27015dac0 con 0x7fa258003fe0 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27015aa30 con 0x7fa258004d50 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25800bb40 con 0x7fa27015df50 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa258003fe0 0x7fa258004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2761b1700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa258003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2769b2700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258004d50 0x7fa2580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 -- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 msgr2=0x7fa258003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa27015df50 0x7fa258003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 -- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258004d50 msgr2=0x7fa2580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258004d50 0x7fa2580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 -- 172.21.15.46:0/120187521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258003570 con 0x7fa258003fe0 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2769b2700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258004d50 0x7fa2580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2759b0700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa258003fe0 0x7fa258004810 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c390 tx=0x7fa264001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1099ede794a88e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400cc60 con 0x7fa258003fe0 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400cde0 con 0x7fa258003fe0 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.618+0000 7fa2751af700 1 -- 172.21.15.46:0/120187521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264005b70 con 0x7fa258003fe0 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 -- 172.21.15.46:0/120187521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa258003fe0 msgr2=0x7fa258004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 --2- 172.21.15.46:0/120187521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa258003fe0 0x7fa258004810 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c390 tx=0x7fa264001e90 comp rx=0 tx=0).stop 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa2769b2700 1 -- 172.21.15.46:0/120187521 reap_dead start 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 -- 172.21.15.46:0/120187521 shutdown_connections 2023-10-07T09:07:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 -- 172.21.15.46:0/120187521 >> 172.21.15.46:0/120187521 conn(0x7fa2700ce600 msgr2=0x7fa2700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 -- 172.21.15.46:0/120187521 shutdown_connections 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.619+0000 7fa278415700 1 -- 172.21.15.46:0/120187521 wait complete. 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.620+0000 7fa278415700 1 Processor -- start 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.620+0000 7fa278415700 1 -- start start 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 0x7fa27016d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2700c3d40 0x7fa270149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27016e130 con 0x7fa27016dcc0 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2700c5100 con 0x7fa258003fe0 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa278415700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2700c44f0 con 0x7fa2700c3d40 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49814/0 (socket says 172.21.15.46:49814) 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 -- 172.21.15.46:0/3663946694 learned_addr learned my addr 172.21.15.46:0/3663946694 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2761b1700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 0x7fa27016d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2769b2700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2700c3d40 0x7fa270149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 -- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2700c3d40 msgr2=0x7fa270149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2700c3d40 0x7fa270149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 -- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 msgr2=0x7fa27016d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 0x7fa27016d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 -- 172.21.15.46:0/3663946694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2700c47d0 con 0x7fa27016dcc0 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2761b1700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 0x7fa27016d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:24.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.621+0000 7fa2759b0700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa264001ed0 tx=0x7fa264015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.622+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400c9b0 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.622+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2640072e0 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.622+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2700c4ab0 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.622+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640076a0 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.622+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2700c41b0 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.623+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27016e130 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.623+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa264019030 con 0x7fa27016dcc0 2023-10-07T09:07:24.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.624+0000 7fa26e7fc700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 0x7fa25c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:24.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.624+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa264085f80 con 0x7fa27016dcc0 2023-10-07T09:07:24.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.624+0000 7fa2761b1700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 0x7fa25c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:24.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.624+0000 7fa2761b1700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 0x7fa25c0697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa268009de0 tx=0x7fa268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:24.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.628+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa264052c90 con 0x7fa27016dcc0 2023-10-07T09:07:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.866+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2700b22c0 con 0x7fa27016dcc0 2023-10-07T09:07:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.866+0000 7fa26e7fc700 1 -- 172.21.15.46:0/3663946694 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v123) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2640562b0 con 0x7fa27016dcc0 2023-10-07T09:07:24.867 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 msgr2=0x7fa25c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 0x7fa25c0697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa268009de0 tx=0x7fa268008040 comp rx=0 tx=0).stop 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 msgr2=0x7fa2700c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa264001ed0 tx=0x7fa264015000 comp rx=0 tx=0).stop 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 shutdown_connections 2023-10-07T09:07:24.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa25c067320 0x7fa25c0697d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa2700c3d40 0x7fa270149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa258003fe0 0x7fa27016d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 --2- 172.21.15.46:0/3663946694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa27016dcc0 0x7fa2700c3800 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 >> 172.21.15.46:0/3663946694 conn(0x7fa2700ce600 msgr2=0x7fa27015c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 shutdown_connections 2023-10-07T09:07:24.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:24.868+0000 7fa278415700 1 -- 172.21.15.46:0/3663946694 wait complete. 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:07:24.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:07:24.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:24.882 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:07:24.897 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:24.898 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41969sec preferred_lft 41969sec 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:07:24.899 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:07:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:07:24.901 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:24.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:24.901 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:07:24.963 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:07:24.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:24.963 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:07:25.019 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:07:25.019 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:07:25.019 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:07:25.019 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:07:25.019 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:07:25.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:07:25.020 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:07:25.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.122 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:07:25.137 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:07:25.138 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:07:25.138 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:25.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:07:25.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:25.203 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:25.259 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:25.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:25.260 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:25.315 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:07:25.315 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:07:25.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:25.395 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:25.395 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:25.414 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:25.414 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:25.414 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:25.414 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:25.414 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:25.415 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:25.415 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:25.415 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:25.436 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:25.437 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:25.437 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:25.437 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:07:25.437 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:07:25.437 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:07:25.438 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:07:25.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:25.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:07:25.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 Processor -- start 2023-10-07T09:07:25.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 -- start start 2023-10-07T09:07:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faffc159890 0x7faffc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faffc159c60 0x7faffc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc15a160 con 0x7faffc15db10 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc15df50 con 0x7faffc159890 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.665+0000 7fb003135700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc0d13a0 con 0x7faffc159c60 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faffc159890 0x7faffc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faffc159890 0x7faffc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49830/0 (socket says 172.21.15.46:49830) 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 -- 172.21.15.46:0/3415861499 learned_addr learned my addr 172.21.15.46:0/3415861499 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7faffbfff700 1 --2- 172.21.15.46:0/3415861499 >> v2:172.21.15.133:3300/0 conn(0x7faffc159c60 0x7faffc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 -- 172.21.15.46:0/3415861499 >> v2:172.21.15.133:3300/0 conn(0x7faffc159c60 msgr2=0x7faffc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 --2- 172.21.15.46:0/3415861499 >> v2:172.21.15.133:3300/0 conn(0x7faffc159c60 0x7faffc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 -- 172.21.15.46:0/3415861499 >> v1:172.21.15.133:6789/0 conn(0x7faffc15db10 legacy=0x7faffc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 -- 172.21.15.46:0/3415861499 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc15e140 con 0x7faffc159890 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7fb000ed1700 1 --2- 172.21.15.46:0/3415861499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc159890 0x7faffc15abd0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7faffc0b67f0 tx=0x7faff4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc1cf6e1b2f59ec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7faffb7fe700 1 -- 172.21.15.46:0/3415861499 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400e070 con 0x7faffc159890 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7faffb7fe700 1 -- 172.21.15.46:0/3415861499 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff400ba10 con 0x7faffc159890 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.666+0000 7faffb7fe700 1 -- 172.21.15.46:0/3415861499 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40092e0 con 0x7faffc159890 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 -- 172.21.15.46:0/3415861499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc159890 msgr2=0x7faffc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 --2- 172.21.15.46:0/3415861499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc159890 0x7faffc15abd0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7faffc0b67f0 tx=0x7faff4009840 comp rx=0 tx=0).stop 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 -- 172.21.15.46:0/3415861499 shutdown_connections 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 --2- 172.21.15.46:0/3415861499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc159890 0x7faffc15abd0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 --2- 172.21.15.46:0/3415861499 >> v2:172.21.15.133:3300/0 conn(0x7faffc159c60 0x7faffc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 -- 172.21.15.46:0/3415861499 >> 172.21.15.46:0/3415861499 conn(0x7faffc068e20 msgr2=0x7faffc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 -- 172.21.15.46:0/3415861499 shutdown_connections 2023-10-07T09:07:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.667+0000 7fb003135700 1 -- 172.21.15.46:0/3415861499 wait complete. 2023-10-07T09:07:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.668+0000 7fb003135700 1 Processor -- start 2023-10-07T09:07:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.668+0000 7fb003135700 1 -- start start 2023-10-07T09:07:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc159890 0x7faffc0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 0x7faffc14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc16ae90 con 0x7faffc15db10 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc16a310 con 0x7faffc159890 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb003135700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc16a5f0 con 0x7faffc159c60 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49846/0 (socket says 172.21.15.46:49846) 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 -- 172.21.15.46:0/1602194423 learned_addr learned my addr 172.21.15.46:0/1602194423 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb000ed1700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc159890 0x7faffc0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7faffbfff700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 0x7faffc14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 -- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 msgr2=0x7faffc14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 0x7faffc14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 -- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc159890 msgr2=0x7faffc0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc159890 0x7faffc0b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 -- 172.21.15.46:0/1602194423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4009ae0 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7faffbfff700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 0x7faffc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.669+0000 7fb0016d2700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b4e0 tx=0x7fafe4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400f510 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe400f690 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc16a8d0 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400fa50 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0b5810 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.670+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc04c3c0 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.671+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fafe401a400 con 0x7faffc15db10 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.671+0000 7faff8ff9700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 0x7fafdc069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.672+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafe4084640 con 0x7faffc15db10 2023-10-07T09:07:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.672+0000 7fb000ed1700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 0x7fafdc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.672+0000 7fb000ed1700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 0x7fafdc069800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7faff4009880 tx=0x7faff4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.676+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafe4051450 con 0x7faffc15db10 2023-10-07T09:07:25.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.913+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faffc06a5b0 con 0x7faffc15db10 2023-10-07T09:07:25.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.913+0000 7faff8ff9700 1 -- 172.21.15.46:0/1602194423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v123) v1 ==== 53+0+73 (secure 0 0 0) 0x7fafe4054a70 con 0x7faffc15db10 2023-10-07T09:07:25.914 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:07:25.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 msgr2=0x7fafdc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 0x7fafdc069800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7faff4009880 tx=0x7faff4017000 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 msgr2=0x7faffc152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b4e0 tx=0x7fafe4006f90 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 shutdown_connections 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fafdc067350 0x7fafdc069800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faffc15db10 0x7faffc152740 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc159890 0x7faffc0b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 --2- 172.21.15.46:0/1602194423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faffc159c60 0x7faffc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 >> 172.21.15.46:0/1602194423 conn(0x7faffc068e20 msgr2=0x7faffc0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 shutdown_connections 2023-10-07T09:07:25.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:25.915+0000 7fb003135700 1 -- 172.21.15.46:0/1602194423 wait complete. 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:07:25.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:07:25.929 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:25.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.929 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:07:25.947 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:07:25.947 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:25.948 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41960sec preferred_lft 41960sec 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.949 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:25.950 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:07:26.014 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:07:26.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:26.016 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:07:26.073 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:07:26.074 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:07:26.074 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:07:26.074 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:07:26.074 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:07:26.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:26.074 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:07:26.074 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:07:26.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:07:26.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:07:26.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:07:26.075 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:07:26.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:26.177 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:07:26.192 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:07:26.193 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:07:26.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:26.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:26.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:07:26.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:26.258 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:26.313 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:26.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:26.313 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:26.367 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:07:26.367 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:07:26.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:26.446 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:26.446 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:26.464 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:26.464 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:26.465 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:26.487 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:07:26.488 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:07:26.488 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:07:26.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:07:26.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:26.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:26.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:07:26.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.689+0000 7f0226bdb700 1 Processor -- start 2023-10-07T09:07:26.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 -- start start 2023-10-07T09:07:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f02200af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220159b80 0x7f022006a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f022006a7f0 0x7f0220068d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0220068390 con 0x7f0220159b80 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200ac530 con 0x7f022006a7f0 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.690+0000 7f0226bdb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022006ac30 con 0x7f02201597b0 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220159b80 0x7f022006a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220159b80 0x7f022006a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49854/0 (socket says 172.21.15.46:49854) 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 -- 172.21.15.46:0/2725114940 learned_addr learned my addr 172.21.15.46:0/2725114940 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f0224977700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f02200af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f0225178700 1 --2- 172.21.15.46:0/2725114940 >> v2:172.21.15.133:3300/0 conn(0x7f022006a7f0 0x7f0220068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 -- 172.21.15.46:0/2725114940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 msgr2=0x7f02200af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f02200af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 -- 172.21.15.46:0/2725114940 >> v2:172.21.15.133:3300/0 conn(0x7f022006a7f0 msgr2=0x7f0220068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 --2- 172.21.15.46:0/2725114940 >> v2:172.21.15.133:3300/0 conn(0x7f022006a7f0 0x7f0220068d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 -- 172.21.15.46:0/2725114940 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200aa680 con 0x7f0220159b80 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021ffff700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220159b80 0x7f022006a2b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f02200aad50 tx=0x7f0210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60697fb9dadc8342 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021f7fe700 1 -- 172.21.15.46:0/2725114940 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000b640 con 0x7f0220159b80 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021f7fe700 1 -- 172.21.15.46:0/2725114940 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000b7a0 con 0x7f0220159b80 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.691+0000 7f021f7fe700 1 -- 172.21.15.46:0/2725114940 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000bb40 con 0x7f0220159b80 2023-10-07T09:07:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 -- 172.21.15.46:0/2725114940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220159b80 msgr2=0x7f022006a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220159b80 0x7f022006a2b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f02200aad50 tx=0x7f0210009250 comp rx=0 tx=0).stop 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 -- 172.21.15.46:0/2725114940 shutdown_connections 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2725114940 >> v2:172.21.15.133:3300/0 conn(0x7f022006a7f0 0x7f0220068d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f02200af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2725114940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220159b80 0x7f022006a2b0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 -- 172.21.15.46:0/2725114940 >> 172.21.15.46:0/2725114940 conn(0x7f02200cd880 msgr2=0x7f02200ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 -- 172.21.15.46:0/2725114940 shutdown_connections 2023-10-07T09:07:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.692+0000 7f0226bdb700 1 -- 172.21.15.46:0/2725114940 wait complete. 2023-10-07T09:07:26.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.693+0000 7f0226bdb700 1 Processor -- start 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.693+0000 7f0226bdb700 1 -- start start 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f022015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0220159b80 0x7f022015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220155990 con 0x7f022006a7f0 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200b1190 con 0x7f0220159b80 2023-10-07T09:07:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0226bdb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200b1470 con 0x7f02201597b0 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49858/0 (socket says 172.21.15.46:49858) 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 -- 172.21.15.46:0/2030531906 learned_addr learned my addr 172.21.15.46:0/2030531906 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f021ffff700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f022015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0225178700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0220159b80 0x7f022015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 -- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 msgr2=0x7f022015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f022015a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 -- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0220159b80 msgr2=0x7f022015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0220159b80 0x7f022015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 -- 172.21.15.46:0/2030531906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100094f0 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f0224977700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f0218009ef0 tx=0x7f021800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.694+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800cb70 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.695+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800f040 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.695+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218014480 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.695+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200b1750 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.695+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220169b10 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.695+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220169eb0 con 0x7f022006a7f0 2023-10-07T09:07:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.696+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02180147f0 con 0x7f022006a7f0 2023-10-07T09:07:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.696+0000 7f021cff9700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 0x7f02000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.696+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f02180856f0 con 0x7f022006a7f0 2023-10-07T09:07:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.697+0000 7f021ffff700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 0x7f02000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.697+0000 7f021ffff700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 0x7f02000697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f02200aad50 tx=0x7f0210017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.701+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0218052230 con 0x7f022006a7f0 2023-10-07T09:07:26.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:26.939+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02200718b0 con 0x7f022006a7f0 2023-10-07T09:07:27.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.600+0000 7f021cff9700 1 -- 172.21.15.46:0/2030531906 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v124) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0218055850 con 0x7f022006a7f0 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.603+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 msgr2=0x7f02000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.603+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 0x7f02000697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f02200aad50 tx=0x7f0210017000 comp rx=0 tx=0).stop 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.603+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 msgr2=0x7f0220155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.603+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f0218009ef0 tx=0x7f021800b040 comp rx=0 tx=0).stop 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 shutdown_connections 2023-10-07T09:07:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0200067320 0x7f02000697d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0220159b80 0x7f022015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f022006a7f0 0x7f0220155450 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 --2- 172.21.15.46:0/2030531906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02201597b0 0x7f022015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 >> 172.21.15.46:0/2030531906 conn(0x7f02200cd880 msgr2=0x7f0220157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 shutdown_connections 2023-10-07T09:07:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.604+0000 7f0226bdb700 1 -- 172.21.15.46:0/2030531906 wait complete. 2023-10-07T09:07:27.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:07:27.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.748+0000 7f0982494700 1 Processor -- start 2023-10-07T09:07:27.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.748+0000 7f0982494700 1 -- start start 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f0982494700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f097c06bcd0 0x7f097c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f0982494700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c15c2a0 con 0x7f097c06c0a0 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f0982494700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c15b690 con 0x7f097c0c9510 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f0982494700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c0c9900 con 0x7f097c06bcd0 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f097c06bcd0 0x7f097c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:27.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f097c06c0a0 0x7f097c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53842/0 (socket says 172.21.15.46:53842) 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097b7fe700 1 -- 172.21.15.46:0/2471674682 learned_addr learned my addr 172.21.15.46:0/2471674682 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097affd700 1 -- 172.21.15.46:0/2471674682 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012961412 0 0) 0x7f097c15c2a0 con 0x7f097c06c0a0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097affd700 1 -- 172.21.15.46:0/2471674682 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0968003570 con 0x7f097c06c0a0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097bfff700 1 -- 172.21.15.46:0/2471674682 >> v1:172.21.15.133:6789/0 conn(0x7f097c0c9510 legacy=0x7f097c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097bfff700 1 -- 172.21.15.46:0/2471674682 >> v1:172.21.15.46:6789/0 conn(0x7f097c06c0a0 legacy=0x7f097c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.749+0000 7f097bfff700 1 -- 172.21.15.46:0/2471674682 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c15b970 con 0x7f097c06bcd0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f097bfff700 1 --2- 172.21.15.46:0/2471674682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c06bcd0 0x7f097c140df0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f096c0098e0 tx=0x7f096c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61398fb28f6368 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f097affd700 1 -- 172.21.15.46:0/2471674682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00b640 con 0x7f097c06bcd0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f097affd700 1 -- 172.21.15.46:0/2471674682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00b7a0 con 0x7f097c06bcd0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f097affd700 1 -- 172.21.15.46:0/2471674682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00bb40 con 0x7f097c06bcd0 2023-10-07T09:07:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 -- 172.21.15.46:0/2471674682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c06bcd0 msgr2=0x7f097c140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 --2- 172.21.15.46:0/2471674682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c06bcd0 0x7f097c140df0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f096c0098e0 tx=0x7f096c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 -- 172.21.15.46:0/2471674682 shutdown_connections 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 --2- 172.21.15.46:0/2471674682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c06bcd0 0x7f097c140df0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 -- 172.21.15.46:0/2471674682 >> 172.21.15.46:0/2471674682 conn(0x7f097c0ce600 msgr2=0x7f097c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 -- 172.21.15.46:0/2471674682 shutdown_connections 2023-10-07T09:07:27.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.750+0000 7f0982494700 1 -- 172.21.15.46:0/2471674682 wait complete. 2023-10-07T09:07:27.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.751+0000 7f0982494700 1 Processor -- start 2023-10-07T09:07:27.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 -- start start 2023-10-07T09:07:27.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f097c06bcd0 0x7f097c13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:27.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 0x7f097c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c6ff0 con 0x7f097c0c9510 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c63e0 con 0x7f097c06c0a0 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0982494700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c66c0 con 0x7f097c06bcd0 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0980a31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0980a31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49886/0 (socket says 172.21.15.46:49886) 2023-10-07T09:07:27.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f0980a31700 1 -- 172.21.15.46:0/1976295624 learned_addr learned my addr 172.21.15.46:0/1976295624 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f097bfff700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f097c06bcd0 0x7f097c13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.752+0000 7f097b7fe700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 0x7f097c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 -- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f097c06bcd0 msgr2=0x7f097c13f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f097c06bcd0 0x7f097c13f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 -- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 msgr2=0x7f097c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 0x7f097c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 -- 172.21.15.46:0/1976295624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009420 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f097b7fe700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 0x7f097c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0980a31700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f097400bbb0 tx=0x7f0974009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740092e0 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400c6f0 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400ca90 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c0c69a0 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.753+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c13f920 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.754+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c0c7160 con 0x7f097c0c9510 2023-10-07T09:07:27.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.754+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0974012070 con 0x7f097c0c9510 2023-10-07T09:07:27.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.755+0000 7f0973fff700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 0x7f095c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:27.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.755+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0974084860 con 0x7f097c0c9510 2023-10-07T09:07:27.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.755+0000 7f097bfff700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 0x7f095c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:27.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.756+0000 7f097bfff700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 0x7f095c0697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f096c0093f0 tx=0x7f096c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:27.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.759+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09740514b0 con 0x7f097c0c9510 2023-10-07T09:07:27.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.981+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f097c04c3c0 con 0x7f095c067320 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.983+0000 7f0973fff700 1 -- 172.21.15.46:0/1976295624 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f097c04c3c0 con 0x7f095c067320 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:27.985 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:27.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 msgr2=0x7f095c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 0x7f095c0697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f096c0093f0 tx=0x7f096c016000 comp rx=0 tx=0).stop 2023-10-07T09:07:27.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 msgr2=0x7f097c15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f097400bbb0 tx=0x7f0974009840 comp rx=0 tx=0).stop 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 shutdown_connections 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f095c067320 0x7f095c0697d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f097c0c9510 0x7f097c15a860 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f097c06bcd0 0x7f097c13f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 --2- 172.21.15.46:0/1976295624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c06c0a0 0x7f097c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 >> 172.21.15.46:0/1976295624 conn(0x7f097c0ce600 msgr2=0x7f097c0c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 shutdown_connections 2023-10-07T09:07:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:27.985+0000 7f0982494700 1 -- 172.21.15.46:0/1976295624 wait complete. 2023-10-07T09:07:27.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:07:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.120+0000 7fd31fc69700 1 Processor -- start 2023-10-07T09:07:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.120+0000 7fd31fc69700 1 -- start start 2023-10-07T09:07:28.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31fc69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd318159c60 0x7fd31815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31fc69700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd31815db10 0x7fd318069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31fc69700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31815a160 con 0x7fd318159890 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31fc69700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180d13a0 con 0x7fd31815db10 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31fc69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815e140 con 0x7fd318159c60 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31da05700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd318159890 0x7fd31815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53854/0 (socket says 172.21.15.46:53854) 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.121+0000 7fd31da05700 1 -- 172.21.15.46:0/3065205965 learned_addr learned my addr 172.21.15.46:0/3065205965 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752892541 0 0) 0x7fd31815a160 con 0x7fd318159890 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd318159c60 0x7fd31815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31e206700 1 --2- 172.21.15.46:0/3065205965 >> v2:172.21.15.133:3300/0 conn(0x7fd31815db10 0x7fd318069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd300003570 con 0x7fd318159890 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368058833 0 0) 0x7fd300003570 con 0x7fd318159890 2023-10-07T09:07:28.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd318159c60 msgr2=0x7fd31815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd318159c60 0x7fd31815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 >> v2:172.21.15.133:3300/0 conn(0x7fd31815db10 msgr2=0x7fd318069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 --2- 172.21.15.46:0/3065205965 >> v2:172.21.15.133:3300/0 conn(0x7fd31815db10 0x7fd318069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31815a3d0 con 0x7fd318159890 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd310001470 con 0x7fd318159890 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 >> v1:172.21.15.46:6789/0 conn(0x7fd318159890 legacy=0x7fd31815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd300003a60 0x7fd300003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3000051c0 0x7fd30000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180d13a0 con 0x7fd300004810 2023-10-07T09:07:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815e140 con 0x7fd3000051c0 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30000bfa0 con 0x7fd300003a60 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd318159c60 0x7fd31815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31da05700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd300003a60 0x7fd300003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.122+0000 7fd31e206700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3000051c0 0x7fd30000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 -- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd300003a60 msgr2=0x7fd300003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd300003a60 0x7fd300003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 -- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3000051c0 msgr2=0x7fd30000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3000051c0 0x7fd30000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 -- 172.21.15.46:0/3065205965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300003570 con 0x7fd300004810 2023-10-07T09:07:28.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31da05700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd300003a60 0x7fd300003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31d204700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd300004c80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b67f0 tx=0x7fd30c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f78d79acf43fbec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00c070 con 0x7fd300004810 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c013410 con 0x7fd300004810 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.123+0000 7fd31ca03700 1 -- 172.21.15.46:0/3065205965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0135a0 con 0x7fd300004810 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 -- 172.21.15.46:0/3065205965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 msgr2=0x7fd300004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 --2- 172.21.15.46:0/3065205965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd300004c80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b67f0 tx=0x7fd30c008040 comp rx=0 tx=0).stop 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31e206700 1 -- 172.21.15.46:0/3065205965 reap_dead start 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 -- 172.21.15.46:0/3065205965 shutdown_connections 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 -- 172.21.15.46:0/3065205965 >> 172.21.15.46:0/3065205965 conn(0x7fd318068e20 msgr2=0x7fd3180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 -- 172.21.15.46:0/3065205965 shutdown_connections 2023-10-07T09:07:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.124+0000 7fd31fc69700 1 -- 172.21.15.46:0/3065205965 wait complete. 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.125+0000 7fd31fc69700 1 Processor -- start 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.125+0000 7fd31fc69700 1 -- start start 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3180b4d70 0x7fd3180cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180ce520 0x7fd31815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b51e0 con 0x7fd300004810 2023-10-07T09:07:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180cdb50 con 0x7fd3180ce520 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b6370 con 0x7fd3180b4d70 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49906/0 (socket says 172.21.15.46:49906) 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 -- 172.21.15.46:0/2720329416 learned_addr learned my addr 172.21.15.46:0/2720329416 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31d204700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3180b4d70 0x7fd3180cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 -- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3180b4d70 msgr2=0x7fd3180cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3180b4d70 0x7fd3180cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 -- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180ce520 msgr2=0x7fd31815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31e206700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180ce520 0x7fd31815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180ce520 0x7fd31815b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 -- 172.21.15.46:0/2720329416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180cd220 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31da05700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd3100074e0 tx=0x7fd310001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310018030 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000f920 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000fce0 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.126+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3180cd500 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.127+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31814fd50 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.128+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31804c3c0 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.128+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd31001b070 con 0x7fd300004810 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.128+0000 7fd315ffb700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 0x7fd3040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.129+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd310019070 con 0x7fd300004810 2023-10-07T09:07:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.129+0000 7fd31d204700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 0x7fd3040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.129+0000 7fd31d204700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 0x7fd3040697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b67f0 tx=0x7fd30c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.133+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3100519f0 con 0x7fd300004810 2023-10-07T09:07:28.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.324+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd31806a5b0 con 0x7fd300004810 2023-10-07T09:07:28.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.325+0000 7fd315ffb700 1 -- 172.21.15.46:0/2720329416 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd310055010 con 0x7fd300004810 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 msgr2=0x7fd3040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 0x7fd3040697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b67f0 tx=0x7fd30c019000 comp rx=0 tx=0).stop 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 msgr2=0x7fd3180b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd3100074e0 tx=0x7fd310001e90 comp rx=0 tx=0).stop 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 shutdown_connections 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd304067320 0x7fd3040697d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180ce520 0x7fd31815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd300004810 0x7fd3180b5d50 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 --2- 172.21.15.46:0/2720329416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3180b4d70 0x7fd3180cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 >> 172.21.15.46:0/2720329416 conn(0x7fd318068e20 msgr2=0x7fd3180b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 shutdown_connections 2023-10-07T09:07:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.327+0000 7fd31fc69700 1 -- 172.21.15.46:0/2720329416 wait complete. 2023-10-07T09:07:28.340 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:07:28.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:07:28.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:28.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:07:28.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:28.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:07:28.433 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:07:28.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:07:28.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:28.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:07:28.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:28.479 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:07:28.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:07:28.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:28.537 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T09:07:28.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:07:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-07T09:07:28.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:07:28.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:28.553 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T09:07:28.594 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-07T09:07:28.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:07:28.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000001034129 --yes-i-really-mean-it 2023-10-07T09:07:28.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.717+0000 7f0a4e0d6700 1 Processor -- start 2023-10-07T09:07:28.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.717+0000 7f0a4e0d6700 1 -- start start 2023-10-07T09:07:28.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4e0d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a480cb560 0x7f0a480cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4e0d6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a48159db0 con 0x7f0a48069ec0 2023-10-07T09:07:28.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4e0d6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4806a470 con 0x7f0a480cc970 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4e0d6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4806aa30 con 0x7f0a480cb560 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4d8d5700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0a48069ec0 0x7f0a4815ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53858/0 (socket says 172.21.15.46:53858) 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.718+0000 7f0a4d8d5700 1 -- 172.21.15.46:0/2910761984 learned_addr learned my addr 172.21.15.46:0/2910761984 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/2910761984 >> v2:172.21.15.133:3300/0 conn(0x7f0a480cb560 0x7f0a480cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810454454 0 0) 0x7f0a48159db0 con 0x7f0a48069ec0 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a30003570 con 0x7f0a48069ec0 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857414782 0 0) 0x7f0a30003570 con 0x7f0a48069ec0 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 >> v2:172.21.15.133:3300/0 conn(0x7f0a480cb560 msgr2=0x7f0a480cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 --2- 172.21.15.46:0/2910761984 >> v2:172.21.15.133:3300/0 conn(0x7f0a480cb560 0x7f0a480cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 >> v1:172.21.15.133:6789/0 conn(0x7f0a480cc970 legacy=0x7f0a480697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4806a750 con 0x7f0a48069ec0 2023-10-07T09:07:28.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f0a38001470 con 0x7f0a48069ec0 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 >> v1:172.21.15.46:6789/0 conn(0x7f0a48069ec0 legacy=0x7f0a4815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a30004810 0x7f0a30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a300051c0 0x7f0a3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4806aa30 con 0x7f0a30003a60 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000c160 con 0x7f0a30004810 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000c320 con 0x7f0a300051c0 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d8d5700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a300051c0 0x7f0a3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4c8d3700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a30004810 0x7f0a30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a300051c0 msgr2=0x7f0a3000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a300051c0 0x7f0a3000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a30004810 msgr2=0x7f0a30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a30004810 0x7f0a30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/2910761984 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30003570 con 0x7f0a30003a60 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d8d5700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a300051c0 0x7f0a3000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4c8d3700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a30004810 0x7f0a30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.719+0000 7f0a4d8d5700 1 -- 172.21.15.46:0/2910761984 reap_dead start 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a30003e70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e210 tx=0x7f0a4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84548242ff1843a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000eac0 con 0x7f0a30003a60 2023-10-07T09:07:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000f040 con 0x7f0a30003a60 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a47fff700 1 -- 172.21.15.46:0/2910761984 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000ee70 con 0x7f0a30003a60 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 msgr2=0x7f0a30003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a30003e70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e210 tx=0x7f0a4000b040 comp rx=0 tx=0).stop 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/2910761984 shutdown_connections 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/2910761984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a30003e70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/2910761984 >> 172.21.15.46:0/2910761984 conn(0x7f0a4806baf0 msgr2=0x7f0a4806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/2910761984 shutdown_connections 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.720+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/2910761984 wait complete. 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.721+0000 7f0a4e0d6700 1 Processor -- start 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.721+0000 7f0a4e0d6700 1 -- start start 2023-10-07T09:07:28.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a480b3650 0x7f0a4815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 0x7f0a4816cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481476d0 con 0x7f0a30003a60 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4815dc70 con 0x7f0a4815d7d0 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4e0d6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481606d0 con 0x7f0a480b3650 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4d0d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4d0d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49918/0 (socket says 172.21.15.46:49918) 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.722+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/900427698 learned_addr learned my addr 172.21.15.46:0/900427698 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a480b3650 msgr2=0x7f0a4815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a480b3650 0x7f0a4815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d8d5700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 0x7f0a4816cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 msgr2=0x7f0a4816cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 0x7f0a4816cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 -- 172.21.15.46:0/900427698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48160240 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d8d5700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 0x7f0a4816cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4d0d4700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e800 tx=0x7f0a4001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4001d420 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4001d580 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4815f390 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4001d980 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.723+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4815f910 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.724+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4804c3c0 con 0x7f0a30003a60 2023-10-07T09:07:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.724+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a40003040 con 0x7f0a30003a60 2023-10-07T09:07:28.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.725+0000 7f0a457fa700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 0x7f0a340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:28.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.725+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0a400871e0 con 0x7f0a30003a60 2023-10-07T09:07:28.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.725+0000 7f0a4c8d3700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 0x7f0a340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:28.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.725+0000 7f0a4c8d3700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 0x7f0a340697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c007fd0 tx=0x7f0a3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:28.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.729+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a40053d20 con 0x7f0a30003a60 2023-10-07T09:07:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:28.950+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000001034129", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0a48065910 con 0x7f0a34067320 2023-10-07T09:07:31.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.629+0000 7f0a457fa700 1 -- 172.21.15.46:0/900427698 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f0a48065910 con 0x7f0a34067320 2023-10-07T09:07:31.630 INFO:teuthology.orchestra.run.smithi046.stdout:FS volume 'cephfs' renamed to 'volume_0000000001034129' 2023-10-07T09:07:31.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 msgr2=0x7f0a340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 0x7f0a340697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c007fd0 tx=0x7f0a3c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 msgr2=0x7f0a48147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e800 tx=0x7f0a4001a000 comp rx=0 tx=0).stop 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 shutdown_connections 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0a34067320 0x7f0a340697d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a4815d7d0 0x7f0a4816cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a30003a60 0x7f0a48147190 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 --2- 172.21.15.46:0/900427698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a480b3650 0x7f0a4815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 >> 172.21.15.46:0/900427698 conn(0x7f0a4806baf0 msgr2=0x7f0a480c33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:31.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 shutdown_connections 2023-10-07T09:07:31.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.632+0000 7f0a4e0d6700 1 -- 172.21.15.46:0/900427698 wait complete. 2023-10-07T09:07:31.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000001034129 --yes-i-really-mean-it 2023-10-07T09:07:31.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.776+0000 7fad50df6700 1 Processor -- start 2023-10-07T09:07:31.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.776+0000 7fad50df6700 1 -- start start 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad50df6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 0x7fad4c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad50df6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad4c154320 0x7fad4c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad50df6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c0b4570 con 0x7fad4c15a190 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad50df6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c15a730 con 0x7fad4c154320 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad50df6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c15aa10 con 0x7fad4c153f50 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad4ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fad4c15a190 0x7fad4c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60012/0 (socket says 172.21.15.46:60012) 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.777+0000 7fad4ad9d700 1 -- 172.21.15.46:0/4220559969 learned_addr learned my addr 172.21.15.46:0/4220559969 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad49d9b700 1 --2- 172.21.15.46:0/4220559969 >> v2:172.21.15.133:3300/0 conn(0x7fad4c154320 0x7fad4c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4220559969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 0x7fad4c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383956169 0 0) 0x7fad4c0b4570 con 0x7fad4c15a190 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad38003570 con 0x7fad4c15a190 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 -- 172.21.15.46:0/4220559969 >> v2:172.21.15.133:3300/0 conn(0x7fad4c154320 msgr2=0x7fad4c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4220559969 >> v2:172.21.15.133:3300/0 conn(0x7fad4c154320 0x7fad4c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 -- 172.21.15.46:0/4220559969 >> v1:172.21.15.46:6789/0 conn(0x7fad4c15a190 legacy=0x7fad4c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837964694 0 0) 0x7fad38003570 con 0x7fad4c15a190 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 -- 172.21.15.46:0/4220559969 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c15acf0 con 0x7fad4c153f50 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4220559969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 0x7fad4c0b2000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e60 tx=0x7fad44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d2fc1eb0043b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400e070 con 0x7fad4c153f50 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400b7a0 con 0x7fad4c153f50 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.778+0000 7fad4959a700 1 -- 172.21.15.46:0/4220559969 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c001470 con 0x7fad4c153f50 2023-10-07T09:07:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 -- 172.21.15.46:0/4220559969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 msgr2=0x7fad4c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 --2- 172.21.15.46:0/4220559969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 0x7fad4c0b2000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e60 tx=0x7fad44009780 comp rx=0 tx=0).stop 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 -- 172.21.15.46:0/4220559969 shutdown_connections 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 --2- 172.21.15.46:0/4220559969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c153f50 0x7fad4c0b2000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 --2- 172.21.15.46:0/4220559969 >> v2:172.21.15.133:3300/0 conn(0x7fad4c154320 0x7fad4c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 -- 172.21.15.46:0/4220559969 >> 172.21.15.46:0/4220559969 conn(0x7fad4c06baf0 msgr2=0x7fad4c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 -- 172.21.15.46:0/4220559969 shutdown_connections 2023-10-07T09:07:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.779+0000 7fad50df6700 1 -- 172.21.15.46:0/4220559969 wait complete. 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.780+0000 7fad50df6700 1 Processor -- start 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.780+0000 7fad50df6700 1 -- start start 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c153f50 0x7fad4c14b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c154320 0x7fad4c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c14f0b0 con 0x7fad4c15a190 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c14e4a0 con 0x7fad4c153f50 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad50df6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c14e780 con 0x7fad4c154320 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38108/0 (socket says 172.21.15.46:38108) 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 -- 172.21.15.46:0/4097497395 learned_addr learned my addr 172.21.15.46:0/4097497395 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad49d9b700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c154320 0x7fad4c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c153f50 0x7fad4c14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 -- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c154320 msgr2=0x7fad4c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c154320 0x7fad4c151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 -- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c153f50 msgr2=0x7fad4c14b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c153f50 0x7fad4c14b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 -- 172.21.15.46:0/4097497395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009a20 con 0x7fad4c15a190 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.781+0000 7fad4ad9d700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c810 tx=0x7fad3c001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.782+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007360 con 0x7fad4c15a190 2023-10-07T09:07:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.782+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0074c0 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.782+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004830 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.782+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c14ea60 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.782+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c14bec0 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.783+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c0718b0 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.783+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fad3c004c80 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.784+0000 7fad427fc700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 0x7fad2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.784+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fad3c084490 con 0x7fad4c15a190 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.784+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 0x7fad2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.784+0000 7fad4a59c700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 0x7fad2c0697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad440097c0 tx=0x7fad44018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:31.788+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad3c051110 con 0x7fad4c15a190 2023-10-07T09:07:32.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.009+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000001034129", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fad4c069650 con 0x7fad2c067320 2023-10-07T09:07:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.638+0000 7fad427fc700 1 -- 172.21.15.46:0/4097497395 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fad4c069650 con 0x7fad2c067320 2023-10-07T09:07:32.639 INFO:teuthology.orchestra.run.smithi046.stdout:FS volume 'cephfs' renamed to 'volume_0000000001034129' 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 msgr2=0x7fad2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 0x7fad2c0697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad440097c0 tx=0x7fad44018000 comp rx=0 tx=0).stop 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 msgr2=0x7fad4c151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c810 tx=0x7fad3c001960 comp rx=0 tx=0).stop 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 shutdown_connections 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fad2c067320 0x7fad2c0697d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad4c15a190 0x7fad4c151a80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad4c153f50 0x7fad4c14b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 --2- 172.21.15.46:0/4097497395 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad4c154320 0x7fad4c151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 >> 172.21.15.46:0/4097497395 conn(0x7fad4c06baf0 msgr2=0x7fad4c0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 shutdown_connections 2023-10-07T09:07:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.641+0000 7fad50df6700 1 -- 172.21.15.46:0/4097497395 wait complete. 2023-10-07T09:07:32.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:07:32.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.783+0000 7f35f63d3700 1 Processor -- start 2023-10-07T09:07:32.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.783+0000 7f35f63d3700 1 -- start start 2023-10-07T09:07:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f63d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 0x7f35f0159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f63d3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00cfe20 con 0x7f35f00ceaa0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f63d3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00cf210 con 0x7f35f01593b0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f63d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00cf4f0 con 0x7f35f00b1e50 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f5bd2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f35f00ceaa0 0x7f35f00b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60026/0 (socket says 172.21.15.46:60026) 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f5bd2700 1 -- 172.21.15.46:0/213309935 learned_addr learned my addr 172.21.15.46:0/213309935 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/213309935 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 0x7f35f0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700336304 0 0) 0x7f35f00cfe20 con 0x7f35f00ceaa0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d8003570 con 0x7f35f00ceaa0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759650096 0 0) 0x7f35f00cf210 con 0x7f35f01593b0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.784+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f00cfe20 con 0x7f35f01593b0 2023-10-07T09:07:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f4bd0700 1 -- 172.21.15.46:0/213309935 >> v1:172.21.15.133:6789/0 conn(0x7f35f01593b0 legacy=0x7f35f00b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f4bd0700 1 -- 172.21.15.46:0/213309935 >> v1:172.21.15.46:6789/0 conn(0x7f35f00ceaa0 legacy=0x7f35f00b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f4bd0700 1 -- 172.21.15.46:0/213309935 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00cf7d0 con 0x7f35f00b1e50 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/213309935 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 0x7f35f0159780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009910 tx=0x7f35e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3b11548ef3058c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4011630 con 0x7f35f00b1e50 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4011790 con 0x7f35f00b1e50 2023-10-07T09:07:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35effff700 1 -- 172.21.15.46:0/213309935 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4011b30 con 0x7f35f00b1e50 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f63d3700 1 -- 172.21.15.46:0/213309935 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 msgr2=0x7f35f0159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.785+0000 7f35f63d3700 1 --2- 172.21.15.46:0/213309935 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 0x7f35f0159780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009910 tx=0x7f35e40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.786+0000 7f35f63d3700 1 -- 172.21.15.46:0/213309935 shutdown_connections 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.786+0000 7f35f63d3700 1 --2- 172.21.15.46:0/213309935 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f00b1e50 0x7f35f0159780 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.786+0000 7f35f63d3700 1 -- 172.21.15.46:0/213309935 >> 172.21.15.46:0/213309935 conn(0x7f35f00d1130 msgr2=0x7f35f00b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.786+0000 7f35f63d3700 1 -- 172.21.15.46:0/213309935 shutdown_connections 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.786+0000 7f35f63d3700 1 -- 172.21.15.46:0/213309935 wait complete. 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.787+0000 7f35f63d3700 1 Processor -- start 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.787+0000 7f35f63d3700 1 -- start start 2023-10-07T09:07:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 0x7f35f00b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f01593b0 0x7f35f01699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00c63f0 con 0x7f35f00b1e50 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f015a6d0 con 0x7f35f00ceaa0 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f63d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00c57e0 con 0x7f35f01593b0 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38120/0 (socket says 172.21.15.46:38120) 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 -- 172.21.15.46:0/1828406351 learned_addr learned my addr 172.21.15.46:0/1828406351 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 0x7f35f00b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f5bd2700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f01593b0 0x7f35f01699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 -- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f01593b0 msgr2=0x7f35f01699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f01593b0 0x7f35f01699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 -- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 msgr2=0x7f35f00b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 0x7f35f00b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 -- 172.21.15.46:0/1828406351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009420 con 0x7f35f00b1e50 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 0x7f35f00b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.788+0000 7f35f53d1700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c580 tx=0x7f35e8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.789+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8010510 con 0x7f35f00b1e50 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.789+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8010670 con 0x7f35f00b1e50 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.789+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f00c5ac0 con 0x7f35f00b1e50 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.789+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8010a30 con 0x7f35f00b1e50 2023-10-07T09:07:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.789+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f00c6080 con 0x7f35f00b1e50 2023-10-07T09:07:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.790+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f004c3c0 con 0x7f35f00b1e50 2023-10-07T09:07:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.790+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f35e801b400 con 0x7f35f00b1e50 2023-10-07T09:07:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.790+0000 7f35ed7fa700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 0x7f35dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.791+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f35e8084a50 con 0x7f35f00b1e50 2023-10-07T09:07:32.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.791+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 0x7f35dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.791+0000 7f35f4bd0700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 0x7f35dc0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009860 tx=0x7f35e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:32.795+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35e8051650 con 0x7f35f00b1e50 2023-10-07T09:07:33.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.018+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f35f00cfab0 con 0x7f35dc067320 2023-10-07T09:07:33.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.020+0000 7f35ed7fa700 1 -- 172.21.15.46:0/1828406351 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f35f00cfab0 con 0x7f35dc067320 2023-10-07T09:07:33.021 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:33.021 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:33.021 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000001034129" 2023-10-07T09:07:33.021 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:33.021 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 msgr2=0x7f35dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 0x7f35dc0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009860 tx=0x7f35e4017000 comp rx=0 tx=0).stop 2023-10-07T09:07:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 msgr2=0x7f35f015a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c580 tx=0x7f35e8007e10 comp rx=0 tx=0).stop 2023-10-07T09:07:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 shutdown_connections 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f35dc067320 0x7f35dc0697d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35f01593b0 0x7f35f01699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f00b1e50 0x7f35f015a190 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 --2- 172.21.15.46:0/1828406351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35f00ceaa0 0x7f35f00b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 >> 172.21.15.46:0/1828406351 conn(0x7f35f00d1130 msgr2=0x7f35f00b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 shutdown_connections 2023-10-07T09:07:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.022+0000 7f35f63d3700 1 -- 172.21.15.46:0/1828406351 wait complete. 2023-10-07T09:07:33.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:33.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.155+0000 7ffa58240700 1 Processor -- start 2023-10-07T09:07:33.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.155+0000 7ffa58240700 1 -- start start 2023-10-07T09:07:33.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 0x7ffa5015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159c60 0x7ffa5015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa5015db10 0x7ffa50069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5015a160 con 0x7ffa5015db10 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa500d13a0 con 0x7ffa50159890 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa58240700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5015e140 con 0x7ffa50159c60 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa567dd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa5015db10 0x7ffa50069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa567dd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa5015db10 0x7ffa50069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38124/0 (socket says 172.21.15.46:38124) 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.156+0000 7ffa567dd700 1 -- 172.21.15.46:0/3642147413 learned_addr learned my addr 172.21.15.46:0/3642147413 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa55fdc700 1 --2- 172.21.15.46:0/3642147413 >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 0x7ffa5015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa557db700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159c60 0x7ffa5015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 -- 172.21.15.46:0/3642147413 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159c60 msgr2=0x7ffa5015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:33.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159c60 0x7ffa5015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 -- 172.21.15.46:0/3642147413 >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 msgr2=0x7ffa5015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 --2- 172.21.15.46:0/3642147413 >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 0x7ffa5015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 -- 172.21.15.46:0/3642147413 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5015a3d0 con 0x7ffa5015db10 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa55fdc700 1 --2- 172.21.15.46:0/3642147413 >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 0x7ffa5015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa567dd700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa5015db10 0x7ffa50069560 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ffa500d1090 tx=0x7ffa40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b371822ef473046 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa54fda700 1 -- 172.21.15.46:0/3642147413 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000e070 con 0x7ffa5015db10 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa54fda700 1 -- 172.21.15.46:0/3642147413 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4000ba50 con 0x7ffa5015db10 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa54fda700 1 -- 172.21.15.46:0/3642147413 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400092e0 con 0x7ffa5015db10 2023-10-07T09:07:33.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa58240700 1 -- 172.21.15.46:0/3642147413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa5015db10 msgr2=0x7ffa50069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.157+0000 7ffa58240700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa5015db10 0x7ffa50069560 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ffa500d1090 tx=0x7ffa40009840 comp rx=0 tx=0).stop 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 -- 172.21.15.46:0/3642147413 shutdown_connections 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa5015db10 0x7ffa50069560 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 --2- 172.21.15.46:0/3642147413 >> v2:172.21.15.133:3300/0 conn(0x7ffa50159890 0x7ffa5015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 --2- 172.21.15.46:0/3642147413 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159c60 0x7ffa5015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 -- 172.21.15.46:0/3642147413 >> 172.21.15.46:0/3642147413 conn(0x7ffa50068e20 msgr2=0x7ffa500d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 -- 172.21.15.46:0/3642147413 shutdown_connections 2023-10-07T09:07:33.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.158+0000 7ffa58240700 1 -- 172.21.15.46:0/3642147413 wait complete. 2023-10-07T09:07:33.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 Processor -- start 2023-10-07T09:07:33.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 -- start start 2023-10-07T09:07:33.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159890 0x7ffa50151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 0x7ffa500cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50169bb0 con 0x7ffa50159c60 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50169e90 con 0x7ffa5015db10 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.159+0000 7ffa58240700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5016a170 con 0x7ffa50159890 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38126/0 (socket says 172.21.15.46:38126) 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 -- 172.21.15.46:0/3133716512 learned_addr learned my addr 172.21.15.46:0/3133716512 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa567dd700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 0x7ffa500cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa55fdc700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159890 0x7ffa50151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 -- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159890 msgr2=0x7ffa50151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159890 0x7ffa50151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 -- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 msgr2=0x7ffa500cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 0x7ffa500cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 -- 172.21.15.46:0/3133716512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40009ae0 con 0x7ffa50159c60 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa567dd700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 0x7ffa500cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa557db700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c880 tx=0x7ffa44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011600 con 0x7ffa50159c60 2023-10-07T09:07:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44011780 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011b40 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5016a450 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.160+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa50169830 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.161+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5016a670 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.162+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa44010350 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.162+0000 7ffa4dffb700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 0x7ffa3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.162+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7ffa44084ba0 con 0x7ffa50159c60 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.162+0000 7ffa55fdc700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 0x7ffa3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.163+0000 7ffa55fdc700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 0x7ffa3c0697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800ac00 tx=0x7ffa48006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.166+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa44051690 con 0x7ffa50159c60 2023-10-07T09:07:33.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.408+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa50169cf0 con 0x7ffa50159c60 2023-10-07T09:07:33.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.409+0000 7ffa4dffb700 1 -- 172.21.15.46:0/3133716512 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4627 (secure 0 0 0) 0x7ffa50169cf0 con 0x7ffa50159c60 2023-10-07T09:07:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:33.410 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:29.608279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000001034129","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 msgr2=0x7ffa3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 0x7ffa3c0697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800ac00 tx=0x7ffa48006f90 comp rx=0 tx=0).stop 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 msgr2=0x7ffa500cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c880 tx=0x7ffa44008040 comp rx=0 tx=0).stop 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 shutdown_connections 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa3c067320 0x7ffa3c0697d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa5015db10 0x7ffa500cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa50159890 0x7ffa50151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 --2- 172.21.15.46:0/3133716512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa50159c60 0x7ffa500cef90 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 >> 172.21.15.46:0/3133716512 conn(0x7ffa50068e20 msgr2=0x7ffa5015cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 shutdown_connections 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.411+0000 7ffa58240700 1 -- 172.21.15.46:0/3133716512 wait complete. 2023-10-07T09:07:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 126 2023-10-07T09:07:33.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:33.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.543+0000 7f414d7b5700 1 Processor -- start 2023-10-07T09:07:33.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.543+0000 7f414d7b5700 1 -- start start 2023-10-07T09:07:33.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f414d7b5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4148068920 0x7f414806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f414d7b5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414806ec70 con 0x7f414806f640 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f414d7b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480b2e70 con 0x7f4148068550 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f414d7b5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4148068d90 con 0x7f4148068920 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f41467fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4148068920 0x7f414806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f41477fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f414806f640 0x7f4148159510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60040/0 (socket says 172.21.15.46:60040) 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.544+0000 7f41477fe700 1 -- 172.21.15.46:0/3366791426 learned_addr learned my addr 172.21.15.46:0/3366791426 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f41467fc700 1 -- 172.21.15.46:0/3366791426 >> v1:172.21.15.133:6789/0 conn(0x7f4148068550 legacy=0x7f414815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f41467fc700 1 -- 172.21.15.46:0/3366791426 >> v1:172.21.15.46:6789/0 conn(0x7f414806f640 legacy=0x7f4148159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f41467fc700 1 -- 172.21.15.46:0/3366791426 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480b3150 con 0x7f4148068920 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f4145ffb700 1 -- 172.21.15.46:0/3366791426 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564189926 0 0) 0x7f414806ec70 con 0x7f414806f640 2023-10-07T09:07:33.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f41467fc700 1 --2- 172.21.15.46:0/3366791426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414806f100 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f41300098e0 tx=0x7f41300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25e565475754824 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f4145ffb700 1 -- 172.21.15.46:0/3366791426 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130009e80 con 0x7f4148068920 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f4145ffb700 1 -- 172.21.15.46:0/3366791426 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413000b860 con 0x7f4148068920 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f4145ffb700 1 -- 172.21.15.46:0/3366791426 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000bbe0 con 0x7f4148068920 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f414d7b5700 1 -- 172.21.15.46:0/3366791426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 msgr2=0x7f414806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.545+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3366791426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414806f100 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f41300098e0 tx=0x7f41300091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.546+0000 7f414d7b5700 1 -- 172.21.15.46:0/3366791426 shutdown_connections 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.546+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3366791426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414806f100 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.546+0000 7f414d7b5700 1 -- 172.21.15.46:0/3366791426 >> 172.21.15.46:0/3366791426 conn(0x7f41480cd480 msgr2=0x7f41480cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.546+0000 7f414d7b5700 1 -- 172.21.15.46:0/3366791426 shutdown_connections 2023-10-07T09:07:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.546+0000 7f414d7b5700 1 -- 172.21.15.46:0/3366791426 wait complete. 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.547+0000 7f414d7b5700 1 Processor -- start 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.547+0000 7f414d7b5700 1 -- start start 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.547+0000 7f414d7b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4148068550 0x7f414815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.547+0000 7f414d7b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f414806f640 0x7f4148156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414815cb90 con 0x7f4148068920 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414815bcd0 con 0x7f414806f640 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414815bf80 con 0x7f4148068550 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38136/0 (socket says 172.21.15.46:38136) 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 -- 172.21.15.46:0/3591824109 learned_addr learned my addr 172.21.15.46:0/3591824109 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41477fe700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f414806f640 0x7f4148156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 -- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4148068550 msgr2=0x7f414815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f4146ffd700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4148068550 0x7f414815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4148068550 0x7f414815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 -- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f414806f640 msgr2=0x7f4148156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f414806f640 0x7f4148156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 -- 172.21.15.46:0/3591824109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130009420 con 0x7f4148068920 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f41467fc700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f41480ce220 tx=0x7f4130017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413001f070 con 0x7f4148068920 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130011420 con 0x7f4148068920 2023-10-07T09:07:33.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414815c260 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000bbe0 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.548+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414815c820 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.549+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414815cd00 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.550+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4130011a50 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.550+0000 7f413effd700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 0x7f41280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.550+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f4130086260 con 0x7f4148068920 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.550+0000 7f4146ffd700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 0x7f41280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.551+0000 7f4146ffd700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 0x7f41280697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4140007fd0 tx=0x7f4140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.555+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4130052e60 con 0x7f4148068920 2023-10-07T09:07:33.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.751+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f414804c3c0 con 0x7f4148068920 2023-10-07T09:07:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.752+0000 7f413effd700 1 -- 172.21.15.46:0/3591824109 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+15539 (secure 0 0 0) 0x7f4130056480 con 0x7f4148068920 2023-10-07T09:07:33.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":187,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:31.621593+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000001034129.meta","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001034129"}}},{"pool":32,"pool_name":"cephfs.volume_0000000001034129.data","create_time":"2023-10-07T09:07:16.921910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000001034129"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.16","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 msgr2=0x7f41280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 0x7f41280697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4140007fd0 tx=0x7f4140009040 comp rx=0 tx=0).stop 2023-10-07T09:07:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 msgr2=0x7f414815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f41480ce220 tx=0x7f4130017000 comp rx=0 tx=0).stop 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 shutdown_connections 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4128067320 0x7f41280697d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f414806f640 0x7f4148156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4148068550 0x7f414815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 --2- 172.21.15.46:0/3591824109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4148068920 0x7f414815b790 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 >> 172.21.15.46:0/3591824109 conn(0x7f41480cd480 msgr2=0x7f4148155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 shutdown_connections 2023-10-07T09:07:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.754+0000 7f414d7b5700 1 -- 172.21.15.46:0/3591824109 wait complete. 2023-10-07T09:07:33.768 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:07:33.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:33.811 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:33.852 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:07:33.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.971+0000 7f18649ef700 1 Processor -- start 2023-10-07T09:07:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.971+0000 7f18649ef700 1 -- start start 2023-10-07T09:07:33.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f18649ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1860159420 0x7f18600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f18649ef700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f186015d230 0x7f186015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f18649ef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18600b2980 con 0x7f18601597f0 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f18649ef700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186015db70 con 0x7f186015d230 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f18649ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18600b11d0 con 0x7f1860159420 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f186015d230 0x7f186015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f186015d230 0x7f186015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38148/0 (socket says 172.21.15.46:38148) 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 -- 172.21.15.46:0/965459127 learned_addr learned my addr 172.21.15.46:0/965459127 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185f7fe700 1 --2- 172.21.15.46:0/965459127 >> v2:172.21.15.133:3300/0 conn(0x7f1860159420 0x7f18600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 -- 172.21.15.46:0/965459127 >> v2:172.21.15.133:3300/0 conn(0x7f1860159420 msgr2=0x7f18600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 --2- 172.21.15.46:0/965459127 >> v2:172.21.15.133:3300/0 conn(0x7f1860159420 0x7f18600b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 -- 172.21.15.46:0/965459127 >> v1:172.21.15.133:6789/0 conn(0x7f18601597f0 legacy=0x7f18600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.972+0000 7f185ffff700 1 -- 172.21.15.46:0/965459127 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600b14b0 con 0x7f186015d230 2023-10-07T09:07:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f185ffff700 1 --2- 172.21.15.46:0/965459127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f186015d230 0x7f186015d630 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f18600b2f20 tx=0x7f1858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d885b16b0549a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f185e7fc700 1 -- 172.21.15.46:0/965459127 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800e070 con 0x7f186015d230 2023-10-07T09:07:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f185e7fc700 1 -- 172.21.15.46:0/965459127 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800ba20 con 0x7f186015d230 2023-10-07T09:07:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f185e7fc700 1 -- 172.21.15.46:0/965459127 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580092e0 con 0x7f186015d230 2023-10-07T09:07:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 -- 172.21.15.46:0/965459127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f186015d230 msgr2=0x7f186015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 --2- 172.21.15.46:0/965459127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f186015d230 0x7f186015d630 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f18600b2f20 tx=0x7f1858009840 comp rx=0 tx=0).stop 2023-10-07T09:07:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 -- 172.21.15.46:0/965459127 shutdown_connections 2023-10-07T09:07:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 --2- 172.21.15.46:0/965459127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f186015d230 0x7f186015d630 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 --2- 172.21.15.46:0/965459127 >> v2:172.21.15.133:3300/0 conn(0x7f1860159420 0x7f18600b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 -- 172.21.15.46:0/965459127 >> 172.21.15.46:0/965459127 conn(0x7f18600d0660 msgr2=0x7f18600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 -- 172.21.15.46:0/965459127 shutdown_connections 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.973+0000 7f18649ef700 1 -- 172.21.15.46:0/965459127 wait complete. 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 Processor -- start 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 -- start start 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1860159420 0x7f1860155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 0x7f18600c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600c9740 con 0x7f18601597f0 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600c5400 con 0x7f186015d230 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f18649ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600c5650 con 0x7f1860159420 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.975+0000 7f185effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38156/0 (socket says 172.21.15.46:38156) 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 -- 172.21.15.46:0/3096377630 learned_addr learned my addr 172.21.15.46:0/3096377630 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185ffff700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 0x7f18600c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185f7fe700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1860159420 0x7f1860155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 -- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1860159420 msgr2=0x7f1860155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1860159420 0x7f1860155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 -- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 msgr2=0x7f18600c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 0x7f18600c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 -- 172.21.15.46:0/3096377630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009ae0 con 0x7f18601597f0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185ffff700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 0x7f18600c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f185effd700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f185400c7c0 tx=0x7f1854007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011590 con 0x7f18601597f0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540116f0 con 0x7f18601597f0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011ab0 con 0x7f18601597f0 2023-10-07T09:07:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600c5930 con 0x7f18601597f0 2023-10-07T09:07:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.976+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18600c5ef0 con 0x7f18601597f0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.977+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186004c3c0 con 0x7f18601597f0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.977+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f185401b3b0 con 0x7f18601597f0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.978+0000 7f18477fe700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 0x7f184c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.978+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f1854084220 con 0x7f18601597f0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.978+0000 7f185f7fe700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 0x7f184c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.979+0000 7f185f7fe700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 0x7f184c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1850009d40 tx=0x7f1850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:33.982+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1854050e20 con 0x7f18601597f0 2023-10-07T09:07:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.217+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18600b1790 con 0x7f18601597f0 2023-10-07T09:07:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.218+0000 7f18477fe700 1 -- 172.21.15.46:0/3096377630 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4627 (secure 0 0 0) 0x7f1854017090 con 0x7f18601597f0 2023-10-07T09:07:34.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:34.219 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:29.608279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000001034129","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 msgr2=0x7f184c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 0x7f184c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1850009d40 tx=0x7f1850008040 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 msgr2=0x7f18600c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f185400c7c0 tx=0x7f1854007f50 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 shutdown_connections 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f184c067320 0x7f184c0697d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186015d230 0x7f18600c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1860159420 0x7f1860155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 --2- 172.21.15.46:0/3096377630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18601597f0 0x7f18600c66f0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 >> 172.21.15.46:0/3096377630 conn(0x7f18600d0660 msgr2=0x7f18601586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 shutdown_connections 2023-10-07T09:07:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.220+0000 7f18649ef700 1 -- 172.21.15.46:0/3096377630 wait complete. 2023-10-07T09:07:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 126 2023-10-07T09:07:34.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.351+0000 7f408232b700 1 Processor -- start 2023-10-07T09:07:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.351+0000 7f408232b700 1 -- start start 2023-10-07T09:07:34.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f408232b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f407c140720 0x7f407c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f408232b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f407c0688d0 0x7f407c0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f408232b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c068d30 con 0x7f407c140350 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f408232b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0c7de0 con 0x7f407c140720 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f408232b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c140c10 con 0x7f407c0688d0 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f407b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f407c140720 0x7f407c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f407b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f407c140720 0x7f407c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38158/0 (socket says 172.21.15.46:38158) 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f407bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f407c140350 0x7f407c069c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43720/0 (socket says 172.21.15.46:43720) 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.352+0000 7f407b7fe700 1 -- 172.21.15.46:0/1045686121 learned_addr learned my addr 172.21.15.46:0/1045686121 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f40808c8700 1 --2- 172.21.15.46:0/1045686121 >> v2:172.21.15.133:3300/0 conn(0x7f407c0688d0 0x7f407c0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407b7fe700 1 -- 172.21.15.46:0/1045686121 >> v2:172.21.15.133:3300/0 conn(0x7f407c0688d0 msgr2=0x7f407c0c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407b7fe700 1 --2- 172.21.15.46:0/1045686121 >> v2:172.21.15.133:3300/0 conn(0x7f407c0688d0 0x7f407c0c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407b7fe700 1 -- 172.21.15.46:0/1045686121 >> v1:172.21.15.133:6789/0 conn(0x7f407c140350 legacy=0x7f407c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407b7fe700 1 -- 172.21.15.46:0/1045686121 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c141490 con 0x7f407c140720 2023-10-07T09:07:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407affd700 1 -- 172.21.15.46:0/1045686121 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151602739 0 0) 0x7f406c001160 con 0x7f407c140350 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407b7fe700 1 --2- 172.21.15.46:0/1045686121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140720 0x7f407c068390 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f407c0c7c40 tx=0x7f4064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545dcc24e2954ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407affd700 1 -- 172.21.15.46:0/1045686121 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064009e70 con 0x7f407c140720 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407affd700 1 -- 172.21.15.46:0/1045686121 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400b860 con 0x7f407c140720 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f407affd700 1 -- 172.21.15.46:0/1045686121 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bc00 con 0x7f407c140720 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f408232b700 1 -- 172.21.15.46:0/1045686121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140720 msgr2=0x7f407c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.353+0000 7f408232b700 1 --2- 172.21.15.46:0/1045686121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140720 0x7f407c068390 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f407c0c7c40 tx=0x7f4064009250 comp rx=0 tx=0).stop 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 -- 172.21.15.46:0/1045686121 shutdown_connections 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 --2- 172.21.15.46:0/1045686121 >> v2:172.21.15.133:3300/0 conn(0x7f407c0688d0 0x7f407c0c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 --2- 172.21.15.46:0/1045686121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140720 0x7f407c068390 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 -- 172.21.15.46:0/1045686121 >> 172.21.15.46:0/1045686121 conn(0x7f407c0cd670 msgr2=0x7f407c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:34.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 -- 172.21.15.46:0/1045686121 shutdown_connections 2023-10-07T09:07:34.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.354+0000 7f408232b700 1 -- 172.21.15.46:0/1045686121 wait complete. 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.355+0000 7f408232b700 1 Processor -- start 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.355+0000 7f408232b700 1 -- start start 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.355+0000 7f408232b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407c0688d0 0x7f407c1690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f407c140720 0x7f407c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c13d630 con 0x7f407c140350 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c168ea0 con 0x7f407c0688d0 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c16b290 con 0x7f407c140720 2023-10-07T09:07:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38166/0 (socket says 172.21.15.46:38166) 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 -- 172.21.15.46:0/1558576899 learned_addr learned my addr 172.21.15.46:0/1558576899 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407bfff700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407c0688d0 0x7f407c1690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 -- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f407c140720 msgr2=0x7f407c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f40808c8700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f407c140720 0x7f407c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f407c140720 0x7f407c0cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 -- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407c0688d0 msgr2=0x7f407c1690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407c0688d0 0x7f407c1690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 -- 172.21.15.46:0/1558576899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094f0 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f407b7fe700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f407c06c6a0 tx=0x7f4064017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bbe0 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064011420 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40640117a0 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c168bc0 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.356+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c159610 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.357+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c159190 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.358+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4064011bd0 con 0x7f407c140350 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.358+0000 7f4073fff700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 0x7f405c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.358+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f4064086640 con 0x7f407c140350 2023-10-07T09:07:34.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.358+0000 7f407bfff700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 0x7f405c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.359+0000 7f407bfff700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 0x7f405c0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f406c007fd0 tx=0x7f406c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.363+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f407c159190 con 0x7f407c140350 2023-10-07T09:07:34.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.555+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f407c159190 con 0x7f407c140350 2023-10-07T09:07:34.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.556+0000 7f4073fff700 1 -- 172.21.15.46:0/1558576899 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+15539 (secure 0 0 0) 0x7f407c159190 con 0x7f407c140350 2023-10-07T09:07:34.557 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:34.558 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":187,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:31.621593+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000001034129.meta","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001034129"}}},{"pool":32,"pool_name":"cephfs.volume_0000000001034129.data","create_time":"2023-10-07T09:07:16.921910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000001034129"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.16","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 msgr2=0x7f405c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 0x7f405c0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f406c007fd0 tx=0x7f406c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 msgr2=0x7f407c16ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f407c06c6a0 tx=0x7f4064017000 comp rx=0 tx=0).stop 2023-10-07T09:07:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 shutdown_connections 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f405c067320 0x7f405c0697d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f407c140720 0x7f407c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407c0688d0 0x7f407c1690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 --2- 172.21.15.46:0/1558576899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c140350 0x7f407c16ad50 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 >> 172.21.15.46:0/1558576899 conn(0x7f407c0cd670 msgr2=0x7f407c0c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 shutdown_connections 2023-10-07T09:07:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.558+0000 7f408232b700 1 -- 172.21.15.46:0/1558576899 wait complete. 2023-10-07T09:07:34.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 31, 'pool_name': 'cephfs.volume_0000000001034129.meta', 'create_time': '2023-10-07T09:07:16.361103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001034129'}}}, {'pool': 32, 'pool_name': 'cephfs.volume_0000000001034129.data', 'create_time': '2023-10-07T09:07:16.921910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001034129'}}}] 2023-10-07T09:07:34.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:07:34.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 Processor -- start 2023-10-07T09:07:34.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 -- start start 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f346415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346415a160 con 0x7f3464159c60 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640d13a0 con 0x7f3464069560 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.695+0000 7f346ac87700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346415e140 con 0x7f3464159890 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3463fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3464159c60 0x7f346415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60056/0 (socket says 172.21.15.46:60056) 2023-10-07T09:07:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3463fff700 1 -- 172.21.15.46:0/2944265103 learned_addr learned my addr 172.21.15.46:0/2944265103 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3468a23700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f346415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823091910 0 0) 0x7f346415a160 con 0x7f3464159c60 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f344c003570 con 0x7f3464159c60 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667232598 0 0) 0x7f34640d13a0 con 0x7f3464069560 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f346415a160 con 0x7f3464069560 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3112321249 0 0) 0x7f344c003570 con 0x7f3464159c60 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 msgr2=0x7f346415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f346415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 >> v1:172.21.15.133:6789/0 conn(0x7f3464069560 legacy=0x7f34640ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415a3d0 con 0x7f3464159c60 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f3458001470 con 0x7f3464159c60 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 >> v1:172.21.15.46:6789/0 conn(0x7f3464159c60 legacy=0x7f346415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f344c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f344c004810 0x7f344c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f344c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346415e140 con 0x7f344c003c20 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00bb40 con 0x7f344c004810 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00bd00 con 0x7f3464159890 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3468a23700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f344c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3463fff700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f344c004810 0x7f344c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.696+0000 7f3469224700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f344c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 -- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 msgr2=0x7f344c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3464159890 0x7f344c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 -- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f344c004810 msgr2=0x7f344c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f344c004810 0x7f344c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 -- 172.21.15.46:0/2944265103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c003570 con 0x7f344c003c20 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3468a23700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f344c004010 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e210 tx=0x7f345c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7848b28ff8991ff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00eac0 con 0x7f344c003c20 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c00f040 con 0x7f344c003c20 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f34637fe700 1 -- 172.21.15.46:0/2944265103 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00ee70 con 0x7f344c003c20 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 -- 172.21.15.46:0/2944265103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 msgr2=0x7f344c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 --2- 172.21.15.46:0/2944265103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f344c004010 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e210 tx=0x7f345c00b040 comp rx=0 tx=0).stop 2023-10-07T09:07:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f3469224700 1 -- 172.21.15.46:0/2944265103 reap_dead start 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 -- 172.21.15.46:0/2944265103 shutdown_connections 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 -- 172.21.15.46:0/2944265103 >> 172.21.15.46:0/2944265103 conn(0x7f3464068e20 msgr2=0x7f34640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 -- 172.21.15.46:0/2944265103 shutdown_connections 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.697+0000 7f346ac87700 1 -- 172.21.15.46:0/2944265103 wait complete. 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 Processor -- start 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 -- start start 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 0x7f34640ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 0x7f34641518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346416aed0 con 0x7f344c003c20 2023-10-07T09:07:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640cf900 con 0x7f34640b4080 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f346ac87700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640cfbe0 con 0x7f34640cf240 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.699+0000 7f3468a23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38172/0 (socket says 172.21.15.46:38172) 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 -- 172.21.15.46:0/480723812 learned_addr learned my addr 172.21.15.46:0/480723812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3463fff700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 0x7f34640ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3469224700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 0x7f34641518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 -- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 msgr2=0x7f34641518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 0x7f34641518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 -- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 msgr2=0x7f34640ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 0x7f34640ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 -- 172.21.15.46:0/480723812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640cfec0 con 0x7f344c003c20 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3469224700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 0x7f34641518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:34.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3463fff700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 0x7f34640ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:34.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3468a23700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f345c00afd0 tx=0x7f345c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c029450 con 0x7f344c003c20 2023-10-07T09:07:34.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c0295d0 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34640ce220 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c029990 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.700+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34640ce7e0 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.701+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640ceb50 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.701+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f345c003040 con 0x7f344c003c20 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.702+0000 7f3460ff9700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 0x7f34500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:34.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.702+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f345c0872c0 con 0x7f344c003c20 2023-10-07T09:07:34.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.702+0000 7f3463fff700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 0x7f34500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:34.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.703+0000 7f3463fff700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 0x7f34500697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3458000e10 tx=0x7f3458000cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.706+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f345c053db0 con 0x7f344c003c20 2023-10-07T09:07:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.899+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f346404c3c0 con 0x7f344c003c20 2023-10-07T09:07:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.899+0000 7f3460ff9700 1 -- 172.21.15.46:0/480723812 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7f345c018020 con 0x7f344c003c20 2023-10-07T09:07:34.900 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:07:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 msgr2=0x7f34500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 0x7f34500697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3458000e10 tx=0x7f3458000cd0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 msgr2=0x7f346416a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f345c00afd0 tx=0x7f345c01a000 comp rx=0 tx=0).stop 2023-10-07T09:07:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 shutdown_connections 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3450067320 0x7f34500697d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f34640cf240 0x7f34641518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344c003c20 0x7f346416a990 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 --2- 172.21.15.46:0/480723812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34640b4080 0x7f34640ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 >> 172.21.15.46:0/480723812 conn(0x7f3464068e20 msgr2=0x7f346414d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 shutdown_connections 2023-10-07T09:07:34.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:34.901+0000 7f346ac87700 1 -- 172.21.15.46:0/480723812 wait complete. 2023-10-07T09:07:34.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001034129.meta pg_num 2023-10-07T09:07:35.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.036+0000 7f0f44316700 1 Processor -- start 2023-10-07T09:07:35.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.037+0000 7f0f44316700 1 -- start start 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.037+0000 7f0f44316700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f3c159890 0x7f0f3c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.037+0000 7f0f44316700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159c60 0x7f0f3c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.037+0000 7f0f44316700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c15a160 con 0x7f0f3c15db10 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f44316700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0d13a0 con 0x7f0f3c159890 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f44316700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15e140 con 0x7f0f3c159c60 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f3c159890 0x7f0f3c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f428b3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0f3c15db10 0x7f0f3c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60068/0 (socket says 172.21.15.46:60068) 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f428b3700 1 -- 172.21.15.46:0/2831992244 learned_addr learned my addr 172.21.15.46:0/2831992244 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f418b1700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159c60 0x7f0f3c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 -- 172.21.15.46:0/2831992244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159c60 msgr2=0x7f0f3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159c60 0x7f0f3c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 -- 172.21.15.46:0/2831992244 >> v1:172.21.15.46:6789/0 conn(0x7f0f3c15db10 legacy=0x7f0f3c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 -- 172.21.15.46:0/2831992244 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c15a3d0 con 0x7f0f3c159890 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f420b2700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159890 0x7f0f3c15abd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098e0 tx=0x7f0f2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1381f98f2a124c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f410b0700 1 -- 172.21.15.46:0/2831992244 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c009e80 con 0x7f0f3c159890 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f410b0700 1 -- 172.21.15.46:0/2831992244 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00b860 con 0x7f0f3c159890 2023-10-07T09:07:35.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.038+0000 7f0f410b0700 1 -- 172.21.15.46:0/2831992244 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00bbe0 con 0x7f0f3c159890 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 -- 172.21.15.46:0/2831992244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159890 msgr2=0x7f0f3c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159890 0x7f0f3c15abd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098e0 tx=0x7f0f2c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 -- 172.21.15.46:0/2831992244 shutdown_connections 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159890 0x7f0f3c15abd0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 --2- 172.21.15.46:0/2831992244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159c60 0x7f0f3c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 -- 172.21.15.46:0/2831992244 >> 172.21.15.46:0/2831992244 conn(0x7f0f3c068e20 msgr2=0x7f0f3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 -- 172.21.15.46:0/2831992244 shutdown_connections 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.039+0000 7f0f44316700 1 -- 172.21.15.46:0/2831992244 wait complete. 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.040+0000 7f0f44316700 1 Processor -- start 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.040+0000 7f0f44316700 1 -- start start 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159890 0x7f0f3c14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c15db10 0x7f0f3c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b39a0 con 0x7f0f3c159c60 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0ce340 con 0x7f0f3c15db10 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f44316700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b5d90 con 0x7f0f3c159890 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38186/0 (socket says 172.21.15.46:38186) 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 -- 172.21.15.46:0/3537711571 learned_addr learned my addr 172.21.15.46:0/3537711571 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 -- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159890 msgr2=0x7f0f3c14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f420b2700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159890 0x7f0f3c14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159890 0x7f0f3c14c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f428b3700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c15db10 0x7f0f3c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 -- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c15db10 msgr2=0x7f0f3c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c15db10 0x7f0f3c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 -- 172.21.15.46:0/3537711571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009420 con 0x7f0f3c159c60 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.041+0000 7f0f418b1700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000d860 tx=0x7f0f30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300125f0 con 0x7f0f3c159c60 2023-10-07T09:07:35.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30012750 con 0x7f0f3c159c60 2023-10-07T09:07:35.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0b6070 con 0x7f0f3c159c60 2023-10-07T09:07:35.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30012ad0 con 0x7f0f3c159c60 2023-10-07T09:07:35.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c0b3630 con 0x7f0f3c159c60 2023-10-07T09:07:35.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.042+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c0b3b50 con 0x7f0f3c159c60 2023-10-07T09:07:35.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.043+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f3001e460 con 0x7f0f3c159c60 2023-10-07T09:07:35.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.043+0000 7f0f3a7fc700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.043+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f0f30085400 con 0x7f0f3c159c60 2023-10-07T09:07:35.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.044+0000 7f0f420b2700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.044+0000 7f0f420b2700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 0x7f0f280697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c003080 tx=0x7f0f2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.048+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f3c0b3b50 con 0x7f0f3c159c60 2023-10-07T09:07:35.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.240+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001034129.meta", "var": "pg_num"} v 0) v1 -- 0x7f0f3c04c3c0 con 0x7f0f3c159c60 2023-10-07T09:07:35.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.240+0000 7f0f3a7fc700 1 -- 172.21.15.46:0/3537711571 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001034129.meta", "var": "pg_num"}]=0 v187) v1 ==== 124+0+11 (secure 0 0 0) 0x7f0f300557c0 con 0x7f0f3c159c60 2023-10-07T09:07:35.243 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:07:35.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 msgr2=0x7f0f280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 0x7f0f280697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c003080 tx=0x7f0f2c017000 comp rx=0 tx=0).stop 2023-10-07T09:07:35.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 msgr2=0x7f0f3c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000d860 tx=0x7f0f30008040 comp rx=0 tx=0).stop 2023-10-07T09:07:35.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 shutdown_connections 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c15db10 0x7f0f3c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3c159890 0x7f0f3c14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 --2- 172.21.15.46:0/3537711571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f3c159c60 0x7f0f3c14f300 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 >> 172.21.15.46:0/3537711571 conn(0x7f0f3c068e20 msgr2=0x7f0f3c0b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 shutdown_connections 2023-10-07T09:07:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.242+0000 7f0f44316700 1 -- 172.21.15.46:0/3537711571 wait complete. 2023-10-07T09:07:35.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001034129.data pg_num 2023-10-07T09:07:35.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.376+0000 7f8220f90700 1 Processor -- start 2023-10-07T09:07:35.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.376+0000 7f8220f90700 1 -- start start 2023-10-07T09:07:35.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f8220f90700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 0x7f821c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f8220f90700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0cfb00 con 0x7f821c0b4e70 2023-10-07T09:07:35.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f8220f90700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0b5c40 con 0x7f821c0b16d0 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f8220f90700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0b5f20 con 0x7f821c0b1b40 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f821b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f821c0b4e70 0x7f821c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60084/0 (socket says 172.21.15.46:60084) 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f821b7fe700 1 -- 172.21.15.46:0/285955235 learned_addr learned my addr 172.21.15.46:0/285955235 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.377+0000 7f821bfff700 1 --2- 172.21.15.46:0/285955235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 0x7f821c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817420367 0 0) 0x7f821c0cfb00 con 0x7f821c0b4e70 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8204003570 con 0x7f821c0b4e70 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831050115 0 0) 0x7f821c0b5c40 con 0x7f821c0b16d0 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f821c0cfb00 con 0x7f821c0b16d0 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821bfff700 1 -- 172.21.15.46:0/285955235 >> v1:172.21.15.133:6789/0 conn(0x7f821c0b16d0 legacy=0x7f821c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821bfff700 1 -- 172.21.15.46:0/285955235 >> v1:172.21.15.46:6789/0 conn(0x7f821c0b4e70 legacy=0x7f821c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821bfff700 1 -- 172.21.15.46:0/285955235 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0b6200 con 0x7f821c0b1b40 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821bfff700 1 --2- 172.21.15.46:0/285955235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 0x7f821c0b3ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e90 tx=0x7f8214009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843c9e4dbe89be16 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400e070 con 0x7f821c0b1b40 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400bb80 con 0x7f821c0b1b40 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.378+0000 7f821a7fc700 1 -- 172.21.15.46:0/285955235 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214012430 con 0x7f821c0b1b40 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 -- 172.21.15.46:0/285955235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 msgr2=0x7f821c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 --2- 172.21.15.46:0/285955235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 0x7f821c0b3ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e90 tx=0x7f8214009780 comp rx=0 tx=0).stop 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 -- 172.21.15.46:0/285955235 shutdown_connections 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 --2- 172.21.15.46:0/285955235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b1b40 0x7f821c0b3ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 -- 172.21.15.46:0/285955235 >> 172.21.15.46:0/285955235 conn(0x7f821c0d10c0 msgr2=0x7f821c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 -- 172.21.15.46:0/285955235 shutdown_connections 2023-10-07T09:07:35.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.379+0000 7f8220f90700 1 -- 172.21.15.46:0/285955235 wait complete. 2023-10-07T09:07:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.380+0000 7f8220f90700 1 Processor -- start 2023-10-07T09:07:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.380+0000 7f8220f90700 1 -- start start 2023-10-07T09:07:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0b1b40 0x7f821c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b4e70 0x7f821c0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ca500 con 0x7f821c0b16d0 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c8060 con 0x7f821c0b1b40 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c157dc0 con 0x7f821c0b4e70 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38202/0 (socket says 172.21.15.46:38202) 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 -- 172.21.15.46:0/4122048096 learned_addr learned my addr 172.21.15.46:0/4122048096 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821bfff700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b4e70 0x7f821c0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821affd700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0b1b40 0x7f821c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 -- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b4e70 msgr2=0x7f821c0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b4e70 0x7f821c0c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 -- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0b1b40 msgr2=0x7f821c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0b1b40 0x7f821c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 -- 172.21.15.46:0/4122048096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009a20 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f821b7fe700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c790 tx=0x7f820c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c005b30 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c005c90 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0c7420 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.381+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c007300 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.382+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c7cf0 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.383+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c088990 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.383+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f820c01b400 con 0x7f821c0b16d0 2023-10-07T09:07:35.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.383+0000 7f82037fe700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 0x7f82080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.383+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f820c0847e0 con 0x7f821c0b16d0 2023-10-07T09:07:35.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.384+0000 7f821affd700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 0x7f82080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.384+0000 7f821affd700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 0x7f82080697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f821c069690 tx=0x7f8210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.388+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f820c051480 con 0x7f821c0b16d0 2023-10-07T09:07:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.580+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001034129.data", "var": "pg_num"} v 0) v1 -- 0x7f821c04bb80 con 0x7f821c0b16d0 2023-10-07T09:07:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.580+0000 7f82037fe700 1 -- 172.21.15.46:0/4122048096 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001034129.data", "var": "pg_num"}]=0 v187) v1 ==== 124+0+11 (secure 0 0 0) 0x7f820c054aa0 con 0x7f821c0b16d0 2023-10-07T09:07:35.581 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:07:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 msgr2=0x7f82080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 0x7f82080697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f821c069690 tx=0x7f8210009040 comp rx=0 tx=0).stop 2023-10-07T09:07:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 msgr2=0x7f821c157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c790 tx=0x7f820c007ea0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 shutdown_connections 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8208067320 0x7f82080697d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f821c0b4e70 0x7f821c0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c0b16d0 0x7f821c157fa0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 --2- 172.21.15.46:0/4122048096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0b1b40 0x7f821c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 >> 172.21.15.46:0/4122048096 conn(0x7f821c0d10c0 msgr2=0x7f821c159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 shutdown_connections 2023-10-07T09:07:35.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.582+0000 7f8220f90700 1 -- 172.21.15.46:0/4122048096 wait complete. 2023-10-07T09:07:35.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:35.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.714+0000 7fa7b6d9c700 1 Processor -- start 2023-10-07T09:07:35.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.714+0000 7fa7b6d9c700 1 -- start start 2023-10-07T09:07:35.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 0x7fa7b0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7b006c0a0 0x7fa7b0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b015c2a0 con 0x7fa7b006c0a0 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b015b690 con 0x7fa7b006bcd0 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7b6d9c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b015b970 con 0x7fa7b00c8e00 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.715+0000 7fa7affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7b006c0a0 0x7fa7b0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7b006c0a0 0x7fa7b0141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38216/0 (socket says 172.21.15.46:38216) 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 -- 172.21.15.46:0/2246911461 learned_addr learned my addr 172.21.15.46:0/2246911461 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7b5339700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7b4b38700 1 --2- 172.21.15.46:0/2246911461 >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 0x7fa7b0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 -- 172.21.15.46:0/2246911461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 msgr2=0x7fa7b00c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 -- 172.21.15.46:0/2246911461 >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 msgr2=0x7fa7b0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 --2- 172.21.15.46:0/2246911461 >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 0x7fa7b0140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 -- 172.21.15.46:0/2246911461 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b015bc50 con 0x7fa7b006c0a0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7b4b38700 1 --2- 172.21.15.46:0/2246911461 >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 0x7fa7b0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7affff700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006c0a0 0x7fa7b0141330 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00cafd0 tx=0x7fa7a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bb14538f7c492e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7af7fe700 1 -- 172.21.15.46:0/2246911461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000e070 con 0x7fa7b006c0a0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7af7fe700 1 -- 172.21.15.46:0/2246911461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000ba20 con 0x7fa7b006c0a0 2023-10-07T09:07:35.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.716+0000 7fa7af7fe700 1 -- 172.21.15.46:0/2246911461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00092e0 con 0x7fa7b006c0a0 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2246911461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006c0a0 msgr2=0x7fa7b0141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006c0a0 0x7fa7b0141330 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00cafd0 tx=0x7fa7a0009840 comp rx=0 tx=0).stop 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2246911461 shutdown_connections 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2246911461 >> v2:172.21.15.133:3300/0 conn(0x7fa7b006bcd0 0x7fa7b0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2246911461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006c0a0 0x7fa7b0141330 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2246911461 >> 172.21.15.46:0/2246911461 conn(0x7fa7b00ce600 msgr2=0x7fa7b00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2246911461 shutdown_connections 2023-10-07T09:07:35.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.717+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2246911461 wait complete. 2023-10-07T09:07:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.718+0000 7fa7b6d9c700 1 Processor -- start 2023-10-07T09:07:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.718+0000 7fa7b6d9c700 1 -- start start 2023-10-07T09:07:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 0x7fa7b00c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0157d40 con 0x7fa7b006bcd0 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0158020 con 0x7fa7b006c0a0 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b6d9c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0158300 con 0x7fa7b00c8e00 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38222/0 (socket says 172.21.15.46:38222) 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 -- 172.21.15.46:0/2359092398 learned_addr learned my addr 172.21.15.46:0/2359092398 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7affff700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 0x7fa7b00c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b5339700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 -- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 msgr2=0x7fa7b00c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 -- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 msgr2=0x7fa7b00c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 0x7fa7b00c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 -- 172.21.15.46:0/2359092398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009ae0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7affff700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 0x7fa7b00c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7b4b38700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e8d0 tx=0x7fa7a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.719+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800ee70 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.720+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a800c5e0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.720+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b01585e0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.720+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800c980 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.720+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b00b00e0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.720+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b00b1720 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.721+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7a8013410 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.721+0000 7fa7acff9700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 0x7fa7900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.721+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fa7a8084ce0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.721+0000 7fa7affff700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 0x7fa7900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.722+0000 7fa7affff700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 0x7fa7900697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009880 tx=0x7fa7a0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.725+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a80517d0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.961+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7b004c3c0 con 0x7fa7b006bcd0 2023-10-07T09:07:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.961+0000 7fa7acff9700 1 -- 172.21.15.46:0/2359092398 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fa7a8020090 con 0x7fa7b006bcd0 2023-10-07T09:07:35.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:29.608279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000001034129","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 msgr2=0x7fa7900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 0x7fa7900697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009880 tx=0x7fa7a0018000 comp rx=0 tx=0).stop 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 msgr2=0x7fa7b0157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e8d0 tx=0x7fa7a8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 shutdown_connections 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa790067320 0x7fa7900697d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7b00c8e00 0x7fa7b00c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7b006bcd0 0x7fa7b0157510 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 --2- 172.21.15.46:0/2359092398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7b006c0a0 0x7fa7b00c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 >> 172.21.15.46:0/2359092398 conn(0x7fa7b00ce600 msgr2=0x7fa7b00cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 shutdown_connections 2023-10-07T09:07:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:35.964+0000 7fa7b6d9c700 1 -- 172.21.15.46:0/2359092398 wait complete. 2023-10-07T09:07:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 126 2023-10-07T09:07:35.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.095+0000 7fdacb352700 1 Processor -- start 2023-10-07T09:07:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.095+0000 7fdacb352700 1 -- start start 2023-10-07T09:07:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacb352700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 0x7fdac40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacb352700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdac415d230 0x7fdac415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacb352700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac415dbd0 con 0x7fdac4159420 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacb352700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40b11d0 con 0x7fdac415d230 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacb352700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40b14b0 con 0x7fdac41597f0 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdaca350700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdac4159420 0x7fdac40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60098/0 (socket says 172.21.15.46:60098) 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdaca350700 1 -- 172.21.15.46:0/1428085990 learned_addr learned my addr 172.21.15.46:0/1428085990 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdacab51700 1 --2- 172.21.15.46:0/1428085990 >> v2:172.21.15.133:3300/0 conn(0x7fdac415d230 0x7fdac415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdac9b4f700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 0x7fdac40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdac934e700 1 -- 172.21.15.46:0/1428085990 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398006082 0 0) 0x7fdabc001110 con 0x7fdac4159420 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.096+0000 7fdac934e700 1 -- 172.21.15.46:0/1428085990 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac003570 con 0x7fdac4159420 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdacab51700 1 -- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 msgr2=0x7fdac40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdacab51700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 0x7fdac40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdacab51700 1 -- 172.21.15.46:0/1428085990 >> v1:172.21.15.46:6789/0 conn(0x7fdac4159420 legacy=0x7fdac40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdacab51700 1 -- 172.21.15.46:0/1428085990 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40b1790 con 0x7fdac415d230 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdac9b4f700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 0x7fdac40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdacab51700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac415d230 0x7fdac415d690 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009e60 tx=0x7fdab4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875a8f5ff78de822 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdac934e700 1 -- 172.21.15.46:0/1428085990 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400e070 con 0x7fdac415d230 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdac934e700 1 -- 172.21.15.46:0/1428085990 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400bab0 con 0x7fdac415d230 2023-10-07T09:07:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.097+0000 7fdac934e700 1 -- 172.21.15.46:0/1428085990 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400be30 con 0x7fdac415d230 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 -- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac415d230 msgr2=0x7fdac415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac415d230 0x7fdac415d690 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009e60 tx=0x7fdab4009780 comp rx=0 tx=0).stop 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 -- 172.21.15.46:0/1428085990 shutdown_connections 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac415d230 0x7fdac415d690 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 --2- 172.21.15.46:0/1428085990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac41597f0 0x7fdac40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 -- 172.21.15.46:0/1428085990 >> 172.21.15.46:0/1428085990 conn(0x7fdac40d0660 msgr2=0x7fdac40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 -- 172.21.15.46:0/1428085990 shutdown_connections 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.098+0000 7fdacb352700 1 -- 172.21.15.46:0/1428085990 wait complete. 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 Processor -- start 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 -- start start 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac4159420 0x7fdac415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac415d230 0x7fdac4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415cf10 con 0x7fdac41597f0 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415c300 con 0x7fdac4159420 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.099+0000 7fdacb352700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415c5e0 con 0x7fdac415d230 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38236/0 (socket says 172.21.15.46:38236) 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 -- 172.21.15.46:0/1318100219 learned_addr learned my addr 172.21.15.46:0/1318100219 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdaca350700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac4159420 0x7fdac415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdacab51700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac415d230 0x7fdac4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 -- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac415d230 msgr2=0x7fdac4154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac415d230 0x7fdac4154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 -- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac4159420 msgr2=0x7fdac415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac4159420 0x7fdac415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 -- 172.21.15.46:0/1318100219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009420 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac9b4f700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fdab800ec80 tx=0x7fdab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800c920 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800ca80 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab4009a20 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800ce00 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.100+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac415c970 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.101+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac404c3c0 con 0x7fdac41597f0 2023-10-07T09:07:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.102+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdab8013680 con 0x7fdac41597f0 2023-10-07T09:07:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.102+0000 7fdac27fc700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 0x7fdab0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.102+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fdab80850b0 con 0x7fdac41597f0 2023-10-07T09:07:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.102+0000 7fdaca350700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 0x7fdab0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.103+0000 7fdaca350700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 0x7fdab0069800 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001270 tx=0x7fdabc000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.106+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdab8051cb0 con 0x7fdac41597f0 2023-10-07T09:07:36.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.301+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdac40b1a70 con 0x7fdac41597f0 2023-10-07T09:07:36.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.302+0000 7fdac27fc700 1 -- 172.21.15.46:0/1318100219 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+15539 (secure 0 0 0) 0x7fdab80552d0 con 0x7fdac41597f0 2023-10-07T09:07:36.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:36.303 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":187,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:31.621593+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000001034129.meta","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001034129"}}},{"pool":32,"pool_name":"cephfs.volume_0000000001034129.data","create_time":"2023-10-07T09:07:16.921910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000001034129"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.16","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:36.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 msgr2=0x7fdab0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 0x7fdab0069800 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001270 tx=0x7fdabc000bc0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 msgr2=0x7fdac40b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fdab800ec80 tx=0x7fdab80091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 shutdown_connections 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab0067350 0x7fdab0069800 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdac415d230 0x7fdac4154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac4159420 0x7fdac415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 --2- 172.21.15.46:0/1318100219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac41597f0 0x7fdac40b5070 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 >> 172.21.15.46:0/1318100219 conn(0x7fdac40d0660 msgr2=0x7fdac4156290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:36.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 shutdown_connections 2023-10-07T09:07:36.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.304+0000 7fdacb352700 1 -- 172.21.15.46:0/1318100219 wait complete. 2023-10-07T09:07:36.317 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001034129 and related pools 2023-10-07T09:07:36.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.435+0000 7ff3daffd700 1 Processor -- start 2023-10-07T09:07:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.435+0000 7ff3daffd700 1 -- start start 2023-10-07T09:07:36.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3daffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d4159840 0x7ff3d40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 0x7ff3d40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3daffd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40cfb30 con 0x7ff3d4159c10 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3daffd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d40cbf10 con 0x7ff3d4159840 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3daffd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40cf4e0 con 0x7ff3d40cba70 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3d8d99700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d4159840 0x7ff3d40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3d3fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 0x7ff3d40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3d8d99700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d4159840 0x7ff3d40cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:60548/0 (socket says 172.21.15.46:60548) 2023-10-07T09:07:36.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3d8d99700 1 -- 172.21.15.46:0/3462488480 learned_addr learned my addr 172.21.15.46:0/3462488480 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:36.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.436+0000 7ff3d959a700 1 --1- 172.21.15.46:0/3462488480 >> v1:172.21.15.133:6789/0 conn(0x7ff3d4159c10 0x7ff3d40ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:43732/0 (socket says 172.21.15.46:43732) 2023-10-07T09:07:36.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d8d99700 1 -- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 msgr2=0x7ff3d40694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:36.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d8d99700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 0x7ff3d40694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d8d99700 1 -- 172.21.15.46:0/3462488480 >> v1:172.21.15.133:6789/0 conn(0x7ff3d4159c10 legacy=0x7ff3d40ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d8d99700 1 -- 172.21.15.46:0/3462488480 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40cf7c0 con 0x7ff3d4159840 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d3fff700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 0x7ff3d40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d8d99700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40cb530 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0099b0 tx=0x7ff3cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=272612d94ca7292e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d37fe700 1 -- 172.21.15.46:0/3462488480 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc009ea0 con 0x7ff3d4159840 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d37fe700 1 -- 172.21.15.46:0/3462488480 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00b860 con 0x7ff3d4159840 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.437+0000 7ff3d37fe700 1 -- 172.21.15.46:0/3462488480 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00bc20 con 0x7ff3d4159840 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 -- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 msgr2=0x7ff3d40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40cb530 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0099b0 tx=0x7ff3cc009250 comp rx=0 tx=0).stop 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 -- 172.21.15.46:0/3462488480 shutdown_connections 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40cb530 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 --2- 172.21.15.46:0/3462488480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d40cba70 0x7ff3d40694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 -- 172.21.15.46:0/3462488480 >> 172.21.15.46:0/3462488480 conn(0x7ff3d4068e10 msgr2=0x7ff3d40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 -- 172.21.15.46:0/3462488480 shutdown_connections 2023-10-07T09:07:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.438+0000 7ff3daffd700 1 -- 172.21.15.46:0/3462488480 wait complete. 2023-10-07T09:07:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.439+0000 7ff3daffd700 1 Processor -- start 2023-10-07T09:07:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.439+0000 7ff3daffd700 1 -- start start 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159c10 0x7ff3d40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4169980 con 0x7ff3d40cba70 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b63d0 con 0x7ff3d4159840 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3daffd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d416a4a0 con 0x7ff3d4159c10 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38252/0 (socket says 172.21.15.46:38252) 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 -- 172.21.15.46:0/510571992 learned_addr learned my addr 172.21.15.46:0/510571992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d959a700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159c10 0x7ff3d40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d3fff700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 -- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159c10 msgr2=0x7ff3d40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159c10 0x7ff3d40b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 -- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 msgr2=0x7ff3d40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 -- 172.21.15.46:0/510571992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009a20 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.440+0000 7ff3d8d99700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc006fd0 tx=0x7ff3cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.441+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc01f070 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.441+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc000c90 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.441+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc025420 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.441+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc0094f0 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.441+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d4169b70 con 0x7ff3d40cba70 2023-10-07T09:07:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.442+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4064550 con 0x7ff3d40cba70 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.442+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff3cc023070 con 0x7ff3d40cba70 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.442+0000 7ff3d0ff9700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 0x7ff3b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.443+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7ff3cc0861a0 con 0x7ff3d40cba70 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.443+0000 7ff3d3fff700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 0x7ff3b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.443+0000 7ff3d3fff700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 0x7ff3b40697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40099f0 tx=0x7ff3c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.447+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3cc052da0 con 0x7ff3d40cba70 2023-10-07T09:07:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.682+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3d404c3c0 con 0x7ff3d40cba70 2023-10-07T09:07:36.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.682+0000 7ff3d0ff9700 1 -- 172.21.15.46:0/510571992 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4627 (secure 0 0 0) 0x7ff3cc009300 con 0x7ff3d40cba70 2023-10-07T09:07:36.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:36.683 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:29.608279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000001034129","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:36.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 msgr2=0x7ff3b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 0x7ff3b40697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40099f0 tx=0x7ff3c400b040 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 msgr2=0x7ff3d4153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc006fd0 tx=0x7ff3cc017000 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 shutdown_connections 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3b4067320 0x7ff3b40697d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159c10 0x7ff3d40b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3d40cba70 0x7ff3d4153810 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 --2- 172.21.15.46:0/510571992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d4159840 0x7ff3d40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 >> 172.21.15.46:0/510571992 conn(0x7ff3d4068e10 msgr2=0x7ff3d40c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 shutdown_connections 2023-10-07T09:07:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.685+0000 7ff3daffd700 1 -- 172.21.15.46:0/510571992 wait complete. 2023-10-07T09:07:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 126 2023-10-07T09:07:36.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.817+0000 7fedfe13f700 1 Processor -- start 2023-10-07T09:07:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.817+0000 7fedfe13f700 1 -- start start 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedf81593b0 0x7fedf8159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf80ceaa0 0x7fedf80b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedf80b1740 0x7fedf80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80b2100 con 0x7fedf81593b0 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80b6570 con 0x7fedf80b1740 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfe13f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80cfe20 con 0x7fedf80ceaa0 2023-10-07T09:07:36.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedf81593b0 0x7fedf8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedf81593b0 0x7fedf8159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38254/0 (socket says 172.21.15.46:38254) 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 -- 172.21.15.46:0/3314647121 learned_addr learned my addr 172.21.15.46:0/3314647121 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfc93c700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf80ceaa0 0x7fedf80b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd93e700 1 --2- 172.21.15.46:0/3314647121 >> v2:172.21.15.133:3300/0 conn(0x7fedf80b1740 0x7fedf80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 -- 172.21.15.46:0/3314647121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf80ceaa0 msgr2=0x7fedf80b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf80ceaa0 0x7fedf80b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 -- 172.21.15.46:0/3314647121 >> v2:172.21.15.133:3300/0 conn(0x7fedf80b1740 msgr2=0x7fedf80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3314647121 >> v2:172.21.15.133:3300/0 conn(0x7fedf80b1740 0x7fedf80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 -- 172.21.15.46:0/3314647121 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80cf210 con 0x7fedf81593b0 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.818+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf81593b0 0x7fedf8159780 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fedf80b24b0 tx=0x7fedf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4eb7c3d6ccc61f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedeffff700 1 -- 172.21.15.46:0/3314647121 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400b860 con 0x7fedf81593b0 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedeffff700 1 -- 172.21.15.46:0/3314647121 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400b9c0 con 0x7fedf81593b0 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedeffff700 1 -- 172.21.15.46:0/3314647121 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400bd60 con 0x7fedf81593b0 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 -- 172.21.15.46:0/3314647121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf81593b0 msgr2=0x7fedf8159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf81593b0 0x7fedf8159780 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fedf80b24b0 tx=0x7fedf4009250 comp rx=0 tx=0).stop 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 -- 172.21.15.46:0/3314647121 shutdown_connections 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3314647121 >> v2:172.21.15.133:3300/0 conn(0x7fedf80b1740 0x7fedf80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf81593b0 0x7fedf8159780 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3314647121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf80ceaa0 0x7fedf80b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 -- 172.21.15.46:0/3314647121 >> 172.21.15.46:0/3314647121 conn(0x7fedf80d1130 msgr2=0x7fedf80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 -- 172.21.15.46:0/3314647121 shutdown_connections 2023-10-07T09:07:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.819+0000 7fedfe13f700 1 -- 172.21.15.46:0/3314647121 wait complete. 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.820+0000 7fedfe13f700 1 Processor -- start 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.820+0000 7fedfe13f700 1 -- start start 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf80b1740 0x7fedf8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf81593b0 0x7fedf80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80cb870 con 0x7fedf80ceaa0 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80ca7d0 con 0x7fedf80b1740 2023-10-07T09:07:36.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfe13f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80caab0 con 0x7fedf81593b0 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfc93c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfc93c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38270/0 (socket says 172.21.15.46:38270) 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfc93c700 1 -- 172.21.15.46:0/3776952200 learned_addr learned my addr 172.21.15.46:0/3776952200 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf80b1740 0x7fedf8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.821+0000 7fedfd93e700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf81593b0 0x7fedf80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 -- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf81593b0 msgr2=0x7fedf80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf81593b0 0x7fedf80c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 -- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf80b1740 msgr2=0x7fedf8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf80b1740 0x7fedf8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 -- 172.21.15.46:0/3776952200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40094f0 con 0x7fedf80ceaa0 2023-10-07T09:07:36.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfc93c700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fede800d890 tx=0x7fede8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80125f0 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8012750 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf80cad90 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8012af0 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.822+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf80cb350 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.823+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf804c3c0 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.823+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fede801e460 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.824+0000 7feded7fa700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 0x7feddc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.824+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fede80852b0 con 0x7fedf80ceaa0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.824+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 0x7feddc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.824+0000 7fedfd13d700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 0x7feddc0697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fedf80b24b0 tx=0x7fedf4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:36.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:36.828+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fede8051e70 con 0x7fedf80ceaa0 2023-10-07T09:07:37.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.065+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf80cf4f0 con 0x7fedf80ceaa0 2023-10-07T09:07:37.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.065+0000 7feded7fa700 1 -- 172.21.15.46:0/3776952200 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fede8055490 con 0x7fedf80ceaa0 2023-10-07T09:07:37.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:37.066 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":126,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:17.957309+0000","modified":"2023-10-07T09:07:29.608279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8655":{"gid":8655,"name":"a","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6834/1456001101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1456001101},{"type":"v1","addr":"172.21.15.46:6834","nonce":1456001101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000001034129","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-07T09:07:37.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 msgr2=0x7feddc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 0x7feddc0697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fedf80b24b0 tx=0x7fedf4017000 comp rx=0 tx=0).stop 2023-10-07T09:07:37.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 msgr2=0x7fedf80c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fede800d890 tx=0x7fede8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 shutdown_connections 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7feddc067320 0x7feddc0697d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedf81593b0 0x7fedf80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf80b1740 0x7fedf8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 --2- 172.21.15.46:0/3776952200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf80ceaa0 0x7fedf80c9cc0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 >> 172.21.15.46:0/3776952200 conn(0x7fedf80d1130 msgr2=0x7fedf8068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 shutdown_connections 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.067+0000 7fedfe13f700 1 -- 172.21.15.46:0/3776952200 wait complete. 2023-10-07T09:07:37.069 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 126 2023-10-07T09:07:37.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 Processor -- start 2023-10-07T09:07:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 -- start start 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c159c60 0x7f317c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f317c15db10 0x7f317c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c15a160 con 0x7f317c159890 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c15df50 con 0x7f317c159c60 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.199+0000 7f3182cb7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0d13a0 con 0x7f317c15db10 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c159c60 0x7f317c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c159c60 0x7f317c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38284/0 (socket says 172.21.15.46:38284) 2023-10-07T09:07:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 -- 172.21.15.46:0/3661713932 learned_addr learned my addr 172.21.15.46:0/3661713932 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f3181254700 1 --2- 172.21.15.46:0/3661713932 >> v2:172.21.15.133:3300/0 conn(0x7f317c15db10 0x7f317c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 -- 172.21.15.46:0/3661713932 >> v2:172.21.15.133:3300/0 conn(0x7f317c15db10 msgr2=0x7f317c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 --2- 172.21.15.46:0/3661713932 >> v2:172.21.15.133:3300/0 conn(0x7f317c15db10 0x7f317c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 -- 172.21.15.46:0/3661713932 >> v1:172.21.15.133:6789/0 conn(0x7f317c159890 legacy=0x7f317c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 -- 172.21.15.46:0/3661713932 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c15e140 con 0x7f317c159c60 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317bfff700 1 --2- 172.21.15.46:0/3661713932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c15d5d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f317c06a890 tx=0x7f316c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e54d36acce8da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317b7fe700 1 -- 172.21.15.46:0/3661713932 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c009e70 con 0x7f317c159c60 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317b7fe700 1 -- 172.21.15.46:0/3661713932 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00b860 con 0x7f317c159c60 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.200+0000 7f317b7fe700 1 -- 172.21.15.46:0/3661713932 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00bc00 con 0x7f317c159c60 2023-10-07T09:07:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 -- 172.21.15.46:0/3661713932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 msgr2=0x7f317c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 --2- 172.21.15.46:0/3661713932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c15d5d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f317c06a890 tx=0x7f316c009250 comp rx=0 tx=0).stop 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 -- 172.21.15.46:0/3661713932 shutdown_connections 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 --2- 172.21.15.46:0/3661713932 >> v2:172.21.15.133:3300/0 conn(0x7f317c15db10 0x7f317c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 --2- 172.21.15.46:0/3661713932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c15d5d0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 -- 172.21.15.46:0/3661713932 >> 172.21.15.46:0/3661713932 conn(0x7f317c068e20 msgr2=0x7f317c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 -- 172.21.15.46:0/3661713932 shutdown_connections 2023-10-07T09:07:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.201+0000 7f3182cb7700 1 -- 172.21.15.46:0/3661713932 wait complete. 2023-10-07T09:07:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.202+0000 7f3182cb7700 1 Processor -- start 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.202+0000 7f3182cb7700 1 -- start start 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f317c159890 0x7f317c140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f317c15db10 0x7f317c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c141300 con 0x7f317c159c60 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0cd6d0 con 0x7f317c159890 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3182cb7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0cd9b0 con 0x7f317c15db10 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38296/0 (socket says 172.21.15.46:38296) 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 -- 172.21.15.46:0/612498501 learned_addr learned my addr 172.21.15.46:0/612498501 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3180a53700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f317c159890 0x7f317c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f3181254700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f317c15db10 0x7f317c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 -- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f317c15db10 msgr2=0x7f317c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f317c15db10 0x7f317c0b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 -- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f317c159890 msgr2=0x7f317c140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f317c159890 0x7f317c140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 -- 172.21.15.46:0/612498501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0094f0 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.203+0000 7f317bfff700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f317c070e20 tx=0x7f316c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.204+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00bbe0 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.204+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c011420 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.204+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c0cdc90 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.204+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0117c0 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.204+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c0ce250 con 0x7f317c159c60 2023-10-07T09:07:37.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.205+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c0ce440 con 0x7f317c159c60 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.205+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f316c011bf0 con 0x7f317c159c60 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.205+0000 7f3178ff9700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 0x7f315c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.206+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f316c086560 con 0x7f317c159c60 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.206+0000 7f3180a53700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 0x7f315c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.206+0000 7f3180a53700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 0x7f315c0697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3174007fd0 tx=0x7f31740016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.210+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f316c053160 con 0x7f317c159c60 2023-10-07T09:07:37.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.403+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f317c04c3c0 con 0x7f317c159c60 2023-10-07T09:07:37.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.404+0000 7f3178ff9700 1 -- 172.21.15.46:0/612498501 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+15539 (secure 0 0 0) 0x7f316c056780 con 0x7f317c159c60 2023-10-07T09:07:37.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:37.405 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":187,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:31.621593+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000001034129.meta","create_time":"2023-10-07T09:07:16.361103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001034129"}}},{"pool":32,"pool_name":"cephfs.volume_0000000001034129.data","create_time":"2023-10-07T09:07:16.921910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000001034129"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.16","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 msgr2=0x7f315c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 0x7f315c0697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3174007fd0 tx=0x7f31740016f0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 msgr2=0x7f317c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f317c070e20 tx=0x7f316c017000 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 shutdown_connections 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f315c067320 0x7f315c0697d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f317c15db10 0x7f317c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f317c159890 0x7f317c140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 --2- 172.21.15.46:0/612498501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c159c60 0x7f317c0b3590 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 >> 172.21.15.46:0/612498501 conn(0x7f317c068e20 msgr2=0x7f317c157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 shutdown_connections 2023-10-07T09:07:37.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.406+0000 7f3182cb7700 1 -- 172.21.15.46:0/612498501 wait complete. 2023-10-07T09:07:37.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001034129 2023-10-07T09:07:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.541+0000 7faccdc1d700 1 Processor -- start 2023-10-07T09:07:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.541+0000 7faccdc1d700 1 -- start start 2023-10-07T09:07:37.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccdc1d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7facc80cc3c0 0x7facc806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccdc1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc806bf20 0x7facc80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccdc1d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80b16a0 con 0x7facc81574d0 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccdc1d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80cd980 con 0x7facc80cc3c0 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccdc1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b1c60 con 0x7facc806bf20 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facccc1b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7facc81574d0 0x7facc80cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60100/0 (socket says 172.21.15.46:60100) 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facccc1b700 1 -- 172.21.15.46:0/65415536 learned_addr learned my addr 172.21.15.46:0/65415536 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc7fff700 1 --2- 172.21.15.46:0/65415536 >> v2:172.21.15.46:3300/0 conn(0x7facc80cc3c0 0x7facc806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7faccd41c700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc806bf20 0x7facc80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc77fe700 1 -- 172.21.15.46:0/65415536 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221984476 0 0) 0x7facc80b16a0 con 0x7facc81574d0 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc77fe700 1 -- 172.21.15.46:0/65415536 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb0003570 con 0x7facc81574d0 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc7fff700 1 -- 172.21.15.46:0/65415536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc806bf20 msgr2=0x7facc80b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc7fff700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc806bf20 0x7facc80b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc7fff700 1 -- 172.21.15.46:0/65415536 >> v1:172.21.15.46:6789/0 conn(0x7facc81574d0 legacy=0x7facc80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.542+0000 7facc7fff700 1 -- 172.21.15.46:0/65415536 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc806c360 con 0x7facc80cc3c0 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7facc7fff700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc80cc3c0 0x7facc806b9e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098e0 tx=0x7facbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3cd712c1a8b856 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7facc77fe700 1 -- 172.21.15.46:0/65415536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00b640 con 0x7facc80cc3c0 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7facc77fe700 1 -- 172.21.15.46:0/65415536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00b7a0 con 0x7facc80cc3c0 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7facc77fe700 1 -- 172.21.15.46:0/65415536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00bb40 con 0x7facc80cc3c0 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 -- 172.21.15.46:0/65415536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc80cc3c0 msgr2=0x7facc806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc80cc3c0 0x7facc806b9e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098e0 tx=0x7facbc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 -- 172.21.15.46:0/65415536 shutdown_connections 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc806bf20 0x7facc80b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 --2- 172.21.15.46:0/65415536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc80cc3c0 0x7facc806b9e0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 -- 172.21.15.46:0/65415536 >> 172.21.15.46:0/65415536 conn(0x7facc80ce430 msgr2=0x7facc80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 -- 172.21.15.46:0/65415536 shutdown_connections 2023-10-07T09:07:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.543+0000 7faccdc1d700 1 -- 172.21.15.46:0/65415536 wait complete. 2023-10-07T09:07:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.544+0000 7faccdc1d700 1 Processor -- start 2023-10-07T09:07:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 -- start start 2023-10-07T09:07:37.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 0x7facc814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc80cc3c0 0x7facc815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80c81f0 con 0x7facc81574d0 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80c75e0 con 0x7facc806bf20 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccdc1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80c78c0 con 0x7facc80cc3c0 2023-10-07T09:07:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.545+0000 7faccd41c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38310/0 (socket says 172.21.15.46:38310) 2023-10-07T09:07:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 -- 172.21.15.46:0/715051089 learned_addr learned my addr 172.21.15.46:0/715051089 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facccc1b700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 0x7facc814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facc7fff700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc80cc3c0 0x7facc815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 -- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc80cc3c0 msgr2=0x7facc815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc80cc3c0 0x7facc815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 -- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 msgr2=0x7facc814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 0x7facc814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 -- 172.21.15.46:0/715051089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009420 con 0x7facc81574d0 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facccc1b700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 0x7facc814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccd41c700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7facb800d890 tx=0x7facb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb80125f0 con 0x7facc81574d0 2023-10-07T09:07:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8012770 con 0x7facc81574d0 2023-10-07T09:07:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc80c7ba0 con 0x7facc81574d0 2023-10-07T09:07:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8012b30 con 0x7facc81574d0 2023-10-07T09:07:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.546+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc806b0d0 con 0x7facc81574d0 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.547+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80c8040 con 0x7facc81574d0 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.548+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7facb801e460 con 0x7facc81574d0 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.548+0000 7facc4ff9700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 0x7facb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.548+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5841+0+0 (secure 0 0 0) 0x7facb8085460 con 0x7facc81574d0 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.548+0000 7facccc1b700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 0x7facb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.549+0000 7facccc1b700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 0x7facb40697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7facc00016e0 tx=0x7facc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.552+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facb8052060 con 0x7facc81574d0 2023-10-07T09:07:37.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.790+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001034129"} v 0) v1 -- 0x7facc804c3c0 con 0x7facc81574d0 2023-10-07T09:07:37.791 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:07:37.791+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:07:37.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.794+0000 7facc4ff9700 1 -- 172.21.15.46:0/715051089 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001034129"}]=0 volume_0000000001034129 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v127) v1 ==== 195+0+0 (secure 0 0 0) 0x7facb8055680 con 0x7facc81574d0 2023-10-07T09:07:37.796 INFO:tasks.ceph.mds.a.smithi046.stderr: -897> 2023-10-07T09:07:20.537+0000 7fce4f881700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 msgr2=0x7facb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 0x7facb40697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7facc00016e0 tx=0x7facc0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 msgr2=0x7facc815d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7facb800d890 tx=0x7facb8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 shutdown_connections 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7facb4067320 0x7facb40697d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facc81574d0 0x7facc815d100 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc806bf20 0x7facc814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 --2- 172.21.15.46:0/715051089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facc80cc3c0 0x7facc815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 >> 172.21.15.46:0/715051089 conn(0x7facc80ce430 msgr2=0x7facc80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 shutdown_connections 2023-10-07T09:07:37.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.799+0000 7faccdc1d700 1 -- 172.21.15.46:0/715051089 wait complete. 2023-10-07T09:07:37.801 INFO:teuthology.orchestra.run.smithi046.stderr:volume_0000000001034129 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:07:37.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001034129 --yes-i-really-mean-it 2023-10-07T09:07:37.818 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:07:37.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.934+0000 7f455fe5d700 1 Processor -- start 2023-10-07T09:07:37.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.934+0000 7f455fe5d700 1 -- start start 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455fe5d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4558159c60 0x7f455815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455fe5d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455815a160 con 0x7f4558159890 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455fe5d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45580d13a0 con 0x7f455815db10 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455fe5d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455815df50 con 0x7f4558159c60 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455d3f8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4558159c60 0x7f455815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455dbf9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4558159890 0x7f455815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60122/0 (socket says 172.21.15.46:60122) 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455dbf9700 1 -- 172.21.15.46:0/194671770 learned_addr learned my addr 172.21.15.46:0/194671770 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455d3f8700 1 -- 172.21.15.46:0/194671770 >> v1:172.21.15.133:6789/0 conn(0x7f455815db10 legacy=0x7f4558069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455d3f8700 1 -- 172.21.15.46:0/194671770 >> v1:172.21.15.46:6789/0 conn(0x7f4558159890 legacy=0x7f455815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455cbf7700 1 -- 172.21.15.46:0/194671770 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264055676 0 0) 0x7f455815a160 con 0x7f4558159890 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455d3f8700 1 -- 172.21.15.46:0/194671770 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455815e140 con 0x7f4558159c60 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455d3f8700 1 --2- 172.21.15.46:0/194671770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4558159c60 0x7f455815d5d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098e0 tx=0x7f454c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944dd23fb117ea2b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455cbf7700 1 -- 172.21.15.46:0/194671770 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c009e80 con 0x7f4558159c60 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455cbf7700 1 -- 172.21.15.46:0/194671770 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c00b860 con 0x7f4558159c60 2023-10-07T09:07:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.935+0000 7f455cbf7700 1 -- 172.21.15.46:0/194671770 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00bbe0 con 0x7f4558159c60 2023-10-07T09:07:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 -- 172.21.15.46:0/194671770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4558159c60 msgr2=0x7f455815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 --2- 172.21.15.46:0/194671770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4558159c60 0x7f455815d5d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098e0 tx=0x7f454c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 -- 172.21.15.46:0/194671770 shutdown_connections 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 --2- 172.21.15.46:0/194671770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4558159c60 0x7f455815d5d0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 -- 172.21.15.46:0/194671770 >> 172.21.15.46:0/194671770 conn(0x7f4558068e20 msgr2=0x7f45580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 -- 172.21.15.46:0/194671770 shutdown_connections 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.936+0000 7f455fe5d700 1 -- 172.21.15.46:0/194671770 wait complete. 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.937+0000 7f455fe5d700 1 Processor -- start 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.937+0000 7f455fe5d700 1 -- start start 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4558159890 0x7f45580b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 0x7f45580b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b2090 con 0x7f455815db10 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b64b0 con 0x7f4558159c60 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455fe5d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b1480 con 0x7f4558159890 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38346/0 (socket says 172.21.15.46:38346) 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 -- 172.21.15.46:0/2012351492 learned_addr learned my addr 172.21.15.46:0/2012351492 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455d3f8700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 0x7f45580b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455dbf9700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4558159890 0x7f45580b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 -- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4558159890 msgr2=0x7f45580b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4558159890 0x7f45580b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 -- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 msgr2=0x7f45580b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 0x7f45580b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 -- 172.21.15.46:0/2012351492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c009420 con 0x7f455815db10 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455d3f8700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 0x7f45580b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.938+0000 7f455e3fa700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f454800c840 tx=0x7f4548001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.939+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012630 con 0x7f455815db10 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.939+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45480127b0 con 0x7f455815db10 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.939+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45580b1760 con 0x7f455815db10 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.939+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012b70 con 0x7f455815db10 2023-10-07T09:07:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.939+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45580b1d20 con 0x7f455815db10 2023-10-07T09:07:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.940+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45580cd100 con 0x7f455815db10 2023-10-07T09:07:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.940+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4548003030 con 0x7f455815db10 2023-10-07T09:07:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.941+0000 7f4555ffb700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 0x7f45440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.941+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f4548084d50 con 0x7f455815db10 2023-10-07T09:07:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.941+0000 7f455dbf9700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 0x7f45440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.942+0000 7f455dbf9700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 0x7f45440697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f45500011e0 tx=0x7f4550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:37.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:37.945+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45580cd100 con 0x7f455815db10 2023-10-07T09:07:38.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.181+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001034129", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45580cd100 con 0x7f455815db10 2023-10-07T09:07:38.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.797+0000 7f4555ffb700 1 -- 172.21.15.46:0/2012351492 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001034129", "yes_i_really_mean_it": true}]=0 v128) v1 ==== 121+0+0 (secure 0 0 0) 0x7f45580cd100 con 0x7f455815db10 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 msgr2=0x7f45440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 0x7f45440697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f45500011e0 tx=0x7f4550009040 comp rx=0 tx=0).stop 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 msgr2=0x7f45580b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f454800c840 tx=0x7f4548001670 comp rx=0 tx=0).stop 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 shutdown_connections 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4544067320 0x7f45440697d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f455815db10 0x7f45580b3ad0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4558159890 0x7f45580b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 --2- 172.21.15.46:0/2012351492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4558159c60 0x7f45580b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 >> 172.21.15.46:0/2012351492 conn(0x7f4558068e20 msgr2=0x7f4558153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:38.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 shutdown_connections 2023-10-07T09:07:38.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.800+0000 7f455fe5d700 1 -- 172.21.15.46:0/2012351492 wait complete. 2023-10-07T09:07:38.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001034129.meta cephfs.volume_0000000001034129.meta --yes-i-really-really-mean-it 2023-10-07T09:07:38.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.987+0000 7faf6cdb1700 1 Processor -- start 2023-10-07T09:07:38.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.987+0000 7faf6cdb1700 1 -- start start 2023-10-07T09:07:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6cdb1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf681563b0 0x7faf68156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6cdb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf680acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6cdb1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6815a9b0 con 0x7faf68068890 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6cdb1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6815ac90 con 0x7faf681563b0 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6cdb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6815af70 con 0x7faf6815a440 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf6659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf681563b0 0x7faf68156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf66d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faf68068890 0x7faf680c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60134/0 (socket says 172.21.15.46:60134) 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf66d9d700 1 -- 172.21.15.46:0/2913279482 learned_addr learned my addr 172.21.15.46:0/2913279482 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.988+0000 7faf65d9b700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf680acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6659c700 1 -- 172.21.15.46:0/2913279482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 msgr2=0x7faf680acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6659c700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf680acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6659c700 1 -- 172.21.15.46:0/2913279482 >> v1:172.21.15.46:6789/0 conn(0x7faf68068890 legacy=0x7faf680c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6659c700 1 -- 172.21.15.46:0/2913279482 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6815b250 con 0x7faf681563b0 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6559a700 1 -- 172.21.15.46:0/2913279482 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595413965 0 0) 0x7faf6815a9b0 con 0x7faf68068890 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6659c700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf68156780 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7faf600098e0 tx=0x7faf600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8057d4a00ed437 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6559a700 1 -- 172.21.15.46:0/2913279482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60009e80 con 0x7faf681563b0 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6559a700 1 -- 172.21.15.46:0/2913279482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000b860 con 0x7faf681563b0 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6559a700 1 -- 172.21.15.46:0/2913279482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000bbe0 con 0x7faf681563b0 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6cdb1700 1 -- 172.21.15.46:0/2913279482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 msgr2=0x7faf68156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf68156780 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7faf600098e0 tx=0x7faf600091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6cdb1700 1 -- 172.21.15.46:0/2913279482 shutdown_connections 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf68156780 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.989+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/2913279482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf680acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.990+0000 7faf6cdb1700 1 -- 172.21.15.46:0/2913279482 >> 172.21.15.46:0/2913279482 conn(0x7faf680c8f90 msgr2=0x7faf680c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.990+0000 7faf6cdb1700 1 -- 172.21.15.46:0/2913279482 shutdown_connections 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.990+0000 7faf6cdb1700 1 -- 172.21.15.46:0/2913279482 wait complete. 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 Processor -- start 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 -- start start 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf68068890 0x7faf68168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf6814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680af690 con 0x7faf681563b0 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c1ef0 con 0x7faf68068890 2023-10-07T09:07:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf6cdb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf68169040 con 0x7faf6815a440 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.991+0000 7faf65d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38358/0 (socket says 172.21.15.46:38358) 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 -- 172.21.15.46:0/1183487589 learned_addr learned my addr 172.21.15.46:0/1183487589 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf6659c700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf68068890 0x7faf68168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf66d9d700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf6814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 -- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 msgr2=0x7faf6814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf6814cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 -- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf68068890 msgr2=0x7faf68168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf68068890 0x7faf68168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 -- 172.21.15.46:0/1183487589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009420 con 0x7faf681563b0 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf65d9b700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d890 tx=0x7faf50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500125f0 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50012750 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680c1600 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50012af0 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.992+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680c18a0 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.993+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680c20a0 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.994+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faf5001e460 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.994+0000 7faf5e7fc700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 0x7faf480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.994+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5927+0+0 (secure 0 0 0) 0x7faf500852c0 con 0x7faf681563b0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.994+0000 7faf6659c700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 0x7faf480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.995+0000 7faf6659c700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 0x7faf480697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7faf600091e0 tx=0x7faf60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:39.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:38.998+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf680c20a0 con 0x7faf681563b0 2023-10-07T09:07:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.190+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001034129.meta", "pool2": "cephfs.volume_0000000001034129.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf680c20a0 con 0x7faf681563b0 2023-10-07T09:07:39.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.802+0000 7faf5e7fc700 1 -- 172.21.15.46:0/1183487589 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001034129.meta", "pool2": "cephfs.volume_0000000001034129.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001034129.meta' removed v189) v1 ==== 241+0+0 (secure 0 0 0) 0x7faf680c20a0 con 0x7faf681563b0 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 msgr2=0x7faf480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 0x7faf480697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7faf600091e0 tx=0x7faf60017000 comp rx=0 tx=0).stop 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 msgr2=0x7faf680afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d890 tx=0x7faf50008040 comp rx=0 tx=0).stop 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 shutdown_connections 2023-10-07T09:07:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7faf48067320 0x7faf480697d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6815a440 0x7faf6814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf68068890 0x7faf68168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 --2- 172.21.15.46:0/1183487589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf681563b0 0x7faf680afa60 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 >> 172.21.15.46:0/1183487589 conn(0x7faf680c8f90 msgr2=0x7faf6814db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 shutdown_connections 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.806+0000 7faf6cdb1700 1 -- 172.21.15.46:0/1183487589 wait complete. 2023-10-07T09:07:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000001034129.meta' removed 2023-10-07T09:07:39.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001034129.data cephfs.volume_0000000001034129.data --yes-i-really-really-mean-it 2023-10-07T09:07:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.951+0000 7ff3e30cb700 1 Processor -- start 2023-10-07T09:07:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.951+0000 7ff3e30cb700 1 -- start start 2023-10-07T09:07:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e30cb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3dc0cd910 0x7ff3dc0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e30cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e30cb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0b5b00 con 0x7ff3dc159ec0 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e30cb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0b5da0 con 0x7ff3dc0cd910 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e30cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0b6080 con 0x7ff3dc0b55a0 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3dbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3dc0cd910 0x7ff3dc0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e0e67700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff3dc159ec0 0x7ff3dc0b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40936/0 (socket says 172.21.15.46:40936) 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e0e67700 1 -- 172.21.15.46:0/1929387993 learned_addr learned my addr 172.21.15.46:0/1929387993 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3e1668700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3dbfff700 1 -- 172.21.15.46:0/1929387993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 msgr2=0x7ff3dc0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3dbfff700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3dbfff700 1 -- 172.21.15.46:0/1929387993 >> v1:172.21.15.46:6789/0 conn(0x7ff3dc159ec0 legacy=0x7ff3dc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.952+0000 7ff3dbfff700 1 -- 172.21.15.46:0/1929387993 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0cc100 con 0x7ff3dc0cd910 2023-10-07T09:07:39.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3dbfff700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc0cd910 0x7ff3dc0ce340 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009910 tx=0x7ff3c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc70ec8a01b2707f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:39.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3db7fe700 1 -- 172.21.15.46:0/1929387993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800b640 con 0x7ff3dc0cd910 2023-10-07T09:07:39.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3db7fe700 1 -- 172.21.15.46:0/1929387993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800b7a0 con 0x7ff3dc0cd910 2023-10-07T09:07:39.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3db7fe700 1 -- 172.21.15.46:0/1929387993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800bb60 con 0x7ff3dc0cd910 2023-10-07T09:07:39.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 -- 172.21.15.46:0/1929387993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc0cd910 msgr2=0x7ff3dc0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc0cd910 0x7ff3dc0ce340 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009910 tx=0x7ff3c80091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 -- 172.21.15.46:0/1929387993 shutdown_connections 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/1929387993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc0cd910 0x7ff3dc0ce340 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 -- 172.21.15.46:0/1929387993 >> 172.21.15.46:0/1929387993 conn(0x7ff3dc0999f0 msgr2=0x7ff3dc0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 -- 172.21.15.46:0/1929387993 shutdown_connections 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.953+0000 7ff3e30cb700 1 -- 172.21.15.46:0/1929387993 wait complete. 2023-10-07T09:07:39.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.954+0000 7ff3e30cb700 1 Processor -- start 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 -- start start 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3dc1567f0 0x7ff3dc156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1571b0 con 0x7ff3dc159ec0 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc16e3e0 con 0x7ff3dc1567f0 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.955+0000 7ff3e30cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc16d810 con 0x7ff3dc0b55a0 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51818/0 (socket says 172.21.15.46:51818) 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 -- 172.21.15.46:0/3294111704 learned_addr learned my addr 172.21.15.46:0/3294111704 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3e1668700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3dc1567f0 0x7ff3dc156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3e0e67700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 -- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 msgr2=0x7ff3dc1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 -- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3dc1567f0 msgr2=0x7ff3dc156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3dc1567f0 0x7ff3dc156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 -- 172.21.15.46:0/3294111704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009420 con 0x7ff3dc159ec0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3e0e67700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3dbfff700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc089390 tx=0x7ff3c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c801f070 con 0x7ff3dc159ec0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8000bc0 con 0x7ff3dc159ec0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc150bf0 con 0x7ff3dc159ec0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800bb60 con 0x7ff3dc159ec0 2023-10-07T09:07:39.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.956+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc16dd90 con 0x7ff3dc159ec0 2023-10-07T09:07:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.957+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc063c90 con 0x7ff3dc159ec0 2023-10-07T09:07:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.958+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff3c8023070 con 0x7ff3dc159ec0 2023-10-07T09:07:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.958+0000 7ff3d8ff9700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 0x7ff3c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.958+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5452+0+0 (secure 0 0 0) 0x7ff3c8085ed0 con 0x7ff3dc159ec0 2023-10-07T09:07:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.958+0000 7ff3e0e67700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 0x7ff3c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.959+0000 7ff3e0e67700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 0x7ff3c00697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00010e0 tx=0x7ff3d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:39.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:39.963+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3c8052c60 con 0x7ff3dc159ec0 2023-10-07T09:07:40.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.155+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001034129.data", "pool2": "cephfs.volume_0000000001034129.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff3dc0718b0 con 0x7ff3dc159ec0 2023-10-07T09:07:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.954+0000 7ff3d8ff9700 1 -- 172.21.15.46:0/3294111704 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001034129.data", "pool2": "cephfs.volume_0000000001034129.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001034129.data' removed v190) v1 ==== 241+0+0 (secure 0 0 0) 0x7ff3c8015100 con 0x7ff3dc159ec0 2023-10-07T09:07:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 msgr2=0x7ff3c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 0x7ff3c00697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00010e0 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 msgr2=0x7ff3dc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc089390 tx=0x7ff3c8017000 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 shutdown_connections 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff3c0067320 0x7ff3c00697d0 secure :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00010e0 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3dc1567f0 0x7ff3dc156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3dc0b55a0 0x7ff3dc1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 --2- 172.21.15.46:0/3294111704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3dc159ec0 0x7ff3dc0c9040 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 >> 172.21.15.46:0/3294111704 conn(0x7ff3dc0999f0 msgr2=0x7ff3dc0c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.964+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 shutdown_connections 2023-10-07T09:07:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:40.965+0000 7ff3e30cb700 1 -- 172.21.15.46:0/3294111704 wait complete. 2023-10-07T09:07:40.968 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000001034129.data' removed 2023-10-07T09:07:40.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:07:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.110+0000 7fa88d3d4700 1 Processor -- start 2023-10-07T09:07:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.110+0000 7fa88d3d4700 1 -- start start 2023-10-07T09:07:41.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa88d3d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 0x7fa88815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa88d3d4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa88815db10 0x7fa888069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa88d3d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88815a160 con 0x7fa888159890 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa88d3d4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88815df50 con 0x7fa88815db10 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa88d3d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880d13a0 con 0x7fa888159c60 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa8877fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa88815db10 0x7fa888069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa8877fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa88815db10 0x7fa888069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51828/0 (socket says 172.21.15.46:51828) 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.111+0000 7fa8877fe700 1 -- 172.21.15.46:0/4281552378 learned_addr learned my addr 172.21.15.46:0/4281552378 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8867fc700 1 --2- 172.21.15.46:0/4281552378 >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 0x7fa88815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8877fe700 1 -- 172.21.15.46:0/4281552378 >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 msgr2=0x7fa88815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8877fe700 1 --2- 172.21.15.46:0/4281552378 >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 0x7fa88815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8877fe700 1 -- 172.21.15.46:0/4281552378 >> v1:172.21.15.133:6789/0 conn(0x7fa888159890 legacy=0x7fa88815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8877fe700 1 -- 172.21.15.46:0/4281552378 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88815e140 con 0x7fa88815db10 2023-10-07T09:07:41.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8867fc700 1 --2- 172.21.15.46:0/4281552378 >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 0x7fa88815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:41.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa8877fe700 1 --2- 172.21.15.46:0/4281552378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa88815db10 0x7fa888069560 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b67f0 tx=0x7fa878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e0900cd4a207d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa885ffb700 1 -- 172.21.15.46:0/4281552378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800b820 con 0x7fa88815db10 2023-10-07T09:07:41.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa885ffb700 1 -- 172.21.15.46:0/4281552378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800b980 con 0x7fa88815db10 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.112+0000 7fa885ffb700 1 -- 172.21.15.46:0/4281552378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800bd20 con 0x7fa88815db10 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 -- 172.21.15.46:0/4281552378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa88815db10 msgr2=0x7fa888069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/4281552378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa88815db10 0x7fa888069560 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b67f0 tx=0x7fa878009250 comp rx=0 tx=0).stop 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 -- 172.21.15.46:0/4281552378 shutdown_connections 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/4281552378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa88815db10 0x7fa888069560 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/4281552378 >> v2:172.21.15.133:3300/0 conn(0x7fa888159c60 0x7fa88815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 -- 172.21.15.46:0/4281552378 >> 172.21.15.46:0/4281552378 conn(0x7fa888068e20 msgr2=0x7fa8880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 -- 172.21.15.46:0/4281552378 shutdown_connections 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.113+0000 7fa88d3d4700 1 -- 172.21.15.46:0/4281552378 wait complete. 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.114+0000 7fa88d3d4700 1 Processor -- start 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.114+0000 7fa88d3d4700 1 -- start start 2023-10-07T09:07:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa888159c60 0x7fa8880b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 0x7fa88816a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88816aad0 con 0x7fa888159890 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880cfed0 con 0x7fa88815db10 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880cf910 con 0x7fa888159c60 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51836/0 (socket says 172.21.15.46:51836) 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 -- 172.21.15.46:0/2257390589 learned_addr learned my addr 172.21.15.46:0/2257390589 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:41.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa8877fe700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 0x7fa88816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 -- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa888159c60 msgr2=0x7fa8880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa888159c60 0x7fa8880b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 -- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 msgr2=0x7fa88816a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 0x7fa88816a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 -- 172.21.15.46:0/2257390589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094f0 con 0x7fa888159890 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa8877fe700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 0x7fa88816a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa886ffd700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa88000c950 tx=0x7fa880002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000a7e0 con 0x7fa888159890 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000a940 con 0x7fa888159890 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8880cfbf0 con 0x7fa888159890 2023-10-07T09:07:41.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000ad00 con 0x7fa888159890 2023-10-07T09:07:41.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.115+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8880b5400 con 0x7fa888159890 2023-10-07T09:07:41.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.116+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8880b4f80 con 0x7fa888159890 2023-10-07T09:07:41.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.117+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa880012630 con 0x7fa888159890 2023-10-07T09:07:41.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.117+0000 7fa87effd700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 0x7fa8680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.117+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa880084ec0 con 0x7fa888159890 2023-10-07T09:07:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.118+0000 7fa8867fc700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 0x7fa8680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.118+0000 7fa8867fc700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 0x7fa8680697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa888153950 tx=0x7fa870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.122+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8880b4f80 con 0x7fa888159890 2023-10-07T09:07:41.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.315+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa8880b4f80 con 0x7fa888159890 2023-10-07T09:07:41.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.318+0000 7fa87effd700 1 -- 172.21.15.46:0/2257390589 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8880b4f80 con 0x7fa888159890 2023-10-07T09:07:41.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 msgr2=0x7fa8680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 0x7fa8680697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa888153950 tx=0x7fa870008040 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 msgr2=0x7fa8880ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa88000c950 tx=0x7fa880002760 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 shutdown_connections 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fa868067320 0x7fa8680697d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa88815db10 0x7fa88816a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa888159890 0x7fa8880ceb00 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 --2- 172.21.15.46:0/2257390589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa888159c60 0x7fa8880b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 >> 172.21.15.46:0/2257390589 conn(0x7fa888068e20 msgr2=0x7fa888152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 shutdown_connections 2023-10-07T09:07:41.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.320+0000 7fa88d3d4700 1 -- 172.21.15.46:0/2257390589 wait complete. 2023-10-07T09:07:41.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-07T09:07:41.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.452+0000 7f59a61da700 1 Processor -- start 2023-10-07T09:07:41.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.452+0000 7f59a61da700 1 -- start start 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a61da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59a00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a61da700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59a015d230 0x7f59a015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a61da700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a015dbd0 con 0x7f59a01597f0 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a61da700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a00b2980 con 0x7f59a015d230 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a61da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b11d0 con 0x7f59a0159420 2023-10-07T09:07:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a49d7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f59a01597f0 0x7f59a00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40952/0 (socket says 172.21.15.46:40952) 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.453+0000 7f59a49d7700 1 -- 172.21.15.46:0/2485755946 learned_addr learned my addr 172.21.15.46:0/2485755946 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944576672 0 0) 0x7f5994001110 con 0x7f59a01597f0 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5988003570 con 0x7f59a01597f0 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59a00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a59d9700 1 --2- 172.21.15.46:0/2485755946 >> v2:172.21.15.133:3300/0 conn(0x7f59a015d230 0x7f59a015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1142047168 0 0) 0x7f5988003570 con 0x7f59a01597f0 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 msgr2=0x7f59a00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59a00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 >> v2:172.21.15.133:3300/0 conn(0x7f59a015d230 msgr2=0x7f59a015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 --2- 172.21.15.46:0/2485755946 >> v2:172.21.15.133:3300/0 conn(0x7f59a015d230 0x7f59a015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00b14b0 con 0x7f59a01597f0 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5994001600 con 0x7f59a01597f0 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 >> v1:172.21.15.46:6789/0 conn(0x7f59a01597f0 legacy=0x7f59a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5988003a60 0x7f5988003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988004810 0x7f5988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b2980 con 0x7f5988003a60 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b11d0 con 0x7f5988004810 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598800ba60 con 0x7f59a0159420 2023-10-07T09:07:41.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5988003a60 0x7f5988003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a49d7700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988004810 0x7f5988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a59d9700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 -- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 msgr2=0x7f59880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 -- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988004810 msgr2=0x7f5988004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988004810 0x7f5988004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a51d8700 1 -- 172.21.15.46:0/2485755946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988003570 con 0x7f5988003a60 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.454+0000 7f59a59d9700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59a0159420 0x7f59880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:41.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a51d8700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5988003a60 0x7f5988003e70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f5998009c30 tx=0x7f59980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf6d4e5244bbba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599800e710 con 0x7f5988003a60 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599800e870 con 0x7f5988003a60 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f599ffff700 1 -- 172.21.15.46:0/2485755946 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599800ec30 con 0x7f5988003a60 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 -- 172.21.15.46:0/2485755946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5988003a60 msgr2=0x7f5988003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 --2- 172.21.15.46:0/2485755946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5988003a60 0x7f5988003e70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f5998009c30 tx=0x7f59980091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a59d9700 1 -- 172.21.15.46:0/2485755946 reap_dead start 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 -- 172.21.15.46:0/2485755946 shutdown_connections 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 -- 172.21.15.46:0/2485755946 >> 172.21.15.46:0/2485755946 conn(0x7f59a00d0660 msgr2=0x7f59a00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 -- 172.21.15.46:0/2485755946 shutdown_connections 2023-10-07T09:07:41.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.455+0000 7f59a61da700 1 -- 172.21.15.46:0/2485755946 wait complete. 2023-10-07T09:07:41.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.456+0000 7f59a61da700 1 Processor -- start 2023-10-07T09:07:41.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 -- start start 2023-10-07T09:07:41.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a60 0x7f59a00a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 0x7f59a0157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0157bc0 con 0x7f59a0157750 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00a7c20 con 0x7f59a0147060 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a61da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00a85f0 con 0x7f5988003a60 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a59d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a59d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51850/0 (socket says 172.21.15.46:51850) 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.457+0000 7f59a59d9700 1 -- 172.21.15.46:0/448252102 learned_addr learned my addr 172.21.15.46:0/448252102 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a49d7700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 0x7f59a0157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a51d8700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a60 0x7f59a00a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 -- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a60 msgr2=0x7f59a00a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a60 0x7f59a00a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 -- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 msgr2=0x7f59a0157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 0x7f59a0157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 -- 172.21.15.46:0/448252102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00a7010 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a49d7700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 0x7f59a0157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a59d9700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f59a015d600 tx=0x7f599000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000fc80 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000fde0 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00a72f0 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990016650 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.458+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00a78b0 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.459+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a004c3c0 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.460+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59900169c0 con 0x7f59a0157750 2023-10-07T09:07:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.460+0000 7f599d7fa700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 0x7f598c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:41.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.460+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5990085550 con 0x7f59a0157750 2023-10-07T09:07:41.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.460+0000 7f59a51d8700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 0x7f598c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:41.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.461+0000 7f59a51d8700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 0x7f598c0697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59980091e0 tx=0x7f599801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:41.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.464+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59900523d0 con 0x7f59a0157750 2023-10-07T09:07:41.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.738+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f59a00b1790 con 0x7f59a0157750 2023-10-07T09:07:41.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.956+0000 7f599d7fa700 1 -- 172.21.15.46:0/448252102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v466) v1 ==== 147+0+0 (secure 0 0 0) 0x7f59900559f0 con 0x7f59a0157750 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 msgr2=0x7f598c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 0x7f598c0697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59980091e0 tx=0x7f599801a000 comp rx=0 tx=0).stop 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 msgr2=0x7f59a00aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f59a015d600 tx=0x7f599000b040 comp rx=0 tx=0).stop 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 shutdown_connections 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f598c067320 0x7f598c0697d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59a0157750 0x7f59a00aa880 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a60 0x7f59a00a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 --2- 172.21.15.46:0/448252102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a0147060 0x7f59a0157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 >> 172.21.15.46:0/448252102 conn(0x7f59a00d0660 msgr2=0x7f59a00b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 shutdown_connections 2023-10-07T09:07:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:41.958+0000 7f59a61da700 1 -- 172.21.15.46:0/448252102 wait complete. 2023-10-07T09:07:41.971 INFO:tasks.cephfs_test_runner:That volume rename is idempotent. ... ok 2023-10-07T09:07:41.971 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-07T09:07:41.971 INFO:tasks.cephfs_test_runner:test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:07:41.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-07T09:07:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.090+0000 7f4386fef700 1 Processor -- start 2023-10-07T09:07:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.090+0000 7f4386fef700 1 -- start start 2023-10-07T09:07:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4386fef700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4380159890 0x7f438015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4386fef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4380159c60 0x7f438015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4386fef700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438015a160 con 0x7f438015db10 2023-10-07T09:07:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4386fef700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800d13a0 con 0x7f4380159890 2023-10-07T09:07:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4386fef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015e140 con 0x7f4380159c60 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4380159890 0x7f438015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f438558c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f438015db10 0x7f4380069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40966/0 (socket says 172.21.15.46:40966) 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f438558c700 1 -- 172.21.15.46:0/677848559 learned_addr learned my addr 172.21.15.46:0/677848559 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f437ffff700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4380159c60 0x7f438015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 -- 172.21.15.46:0/677848559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4380159c60 msgr2=0x7f438015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4380159c60 0x7f438015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 -- 172.21.15.46:0/677848559 >> v1:172.21.15.46:6789/0 conn(0x7f438015db10 legacy=0x7f4380069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 -- 172.21.15.46:0/677848559 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438015a3d0 con 0x7f4380159890 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f437f7fe700 1 -- 172.21.15.46:0/677848559 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769848354 0 0) 0x7f438015a160 con 0x7f438015db10 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.091+0000 7f4384d8b700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159890 0x7f438015abd0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f43740098e0 tx=0x7f43740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63525e59dc18c07e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f437f7fe700 1 -- 172.21.15.46:0/677848559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374009e80 con 0x7f4380159890 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f437f7fe700 1 -- 172.21.15.46:0/677848559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400b860 con 0x7f4380159890 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f437f7fe700 1 -- 172.21.15.46:0/677848559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400bbe0 con 0x7f4380159890 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 -- 172.21.15.46:0/677848559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159890 msgr2=0x7f438015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159890 0x7f438015abd0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f43740098e0 tx=0x7f43740091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 -- 172.21.15.46:0/677848559 shutdown_connections 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159890 0x7f438015abd0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 --2- 172.21.15.46:0/677848559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4380159c60 0x7f438015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 -- 172.21.15.46:0/677848559 >> 172.21.15.46:0/677848559 conn(0x7f4380068e20 msgr2=0x7f43800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 -- 172.21.15.46:0/677848559 shutdown_connections 2023-10-07T09:07:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.092+0000 7f4386fef700 1 -- 172.21.15.46:0/677848559 wait complete. 2023-10-07T09:07:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.093+0000 7f4386fef700 1 Processor -- start 2023-10-07T09:07:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.093+0000 7f4386fef700 1 -- start start 2023-10-07T09:07:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4380159890 0x7f43800b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 0x7f43800c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438016a9f0 con 0x7f4380159c60 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438016a710 con 0x7f4380159890 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f4386fef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015bc80 con 0x7f438015db10 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f437ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f437ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51860/0 (socket says 172.21.15.46:51860) 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f437ffff700 1 -- 172.21.15.46:0/2719961493 learned_addr learned my addr 172.21.15.46:0/2719961493 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.094+0000 7f438558c700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 0x7f43800c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f4384d8b700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4380159890 0x7f43800b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 -- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 msgr2=0x7f43800c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 0x7f43800c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 -- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4380159890 msgr2=0x7f43800b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4380159890 0x7f43800b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 -- 172.21.15.46:0/2719961493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374009420 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f438558c700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 0x7f43800c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437ffff700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f436c00d860 tx=0x7f436c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0125f0 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c012750 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438015bf60 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c012ad0 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.095+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43800ca900 con 0x7f4380159c60 2023-10-07T09:07:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.096+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438015c400 con 0x7f4380159c60 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.096+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f436c01e460 con 0x7f4380159c60 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.097+0000 7f437cff9700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 0x7f43640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.097+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f436c084fd0 con 0x7f4380159c60 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.097+0000 7f4384d8b700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 0x7f43640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.098+0000 7f4384d8b700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 0x7f43640697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43740091e0 tx=0x7f4374017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:42.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.101+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f436c0559f0 con 0x7f4380159c60 2023-10-07T09:07:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.373+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f438004c3c0 con 0x7f4380159c60 2023-10-07T09:07:42.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:07:42.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:07:42.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.957+0000 7f437cff9700 1 -- 172.21.15.46:0/2719961493 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v467) v1 ==== 134+0+0 (secure 0 0 0) 0x7f436c055580 con 0x7f4380159c60 2023-10-07T09:07:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 msgr2=0x7f43640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 0x7f43640697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43740091e0 tx=0x7f4374017000 comp rx=0 tx=0).stop 2023-10-07T09:07:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 msgr2=0x7f43800ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f436c00d860 tx=0x7f436c008040 comp rx=0 tx=0).stop 2023-10-07T09:07:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 shutdown_connections 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4364067320 0x7f43640697d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438015db10 0x7f43800c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4380159890 0x7f43800b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 --2- 172.21.15.46:0/2719961493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4380159c60 0x7f43800ca3c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 >> 172.21.15.46:0/2719961493 conn(0x7f4380068e20 msgr2=0x7f4380152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 shutdown_connections 2023-10-07T09:07:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:42.960+0000 7f4386fef700 1 -- 172.21.15.46:0/2719961493 wait complete. 2023-10-07T09:07:42.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:07:43.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.152+0000 7fe96359e700 1 Processor -- start 2023-10-07T09:07:43.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.152+0000 7fe96359e700 1 -- start start 2023-10-07T09:07:43.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9640b16d0 0x7fe9640b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9640b33b0 0x7fe9640b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640b2080 con 0x7fe9640b4e70 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640cfb00 con 0x7fe9640b16d0 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640b5c40 con 0x7fe9640b33b0 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe9640b4e70 0x7fe9640ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40980/0 (socket says 172.21.15.46:40980) 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96259c700 1 -- 172.21.15.46:0/2166506907 learned_addr learned my addr 172.21.15.46:0/2166506907 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe961d9b700 1 --2- 172.21.15.46:0/2166506907 >> v2:172.21.15.46:3300/0 conn(0x7fe9640b16d0 0x7fe9640b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe962d9d700 1 --2- 172.21.15.46:0/2166506907 >> v2:172.21.15.133:3300/0 conn(0x7fe9640b33b0 0x7fe9640b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96159a700 1 -- 172.21.15.46:0/2166506907 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270809423 0 0) 0x7fe9640b2080 con 0x7fe9640b4e70 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe96159a700 1 -- 172.21.15.46:0/2166506907 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe950003570 con 0x7fe9640b4e70 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe961d9b700 1 -- 172.21.15.46:0/2166506907 >> v2:172.21.15.133:3300/0 conn(0x7fe9640b33b0 msgr2=0x7fe9640b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe961d9b700 1 --2- 172.21.15.46:0/2166506907 >> v2:172.21.15.133:3300/0 conn(0x7fe9640b33b0 0x7fe9640b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe961d9b700 1 -- 172.21.15.46:0/2166506907 >> v1:172.21.15.46:6789/0 conn(0x7fe9640b4e70 legacy=0x7fe9640ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.153+0000 7fe961d9b700 1 -- 172.21.15.46:0/2166506907 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640b5f20 con 0x7fe9640b16d0 2023-10-07T09:07:43.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe961d9b700 1 --2- 172.21.15.46:0/2166506907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640b1b40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe964071380 tx=0x7fe94c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3994c66fc68d6abd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96159a700 1 -- 172.21.15.46:0/2166506907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011630 con 0x7fe9640b16d0 2023-10-07T09:07:43.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96159a700 1 -- 172.21.15.46:0/2166506907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0117b0 con 0x7fe9640b16d0 2023-10-07T09:07:43.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96159a700 1 -- 172.21.15.46:0/2166506907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011b70 con 0x7fe9640b16d0 2023-10-07T09:07:43.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 -- 172.21.15.46:0/2166506907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 msgr2=0x7fe9640b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 --2- 172.21.15.46:0/2166506907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640b1b40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe964071380 tx=0x7fe94c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 -- 172.21.15.46:0/2166506907 shutdown_connections 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 --2- 172.21.15.46:0/2166506907 >> v2:172.21.15.133:3300/0 conn(0x7fe9640b33b0 0x7fe9640b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 --2- 172.21.15.46:0/2166506907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640b1b40 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 -- 172.21.15.46:0/2166506907 >> 172.21.15.46:0/2166506907 conn(0x7fe9640d10c0 msgr2=0x7fe9640affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 -- 172.21.15.46:0/2166506907 shutdown_connections 2023-10-07T09:07:43.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.154+0000 7fe96359e700 1 -- 172.21.15.46:0/2166506907 wait complete. 2023-10-07T09:07:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.155+0000 7fe96359e700 1 Processor -- start 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 -- start start 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9640b33b0 0x7fe9641573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640b4e70 0x7fe96415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640c8360 con 0x7fe9640b16d0 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640c7520 con 0x7fe9640b4e70 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640c7750 con 0x7fe9640b33b0 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51878/0 (socket says 172.21.15.46:51878) 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe96259c700 1 -- 172.21.15.46:0/359531835 learned_addr learned my addr 172.21.15.46:0/359531835 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe962d9d700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640b4e70 0x7fe96415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.156+0000 7fe961d9b700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9640b33b0 0x7fe9641573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 -- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9640b33b0 msgr2=0x7fe9641573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9640b33b0 0x7fe9641573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 -- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640b4e70 msgr2=0x7fe96415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640b4e70 0x7fe96415ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 -- 172.21.15.46:0/359531835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c009420 con 0x7fe9640b16d0 2023-10-07T09:07:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96259c700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c7c0 tx=0x7fe95c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c005b30 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c005c90 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9640c7a30 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c007340 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.157+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9640c7ff0 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.158+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9640c8510 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.159+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe95c01b400 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.159+0000 7fe95a7fc700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 0x7fe9440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.159+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe95c084330 con 0x7fe9640b16d0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.159+0000 7fe961d9b700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 0x7fe9440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.160+0000 7fe961d9b700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 0x7fe9440697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe964071380 tx=0x7fe94c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.163+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe95c051440 con 0x7fe9640b16d0 2023-10-07T09:07:43.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.357+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe96404bb80 con 0x7fe9640b16d0 2023-10-07T09:07:43.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.360+0000 7fe95a7fc700 1 -- 172.21.15.46:0/359531835 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe95c054a60 con 0x7fe9640b16d0 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 msgr2=0x7fe9440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 0x7fe9440697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe964071380 tx=0x7fe94c017000 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 msgr2=0x7fe9640c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c7c0 tx=0x7fe95c007e00 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 shutdown_connections 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fe944067320 0x7fe9440697d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640b4e70 0x7fe96415ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9640b16d0 0x7fe9640c6fe0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 --2- 172.21.15.46:0/359531835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe9640b33b0 0x7fe9641573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.362+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 >> 172.21.15.46:0/359531835 conn(0x7fe9640d10c0 msgr2=0x7fe9640ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.363+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 shutdown_connections 2023-10-07T09:07:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.363+0000 7fe96359e700 1 -- 172.21.15.46:0/359531835 wait complete. 2023-10-07T09:07:43.375 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:07:43.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:43.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:07:43.468 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:07:43.468 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T09:07:43.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.587+0000 7f86d947f700 1 Processor -- start 2023-10-07T09:07:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.587+0000 7f86d947f700 1 -- start start 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.587+0000 7f86d947f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f86d4159c60 0x7f86d415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.587+0000 7f86d947f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 0x7f86d4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d947f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d415a160 con 0x7f86d4159890 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d947f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d415df50 con 0x7f86d4159c60 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d947f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40d13a0 con 0x7f86d415db10 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f86d4159c60 0x7f86d415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f86d4159c60 0x7f86d415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51882/0 (socket says 172.21.15.46:51882) 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 -- 172.21.15.46:0/1337981539 learned_addr learned my addr 172.21.15.46:0/1337981539 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d37fe700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 0x7f86d4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 -- 172.21.15.46:0/1337981539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 msgr2=0x7f86d4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 0x7f86d4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 -- 172.21.15.46:0/1337981539 >> v1:172.21.15.133:6789/0 conn(0x7f86d4159890 legacy=0x7f86d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 -- 172.21.15.46:0/1337981539 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d415e140 con 0x7f86d4159c60 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d37fe700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 0x7f86d4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d27fc700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d415d5d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0099b0 tx=0x7f86bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a45d5b1748a4878 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d1ffb700 1 -- 172.21.15.46:0/1337981539 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00b860 con 0x7f86d4159c60 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d1ffb700 1 -- 172.21.15.46:0/1337981539 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00b9c0 con 0x7f86d4159c60 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.588+0000 7f86d1ffb700 1 -- 172.21.15.46:0/1337981539 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00bd60 con 0x7f86d4159c60 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 -- 172.21.15.46:0/1337981539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 msgr2=0x7f86d415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d415d5d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0099b0 tx=0x7f86bc009250 comp rx=0 tx=0).stop 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 -- 172.21.15.46:0/1337981539 shutdown_connections 2023-10-07T09:07:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d415db10 0x7f86d4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 --2- 172.21.15.46:0/1337981539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d415d5d0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 -- 172.21.15.46:0/1337981539 >> 172.21.15.46:0/1337981539 conn(0x7f86d4068e20 msgr2=0x7f86d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 -- 172.21.15.46:0/1337981539 shutdown_connections 2023-10-07T09:07:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.589+0000 7f86d947f700 1 -- 172.21.15.46:0/1337981539 wait complete. 2023-10-07T09:07:43.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.590+0000 7f86d947f700 1 Processor -- start 2023-10-07T09:07:43.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.590+0000 7f86d947f700 1 -- start start 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d4159890 0x7f86d40ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d415db10 0x7f86d4149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d416a9c0 con 0x7f86d4159c60 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4158ad0 con 0x7f86d415db10 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d947f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d416a090 con 0x7f86d4159890 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51898/0 (socket says 172.21.15.46:51898) 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 -- 172.21.15.46:0/94987993 learned_addr learned my addr 172.21.15.46:0/94987993 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d37fe700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d415db10 0x7f86d4149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d2ffd700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d4159890 0x7f86d40ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 -- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d4159890 msgr2=0x7f86d40ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d4159890 0x7f86d40ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 -- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d415db10 msgr2=0x7f86d4149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d415db10 0x7f86d4149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.591+0000 7f86d27fc700 1 -- 172.21.15.46:0/94987993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0094f0 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86d27fc700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009290 tx=0x7f86bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc011e00 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc01f070 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d416a370 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0266d0 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.592+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d40c7ad0 con 0x7f86d4159c60 2023-10-07T09:07:43.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.593+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d416ab30 con 0x7f86d4159c60 2023-10-07T09:07:43.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.593+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f86bc026a40 con 0x7f86d4159c60 2023-10-07T09:07:43.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.594+0000 7f86caffd700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 0x7f86b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:43.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.594+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f86bc021070 con 0x7f86d4159c60 2023-10-07T09:07:43.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.594+0000 7f86d2ffd700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 0x7f86b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:43.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.595+0000 7f86d2ffd700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 0x7f86b40697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f86cc003a80 tx=0x7f86cc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:43.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.598+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86bc0536b0 con 0x7f86d4159c60 2023-10-07T09:07:43.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.833+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d404c3c0 con 0x7f86d4159c60 2023-10-07T09:07:43.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.833+0000 7f86caffd700 1 -- 172.21.15.46:0/94987993 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+3534 (secure 0 0 0) 0x7f86bc015090 con 0x7f86d4159c60 2023-10-07T09:07:43.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:43.834 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":128,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3804115497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3804115497},{"type":"v1","addr":"172.21.15.46:6835","nonce":3804115497}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2258837074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2258837074},{"type":"v1","addr":"172.21.15.133:6836","nonce":2258837074}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/230210674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":230210674},{"type":"v1","addr":"172.21.15.133:6837","nonce":230210674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/209274607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":209274607},{"type":"v1","addr":"172.21.15.46:6834","nonce":209274607}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[]} 2023-10-07T09:07:43.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 msgr2=0x7f86b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 0x7f86b40697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f86cc003a80 tx=0x7f86cc007ec0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 msgr2=0x7f86d4158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009290 tx=0x7f86bc017000 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 shutdown_connections 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f86b4067320 0x7f86b40697d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d415db10 0x7f86d4149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86d4159890 0x7f86d40ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 --2- 172.21.15.46:0/94987993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d4159c60 0x7f86d4158440 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 >> 172.21.15.46:0/94987993 conn(0x7f86d4068e20 msgr2=0x7f86d4153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 shutdown_connections 2023-10-07T09:07:43.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:43.836+0000 7f86d947f700 1 -- 172.21.15.46:0/94987993 wait complete. 2023-10-07T09:07:43.838 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 128 2023-10-07T09:07:43.849 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T09:07:43.849 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T09:07:43.849 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:07:43.849 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:43.850 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T09:07:43.850 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T09:07:43.850 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:07:43.850 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:43.850 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T09:07:43.850 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T09:07:43.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:07:43.851 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:43.851 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T09:07:43.851 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T09:07:43.851 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:07:43.851 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:07:43.858 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:07:43.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T09:07:43.859 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:07:43.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T09:07:43.861 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:07:43.861 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T09:07:43.862 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:07:43.862 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T09:07:43.901 INFO:tasks.ceph.mds.a:Started 2023-10-07T09:07:43.901 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:43.902 INFO:tasks.ceph.mds.c:Started 2023-10-07T09:07:43.902 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:43.904 INFO:tasks.ceph.mds.b:Started 2023-10-07T09:07:43.904 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:43.905 INFO:tasks.ceph.mds.d:Started 2023-10-07T09:07:43.905 DEBUG:teuthology.parallel:result is None 2023-10-07T09:07:43.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T09:07:43.978 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:07:43.978 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-10-07T09:07:43.987 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-10-07T09:07:43.987 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-10-07T09:07:44.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.030+0000 7ffaac87f700 1 Processor -- start 2023-10-07T09:07:44.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.031+0000 7ffaac87f700 1 -- start start 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaac87f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffaa8159890 0x7ffaa815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaac87f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffaa8159c60 0x7ffaa815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaac87f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa815a160 con 0x7ffaa815db10 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaac87f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa815df50 con 0x7ffaa8159c60 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaac87f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa80d13a0 con 0x7ffaa8159890 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffaa8159c60 0x7ffaa815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffaa8159c60 0x7ffaa815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51946/0 (socket says 172.21.15.46:51946) 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/2302559847 learned_addr learned my addr 172.21.15.46:0/2302559847 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa659c700 1 --2- 172.21.15.46:0/2302559847 >> v2:172.21.15.133:3300/0 conn(0x7ffaa8159890 0x7ffaa815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/2302559847 >> v2:172.21.15.133:3300/0 conn(0x7ffaa8159890 msgr2=0x7ffaa815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 --2- 172.21.15.46:0/2302559847 >> v2:172.21.15.133:3300/0 conn(0x7ffaa8159890 0x7ffaa815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/2302559847 >> v1:172.21.15.133:6789/0 conn(0x7ffaa815db10 legacy=0x7ffaa8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/2302559847 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa815e140 con 0x7ffaa8159c60 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa5d9b700 1 --2- 172.21.15.46:0/2302559847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa815d5d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80d1090 tx=0x7ffa90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1f6ed7e0d1f555 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa559a700 1 -- 172.21.15.46:0/2302559847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000b860 con 0x7ffaa8159c60 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa559a700 1 -- 172.21.15.46:0/2302559847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000b9c0 con 0x7ffaa8159c60 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.032+0000 7ffaa559a700 1 -- 172.21.15.46:0/2302559847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000bd60 con 0x7ffaa8159c60 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 -- 172.21.15.46:0/2302559847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 msgr2=0x7ffaa815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 --2- 172.21.15.46:0/2302559847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa815d5d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80d1090 tx=0x7ffa90009250 comp rx=0 tx=0).stop 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 -- 172.21.15.46:0/2302559847 shutdown_connections 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 --2- 172.21.15.46:0/2302559847 >> v2:172.21.15.133:3300/0 conn(0x7ffaa8159890 0x7ffaa815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 --2- 172.21.15.46:0/2302559847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa815d5d0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 -- 172.21.15.46:0/2302559847 >> 172.21.15.46:0/2302559847 conn(0x7ffaa8068e20 msgr2=0x7ffaa80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 -- 172.21.15.46:0/2302559847 shutdown_connections 2023-10-07T09:07:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.033+0000 7ffaac87f700 1 -- 172.21.15.46:0/2302559847 wait complete. 2023-10-07T09:07:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.034+0000 7ffaac87f700 1 Processor -- start 2023-10-07T09:07:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.034+0000 7ffaac87f700 1 -- start start 2023-10-07T09:07:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa8159890 0x7ffaa8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815db10 0x7ffaa80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80b4480 con 0x7ffaa8159c60 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8153970 con 0x7ffaa8159890 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaac87f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80b3590 con 0x7ffaa815db10 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51956/0 (socket says 172.21.15.46:51956) 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/3863248878 learned_addr learned my addr 172.21.15.46:0/3863248878 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa659c700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa8159890 0x7ffaa8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa6d9d700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815db10 0x7ffaa80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815db10 msgr2=0x7ffaa80c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815db10 0x7ffaa80c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa8159890 msgr2=0x7ffaa8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa8159890 0x7ffaa8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 -- 172.21.15.46:0/3863248878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900094f0 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.035+0000 7ffaa5d9b700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8070e20 tx=0x7ffa90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.036+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90024440 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.036+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa900245a0 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.036+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80b3870 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.036+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90024960 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.036+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa80b3e30 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.037+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa80b45f0 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.037+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa9001a420 con 0x7ffaa8159c60 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.037+0000 7ffa9e7fc700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 0x7ffa880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.038+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ffa900866c0 con 0x7ffaa8159c60 2023-10-07T09:07:44.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.038+0000 7ffaa659c700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 0x7ffa880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:44.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.038+0000 7ffaa659c700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 0x7ffa880697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.042+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa90053650 con 0x7ffaa8159c60 2023-10-07T09:07:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:44.251+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffaa804c3c0 con 0x7ffaa8159c60 2023-10-07T09:07:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.379+0000 7ffa9e7fc700 1 -- 172.21.15.46:0/3863248878 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v195) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffa90056c70 con 0x7ffaa8159c60 2023-10-07T09:07:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 msgr2=0x7ffa880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 0x7ffa880697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa0008040 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 msgr2=0x7ffaa8153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8070e20 tx=0x7ffa90017000 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 shutdown_connections 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ffa88067320 0x7ffa880697d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815db10 0x7ffaa80c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa8159890 0x7ffaa8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 --2- 172.21.15.46:0/3863248878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa8159c60 0x7ffaa8153430 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 >> 172.21.15.46:0/3863248878 conn(0x7ffaa8068e20 msgr2=0x7ffaa81543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 shutdown_connections 2023-10-07T09:07:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.382+0000 7ffaac87f700 1 -- 172.21.15.46:0/3863248878 wait complete. 2023-10-07T09:07:45.385 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-10-07T09:07:45.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T09:07:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.523+0000 7fdadb09e700 1 Processor -- start 2023-10-07T09:07:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.523+0000 7fdadb09e700 1 -- start start 2023-10-07T09:07:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdadb09e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad406c0a0 0x7fdad40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdadb09e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 0x7fdad415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdadb09e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad415d7e0 con 0x7fdad406bcd0 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdadb09e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad415dac0 con 0x7fdad406c0a0 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdadb09e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415aa30 con 0x7fdad415df50 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdad3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad406c0a0 0x7fdad40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.524+0000 7fdad3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdad406c0a0 0x7fdad40caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51966/0 (socket says 172.21.15.46:51966) 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 -- 172.21.15.46:0/421110321 learned_addr learned my addr 172.21.15.46:0/421110321 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad963b700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 0x7fdad415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 -- 172.21.15.46:0/421110321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 msgr2=0x7fdad415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 0x7fdad415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 -- 172.21.15.46:0/421110321 >> v1:172.21.15.133:6789/0 conn(0x7fdad406bcd0 legacy=0x7fdad415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 -- 172.21.15.46:0/421110321 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad415ad10 con 0x7fdad406c0a0 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad963b700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 0x7fdad415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad3fff700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad406c0a0 0x7fdad40caa90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91236dde9578fe3c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad37fe700 1 -- 172.21.15.46:0/421110321 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400b860 con 0x7fdad406c0a0 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad37fe700 1 -- 172.21.15.46:0/421110321 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400b9c0 con 0x7fdad406c0a0 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.525+0000 7fdad37fe700 1 -- 172.21.15.46:0/421110321 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400bd80 con 0x7fdad406c0a0 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 -- 172.21.15.46:0/421110321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad406c0a0 msgr2=0x7fdad40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad406c0a0 0x7fdad40caa90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4009250 comp rx=0 tx=0).stop 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 -- 172.21.15.46:0/421110321 shutdown_connections 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad415df50 0x7fdad415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 --2- 172.21.15.46:0/421110321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad406c0a0 0x7fdad40caa90 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 -- 172.21.15.46:0/421110321 >> 172.21.15.46:0/421110321 conn(0x7fdad40ce600 msgr2=0x7fdad40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 -- 172.21.15.46:0/421110321 shutdown_connections 2023-10-07T09:07:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.526+0000 7fdadb09e700 1 -- 172.21.15.46:0/421110321 wait complete. 2023-10-07T09:07:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.527+0000 7fdadb09e700 1 Processor -- start 2023-10-07T09:07:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.527+0000 7fdadb09e700 1 -- start start 2023-10-07T09:07:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 0x7fdad4144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 0x7fdad406cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415ed90 con 0x7fdad415df50 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad416a9f0 con 0x7fdad406bcd0 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40c8350 con 0x7fdad406c0a0 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51970/0 (socket says 172.21.15.46:51970) 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 -- 172.21.15.46:0/49936613 learned_addr learned my addr 172.21.15.46:0/49936613 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad8e3a700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 0x7fdad4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad3fff700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 0x7fdad406cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 -- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 msgr2=0x7fdad406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 0x7fdad406cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 -- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 msgr2=0x7fdad4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 0x7fdad4144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 -- 172.21.15.46:0/49936613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40094f0 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad8e3a700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 0x7fdad4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad3fff700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 0x7fdad406cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad963b700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c880 tx=0x7fdabc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011600 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc011760 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.528+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad416a3a0 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.529+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011b20 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.529+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad416a080 con 0x7fdad415df50 2023-10-07T09:07:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.529+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad406af60 con 0x7fdad415df50 2023-10-07T09:07:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.530+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdabc0193b0 con 0x7fdad415df50 2023-10-07T09:07:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.530+0000 7fdad0ff9700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.530+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdabc084b10 con 0x7fdad415df50 2023-10-07T09:07:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.531+0000 7fdad8e3a700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.531+0000 7fdad8e3a700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 0x7fdab40697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdacc007fd0 tx=0x7fdacc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.535+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdabc0519e0 con 0x7fdad415df50 2023-10-07T09:07:45.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.803+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdad404c3c0 con 0x7fdad415df50 2023-10-07T09:07:45.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.804+0000 7fdad0ff9700 1 -- 172.21.15.46:0/49936613 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdabc01f090 con 0x7fdad415df50 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlRGRkJBAAx5oPbUlVboTfjAXxNRlx6g==", 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlcBvTLxAAHttBCn1TJhEHVVAoWQXH2w==", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFl7C5WKxAAKYwbgwUuMFP74kQoTIcM6g==", 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlyNe0NhAAeVum3QWiD19eTv+aaLLScg==", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-10-07T09:07:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCJHSFlr3aCHRAA0CpZYF8uzYX7/HwxMPBxJQ==", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCMHSFl3T6FGxAAMYw4d+09zwnKsgoXoF/qwg==", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCPHSFlmph2GRAAL31fGrePW21+8BpIz8Ujrw==", 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCSHSFl0N7AFxAAxTRIKvK1h/YbIrfTPKrY6A==", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCYHSFlVMVbFxAAifZXmFkFQhQsMSaFPhbSRw==", 2023-10-07T09:07:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbHSFlZdjvFRAA5Xh2zi8dleVgHuIgxHlKOg==", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCeHSFl43q+FRAADG4eqKdSQjJiDRziBwdIXg==", 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-10-07T09:07:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChHSFlJMNsFRAA2JJm0blGgHe4F1VB+ANjpQ==", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFFzDOhAApiRvcEAhlZJjlwdReD7tLQ==", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow r", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFloZa1BxAApZIoYB5am5RQup01sHR0EQ==", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFl7xetBBAAbg34iuFoR/B/ADT6PLqhBg==", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-10-07T09:07:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCIHSFlIo8ZDRAAOFZWJZ456JGYesoAcDnmuw==", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlFkrZCBAA4VAr3sOnHtdvnYKi2A6hAA==", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlzv47IRAA1zPuy3dGLLqUm9+uV8VsFQ==", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCHHSFlNs5KHRAACpOkSeLGjZOPxEExmNfVzw==", 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-07T09:07:45.819 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:07:45.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 msgr2=0x7fdab40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 0x7fdab40697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdacc007fd0 tx=0x7fdacc009040 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 msgr2=0x7fdad406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c880 tx=0x7fdabc008040 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 shutdown_connections 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad415df50 0x7fdad406d4e0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad406bcd0 0x7fdad4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 --2- 172.21.15.46:0/49936613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad406c0a0 0x7fdad406cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 >> 172.21.15.46:0/49936613 conn(0x7fdad40ce600 msgr2=0x7fdad40c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 shutdown_connections 2023-10-07T09:07:45.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.806+0000 7fdadb09e700 1 -- 172.21.15.46:0/49936613 wait complete. 2023-10-07T09:07:45.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:45.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.943+0000 7f9475d43700 1 Processor -- start 2023-10-07T09:07:45.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 -- start start 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9470140720 0x7f9470068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f94700c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700c7de0 con 0x7f9470140350 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470068d50 con 0x7f9470140720 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f9475d43700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9470140c10 con 0x7f94700688d0 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.944+0000 7f946effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9470140720 0x7f9470068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9470140720 0x7f9470068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51984/0 (socket says 172.21.15.46:51984) 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 -- 172.21.15.46:0/825434205 learned_addr learned my addr 172.21.15.46:0/825434205 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:45.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946ffff700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f94700c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 -- 172.21.15.46:0/825434205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 msgr2=0x7f94700c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f94700c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 -- 172.21.15.46:0/825434205 >> v1:172.21.15.133:6789/0 conn(0x7f9470140350 legacy=0x7f9470069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 -- 172.21.15.46:0/825434205 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470141490 con 0x7f9470140720 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946effd700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140720 0x7f9470068390 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f94640099b0 tx=0x7f9464009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba08881e2421c055 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946e7fc700 1 -- 172.21.15.46:0/825434205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400b820 con 0x7f9470140720 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946e7fc700 1 -- 172.21.15.46:0/825434205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400b980 con 0x7f9470140720 2023-10-07T09:07:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.945+0000 7f946e7fc700 1 -- 172.21.15.46:0/825434205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400bd20 con 0x7f9470140720 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 -- 172.21.15.46:0/825434205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140720 msgr2=0x7f9470068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140720 0x7f9470068390 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f94640099b0 tx=0x7f9464009250 comp rx=0 tx=0).stop 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 -- 172.21.15.46:0/825434205 shutdown_connections 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f94700c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 --2- 172.21.15.46:0/825434205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140720 0x7f9470068390 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 -- 172.21.15.46:0/825434205 >> 172.21.15.46:0/825434205 conn(0x7f94700cd670 msgr2=0x7f94700cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 -- 172.21.15.46:0/825434205 shutdown_connections 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.946+0000 7f9475d43700 1 -- 172.21.15.46:0/825434205 wait complete. 2023-10-07T09:07:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.947+0000 7f9475d43700 1 Processor -- start 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.947+0000 7f9475d43700 1 -- start start 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f947013c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 0x7f94700af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947013c6b0 con 0x7f9470140350 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700ae900 con 0x7f9470140720 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f9475d43700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9470154410 con 0x7f94700688d0 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51988/0 (socket says 172.21.15.46:51988) 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 -- 172.21.15.46:0/4002421795 learned_addr learned my addr 172.21.15.46:0/4002421795 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946ffff700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 0x7f94700af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946f7fe700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f947013c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 -- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 msgr2=0x7f947013c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f947013c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 -- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 msgr2=0x7f94700af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 0x7f94700af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 -- 172.21.15.46:0/4002421795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640094f0 con 0x7f9470140350 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946ffff700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 0x7f94700af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946f7fe700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f947013c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f946effd700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9464009290 tx=0x7f9464016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.948+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464011d10 con 0x7f9470140350 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.949+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464020070 con 0x7f9470140350 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.949+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94701546b0 con 0x7f9470140350 2023-10-07T09:07:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.949+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946401b6a0 con 0x7f9470140350 2023-10-07T09:07:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.949+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94700ae590 con 0x7f9470140350 2023-10-07T09:07:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.949+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947006ad00 con 0x7f9470140350 2023-10-07T09:07:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.950+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9464022030 con 0x7f9470140350 2023-10-07T09:07:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.950+0000 7f94577fe700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 0x7f945c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:45.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.950+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9464086640 con 0x7f9470140350 2023-10-07T09:07:45.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.950+0000 7f946f7fe700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 0x7f945c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:45.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.951+0000 7f946f7fe700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 0x7f945c0697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94600028b0 tx=0x7f9460009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:45.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:45.955+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9464053730 con 0x7f9470140350 2023-10-07T09:07:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.148+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f947006ad00 con 0x7f9470140350 2023-10-07T09:07:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.149+0000 7f94577fe700 1 -- 172.21.15.46:0/4002421795 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f9464056d50 con 0x7f9470140350 2023-10-07T09:07:46.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:46.150 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":195,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:45.376374+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 msgr2=0x7f945c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 0x7f945c0697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94600028b0 tx=0x7f9460009040 comp rx=0 tx=0).stop 2023-10-07T09:07:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 msgr2=0x7f94700aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9464009290 tx=0x7f9464016000 comp rx=0 tx=0).stop 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 shutdown_connections 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f945c067320 0x7f945c0697d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9470140720 0x7f94700af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94700688d0 0x7f947013c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 --2- 172.21.15.46:0/4002421795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9470140350 0x7f94700aed90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 >> 172.21.15.46:0/4002421795 conn(0x7f94700cd670 msgr2=0x7f9470156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 shutdown_connections 2023-10-07T09:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.151+0000 7f9475d43700 1 -- 172.21.15.46:0/4002421795 wait complete. 2023-10-07T09:07:46.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T09:07:46.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:07:46.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.286+0000 7f2af1fa2700 1 Processor -- start 2023-10-07T09:07:46.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.286+0000 7f2af1fa2700 1 -- start start 2023-10-07T09:07:46.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af1fa2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2aec0b4e70 0x7f2aec0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af1fa2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2aec0b16d0 0x7f2aec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af1fa2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0b2080 con 0x7f2aec15d240 2023-10-07T09:07:46.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af1fa2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0cfb00 con 0x7f2aec0b4e70 2023-10-07T09:07:46.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af1fa2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0b5c40 con 0x7f2aec0b16d0 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af0fa0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2aec0b4e70 0x7f2aec0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af0fa0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2aec0b4e70 0x7f2aec0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51996/0 (socket says 172.21.15.46:51996) 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.287+0000 7f2af0fa0700 1 -- 172.21.15.46:0/4111026448 learned_addr learned my addr 172.21.15.46:0/4111026448 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2aebfff700 1 --2- 172.21.15.46:0/4111026448 >> v2:172.21.15.133:3300/0 conn(0x7f2aec0b16d0 0x7f2aec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2af0fa0700 1 -- 172.21.15.46:0/4111026448 >> v2:172.21.15.133:3300/0 conn(0x7f2aec0b16d0 msgr2=0x7f2aec0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/4111026448 >> v2:172.21.15.133:3300/0 conn(0x7f2aec0b16d0 0x7f2aec0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2af0fa0700 1 -- 172.21.15.46:0/4111026448 >> v1:172.21.15.133:6789/0 conn(0x7f2aec15d240 legacy=0x7f2aec15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2af0fa0700 1 -- 172.21.15.46:0/4111026448 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b5f20 con 0x7f2aec0b4e70 2023-10-07T09:07:46.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/4111026448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec0ccff0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2aec089830 tx=0x7f2ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c15bc767db9deaf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2aeb7fe700 1 -- 172.21.15.46:0/4111026448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400b820 con 0x7f2aec0b4e70 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2aeb7fe700 1 -- 172.21.15.46:0/4111026448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400b980 con 0x7f2aec0b4e70 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.288+0000 7f2aeb7fe700 1 -- 172.21.15.46:0/4111026448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400bd20 con 0x7f2aec0b4e70 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 -- 172.21.15.46:0/4111026448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 msgr2=0x7f2aec0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/4111026448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec0ccff0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2aec089830 tx=0x7f2ae4009250 comp rx=0 tx=0).stop 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 -- 172.21.15.46:0/4111026448 shutdown_connections 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/4111026448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec0ccff0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/4111026448 >> v2:172.21.15.133:3300/0 conn(0x7f2aec0b16d0 0x7f2aec0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 -- 172.21.15.46:0/4111026448 >> 172.21.15.46:0/4111026448 conn(0x7f2aec0d10c0 msgr2=0x7f2aec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 -- 172.21.15.46:0/4111026448 shutdown_connections 2023-10-07T09:07:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.289+0000 7f2af1fa2700 1 -- 172.21.15.46:0/4111026448 wait complete. 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.290+0000 7f2af1fa2700 1 Processor -- start 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.290+0000 7f2af1fa2700 1 -- start start 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 0x7f2aec158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aec15d240 0x7f2aec0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c9860 con 0x7f2aec0b4e70 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0caec0 con 0x7f2aec0b16d0 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec169ad0 con 0x7f2aec15d240 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52010/0 (socket says 172.21.15.46:52010) 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 -- 172.21.15.46:0/3133743822 learned_addr learned my addr 172.21.15.46:0/3133743822 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 0x7f2aec158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af17a1700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aec15d240 0x7f2aec0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 -- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aec15d240 msgr2=0x7f2aec0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aec15d240 0x7f2aec0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 -- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 msgr2=0x7f2aec158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 0x7f2aec158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 -- 172.21.15.46:0/3133743822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40094f0 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 0x7f2aec158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2aebfff700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e190 tx=0x7f2adc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00ee30 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc014420 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec158b70 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0147c0 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.291+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec0cbc90 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.292+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0cba60 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.293+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2adc014b70 con 0x7f2aec0b4e70 2023-10-07T09:07:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.293+0000 7f2ae8ff9700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 0x7f2acc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.293+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2adc085060 con 0x7f2aec0b4e70 2023-10-07T09:07:46.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.294+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 0x7f2acc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.294+0000 7f2af0fa0700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 0x7f2acc0697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2aec089830 tx=0x7f2ae4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.298+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2aec0cba60 con 0x7f2aec0b4e70 2023-10-07T09:07:46.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.490+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2aec0cba60 con 0x7f2aec0b4e70 2023-10-07T09:07:46.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.490+0000 7f2ae8ff9700 1 -- 172.21.15.46:0/3133743822 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v195) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2aec0cba60 con 0x7f2aec0b4e70 2023-10-07T09:07:46.491 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:07:46.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 msgr2=0x7f2acc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 0x7f2acc0697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2aec089830 tx=0x7f2ae4016000 comp rx=0 tx=0).stop 2023-10-07T09:07:46.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 msgr2=0x7f2aec14e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e190 tx=0x7f2adc009920 comp rx=0 tx=0).stop 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 shutdown_connections 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2acc067320 0x7f2acc0697d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aec15d240 0x7f2aec0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aec0b16d0 0x7f2aec158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 --2- 172.21.15.46:0/3133743822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aec0b4e70 0x7f2aec14e060 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 >> 172.21.15.46:0/3133743822 conn(0x7f2aec0d10c0 msgr2=0x7f2aec1590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 shutdown_connections 2023-10-07T09:07:46.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.492+0000 7f2af1fa2700 1 -- 172.21.15.46:0/3133743822 wait complete. 2023-10-07T09:07:46.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T09:07:46.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.623+0000 7fd0d64bb700 1 Processor -- start 2023-10-07T09:07:46.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.623+0000 7fd0d64bb700 1 -- start start 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0d64bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0d015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0d64bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d015d2b0 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0d64bb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d015c480 con 0x7fd0d0159c10 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0d64bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b2a40 con 0x7fd0d015c910 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0cf7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd0d00b5ea0 0x7fd0d0068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40996/0 (socket says 172.21.15.46:40996) 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.624+0000 7fd0cf7fe700 1 -- 172.21.15.46:0/3882918493 learned_addr learned my addr 172.21.15.46:0/3882918493 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:46.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0d4a58700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0d015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080830872 0 0) 0x7fd0c4001110 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b8003570 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056227155 0 0) 0x7fd0b8003570 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 msgr2=0x7fd0d015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0d015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 >> v1:172.21.15.133:6789/0 conn(0x7fd0d0159c10 legacy=0x7fd0d015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d015b870 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fd0c4001600 con 0x7fd0d00b5ea0 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 >> v1:172.21.15.46:6789/0 conn(0x7fd0d00b5ea0 legacy=0x7fd0d0068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8003a90 0x7fd0b8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0b8005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b800bbf0 con 0x7fd0b8004810 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b800bd30 con 0x7fd0b8003a90 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b800bec0 con 0x7fd0d015c910 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0cffff700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8003a90 0x7fd0b8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0d4a58700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0b8005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0cf7fe700 1 -- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 msgr2=0x7fd0b8005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.625+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d015c910 0x7fd0b8005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0cf7fe700 1 -- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8003a90 msgr2=0x7fd0b8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8003a90 0x7fd0b8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0cf7fe700 1 -- 172.21.15.46:0/3882918493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8003570 con 0x7fd0b8004810 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0cffff700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8003a90 0x7fd0b8003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0b8004c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c3f0 tx=0x7fd0c40079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21405bc58b92020 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400cce0 con 0x7fd0b8004810 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400ce60 con 0x7fd0b8004810 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0ceffd700 1 -- 172.21.15.46:0/3882918493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4005b70 con 0x7fd0b8004810 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3882918493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 msgr2=0x7fd0b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3882918493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0b8004c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c3f0 tx=0x7fd0c40079d0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d4a58700 1 -- 172.21.15.46:0/3882918493 reap_dead start 2023-10-07T09:07:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3882918493 shutdown_connections 2023-10-07T09:07:46.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3882918493 >> 172.21.15.46:0/3882918493 conn(0x7fd0d0099a20 msgr2=0x7fd0d00af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3882918493 shutdown_connections 2023-10-07T09:07:46.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.626+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3882918493 wait complete. 2023-10-07T09:07:46.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.627+0000 7fd0d64bb700 1 Processor -- start 2023-10-07T09:07:46.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 -- start start 2023-10-07T09:07:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0d00aeff0 0x7fd0d0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d016a490 0x7fd0d009d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00af5b0 con 0x7fd0b8004810 2023-10-07T09:07:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ad430 con 0x7fd0d00aeff0 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0d64bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ad710 con 0x7fd0d016a490 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.628+0000 7fd0cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52022/0 (socket says 172.21.15.46:52022) 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 -- 172.21.15.46:0/3636767657 learned_addr learned my addr 172.21.15.46:0/3636767657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0d00aeff0 0x7fd0d0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0d4a58700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d016a490 0x7fd0d009d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 -- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d016a490 msgr2=0x7fd0d009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d016a490 0x7fd0d009d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 -- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0d00aeff0 msgr2=0x7fd0d0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0d00aeff0 0x7fd0d0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 -- 172.21.15.46:0/3636767657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00ad9f0 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0cffff700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000e7c0 tx=0x7fd0c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0017070 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0006820 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00adcd0 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0006be0 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.629+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d009d8c0 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.630+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d004c3c0 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.630+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd0c0006d40 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.631+0000 7fd0b7fff700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 0x7fd0bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.631+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd0c0084510 con 0x7fd0b8004810 2023-10-07T09:07:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.631+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 0x7fd0bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.632+0000 7fd0cf7fe700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 0x7fd0bc0697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c390 tx=0x7fd0c4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.635+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0c00514f0 con 0x7fd0b8004810 2023-10-07T09:07:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.830+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0d015bb50 con 0x7fd0b8004810 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.831+0000 7fd0b7fff700 1 -- 172.21.15.46:0/3636767657 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v195) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd0c0054b10 con 0x7fd0b8004810 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-07T09:07:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-07T09:07:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:46.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 msgr2=0x7fd0bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 0x7fd0bc0697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c390 tx=0x7fd0c4015000 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 msgr2=0x7fd0d00ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000e7c0 tx=0x7fd0c0009040 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 shutdown_connections 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd0bc067320 0x7fd0bc0697d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0d016a490 0x7fd0d009d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0b8004810 0x7fd0d00ae1f0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 --2- 172.21.15.46:0/3636767657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0d00aeff0 0x7fd0d0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 >> 172.21.15.46:0/3636767657 conn(0x7fd0d0099a20 msgr2=0x7fd0d00d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 shutdown_connections 2023-10-07T09:07:46.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.833+0000 7fd0d64bb700 1 -- 172.21.15.46:0/3636767657 wait complete. 2023-10-07T09:07:46.846 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T09:07:46.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T09:07:46.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.968+0000 7f3c446b7700 1 Processor -- start 2023-10-07T09:07:46.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.968+0000 7f3c446b7700 1 -- start start 2023-10-07T09:07:46.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c446b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c0cd910 0x7f3c3c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c446b7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c446b7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0b5b00 con 0x7f3c3c159ec0 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c446b7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b5da0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c446b7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b6080 con 0x7f3c3c0cd910 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52028/0 (socket says 172.21.15.46:52028) 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 -- 172.21.15.46:0/2520756391 learned_addr learned my addr 172.21.15.46:0/2520756391 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c41c52700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c0cd910 0x7f3c3c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 -- 172.21.15.46:0/2520756391 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c0cd910 msgr2=0x7f3c3c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c0cd910 0x7f3c3c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 -- 172.21.15.46:0/2520756391 >> v1:172.21.15.133:6789/0 conn(0x7f3c3c159ec0 legacy=0x7f3c3c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 -- 172.21.15.46:0/2520756391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0cc100 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.969+0000 7f3c42c54700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009f20 tx=0x7f3c34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6945b6739a858c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c41451700 1 -- 172.21.15.46:0/2520756391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400e070 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c41451700 1 -- 172.21.15.46:0/2520756391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3400ba80 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c41451700 1 -- 172.21.15.46:0/2520756391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c340092e0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 -- 172.21.15.46:0/2520756391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 msgr2=0x7f3c3c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009f20 tx=0x7f3c34009840 comp rx=0 tx=0).stop 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 -- 172.21.15.46:0/2520756391 shutdown_connections 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c0ce880 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 --2- 172.21.15.46:0/2520756391 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c0cd910 0x7f3c3c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 -- 172.21.15.46:0/2520756391 >> 172.21.15.46:0/2520756391 conn(0x7f3c3c0999f0 msgr2=0x7f3c3c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 -- 172.21.15.46:0/2520756391 shutdown_connections 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.970+0000 7f3c446b7700 1 -- 172.21.15.46:0/2520756391 wait complete. 2023-10-07T09:07:46.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.971+0000 7f3c446b7700 1 Processor -- start 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.971+0000 7f3c446b7700 1 -- start start 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c159ec0 0x7f3c3c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 0x7f3c3c068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c153940 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c152d30 con 0x7f3c3c1558f0 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c446b7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c153010 con 0x7f3c3c159ec0 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c42453700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c42453700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52032/0 (socket says 172.21.15.46:52032) 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c42453700 1 -- 172.21.15.46:0/3714992509 learned_addr learned my addr 172.21.15.46:0/3714992509 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c41c52700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c159ec0 0x7f3c3c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.972+0000 7f3c42c54700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 0x7f3c3c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 -- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c159ec0 msgr2=0x7f3c3c1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c159ec0 0x7f3c3c1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 -- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 msgr2=0x7f3c3c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 0x7f3c3c068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 -- 172.21.15.46:0/3714992509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009ae0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42c54700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 0x7f3c3c068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c42453700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c540 tx=0x7f3c38001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38011590 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c380116f0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c1532f0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38011ab0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.973+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c1529e0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.974+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c063c90 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.974+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c3801b3b0 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.975+0000 7f3c327fc700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 0x7f3c200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:46.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.975+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c38083c50 con 0x7f3c3c0b55a0 2023-10-07T09:07:46.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.975+0000 7f3c41c52700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 0x7f3c200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:46.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.976+0000 7f3c41c52700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 0x7f3c200697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0b6530 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:46.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:46.979+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c38050ce0 con 0x7f3c3c0b55a0 2023-10-07T09:07:47.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.171+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3c3c153c20 con 0x7f3c3c0b55a0 2023-10-07T09:07:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.971+0000 7f3c327fc700 1 -- 172.21.15.46:0/3714992509 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v196) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3c38017070 con 0x7f3c3c0b55a0 2023-10-07T09:07:47.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 msgr2=0x7f3c200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:47.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 0x7f3c200697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0b6530 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2023-10-07T09:07:47.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 msgr2=0x7f3c3c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c540 tx=0x7f3c38001070 comp rx=0 tx=0).stop 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 shutdown_connections 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3c20067320 0x7f3c200697d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c3c1558f0 0x7f3c3c068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c3c0b55a0 0x7f3c3c153dd0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 --2- 172.21.15.46:0/3714992509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c3c159ec0 0x7f3c3c1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 >> 172.21.15.46:0/3714992509 conn(0x7f3c3c0999f0 msgr2=0x7f3c3c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 shutdown_connections 2023-10-07T09:07:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:47.979+0000 7f3c446b7700 1 -- 172.21.15.46:0/3714992509 wait complete. 2023-10-07T09:07:47.982 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-07T09:07:47.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T09:07:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.127+0000 7f95aabc1700 1 Processor -- start 2023-10-07T09:07:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.127+0000 7f95aabc1700 1 -- start start 2023-10-07T09:07:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95aabc1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95a4159950 0x7f95a40cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:48.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95aabc1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a40ce380 con 0x7f95a40af320 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95aabc1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a40cec20 con 0x7f95a4069c70 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95aabc1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a40afa90 con 0x7f95a4159950 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95a40af320 0x7f95a4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41004/0 (socket says 172.21.15.46:41004) 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959bfff700 1 -- 172.21.15.46:0/1779471210 learned_addr learned my addr 172.21.15.46:0/1779471210 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95a895d700 1 --2- 172.21.15.46:0/1779471210 >> v2:172.21.15.133:3300/0 conn(0x7f95a4159950 0x7f95a40cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388798129 0 0) 0x7f95a40ce380 con 0x7f95a40af320 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c003570 con 0x7f95a40af320 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279382235 0 0) 0x7f95a40cec20 con 0x7f95a4069c70 2023-10-07T09:07:48.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a40ce380 con 0x7f95a4069c70 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95a895d700 1 -- 172.21.15.46:0/1779471210 >> v1:172.21.15.133:6789/0 conn(0x7f95a4069c70 legacy=0x7f95a40cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95a895d700 1 -- 172.21.15.46:0/1779471210 >> v1:172.21.15.46:6789/0 conn(0x7f95a40af320 legacy=0x7f95a4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95a895d700 1 -- 172.21.15.46:0/1779471210 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40ce5d0 con 0x7f95a4159950 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.128+0000 7f95a895d700 1 --2- 172.21.15.46:0/1779471210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a4159950 0x7f95a40cbb90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f95a00098e0 tx=0x7f95a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f5e1f299b5be04 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0011630 con 0x7f95a4159950 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0011790 con 0x7f95a4159950 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f959b7fe700 1 -- 172.21.15.46:0/1779471210 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0011b30 con 0x7f95a4159950 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 -- 172.21.15.46:0/1779471210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a4159950 msgr2=0x7f95a40cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 --2- 172.21.15.46:0/1779471210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a4159950 0x7f95a40cbb90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f95a00098e0 tx=0x7f95a00091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 -- 172.21.15.46:0/1779471210 shutdown_connections 2023-10-07T09:07:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 --2- 172.21.15.46:0/1779471210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a4159950 0x7f95a40cbb90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 -- 172.21.15.46:0/1779471210 >> 172.21.15.46:0/1779471210 conn(0x7f95a4068e00 msgr2=0x7f95a40d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 -- 172.21.15.46:0/1779471210 shutdown_connections 2023-10-07T09:07:48.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.129+0000 7f95aabc1700 1 -- 172.21.15.46:0/1779471210 wait complete. 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.130+0000 7f95aabc1700 1 Processor -- start 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.130+0000 7f95aabc1700 1 -- start start 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40af320 0x7f95a416dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 0x7f95a415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c8e80 con 0x7f95a4069c70 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a416e1e0 con 0x7f95a40af320 2023-10-07T09:07:48.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95aabc1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c8270 con 0x7f95a4159950 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95a895d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95a895d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52034/0 (socket says 172.21.15.46:52034) 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95a895d700 1 -- 172.21.15.46:0/3027064199 learned_addr learned my addr 172.21.15.46:0/3027064199 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f959bfff700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40af320 0x7f95a416dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.131+0000 7f95a915e700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 0x7f95a415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:48.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 -- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 msgr2=0x7f95a415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 0x7f95a415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 -- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40af320 msgr2=0x7f95a416dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40af320 0x7f95a416dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 -- 172.21.15.46:0/3027064199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009420 con 0x7f95a4069c70 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a915e700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 0x7f95a415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95a895d700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f95a4070e20 tx=0x7f95a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0011900 con 0x7f95a4069c70 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0011a80 con 0x7f95a4069c70 2023-10-07T09:07:48.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a40c8550 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a001a680 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.132+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a40c8b10 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.133+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40718b0 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.133+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f95a001aa30 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.134+0000 7f9598ff9700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.134+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f95a0086480 con 0x7f95a4069c70 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.134+0000 7f959bfff700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:48.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.134+0000 7f959bfff700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f95a4153d30 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:48.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.138+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95a00533f0 con 0x7f95a4069c70 2023-10-07T09:07:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.331+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95a40ce8b0 con 0x7f95a4069c70 2023-10-07T09:07:48.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.979+0000 7f9598ff9700 1 -- 172.21.15.46:0/3027064199 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v197) v1 ==== 170+0+0 (secure 0 0 0) 0x7f95a0056a10 con 0x7f95a4069c70 2023-10-07T09:07:48.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.985+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 msgr2=0x7f95900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.985+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f95a4153d30 tx=0x7f9594009040 comp rx=0 tx=0).stop 2023-10-07T09:07:48.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.985+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 msgr2=0x7f95a4152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:48.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.985+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f95a4070e20 tx=0x7f95a0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 shutdown_connections 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a4159950 0x7f95a415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4069c70 0x7f95a4152280 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 --2- 172.21.15.46:0/3027064199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40af320 0x7f95a416dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.986+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 >> 172.21.15.46:0/3027064199 conn(0x7f95a4068e00 msgr2=0x7f95a4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.989+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 shutdown_connections 2023-10-07T09:07:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:48.990+0000 7f95aabc1700 1 -- 172.21.15.46:0/3027064199 wait complete. 2023-10-07T09:07:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-07T09:07:49.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T09:07:49.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.138+0000 7f7e9ca1f700 1 Processor -- start 2023-10-07T09:07:49.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.138+0000 7f7e9ca1f700 1 -- start start 2023-10-07T09:07:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9ca1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e980b4e70 0x7f7e980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9ca1f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e980b16d0 0x7f7e980b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9ca1f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980b2080 con 0x7f7e9815d240 2023-10-07T09:07:49.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9ca1f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980cfb00 con 0x7f7e980b16d0 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9ca1f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980b5c40 con 0x7f7e980b4e70 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e980b16d0 0x7f7e980b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e980b16d0 0x7f7e980b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52048/0 (socket says 172.21.15.46:52048) 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 -- 172.21.15.46:0/1244472147 learned_addr learned my addr 172.21.15.46:0/1244472147 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e96d9d700 1 --2- 172.21.15.46:0/1244472147 >> v2:172.21.15.133:3300/0 conn(0x7f7e980b4e70 0x7f7e980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 -- 172.21.15.46:0/1244472147 >> v2:172.21.15.133:3300/0 conn(0x7f7e980b4e70 msgr2=0x7f7e980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 --2- 172.21.15.46:0/1244472147 >> v2:172.21.15.133:3300/0 conn(0x7f7e980b4e70 0x7f7e980ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 -- 172.21.15.46:0/1244472147 >> v1:172.21.15.133:6789/0 conn(0x7f7e9815d240 legacy=0x7f7e9815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.139+0000 7f7e9659c700 1 -- 172.21.15.46:0/1244472147 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980b5f20 con 0x7f7e980b16d0 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9659c700 1 --2- 172.21.15.46:0/1244472147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e980b16d0 0x7f7e980b1b40 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7e98064910 tx=0x7f7e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4412dceed48334dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:49.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e95d9b700 1 -- 172.21.15.46:0/1244472147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000b860 con 0x7f7e980b16d0 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e95d9b700 1 -- 172.21.15.46:0/1244472147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8000b9c0 con 0x7f7e980b16d0 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e95d9b700 1 -- 172.21.15.46:0/1244472147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000bd60 con 0x7f7e980b16d0 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1244472147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e980b16d0 msgr2=0x7f7e980b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1244472147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e980b16d0 0x7f7e980b1b40 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7e98064910 tx=0x7f7e80009250 comp rx=0 tx=0).stop 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1244472147 shutdown_connections 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1244472147 >> v2:172.21.15.133:3300/0 conn(0x7f7e980b4e70 0x7f7e980ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1244472147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e980b16d0 0x7f7e980b1b40 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1244472147 >> 172.21.15.46:0/1244472147 conn(0x7f7e980d10c0 msgr2=0x7f7e980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1244472147 shutdown_connections 2023-10-07T09:07:49.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.140+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1244472147 wait complete. 2023-10-07T09:07:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 Processor -- start 2023-10-07T09:07:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 -- start start 2023-10-07T09:07:49.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e980b16d0 0x7f7e980a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980b4e70 0x7f7e980cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980ca070 con 0x7f7e9815d240 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980cc240 con 0x7f7e980b4e70 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9ca1f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c9460 con 0x7f7e980b16d0 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52058/0 (socket says 172.21.15.46:52058) 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.142+0000 7f7e9759e700 1 -- 172.21.15.46:0/1758044245 learned_addr learned my addr 172.21.15.46:0/1758044245 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e96d9d700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e980b16d0 0x7f7e980a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9659c700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980b4e70 0x7f7e980cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 -- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e980b16d0 msgr2=0x7f7e980a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e980b16d0 0x7f7e980a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 -- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980b4e70 msgr2=0x7f7e980cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980b4e70 0x7f7e980cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 -- 172.21.15.46:0/1758044245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800094f0 con 0x7f7e9815d240 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9759e700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800c840 tx=0x7f7e88001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88012630 con 0x7f7e9815d240 2023-10-07T09:07:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880127b0 con 0x7f7e9815d240 2023-10-07T09:07:49.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88012b70 con 0x7f7e9815d240 2023-10-07T09:07:49.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c9740 con 0x7f7e9815d240 2023-10-07T09:07:49.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.143+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c9d00 con 0x7f7e9815d240 2023-10-07T09:07:49.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.144+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980ca1e0 con 0x7f7e9815d240 2023-10-07T09:07:49.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.145+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7e8801a3a0 con 0x7f7e9815d240 2023-10-07T09:07:49.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.145+0000 7f7e8effd700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:49.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.145+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7e88084d40 con 0x7f7e9815d240 2023-10-07T09:07:49.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.145+0000 7f7e96d9d700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:49.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.146+0000 7f7e96d9d700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 0x7f7e780697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006fd0 tx=0x7f7e90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:49.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.150+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e88051a30 con 0x7f7e9815d240 2023-10-07T09:07:49.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.388+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7e9804bb80 con 0x7f7e9815d240 2023-10-07T09:07:49.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.987+0000 7f7e8effd700 1 -- 172.21.15.46:0/1758044245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v130) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7e88055050 con 0x7f7e9815d240 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 msgr2=0x7f7e780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 0x7f7e780697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006fd0 tx=0x7f7e90008040 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 msgr2=0x7f7e9814afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800c840 tx=0x7f7e88001670 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 shutdown_connections 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e9815d240 0x7f7e9814afc0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e980b16d0 0x7f7e980a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 --2- 172.21.15.46:0/1758044245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980b4e70 0x7f7e980cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 >> 172.21.15.46:0/1758044245 conn(0x7f7e980d10c0 msgr2=0x7f7e980b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 shutdown_connections 2023-10-07T09:07:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:49.993+0000 7f7e9ca1f700 1 -- 172.21.15.46:0/1758044245 wait complete. 2023-10-07T09:07:49.998 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 33 and data pool 34 2023-10-07T09:07:50.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:50.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.128+0000 7fc6cbd0b700 1 Processor -- start 2023-10-07T09:07:50.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.128+0000 7fc6cbd0b700 1 -- start start 2023-10-07T09:07:50.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6cbd0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6c40c91e0 0x7fc6c40cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6cbd0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6cbd0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40cc210 con 0x7fc6c406aa40 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6cbd0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40cc4f0 con 0x7fc6c40c91e0 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6cbd0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cc7d0 con 0x7fc6c406ae10 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6ca2a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c92a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6c40c91e0 0x7fc6c40cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6ca2a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:58252/0 (socket says 172.21.15.46:58252) 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6ca2a8700 1 -- 172.21.15.46:0/2042263393 learned_addr learned my addr 172.21.15.46:0/2042263393 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c9aa7700 1 --1- 172.21.15.46:0/2042263393 >> v1:172.21.15.133:6789/0 conn(0x7fc6c406aa40 0x7fc6c406bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:35872/0 (socket says 172.21.15.46:35872) 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c92a6700 1 -- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 msgr2=0x7fc6c406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:50.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c92a6700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c92a6700 1 -- 172.21.15.46:0/2042263393 >> v1:172.21.15.133:6789/0 conn(0x7fc6c406aa40 legacy=0x7fc6c406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c92a6700 1 -- 172.21.15.46:0/2042263393 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40ccab0 con 0x7fc6c40c91e0 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6c8aa5700 1 -- 172.21.15.46:0/2042263393 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794558685 0 0) 0x7fc6c40cc210 con 0x7fc6c406aa40 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.129+0000 7fc6ca2a8700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6c92a6700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40c91e0 0x7fc6c40cbc00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800bbc0 tx=0x7fc6b800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5ee1af90ea4927e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6c8aa5700 1 -- 172.21.15.46:0/2042263393 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800dae0 con 0x7fc6c40c91e0 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6c8aa5700 1 -- 172.21.15.46:0/2042263393 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800dc40 con 0x7fc6c40c91e0 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6c8aa5700 1 -- 172.21.15.46:0/2042263393 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8019480 con 0x7fc6c40c91e0 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40c91e0 msgr2=0x7fc6c40cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40c91e0 0x7fc6c40cbc00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800bbc0 tx=0x7fc6b800b430 comp rx=0 tx=0).stop 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/2042263393 shutdown_connections 2023-10-07T09:07:50.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c406ae10 0x7fc6c406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/2042263393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40c91e0 0x7fc6c40cbc00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/2042263393 >> 172.21.15.46:0/2042263393 conn(0x7fc6c40cd670 msgr2=0x7fc6c40cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:50.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/2042263393 shutdown_connections 2023-10-07T09:07:50.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.130+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/2042263393 wait complete. 2023-10-07T09:07:50.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 Processor -- start 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 -- start start 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c406aa40 0x7fc6c4154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c40c91e0 0x7fc6c40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4155da0 con 0x7fc6c406ae10 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4155190 con 0x7fc6c406aa40 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6cbd0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4155470 con 0x7fc6c40c91e0 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6c92a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6c92a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32994/0 (socket says 172.21.15.46:32994) 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.132+0000 7fc6c92a6700 1 -- 172.21.15.46:0/1210485256 learned_addr learned my addr 172.21.15.46:0/1210485256 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c9aa7700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c406aa40 0x7fc6c4154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6ca2a8700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c40c91e0 0x7fc6c40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 -- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c40c91e0 msgr2=0x7fc6c40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c40c91e0 0x7fc6c40b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 -- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c406aa40 msgr2=0x7fc6c4154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c406aa40 0x7fc6c4154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 -- 172.21.15.46:0/1210485256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40094f0 con 0x7fc6c406ae10 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c92a6700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b2c0 tx=0x7fc6b801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8010470 con 0x7fc6c406ae10 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b80105d0 con 0x7fc6c406ae10 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b800b6d0 con 0x7fc6c406ae10 2023-10-07T09:07:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8010990 con 0x7fc6c406ae10 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.133+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c4155a30 con 0x7fc6c406ae10 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.134+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c404c3c0 con 0x7fc6c406ae10 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.135+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc6b802d440 con 0x7fc6c406ae10 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.135+0000 7fc6c1ffb700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 0x7fc6b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.135+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6b8020070 con 0x7fc6c406ae10 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.135+0000 7fc6c9aa7700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 0x7fc6b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.136+0000 7fc6c9aa7700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 0x7fc6b00697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0022a0 tx=0x7fc6bc001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.139+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6b80537b0 con 0x7fc6c406ae10 2023-10-07T09:07:50.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.334+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c4155ee0 con 0x7fc6c406ae10 2023-10-07T09:07:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.335+0000 7fc6c1ffb700 1 -- 172.21.15.46:0/1210485256 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fc6b8056dd0 con 0x7fc6c406ae10 2023-10-07T09:07:50.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:50.336 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":198,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:49.389650+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 msgr2=0x7fc6b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 0x7fc6b00697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0022a0 tx=0x7fc6bc001ad0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 msgr2=0x7fc6c40b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b2c0 tx=0x7fc6b801b000 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 shutdown_connections 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6b0067320 0x7fc6b00697d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc6c40c91e0 0x7fc6c40b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c406aa40 0x7fc6c4154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 --2- 172.21.15.46:0/1210485256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6c406ae10 0x7fc6c40b0fe0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 >> 172.21.15.46:0/1210485256 conn(0x7fc6c40cd670 msgr2=0x7fc6c41524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:50.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 shutdown_connections 2023-10-07T09:07:50.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.337+0000 7fc6cbd0b700 1 -- 172.21.15.46:0/1210485256 wait complete. 2023-10-07T09:07:50.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.468+0000 7fd5d09ec700 1 Processor -- start 2023-10-07T09:07:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.468+0000 7fd5d09ec700 1 -- start start 2023-10-07T09:07:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5d09ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 0x7fd5cc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5d09ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5cc06c0a0 0x7fd5cc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5d09ec700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc15d7e0 con 0x7fd5cc15df50 2023-10-07T09:07:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5d09ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc15dac0 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5d09ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc15aa30 con 0x7fd5cc06bcd0 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5cad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5cc15df50 0x7fd5cc0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47706/0 (socket says 172.21.15.46:47706) 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5cad9d700 1 -- 172.21.15.46:0/198114750 learned_addr learned my addr 172.21.15.46:0/198114750 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5ca59c700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 0x7fd5cc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.469+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/198114750 >> v2:172.21.15.133:3300/0 conn(0x7fd5cc06c0a0 0x7fd5cc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c959a700 1 -- 172.21.15.46:0/198114750 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181378668 0 0) 0x7fd5cc15d7e0 con 0x7fd5cc15df50 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c959a700 1 -- 172.21.15.46:0/198114750 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b8003570 con 0x7fd5cc15df50 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 msgr2=0x7fd5cc0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 0x7fd5cc0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/198114750 >> v1:172.21.15.46:6789/0 conn(0x7fd5cc15df50 legacy=0x7fd5cc0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/198114750 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc15ad10 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5ca59c700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 0x7fd5cc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc15a1e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098e0 tx=0x7fd5b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701818e53bb61c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c959a700 1 -- 172.21.15.46:0/198114750 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4011630 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c959a700 1 -- 172.21.15.46:0/198114750 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4011790 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.470+0000 7fd5c959a700 1 -- 172.21.15.46:0/198114750 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4011b30 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 -- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06c0a0 msgr2=0x7fd5cc15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc15a1e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098e0 tx=0x7fd5b40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 -- 172.21.15.46:0/198114750 shutdown_connections 2023-10-07T09:07:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc06bcd0 0x7fd5cc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/198114750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc15a1e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 -- 172.21.15.46:0/198114750 >> 172.21.15.46:0/198114750 conn(0x7fd5cc0ce600 msgr2=0x7fd5cc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 -- 172.21.15.46:0/198114750 shutdown_connections 2023-10-07T09:07:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.471+0000 7fd5d09ec700 1 -- 172.21.15.46:0/198114750 wait complete. 2023-10-07T09:07:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.472+0000 7fd5d09ec700 1 Processor -- start 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.472+0000 7fd5d09ec700 1 -- start start 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06bcd0 0x7fd5cc155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc15df50 0x7fd5cc1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c66b0 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b4110 con 0x7fd5cc06bcd0 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5d09ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c60f0 con 0x7fd5cc15df50 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32998/0 (socket says 172.21.15.46:32998) 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/2038574537 learned_addr learned my addr 172.21.15.46:0/2038574537 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5ca59c700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06bcd0 0x7fd5cc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5cad9d700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc15df50 0x7fd5cc1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc15df50 msgr2=0x7fd5cc1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc15df50 0x7fd5cc1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06bcd0 msgr2=0x7fd5cc155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06bcd0 0x7fd5cc155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 -- 172.21.15.46:0/2038574537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009a20 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c9d9b700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009ed0 tx=0x7fd5b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.473+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4000d10 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.474+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4011b10 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.474+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4009420 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.474+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4025620 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.474+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc0b3310 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.475+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc04c3c0 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.475+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd5b4025a50 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.475+0000 7fd5c27fc700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 0x7fd5ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.476+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5b4086300 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.476+0000 7fd5ca59c700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 0x7fd5ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.476+0000 7fd5ca59c700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 0x7fd5ac0697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0c5fe0 tx=0x7fd5c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.480+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5b4052f90 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.673+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5cc15aff0 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.674+0000 7fd5c27fc700 1 -- 172.21.15.46:0/2038574537 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fd5b40565b0 con 0x7fd5cc06c0a0 2023-10-07T09:07:50.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:50.675 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":198,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:49.389650+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:50.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 msgr2=0x7fd5ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 0x7fd5ac0697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0c5fe0 tx=0x7fd5c400b040 comp rx=0 tx=0).stop 2023-10-07T09:07:50.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 msgr2=0x7fd5cc0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009ed0 tx=0x7fd5b4017000 comp rx=0 tx=0).stop 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 shutdown_connections 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd5ac067320 0x7fd5ac0697d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5cc15df50 0x7fd5cc1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5cc06bcd0 0x7fd5cc155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 --2- 172.21.15.46:0/2038574537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5cc06c0a0 0x7fd5cc0b3830 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 >> 172.21.15.46:0/2038574537 conn(0x7fd5cc0ce600 msgr2=0x7fd5cc159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.676+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 shutdown_connections 2023-10-07T09:07:50.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.677+0000 7fd5d09ec700 1 -- 172.21.15.46:0/2038574537 wait complete. 2023-10-07T09:07:50.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T09:07:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.811+0000 7ff1ee4d4700 1 Processor -- start 2023-10-07T09:07:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.811+0000 7ff1ee4d4700 1 -- start start 2023-10-07T09:07:50.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ee4d4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 0x7ff1e80c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ee4d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 0x7ff1e80c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ee4d4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e80ca920 con 0x7ff1e8068390 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ee4d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e806af00 con 0x7ff1e806bfa0 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ee4d4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e806b1e0 con 0x7ff1e8159a70 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1edcd3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff1e8068390 0x7ff1e80caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47720/0 (socket says 172.21.15.46:47720) 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1edcd3700 1 -- 172.21.15.46:0/337858130 learned_addr learned my addr 172.21.15.46:0/337858130 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/337858130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 0x7ff1e80c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.812+0000 7ff1eccd1700 1 --2- 172.21.15.46:0/337858130 >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 0x7ff1e80c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1dffff700 1 -- 172.21.15.46:0/337858130 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52183315 0 0) 0x7ff1e80ca920 con 0x7ff1e8068390 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1dffff700 1 -- 172.21.15.46:0/337858130 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d4003570 con 0x7ff1e8068390 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1ed4d2700 1 -- 172.21.15.46:0/337858130 >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 msgr2=0x7ff1e80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/337858130 >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 0x7ff1e80c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1ed4d2700 1 -- 172.21.15.46:0/337858130 >> v1:172.21.15.46:6789/0 conn(0x7ff1e8068390 legacy=0x7ff1e80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1ed4d2700 1 -- 172.21.15.46:0/337858130 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e806b4c0 con 0x7ff1e8159a70 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1eccd1700 1 --2- 172.21.15.46:0/337858130 >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 0x7ff1e80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/337858130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 0x7ff1e80c82f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009e60 tx=0x7ff1e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e631f05b98720b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1dffff700 1 -- 172.21.15.46:0/337858130 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400e070 con 0x7ff1e8159a70 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1dffff700 1 -- 172.21.15.46:0/337858130 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400bab0 con 0x7ff1e8159a70 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.813+0000 7ff1dffff700 1 -- 172.21.15.46:0/337858130 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400be30 con 0x7ff1e8159a70 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/337858130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 msgr2=0x7ff1e80c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/337858130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 0x7ff1e80c82f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009e60 tx=0x7ff1e4009780 comp rx=0 tx=0).stop 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/337858130 shutdown_connections 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/337858130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8159a70 0x7ff1e80c82f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/337858130 >> v2:172.21.15.133:3300/0 conn(0x7ff1e806bfa0 0x7ff1e80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/337858130 >> 172.21.15.46:0/337858130 conn(0x7ff1e80cddc0 msgr2=0x7ff1e80c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:50.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/337858130 shutdown_connections 2023-10-07T09:07:50.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.814+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/337858130 wait complete. 2023-10-07T09:07:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.815+0000 7ff1ee4d4700 1 Processor -- start 2023-10-07T09:07:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.815+0000 7ff1ee4d4700 1 -- start start 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 0x7ff1e8158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 0x7ff1e8156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8146880 con 0x7ff1e806bfa0 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e815d020 con 0x7ff1e8159a70 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ee4d4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e815c410 con 0x7ff1e8068390 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33010/0 (socket says 172.21.15.46:33010) 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 -- 172.21.15.46:0/52772910 learned_addr learned my addr 172.21.15.46:0/52772910 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1edcd3700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 0x7ff1e8156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 0x7ff1e8158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 -- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 msgr2=0x7ff1e8158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 0x7ff1e8158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 -- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 msgr2=0x7ff1e8156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 0x7ff1e8156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 -- 172.21.15.46:0/52772910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80093c0 con 0x7ff1e806bfa0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 0x7ff1e8158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1edcd3700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 0x7ff1e8156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.816+0000 7ff1eccd1700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800ec80 tx=0x7ff1d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.817+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8005a00 con 0x7ff1e806bfa0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.817+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8005b60 con 0x7ff1e806bfa0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.817+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800c9d0 con 0x7ff1e806bfa0 2023-10-07T09:07:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.817+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4009a20 con 0x7ff1e806bfa0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.817+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e815ccb0 con 0x7ff1e806bfa0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.818+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e80c8bb0 con 0x7ff1e806bfa0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.818+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff1d800cd80 con 0x7ff1e806bfa0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.818+0000 7ff1dd7fa700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 0x7ff1cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.819+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1d80851e0 con 0x7ff1e806bfa0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.819+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 0x7ff1cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.819+0000 7ff1ed4d2700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 0x7ff1cc0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40099a0 tx=0x7ff1e4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:50.823+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d8051e70 con 0x7ff1e806bfa0 2023-10-07T09:07:51.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:51.064+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff1e806b7a0 con 0x7ff1e806bfa0 2023-10-07T09:07:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.005+0000 7ff1dd7fa700 1 -- 172.21.15.46:0/52772910 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v133) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff1d8055490 con 0x7ff1e806bfa0 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 msgr2=0x7ff1cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 0x7ff1cc0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40099a0 tx=0x7ff1e4019000 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 msgr2=0x7ff1e80c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800ec80 tx=0x7ff1d8009120 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 shutdown_connections 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff1cc067320 0x7ff1cc0697d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e8159a70 0x7ff1e8156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e8068390 0x7ff1e8158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 --2- 172.21.15.46:0/52772910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e806bfa0 0x7ff1e80c6560 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 >> 172.21.15.46:0/52772910 conn(0x7ff1e80cddc0 msgr2=0x7ff1e80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:52.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 shutdown_connections 2023-10-07T09:07:52.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.008+0000 7ff1ee4d4700 1 -- 172.21.15.46:0/52772910 wait complete. 2023-10-07T09:07:52.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T09:07:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.152+0000 7f5bb11a7700 1 Processor -- start 2023-10-07T09:07:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.152+0000 7f5bb11a7700 1 -- start start 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5bb11a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5bac0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5bb11a7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac069ee0 con 0x7f5bac159890 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5bb11a7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac15a160 con 0x7f5bac159c60 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5bb11a7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0d13a0 con 0x7f5bac069560 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5baad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5bac159890 0x7f5bac15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47726/0 (socket says 172.21.15.46:47726) 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5baad9d700 1 -- 172.21.15.46:0/3985182137 learned_addr learned my addr 172.21.15.46:0/3985182137 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5bab59e700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5bac0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064665387 0 0) 0x7f5bac069ee0 con 0x7f5bac159890 2023-10-07T09:07:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b94003570 con 0x7f5bac159890 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1602551064 0 0) 0x7f5b94003570 con 0x7f5bac159890 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 msgr2=0x7f5bac0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5bac0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 >> v1:172.21.15.133:6789/0 conn(0x7f5bac159c60 legacy=0x7f5bac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac15e140 con 0x7f5bac159890 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5b9c001470 con 0x7f5bac159890 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 >> v1:172.21.15.46:6789/0 conn(0x7f5bac159890 legacy=0x7f5bac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b94003a90 0x7f5b94003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b94004810 0x7f5b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5b940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0d13a0 con 0x7f5b94004810 2023-10-07T09:07:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9400bb40 con 0x7f5b94003a90 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.153+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9400bd00 con 0x7f5bac069560 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b94004810 0x7f5b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baad9d700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b94003a90 0x7f5b94003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5bab59e700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5b940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 -- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 msgr2=0x7f5b940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bac069560 0x7f5b940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 -- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b94003a90 msgr2=0x7f5b94003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b94003a90 0x7f5b94003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 -- 172.21.15.46:0/3985182137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94003570 con 0x7f5b94004810 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b94004810 0x7f5b94004c80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001970 tx=0x7f5ba0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66a0d42df749b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000c5d0 con 0x7f5b94004810 2023-10-07T09:07:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000c730 con 0x7f5b94004810 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.154+0000 7f5ba9d9b700 1 -- 172.21.15.46:0/3985182137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000cad0 con 0x7f5b94004810 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3985182137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b94004810 msgr2=0x7f5b94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3985182137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b94004810 0x7f5b94004c80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001970 tx=0x7f5ba0007d30 comp rx=0 tx=0).stop 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bab59e700 1 -- 172.21.15.46:0/3985182137 reap_dead start 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3985182137 shutdown_connections 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3985182137 >> 172.21.15.46:0/3985182137 conn(0x7f5bac068e20 msgr2=0x7f5bac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3985182137 shutdown_connections 2023-10-07T09:07:52.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.155+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3985182137 wait complete. 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.156+0000 7f5bb11a7700 1 Processor -- start 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.156+0000 7f5bb11a7700 1 -- start start 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 0x7f5bac14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bac15c540 0x7f5bac15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0cb810 con 0x7f5bac0cae60 2023-10-07T09:07:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac15de60 con 0x7f5bac15c540 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bb11a7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac14d890 con 0x7f5b94004810 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33030/0 (socket says 172.21.15.46:33030) 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 -- 172.21.15.46:0/3364059301 learned_addr learned my addr 172.21.15.46:0/3364059301 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5bab59e700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bac15c540 0x7f5bac15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baad9d700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 0x7f5bac14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 -- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 msgr2=0x7f5bac14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 0x7f5bac14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 -- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bac15c540 msgr2=0x7f5bac15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bac15c540 0x7f5bac15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 -- 172.21.15.46:0/3364059301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac15d2e0 con 0x7f5bac0cae60 2023-10-07T09:07:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baad9d700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 0x7f5bac14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5baa59c700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c3c0 tx=0x7f5ba0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.157+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000c5d0 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.158+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000cab0 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.158+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac15d5c0 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.158+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0006a70 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.158+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac15db80 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.159+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac0b3590 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.159+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5ba0019070 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.159+0000 7f5b92ffd700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 0x7f5b980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.159+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ba0085640 con 0x7f5bac0cae60 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.160+0000 7f5baad9d700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 0x7f5b980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.160+0000 7f5baad9d700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 0x7f5b980697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0015a0 tx=0x7f5b9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.164+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bac0b3590 con 0x7f5bac0cae60 2023-10-07T09:07:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:52.404+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5bac0b3590 con 0x7f5bac0cae60 2023-10-07T09:07:53.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.006+0000 7f5b92ffd700 1 -- 172.21.15.46:0/3364059301 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v134) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5bac0b3590 con 0x7f5bac0cae60 2023-10-07T09:07:53.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.008+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 msgr2=0x7f5b980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.008+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 0x7f5b980697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0015a0 tx=0x7f5b9c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:53.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.008+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 msgr2=0x7f5bac0cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.008+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c3c0 tx=0x7f5ba0015000 comp rx=0 tx=0).stop 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 shutdown_connections 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5b98067320 0x7f5b980697d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bac15c540 0x7f5bac15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b94004810 0x7f5bac14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 --2- 172.21.15.46:0/3364059301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bac0cae60 0x7f5bac0cb2d0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 >> 172.21.15.46:0/3364059301 conn(0x7f5bac068e20 msgr2=0x7f5bac0b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 shutdown_connections 2023-10-07T09:07:53.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.009+0000 7f5bb11a7700 1 -- 172.21.15.46:0/3364059301 wait complete. 2023-10-07T09:07:53.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.147+0000 7f857f33d700 1 Processor -- start 2023-10-07T09:07:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 -- start start 2023-10-07T09:07:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 0x7f857815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857815a160 con 0x7f857815db10 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780d13a0 con 0x7f8578159890 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.148+0000 7f857f33d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857815e140 con 0x7f8578159c60 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857d0d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 0x7f857815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:58314/0 (socket says 172.21.15.46:58314) 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 -- 172.21.15.46:0/330830425 learned_addr learned my addr 172.21.15.46:0/330830425 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857d8da700 1 --1- 172.21.15.46:0/330830425 >> v1:172.21.15.133:6789/0 conn(0x7f857815db10 0x7f8578069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:35892/0 (socket says 172.21.15.46:35892) 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f8577fff700 1 -- 172.21.15.46:0/330830425 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234087922 0 0) 0x7f857815a160 con 0x7f857815db10 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f8577fff700 1 -- 172.21.15.46:0/330830425 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003570 con 0x7f857815db10 2023-10-07T09:07:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 -- 172.21.15.46:0/330830425 >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 msgr2=0x7f857815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 --2- 172.21.15.46:0/330830425 >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 0x7f857815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 -- 172.21.15.46:0/330830425 >> v1:172.21.15.133:6789/0 conn(0x7f857815db10 legacy=0x7f8578069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 -- 172.21.15.46:0/330830425 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857815a3d0 con 0x7f8578159c60 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857d0d9700 1 --2- 172.21.15.46:0/330830425 >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 0x7f857815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.149+0000 7f857c8d8700 1 --2- 172.21.15.46:0/330830425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f856c0099b0 tx=0x7f856c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da296a124164a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f8577fff700 1 -- 172.21.15.46:0/330830425 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00b680 con 0x7f8578159c60 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f8577fff700 1 -- 172.21.15.46:0/330830425 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c00b7e0 con 0x7f8578159c60 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f8577fff700 1 -- 172.21.15.46:0/330830425 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00bb80 con 0x7f8578159c60 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 -- 172.21.15.46:0/330830425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 msgr2=0x7f857815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 --2- 172.21.15.46:0/330830425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f856c0099b0 tx=0x7f856c009250 comp rx=0 tx=0).stop 2023-10-07T09:07:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 -- 172.21.15.46:0/330830425 shutdown_connections 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 --2- 172.21.15.46:0/330830425 >> v2:172.21.15.133:3300/0 conn(0x7f8578159890 0x7f857815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 --2- 172.21.15.46:0/330830425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159c60 0x7f857815d5d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 -- 172.21.15.46:0/330830425 >> 172.21.15.46:0/330830425 conn(0x7f8578068e20 msgr2=0x7f85780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 -- 172.21.15.46:0/330830425 shutdown_connections 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.150+0000 7f857f33d700 1 -- 172.21.15.46:0/330830425 wait complete. 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.151+0000 7f857f33d700 1 Processor -- start 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.151+0000 7f857f33d700 1 -- start start 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159890 0x7f857814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8578159c60 0x7f8578151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c57b0 con 0x7f857815db10 2023-10-07T09:07:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780ce2b0 con 0x7f8578159c60 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857f33d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c74f0 con 0x7f8578159890 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857d8da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857d0d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159890 0x7f857814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857d8da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33038/0 (socket says 172.21.15.46:33038) 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857c8d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8578159c60 0x7f8578151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.152+0000 7f857d8da700 1 -- 172.21.15.46:0/2878514670 learned_addr learned my addr 172.21.15.46:0/2878514670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 -- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159890 msgr2=0x7f857814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159890 0x7f857814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 -- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8578159c60 msgr2=0x7f8578151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8578159c60 0x7f8578151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 -- 172.21.15.46:0/2878514670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009a20 con 0x7f857815db10 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857d8da700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f857000c590 tx=0x7f8570007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570005a70 con 0x7f857815db10 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570005bd0 con 0x7f857815db10 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0094f0 con 0x7f857815db10 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700070d0 con 0x7f857815db10 2023-10-07T09:07:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.153+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85780ce4e0 con 0x7f857815db10 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.154+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857804c3c0 con 0x7f857815db10 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.154+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f85700074c0 con 0x7f857815db10 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.155+0000 7f85757fa700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.155+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8570083fe0 con 0x7f857815db10 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.155+0000 7f857d0d9700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.156+0000 7f857d0d9700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 0x7f85640697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f856800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.159+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8570050c90 con 0x7f857815db10 2023-10-07T09:07:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.394+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f857806a5b0 con 0x7f857815db10 2023-10-07T09:07:53.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.394+0000 7f85757fa700 1 -- 172.21.15.46:0/2878514670 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f8570017020 con 0x7f857815db10 2023-10-07T09:07:53.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:53.395 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":134,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:07:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 msgr2=0x7f85640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 0x7f85640697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f856800b040 comp rx=0 tx=0).stop 2023-10-07T09:07:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 msgr2=0x7f85780b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f857000c590 tx=0x7f8570007d90 comp rx=0 tx=0).stop 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 shutdown_connections 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f857815db10 0x7f85780b0b90 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8578159890 0x7f857814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 --2- 172.21.15.46:0/2878514670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8578159c60 0x7f8578151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 >> 172.21.15.46:0/2878514670 conn(0x7f8578068e20 msgr2=0x7f8578158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 shutdown_connections 2023-10-07T09:07:53.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.396+0000 7f857f33d700 1 -- 172.21.15.46:0/2878514670 wait complete. 2023-10-07T09:07:53.399 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 134 2023-10-07T09:07:53.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:07:53.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.527+0000 7f7647470700 1 Processor -- start 2023-10-07T09:07:53.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.527+0000 7f7647470700 1 -- start start 2023-10-07T09:07:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7647470700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f764015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7647470700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400b2980 con 0x7f76401597f0 2023-10-07T09:07:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7647470700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764015dbb0 con 0x7f7640159420 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7647470700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b11d0 con 0x7f764015d230 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7645c6d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f76401597f0 0x7f76400b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47742/0 (socket says 172.21.15.46:47742) 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7645c6d700 1 -- 172.21.15.46:0/1739571188 learned_addr learned my addr 172.21.15.46:0/1739571188 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299549521 0 0) 0x7f76400b2980 con 0x7f76401597f0 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f7646c6f700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f764015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.528+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7628003570 con 0x7f76401597f0 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944412774 0 0) 0x7f7628003570 con 0x7f76401597f0 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 msgr2=0x7f764015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f764015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 >> v1:172.21.15.133:6789/0 conn(0x7f7640159420 legacy=0x7f76400b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400b14b0 con 0x7f76401597f0 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f7634001470 con 0x7f76401597f0 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 >> v1:172.21.15.46:6789/0 conn(0x7f76401597f0 legacy=0x7f76400b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7628003a90 0x7f7628003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628004810 0x7f7628004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f76280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b11d0 con 0x7f7628003a90 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762800bb60 con 0x7f7628004810 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762800bd20 con 0x7f764015d230 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7628003a90 0x7f7628003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f7645c6d700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628004810 0x7f7628004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f7646c6f700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f76280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 -- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 msgr2=0x7f76280051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015d230 0x7f76280051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 -- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628004810 msgr2=0x7f7628004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628004810 0x7f7628004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 -- 172.21.15.46:0/1739571188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628003570 con 0x7f7628003a90 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764646e700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7628003a90 0x7f7628003ea0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f76380018e0 tx=0x7f7638007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fb4550b71ae921 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638012420 con 0x7f7628003a90 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638012580 con 0x7f7628003a90 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.529+0000 7f764546c700 1 -- 172.21.15.46:0/1739571188 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638012920 con 0x7f7628003a90 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 -- 172.21.15.46:0/1739571188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7628003a90 msgr2=0x7f7628003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 --2- 172.21.15.46:0/1739571188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7628003a90 0x7f7628003ea0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f76380018e0 tx=0x7f7638007d30 comp rx=0 tx=0).stop 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7646c6f700 1 -- 172.21.15.46:0/1739571188 reap_dead start 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 -- 172.21.15.46:0/1739571188 shutdown_connections 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 -- 172.21.15.46:0/1739571188 >> 172.21.15.46:0/1739571188 conn(0x7f76400d0660 msgr2=0x7f76400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 -- 172.21.15.46:0/1739571188 shutdown_connections 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.530+0000 7f7647470700 1 -- 172.21.15.46:0/1739571188 wait complete. 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.531+0000 7f7647470700 1 Processor -- start 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.531+0000 7f7647470700 1 -- start start 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 0x7f7640141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015bef0 0x7f76400cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764015c670 con 0x7f764014e730 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764014e2a0 con 0x7f7628003a90 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7647470700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764015c390 con 0x7f764015bef0 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33046/0 (socket says 172.21.15.46:33046) 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 -- 172.21.15.46:0/541435713 learned_addr learned my addr 172.21.15.46:0/541435713 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7646c6f700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015bef0 0x7f76400cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f764646e700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 0x7f7640141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 -- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015bef0 msgr2=0x7f76400cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015bef0 0x7f76400cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 -- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 msgr2=0x7f7640141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 0x7f7640141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 -- 172.21.15.46:0/541435713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764014dc50 con 0x7f764014e730 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f764646e700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 0x7f7640141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.532+0000 7f7645c6d700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f76340073c0 tx=0x7f7634001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.533+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634018030 con 0x7f764014e730 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.533+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634007780 con 0x7f764014e730 2023-10-07T09:07:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.533+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764014df30 con 0x7f764014e730 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.533+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400fa80 con 0x7f764014e730 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.533+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76401424b0 con 0x7f764014e730 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.534+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764014dab0 con 0x7f764014e730 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.534+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f763401b070 con 0x7f764014e730 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.535+0000 7f763e7fc700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 0x7f762c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.535+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7634019070 con 0x7f764014e730 2023-10-07T09:07:53.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.535+0000 7f764646e700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 0x7f762c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.535+0000 7f764646e700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 0x7f762c0697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7638008fd0 tx=0x7f7638015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.539+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f764014dab0 con 0x7f764014e730 2023-10-07T09:07:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.731+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f764014dab0 con 0x7f764014e730 2023-10-07T09:07:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.732+0000 7f763e7fc700 1 -- 172.21.15.46:0/541435713 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f764014dab0 con 0x7f764014e730 2023-10-07T09:07:53.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:53.733 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":199,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:07:50.953777+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:07:53.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 msgr2=0x7f762c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 0x7f762c0697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7638008fd0 tx=0x7f7638015000 comp rx=0 tx=0).stop 2023-10-07T09:07:53.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 msgr2=0x7f764015b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f76340073c0 tx=0x7f7634001e50 comp rx=0 tx=0).stop 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 shutdown_connections 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f762c067320 0x7f762c0697d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f764015bef0 0x7f76400cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7628003a90 0x7f7640141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 --2- 172.21.15.46:0/541435713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f764014e730 0x7f764015b9b0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 >> 172.21.15.46:0/541435713 conn(0x7f76400d0660 msgr2=0x7f7640069990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.734+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 shutdown_connections 2023-10-07T09:07:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.735+0000 7f7647470700 1 -- 172.21.15.46:0/541435713 wait complete. 2023-10-07T09:07:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T09:07:53.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:07:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.866+0000 7f5949dc9700 1 Processor -- start 2023-10-07T09:07:53.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.866+0000 7f5949dc9700 1 -- start start 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5949dc9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594406bcd0 0x7f59440caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5949dc9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f594406c0a0 0x7f594415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5949dc9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594415d7e0 con 0x7f594415df50 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5949dc9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594415dac0 con 0x7f594406c0a0 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5949dc9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594415aa30 con 0x7f594406bcd0 2023-10-07T09:07:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f594406c0a0 0x7f594415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f594406c0a0 0x7f594415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33050/0 (socket says 172.21.15.46:33050) 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 -- 172.21.15.46:0/6859514 learned_addr learned my addr 172.21.15.46:0/6859514 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f59437fe700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594406bcd0 0x7f59440caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 -- 172.21.15.46:0/6859514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594406bcd0 msgr2=0x7f59440caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594406bcd0 0x7f59440caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 -- 172.21.15.46:0/6859514 >> v1:172.21.15.133:6789/0 conn(0x7f594415df50 legacy=0x7f59440c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 -- 172.21.15.46:0/6859514 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594415ad10 con 0x7f594406c0a0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f5942ffd700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f594415a1e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f59340099b0 tx=0x7f5934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35649d596b9b0270 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f59427fc700 1 -- 172.21.15.46:0/6859514 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400b860 con 0x7f594406c0a0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f59427fc700 1 -- 172.21.15.46:0/6859514 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400b9c0 con 0x7f594406c0a0 2023-10-07T09:07:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.867+0000 7f59427fc700 1 -- 172.21.15.46:0/6859514 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400bd80 con 0x7f594406c0a0 2023-10-07T09:07:53.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 -- 172.21.15.46:0/6859514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 msgr2=0x7f594415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f594415a1e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f59340099b0 tx=0x7f5934009250 comp rx=0 tx=0).stop 2023-10-07T09:07:53.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 -- 172.21.15.46:0/6859514 shutdown_connections 2023-10-07T09:07:53.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594406bcd0 0x7f59440caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 --2- 172.21.15.46:0/6859514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f594415a1e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 -- 172.21.15.46:0/6859514 >> 172.21.15.46:0/6859514 conn(0x7f59440ce600 msgr2=0x7f59440cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 -- 172.21.15.46:0/6859514 shutdown_connections 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.868+0000 7f5949dc9700 1 -- 172.21.15.46:0/6859514 wait complete. 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.869+0000 7f5949dc9700 1 Processor -- start 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.869+0000 7f5949dc9700 1 -- start start 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594406bcd0 0x7f59440b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594415df50 0x7f5944159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440c9640 con 0x7f594406c0a0 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594416a270 con 0x7f594406bcd0 2023-10-07T09:07:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5949dc9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440b1980 con 0x7f594415df50 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33058/0 (socket says 172.21.15.46:33058) 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 -- 172.21.15.46:0/3142202699 learned_addr learned my addr 172.21.15.46:0/3142202699 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f59437fe700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594406bcd0 0x7f59440b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5943fff700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594415df50 0x7f5944159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 -- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594415df50 msgr2=0x7f5944159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594415df50 0x7f5944159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 -- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594406bcd0 msgr2=0x7f59440b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594406bcd0 0x7f59440b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:53.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.870+0000 7f5942ffd700 1 -- 172.21.15.46:0/3142202699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340094f0 con 0x7f594406c0a0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f5942ffd700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f5934006fd0 tx=0x7f5934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593401f070 con 0x7f594406c0a0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934011d70 con 0x7f594406c0a0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593401a650 con 0x7f594406c0a0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440b1c60 con 0x7f594406c0a0 2023-10-07T09:07:53.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.871+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440b2220 con 0x7f594406c0a0 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.872+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594416a090 con 0x7f594406c0a0 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.872+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f593401aa00 con 0x7f594406c0a0 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.873+0000 7f592b7fe700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 0x7f59300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.873+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59340860c0 con 0x7f594406c0a0 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.873+0000 7f59437fe700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 0x7f59300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.873+0000 7f59437fe700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 0x7f59300697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5938006fd0 tx=0x7f5938008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:53.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:53.877+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5934052dd0 con 0x7f594406c0a0 2023-10-07T09:07:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.067+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f594404c3c0 con 0x7f5930067320 2023-10-07T09:07:54.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.076+0000 7f592b7fe700 1 -- 172.21.15.46:0/3142202699 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289956 (secure 0 0 0) 0x7f594404c3c0 con 0x7f5930067320 2023-10-07T09:07:54.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:54.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 msgr2=0x7f59300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 0x7f59300697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5938006fd0 tx=0x7f5938008040 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 msgr2=0x7f59440c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f5934006fd0 tx=0x7f5934017000 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 shutdown_connections 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5930067320 0x7f59300697d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f594415df50 0x7f5944159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594406bcd0 0x7f59440b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 --2- 172.21.15.46:0/3142202699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f594406c0a0 0x7f59440c9100 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 >> 172.21.15.46:0/3142202699 conn(0x7f59440ce600 msgr2=0x7f59440c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 shutdown_connections 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.079+0000 7f5949dc9700 1 -- 172.21.15.46:0/3142202699 wait complete. 2023-10-07T09:07:54.083 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:07:54.093 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2023-10-07T09:07:53.895810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444256,"kb_used_data":20896,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530464,"statfs":{"total":773094113280,"available":770591195136,"internally_reserved":0,"allocated":21397504,"data_stored":10221544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.925173"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975213+0000","last_change":"2023-10-07T09:07:49.975213+0000","last_active":"2023-10-07T09:07:49.975213+0000","last_peered":"2023-10-07T09:07:49.975213+0000","last_clean":"2023-10-07T09:07:49.975213+0000","last_became_active":"2023-10-07T09:07:49.974425+0000","last_became_peered":"2023-10-07T09:07:49.974425+0000","last_unstale":"2023-10-07T09:07:49.975213+0000","last_undegraded":"2023-10-07T09:07:49.975213+0000","last_fullsized":"2023-10-07T09:07:49.975213+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:19.598831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970237+0000","last_change":"2023-10-07T09:07:49.970237+0000","last_active":"2023-10-07T09:07:49.970237+0000","last_peered":"2023-10-07T09:07:49.970237+0000","last_clean":"2023-10-07T09:07:49.970237+0000","last_became_active":"2023-10-07T09:07:49.969730+0000","last_became_peered":"2023-10-07T09:07:49.969730+0000","last_unstale":"2023-10-07T09:07:49.970237+0000","last_undegraded":"2023-10-07T09:07:49.970237+0000","last_fullsized":"2023-10-07T09:07:49.970237+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:57:50.664932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976139+0000","last_change":"2023-10-07T09:07:49.976139+0000","last_active":"2023-10-07T09:07:49.976139+0000","last_peered":"2023-10-07T09:07:49.976139+0000","last_clean":"2023-10-07T09:07:49.976139+0000","last_became_active":"2023-10-07T09:07:49.975873+0000","last_became_peered":"2023-10-07T09:07:49.975873+0000","last_unstale":"2023-10-07T09:07:49.976139+0000","last_undegraded":"2023-10-07T09:07:49.976139+0000","last_fullsized":"2023-10-07T09:07:49.976139+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:07.765285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.967819+0000","last_change":"2023-10-07T09:07:49.967819+0000","last_active":"2023-10-07T09:07:49.967819+0000","last_peered":"2023-10-07T09:07:49.967819+0000","last_clean":"2023-10-07T09:07:49.967819+0000","last_became_active":"2023-10-07T09:07:49.967556+0000","last_became_peered":"2023-10-07T09:07:49.967556+0000","last_unstale":"2023-10-07T09:07:49.967819+0000","last_undegraded":"2023-10-07T09:07:49.967819+0000","last_fullsized":"2023-10-07T09:07:49.967819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:02.105284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.966180+0000","last_change":"2023-10-07T09:07:49.966180+0000","last_active":"2023-10-07T09:07:49.966180+0000","last_peered":"2023-10-07T09:07:49.966180+0000","last_clean":"2023-10-07T09:07:49.966180+0000","last_became_active":"2023-10-07T09:07:49.965784+0000","last_became_peered":"2023-10-07T09:07:49.965784+0000","last_unstale":"2023-10-07T09:07:49.966180+0000","last_undegraded":"2023-10-07T09:07:49.966180+0000","last_fullsized":"2023-10-07T09:07:49.966180+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:21:10.091794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973038+0000","last_change":"2023-10-07T09:07:49.973038+0000","last_active":"2023-10-07T09:07:49.973038+0000","last_peered":"2023-10-07T09:07:49.973038+0000","last_clean":"2023-10-07T09:07:49.973038+0000","last_became_active":"2023-10-07T09:07:49.972732+0000","last_became_peered":"2023-10-07T09:07:49.972732+0000","last_unstale":"2023-10-07T09:07:49.973038+0000","last_undegraded":"2023-10-07T09:07:49.973038+0000","last_fullsized":"2023-10-07T09:07:49.973038+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:26.496994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973527+0000","last_change":"2023-10-07T09:07:49.973527+0000","last_active":"2023-10-07T09:07:49.973527+0000","last_peered":"2023-10-07T09:07:49.973527+0000","last_clean":"2023-10-07T09:07:49.973527+0000","last_became_active":"2023-10-07T09:07:49.973238+0000","last_became_peered":"2023-10-07T09:07:49.973238+0000","last_unstale":"2023-10-07T09:07:49.973527+0000","last_undegraded":"2023-10-07T09:07:49.973527+0000","last_fullsized":"2023-10-07T09:07:49.973527+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:47.510196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971672+0000","last_change":"2023-10-07T09:07:49.971672+0000","last_active":"2023-10-07T09:07:49.971672+0000","last_peered":"2023-10-07T09:07:49.971672+0000","last_clean":"2023-10-07T09:07:49.971672+0000","last_became_active":"2023-10-07T09:07:49.971402+0000","last_became_peered":"2023-10-07T09:07:49.971402+0000","last_unstale":"2023-10-07T09:07:49.971672+0000","last_undegraded":"2023-10-07T09:07:49.971672+0000","last_fullsized":"2023-10-07T09:07:49.971672+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971955+0000","last_change":"2023-10-07T09:07:49.971955+0000","last_active":"2023-10-07T09:07:49.971955+0000","last_peered":"2023-10-07T09:07:49.971955+0000","last_clean":"2023-10-07T09:07:49.971955+0000","last_became_active":"2023-10-07T09:07:49.970054+0000","last_became_peered":"2023-10-07T09:07:49.970054+0000","last_unstale":"2023-10-07T09:07:49.971955+0000","last_undegraded":"2023-10-07T09:07:49.971955+0000","last_fullsized":"2023-10-07T09:07:49.971955+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:13.716945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976106+0000","last_change":"2023-10-07T09:07:49.976106+0000","last_active":"2023-10-07T09:07:49.976106+0000","last_peered":"2023-10-07T09:07:49.976106+0000","last_clean":"2023-10-07T09:07:49.976106+0000","last_became_active":"2023-10-07T09:07:49.975827+0000","last_became_peered":"2023-10-07T09:07:49.975827+0000","last_unstale":"2023-10-07T09:07:49.976106+0000","last_undegraded":"2023-10-07T09:07:49.976106+0000","last_fullsized":"2023-10-07T09:07:49.976106+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:13.716945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972397+0000","last_change":"2023-10-07T09:07:49.972397+0000","last_active":"2023-10-07T09:07:49.972397+0000","last_peered":"2023-10-07T09:07:49.972397+0000","last_clean":"2023-10-07T09:07:49.972397+0000","last_became_active":"2023-10-07T09:07:49.972112+0000","last_became_peered":"2023-10-07T09:07:49.972112+0000","last_unstale":"2023-10-07T09:07:49.972397+0000","last_undegraded":"2023-10-07T09:07:49.972397+0000","last_fullsized":"2023-10-07T09:07:49.972397+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:18.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975395+0000","last_change":"2023-10-07T09:07:49.975395+0000","last_active":"2023-10-07T09:07:49.975395+0000","last_peered":"2023-10-07T09:07:49.975395+0000","last_clean":"2023-10-07T09:07:49.975395+0000","last_became_active":"2023-10-07T09:07:49.975123+0000","last_became_peered":"2023-10-07T09:07:49.975123+0000","last_unstale":"2023-10-07T09:07:49.975395+0000","last_undegraded":"2023-10-07T09:07:49.975395+0000","last_fullsized":"2023-10-07T09:07:49.975395+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:56:24.108225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975151+0000","last_change":"2023-10-07T09:07:49.975151+0000","last_active":"2023-10-07T09:07:49.975151+0000","last_peered":"2023-10-07T09:07:49.975151+0000","last_clean":"2023-10-07T09:07:49.975151+0000","last_became_active":"2023-10-07T09:07:49.974859+0000","last_became_peered":"2023-10-07T09:07:49.974859+0000","last_unstale":"2023-10-07T09:07:49.975151+0000","last_undegraded":"2023-10-07T09:07:49.975151+0000","last_fullsized":"2023-10-07T09:07:49.975151+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:01.605298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975331+0000","last_change":"2023-10-07T09:07:49.975331+0000","last_active":"2023-10-07T09:07:49.975331+0000","last_peered":"2023-10-07T09:07:49.975331+0000","last_clean":"2023-10-07T09:07:49.975331+0000","last_became_active":"2023-10-07T09:07:49.974399+0000","last_became_peered":"2023-10-07T09:07:49.974399+0000","last_unstale":"2023-10-07T09:07:49.975331+0000","last_undegraded":"2023-10-07T09:07:49.975331+0000","last_fullsized":"2023-10-07T09:07:49.975331+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:19.780622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977882+0000","last_change":"2023-10-07T09:07:49.977882+0000","last_active":"2023-10-07T09:07:49.977882+0000","last_peered":"2023-10-07T09:07:49.977882+0000","last_clean":"2023-10-07T09:07:49.977882+0000","last_became_active":"2023-10-07T09:07:49.977463+0000","last_became_peered":"2023-10-07T09:07:49.977463+0000","last_unstale":"2023-10-07T09:07:49.977882+0000","last_undegraded":"2023-10-07T09:07:49.977882+0000","last_fullsized":"2023-10-07T09:07:49.977882+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:01.316994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977120+0000","last_change":"2023-10-07T09:07:49.977120+0000","last_active":"2023-10-07T09:07:49.977120+0000","last_peered":"2023-10-07T09:07:49.977120+0000","last_clean":"2023-10-07T09:07:49.977120+0000","last_became_active":"2023-10-07T09:07:49.976833+0000","last_became_peered":"2023-10-07T09:07:49.976833+0000","last_unstale":"2023-10-07T09:07:49.977120+0000","last_undegraded":"2023-10-07T09:07:49.977120+0000","last_fullsized":"2023-10-07T09:07:49.977120+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:58.344925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972503+0000","last_change":"2023-10-07T09:07:49.972503+0000","last_active":"2023-10-07T09:07:49.972503+0000","last_peered":"2023-10-07T09:07:49.972503+0000","last_clean":"2023-10-07T09:07:49.972503+0000","last_became_active":"2023-10-07T09:07:49.971757+0000","last_became_peered":"2023-10-07T09:07:49.971757+0000","last_unstale":"2023-10-07T09:07:49.972503+0000","last_undegraded":"2023-10-07T09:07:49.972503+0000","last_fullsized":"2023-10-07T09:07:49.972503+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:32.140902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.959633+0000","last_change":"2023-10-07T09:07:49.959633+0000","last_active":"2023-10-07T09:07:49.959633+0000","last_peered":"2023-10-07T09:07:49.959633+0000","last_clean":"2023-10-07T09:07:49.959633+0000","last_became_active":"2023-10-07T09:07:49.959361+0000","last_became_peered":"2023-10-07T09:07:49.959361+0000","last_unstale":"2023-10-07T09:07:49.959633+0000","last_undegraded":"2023-10-07T09:07:49.959633+0000","last_fullsized":"2023-10-07T09:07:49.959633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:25.773934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975928+0000","last_change":"2023-10-07T09:07:49.975928+0000","last_active":"2023-10-07T09:07:49.975928+0000","last_peered":"2023-10-07T09:07:49.975928+0000","last_clean":"2023-10-07T09:07:49.975928+0000","last_became_active":"2023-10-07T09:07:49.975661+0000","last_became_peered":"2023-10-07T09:07:49.975661+0000","last_unstale":"2023-10-07T09:07:49.975928+0000","last_undegraded":"2023-10-07T09:07:49.975928+0000","last_fullsized":"2023-10-07T09:07:49.975928+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:13.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977615+0000","last_change":"2023-10-07T09:07:49.977615+0000","last_active":"2023-10-07T09:07:49.977615+0000","last_peered":"2023-10-07T09:07:49.977615+0000","last_clean":"2023-10-07T09:07:49.977615+0000","last_became_active":"2023-10-07T09:07:49.977372+0000","last_became_peered":"2023-10-07T09:07:49.977372+0000","last_unstale":"2023-10-07T09:07:49.977615+0000","last_undegraded":"2023-10-07T09:07:49.977615+0000","last_fullsized":"2023-10-07T09:07:49.977615+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:27.925382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.966685+0000","last_change":"2023-10-07T09:07:49.966685+0000","last_active":"2023-10-07T09:07:49.966685+0000","last_peered":"2023-10-07T09:07:49.966685+0000","last_clean":"2023-10-07T09:07:49.966685+0000","last_became_active":"2023-10-07T09:07:49.966412+0000","last_became_peered":"2023-10-07T09:07:49.966412+0000","last_unstale":"2023-10-07T09:07:49.966685+0000","last_undegraded":"2023-10-07T09:07:49.966685+0000","last_fullsized":"2023-10-07T09:07:49.966685+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:18:12.848103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974530+0000","last_change":"2023-10-07T09:07:49.974530+0000","last_active":"2023-10-07T09:07:49.974530+0000","last_peered":"2023-10-07T09:07:49.974530+0000","last_clean":"2023-10-07T09:07:49.974530+0000","last_became_active":"2023-10-07T09:07:49.974261+0000","last_became_peered":"2023-10-07T09:07:49.974261+0000","last_unstale":"2023-10-07T09:07:49.974530+0000","last_undegraded":"2023-10-07T09:07:49.974530+0000","last_fullsized":"2023-10-07T09:07:49.974530+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:36.631895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969957+0000","last_change":"2023-10-07T09:07:49.969957+0000","last_active":"2023-10-07T09:07:49.969957+0000","last_peered":"2023-10-07T09:07:49.969957+0000","last_clean":"2023-10-07T09:07:49.969957+0000","last_became_active":"2023-10-07T09:07:49.969442+0000","last_became_peered":"2023-10-07T09:07:49.969442+0000","last_unstale":"2023-10-07T09:07:49.969957+0000","last_undegraded":"2023-10-07T09:07:49.969957+0000","last_fullsized":"2023-10-07T09:07:49.969957+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:26.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978863+0000","last_change":"2023-10-07T09:07:49.978863+0000","last_active":"2023-10-07T09:07:49.978863+0000","last_peered":"2023-10-07T09:07:49.978863+0000","last_clean":"2023-10-07T09:07:49.978863+0000","last_became_active":"2023-10-07T09:07:49.978585+0000","last_became_peered":"2023-10-07T09:07:49.978585+0000","last_unstale":"2023-10-07T09:07:49.978863+0000","last_undegraded":"2023-10-07T09:07:49.978863+0000","last_fullsized":"2023-10-07T09:07:49.978863+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:30.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970958+0000","last_change":"2023-10-07T09:07:49.970958+0000","last_active":"2023-10-07T09:07:49.970958+0000","last_peered":"2023-10-07T09:07:49.970958+0000","last_clean":"2023-10-07T09:07:49.970958+0000","last_became_active":"2023-10-07T09:07:49.970623+0000","last_became_peered":"2023-10-07T09:07:49.970623+0000","last_unstale":"2023-10-07T09:07:49.970958+0000","last_undegraded":"2023-10-07T09:07:49.970958+0000","last_fullsized":"2023-10-07T09:07:49.970958+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:45.372092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970352+0000","last_change":"2023-10-07T09:07:49.970352+0000","last_active":"2023-10-07T09:07:49.970352+0000","last_peered":"2023-10-07T09:07:49.970352+0000","last_clean":"2023-10-07T09:07:49.970352+0000","last_became_active":"2023-10-07T09:07:49.970049+0000","last_became_peered":"2023-10-07T09:07:49.970049+0000","last_unstale":"2023-10-07T09:07:49.970352+0000","last_undegraded":"2023-10-07T09:07:49.970352+0000","last_fullsized":"2023-10-07T09:07:49.970352+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:50.279155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975555+0000","last_change":"2023-10-07T09:07:49.975555+0000","last_active":"2023-10-07T09:07:49.975555+0000","last_peered":"2023-10-07T09:07:49.975555+0000","last_clean":"2023-10-07T09:07:49.975555+0000","last_became_active":"2023-10-07T09:07:49.975000+0000","last_became_peered":"2023-10-07T09:07:49.975000+0000","last_unstale":"2023-10-07T09:07:49.975555+0000","last_undegraded":"2023-10-07T09:07:49.975555+0000","last_fullsized":"2023-10-07T09:07:49.975555+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:35:39.281205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975389+0000","last_change":"2023-10-07T09:07:49.975389+0000","last_active":"2023-10-07T09:07:49.975389+0000","last_peered":"2023-10-07T09:07:49.975389+0000","last_clean":"2023-10-07T09:07:49.975389+0000","last_became_active":"2023-10-07T09:07:49.974973+0000","last_became_peered":"2023-10-07T09:07:49.974973+0000","last_unstale":"2023-10-07T09:07:49.975389+0000","last_undegraded":"2023-10-07T09:07:49.975389+0000","last_fullsized":"2023-10-07T09:07:49.975389+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:37:54.857046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970218+0000","last_change":"2023-10-07T09:07:49.970218+0000","last_active":"2023-10-07T09:07:49.970218+0000","last_peered":"2023-10-07T09:07:49.970218+0000","last_clean":"2023-10-07T09:07:49.970218+0000","last_became_active":"2023-10-07T09:07:49.969839+0000","last_became_peered":"2023-10-07T09:07:49.969839+0000","last_unstale":"2023-10-07T09:07:49.970218+0000","last_undegraded":"2023-10-07T09:07:49.970218+0000","last_fullsized":"2023-10-07T09:07:49.970218+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:27.758658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972416+0000","last_change":"2023-10-07T09:07:49.972416+0000","last_active":"2023-10-07T09:07:49.972416+0000","last_peered":"2023-10-07T09:07:49.972416+0000","last_clean":"2023-10-07T09:07:49.972416+0000","last_became_active":"2023-10-07T09:07:49.972118+0000","last_became_peered":"2023-10-07T09:07:49.972118+0000","last_unstale":"2023-10-07T09:07:49.972416+0000","last_undegraded":"2023-10-07T09:07:49.972416+0000","last_fullsized":"2023-10-07T09:07:49.972416+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:10.654407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974859+0000","last_change":"2023-10-07T09:07:49.974859+0000","last_active":"2023-10-07T09:07:49.974859+0000","last_peered":"2023-10-07T09:07:49.974859+0000","last_clean":"2023-10-07T09:07:49.974859+0000","last_became_active":"2023-10-07T09:07:49.973112+0000","last_became_peered":"2023-10-07T09:07:49.973112+0000","last_unstale":"2023-10-07T09:07:49.974859+0000","last_undegraded":"2023-10-07T09:07:49.974859+0000","last_fullsized":"2023-10-07T09:07:49.974859+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:59.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978401+0000","last_change":"2023-10-07T09:07:49.978401+0000","last_active":"2023-10-07T09:07:49.978401+0000","last_peered":"2023-10-07T09:07:49.978401+0000","last_clean":"2023-10-07T09:07:49.978401+0000","last_became_active":"2023-10-07T09:07:49.978101+0000","last_became_peered":"2023-10-07T09:07:49.978101+0000","last_unstale":"2023-10-07T09:07:49.978401+0000","last_undegraded":"2023-10-07T09:07:49.978401+0000","last_fullsized":"2023-10-07T09:07:49.978401+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:27.758658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"198'4","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995492+0000","last_change":"2023-10-07T09:07:48.989874+0000","last_active":"2023-10-07T09:07:49.995492+0000","last_peered":"2023-10-07T09:07:49.995492+0000","last_clean":"2023-10-07T09:07:49.995492+0000","last_became_active":"2023-10-07T09:07:48.989575+0000","last_became_peered":"2023-10-07T09:07:48.989575+0000","last_unstale":"2023-10-07T09:07:49.995492+0000","last_undegraded":"2023-10-07T09:07:49.995492+0000","last_fullsized":"2023-10-07T09:07:49.995492+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:10:14.711099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970320+0000","last_change":"2023-10-07T09:07:49.970320+0000","last_active":"2023-10-07T09:07:49.970320+0000","last_peered":"2023-10-07T09:07:49.970320+0000","last_clean":"2023-10-07T09:07:49.970320+0000","last_became_active":"2023-10-07T09:07:49.970065+0000","last_became_peered":"2023-10-07T09:07:49.970065+0000","last_unstale":"2023-10-07T09:07:49.970320+0000","last_undegraded":"2023-10-07T09:07:49.970320+0000","last_fullsized":"2023-10-07T09:07:49.970320+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:57:10.835793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969034+0000","last_change":"2023-10-07T09:07:48.992559+0000","last_active":"2023-10-07T09:07:49.969034+0000","last_peered":"2023-10-07T09:07:49.969034+0000","last_clean":"2023-10-07T09:07:49.969034+0000","last_became_active":"2023-10-07T09:07:48.992308+0000","last_became_peered":"2023-10-07T09:07:48.992308+0000","last_unstale":"2023-10-07T09:07:49.969034+0000","last_undegraded":"2023-10-07T09:07:49.969034+0000","last_fullsized":"2023-10-07T09:07:49.969034+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:22:15.166687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.964286+0000","last_change":"2023-10-07T09:07:49.964286+0000","last_active":"2023-10-07T09:07:49.964286+0000","last_peered":"2023-10-07T09:07:49.964286+0000","last_clean":"2023-10-07T09:07:49.964286+0000","last_became_active":"2023-10-07T09:07:49.963998+0000","last_became_peered":"2023-10-07T09:07:49.963998+0000","last_unstale":"2023-10-07T09:07:49.964286+0000","last_undegraded":"2023-10-07T09:07:49.964286+0000","last_fullsized":"2023-10-07T09:07:49.964286+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:03.915486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.996496+0000","last_change":"2023-10-07T09:07:49.000276+0000","last_active":"2023-10-07T09:07:49.996496+0000","last_peered":"2023-10-07T09:07:49.996496+0000","last_clean":"2023-10-07T09:07:49.996496+0000","last_became_active":"2023-10-07T09:07:48.999951+0000","last_became_peered":"2023-10-07T09:07:48.999951+0000","last_unstale":"2023-10-07T09:07:49.996496+0000","last_undegraded":"2023-10-07T09:07:49.996496+0000","last_fullsized":"2023-10-07T09:07:49.996496+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:44.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974650+0000","last_change":"2023-10-07T09:07:49.974650+0000","last_active":"2023-10-07T09:07:49.974650+0000","last_peered":"2023-10-07T09:07:49.974650+0000","last_clean":"2023-10-07T09:07:49.974650+0000","last_became_active":"2023-10-07T09:07:49.973080+0000","last_became_peered":"2023-10-07T09:07:49.973080+0000","last_unstale":"2023-10-07T09:07:49.974650+0000","last_undegraded":"2023-10-07T09:07:49.974650+0000","last_fullsized":"2023-10-07T09:07:49.974650+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:00:27.596472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995793+0000","last_change":"2023-10-07T09:07:48.991043+0000","last_active":"2023-10-07T09:07:49.995793+0000","last_peered":"2023-10-07T09:07:49.995793+0000","last_clean":"2023-10-07T09:07:49.995793+0000","last_became_active":"2023-10-07T09:07:48.990746+0000","last_became_peered":"2023-10-07T09:07:48.990746+0000","last_unstale":"2023-10-07T09:07:49.995793+0000","last_undegraded":"2023-10-07T09:07:49.995793+0000","last_fullsized":"2023-10-07T09:07:49.995793+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:52.616093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974831+0000","last_change":"2023-10-07T09:07:49.974831+0000","last_active":"2023-10-07T09:07:49.974831+0000","last_peered":"2023-10-07T09:07:49.974831+0000","last_clean":"2023-10-07T09:07:49.974831+0000","last_became_active":"2023-10-07T09:07:49.972762+0000","last_became_peered":"2023-10-07T09:07:49.972762+0000","last_unstale":"2023-10-07T09:07:49.974831+0000","last_undegraded":"2023-10-07T09:07:49.974831+0000","last_fullsized":"2023-10-07T09:07:49.974831+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:20.237534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.955977+0000","last_change":"2023-10-07T09:07:48.997782+0000","last_active":"2023-10-07T09:07:49.955977+0000","last_peered":"2023-10-07T09:07:49.955977+0000","last_clean":"2023-10-07T09:07:49.955977+0000","last_became_active":"2023-10-07T09:07:48.997498+0000","last_became_peered":"2023-10-07T09:07:48.997498+0000","last_unstale":"2023-10-07T09:07:49.955977+0000","last_undegraded":"2023-10-07T09:07:49.955977+0000","last_fullsized":"2023-10-07T09:07:49.955977+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:57.338417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973047+0000","last_change":"2023-10-07T09:07:49.973047+0000","last_active":"2023-10-07T09:07:49.973047+0000","last_peered":"2023-10-07T09:07:49.973047+0000","last_clean":"2023-10-07T09:07:49.973047+0000","last_became_active":"2023-10-07T09:07:49.972729+0000","last_became_peered":"2023-10-07T09:07:49.972729+0000","last_unstale":"2023-10-07T09:07:49.973047+0000","last_undegraded":"2023-10-07T09:07:49.973047+0000","last_fullsized":"2023-10-07T09:07:49.973047+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:22:35.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.964759+0000","last_change":"2023-10-07T09:07:48.998486+0000","last_active":"2023-10-07T09:07:49.964759+0000","last_peered":"2023-10-07T09:07:49.964759+0000","last_clean":"2023-10-07T09:07:49.964759+0000","last_became_active":"2023-10-07T09:07:48.998213+0000","last_became_peered":"2023-10-07T09:07:48.998213+0000","last_unstale":"2023-10-07T09:07:49.964759+0000","last_undegraded":"2023-10-07T09:07:49.964759+0000","last_fullsized":"2023-10-07T09:07:49.964759+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:12.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976063+0000","last_change":"2023-10-07T09:07:49.976063+0000","last_active":"2023-10-07T09:07:49.976063+0000","last_peered":"2023-10-07T09:07:49.976063+0000","last_clean":"2023-10-07T09:07:49.976063+0000","last_became_active":"2023-10-07T09:07:49.975765+0000","last_became_peered":"2023-10-07T09:07:49.975765+0000","last_unstale":"2023-10-07T09:07:49.976063+0000","last_undegraded":"2023-10-07T09:07:49.976063+0000","last_fullsized":"2023-10-07T09:07:49.976063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:26.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995758+0000","last_change":"2023-10-07T09:07:48.993577+0000","last_active":"2023-10-07T09:07:48.995758+0000","last_peered":"2023-10-07T09:07:48.995758+0000","last_clean":"2023-10-07T09:07:48.995758+0000","last_became_active":"2023-10-07T09:07:48.993306+0000","last_became_peered":"2023-10-07T09:07:48.993306+0000","last_unstale":"2023-10-07T09:07:48.995758+0000","last_undegraded":"2023-10-07T09:07:48.995758+0000","last_fullsized":"2023-10-07T09:07:48.995758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:51.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972368+0000","last_change":"2023-10-07T09:07:49.972368+0000","last_active":"2023-10-07T09:07:49.972368+0000","last_peered":"2023-10-07T09:07:49.972368+0000","last_clean":"2023-10-07T09:07:49.972368+0000","last_became_active":"2023-10-07T09:07:49.971563+0000","last_became_peered":"2023-10-07T09:07:49.971563+0000","last_unstale":"2023-10-07T09:07:49.972368+0000","last_undegraded":"2023-10-07T09:07:49.972368+0000","last_fullsized":"2023-10-07T09:07:49.972368+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:12:32.939745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.994615+0000","last_change":"2023-10-07T09:07:48.992788+0000","last_active":"2023-10-07T09:07:48.994615+0000","last_peered":"2023-10-07T09:07:48.994615+0000","last_clean":"2023-10-07T09:07:48.994615+0000","last_became_active":"2023-10-07T09:07:48.992491+0000","last_became_peered":"2023-10-07T09:07:48.992491+0000","last_unstale":"2023-10-07T09:07:48.994615+0000","last_undegraded":"2023-10-07T09:07:48.994615+0000","last_fullsized":"2023-10-07T09:07:48.994615+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:25.490486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973634+0000","last_change":"2023-10-07T09:07:49.973634+0000","last_active":"2023-10-07T09:07:49.973634+0000","last_peered":"2023-10-07T09:07:49.973634+0000","last_clean":"2023-10-07T09:07:49.973634+0000","last_became_active":"2023-10-07T09:07:49.973394+0000","last_became_peered":"2023-10-07T09:07:49.973394+0000","last_unstale":"2023-10-07T09:07:49.973634+0000","last_undegraded":"2023-10-07T09:07:49.973634+0000","last_fullsized":"2023-10-07T09:07:49.973634+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:22.635655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.997135+0000","last_change":"2023-10-07T09:07:48.994252+0000","last_active":"2023-10-07T09:07:48.997135+0000","last_peered":"2023-10-07T09:07:48.997135+0000","last_clean":"2023-10-07T09:07:48.997135+0000","last_became_active":"2023-10-07T09:07:48.993728+0000","last_became_peered":"2023-10-07T09:07:48.993728+0000","last_unstale":"2023-10-07T09:07:48.997135+0000","last_undegraded":"2023-10-07T09:07:48.997135+0000","last_fullsized":"2023-10-07T09:07:48.997135+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:30.631080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971741+0000","last_change":"2023-10-07T09:07:49.971741+0000","last_active":"2023-10-07T09:07:49.971741+0000","last_peered":"2023-10-07T09:07:49.971741+0000","last_clean":"2023-10-07T09:07:49.971741+0000","last_became_active":"2023-10-07T09:07:49.971454+0000","last_became_peered":"2023-10-07T09:07:49.971454+0000","last_unstale":"2023-10-07T09:07:49.971741+0000","last_undegraded":"2023-10-07T09:07:49.971741+0000","last_fullsized":"2023-10-07T09:07:49.971741+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:38.349404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995735+0000","last_change":"2023-10-07T09:07:48.992291+0000","last_active":"2023-10-07T09:07:48.995735+0000","last_peered":"2023-10-07T09:07:48.995735+0000","last_clean":"2023-10-07T09:07:48.995735+0000","last_became_active":"2023-10-07T09:07:48.992024+0000","last_became_peered":"2023-10-07T09:07:48.992024+0000","last_unstale":"2023-10-07T09:07:48.995735+0000","last_undegraded":"2023-10-07T09:07:48.995735+0000","last_fullsized":"2023-10-07T09:07:48.995735+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:32.533498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970380+0000","last_change":"2023-10-07T09:07:49.970380+0000","last_active":"2023-10-07T09:07:49.970380+0000","last_peered":"2023-10-07T09:07:49.970380+0000","last_clean":"2023-10-07T09:07:49.970380+0000","last_became_active":"2023-10-07T09:07:49.970008+0000","last_became_peered":"2023-10-07T09:07:49.970008+0000","last_unstale":"2023-10-07T09:07:49.970380+0000","last_undegraded":"2023-10-07T09:07:49.970380+0000","last_fullsized":"2023-10-07T09:07:49.970380+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:13.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"198'3","reported_seq":12,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.996232+0000","last_change":"2023-10-07T09:07:48.993988+0000","last_active":"2023-10-07T09:07:49.996232+0000","last_peered":"2023-10-07T09:07:49.996232+0000","last_clean":"2023-10-07T09:07:49.996232+0000","last_became_active":"2023-10-07T09:07:48.993620+0000","last_became_peered":"2023-10-07T09:07:48.993620+0000","last_unstale":"2023-10-07T09:07:49.996232+0000","last_undegraded":"2023-10-07T09:07:49.996232+0000","last_fullsized":"2023-10-07T09:07:49.996232+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:58.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969878+0000","last_change":"2023-10-07T09:07:49.969878+0000","last_active":"2023-10-07T09:07:49.969878+0000","last_peered":"2023-10-07T09:07:49.969878+0000","last_clean":"2023-10-07T09:07:49.969878+0000","last_became_active":"2023-10-07T09:07:49.969595+0000","last_became_peered":"2023-10-07T09:07:49.969595+0000","last_unstale":"2023-10-07T09:07:49.969878+0000","last_undegraded":"2023-10-07T09:07:49.969878+0000","last_fullsized":"2023-10-07T09:07:49.969878+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:19.556800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"198'6","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.000976+0000","last_change":"2023-10-07T09:07:48.990632+0000","last_active":"2023-10-07T09:07:50.000976+0000","last_peered":"2023-10-07T09:07:50.000976+0000","last_clean":"2023-10-07T09:07:50.000976+0000","last_became_active":"2023-10-07T09:07:48.988475+0000","last_became_peered":"2023-10-07T09:07:48.988475+0000","last_unstale":"2023-10-07T09:07:50.000976+0000","last_undegraded":"2023-10-07T09:07:50.000976+0000","last_fullsized":"2023-10-07T09:07:50.000976+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:27.289033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971990+0000","last_change":"2023-10-07T09:07:49.971990+0000","last_active":"2023-10-07T09:07:49.971990+0000","last_peered":"2023-10-07T09:07:49.971990+0000","last_clean":"2023-10-07T09:07:49.971990+0000","last_became_active":"2023-10-07T09:07:49.971121+0000","last_became_peered":"2023-10-07T09:07:49.971121+0000","last_unstale":"2023-10-07T09:07:49.971990+0000","last_undegraded":"2023-10-07T09:07:49.971990+0000","last_fullsized":"2023-10-07T09:07:49.971990+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:49:19.291148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995536+0000","last_change":"2023-10-07T09:07:48.997720+0000","last_active":"2023-10-07T09:07:49.995536+0000","last_peered":"2023-10-07T09:07:49.995536+0000","last_clean":"2023-10-07T09:07:49.995536+0000","last_became_active":"2023-10-07T09:07:48.997393+0000","last_became_peered":"2023-10-07T09:07:48.997393+0000","last_unstale":"2023-10-07T09:07:49.995536+0000","last_undegraded":"2023-10-07T09:07:49.995536+0000","last_fullsized":"2023-10-07T09:07:49.995536+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:26.918875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975986+0000","last_change":"2023-10-07T09:07:49.975986+0000","last_active":"2023-10-07T09:07:49.975986+0000","last_peered":"2023-10-07T09:07:49.975986+0000","last_clean":"2023-10-07T09:07:49.975986+0000","last_became_active":"2023-10-07T09:07:49.975504+0000","last_became_peered":"2023-10-07T09:07:49.975504+0000","last_unstale":"2023-10-07T09:07:49.975986+0000","last_undegraded":"2023-10-07T09:07:49.975986+0000","last_fullsized":"2023-10-07T09:07:49.975986+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:16:34.820550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.996783+0000","last_change":"2023-10-07T09:07:48.993722+0000","last_active":"2023-10-07T09:07:48.996783+0000","last_peered":"2023-10-07T09:07:48.996783+0000","last_clean":"2023-10-07T09:07:48.996783+0000","last_became_active":"2023-10-07T09:07:48.993265+0000","last_became_peered":"2023-10-07T09:07:48.993265+0000","last_unstale":"2023-10-07T09:07:48.996783+0000","last_undegraded":"2023-10-07T09:07:48.996783+0000","last_fullsized":"2023-10-07T09:07:48.996783+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:19.231026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969642+0000","last_change":"2023-10-07T09:07:49.969642+0000","last_active":"2023-10-07T09:07:49.969642+0000","last_peered":"2023-10-07T09:07:49.969642+0000","last_clean":"2023-10-07T09:07:49.969642+0000","last_became_active":"2023-10-07T09:07:49.969339+0000","last_became_peered":"2023-10-07T09:07:49.969339+0000","last_unstale":"2023-10-07T09:07:49.969642+0000","last_undegraded":"2023-10-07T09:07:49.969642+0000","last_fullsized":"2023-10-07T09:07:49.969642+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:44.054556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995349+0000","last_change":"2023-10-07T09:07:48.992091+0000","last_active":"2023-10-07T09:07:48.995349+0000","last_peered":"2023-10-07T09:07:48.995349+0000","last_clean":"2023-10-07T09:07:48.995349+0000","last_became_active":"2023-10-07T09:07:48.991793+0000","last_became_peered":"2023-10-07T09:07:48.991793+0000","last_unstale":"2023-10-07T09:07:48.995349+0000","last_undegraded":"2023-10-07T09:07:48.995349+0000","last_fullsized":"2023-10-07T09:07:48.995349+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:00.310486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971098+0000","last_change":"2023-10-07T09:07:49.971098+0000","last_active":"2023-10-07T09:07:49.971098+0000","last_peered":"2023-10-07T09:07:49.971098+0000","last_clean":"2023-10-07T09:07:49.971098+0000","last_became_active":"2023-10-07T09:07:49.970800+0000","last_became_peered":"2023-10-07T09:07:49.970800+0000","last_unstale":"2023-10-07T09:07:49.971098+0000","last_undegraded":"2023-10-07T09:07:49.971098+0000","last_fullsized":"2023-10-07T09:07:49.971098+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:37.113567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"198'8","reported_seq":17,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.002027+0000","last_change":"2023-10-07T09:07:48.995516+0000","last_active":"2023-10-07T09:07:50.002027+0000","last_peered":"2023-10-07T09:07:50.002027+0000","last_clean":"2023-10-07T09:07:50.002027+0000","last_became_active":"2023-10-07T09:07:48.995326+0000","last_became_peered":"2023-10-07T09:07:48.995326+0000","last_unstale":"2023-10-07T09:07:50.002027+0000","last_undegraded":"2023-10-07T09:07:50.002027+0000","last_fullsized":"2023-10-07T09:07:50.002027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:21.674007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976780+0000","last_change":"2023-10-07T09:07:49.976780+0000","last_active":"2023-10-07T09:07:49.976780+0000","last_peered":"2023-10-07T09:07:49.976780+0000","last_clean":"2023-10-07T09:07:49.976780+0000","last_became_active":"2023-10-07T09:07:49.976478+0000","last_became_peered":"2023-10-07T09:07:49.976478+0000","last_unstale":"2023-10-07T09:07:49.976780+0000","last_undegraded":"2023-10-07T09:07:49.976780+0000","last_fullsized":"2023-10-07T09:07:49.976780+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:24:44.075029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.965530+0000","last_change":"2023-10-07T09:07:48.989774+0000","last_active":"2023-10-07T09:07:49.965530+0000","last_peered":"2023-10-07T09:07:49.965530+0000","last_clean":"2023-10-07T09:07:49.965530+0000","last_became_active":"2023-10-07T09:07:48.989468+0000","last_became_peered":"2023-10-07T09:07:48.989468+0000","last_unstale":"2023-10-07T09:07:49.965530+0000","last_undegraded":"2023-10-07T09:07:49.965530+0000","last_fullsized":"2023-10-07T09:07:49.965530+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:32.533498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973830+0000","last_change":"2023-10-07T09:07:49.973830+0000","last_active":"2023-10-07T09:07:49.973830+0000","last_peered":"2023-10-07T09:07:49.973830+0000","last_clean":"2023-10-07T09:07:49.973830+0000","last_became_active":"2023-10-07T09:07:49.973608+0000","last_became_peered":"2023-10-07T09:07:49.973608+0000","last_unstale":"2023-10-07T09:07:49.973830+0000","last_undegraded":"2023-10-07T09:07:49.973830+0000","last_fullsized":"2023-10-07T09:07:49.973830+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:12:01.750583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995156+0000","last_change":"2023-10-07T09:07:48.990074+0000","last_active":"2023-10-07T09:07:49.995156+0000","last_peered":"2023-10-07T09:07:49.995156+0000","last_clean":"2023-10-07T09:07:49.995156+0000","last_became_active":"2023-10-07T09:07:48.989531+0000","last_became_peered":"2023-10-07T09:07:48.989531+0000","last_unstale":"2023-10-07T09:07:49.995156+0000","last_undegraded":"2023-10-07T09:07:49.995156+0000","last_fullsized":"2023-10-07T09:07:49.995156+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:25.709798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969332+0000","last_change":"2023-10-07T09:07:49.969332+0000","last_active":"2023-10-07T09:07:49.969332+0000","last_peered":"2023-10-07T09:07:49.969332+0000","last_clean":"2023-10-07T09:07:49.969332+0000","last_became_active":"2023-10-07T09:07:49.969110+0000","last_became_peered":"2023-10-07T09:07:49.969110+0000","last_unstale":"2023-10-07T09:07:49.969332+0000","last_undegraded":"2023-10-07T09:07:49.969332+0000","last_fullsized":"2023-10-07T09:07:49.969332+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.062317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.960691+0000","last_change":"2023-10-07T09:07:49.000224+0000","last_active":"2023-10-07T09:07:49.960691+0000","last_peered":"2023-10-07T09:07:49.960691+0000","last_clean":"2023-10-07T09:07:49.960691+0000","last_became_active":"2023-10-07T09:07:48.999950+0000","last_became_peered":"2023-10-07T09:07:48.999950+0000","last_unstale":"2023-10-07T09:07:49.960691+0000","last_undegraded":"2023-10-07T09:07:49.960691+0000","last_fullsized":"2023-10-07T09:07:49.960691+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:37:20.234099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975389+0000","last_change":"2023-10-07T09:07:49.975389+0000","last_active":"2023-10-07T09:07:49.975389+0000","last_peered":"2023-10-07T09:07:49.975389+0000","last_clean":"2023-10-07T09:07:49.975389+0000","last_became_active":"2023-10-07T09:07:49.974419+0000","last_became_peered":"2023-10-07T09:07:49.974419+0000","last_unstale":"2023-10-07T09:07:49.975389+0000","last_undegraded":"2023-10-07T09:07:49.975389+0000","last_fullsized":"2023-10-07T09:07:49.975389+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:07:14.733813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993634+0000","last_change":"2023-10-07T09:07:48.989931+0000","last_active":"2023-10-07T09:07:48.993634+0000","last_peered":"2023-10-07T09:07:48.993634+0000","last_clean":"2023-10-07T09:07:48.993634+0000","last_became_active":"2023-10-07T09:07:48.989704+0000","last_became_peered":"2023-10-07T09:07:48.989704+0000","last_unstale":"2023-10-07T09:07:48.993634+0000","last_undegraded":"2023-10-07T09:07:48.993634+0000","last_fullsized":"2023-10-07T09:07:48.993634+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:50.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975058+0000","last_change":"2023-10-07T09:07:49.975058+0000","last_active":"2023-10-07T09:07:49.975058+0000","last_peered":"2023-10-07T09:07:49.975058+0000","last_clean":"2023-10-07T09:07:49.975058+0000","last_became_active":"2023-10-07T09:07:49.974598+0000","last_became_peered":"2023-10-07T09:07:49.974598+0000","last_unstale":"2023-10-07T09:07:49.975058+0000","last_undegraded":"2023-10-07T09:07:49.975058+0000","last_fullsized":"2023-10-07T09:07:49.975058+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:02.148149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.001505+0000","last_change":"2023-10-07T09:07:48.996186+0000","last_active":"2023-10-07T09:07:50.001505+0000","last_peered":"2023-10-07T09:07:50.001505+0000","last_clean":"2023-10-07T09:07:50.001505+0000","last_became_active":"2023-10-07T09:07:48.995683+0000","last_became_peered":"2023-10-07T09:07:48.995683+0000","last_unstale":"2023-10-07T09:07:50.001505+0000","last_undegraded":"2023-10-07T09:07:50.001505+0000","last_fullsized":"2023-10-07T09:07:50.001505+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:12.891588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976540+0000","last_change":"2023-10-07T09:07:49.976540+0000","last_active":"2023-10-07T09:07:49.976540+0000","last_peered":"2023-10-07T09:07:49.976540+0000","last_clean":"2023-10-07T09:07:49.976540+0000","last_became_active":"2023-10-07T09:07:49.976247+0000","last_became_peered":"2023-10-07T09:07:49.976247+0000","last_unstale":"2023-10-07T09:07:49.976540+0000","last_undegraded":"2023-10-07T09:07:49.976540+0000","last_fullsized":"2023-10-07T09:07:49.976540+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:02.997800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.001632+0000","last_change":"2023-10-07T09:07:49.001250+0000","last_active":"2023-10-07T09:07:49.001632+0000","last_peered":"2023-10-07T09:07:49.001632+0000","last_clean":"2023-10-07T09:07:49.001632+0000","last_became_active":"2023-10-07T09:07:49.000922+0000","last_became_peered":"2023-10-07T09:07:49.000922+0000","last_unstale":"2023-10-07T09:07:49.001632+0000","last_undegraded":"2023-10-07T09:07:49.001632+0000","last_fullsized":"2023-10-07T09:07:49.001632+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:12.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971568+0000","last_change":"2023-10-07T09:07:49.971568+0000","last_active":"2023-10-07T09:07:49.971568+0000","last_peered":"2023-10-07T09:07:49.971568+0000","last_clean":"2023-10-07T09:07:49.971568+0000","last_became_active":"2023-10-07T09:07:49.971291+0000","last_became_peered":"2023-10-07T09:07:49.971291+0000","last_unstale":"2023-10-07T09:07:49.971568+0000","last_undegraded":"2023-10-07T09:07:49.971568+0000","last_fullsized":"2023-10-07T09:07:49.971568+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:57.266749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.001124+0000","last_change":"2023-10-07T09:07:49.000619+0000","last_active":"2023-10-07T09:07:49.001124+0000","last_peered":"2023-10-07T09:07:49.001124+0000","last_clean":"2023-10-07T09:07:49.001124+0000","last_became_active":"2023-10-07T09:07:49.000350+0000","last_became_peered":"2023-10-07T09:07:49.000350+0000","last_unstale":"2023-10-07T09:07:49.001124+0000","last_undegraded":"2023-10-07T09:07:49.001124+0000","last_fullsized":"2023-10-07T09:07:49.001124+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:20.676551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972229+0000","last_change":"2023-10-07T09:07:49.972229+0000","last_active":"2023-10-07T09:07:49.972229+0000","last_peered":"2023-10-07T09:07:49.972229+0000","last_clean":"2023-10-07T09:07:49.972229+0000","last_became_active":"2023-10-07T09:07:49.969678+0000","last_became_peered":"2023-10-07T09:07:49.969678+0000","last_unstale":"2023-10-07T09:07:49.972229+0000","last_undegraded":"2023-10-07T09:07:49.972229+0000","last_fullsized":"2023-10-07T09:07:49.972229+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:53:43.801775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.997877+0000","last_change":"2023-10-07T09:07:48.995071+0000","last_active":"2023-10-07T09:07:48.997877+0000","last_peered":"2023-10-07T09:07:48.997877+0000","last_clean":"2023-10-07T09:07:48.997877+0000","last_became_active":"2023-10-07T09:07:48.994593+0000","last_became_peered":"2023-10-07T09:07:48.994593+0000","last_unstale":"2023-10-07T09:07:48.997877+0000","last_undegraded":"2023-10-07T09:07:48.997877+0000","last_fullsized":"2023-10-07T09:07:48.997877+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:00:26.589964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978550+0000","last_change":"2023-10-07T09:07:49.978550+0000","last_active":"2023-10-07T09:07:49.978550+0000","last_peered":"2023-10-07T09:07:49.978550+0000","last_clean":"2023-10-07T09:07:49.978550+0000","last_became_active":"2023-10-07T09:07:49.977565+0000","last_became_peered":"2023-10-07T09:07:49.977565+0000","last_unstale":"2023-10-07T09:07:49.978550+0000","last_undegraded":"2023-10-07T09:07:49.978550+0000","last_fullsized":"2023-10-07T09:07:49.978550+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:58.344925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995312+0000","last_change":"2023-10-07T09:07:48.994060+0000","last_active":"2023-10-07T09:07:49.995312+0000","last_peered":"2023-10-07T09:07:49.995312+0000","last_clean":"2023-10-07T09:07:49.995312+0000","last_became_active":"2023-10-07T09:07:48.993354+0000","last_became_peered":"2023-10-07T09:07:48.993354+0000","last_unstale":"2023-10-07T09:07:49.995312+0000","last_undegraded":"2023-10-07T09:07:49.995312+0000","last_fullsized":"2023-10-07T09:07:49.995312+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:22:34.700665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973947+0000","last_change":"2023-10-07T09:07:49.973947+0000","last_active":"2023-10-07T09:07:49.973947+0000","last_peered":"2023-10-07T09:07:49.973947+0000","last_clean":"2023-10-07T09:07:49.973947+0000","last_became_active":"2023-10-07T09:07:49.973673+0000","last_became_peered":"2023-10-07T09:07:49.973673+0000","last_unstale":"2023-10-07T09:07:49.973947+0000","last_undegraded":"2023-10-07T09:07:49.973947+0000","last_fullsized":"2023-10-07T09:07:49.973947+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:12.347010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993841+0000","last_change":"2023-10-07T09:07:48.989845+0000","last_active":"2023-10-07T09:07:48.993841+0000","last_peered":"2023-10-07T09:07:48.993841+0000","last_clean":"2023-10-07T09:07:48.993841+0000","last_became_active":"2023-10-07T09:07:48.988698+0000","last_became_peered":"2023-10-07T09:07:48.988698+0000","last_unstale":"2023-10-07T09:07:48.993841+0000","last_undegraded":"2023-10-07T09:07:48.993841+0000","last_fullsized":"2023-10-07T09:07:48.993841+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:06.758777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.965693+0000","last_change":"2023-10-07T09:07:49.965693+0000","last_active":"2023-10-07T09:07:49.965693+0000","last_peered":"2023-10-07T09:07:49.965693+0000","last_clean":"2023-10-07T09:07:49.965693+0000","last_became_active":"2023-10-07T09:07:49.965422+0000","last_became_peered":"2023-10-07T09:07:49.965422+0000","last_unstale":"2023-10-07T09:07:49.965693+0000","last_undegraded":"2023-10-07T09:07:49.965693+0000","last_fullsized":"2023-10-07T09:07:49.965693+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:20.591948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993189+0000","last_change":"2023-10-07T09:07:48.991574+0000","last_active":"2023-10-07T09:07:48.993189+0000","last_peered":"2023-10-07T09:07:48.993189+0000","last_clean":"2023-10-07T09:07:48.993189+0000","last_became_active":"2023-10-07T09:07:48.991264+0000","last_became_peered":"2023-10-07T09:07:48.991264+0000","last_unstale":"2023-10-07T09:07:48.993189+0000","last_undegraded":"2023-10-07T09:07:48.993189+0000","last_fullsized":"2023-10-07T09:07:48.993189+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:21.033972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972559+0000","last_change":"2023-10-07T09:07:49.972559+0000","last_active":"2023-10-07T09:07:49.972559+0000","last_peered":"2023-10-07T09:07:49.972559+0000","last_clean":"2023-10-07T09:07:49.972559+0000","last_became_active":"2023-10-07T09:07:49.971404+0000","last_became_peered":"2023-10-07T09:07:49.971404+0000","last_unstale":"2023-10-07T09:07:49.972559+0000","last_undegraded":"2023-10-07T09:07:49.972559+0000","last_fullsized":"2023-10-07T09:07:49.972559+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:32.140902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.000763+0000","last_change":"2023-10-07T09:07:49.000145+0000","last_active":"2023-10-07T09:07:49.000763+0000","last_peered":"2023-10-07T09:07:49.000763+0000","last_clean":"2023-10-07T09:07:49.000763+0000","last_became_active":"2023-10-07T09:07:48.999877+0000","last_became_peered":"2023-10-07T09:07:48.999877+0000","last_unstale":"2023-10-07T09:07:49.000763+0000","last_undegraded":"2023-10-07T09:07:49.000763+0000","last_fullsized":"2023-10-07T09:07:49.000763+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:31.537764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.967374+0000","last_change":"2023-10-07T09:07:49.967374+0000","last_active":"2023-10-07T09:07:49.967374+0000","last_peered":"2023-10-07T09:07:49.967374+0000","last_clean":"2023-10-07T09:07:49.967374+0000","last_became_active":"2023-10-07T09:07:49.967051+0000","last_became_peered":"2023-10-07T09:07:49.967051+0000","last_unstale":"2023-10-07T09:07:49.967374+0000","last_undegraded":"2023-10-07T09:07:49.967374+0000","last_fullsized":"2023-10-07T09:07:49.967374+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:57.797256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.992953+0000","last_change":"2023-10-07T09:07:48.989297+0000","last_active":"2023-10-07T09:07:48.992953+0000","last_peered":"2023-10-07T09:07:48.992953+0000","last_clean":"2023-10-07T09:07:48.992953+0000","last_became_active":"2023-10-07T09:07:48.988667+0000","last_became_peered":"2023-10-07T09:07:48.988667+0000","last_unstale":"2023-10-07T09:07:48.992953+0000","last_undegraded":"2023-10-07T09:07:48.992953+0000","last_fullsized":"2023-10-07T09:07:48.992953+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:44.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975790+0000","last_change":"2023-10-07T09:07:49.975790+0000","last_active":"2023-10-07T09:07:49.975790+0000","last_peered":"2023-10-07T09:07:49.975790+0000","last_clean":"2023-10-07T09:07:49.975790+0000","last_became_active":"2023-10-07T09:07:49.975472+0000","last_became_peered":"2023-10-07T09:07:49.975472+0000","last_unstale":"2023-10-07T09:07:49.975790+0000","last_undegraded":"2023-10-07T09:07:49.975790+0000","last_fullsized":"2023-10-07T09:07:49.975790+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:31.637588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.994347+0000","last_change":"2023-10-07T09:07:48.992917+0000","last_active":"2023-10-07T09:07:48.994347+0000","last_peered":"2023-10-07T09:07:48.994347+0000","last_clean":"2023-10-07T09:07:48.994347+0000","last_became_active":"2023-10-07T09:07:48.992658+0000","last_became_peered":"2023-10-07T09:07:48.992658+0000","last_unstale":"2023-10-07T09:07:48.994347+0000","last_undegraded":"2023-10-07T09:07:48.994347+0000","last_fullsized":"2023-10-07T09:07:48.994347+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:19.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972217+0000","last_change":"2023-10-07T09:07:49.972217+0000","last_active":"2023-10-07T09:07:49.972217+0000","last_peered":"2023-10-07T09:07:49.972217+0000","last_clean":"2023-10-07T09:07:49.972217+0000","last_became_active":"2023-10-07T09:07:49.971958+0000","last_became_peered":"2023-10-07T09:07:49.971958+0000","last_unstale":"2023-10-07T09:07:49.972217+0000","last_undegraded":"2023-10-07T09:07:49.972217+0000","last_fullsized":"2023-10-07T09:07:49.972217+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:22.680515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995546+0000","last_change":"2023-10-07T09:07:48.994319+0000","last_active":"2023-10-07T09:07:48.995546+0000","last_peered":"2023-10-07T09:07:48.995546+0000","last_clean":"2023-10-07T09:07:48.995546+0000","last_became_active":"2023-10-07T09:07:48.994032+0000","last_became_peered":"2023-10-07T09:07:48.994032+0000","last_unstale":"2023-10-07T09:07:48.995546+0000","last_undegraded":"2023-10-07T09:07:48.995546+0000","last_fullsized":"2023-10-07T09:07:48.995546+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:43.141059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972342+0000","last_change":"2023-10-07T09:07:49.972342+0000","last_active":"2023-10-07T09:07:49.972342+0000","last_peered":"2023-10-07T09:07:49.972342+0000","last_clean":"2023-10-07T09:07:49.972342+0000","last_became_active":"2023-10-07T09:07:49.970934+0000","last_became_peered":"2023-10-07T09:07:49.970934+0000","last_unstale":"2023-10-07T09:07:49.972342+0000","last_undegraded":"2023-10-07T09:07:49.972342+0000","last_fullsized":"2023-10-07T09:07:49.972342+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:23:44.510614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.998678+0000","last_change":"2023-10-07T09:07:48.996179+0000","last_active":"2023-10-07T09:07:48.998678+0000","last_peered":"2023-10-07T09:07:48.998678+0000","last_clean":"2023-10-07T09:07:48.998678+0000","last_became_active":"2023-10-07T09:07:48.995896+0000","last_became_peered":"2023-10-07T09:07:48.995896+0000","last_unstale":"2023-10-07T09:07:48.998678+0000","last_undegraded":"2023-10-07T09:07:48.998678+0000","last_fullsized":"2023-10-07T09:07:48.998678+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:46.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972536+0000","last_change":"2023-10-07T09:07:49.972536+0000","last_active":"2023-10-07T09:07:49.972536+0000","last_peered":"2023-10-07T09:07:49.972536+0000","last_clean":"2023-10-07T09:07:49.972536+0000","last_became_active":"2023-10-07T09:07:49.972094+0000","last_became_peered":"2023-10-07T09:07:49.972094+0000","last_unstale":"2023-10-07T09:07:49.972536+0000","last_undegraded":"2023-10-07T09:07:49.972536+0000","last_fullsized":"2023-10-07T09:07:49.972536+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:58:01.699641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":322,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.982852+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:07:48.982852+0000","last_peered":"2023-10-07T09:07:48.982852+0000","last_clean":"2023-10-07T09:07:48.982852+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:07:48.982852+0000","last_undegraded":"2023-10-07T09:07:48.982852+0000","last_fullsized":"2023-10-07T09:07:48.982852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304432,"kb_used_data":3048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067408,"statfs":{"total":96636764160,"available":96325025792,"internally_reserved":0,"allocated":3121152,"data_stored":1720484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.746,"15min":0.85799999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60299999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.26700000000000002},"max":{"1min":0.58999999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.77100000000000002,"15min":0.86299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70899999999999996}]},{"osd":4,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.53600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.88400000000000001},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1129574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81399999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.752,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71499999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":1.29},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":4.0880000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.60199999999999998},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":2519040,"data_stored":1129540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34100000000000003,"15min":0.33600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.56299999999999994,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.39200000000000002},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.221},"max":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.24399999999999999,"15min":0.224},"max":{"1min":0.56899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38400000000000001,"15min":0.66700000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58599999999999997,"5min":0.90400000000000003,"15min":11.32},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38,"15min":0.68300000000000005},"min":{"1min":0.27900000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":1.077,"15min":11.880000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38400000000000001,"15min":0.38900000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75800000000000001,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60699999999999998,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.365,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.502},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.75900000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.86799999999999999,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.77300000000000002},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.325,"15min":4.5209999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85499999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308524,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063316,"statfs":{"total":96636764160,"available":96320835584,"internally_reserved":0,"allocated":3117056,"data_stored":1719978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.34200000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.54500000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.191},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.371,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.61199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.625},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35499999999999998},"min":{"1min":0.29299999999999998,"5min":0.253,"15min":0.22},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.626,"15min":0.63500000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.61199999999999999},"min":{"1min":0.46800000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.0249999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.875,"15min":1.006},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.95599999999999996},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2539520,"data_stored":1131652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.52900000000000003},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.497,"5min":0.5,"15min":10.214},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.755},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54800000000000004,"5min":0.66100000000000003,"15min":10.144},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39500000000000002,"15min":0.63500000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52000000000000002,"5min":0.68700000000000006,"15min":10.071},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.65200000000000002},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.57199999999999995,"5min":0.70399999999999996,"15min":10.183},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.58599999999999997},"min":{"1min":0.48499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.745,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":1},"min":{"1min":0.436,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.87,"15min":1.0880000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81299999999999994,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61799999999999999,"15min":1.052},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.753,"5min":4.391,"15min":4.391},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2523136,"data_stored":1129630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.40600000000000003},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.433,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.35099999999999998,"15min":0.63500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49099999999999999,"5min":0.53400000000000003,"15min":12.038},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.42799999999999999,"5min":0.51600000000000001,"15min":2.3450000000000002},"last":0.38},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35899999999999999,"15min":0.439},"min":{"1min":0.245,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.53300000000000003,"5min":0.60499999999999998,"15min":2.3380000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36399999999999999,"15min":0.53400000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":6.1230000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":1.2330000000000001},"last":0.5}]},{"osd":4,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.81799999999999995},"min":{"1min":0.36699999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":2.081},"last":0.54300000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.63800000000000001},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":2.1099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":2.1960000000000002},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59499999999999997,"15min":0.86899999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":1.135,"15min":12.007},"last":0.623},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":2.0459999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":2.1699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60599999999999998,"15min":0.88400000000000001},"min":{"1min":0.48699999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":1.179,"15min":11.973000000000001},"last":0.60499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1131076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.74299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.505,"15min":0.66900000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.79700000000000004},"min":{"1min":0.378,"5min":0.318,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.505},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.82799999999999996},"min":{"1min":0.378,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.80000000000000004},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.82599999999999996},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":10.01},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.66800000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":0.88100000000000001,"15min":5.569},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.80000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78900000000000003,"5min":0.93500000000000005,"15min":10.131},"last":0.436}]},{"osd":5,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49099999999999999,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76800000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.371},{"interface":"front","average":{"1min":0.501,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.70999999999999996,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.79400000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.33500000000000002},"max":{"1min":0.78000000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1129610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66000000000000003,"5min":1.127,"15min":1.127},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.31},"max":{"1min":0.68100000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.71499999999999997,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60999999999999999,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.45700000000000002,"5min":0.36899999999999999,"15min":0.35399999999999998},"max":{"1min":0.71599999999999997,"5min":1.478,"15min":1.478},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67100000000000004,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.25700000000000001},"max":{"1min":0.69399999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68300000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:07:54.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:07:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.251+0000 7fab1e7da700 1 Processor -- start 2023-10-07T09:07:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.251+0000 7fab1e7da700 1 -- start start 2023-10-07T09:07:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1e7da700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fab18159420 0x7fab180b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1e7da700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab180b2980 con 0x7fab181597f0 2023-10-07T09:07:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1e7da700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab180b11d0 con 0x7fab1815d230 2023-10-07T09:07:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1e7da700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab180b14b0 con 0x7fab18159420 2023-10-07T09:07:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1d7d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fab18159420 0x7fab180b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1cfd7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fab181597f0 0x7fab180b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47756/0 (socket says 172.21.15.46:47756) 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1cfd7700 1 -- 172.21.15.46:0/629942500 learned_addr learned my addr 172.21.15.46:0/629942500 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1d7d8700 1 -- 172.21.15.46:0/629942500 >> v1:172.21.15.133:6789/0 conn(0x7fab1815d230 legacy=0x7fab1815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1d7d8700 1 -- 172.21.15.46:0/629942500 >> v1:172.21.15.46:6789/0 conn(0x7fab181597f0 legacy=0x7fab180b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab17fff700 1 -- 172.21.15.46:0/629942500 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562429782 0 0) 0x7fab180b2980 con 0x7fab181597f0 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.252+0000 7fab1d7d8700 1 -- 172.21.15.46:0/629942500 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab180b1790 con 0x7fab18159420 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1d7d8700 1 --2- 172.21.15.46:0/629942500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab18159420 0x7fab180b5f40 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fab100098e0 tx=0x7fab100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f235a6db77e85888 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab17fff700 1 -- 172.21.15.46:0/629942500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10009e80 con 0x7fab18159420 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab17fff700 1 -- 172.21.15.46:0/629942500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000b860 con 0x7fab18159420 2023-10-07T09:07:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab17fff700 1 -- 172.21.15.46:0/629942500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000bbe0 con 0x7fab18159420 2023-10-07T09:07:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 -- 172.21.15.46:0/629942500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab18159420 msgr2=0x7fab180b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 --2- 172.21.15.46:0/629942500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab18159420 0x7fab180b5f40 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fab100098e0 tx=0x7fab100091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 -- 172.21.15.46:0/629942500 shutdown_connections 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 --2- 172.21.15.46:0/629942500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab18159420 0x7fab180b5f40 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 -- 172.21.15.46:0/629942500 >> 172.21.15.46:0/629942500 conn(0x7fab180d0660 msgr2=0x7fab180d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 -- 172.21.15.46:0/629942500 shutdown_connections 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.253+0000 7fab1e7da700 1 -- 172.21.15.46:0/629942500 wait complete. 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.254+0000 7fab1e7da700 1 Processor -- start 2023-10-07T09:07:54.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.254+0000 7fab1e7da700 1 -- start start 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab18159420 0x7fab180c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 0x7fab18155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180c82e0 con 0x7fab1815d230 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180c7240 con 0x7fab18159420 2023-10-07T09:07:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1e7da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab180c7520 con 0x7fab181597f0 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1dfd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1dfd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33076/0 (socket says 172.21.15.46:33076) 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.255+0000 7fab1dfd9700 1 -- 172.21.15.46:0/1978346554 learned_addr learned my addr 172.21.15.46:0/1978346554 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1d7d8700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab18159420 0x7fab180c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1cfd7700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 0x7fab18155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 -- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 msgr2=0x7fab18155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 0x7fab18155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 -- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab18159420 msgr2=0x7fab180c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab18159420 0x7fab180c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 -- 172.21.15.46:0/1978346554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10009420 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1cfd7700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 0x7fab18155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1dfd9700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fab0800c810 tx=0x7fab08001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08012630 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08012790 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab180c7800 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08012b50 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.256+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab180c7dc0 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.257+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1804c3c0 con 0x7fab1815d230 2023-10-07T09:07:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.257+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fab08003030 con 0x7fab1815d230 2023-10-07T09:07:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.258+0000 7fab157fa700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 0x7fab040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.258+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab08084bc0 con 0x7fab1815d230 2023-10-07T09:07:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.258+0000 7fab1d7d8700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 0x7fab040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.259+0000 7fab1d7d8700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 0x7fab040697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab100093f0 tx=0x7fab10017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.262+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab08051810 con 0x7fab1815d230 2023-10-07T09:07:54.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.448+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab180b1a70 con 0x7fab04067320 2023-10-07T09:07:54.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.457+0000 7fab157fa700 1 -- 172.21.15.46:0/1978346554 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289956 (secure 0 0 0) 0x7fab180b1a70 con 0x7fab04067320 2023-10-07T09:07:54.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 msgr2=0x7fab040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 0x7fab040697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab100093f0 tx=0x7fab10017000 comp rx=0 tx=0).stop 2023-10-07T09:07:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 msgr2=0x7fab18155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fab0800c810 tx=0x7fab08001650 comp rx=0 tx=0).stop 2023-10-07T09:07:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 shutdown_connections 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fab04067320 0x7fab040697d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1815d230 0x7fab18155cf0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab18159420 0x7fab180c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 --2- 172.21.15.46:0/1978346554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab181597f0 0x7fab18155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 >> 172.21.15.46:0/1978346554 conn(0x7fab180d0660 msgr2=0x7fab180cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 shutdown_connections 2023-10-07T09:07:54.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.460+0000 7fab1e7da700 1 -- 172.21.15.46:0/1978346554 wait complete. 2023-10-07T09:07:54.465 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:07:54.473 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2023-10-07T09:07:53.895810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444256,"kb_used_data":20896,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530464,"statfs":{"total":773094113280,"available":770591195136,"internally_reserved":0,"allocated":21397504,"data_stored":10221544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.925173"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975213+0000","last_change":"2023-10-07T09:07:49.975213+0000","last_active":"2023-10-07T09:07:49.975213+0000","last_peered":"2023-10-07T09:07:49.975213+0000","last_clean":"2023-10-07T09:07:49.975213+0000","last_became_active":"2023-10-07T09:07:49.974425+0000","last_became_peered":"2023-10-07T09:07:49.974425+0000","last_unstale":"2023-10-07T09:07:49.975213+0000","last_undegraded":"2023-10-07T09:07:49.975213+0000","last_fullsized":"2023-10-07T09:07:49.975213+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:19.598831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970237+0000","last_change":"2023-10-07T09:07:49.970237+0000","last_active":"2023-10-07T09:07:49.970237+0000","last_peered":"2023-10-07T09:07:49.970237+0000","last_clean":"2023-10-07T09:07:49.970237+0000","last_became_active":"2023-10-07T09:07:49.969730+0000","last_became_peered":"2023-10-07T09:07:49.969730+0000","last_unstale":"2023-10-07T09:07:49.970237+0000","last_undegraded":"2023-10-07T09:07:49.970237+0000","last_fullsized":"2023-10-07T09:07:49.970237+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:57:50.664932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976139+0000","last_change":"2023-10-07T09:07:49.976139+0000","last_active":"2023-10-07T09:07:49.976139+0000","last_peered":"2023-10-07T09:07:49.976139+0000","last_clean":"2023-10-07T09:07:49.976139+0000","last_became_active":"2023-10-07T09:07:49.975873+0000","last_became_peered":"2023-10-07T09:07:49.975873+0000","last_unstale":"2023-10-07T09:07:49.976139+0000","last_undegraded":"2023-10-07T09:07:49.976139+0000","last_fullsized":"2023-10-07T09:07:49.976139+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:07.765285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.967819+0000","last_change":"2023-10-07T09:07:49.967819+0000","last_active":"2023-10-07T09:07:49.967819+0000","last_peered":"2023-10-07T09:07:49.967819+0000","last_clean":"2023-10-07T09:07:49.967819+0000","last_became_active":"2023-10-07T09:07:49.967556+0000","last_became_peered":"2023-10-07T09:07:49.967556+0000","last_unstale":"2023-10-07T09:07:49.967819+0000","last_undegraded":"2023-10-07T09:07:49.967819+0000","last_fullsized":"2023-10-07T09:07:49.967819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:02.105284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.966180+0000","last_change":"2023-10-07T09:07:49.966180+0000","last_active":"2023-10-07T09:07:49.966180+0000","last_peered":"2023-10-07T09:07:49.966180+0000","last_clean":"2023-10-07T09:07:49.966180+0000","last_became_active":"2023-10-07T09:07:49.965784+0000","last_became_peered":"2023-10-07T09:07:49.965784+0000","last_unstale":"2023-10-07T09:07:49.966180+0000","last_undegraded":"2023-10-07T09:07:49.966180+0000","last_fullsized":"2023-10-07T09:07:49.966180+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:21:10.091794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973038+0000","last_change":"2023-10-07T09:07:49.973038+0000","last_active":"2023-10-07T09:07:49.973038+0000","last_peered":"2023-10-07T09:07:49.973038+0000","last_clean":"2023-10-07T09:07:49.973038+0000","last_became_active":"2023-10-07T09:07:49.972732+0000","last_became_peered":"2023-10-07T09:07:49.972732+0000","last_unstale":"2023-10-07T09:07:49.973038+0000","last_undegraded":"2023-10-07T09:07:49.973038+0000","last_fullsized":"2023-10-07T09:07:49.973038+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:26.496994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973527+0000","last_change":"2023-10-07T09:07:49.973527+0000","last_active":"2023-10-07T09:07:49.973527+0000","last_peered":"2023-10-07T09:07:49.973527+0000","last_clean":"2023-10-07T09:07:49.973527+0000","last_became_active":"2023-10-07T09:07:49.973238+0000","last_became_peered":"2023-10-07T09:07:49.973238+0000","last_unstale":"2023-10-07T09:07:49.973527+0000","last_undegraded":"2023-10-07T09:07:49.973527+0000","last_fullsized":"2023-10-07T09:07:49.973527+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:47.510196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971672+0000","last_change":"2023-10-07T09:07:49.971672+0000","last_active":"2023-10-07T09:07:49.971672+0000","last_peered":"2023-10-07T09:07:49.971672+0000","last_clean":"2023-10-07T09:07:49.971672+0000","last_became_active":"2023-10-07T09:07:49.971402+0000","last_became_peered":"2023-10-07T09:07:49.971402+0000","last_unstale":"2023-10-07T09:07:49.971672+0000","last_undegraded":"2023-10-07T09:07:49.971672+0000","last_fullsized":"2023-10-07T09:07:49.971672+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971955+0000","last_change":"2023-10-07T09:07:49.971955+0000","last_active":"2023-10-07T09:07:49.971955+0000","last_peered":"2023-10-07T09:07:49.971955+0000","last_clean":"2023-10-07T09:07:49.971955+0000","last_became_active":"2023-10-07T09:07:49.970054+0000","last_became_peered":"2023-10-07T09:07:49.970054+0000","last_unstale":"2023-10-07T09:07:49.971955+0000","last_undegraded":"2023-10-07T09:07:49.971955+0000","last_fullsized":"2023-10-07T09:07:49.971955+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:13.716945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976106+0000","last_change":"2023-10-07T09:07:49.976106+0000","last_active":"2023-10-07T09:07:49.976106+0000","last_peered":"2023-10-07T09:07:49.976106+0000","last_clean":"2023-10-07T09:07:49.976106+0000","last_became_active":"2023-10-07T09:07:49.975827+0000","last_became_peered":"2023-10-07T09:07:49.975827+0000","last_unstale":"2023-10-07T09:07:49.976106+0000","last_undegraded":"2023-10-07T09:07:49.976106+0000","last_fullsized":"2023-10-07T09:07:49.976106+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:13.716945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972397+0000","last_change":"2023-10-07T09:07:49.972397+0000","last_active":"2023-10-07T09:07:49.972397+0000","last_peered":"2023-10-07T09:07:49.972397+0000","last_clean":"2023-10-07T09:07:49.972397+0000","last_became_active":"2023-10-07T09:07:49.972112+0000","last_became_peered":"2023-10-07T09:07:49.972112+0000","last_unstale":"2023-10-07T09:07:49.972397+0000","last_undegraded":"2023-10-07T09:07:49.972397+0000","last_fullsized":"2023-10-07T09:07:49.972397+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:18.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975395+0000","last_change":"2023-10-07T09:07:49.975395+0000","last_active":"2023-10-07T09:07:49.975395+0000","last_peered":"2023-10-07T09:07:49.975395+0000","last_clean":"2023-10-07T09:07:49.975395+0000","last_became_active":"2023-10-07T09:07:49.975123+0000","last_became_peered":"2023-10-07T09:07:49.975123+0000","last_unstale":"2023-10-07T09:07:49.975395+0000","last_undegraded":"2023-10-07T09:07:49.975395+0000","last_fullsized":"2023-10-07T09:07:49.975395+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:56:24.108225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975151+0000","last_change":"2023-10-07T09:07:49.975151+0000","last_active":"2023-10-07T09:07:49.975151+0000","last_peered":"2023-10-07T09:07:49.975151+0000","last_clean":"2023-10-07T09:07:49.975151+0000","last_became_active":"2023-10-07T09:07:49.974859+0000","last_became_peered":"2023-10-07T09:07:49.974859+0000","last_unstale":"2023-10-07T09:07:49.975151+0000","last_undegraded":"2023-10-07T09:07:49.975151+0000","last_fullsized":"2023-10-07T09:07:49.975151+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:01.605298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975331+0000","last_change":"2023-10-07T09:07:49.975331+0000","last_active":"2023-10-07T09:07:49.975331+0000","last_peered":"2023-10-07T09:07:49.975331+0000","last_clean":"2023-10-07T09:07:49.975331+0000","last_became_active":"2023-10-07T09:07:49.974399+0000","last_became_peered":"2023-10-07T09:07:49.974399+0000","last_unstale":"2023-10-07T09:07:49.975331+0000","last_undegraded":"2023-10-07T09:07:49.975331+0000","last_fullsized":"2023-10-07T09:07:49.975331+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:19.780622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977882+0000","last_change":"2023-10-07T09:07:49.977882+0000","last_active":"2023-10-07T09:07:49.977882+0000","last_peered":"2023-10-07T09:07:49.977882+0000","last_clean":"2023-10-07T09:07:49.977882+0000","last_became_active":"2023-10-07T09:07:49.977463+0000","last_became_peered":"2023-10-07T09:07:49.977463+0000","last_unstale":"2023-10-07T09:07:49.977882+0000","last_undegraded":"2023-10-07T09:07:49.977882+0000","last_fullsized":"2023-10-07T09:07:49.977882+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:01.316994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977120+0000","last_change":"2023-10-07T09:07:49.977120+0000","last_active":"2023-10-07T09:07:49.977120+0000","last_peered":"2023-10-07T09:07:49.977120+0000","last_clean":"2023-10-07T09:07:49.977120+0000","last_became_active":"2023-10-07T09:07:49.976833+0000","last_became_peered":"2023-10-07T09:07:49.976833+0000","last_unstale":"2023-10-07T09:07:49.977120+0000","last_undegraded":"2023-10-07T09:07:49.977120+0000","last_fullsized":"2023-10-07T09:07:49.977120+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:58.344925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972503+0000","last_change":"2023-10-07T09:07:49.972503+0000","last_active":"2023-10-07T09:07:49.972503+0000","last_peered":"2023-10-07T09:07:49.972503+0000","last_clean":"2023-10-07T09:07:49.972503+0000","last_became_active":"2023-10-07T09:07:49.971757+0000","last_became_peered":"2023-10-07T09:07:49.971757+0000","last_unstale":"2023-10-07T09:07:49.972503+0000","last_undegraded":"2023-10-07T09:07:49.972503+0000","last_fullsized":"2023-10-07T09:07:49.972503+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:32.140902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.959633+0000","last_change":"2023-10-07T09:07:49.959633+0000","last_active":"2023-10-07T09:07:49.959633+0000","last_peered":"2023-10-07T09:07:49.959633+0000","last_clean":"2023-10-07T09:07:49.959633+0000","last_became_active":"2023-10-07T09:07:49.959361+0000","last_became_peered":"2023-10-07T09:07:49.959361+0000","last_unstale":"2023-10-07T09:07:49.959633+0000","last_undegraded":"2023-10-07T09:07:49.959633+0000","last_fullsized":"2023-10-07T09:07:49.959633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:25.773934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975928+0000","last_change":"2023-10-07T09:07:49.975928+0000","last_active":"2023-10-07T09:07:49.975928+0000","last_peered":"2023-10-07T09:07:49.975928+0000","last_clean":"2023-10-07T09:07:49.975928+0000","last_became_active":"2023-10-07T09:07:49.975661+0000","last_became_peered":"2023-10-07T09:07:49.975661+0000","last_unstale":"2023-10-07T09:07:49.975928+0000","last_undegraded":"2023-10-07T09:07:49.975928+0000","last_fullsized":"2023-10-07T09:07:49.975928+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:13.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.977615+0000","last_change":"2023-10-07T09:07:49.977615+0000","last_active":"2023-10-07T09:07:49.977615+0000","last_peered":"2023-10-07T09:07:49.977615+0000","last_clean":"2023-10-07T09:07:49.977615+0000","last_became_active":"2023-10-07T09:07:49.977372+0000","last_became_peered":"2023-10-07T09:07:49.977372+0000","last_unstale":"2023-10-07T09:07:49.977615+0000","last_undegraded":"2023-10-07T09:07:49.977615+0000","last_fullsized":"2023-10-07T09:07:49.977615+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:27.925382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.966685+0000","last_change":"2023-10-07T09:07:49.966685+0000","last_active":"2023-10-07T09:07:49.966685+0000","last_peered":"2023-10-07T09:07:49.966685+0000","last_clean":"2023-10-07T09:07:49.966685+0000","last_became_active":"2023-10-07T09:07:49.966412+0000","last_became_peered":"2023-10-07T09:07:49.966412+0000","last_unstale":"2023-10-07T09:07:49.966685+0000","last_undegraded":"2023-10-07T09:07:49.966685+0000","last_fullsized":"2023-10-07T09:07:49.966685+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:18:12.848103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974530+0000","last_change":"2023-10-07T09:07:49.974530+0000","last_active":"2023-10-07T09:07:49.974530+0000","last_peered":"2023-10-07T09:07:49.974530+0000","last_clean":"2023-10-07T09:07:49.974530+0000","last_became_active":"2023-10-07T09:07:49.974261+0000","last_became_peered":"2023-10-07T09:07:49.974261+0000","last_unstale":"2023-10-07T09:07:49.974530+0000","last_undegraded":"2023-10-07T09:07:49.974530+0000","last_fullsized":"2023-10-07T09:07:49.974530+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:36.631895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969957+0000","last_change":"2023-10-07T09:07:49.969957+0000","last_active":"2023-10-07T09:07:49.969957+0000","last_peered":"2023-10-07T09:07:49.969957+0000","last_clean":"2023-10-07T09:07:49.969957+0000","last_became_active":"2023-10-07T09:07:49.969442+0000","last_became_peered":"2023-10-07T09:07:49.969442+0000","last_unstale":"2023-10-07T09:07:49.969957+0000","last_undegraded":"2023-10-07T09:07:49.969957+0000","last_fullsized":"2023-10-07T09:07:49.969957+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:26.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978863+0000","last_change":"2023-10-07T09:07:49.978863+0000","last_active":"2023-10-07T09:07:49.978863+0000","last_peered":"2023-10-07T09:07:49.978863+0000","last_clean":"2023-10-07T09:07:49.978863+0000","last_became_active":"2023-10-07T09:07:49.978585+0000","last_became_peered":"2023-10-07T09:07:49.978585+0000","last_unstale":"2023-10-07T09:07:49.978863+0000","last_undegraded":"2023-10-07T09:07:49.978863+0000","last_fullsized":"2023-10-07T09:07:49.978863+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:30.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970958+0000","last_change":"2023-10-07T09:07:49.970958+0000","last_active":"2023-10-07T09:07:49.970958+0000","last_peered":"2023-10-07T09:07:49.970958+0000","last_clean":"2023-10-07T09:07:49.970958+0000","last_became_active":"2023-10-07T09:07:49.970623+0000","last_became_peered":"2023-10-07T09:07:49.970623+0000","last_unstale":"2023-10-07T09:07:49.970958+0000","last_undegraded":"2023-10-07T09:07:49.970958+0000","last_fullsized":"2023-10-07T09:07:49.970958+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:45.372092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970352+0000","last_change":"2023-10-07T09:07:49.970352+0000","last_active":"2023-10-07T09:07:49.970352+0000","last_peered":"2023-10-07T09:07:49.970352+0000","last_clean":"2023-10-07T09:07:49.970352+0000","last_became_active":"2023-10-07T09:07:49.970049+0000","last_became_peered":"2023-10-07T09:07:49.970049+0000","last_unstale":"2023-10-07T09:07:49.970352+0000","last_undegraded":"2023-10-07T09:07:49.970352+0000","last_fullsized":"2023-10-07T09:07:49.970352+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:48:50.279155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975555+0000","last_change":"2023-10-07T09:07:49.975555+0000","last_active":"2023-10-07T09:07:49.975555+0000","last_peered":"2023-10-07T09:07:49.975555+0000","last_clean":"2023-10-07T09:07:49.975555+0000","last_became_active":"2023-10-07T09:07:49.975000+0000","last_became_peered":"2023-10-07T09:07:49.975000+0000","last_unstale":"2023-10-07T09:07:49.975555+0000","last_undegraded":"2023-10-07T09:07:49.975555+0000","last_fullsized":"2023-10-07T09:07:49.975555+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:35:39.281205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975389+0000","last_change":"2023-10-07T09:07:49.975389+0000","last_active":"2023-10-07T09:07:49.975389+0000","last_peered":"2023-10-07T09:07:49.975389+0000","last_clean":"2023-10-07T09:07:49.975389+0000","last_became_active":"2023-10-07T09:07:49.974973+0000","last_became_peered":"2023-10-07T09:07:49.974973+0000","last_unstale":"2023-10-07T09:07:49.975389+0000","last_undegraded":"2023-10-07T09:07:49.975389+0000","last_fullsized":"2023-10-07T09:07:49.975389+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:37:54.857046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970218+0000","last_change":"2023-10-07T09:07:49.970218+0000","last_active":"2023-10-07T09:07:49.970218+0000","last_peered":"2023-10-07T09:07:49.970218+0000","last_clean":"2023-10-07T09:07:49.970218+0000","last_became_active":"2023-10-07T09:07:49.969839+0000","last_became_peered":"2023-10-07T09:07:49.969839+0000","last_unstale":"2023-10-07T09:07:49.970218+0000","last_undegraded":"2023-10-07T09:07:49.970218+0000","last_fullsized":"2023-10-07T09:07:49.970218+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:27.758658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972416+0000","last_change":"2023-10-07T09:07:49.972416+0000","last_active":"2023-10-07T09:07:49.972416+0000","last_peered":"2023-10-07T09:07:49.972416+0000","last_clean":"2023-10-07T09:07:49.972416+0000","last_became_active":"2023-10-07T09:07:49.972118+0000","last_became_peered":"2023-10-07T09:07:49.972118+0000","last_unstale":"2023-10-07T09:07:49.972416+0000","last_undegraded":"2023-10-07T09:07:49.972416+0000","last_fullsized":"2023-10-07T09:07:49.972416+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:10.654407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974859+0000","last_change":"2023-10-07T09:07:49.974859+0000","last_active":"2023-10-07T09:07:49.974859+0000","last_peered":"2023-10-07T09:07:49.974859+0000","last_clean":"2023-10-07T09:07:49.974859+0000","last_became_active":"2023-10-07T09:07:49.973112+0000","last_became_peered":"2023-10-07T09:07:49.973112+0000","last_unstale":"2023-10-07T09:07:49.974859+0000","last_undegraded":"2023-10-07T09:07:49.974859+0000","last_fullsized":"2023-10-07T09:07:49.974859+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:59.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978401+0000","last_change":"2023-10-07T09:07:49.978401+0000","last_active":"2023-10-07T09:07:49.978401+0000","last_peered":"2023-10-07T09:07:49.978401+0000","last_clean":"2023-10-07T09:07:49.978401+0000","last_became_active":"2023-10-07T09:07:49.978101+0000","last_became_peered":"2023-10-07T09:07:49.978101+0000","last_unstale":"2023-10-07T09:07:49.978401+0000","last_undegraded":"2023-10-07T09:07:49.978401+0000","last_fullsized":"2023-10-07T09:07:49.978401+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:27.758658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"198'4","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995492+0000","last_change":"2023-10-07T09:07:48.989874+0000","last_active":"2023-10-07T09:07:49.995492+0000","last_peered":"2023-10-07T09:07:49.995492+0000","last_clean":"2023-10-07T09:07:49.995492+0000","last_became_active":"2023-10-07T09:07:48.989575+0000","last_became_peered":"2023-10-07T09:07:48.989575+0000","last_unstale":"2023-10-07T09:07:49.995492+0000","last_undegraded":"2023-10-07T09:07:49.995492+0000","last_fullsized":"2023-10-07T09:07:49.995492+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:10:14.711099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970320+0000","last_change":"2023-10-07T09:07:49.970320+0000","last_active":"2023-10-07T09:07:49.970320+0000","last_peered":"2023-10-07T09:07:49.970320+0000","last_clean":"2023-10-07T09:07:49.970320+0000","last_became_active":"2023-10-07T09:07:49.970065+0000","last_became_peered":"2023-10-07T09:07:49.970065+0000","last_unstale":"2023-10-07T09:07:49.970320+0000","last_undegraded":"2023-10-07T09:07:49.970320+0000","last_fullsized":"2023-10-07T09:07:49.970320+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:57:10.835793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969034+0000","last_change":"2023-10-07T09:07:48.992559+0000","last_active":"2023-10-07T09:07:49.969034+0000","last_peered":"2023-10-07T09:07:49.969034+0000","last_clean":"2023-10-07T09:07:49.969034+0000","last_became_active":"2023-10-07T09:07:48.992308+0000","last_became_peered":"2023-10-07T09:07:48.992308+0000","last_unstale":"2023-10-07T09:07:49.969034+0000","last_undegraded":"2023-10-07T09:07:49.969034+0000","last_fullsized":"2023-10-07T09:07:49.969034+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:22:15.166687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.964286+0000","last_change":"2023-10-07T09:07:49.964286+0000","last_active":"2023-10-07T09:07:49.964286+0000","last_peered":"2023-10-07T09:07:49.964286+0000","last_clean":"2023-10-07T09:07:49.964286+0000","last_became_active":"2023-10-07T09:07:49.963998+0000","last_became_peered":"2023-10-07T09:07:49.963998+0000","last_unstale":"2023-10-07T09:07:49.964286+0000","last_undegraded":"2023-10-07T09:07:49.964286+0000","last_fullsized":"2023-10-07T09:07:49.964286+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:55:03.915486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.996496+0000","last_change":"2023-10-07T09:07:49.000276+0000","last_active":"2023-10-07T09:07:49.996496+0000","last_peered":"2023-10-07T09:07:49.996496+0000","last_clean":"2023-10-07T09:07:49.996496+0000","last_became_active":"2023-10-07T09:07:48.999951+0000","last_became_peered":"2023-10-07T09:07:48.999951+0000","last_unstale":"2023-10-07T09:07:49.996496+0000","last_undegraded":"2023-10-07T09:07:49.996496+0000","last_fullsized":"2023-10-07T09:07:49.996496+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:44.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974650+0000","last_change":"2023-10-07T09:07:49.974650+0000","last_active":"2023-10-07T09:07:49.974650+0000","last_peered":"2023-10-07T09:07:49.974650+0000","last_clean":"2023-10-07T09:07:49.974650+0000","last_became_active":"2023-10-07T09:07:49.973080+0000","last_became_peered":"2023-10-07T09:07:49.973080+0000","last_unstale":"2023-10-07T09:07:49.974650+0000","last_undegraded":"2023-10-07T09:07:49.974650+0000","last_fullsized":"2023-10-07T09:07:49.974650+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:00:27.596472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995793+0000","last_change":"2023-10-07T09:07:48.991043+0000","last_active":"2023-10-07T09:07:49.995793+0000","last_peered":"2023-10-07T09:07:49.995793+0000","last_clean":"2023-10-07T09:07:49.995793+0000","last_became_active":"2023-10-07T09:07:48.990746+0000","last_became_peered":"2023-10-07T09:07:48.990746+0000","last_unstale":"2023-10-07T09:07:49.995793+0000","last_undegraded":"2023-10-07T09:07:49.995793+0000","last_fullsized":"2023-10-07T09:07:49.995793+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:52.616093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.974831+0000","last_change":"2023-10-07T09:07:49.974831+0000","last_active":"2023-10-07T09:07:49.974831+0000","last_peered":"2023-10-07T09:07:49.974831+0000","last_clean":"2023-10-07T09:07:49.974831+0000","last_became_active":"2023-10-07T09:07:49.972762+0000","last_became_peered":"2023-10-07T09:07:49.972762+0000","last_unstale":"2023-10-07T09:07:49.974831+0000","last_undegraded":"2023-10-07T09:07:49.974831+0000","last_fullsized":"2023-10-07T09:07:49.974831+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:20.237534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.955977+0000","last_change":"2023-10-07T09:07:48.997782+0000","last_active":"2023-10-07T09:07:49.955977+0000","last_peered":"2023-10-07T09:07:49.955977+0000","last_clean":"2023-10-07T09:07:49.955977+0000","last_became_active":"2023-10-07T09:07:48.997498+0000","last_became_peered":"2023-10-07T09:07:48.997498+0000","last_unstale":"2023-10-07T09:07:49.955977+0000","last_undegraded":"2023-10-07T09:07:49.955977+0000","last_fullsized":"2023-10-07T09:07:49.955977+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:57.338417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973047+0000","last_change":"2023-10-07T09:07:49.973047+0000","last_active":"2023-10-07T09:07:49.973047+0000","last_peered":"2023-10-07T09:07:49.973047+0000","last_clean":"2023-10-07T09:07:49.973047+0000","last_became_active":"2023-10-07T09:07:49.972729+0000","last_became_peered":"2023-10-07T09:07:49.972729+0000","last_unstale":"2023-10-07T09:07:49.973047+0000","last_undegraded":"2023-10-07T09:07:49.973047+0000","last_fullsized":"2023-10-07T09:07:49.973047+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:22:35.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.964759+0000","last_change":"2023-10-07T09:07:48.998486+0000","last_active":"2023-10-07T09:07:49.964759+0000","last_peered":"2023-10-07T09:07:49.964759+0000","last_clean":"2023-10-07T09:07:49.964759+0000","last_became_active":"2023-10-07T09:07:48.998213+0000","last_became_peered":"2023-10-07T09:07:48.998213+0000","last_unstale":"2023-10-07T09:07:49.964759+0000","last_undegraded":"2023-10-07T09:07:49.964759+0000","last_fullsized":"2023-10-07T09:07:49.964759+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:27:12.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976063+0000","last_change":"2023-10-07T09:07:49.976063+0000","last_active":"2023-10-07T09:07:49.976063+0000","last_peered":"2023-10-07T09:07:49.976063+0000","last_clean":"2023-10-07T09:07:49.976063+0000","last_became_active":"2023-10-07T09:07:49.975765+0000","last_became_peered":"2023-10-07T09:07:49.975765+0000","last_unstale":"2023-10-07T09:07:49.976063+0000","last_undegraded":"2023-10-07T09:07:49.976063+0000","last_fullsized":"2023-10-07T09:07:49.976063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:26.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995758+0000","last_change":"2023-10-07T09:07:48.993577+0000","last_active":"2023-10-07T09:07:48.995758+0000","last_peered":"2023-10-07T09:07:48.995758+0000","last_clean":"2023-10-07T09:07:48.995758+0000","last_became_active":"2023-10-07T09:07:48.993306+0000","last_became_peered":"2023-10-07T09:07:48.993306+0000","last_unstale":"2023-10-07T09:07:48.995758+0000","last_undegraded":"2023-10-07T09:07:48.995758+0000","last_fullsized":"2023-10-07T09:07:48.995758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:51.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972368+0000","last_change":"2023-10-07T09:07:49.972368+0000","last_active":"2023-10-07T09:07:49.972368+0000","last_peered":"2023-10-07T09:07:49.972368+0000","last_clean":"2023-10-07T09:07:49.972368+0000","last_became_active":"2023-10-07T09:07:49.971563+0000","last_became_peered":"2023-10-07T09:07:49.971563+0000","last_unstale":"2023-10-07T09:07:49.972368+0000","last_undegraded":"2023-10-07T09:07:49.972368+0000","last_fullsized":"2023-10-07T09:07:49.972368+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:12:32.939745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.994615+0000","last_change":"2023-10-07T09:07:48.992788+0000","last_active":"2023-10-07T09:07:48.994615+0000","last_peered":"2023-10-07T09:07:48.994615+0000","last_clean":"2023-10-07T09:07:48.994615+0000","last_became_active":"2023-10-07T09:07:48.992491+0000","last_became_peered":"2023-10-07T09:07:48.992491+0000","last_unstale":"2023-10-07T09:07:48.994615+0000","last_undegraded":"2023-10-07T09:07:48.994615+0000","last_fullsized":"2023-10-07T09:07:48.994615+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:25.490486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973634+0000","last_change":"2023-10-07T09:07:49.973634+0000","last_active":"2023-10-07T09:07:49.973634+0000","last_peered":"2023-10-07T09:07:49.973634+0000","last_clean":"2023-10-07T09:07:49.973634+0000","last_became_active":"2023-10-07T09:07:49.973394+0000","last_became_peered":"2023-10-07T09:07:49.973394+0000","last_unstale":"2023-10-07T09:07:49.973634+0000","last_undegraded":"2023-10-07T09:07:49.973634+0000","last_fullsized":"2023-10-07T09:07:49.973634+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:22.635655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.997135+0000","last_change":"2023-10-07T09:07:48.994252+0000","last_active":"2023-10-07T09:07:48.997135+0000","last_peered":"2023-10-07T09:07:48.997135+0000","last_clean":"2023-10-07T09:07:48.997135+0000","last_became_active":"2023-10-07T09:07:48.993728+0000","last_became_peered":"2023-10-07T09:07:48.993728+0000","last_unstale":"2023-10-07T09:07:48.997135+0000","last_undegraded":"2023-10-07T09:07:48.997135+0000","last_fullsized":"2023-10-07T09:07:48.997135+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:30.631080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971741+0000","last_change":"2023-10-07T09:07:49.971741+0000","last_active":"2023-10-07T09:07:49.971741+0000","last_peered":"2023-10-07T09:07:49.971741+0000","last_clean":"2023-10-07T09:07:49.971741+0000","last_became_active":"2023-10-07T09:07:49.971454+0000","last_became_peered":"2023-10-07T09:07:49.971454+0000","last_unstale":"2023-10-07T09:07:49.971741+0000","last_undegraded":"2023-10-07T09:07:49.971741+0000","last_fullsized":"2023-10-07T09:07:49.971741+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:38.349404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995735+0000","last_change":"2023-10-07T09:07:48.992291+0000","last_active":"2023-10-07T09:07:48.995735+0000","last_peered":"2023-10-07T09:07:48.995735+0000","last_clean":"2023-10-07T09:07:48.995735+0000","last_became_active":"2023-10-07T09:07:48.992024+0000","last_became_peered":"2023-10-07T09:07:48.992024+0000","last_unstale":"2023-10-07T09:07:48.995735+0000","last_undegraded":"2023-10-07T09:07:48.995735+0000","last_fullsized":"2023-10-07T09:07:48.995735+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:32.533498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.970380+0000","last_change":"2023-10-07T09:07:49.970380+0000","last_active":"2023-10-07T09:07:49.970380+0000","last_peered":"2023-10-07T09:07:49.970380+0000","last_clean":"2023-10-07T09:07:49.970380+0000","last_became_active":"2023-10-07T09:07:49.970008+0000","last_became_peered":"2023-10-07T09:07:49.970008+0000","last_unstale":"2023-10-07T09:07:49.970380+0000","last_undegraded":"2023-10-07T09:07:49.970380+0000","last_fullsized":"2023-10-07T09:07:49.970380+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:13.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"198'3","reported_seq":12,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.996232+0000","last_change":"2023-10-07T09:07:48.993988+0000","last_active":"2023-10-07T09:07:49.996232+0000","last_peered":"2023-10-07T09:07:49.996232+0000","last_clean":"2023-10-07T09:07:49.996232+0000","last_became_active":"2023-10-07T09:07:48.993620+0000","last_became_peered":"2023-10-07T09:07:48.993620+0000","last_unstale":"2023-10-07T09:07:49.996232+0000","last_undegraded":"2023-10-07T09:07:49.996232+0000","last_fullsized":"2023-10-07T09:07:49.996232+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:58.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969878+0000","last_change":"2023-10-07T09:07:49.969878+0000","last_active":"2023-10-07T09:07:49.969878+0000","last_peered":"2023-10-07T09:07:49.969878+0000","last_clean":"2023-10-07T09:07:49.969878+0000","last_became_active":"2023-10-07T09:07:49.969595+0000","last_became_peered":"2023-10-07T09:07:49.969595+0000","last_unstale":"2023-10-07T09:07:49.969878+0000","last_undegraded":"2023-10-07T09:07:49.969878+0000","last_fullsized":"2023-10-07T09:07:49.969878+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:43:19.556800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"198'6","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.000976+0000","last_change":"2023-10-07T09:07:48.990632+0000","last_active":"2023-10-07T09:07:50.000976+0000","last_peered":"2023-10-07T09:07:50.000976+0000","last_clean":"2023-10-07T09:07:50.000976+0000","last_became_active":"2023-10-07T09:07:48.988475+0000","last_became_peered":"2023-10-07T09:07:48.988475+0000","last_unstale":"2023-10-07T09:07:50.000976+0000","last_undegraded":"2023-10-07T09:07:50.000976+0000","last_fullsized":"2023-10-07T09:07:50.000976+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:27.289033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971990+0000","last_change":"2023-10-07T09:07:49.971990+0000","last_active":"2023-10-07T09:07:49.971990+0000","last_peered":"2023-10-07T09:07:49.971990+0000","last_clean":"2023-10-07T09:07:49.971990+0000","last_became_active":"2023-10-07T09:07:49.971121+0000","last_became_peered":"2023-10-07T09:07:49.971121+0000","last_unstale":"2023-10-07T09:07:49.971990+0000","last_undegraded":"2023-10-07T09:07:49.971990+0000","last_fullsized":"2023-10-07T09:07:49.971990+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:49:19.291148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995536+0000","last_change":"2023-10-07T09:07:48.997720+0000","last_active":"2023-10-07T09:07:49.995536+0000","last_peered":"2023-10-07T09:07:49.995536+0000","last_clean":"2023-10-07T09:07:49.995536+0000","last_became_active":"2023-10-07T09:07:48.997393+0000","last_became_peered":"2023-10-07T09:07:48.997393+0000","last_unstale":"2023-10-07T09:07:49.995536+0000","last_undegraded":"2023-10-07T09:07:49.995536+0000","last_fullsized":"2023-10-07T09:07:49.995536+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:26.918875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975986+0000","last_change":"2023-10-07T09:07:49.975986+0000","last_active":"2023-10-07T09:07:49.975986+0000","last_peered":"2023-10-07T09:07:49.975986+0000","last_clean":"2023-10-07T09:07:49.975986+0000","last_became_active":"2023-10-07T09:07:49.975504+0000","last_became_peered":"2023-10-07T09:07:49.975504+0000","last_unstale":"2023-10-07T09:07:49.975986+0000","last_undegraded":"2023-10-07T09:07:49.975986+0000","last_fullsized":"2023-10-07T09:07:49.975986+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:16:34.820550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.996783+0000","last_change":"2023-10-07T09:07:48.993722+0000","last_active":"2023-10-07T09:07:48.996783+0000","last_peered":"2023-10-07T09:07:48.996783+0000","last_clean":"2023-10-07T09:07:48.996783+0000","last_became_active":"2023-10-07T09:07:48.993265+0000","last_became_peered":"2023-10-07T09:07:48.993265+0000","last_unstale":"2023-10-07T09:07:48.996783+0000","last_undegraded":"2023-10-07T09:07:48.996783+0000","last_fullsized":"2023-10-07T09:07:48.996783+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:19.231026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969642+0000","last_change":"2023-10-07T09:07:49.969642+0000","last_active":"2023-10-07T09:07:49.969642+0000","last_peered":"2023-10-07T09:07:49.969642+0000","last_clean":"2023-10-07T09:07:49.969642+0000","last_became_active":"2023-10-07T09:07:49.969339+0000","last_became_peered":"2023-10-07T09:07:49.969339+0000","last_unstale":"2023-10-07T09:07:49.969642+0000","last_undegraded":"2023-10-07T09:07:49.969642+0000","last_fullsized":"2023-10-07T09:07:49.969642+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:44.054556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995349+0000","last_change":"2023-10-07T09:07:48.992091+0000","last_active":"2023-10-07T09:07:48.995349+0000","last_peered":"2023-10-07T09:07:48.995349+0000","last_clean":"2023-10-07T09:07:48.995349+0000","last_became_active":"2023-10-07T09:07:48.991793+0000","last_became_peered":"2023-10-07T09:07:48.991793+0000","last_unstale":"2023-10-07T09:07:48.995349+0000","last_undegraded":"2023-10-07T09:07:48.995349+0000","last_fullsized":"2023-10-07T09:07:48.995349+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:00.310486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971098+0000","last_change":"2023-10-07T09:07:49.971098+0000","last_active":"2023-10-07T09:07:49.971098+0000","last_peered":"2023-10-07T09:07:49.971098+0000","last_clean":"2023-10-07T09:07:49.971098+0000","last_became_active":"2023-10-07T09:07:49.970800+0000","last_became_peered":"2023-10-07T09:07:49.970800+0000","last_unstale":"2023-10-07T09:07:49.971098+0000","last_undegraded":"2023-10-07T09:07:49.971098+0000","last_fullsized":"2023-10-07T09:07:49.971098+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:50:37.113567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"198'8","reported_seq":17,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.002027+0000","last_change":"2023-10-07T09:07:48.995516+0000","last_active":"2023-10-07T09:07:50.002027+0000","last_peered":"2023-10-07T09:07:50.002027+0000","last_clean":"2023-10-07T09:07:50.002027+0000","last_became_active":"2023-10-07T09:07:48.995326+0000","last_became_peered":"2023-10-07T09:07:48.995326+0000","last_unstale":"2023-10-07T09:07:50.002027+0000","last_undegraded":"2023-10-07T09:07:50.002027+0000","last_fullsized":"2023-10-07T09:07:50.002027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:21.674007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976780+0000","last_change":"2023-10-07T09:07:49.976780+0000","last_active":"2023-10-07T09:07:49.976780+0000","last_peered":"2023-10-07T09:07:49.976780+0000","last_clean":"2023-10-07T09:07:49.976780+0000","last_became_active":"2023-10-07T09:07:49.976478+0000","last_became_peered":"2023-10-07T09:07:49.976478+0000","last_unstale":"2023-10-07T09:07:49.976780+0000","last_undegraded":"2023-10-07T09:07:49.976780+0000","last_fullsized":"2023-10-07T09:07:49.976780+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:24:44.075029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.965530+0000","last_change":"2023-10-07T09:07:48.989774+0000","last_active":"2023-10-07T09:07:49.965530+0000","last_peered":"2023-10-07T09:07:49.965530+0000","last_clean":"2023-10-07T09:07:49.965530+0000","last_became_active":"2023-10-07T09:07:48.989468+0000","last_became_peered":"2023-10-07T09:07:48.989468+0000","last_unstale":"2023-10-07T09:07:49.965530+0000","last_undegraded":"2023-10-07T09:07:49.965530+0000","last_fullsized":"2023-10-07T09:07:49.965530+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:32.533498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973830+0000","last_change":"2023-10-07T09:07:49.973830+0000","last_active":"2023-10-07T09:07:49.973830+0000","last_peered":"2023-10-07T09:07:49.973830+0000","last_clean":"2023-10-07T09:07:49.973830+0000","last_became_active":"2023-10-07T09:07:49.973608+0000","last_became_peered":"2023-10-07T09:07:49.973608+0000","last_unstale":"2023-10-07T09:07:49.973830+0000","last_undegraded":"2023-10-07T09:07:49.973830+0000","last_fullsized":"2023-10-07T09:07:49.973830+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:12:01.750583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995156+0000","last_change":"2023-10-07T09:07:48.990074+0000","last_active":"2023-10-07T09:07:49.995156+0000","last_peered":"2023-10-07T09:07:49.995156+0000","last_clean":"2023-10-07T09:07:49.995156+0000","last_became_active":"2023-10-07T09:07:48.989531+0000","last_became_peered":"2023-10-07T09:07:48.989531+0000","last_unstale":"2023-10-07T09:07:49.995156+0000","last_undegraded":"2023-10-07T09:07:49.995156+0000","last_fullsized":"2023-10-07T09:07:49.995156+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:25.709798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.969332+0000","last_change":"2023-10-07T09:07:49.969332+0000","last_active":"2023-10-07T09:07:49.969332+0000","last_peered":"2023-10-07T09:07:49.969332+0000","last_clean":"2023-10-07T09:07:49.969332+0000","last_became_active":"2023-10-07T09:07:49.969110+0000","last_became_peered":"2023-10-07T09:07:49.969110+0000","last_unstale":"2023-10-07T09:07:49.969332+0000","last_undegraded":"2023-10-07T09:07:49.969332+0000","last_fullsized":"2023-10-07T09:07:49.969332+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:43.062317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"198'1","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.960691+0000","last_change":"2023-10-07T09:07:49.000224+0000","last_active":"2023-10-07T09:07:49.960691+0000","last_peered":"2023-10-07T09:07:49.960691+0000","last_clean":"2023-10-07T09:07:49.960691+0000","last_became_active":"2023-10-07T09:07:48.999950+0000","last_became_peered":"2023-10-07T09:07:48.999950+0000","last_unstale":"2023-10-07T09:07:49.960691+0000","last_undegraded":"2023-10-07T09:07:49.960691+0000","last_fullsized":"2023-10-07T09:07:49.960691+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:37:20.234099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975389+0000","last_change":"2023-10-07T09:07:49.975389+0000","last_active":"2023-10-07T09:07:49.975389+0000","last_peered":"2023-10-07T09:07:49.975389+0000","last_clean":"2023-10-07T09:07:49.975389+0000","last_became_active":"2023-10-07T09:07:49.974419+0000","last_became_peered":"2023-10-07T09:07:49.974419+0000","last_unstale":"2023-10-07T09:07:49.975389+0000","last_undegraded":"2023-10-07T09:07:49.975389+0000","last_fullsized":"2023-10-07T09:07:49.975389+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:07:14.733813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993634+0000","last_change":"2023-10-07T09:07:48.989931+0000","last_active":"2023-10-07T09:07:48.993634+0000","last_peered":"2023-10-07T09:07:48.993634+0000","last_clean":"2023-10-07T09:07:48.993634+0000","last_became_active":"2023-10-07T09:07:48.989704+0000","last_became_peered":"2023-10-07T09:07:48.989704+0000","last_unstale":"2023-10-07T09:07:48.993634+0000","last_undegraded":"2023-10-07T09:07:48.993634+0000","last_fullsized":"2023-10-07T09:07:48.993634+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:24:50.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975058+0000","last_change":"2023-10-07T09:07:49.975058+0000","last_active":"2023-10-07T09:07:49.975058+0000","last_peered":"2023-10-07T09:07:49.975058+0000","last_clean":"2023-10-07T09:07:49.975058+0000","last_became_active":"2023-10-07T09:07:49.974598+0000","last_became_peered":"2023-10-07T09:07:49.974598+0000","last_unstale":"2023-10-07T09:07:49.975058+0000","last_undegraded":"2023-10-07T09:07:49.975058+0000","last_fullsized":"2023-10-07T09:07:49.975058+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:44:02.148149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:50.001505+0000","last_change":"2023-10-07T09:07:48.996186+0000","last_active":"2023-10-07T09:07:50.001505+0000","last_peered":"2023-10-07T09:07:50.001505+0000","last_clean":"2023-10-07T09:07:50.001505+0000","last_became_active":"2023-10-07T09:07:48.995683+0000","last_became_peered":"2023-10-07T09:07:48.995683+0000","last_unstale":"2023-10-07T09:07:50.001505+0000","last_undegraded":"2023-10-07T09:07:50.001505+0000","last_fullsized":"2023-10-07T09:07:50.001505+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:12.891588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.976540+0000","last_change":"2023-10-07T09:07:49.976540+0000","last_active":"2023-10-07T09:07:49.976540+0000","last_peered":"2023-10-07T09:07:49.976540+0000","last_clean":"2023-10-07T09:07:49.976540+0000","last_became_active":"2023-10-07T09:07:49.976247+0000","last_became_peered":"2023-10-07T09:07:49.976247+0000","last_unstale":"2023-10-07T09:07:49.976540+0000","last_undegraded":"2023-10-07T09:07:49.976540+0000","last_fullsized":"2023-10-07T09:07:49.976540+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:02.997800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.001632+0000","last_change":"2023-10-07T09:07:49.001250+0000","last_active":"2023-10-07T09:07:49.001632+0000","last_peered":"2023-10-07T09:07:49.001632+0000","last_clean":"2023-10-07T09:07:49.001632+0000","last_became_active":"2023-10-07T09:07:49.000922+0000","last_became_peered":"2023-10-07T09:07:49.000922+0000","last_unstale":"2023-10-07T09:07:49.001632+0000","last_undegraded":"2023-10-07T09:07:49.001632+0000","last_fullsized":"2023-10-07T09:07:49.001632+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:12.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.971568+0000","last_change":"2023-10-07T09:07:49.971568+0000","last_active":"2023-10-07T09:07:49.971568+0000","last_peered":"2023-10-07T09:07:49.971568+0000","last_clean":"2023-10-07T09:07:49.971568+0000","last_became_active":"2023-10-07T09:07:49.971291+0000","last_became_peered":"2023-10-07T09:07:49.971291+0000","last_unstale":"2023-10-07T09:07:49.971568+0000","last_undegraded":"2023-10-07T09:07:49.971568+0000","last_fullsized":"2023-10-07T09:07:49.971568+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:57.266749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.001124+0000","last_change":"2023-10-07T09:07:49.000619+0000","last_active":"2023-10-07T09:07:49.001124+0000","last_peered":"2023-10-07T09:07:49.001124+0000","last_clean":"2023-10-07T09:07:49.001124+0000","last_became_active":"2023-10-07T09:07:49.000350+0000","last_became_peered":"2023-10-07T09:07:49.000350+0000","last_unstale":"2023-10-07T09:07:49.001124+0000","last_undegraded":"2023-10-07T09:07:49.001124+0000","last_fullsized":"2023-10-07T09:07:49.001124+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:54:20.676551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972229+0000","last_change":"2023-10-07T09:07:49.972229+0000","last_active":"2023-10-07T09:07:49.972229+0000","last_peered":"2023-10-07T09:07:49.972229+0000","last_clean":"2023-10-07T09:07:49.972229+0000","last_became_active":"2023-10-07T09:07:49.969678+0000","last_became_peered":"2023-10-07T09:07:49.969678+0000","last_unstale":"2023-10-07T09:07:49.972229+0000","last_undegraded":"2023-10-07T09:07:49.972229+0000","last_fullsized":"2023-10-07T09:07:49.972229+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:53:43.801775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.997877+0000","last_change":"2023-10-07T09:07:48.995071+0000","last_active":"2023-10-07T09:07:48.997877+0000","last_peered":"2023-10-07T09:07:48.997877+0000","last_clean":"2023-10-07T09:07:48.997877+0000","last_became_active":"2023-10-07T09:07:48.994593+0000","last_became_peered":"2023-10-07T09:07:48.994593+0000","last_unstale":"2023-10-07T09:07:48.997877+0000","last_undegraded":"2023-10-07T09:07:48.997877+0000","last_fullsized":"2023-10-07T09:07:48.997877+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:00:26.589964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.978550+0000","last_change":"2023-10-07T09:07:49.978550+0000","last_active":"2023-10-07T09:07:49.978550+0000","last_peered":"2023-10-07T09:07:49.978550+0000","last_clean":"2023-10-07T09:07:49.978550+0000","last_became_active":"2023-10-07T09:07:49.977565+0000","last_became_peered":"2023-10-07T09:07:49.977565+0000","last_unstale":"2023-10-07T09:07:49.978550+0000","last_undegraded":"2023-10-07T09:07:49.978550+0000","last_fullsized":"2023-10-07T09:07:49.978550+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:58.344925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"198'2","reported_seq":11,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.995312+0000","last_change":"2023-10-07T09:07:48.994060+0000","last_active":"2023-10-07T09:07:49.995312+0000","last_peered":"2023-10-07T09:07:49.995312+0000","last_clean":"2023-10-07T09:07:49.995312+0000","last_became_active":"2023-10-07T09:07:48.993354+0000","last_became_peered":"2023-10-07T09:07:48.993354+0000","last_unstale":"2023-10-07T09:07:49.995312+0000","last_undegraded":"2023-10-07T09:07:49.995312+0000","last_fullsized":"2023-10-07T09:07:49.995312+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:22:34.700665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.973947+0000","last_change":"2023-10-07T09:07:49.973947+0000","last_active":"2023-10-07T09:07:49.973947+0000","last_peered":"2023-10-07T09:07:49.973947+0000","last_clean":"2023-10-07T09:07:49.973947+0000","last_became_active":"2023-10-07T09:07:49.973673+0000","last_became_peered":"2023-10-07T09:07:49.973673+0000","last_unstale":"2023-10-07T09:07:49.973947+0000","last_undegraded":"2023-10-07T09:07:49.973947+0000","last_fullsized":"2023-10-07T09:07:49.973947+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:45:12.347010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993841+0000","last_change":"2023-10-07T09:07:48.989845+0000","last_active":"2023-10-07T09:07:48.993841+0000","last_peered":"2023-10-07T09:07:48.993841+0000","last_clean":"2023-10-07T09:07:48.993841+0000","last_became_active":"2023-10-07T09:07:48.988698+0000","last_became_peered":"2023-10-07T09:07:48.988698+0000","last_unstale":"2023-10-07T09:07:48.993841+0000","last_undegraded":"2023-10-07T09:07:48.993841+0000","last_fullsized":"2023-10-07T09:07:48.993841+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:35:06.758777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.965693+0000","last_change":"2023-10-07T09:07:49.965693+0000","last_active":"2023-10-07T09:07:49.965693+0000","last_peered":"2023-10-07T09:07:49.965693+0000","last_clean":"2023-10-07T09:07:49.965693+0000","last_became_active":"2023-10-07T09:07:49.965422+0000","last_became_peered":"2023-10-07T09:07:49.965422+0000","last_unstale":"2023-10-07T09:07:49.965693+0000","last_undegraded":"2023-10-07T09:07:49.965693+0000","last_fullsized":"2023-10-07T09:07:49.965693+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:20.591948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.993189+0000","last_change":"2023-10-07T09:07:48.991574+0000","last_active":"2023-10-07T09:07:48.993189+0000","last_peered":"2023-10-07T09:07:48.993189+0000","last_clean":"2023-10-07T09:07:48.993189+0000","last_became_active":"2023-10-07T09:07:48.991264+0000","last_became_peered":"2023-10-07T09:07:48.991264+0000","last_unstale":"2023-10-07T09:07:48.993189+0000","last_undegraded":"2023-10-07T09:07:48.993189+0000","last_fullsized":"2023-10-07T09:07:48.993189+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:21.033972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972559+0000","last_change":"2023-10-07T09:07:49.972559+0000","last_active":"2023-10-07T09:07:49.972559+0000","last_peered":"2023-10-07T09:07:49.972559+0000","last_clean":"2023-10-07T09:07:49.972559+0000","last_became_active":"2023-10-07T09:07:49.971404+0000","last_became_peered":"2023-10-07T09:07:49.971404+0000","last_unstale":"2023-10-07T09:07:49.972559+0000","last_undegraded":"2023-10-07T09:07:49.972559+0000","last_fullsized":"2023-10-07T09:07:49.972559+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:32.140902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.000763+0000","last_change":"2023-10-07T09:07:49.000145+0000","last_active":"2023-10-07T09:07:49.000763+0000","last_peered":"2023-10-07T09:07:49.000763+0000","last_clean":"2023-10-07T09:07:49.000763+0000","last_became_active":"2023-10-07T09:07:48.999877+0000","last_became_peered":"2023-10-07T09:07:48.999877+0000","last_unstale":"2023-10-07T09:07:49.000763+0000","last_undegraded":"2023-10-07T09:07:49.000763+0000","last_fullsized":"2023-10-07T09:07:49.000763+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:03:31.537764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.967374+0000","last_change":"2023-10-07T09:07:49.967374+0000","last_active":"2023-10-07T09:07:49.967374+0000","last_peered":"2023-10-07T09:07:49.967374+0000","last_clean":"2023-10-07T09:07:49.967374+0000","last_became_active":"2023-10-07T09:07:49.967051+0000","last_became_peered":"2023-10-07T09:07:49.967051+0000","last_unstale":"2023-10-07T09:07:49.967374+0000","last_undegraded":"2023-10-07T09:07:49.967374+0000","last_fullsized":"2023-10-07T09:07:49.967374+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:25:57.797256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.992953+0000","last_change":"2023-10-07T09:07:48.989297+0000","last_active":"2023-10-07T09:07:48.992953+0000","last_peered":"2023-10-07T09:07:48.992953+0000","last_clean":"2023-10-07T09:07:48.992953+0000","last_became_active":"2023-10-07T09:07:48.988667+0000","last_became_peered":"2023-10-07T09:07:48.988667+0000","last_unstale":"2023-10-07T09:07:48.992953+0000","last_undegraded":"2023-10-07T09:07:48.992953+0000","last_fullsized":"2023-10-07T09:07:48.992953+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:17:44.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.975790+0000","last_change":"2023-10-07T09:07:49.975790+0000","last_active":"2023-10-07T09:07:49.975790+0000","last_peered":"2023-10-07T09:07:49.975790+0000","last_clean":"2023-10-07T09:07:49.975790+0000","last_became_active":"2023-10-07T09:07:49.975472+0000","last_became_peered":"2023-10-07T09:07:49.975472+0000","last_unstale":"2023-10-07T09:07:49.975790+0000","last_undegraded":"2023-10-07T09:07:49.975790+0000","last_fullsized":"2023-10-07T09:07:49.975790+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:29:31.637588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.994347+0000","last_change":"2023-10-07T09:07:48.992917+0000","last_active":"2023-10-07T09:07:48.994347+0000","last_peered":"2023-10-07T09:07:48.994347+0000","last_clean":"2023-10-07T09:07:48.994347+0000","last_became_active":"2023-10-07T09:07:48.992658+0000","last_became_peered":"2023-10-07T09:07:48.992658+0000","last_unstale":"2023-10-07T09:07:48.994347+0000","last_undegraded":"2023-10-07T09:07:48.994347+0000","last_fullsized":"2023-10-07T09:07:48.994347+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:19.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972217+0000","last_change":"2023-10-07T09:07:49.972217+0000","last_active":"2023-10-07T09:07:49.972217+0000","last_peered":"2023-10-07T09:07:49.972217+0000","last_clean":"2023-10-07T09:07:49.972217+0000","last_became_active":"2023-10-07T09:07:49.971958+0000","last_became_peered":"2023-10-07T09:07:49.971958+0000","last_unstale":"2023-10-07T09:07:49.972217+0000","last_undegraded":"2023-10-07T09:07:49.972217+0000","last_fullsized":"2023-10-07T09:07:49.972217+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:22.680515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.995546+0000","last_change":"2023-10-07T09:07:48.994319+0000","last_active":"2023-10-07T09:07:48.995546+0000","last_peered":"2023-10-07T09:07:48.995546+0000","last_clean":"2023-10-07T09:07:48.995546+0000","last_became_active":"2023-10-07T09:07:48.994032+0000","last_became_peered":"2023-10-07T09:07:48.994032+0000","last_unstale":"2023-10-07T09:07:48.995546+0000","last_undegraded":"2023-10-07T09:07:48.995546+0000","last_fullsized":"2023-10-07T09:07:48.995546+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:43.141059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972342+0000","last_change":"2023-10-07T09:07:49.972342+0000","last_active":"2023-10-07T09:07:49.972342+0000","last_peered":"2023-10-07T09:07:49.972342+0000","last_clean":"2023-10-07T09:07:49.972342+0000","last_became_active":"2023-10-07T09:07:49.970934+0000","last_became_peered":"2023-10-07T09:07:49.970934+0000","last_unstale":"2023-10-07T09:07:49.972342+0000","last_undegraded":"2023-10-07T09:07:49.972342+0000","last_fullsized":"2023-10-07T09:07:49.972342+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:23:44.510614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.998678+0000","last_change":"2023-10-07T09:07:48.996179+0000","last_active":"2023-10-07T09:07:48.998678+0000","last_peered":"2023-10-07T09:07:48.998678+0000","last_clean":"2023-10-07T09:07:48.998678+0000","last_became_active":"2023-10-07T09:07:48.995896+0000","last_became_peered":"2023-10-07T09:07:48.995896+0000","last_unstale":"2023-10-07T09:07:48.998678+0000","last_undegraded":"2023-10-07T09:07:48.998678+0000","last_fullsized":"2023-10-07T09:07:48.998678+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:47.964026+0000","last_clean_scrub_stamp":"2023-10-07T09:07:47.964026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:46.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-07T09:07:49.972536+0000","last_change":"2023-10-07T09:07:49.972536+0000","last_active":"2023-10-07T09:07:49.972536+0000","last_peered":"2023-10-07T09:07:49.972536+0000","last_clean":"2023-10-07T09:07:49.972536+0000","last_became_active":"2023-10-07T09:07:49.972094+0000","last_became_peered":"2023-10-07T09:07:49.972094+0000","last_unstale":"2023-10-07T09:07:49.972536+0000","last_undegraded":"2023-10-07T09:07:49.972536+0000","last_fullsized":"2023-10-07T09:07:49.972536+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T09:07:48.970533+0000","last_clean_scrub_stamp":"2023-10-07T09:07:48.970533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:58:01.699641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":322,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T09:07:48.982852+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:07:48.982852+0000","last_peered":"2023-10-07T09:07:48.982852+0000","last_clean":"2023-10-07T09:07:48.982852+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:07:48.982852+0000","last_undegraded":"2023-10-07T09:07:48.982852+0000","last_fullsized":"2023-10-07T09:07:48.982852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304432,"kb_used_data":3048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067408,"statfs":{"total":96636764160,"available":96325025792,"internally_reserved":0,"allocated":3121152,"data_stored":1720484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.746,"15min":0.85799999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60299999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.26700000000000002},"max":{"1min":0.58999999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.753}]},{"osd":2,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.77100000000000002,"15min":0.86299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70899999999999996}]},{"osd":4,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.53600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:06:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.88400000000000001},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1129574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81399999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.84199999999999997},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.752,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71499999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":1.29},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":4.0880000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.85599999999999998,"15min":0.91900000000000004},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.60199999999999998},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":2519040,"data_stored":1129540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34100000000000003,"15min":0.33600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.56299999999999994,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.39200000000000002},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.221},"max":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":1.3859999999999999},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.24399999999999999,"15min":0.224},"max":{"1min":0.56899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38400000000000001,"15min":0.66700000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58599999999999997,"5min":0.90400000000000003,"15min":11.32},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38,"15min":0.68300000000000005},"min":{"1min":0.27900000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":1.077,"15min":11.880000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38400000000000001,"15min":0.38900000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75800000000000001,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60699999999999998,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.365,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.502},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.75900000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.86799999999999999,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.77300000000000002},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":5.3920000000000003},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 7 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.71499999999999997},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.325,"15min":4.5209999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85499999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308524,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063316,"statfs":{"total":96636764160,"available":96320835584,"internally_reserved":0,"allocated":3117056,"data_stored":1719978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.34200000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.54500000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.191},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.371,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.61199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.625},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35499999999999998},"min":{"1min":0.29299999999999998,"5min":0.253,"15min":0.22},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.626,"15min":0.63500000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.61199999999999999},"min":{"1min":0.46800000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.0249999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.875,"15min":1.006},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.95599999999999996},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2539520,"data_stored":1131652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.52900000000000003},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.497,"5min":0.5,"15min":10.214},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":0.64000000000000001,"15min":1.1899999999999999},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.755},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54800000000000004,"5min":0.66100000000000003,"15min":10.144},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39500000000000002,"15min":0.63500000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52000000000000002,"5min":0.68700000000000006,"15min":10.071},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.65200000000000002},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.57199999999999995,"5min":0.70399999999999996,"15min":10.183},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.58599999999999997},"min":{"1min":0.48499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.745,"5min":0.85499999999999998,"15min":1.0549999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":1},"min":{"1min":0.436,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.87,"15min":1.0880000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81299999999999994,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61799999999999999,"15min":1.052},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.753,"5min":4.391,"15min":4.391},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93000000000000005,"15min":0.95799999999999996},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2523136,"data_stored":1129630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.40600000000000003},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.433,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.35099999999999998,"15min":0.63500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49099999999999999,"5min":0.53400000000000003,"15min":12.038},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.42799999999999999,"5min":0.51600000000000001,"15min":2.3450000000000002},"last":0.38},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35899999999999999,"15min":0.439},"min":{"1min":0.245,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.53300000000000003,"5min":0.60499999999999998,"15min":2.3380000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36399999999999999,"15min":0.53400000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":6.1230000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":1.2330000000000001},"last":0.5}]},{"osd":4,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.81799999999999995},"min":{"1min":0.36699999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":2.081},"last":0.54300000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.63800000000000001},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":2.1099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":2.1960000000000002},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59499999999999997,"15min":0.86899999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":1.135,"15min":12.007},"last":0.623},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":2.0459999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.68200000000000005},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":2.1699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60599999999999998,"15min":0.88400000000000001},"min":{"1min":0.48699999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":1.179,"15min":11.973000000000001},"last":0.60499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1131076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.74299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.505,"15min":0.66900000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.79700000000000004},"min":{"1min":0.378,"5min":0.318,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.505},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.82799999999999996},"min":{"1min":0.378,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.80000000000000004},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.82599999999999996},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":10.01},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.66800000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":0.88100000000000001,"15min":5.569},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.80000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78900000000000003,"5min":0.93500000000000005,"15min":10.131},"last":0.436}]},{"osd":5,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49099999999999999,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76800000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.371},{"interface":"front","average":{"1min":0.501,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.70999999999999996,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.79400000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:07:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.33500000000000002},"max":{"1min":0.78000000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2523136,"data_stored":1129610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66000000000000003,"5min":1.127,"15min":1.127},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.31},"max":{"1min":0.68100000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":9.7799999999999994,"15min":9.7799999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.71499999999999997,"5min":6.3970000000000002,"15min":6.3970000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60999999999999999,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.45700000000000002,"5min":0.36899999999999999,"15min":0.35399999999999998},"max":{"1min":0.71599999999999997,"5min":1.478,"15min":1.478},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67100000000000004,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.25700000000000001},"max":{"1min":0.69399999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68300000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:07:54.517 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T09:07:54.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T09:07:54.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.643+0000 7fd309fbe700 1 Processor -- start 2023-10-07T09:07:54.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.643+0000 7fd309fbe700 1 -- start start 2023-10-07T09:07:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd309fbe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 0x7fd3040c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd309fbe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd304068390 0x7fd304068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd309fbe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30415a6f0 con 0x7fd304156620 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd309fbe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3040c8d30 con 0x7fd304068390 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd309fbe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd304068d50 con 0x7fd3041569f0 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd303fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd304068390 0x7fd304068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd3037fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd304156620 0x7fd3040ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47760/0 (socket says 172.21.15.46:47760) 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.644+0000 7fd3037fe700 1 -- 172.21.15.46:0/2101686885 learned_addr learned my addr 172.21.15.46:0/2101686885 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd302ffd700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 0x7fd3040c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd303fff700 1 -- 172.21.15.46:0/2101686885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 msgr2=0x7fd3040c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd303fff700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 0x7fd3040c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd303fff700 1 -- 172.21.15.46:0/2101686885 >> v1:172.21.15.46:6789/0 conn(0x7fd304156620 legacy=0x7fd3040ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd3027fc700 1 -- 172.21.15.46:0/2101686885 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20936808 0 0) 0x7fd30415a6f0 con 0x7fd304156620 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd303fff700 1 -- 172.21.15.46:0/2101686885 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30415a9d0 con 0x7fd304068390 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd302ffd700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 0x7fd3040c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd303fff700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304068390 0x7fd304068810 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e90 tx=0x7fd2fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38425dc0b92999cc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd3027fc700 1 -- 172.21.15.46:0/2101686885 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc00e070 con 0x7fd304068390 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd3027fc700 1 -- 172.21.15.46:0/2101686885 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc00bbf0 con 0x7fd304068390 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.645+0000 7fd3027fc700 1 -- 172.21.15.46:0/2101686885 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc012430 con 0x7fd304068390 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 -- 172.21.15.46:0/2101686885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304068390 msgr2=0x7fd304068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304068390 0x7fd304068810 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e90 tx=0x7fd2fc009780 comp rx=0 tx=0).stop 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 -- 172.21.15.46:0/2101686885 shutdown_connections 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304068390 0x7fd304068810 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 --2- 172.21.15.46:0/2101686885 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3041569f0 0x7fd3040c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 -- 172.21.15.46:0/2101686885 >> 172.21.15.46:0/2101686885 conn(0x7fd3040cc540 msgr2=0x7fd3040cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 -- 172.21.15.46:0/2101686885 shutdown_connections 2023-10-07T09:07:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.646+0000 7fd309fbe700 1 -- 172.21.15.46:0/2101686885 wait complete. 2023-10-07T09:07:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.647+0000 7fd309fbe700 1 Processor -- start 2023-10-07T09:07:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.647+0000 7fd309fbe700 1 -- start start 2023-10-07T09:07:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd304068390 0x7fd3041504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3041569f0 0x7fd30414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c0f90 con 0x7fd304156620 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c1270 con 0x7fd3041569f0 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c1550 con 0x7fd304068390 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33092/0 (socket says 172.21.15.46:33092) 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 -- 172.21.15.46:0/61279912 learned_addr learned my addr 172.21.15.46:0/61279912 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd303fff700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3041569f0 0x7fd30414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd3037fe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd304068390 0x7fd3041504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 -- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd304068390 msgr2=0x7fd3041504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd304068390 0x7fd3041504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 -- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3041569f0 msgr2=0x7fd30414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3041569f0 0x7fd30414fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 -- 172.21.15.46:0/61279912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc009a20 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd302ffd700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e8a0 tx=0x7fd2f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800c430 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f800c590 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800c950 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3040c1830 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.648+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd304150ba0 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.649+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3040718b0 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.650+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd2f800cd00 con 0x7fd304156620 2023-10-07T09:07:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.650+0000 7fd2eb7fe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 0x7fd2f0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.650+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2f8084af0 con 0x7fd304156620 2023-10-07T09:07:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.650+0000 7fd3037fe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 0x7fd2f0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.651+0000 7fd3037fe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 0x7fd2f0069800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007fd0 tx=0x7fd2f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:54.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.654+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2f8051670 con 0x7fd304156620 2023-10-07T09:07:54.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.928+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd3040c7bc0 con 0x7fd304156620 2023-10-07T09:07:54.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.932+0000 7fd2eb7fe700 1 -- 172.21.15.46:0/61279912 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd2f8054c90 con 0x7fd304156620 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 msgr2=0x7fd2f0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 0x7fd2f0069800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007fd0 tx=0x7fd2f4009040 comp rx=0 tx=0).stop 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 msgr2=0x7fd30414f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e8a0 tx=0x7fd2f8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 shutdown_connections 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd2f0067350 0x7fd2f0069800 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3041569f0 0x7fd30414fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd304068390 0x7fd3041504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 --2- 172.21.15.46:0/61279912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd304156620 0x7fd30414f860 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:54.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 >> 172.21.15.46:0/61279912 conn(0x7fd3040cc540 msgr2=0x7fd30406da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:54.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 shutdown_connections 2023-10-07T09:07:54.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:54.934+0000 7fd309fbe700 1 -- 172.21.15.46:0/61279912 wait complete. 2023-10-07T09:07:54.936 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-10-07T09:07:54.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:07:54.967 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-10-07T09:07:54.966+0000 7fcc0eced700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:07:55.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.065+0000 7fc8db009700 1 Processor -- start 2023-10-07T09:07:55.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.065+0000 7fc8db009700 1 -- start start 2023-10-07T09:07:55.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8db009700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8d4159420 0x7fc8d40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8db009700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8d41597f0 0x7fc8d40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8db009700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40b11d0 con 0x7fc8d415d230 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8db009700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d40b14b0 con 0x7fc8d4159420 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8db009700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d40b1790 con 0x7fc8d41597f0 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8da007700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8d4159420 0x7fc8d40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8da808700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc8d415d230 0x7fc8d415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47768/0 (socket says 172.21.15.46:47768) 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8da007700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8d4159420 0x7fc8d40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33108/0 (socket says 172.21.15.46:33108) 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8da808700 1 -- 172.21.15.46:0/2827472370 learned_addr learned my addr 172.21.15.46:0/2827472370 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.066+0000 7fc8d9806700 1 --2- 172.21.15.46:0/2827472370 >> v2:172.21.15.133:3300/0 conn(0x7fc8d41597f0 0x7fc8d40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8da007700 1 -- 172.21.15.46:0/2827472370 >> v2:172.21.15.133:3300/0 conn(0x7fc8d41597f0 msgr2=0x7fc8d40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8da007700 1 --2- 172.21.15.46:0/2827472370 >> v2:172.21.15.133:3300/0 conn(0x7fc8d41597f0 0x7fc8d40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8da007700 1 -- 172.21.15.46:0/2827472370 >> v1:172.21.15.46:6789/0 conn(0x7fc8d415d230 legacy=0x7fc8d415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8d9005700 1 -- 172.21.15.46:0/2827472370 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042384937 0 0) 0x7fc8d40b11d0 con 0x7fc8d415d230 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8da007700 1 -- 172.21.15.46:0/2827472370 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40b1a70 con 0x7fc8d4159420 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8da007700 1 --2- 172.21.15.46:0/2827472370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d40b5f40 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4089750 tx=0x7fc8c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86849c6d3e635408 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8d9005700 1 -- 172.21.15.46:0/2827472370 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400e070 con 0x7fc8d4159420 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8d9005700 1 -- 172.21.15.46:0/2827472370 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c400bc30 con 0x7fc8d4159420 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8d9005700 1 -- 172.21.15.46:0/2827472370 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4012430 con 0x7fc8d4159420 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8db009700 1 -- 172.21.15.46:0/2827472370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 msgr2=0x7fc8d40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8db009700 1 --2- 172.21.15.46:0/2827472370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d40b5f40 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4089750 tx=0x7fc8c4009780 comp rx=0 tx=0).stop 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.067+0000 7fc8db009700 1 -- 172.21.15.46:0/2827472370 shutdown_connections 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.068+0000 7fc8db009700 1 --2- 172.21.15.46:0/2827472370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d40b5f40 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.068+0000 7fc8db009700 1 --2- 172.21.15.46:0/2827472370 >> v2:172.21.15.133:3300/0 conn(0x7fc8d41597f0 0x7fc8d40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.068+0000 7fc8db009700 1 -- 172.21.15.46:0/2827472370 >> 172.21.15.46:0/2827472370 conn(0x7fc8d40d0660 msgr2=0x7fc8d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.068+0000 7fc8db009700 1 -- 172.21.15.46:0/2827472370 shutdown_connections 2023-10-07T09:07:55.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.068+0000 7fc8db009700 1 -- 172.21.15.46:0/2827472370 wait complete. 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 Processor -- start 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 -- start start 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8d41597f0 0x7fc8d4155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8d415d230 0x7fc8d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4169c10 con 0x7fc8d4159420 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d415b8b0 con 0x7fc8d41597f0 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8db009700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4169620 con 0x7fc8d415d230 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8da007700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8da007700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33112/0 (socket says 172.21.15.46:33112) 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.069+0000 7fc8da007700 1 -- 172.21.15.46:0/2381522676 learned_addr learned my addr 172.21.15.46:0/2381522676 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8d9806700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8d41597f0 0x7fc8d4155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da808700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8d415d230 0x7fc8d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 -- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8d415d230 msgr2=0x7fc8d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8d415d230 0x7fc8d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 -- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8d41597f0 msgr2=0x7fc8d4155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8d41597f0 0x7fc8d4155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 -- 172.21.15.46:0/2381522676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009a20 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8da007700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40097c0 tx=0x7fc8c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4001090 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4027470 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d40cc010 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4027830 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.070+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d415b2f0 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.071+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d4169e80 con 0x7fc8d4159420 2023-10-07T09:07:55.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.072+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc8c4024070 con 0x7fc8d4159420 2023-10-07T09:07:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.072+0000 7fc8d27fc700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 0x7fc8c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.072+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8c40871a0 con 0x7fc8d4159420 2023-10-07T09:07:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.072+0000 7fc8d9806700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 0x7fc8c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.073+0000 7fc8d9806700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 0x7fc8c00697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40af0c0 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.076+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c4053e30 con 0x7fc8d4159420 2023-10-07T09:07:55.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.313+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8d404c3c0 con 0x7fc8d4159420 2023-10-07T09:07:55.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.313+0000 7fc8d27fc700 1 -- 172.21.15.46:0/2381522676 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fc8c4009880 con 0x7fc8d4159420 2023-10-07T09:07:55.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:07:55.314 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":134,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:07:55.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.315+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 msgr2=0x7fc8c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.315+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 0x7fc8c00697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40af0c0 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2023-10-07T09:07:55.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.315+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 msgr2=0x7fc8d416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40097c0 tx=0x7fc8c4019000 comp rx=0 tx=0).stop 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 shutdown_connections 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc8c0067320 0x7fc8c00697d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8d415d230 0x7fc8d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8d4159420 0x7fc8d416a030 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 --2- 172.21.15.46:0/2381522676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8d41597f0 0x7fc8d4155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 >> 172.21.15.46:0/2381522676 conn(0x7fc8d40d0660 msgr2=0x7fc8d4068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 shutdown_connections 2023-10-07T09:07:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.316+0000 7fc8db009700 1 -- 172.21.15.46:0/2381522676 wait complete. 2023-10-07T09:07:55.318 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 134 2023-10-07T09:07:55.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 134, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T09:07:49.389948+0000', 'modified': '2023-10-07T09:07:53.004129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9036}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9036': {'gid': 9036, 'name': 'a', 'rank': 0, 'incarnation': 130, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/1322977630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 1322977630}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1322977630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T09:07:55.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T09:07:55.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.856+0000 7f20b759e700 1 Processor -- start 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.856+0000 7f20b759e700 1 -- start start 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 0x7f20b8159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20b80ceaa0 0x7f20b80b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b759e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b80b6570 con 0x7f20b81593b0 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80cfe20 con 0x7f20b80ceaa0 2023-10-07T09:07:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80cf210 con 0x7f20b80b1e50 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20b80ceaa0 0x7f20b80b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f20b81593b0 0x7f20b80b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47782/0 (socket says 172.21.15.46:47782) 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20b80ceaa0 0x7f20b80b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33120/0 (socket says 172.21.15.46:33120) 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b659c700 1 -- 172.21.15.46:0/2260541491 learned_addr learned my addr 172.21.15.46:0/2260541491 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2260541491 >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 0x7f20b8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 -- 172.21.15.46:0/2260541491 >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 msgr2=0x7f20b8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2260541491 >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 0x7f20b8159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 -- 172.21.15.46:0/2260541491 >> v1:172.21.15.46:6789/0 conn(0x7f20b81593b0 legacy=0x7f20b80b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b6d9d700 1 -- 172.21.15.46:0/2260541491 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80cf4f0 con 0x7f20b80ceaa0 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b559a700 1 -- 172.21.15.46:0/2260541491 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343432696 0 0) 0x7f20b0001110 con 0x7f20b81593b0 2023-10-07T09:07:55.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.857+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2260541491 >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 0x7f20b8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2260541491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80ceaa0 0x7f20b80b6030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b2d90 tx=0x7f20a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7182cba6be0a657 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b559a700 1 -- 172.21.15.46:0/2260541491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800e070 con 0x7f20b80ceaa0 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b559a700 1 -- 172.21.15.46:0/2260541491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800bc30 con 0x7f20b80ceaa0 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b559a700 1 -- 172.21.15.46:0/2260541491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8012430 con 0x7f20b80ceaa0 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 -- 172.21.15.46:0/2260541491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80ceaa0 msgr2=0x7f20b80b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 --2- 172.21.15.46:0/2260541491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80ceaa0 0x7f20b80b6030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b2d90 tx=0x7f20a8009780 comp rx=0 tx=0).stop 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 -- 172.21.15.46:0/2260541491 shutdown_connections 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 --2- 172.21.15.46:0/2260541491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80ceaa0 0x7f20b80b6030 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 --2- 172.21.15.46:0/2260541491 >> v2:172.21.15.133:3300/0 conn(0x7f20b80b1e50 0x7f20b8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 -- 172.21.15.46:0/2260541491 >> 172.21.15.46:0/2260541491 conn(0x7f20b80d1130 msgr2=0x7f20b80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 -- 172.21.15.46:0/2260541491 shutdown_connections 2023-10-07T09:07:55.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.858+0000 7f20b759e700 1 -- 172.21.15.46:0/2260541491 wait complete. 2023-10-07T09:07:55.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 Processor -- start 2023-10-07T09:07:55.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 -- start start 2023-10-07T09:07:55.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 0x7f20b80c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20b81593b0 0x7f20b80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8068390 con 0x7f20b80b1e50 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8068630 con 0x7f20b80ceaa0 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80cbb50 con 0x7f20b81593b0 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33124/0 (socket says 172.21.15.46:33124) 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.860+0000 7f20b659c700 1 -- 172.21.15.46:0/2284538841 learned_addr learned my addr 172.21.15.46:0/2284538841 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 0x7f20b80c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20b81593b0 0x7f20b80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 -- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20b81593b0 msgr2=0x7f20b80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20b81593b0 0x7f20b80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 -- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 msgr2=0x7f20b80c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 0x7f20b80c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 -- 172.21.15.46:0/2284538841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8009a20 con 0x7f20b80b1e50 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 0x7f20b80c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b659c700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c5b0 tx=0x7f20b0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20ae7fc700 1 -- 172.21.15.46:0/2284538841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0005b30 con 0x7f20b80b1e50 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20ae7fc700 1 -- 172.21.15.46:0/2284538841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b0005c90 con 0x7f20b80b1e50 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80cbe30 con 0x7f20b80b1e50 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20ae7fc700 1 -- 172.21.15.46:0/2284538841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0007300 con 0x7f20b80b1e50 2023-10-07T09:07:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.861+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b816abd0 con 0x7f20b80b1e50 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.863+0000 7f20ae7fc700 1 -- 172.21.15.46:0/2284538841 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f20b001b3b0 con 0x7f20b80b1e50 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.863+0000 7f20ae7fc700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 0x7f20980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.863+0000 7f20ae7fc700 1 -- 172.21.15.46:0/2284538841 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20b0084050 con 0x7f20b80b1e50 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.863+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 0x7f20980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.864+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 0x7f20980697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f20a0006f00 tx=0x7f20a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.865+0000 7f20c5bc3b80 1 Processor -- start 2023-10-07T09:07:55.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.865+0000 7f20c5bc3b80 1 -- start start 2023-10-07T09:07:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56885f0 0x55c3e56d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e55e1a70 con 0x55c3e568ab80 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e55df270 con 0x55c3e56885f0 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e55db060 con 0x55c3e56d5480 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33134/0 (socket says 172.21.15.46:33134) 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 -- 172.21.15.46:0/3913051154 learned_addr learned my addr 172.21.15.46:0/3913051154 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b659c700 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56885f0 0x55c3e56d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 -- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 msgr2=0x55c3e56b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 -- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56885f0 msgr2=0x55c3e56d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56885f0 0x55c3e56d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 -- 172.21.15.46:0/3913051154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3e5475270 con 0x55c3e568ab80 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f20a8013000 tx=0x7f20a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda6e45db91df37e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.866+0000 7f20977fe700 1 -- 172.21.15.46:0/3913051154 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800bda0 con 0x55c3e568ab80 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20977fe700 1 -- 172.21.15.46:0/3913051154 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8012810 con 0x55c3e568ab80 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20977fe700 1 -- 172.21.15.46:0/3913051154 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8012bd0 con 0x55c3e568ab80 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/3913051154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 msgr2=0x55c3e568aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f20a8013000 tx=0x7f20a8019000 comp rx=0 tx=0).stop 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/3913051154 shutdown_connections 2023-10-07T09:07:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e568aff0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/3913051154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56885f0 0x55c3e56d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/3913051154 >> 172.21.15.46:0/3913051154 conn(0x55c3e568c0c0 msgr2=0x55c3e568c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/3913051154 shutdown_connections 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.867+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/3913051154 wait complete. 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.868+0000 7f20c5bc3b80 1 -- start start 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.868+0000 7f20c5bc3b80 1 Processor -- start 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e56b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e5586890 con 0x55c3e568ab80 2023-10-07T09:07:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e55a1ea0 con 0x55c3e56d5480 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e545de30 con 0x55c3e56885f0 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20c5bc3b80 10 client.0 _ll_register_callbacks cb 0x55c3e564e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33138/0 (socket says 172.21.15.46:33138) 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2064580679 learned_addr learned my addr 172.21.15.46:0/2064580679 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b659c700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e56b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 msgr2=0x55c3e56b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e56b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 msgr2=0x55c3e56b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2064580679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b80cf4f0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f20a0015920 tx=0x7f20a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7974fb32f85d7a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.869+0000 7f2094ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00167b0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20a0016910 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3e567fcd0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20a0016ce0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 10 client.9177 fetch_fsmap learned FSMap version 134 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x55c3e5417fe0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3e567fcd0 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f20a002b440 con 0x55c3e568ab80 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 10 client.9177 fetch_fsmap finished waiting for FSMap version 134 2023-10-07T09:07:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 10 client.9177 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 20 client.9177 populate_metadata read hostname 'smithi046' 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56b5340 0x55c3e56b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 4 client.9177 mds_command: new command op to 9036 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 --> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3e565caa0 con 0x55c3e56b5340 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20b659c700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56b5340 0x55c3e56b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f2094ff9700 10 client.9177 ms_handle_connect on v2:172.21.15.46:6832/1322977630 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.870+0000 7f20b659c700 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56b5340 0x55c3e56b5710 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398747d7dadf0abf server_cookie=5445970ff86c37aa in_seq=0 out_seq=0 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f2094ff9700 1 -- 172.21.15.46:0/2064580679 <== mds.0 v2:172.21.15.46:6832/1322977630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c3e565caa0 con 0x55c3e56b5340 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f2094ff9700 10 client.9177 handle_command_reply: tid=0 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 client.9177 shutdown 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 msgr2=0x55c3e56b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f20a0015920 tx=0x7f20a0017000 comp rx=0 tx=0).stop 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 shutdown_connections 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56b5340 0x55c3e56b5710 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e56b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2064580679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b3340 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f2094ff9700 0 client.9177 ms_handle_reset on v2:172.21.15.46:6832/1322977630 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 >> 172.21.15.46:0/2064580679 conn(0x55c3e568c0c0 msgr2=0x55c3e5686e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 shutdown_connections 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.871+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2064580679 wait complete. 2023-10-07T09:07:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.872+0000 7f20c5bc3b80 20 client.9177 trim_cache size 0 max 16384 2023-10-07T09:07:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.888+0000 7f20c5bc3b80 1 Processor -- start 2023-10-07T09:07:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.888+0000 7f20c5bc3b80 1 -- start start 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e568ab80 0x55c3e56e0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e566a510 con 0x55c3e56885f0 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e5663410 con 0x55c3e568ab80 2023-10-07T09:07:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e5688e20 con 0x55c3e56d5480 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 -- 172.21.15.46:0/1855851549 learned_addr learned my addr 172.21.15.46:0/1855851549 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 -- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 msgr2=0x55c3e56e0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 -- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e568ab80 msgr2=0x55c3e56e0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e568ab80 0x55c3e56e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 -- 172.21.15.46:0/1855851549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3e55a9780 con 0x55c3e56885f0 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.889+0000 7f20b659c700 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f20b0054930 tx=0x7f20b001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eabf1529a4ade8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f2097fff700 1 -- 172.21.15.46:0/1855851549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0005e00 con 0x55c3e56885f0 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f2097fff700 1 -- 172.21.15.46:0/1855851549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b0052ae0 con 0x55c3e56885f0 2023-10-07T09:07:55.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f2097fff700 1 -- 172.21.15.46:0/1855851549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0052d40 con 0x55c3e56885f0 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/1855851549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 msgr2=0x55c3e56d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f20b0054930 tx=0x7f20b001e040 comp rx=0 tx=0).stop 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/1855851549 shutdown_connections 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56d5480 0x55c3e56e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e56885f0 0x55c3e56d0b60 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/1855851549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e568ab80 0x55c3e56e0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/1855851549 >> 172.21.15.46:0/1855851549 conn(0x55c3e568c0c0 msgr2=0x55c3e5686e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/1855851549 shutdown_connections 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.890+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/1855851549 wait complete. 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.891+0000 7f20c5bc3b80 1 -- start start 2023-10-07T09:07:55.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.891+0000 7f20c5bc3b80 1 Processor -- start 2023-10-07T09:07:55.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e5731690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e56aec50 con 0x55c3e568ab80 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e56b7790 con 0x55c3e56d5480 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e5737e50 con 0x55c3e56885f0 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 10 client.0 _ll_register_callbacks cb 0x55c3e564e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33160/0 (socket says 172.21.15.46:33160) 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2254475550 learned_addr learned my addr 172.21.15.46:0/2254475550 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b659c700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e5731690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 msgr2=0x55c3e5731690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e5731690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 msgr2=0x55c3e56b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 -- 172.21.15.46:0/2254475550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b816abd0 con 0x55c3e568ab80 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b659c700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e5731690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b6d9d700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20b5d9b700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x55c3e56d5280 tx=0x7f20a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61358e1f01369deb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f2094ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00167b0 con 0x55c3e568ab80 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20a0016910 con 0x55c3e568ab80 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20a8012810 con 0x55c3e568ab80 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20a0005c10 con 0x55c3e568ab80 2023-10-07T09:07:55.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.892+0000 7f20c5bc3b80 10 client.9183 fetch_fsmap learned FSMap version 134 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x55c3e5590470 con 0x55c3e568ab80 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8012810 con 0x55c3e568ab80 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f20a0006040 con 0x55c3e568ab80 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 10 client.9183 fetch_fsmap finished waiting for FSMap version 134 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 10 client.9183 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 20 client.9183 populate_metadata read hostname 'smithi046' 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56addf0 0x55c3e56ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 4 client.9183 mds_command: new command op to 9036 tid=0[{"prefix": "status"}] 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 --> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3e557de00 con 0x55c3e56addf0 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20b659c700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56addf0 0x55c3e56ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 10 client.9183 ms_handle_connect on v2:172.21.15.46:6832/1322977630 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20b659c700 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56addf0 0x55c3e56ae1c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b1722e3cb8d3d0 server_cookie=6e0844d7099fa442 in_seq=0 out_seq=0 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 1 -- 172.21.15.46:0/2254475550 <== mds.0 v2:172.21.15.46:6832/1322977630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55c3e557de00 con 0x55c3e56addf0 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 10 client.9183 handle_command_reply: tid=0 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 client.9183 shutdown 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 msgr2=0x55c3e56b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x55c3e56d5280 tx=0x7f20a001a000 comp rx=0 tx=0).stop 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 shutdown_connections 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:6832/1322977630,v1:172.21.15.46:6835/1322977630] conn(0x55c3e56addf0 0x55c3e56ae1c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3e56d5480 0x55c3e56b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c3e56885f0 0x55c3e5731690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f2094ff9700 0 client.9183 ms_handle_reset on v2:172.21.15.46:6832/1322977630 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.893+0000 7f20c5bc3b80 1 --2- 172.21.15.46:0/2254475550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3e568ab80 0x55c3e56b5710 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 >> 172.21.15.46:0/2254475550 conn(0x55c3e568c0c0 msgr2=0x55c3e56879e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 shutdown_connections 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20c5bc3b80 1 -- 172.21.15.46:0/2254475550 wait complete. 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20c5bc3b80 20 client.9183 trim_cache size 0 max 16384 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "28716a76-cc98-43f4-9a5b-38266bddfb96", 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-07T09:07:55.902 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 9036, 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9087707920000003, 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 134, 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 199, 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 199, 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 11.914342641999999 2023-10-07T09:07:55.903 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:07:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 msgr2=0x7f20980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 0x7f20980697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f20a0006f00 tx=0x7f20a0008040 comp rx=0 tx=0).stop 2023-10-07T09:07:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 msgr2=0x7f20b816a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c5b0 tx=0x7f20b0001070 comp rx=0 tx=0).stop 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 shutdown_connections 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2098067320 0x7f20980697d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20b81593b0 0x7f20b80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20b80b1e50 0x7f20b816a690 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 --2- 172.21.15.46:0/2284538841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b80ceaa0 0x7f20b80c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 >> 172.21.15.46:0/2284538841 conn(0x7f20b80d1130 msgr2=0x7f20b8156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 shutdown_connections 2023-10-07T09:07:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:55.894+0000 7f20b759e700 1 -- 172.21.15.46:0/2284538841 wait complete. 2023-10-07T09:07:55.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:07:56.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.026+0000 7fc458a27700 1 Processor -- start 2023-10-07T09:07:56.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.026+0000 7fc458a27700 1 -- start start 2023-10-07T09:07:56.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc458a27700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc4540b5ea0 0x7fc454068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc458a27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc454068bb0 0x7fc45415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc458a27700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45415c480 con 0x7fc454159c10 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc458a27700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4540b2a40 con 0x7fc4540b5ea0 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc458a27700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45415b870 con 0x7fc454068bb0 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc45259c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc454159c10 0x7fc45415b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47794/0 (socket says 172.21.15.46:47794) 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc45259c700 1 -- 172.21.15.46:0/4034041793 learned_addr learned my addr 172.21.15.46:0/4034041793 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc451d9b700 1 --2- 172.21.15.46:0/4034041793 >> v2:172.21.15.46:3300/0 conn(0x7fc4540b5ea0 0x7fc454068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.027+0000 7fc452d9d700 1 --2- 172.21.15.46:0/4034041793 >> v2:172.21.15.133:3300/0 conn(0x7fc454068bb0 0x7fc45415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc45159a700 1 -- 172.21.15.46:0/4034041793 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293890123 0 0) 0x7fc45415c480 con 0x7fc454159c10 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc45159a700 1 -- 172.21.15.46:0/4034041793 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc440003570 con 0x7fc454159c10 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc451d9b700 1 -- 172.21.15.46:0/4034041793 >> v2:172.21.15.133:3300/0 conn(0x7fc454068bb0 msgr2=0x7fc45415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:56.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc451d9b700 1 --2- 172.21.15.46:0/4034041793 >> v2:172.21.15.133:3300/0 conn(0x7fc454068bb0 0x7fc45415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc451d9b700 1 -- 172.21.15.46:0/4034041793 >> v1:172.21.15.46:6789/0 conn(0x7fc454159c10 legacy=0x7fc45415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc451d9b700 1 -- 172.21.15.46:0/4034041793 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45415bb50 con 0x7fc4540b5ea0 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc451d9b700 1 --2- 172.21.15.46:0/4034041793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4540b5ea0 0x7fc454068670 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fc45415c3f0 tx=0x7fc43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6016551fb4056469 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc45159a700 1 -- 172.21.15.46:0/4034041793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011630 con 0x7fc4540b5ea0 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc45159a700 1 -- 172.21.15.46:0/4034041793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c0117b0 con 0x7fc4540b5ea0 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc45159a700 1 -- 172.21.15.46:0/4034041793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011b70 con 0x7fc4540b5ea0 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc458a27700 1 -- 172.21.15.46:0/4034041793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4540b5ea0 msgr2=0x7fc454068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.028+0000 7fc458a27700 1 --2- 172.21.15.46:0/4034041793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4540b5ea0 0x7fc454068670 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fc45415c3f0 tx=0x7fc43c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 -- 172.21.15.46:0/4034041793 shutdown_connections 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 --2- 172.21.15.46:0/4034041793 >> v2:172.21.15.133:3300/0 conn(0x7fc454068bb0 0x7fc45415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 --2- 172.21.15.46:0/4034041793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4540b5ea0 0x7fc454068670 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 -- 172.21.15.46:0/4034041793 >> 172.21.15.46:0/4034041793 conn(0x7fc454099a20 msgr2=0x7fc4540af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:56.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 -- 172.21.15.46:0/4034041793 shutdown_connections 2023-10-07T09:07:56.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.029+0000 7fc458a27700 1 -- 172.21.15.46:0/4034041793 wait complete. 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 Processor -- start 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 -- start start 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc454068bb0 0x7fc4540c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 0x7fc4541574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540c6cf0 con 0x7fc454159c10 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540aec50 con 0x7fc4540b5ea0 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.030+0000 7fc458a27700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540aef30 con 0x7fc454068bb0 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33168/0 (socket says 172.21.15.46:33168) 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 -- 172.21.15.46:0/3084508060 learned_addr learned my addr 172.21.15.46:0/3084508060 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc45259c700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc454068bb0 0x7fc4540c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc451d9b700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 0x7fc4541574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 -- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc454068bb0 msgr2=0x7fc4540c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc454068bb0 0x7fc4540c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 -- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 msgr2=0x7fc4541574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 0x7fc4541574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 -- 172.21.15.46:0/3084508060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009420 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc451d9b700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 0x7fc4541574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc452d9d700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fc444009e90 tx=0x7fc44400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400cc20 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400f040 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540af210 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444014480 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.031+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4540af7d0 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.032+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4540af9f0 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.033+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc444014830 con 0x7fc454159c10 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.033+0000 7fc44a7fc700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 0x7fc4340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.033+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc444085600 con 0x7fc454159c10 2023-10-07T09:07:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.033+0000 7fc45259c700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 0x7fc4340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.034+0000 7fc45259c700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 0x7fc4340697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0058d0 tx=0x7fc44c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.037+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc444052280 con 0x7fc454159c10 2023-10-07T09:07:56.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.276+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc45404c3c0 con 0x7fc454159c10 2023-10-07T09:07:56.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.277+0000 7fc44a7fc700 1 -- 172.21.15.46:0/3084508060 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v134) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc4440558a0 con 0x7fc454159c10 2023-10-07T09:07:56.277 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:07:56.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 msgr2=0x7fc4340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 0x7fc4340697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0058d0 tx=0x7fc44c009040 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 msgr2=0x7fc4540afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fc444009e90 tx=0x7fc44400b040 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 shutdown_connections 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc434067320 0x7fc4340697d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc454159c10 0x7fc4540afcf0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc454068bb0 0x7fc4540c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 --2- 172.21.15.46:0/3084508060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540b5ea0 0x7fc4541574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 >> 172.21.15.46:0/3084508060 conn(0x7fc454099a20 msgr2=0x7fc45409a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 shutdown_connections 2023-10-07T09:07:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:56.279+0000 7fc458a27700 1 -- 172.21.15.46:0/3084508060 wait complete. 2023-10-07T09:07:56.291 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:07:56.291 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:07:56.291 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:07:56.292 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:56.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.292 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-07T09:07:56.308 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41937sec preferred_lft 41937sec 2023-10-07T09:07:56.309 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4417:a9ff:fe63:186c/64 scope link 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:56.310 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 26:5e:49:00:9f:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::245e:49ff:fe00:9f75/64 scope link 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 66:e9:8a:ee:fa:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::64e9:8aff:feee:fae1/64 scope link 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:56.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.311 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:07:56.372 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-07T09:07:56.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.374 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:07:56.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T09:07:56.432 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-07T09:07:56.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.535 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:07:56.550 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:07:56.551 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:07:56.551 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:56.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-07T09:07:56.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:56.616 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:56.672 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T09:07:56.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:56.672 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:56.726 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-07T09:07:56.726 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:07:56.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:56.807 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:56.807 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:56.827 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:56.848 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:56.849 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:56.849 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:07:56.849 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:07:56.849 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:07:56.850 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:07:56.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:56.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:56.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T09:07:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.076+0000 7f23ef140700 1 Processor -- start 2023-10-07T09:07:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.076+0000 7f23ef140700 1 -- start start 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ef140700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23e8159c60 0x7f23e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ef140700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f23e815db10 0x7f23e8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ef140700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e815a160 con 0x7f23e8159890 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ef140700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e815df50 con 0x7f23e815db10 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ef140700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80d13a0 con 0x7f23e8159c60 2023-10-07T09:07:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ecedc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f23e8159890 0x7f23e815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47810/0 (socket says 172.21.15.46:47810) 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ed6dd700 1 --2- 172.21.15.46:0/12603486 >> v2:172.21.15.46:3300/0 conn(0x7f23e815db10 0x7f23e8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23ecedc700 1 -- 172.21.15.46:0/12603486 learned_addr learned my addr 172.21.15.46:0/12603486 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23e7fff700 1 --2- 172.21.15.46:0/12603486 >> v2:172.21.15.133:3300/0 conn(0x7f23e8159c60 0x7f23e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23e77fe700 1 -- 172.21.15.46:0/12603486 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899486011 0 0) 0x7f23e815a160 con 0x7f23e8159890 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.077+0000 7f23e77fe700 1 -- 172.21.15.46:0/12603486 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d0003570 con 0x7f23e8159890 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ed6dd700 1 -- 172.21.15.46:0/12603486 >> v2:172.21.15.133:3300/0 conn(0x7f23e8159c60 msgr2=0x7f23e815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ed6dd700 1 --2- 172.21.15.46:0/12603486 >> v2:172.21.15.133:3300/0 conn(0x7f23e8159c60 0x7f23e815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ed6dd700 1 -- 172.21.15.46:0/12603486 >> v1:172.21.15.46:6789/0 conn(0x7f23e8159890 legacy=0x7f23e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ed6dd700 1 -- 172.21.15.46:0/12603486 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e815e140 con 0x7f23e815db10 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ed6dd700 1 --2- 172.21.15.46:0/12603486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e815db10 0x7f23e8069560 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f23e80b67f0 tx=0x7f23e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82de20857f0cc22 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23e77fe700 1 -- 172.21.15.46:0/12603486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000e070 con 0x7f23e815db10 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23e77fe700 1 -- 172.21.15.46:0/12603486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e000bab0 con 0x7f23e815db10 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23e77fe700 1 -- 172.21.15.46:0/12603486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000be70 con 0x7f23e815db10 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 -- 172.21.15.46:0/12603486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e815db10 msgr2=0x7f23e8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 --2- 172.21.15.46:0/12603486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e815db10 0x7f23e8069560 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f23e80b67f0 tx=0x7f23e0009780 comp rx=0 tx=0).stop 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 -- 172.21.15.46:0/12603486 shutdown_connections 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 --2- 172.21.15.46:0/12603486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e815db10 0x7f23e8069560 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 --2- 172.21.15.46:0/12603486 >> v2:172.21.15.133:3300/0 conn(0x7f23e8159c60 0x7f23e815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 -- 172.21.15.46:0/12603486 >> 172.21.15.46:0/12603486 conn(0x7f23e8068e20 msgr2=0x7f23e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 -- 172.21.15.46:0/12603486 shutdown_connections 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.078+0000 7f23ef140700 1 -- 172.21.15.46:0/12603486 wait complete. 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 Processor -- start 2023-10-07T09:07:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 -- start start 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 0x7f23e80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 0x7f23e80c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e816cdc0 con 0x7f23e8159c60 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80cd430 con 0x7f23e815db10 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.080+0000 7f23ef140700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80cd710 con 0x7f23e8159890 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33186/0 (socket says 172.21.15.46:33186) 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 -- 172.21.15.46:0/2622892572 learned_addr learned my addr 172.21.15.46:0/2622892572 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ecedc700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 0x7f23e80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ed6dd700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 0x7f23e80c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 -- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 msgr2=0x7f23e80b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 0x7f23e80b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 -- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 msgr2=0x7f23e80c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 0x7f23e80c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 -- 172.21.15.46:0/2622892572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0009a20 con 0x7f23e8159c60 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ecedc700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 0x7f23e80b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ed6dd700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 0x7f23e80c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e7fff700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00ec80 tx=0x7f23dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00c9d0 con 0x7f23e8159c60 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc00cb30 con 0x7f23e8159c60 2023-10-07T09:07:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80cd9f0 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc013470 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.081+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80cd0c0 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.082+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e804c3c0 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.083+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f23dc013820 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.083+0000 7f23e4ff9700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 0x7f23d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.083+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23dc085000 con 0x7f23e8159c60 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.083+0000 7f23ecedc700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 0x7f23d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.084+0000 7f23ecedc700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 0x7f23d40697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007fd0 tx=0x7f23d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:57.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.087+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23dc051c90 con 0x7f23e8159c60 2023-10-07T09:07:57.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.325+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23e8154ac0 con 0x7f23e8159c60 2023-10-07T09:07:57.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.325+0000 7f23e4ff9700 1 -- 172.21.15.46:0/2622892572 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v134) v1 ==== 53+0+73 (secure 0 0 0) 0x7f23dc0552b0 con 0x7f23e8159c60 2023-10-07T09:07:57.326 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T09:07:57.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 msgr2=0x7f23d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 0x7f23d40697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007fd0 tx=0x7f23d8009040 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 msgr2=0x7f23e80c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00ec80 tx=0x7f23dc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 shutdown_connections 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f23d4067320 0x7f23d40697d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815db10 0x7f23e80c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e8159890 0x7f23e80b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.327+0000 7f23ef140700 1 --2- 172.21.15.46:0/2622892572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e8159c60 0x7f23e80c6b50 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.328+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 >> 172.21.15.46:0/2622892572 conn(0x7f23e8068e20 msgr2=0x7f23e8149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.328+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 shutdown_connections 2023-10-07T09:07:57.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:57.328+0000 7f23ef140700 1 -- 172.21.15.46:0/2622892572 wait complete. 2023-10-07T09:07:57.340 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T09:07:57.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T09:07:57.341 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:57.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.342 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-10-07T09:07:57.360 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-10-07T09:07:57.361 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41929sec preferred_lft 41929sec 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T09:07:57.362 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f810:82ff:fe81:9945/64 scope link 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether a2:65:66:51:85:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::a065:66ff:fe51:85e2/64 scope link 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 62:83:ca:a0:ea:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6083:caff:fea0:ea4c/64 scope link 2023-10-07T09:07:57.363 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-10-07T09:07:57.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.364 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T09:07:57.428 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-10-07T09:07:57.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.430 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T09:07:57.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.488 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-10-07T09:07:57.489 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-10-07T09:07:57.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T09:07:57.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T09:07:57.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T09:07:57.489 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-10-07T09:07:57.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.593 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:07:57.609 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:07:57.609 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:07:57.609 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:57.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-10-07T09:07:57.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:57.674 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:57.729 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T09:07:57.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T09:07:57.729 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:57.783 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-07T09:07:57.783 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T09:07:57.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:57.863 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:57.863 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:57.882 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:57.883 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:57.904 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-07T09:07:57.904 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-07T09:07:57.904 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-10-07T09:07:57.904 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@28716a76-cc98-43f4-9a5b-38266bddfb96.cephfs=/ 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: v2 mount support check returned 2 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790" 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2023-10-07T09:07:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28716a76-cc98-43f4-9a5b-38266bddfb96" will pass to kernel 2023-10-07T09:07:57.906 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T09:07:57.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:57.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:57.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-07T09:07:58.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.107+0000 7f288894a700 1 Processor -- start 2023-10-07T09:07:58.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.107+0000 7f288894a700 1 -- start start 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288894a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884159ec0 0x7f28840b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288894a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28840b53d0 0x7f28840cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288894a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840b5b00 con 0x7f28840cce40 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288894a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840b5da0 con 0x7f28840b53d0 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288894a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b6080 con 0x7f2884159ec0 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28840b53d0 0x7f28840cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28840b53d0 0x7f28840cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33192/0 (socket says 172.21.15.46:33192) 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 -- 172.21.15.46:0/2921807876 learned_addr learned my addr 172.21.15.46:0/2921807876 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f288259c700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884159ec0 0x7f28840b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 -- 172.21.15.46:0/2921807876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884159ec0 msgr2=0x7f28840b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884159ec0 0x7f28840b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.108+0000 7f2881d9b700 1 -- 172.21.15.46:0/2921807876 >> v1:172.21.15.133:6789/0 conn(0x7f28840cce40 legacy=0x7f28840cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f2881d9b700 1 -- 172.21.15.46:0/2921807876 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840cc100 con 0x7f28840b53d0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f2881d9b700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840b53d0 0x7f28840cc900 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f286c0099b0 tx=0x7f286c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91149f3bfd741bb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288159a700 1 -- 172.21.15.46:0/2921807876 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00b860 con 0x7f28840b53d0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288159a700 1 -- 172.21.15.46:0/2921807876 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00b9c0 con 0x7f28840b53d0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288159a700 1 -- 172.21.15.46:0/2921807876 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00bd60 con 0x7f28840b53d0 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 -- 172.21.15.46:0/2921807876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840b53d0 msgr2=0x7f28840cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840b53d0 0x7f28840cc900 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f286c0099b0 tx=0x7f286c009250 comp rx=0 tx=0).stop 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 -- 172.21.15.46:0/2921807876 shutdown_connections 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884159ec0 0x7f28840b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 --2- 172.21.15.46:0/2921807876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840b53d0 0x7f28840cc900 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 -- 172.21.15.46:0/2921807876 >> 172.21.15.46:0/2921807876 conn(0x7f28840999f0 msgr2=0x7f28840b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 -- 172.21.15.46:0/2921807876 shutdown_connections 2023-10-07T09:07:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.109+0000 7f288894a700 1 -- 172.21.15.46:0/2921807876 wait complete. 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 Processor -- start 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 -- start start 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28840b53d0 0x7f288409ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28840cce40 0x7f2884157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884157c80 con 0x7f2884159ec0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288409bd00 con 0x7f28840b53d0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288894a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288409b0f0 con 0x7f28840cce40 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33196/0 (socket says 172.21.15.46:33196) 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f2882d9d700 1 -- 172.21.15.46:0/3108011294 learned_addr learned my addr 172.21.15.46:0/3108011294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f2881d9b700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28840cce40 0x7f2884157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.111+0000 7f288259c700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28840b53d0 0x7f288409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 -- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28840cce40 msgr2=0x7f2884157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28840cce40 0x7f2884157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 -- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28840b53d0 msgr2=0x7f288409ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28840b53d0 0x7f288409ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 -- 172.21.15.46:0/3108011294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0094f0 con 0x7f2884159ec0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f2882d9d700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c8e0 tx=0x7f287c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:58.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c012630 con 0x7f2884159ec0 2023-10-07T09:07:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c012790 con 0x7f2884159ec0 2023-10-07T09:07:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c012b50 con 0x7f2884159ec0 2023-10-07T09:07:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288409b3d0 con 0x7f2884159ec0 2023-10-07T09:07:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.112+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288409b990 con 0x7f2884159ec0 2023-10-07T09:07:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.113+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28840cabb0 con 0x7f2884159ec0 2023-10-07T09:07:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.114+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f287c01a3a0 con 0x7f2884159ec0 2023-10-07T09:07:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.114+0000 7f287a7fc700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 0x7f28640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.114+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f287c084e10 con 0x7f2884159ec0 2023-10-07T09:07:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.114+0000 7f288259c700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 0x7f28640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.115+0000 7f288259c700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 0x7f28640697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2884063840 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.118+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287c088030 con 0x7f2884159ec0 2023-10-07T09:07:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:58.358+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2884063c90 con 0x7f2884159ec0 2023-10-07T09:07:59.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.024+0000 7f287a7fc700 1 -- 172.21.15.46:0/3108011294 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v135) v1 ==== 136+0+0 (secure 0 0 0) 0x7f287c055530 con 0x7f2884159ec0 2023-10-07T09:07:59.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 msgr2=0x7f28640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 0x7f28640697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2884063840 tx=0x7f2874008040 comp rx=0 tx=0).stop 2023-10-07T09:07:59.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 msgr2=0x7f288409d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c8e0 tx=0x7f287c001710 comp rx=0 tx=0).stop 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 shutdown_connections 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2864067320 0x7f28640697d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2884159ec0 0x7f288409d9e0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28840b53d0 0x7f288409ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 --2- 172.21.15.46:0/3108011294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28840cce40 0x7f2884157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 >> 172.21.15.46:0/3108011294 conn(0x7f28840999f0 msgr2=0x7f28840ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.027+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 shutdown_connections 2023-10-07T09:07:59.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.028+0000 7f288894a700 1 -- 172.21.15.46:0/3108011294 wait complete. 2023-10-07T09:07:59.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-07T09:07:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.168+0000 7f7d23857700 1 Processor -- start 2023-10-07T09:07:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.168+0000 7f7d23857700 1 -- start start 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d23857700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 0x7f7d1c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d23857700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d1c159c60 0x7f7d1c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d23857700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c15a160 con 0x7f7d1c15db10 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d23857700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c15df50 con 0x7f7d1c159c60 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d23857700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c0d13a0 con 0x7f7d1c159890 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d20df2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d1c159c60 0x7f7d1c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d21df4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7d1c15db10 0x7f7d1c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47812/0 (socket says 172.21.15.46:47812) 2023-10-07T09:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.169+0000 7f7d21df4700 1 -- 172.21.15.46:0/1697269874 learned_addr learned my addr 172.21.15.46:0/1697269874 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1697269874 >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 0x7f7d1c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d20df2700 1 -- 172.21.15.46:0/1697269874 >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 msgr2=0x7f7d1c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d20df2700 1 --2- 172.21.15.46:0/1697269874 >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 0x7f7d1c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d20df2700 1 -- 172.21.15.46:0/1697269874 >> v1:172.21.15.46:6789/0 conn(0x7f7d1c15db10 legacy=0x7f7d1c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d1bfff700 1 -- 172.21.15.46:0/1697269874 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054928148 0 0) 0x7f7d1c15a160 con 0x7f7d1c15db10 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d20df2700 1 -- 172.21.15.46:0/1697269874 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c15e140 con 0x7f7d1c159c60 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1697269874 >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 0x7f7d1c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d20df2700 1 --2- 172.21.15.46:0/1697269874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c15d5d0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0d1090 tx=0x7f7d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d5ab6cd47dbe6f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d1bfff700 1 -- 172.21.15.46:0/1697269874 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000b6b0 con 0x7f7d1c159c60 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d1bfff700 1 -- 172.21.15.46:0/1697269874 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1000b810 con 0x7f7d1c159c60 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.170+0000 7f7d1bfff700 1 -- 172.21.15.46:0/1697269874 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000bbb0 con 0x7f7d1c159c60 2023-10-07T09:07:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 -- 172.21.15.46:0/1697269874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 msgr2=0x7f7d1c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 --2- 172.21.15.46:0/1697269874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c15d5d0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0d1090 tx=0x7f7d100091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 -- 172.21.15.46:0/1697269874 shutdown_connections 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 --2- 172.21.15.46:0/1697269874 >> v2:172.21.15.133:3300/0 conn(0x7f7d1c159890 0x7f7d1c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 --2- 172.21.15.46:0/1697269874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c15d5d0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 -- 172.21.15.46:0/1697269874 >> 172.21.15.46:0/1697269874 conn(0x7f7d1c068e20 msgr2=0x7f7d1c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 -- 172.21.15.46:0/1697269874 shutdown_connections 2023-10-07T09:07:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.171+0000 7f7d23857700 1 -- 172.21.15.46:0/1697269874 wait complete. 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.172+0000 7f7d23857700 1 Processor -- start 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.172+0000 7f7d23857700 1 -- start start 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 0x7f7d1c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d1c15db10 0x7f7d1c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0b6210 con 0x7f7d1c159c60 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c16d070 con 0x7f7d1c159890 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d23857700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c16d350 con 0x7f7d1c15db10 2023-10-07T09:07:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33220/0 (socket says 172.21.15.46:33220) 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 -- 172.21.15.46:0/1517103137 learned_addr learned my addr 172.21.15.46:0/1517103137 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 0x7f7d1c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d21df4700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d1c15db10 0x7f7d1c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 -- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d1c15db10 msgr2=0x7f7d1c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d1c15db10 0x7f7d1c0cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 -- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 msgr2=0x7f7d1c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 0x7f7d1c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 -- 172.21.15.46:0/1517103137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009420 con 0x7f7d1c159c60 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 0x7f7d1c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.173+0000 7f7d20df2700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c070e20 tx=0x7f7d10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.174+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000bb90 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.174+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10011420 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.174+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c16d630 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.174+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100117a0 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.174+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c1502a0 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.175+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c16db50 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.175+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7d10011b90 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.176+0000 7f7d197fa700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 0x7f7d080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.176+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d10086640 con 0x7f7d1c159c60 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.176+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 0x7f7d080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.176+0000 7f7d215f3700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 0x7f7d080697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0094d0 tx=0x7f7d0c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.180+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d1c16db50 con 0x7f7d1c159c60 2023-10-07T09:07:59.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.402+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d1c16d1e0 con 0x7f7d08067320 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.403+0000 7f7d197fa700 1 -- 172.21.15.46:0/1517103137 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7d1c16d1e0 con 0x7f7d08067320 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-07T09:07:59.404 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-07T09:07:59.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 msgr2=0x7f7d080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 0x7f7d080697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0094d0 tx=0x7f7d0c00b040 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 msgr2=0x7f7d1c0cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c070e20 tx=0x7f7d10017000 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 shutdown_connections 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7d08067320 0x7f7d080697d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d1c15db10 0x7f7d1c0cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d1c159890 0x7f7d1c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 --2- 172.21.15.46:0/1517103137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1c159c60 0x7f7d1c0cd410 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 >> 172.21.15.46:0/1517103137 conn(0x7f7d1c068e20 msgr2=0x7f7d1c150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 shutdown_connections 2023-10-07T09:07:59.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.406+0000 7f7d23857700 1 -- 172.21.15.46:0/1517103137 wait complete. 2023-10-07T09:07:59.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T09:07:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.539+0000 7ff9b159a700 1 Processor -- start 2023-10-07T09:07:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.539+0000 7ff9b159a700 1 -- start start 2023-10-07T09:07:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9b159a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9ac159890 0x7ff9ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9b159a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9b159a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac15a160 con 0x7ff9ac15db10 2023-10-07T09:07:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9b159a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0d13a0 con 0x7ff9ac159890 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9b159a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac15e140 con 0x7ff9ac159c60 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9ab7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff9ac15db10 0x7ff9ac069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47826/0 (socket says 172.21.15.46:47826) 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.540+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/314406094 learned_addr learned my addr 172.21.15.46:0/314406094 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/314406094 >> v2:172.21.15.133:3300/0 conn(0x7ff9ac159890 0x7ff9ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9aa7fc700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343245216 0 0) 0x7ff9ac15a160 con 0x7ff9ac15db10 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff998003570 con 0x7ff9ac15db10 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756376779 0 0) 0x7ff998003570 con 0x7ff9ac15db10 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 msgr2=0x7ff9ac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9ac15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 >> v2:172.21.15.133:3300/0 conn(0x7ff9ac159890 msgr2=0x7ff9ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 --2- 172.21.15.46:0/314406094 >> v2:172.21.15.133:3300/0 conn(0x7ff9ac159890 0x7ff9ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac15a3d0 con 0x7ff9ac15db10 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7ff99c0017f0 con 0x7ff9ac15db10 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 >> v1:172.21.15.46:6789/0 conn(0x7ff9ac15db10 legacy=0x7ff9ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998003a60 0x7ff998003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0d13a0 con 0x7ff998003a60 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac15e140 con 0x7ff998004810 2023-10-07T09:07:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99800ba60 con 0x7ff9ac159c60 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998003a60 0x7ff998003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9aa7fc700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.541+0000 7ff9ab7fe700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 -- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 msgr2=0x7ff9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac159c60 0x7ff9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 -- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998004810 msgr2=0x7ff998004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 -- 172.21.15.46:0/314406094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998003570 con 0x7ff998003a60 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998003a60 0x7ff998003e70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009c30 tx=0x7ff9a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a370b50f6b3db82c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400e710 con 0x7ff998003a60 2023-10-07T09:07:59.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400e870 con 0x7ff998003a60 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9a9ffb700 1 -- 172.21.15.46:0/314406094 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400ec30 con 0x7ff998003a60 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9b159a700 1 -- 172.21.15.46:0/314406094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998003a60 msgr2=0x7ff998003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9b159a700 1 --2- 172.21.15.46:0/314406094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998003a60 0x7ff998003e70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009c30 tx=0x7ff9a40091a0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/314406094 reap_dead start 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9b159a700 1 -- 172.21.15.46:0/314406094 shutdown_connections 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.542+0000 7ff9b159a700 1 -- 172.21.15.46:0/314406094 >> 172.21.15.46:0/314406094 conn(0x7ff9ac068e20 msgr2=0x7ff9ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.543+0000 7ff9b159a700 1 -- 172.21.15.46:0/314406094 shutdown_connections 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.543+0000 7ff9b159a700 1 -- 172.21.15.46:0/314406094 wait complete. 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 Processor -- start 2023-10-07T09:07:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 -- start start 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998003a60 0x7ff9ac14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac0b5c40 0x7ff9ac0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0cede0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ce1d0 con 0x7ff998003a60 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.544+0000 7ff9b159a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ce4b0 con 0x7ff9ac0b5c40 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33240/0 (socket says 172.21.15.46:33240) 2023-10-07T09:07:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/957222074 learned_addr learned my addr 172.21.15.46:0/957222074 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998003a60 0x7ff9ac14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9aa7fc700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac0b5c40 0x7ff9ac0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac0b5c40 msgr2=0x7ff9ac0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac0b5c40 0x7ff9ac0cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998003a60 msgr2=0x7ff9ac14d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998003a60 0x7ff9ac14d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 -- 172.21.15.46:0/957222074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0ce790 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9ab7fe700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac15dee0 tx=0x7ff99c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00ae50 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0133f0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0cea70 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0137b0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.545+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac14dbe0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.546+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0c75a0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.547+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff99c013b60 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.547+0000 7ff9a2ffd700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 0x7ff98c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.547+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff99c085600 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.547+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 0x7ff98c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:07:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.548+0000 7ff9aaffd700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 0x7ff98c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40091e0 tx=0x7ff9a401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:07:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.551+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff99c052290 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.744+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff9ac04c3c0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.744+0000 7ff9a2ffd700 1 -- 172.21.15.46:0/957222074 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff99c0558b0 con 0x7ff9ac0cf7b0 2023-10-07T09:07:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 msgr2=0x7ff98c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 0x7ff98c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40091e0 tx=0x7ff9a401a000 comp rx=0 tx=0).stop 2023-10-07T09:07:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 msgr2=0x7ff9ac0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac15dee0 tx=0x7ff99c002210 comp rx=0 tx=0).stop 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 shutdown_connections 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff98c067320 0x7ff98c0697d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9ac0cf7b0 0x7ff9ac0c78a0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff998003a60 0x7ff9ac14d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 --2- 172.21.15.46:0/957222074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9ac0b5c40 0x7ff9ac0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 >> 172.21.15.46:0/957222074 conn(0x7ff9ac068e20 msgr2=0x7ff9ac15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.746+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 shutdown_connections 2023-10-07T09:07:59.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:07:59.747+0000 7ff9b159a700 1 -- 172.21.15.46:0/957222074 wait complete. 2023-10-07T09:07:59.759 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T09:07:59.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:07:59.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T09:07:59.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:07:59.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:59.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T09:07:59.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T09:07:59.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T09:07:59.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T09:07:59.898 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:07:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:59.898 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T09:07:59.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:07:59.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:59.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T09:07:59.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:07:59.930 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-07T09:07:59.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:07:59.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:07:59.931 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T09:07:59.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:07:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-07T09:07:59.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs 2023-10-07T09:08:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.095+0000 7f06af908700 1 Processor -- start 2023-10-07T09:08:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.096+0000 7f06af908700 1 -- start start 2023-10-07T09:08:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.096+0000 7f06af908700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f06a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.096+0000 7f06af908700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a815a160 con 0x7f06a8159890 2023-10-07T09:08:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.096+0000 7f06af908700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a80d13a0 con 0x7f06a815db10 2023-10-07T09:08:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.096+0000 7f06af908700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a815e140 con 0x7f06a8159c60 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06ad6a4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f06a8159890 0x7f06a815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48096/0 (socket says 172.21.15.46:48096) 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06ad6a4700 1 -- 172.21.15.46:0/900193821 learned_addr learned my addr 172.21.15.46:0/900193821 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06acea3700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f06a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560141655 0 0) 0x7f06a815a160 con 0x7f06a8159890 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0690003570 con 0x7f06a8159890 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709148424 0 0) 0x7f0690003570 con 0x7f06a8159890 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 msgr2=0x7f06a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:08:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f06a815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 >> v1:172.21.15.133:6789/0 conn(0x7f06a815db10 legacy=0x7f06a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a815a3d0 con 0x7f06a8159890 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f06980017f0 con 0x7f06a8159890 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 >> v1:172.21.15.46:6789/0 conn(0x7f06a8159890 legacy=0x7f06a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f0690003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690003fd0 0x7f0690004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0690004d50 0x7f06900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a815e140 con 0x7f0690003fd0 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069000bb40 con 0x7f0690004d50 2023-10-07T09:08:00.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069000bd00 con 0x7f06a8159c60 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06acea3700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690003fd0 0x7f0690004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06ad6a4700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f0690003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.097+0000 7f06adea5700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0690004d50 0x7f06900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 -- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 msgr2=0x7f0690003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06a8159c60 0x7f0690003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 -- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0690004d50 msgr2=0x7f06900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0690004d50 0x7f06900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 -- 172.21.15.46:0/900193821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690003570 con 0x7f0690003fd0 2023-10-07T09:08:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06acea3700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690003fd0 0x7f0690004810 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f06a815a090 tx=0x7f069c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e271e1bbbeaf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00e710 con 0x7f0690003fd0 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00e870 con 0x7f0690003fd0 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.098+0000 7f06a7fff700 1 -- 172.21.15.46:0/900193821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ec30 con 0x7f0690003fd0 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 -- 172.21.15.46:0/900193821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690003fd0 msgr2=0x7f0690004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 --2- 172.21.15.46:0/900193821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690003fd0 0x7f0690004810 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f06a815a090 tx=0x7f069c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06adea5700 1 -- 172.21.15.46:0/900193821 reap_dead start 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 -- 172.21.15.46:0/900193821 shutdown_connections 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 -- 172.21.15.46:0/900193821 >> 172.21.15.46:0/900193821 conn(0x7f06a8068e20 msgr2=0x7f06a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 -- 172.21.15.46:0/900193821 shutdown_connections 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.099+0000 7f06af908700 1 -- 172.21.15.46:0/900193821 wait complete. 2023-10-07T09:08:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.100+0000 7f06af908700 1 Processor -- start 2023-10-07T09:08:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.100+0000 7f06af908700 1 -- start start 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0690003fd0 0x7f06a8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06a8153350 0x7f06a80c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06a80c6b40 0x7f06a80cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8151b20 con 0x7f06a8153350 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8152980 con 0x7f06a80c6b40 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8151d70 con 0x7f0690003fd0 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06a8153350 0x7f06a80c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06a8153350 0x7f06a80c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53226/0 (socket says 172.21.15.46:53226) 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 -- 172.21.15.46:0/1381846521 learned_addr learned my addr 172.21.15.46:0/1381846521 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06ad6a4700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0690003fd0 0x7f06a8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06adea5700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06a80c6b40 0x7f06a80cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 -- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0690003fd0 msgr2=0x7f06a8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0690003fd0 0x7f06a8152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 -- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06a80c6b40 msgr2=0x7f06a80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06a80c6b40 0x7f06a80cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 -- 172.21.15.46:0/1381846521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8152050 con 0x7f06a8153350 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06acea3700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06a8153350 0x7f06a80c6600 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f069000bb10 tx=0x7f069c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c022070 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00e9e0 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c01c450 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.101+0000 7f06af908700 1 -- 172.21.15.46:0/1381846521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a8152330 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.102+0000 7f06af908700 1 -- 172.21.15.46:0/1381846521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a814bc60 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.102+0000 7f06af908700 1 -- 172.21.15.46:0/1381846521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a80c6f40 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.103+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f069c01c7c0 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.103+0000 7f06a57fa700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0694067320 0x7f06940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.103+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f069c086420 con 0x7f06a8153350 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.103+0000 7f06ad6a4700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0694067320 0x7f06940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.104+0000 7f06ad6a4700 1 --2- 172.21.15.46:0/1381846521 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0694067320 0x7f06940697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0698001920 tx=0x7f0698006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.107+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06a80c6f40 con 0x7f06a8153350 2023-10-07T09:08:00.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.326+0000 7f06af908700 1 -- 172.21.15.46:0/1381846521 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f06a80c6f40 con 0x7f0694067320 2023-10-07T09:08:00.328 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-10-07T09:08:00.327+0000 7f470fd46700 -1 mgr.server reply reply (1) Operation not permitted WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-07T09:08:00.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.328+0000 7f06a57fa700 1 -- 172.21.15.46:0/1381846521 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: -1 WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it.) v1 ==== 204+0+0 (secure 0 0 0) 0x7f06a80c6f40 con 0x7f0694067320 2023-10-07T09:08:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-07T09:08:00.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:08:00.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2023-10-07T09:08:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.455+0000 7f02663f5700 1 Processor -- start 2023-10-07T09:08:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.455+0000 7f02663f5700 1 -- start start 2023-10-07T09:08:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f02663f5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02600aca80 0x7f026006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f02663f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600c83c0 0x7f02600cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f02663f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026006bdb0 con 0x7f0260069d60 2023-10-07T09:08:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f02663f5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02600cb370 con 0x7f02600aca80 2023-10-07T09:08:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f02663f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0260159f60 con 0x7f02600c83c0 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02600aca80 0x7f026006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02600aca80 0x7f026006aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53232/0 (socket says 172.21.15.46:53232) 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0260069d60 0x7f02600c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48104/0 (socket says 172.21.15.46:48104) 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 -- 172.21.15.46:0/1946318969 learned_addr learned my addr 172.21.15.46:0/1946318969 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f0264992700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600c83c0 0x7f02600cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 -- 172.21.15.46:0/1946318969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600c83c0 msgr2=0x7f02600cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600c83c0 0x7f02600cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 -- 172.21.15.46:0/1946318969 >> v1:172.21.15.46:6789/0 conn(0x7f0260069d60 legacy=0x7f02600c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025effd700 1 -- 172.21.15.46:0/1946318969 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169702592 0 0) 0x7f026006bdb0 con 0x7f0260069d60 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.456+0000 7f025ffff700 1 -- 172.21.15.46:0/1946318969 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026006b510 con 0x7f02600aca80 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f025ffff700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600aca80 0x7f026006aba0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0250009990 tx=0x7f0250009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f01e0e4ccb275b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f025effd700 1 -- 172.21.15.46:0/1946318969 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250005c10 con 0x7f02600aca80 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f025effd700 1 -- 172.21.15.46:0/1946318969 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250005d70 con 0x7f02600aca80 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f025effd700 1 -- 172.21.15.46:0/1946318969 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000b880 con 0x7f02600aca80 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 -- 172.21.15.46:0/1946318969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600aca80 msgr2=0x7f026006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600aca80 0x7f026006aba0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0250009990 tx=0x7f0250009220 comp rx=0 tx=0).stop 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 -- 172.21.15.46:0/1946318969 shutdown_connections 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600c83c0 0x7f02600cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 --2- 172.21.15.46:0/1946318969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600aca80 0x7f026006aba0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 -- 172.21.15.46:0/1946318969 >> 172.21.15.46:0/1946318969 conn(0x7f02600cd670 msgr2=0x7f02600cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 -- 172.21.15.46:0/1946318969 shutdown_connections 2023-10-07T09:08:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.457+0000 7f02663f5700 1 -- 172.21.15.46:0/1946318969 wait complete. 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.458+0000 7f02663f5700 1 Processor -- start 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 -- start start 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0260069d60 0x7f02600ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600aca80 0x7f02601574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600c83c0 0x7f026015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600b1300 con 0x7f02600c83c0 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600b0410 con 0x7f0260069d60 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f02663f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600b06f0 con 0x7f02600aca80 2023-10-07T09:08:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f0264992700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600c83c0 0x7f026015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f0264992700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600c83c0 0x7f026015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53238/0 (socket says 172.21.15.46:53238) 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.459+0000 7f0264992700 1 -- 172.21.15.46:0/808724776 learned_addr learned my addr 172.21.15.46:0/808724776 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f025f7fe700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600aca80 0x7f02601574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f025ffff700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0260069d60 0x7f02600ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 -- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600aca80 msgr2=0x7f02601574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02600aca80 0x7f02601574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 -- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0260069d60 msgr2=0x7f02600ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0260069d60 0x7f02600ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 -- 172.21.15.46:0/808724776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009480 con 0x7f02600c83c0 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f025ffff700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0260069d60 0x7f02600ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:08:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0264992700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02600c83c0 0x7f026015a1b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f0258007f20 tx=0x7f0258009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800ecd0 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800ee50 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258014670 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f02663f5700 1 -- 172.21.15.46:0/808724776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02600b09d0 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.460+0000 7f02663f5700 1 -- 172.21.15.46:0/808724776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02600b0f90 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.461+0000 7f02663f5700 1 -- 172.21.15.46:0/808724776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02600b14b0 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.461+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02580149e0 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.462+0000 7f0247fff700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067320 0x7f024c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.462+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02580853a0 con 0x7f02600c83c0 2023-10-07T09:08:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.462+0000 7f025ffff700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067320 0x7f024c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:08:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.463+0000 7f025ffff700 1 --2- 172.21.15.46:0/808724776 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f024c067320 0x7f024c0697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0250009260 tx=0x7f0250016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:08:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.466+0000 7f0247fff700 1 -- 172.21.15.46:0/808724776 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02600b14b0 con 0x7f02600c83c0 2023-10-07T09:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:08:00.690+0000 7f02663f5700 1 -- 172.21.15.46:0/808724776 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f026004c3c0 con 0x7f024c067320 2023-10-07T09:08:13.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:08:13.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:08:43.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:08:43.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:09:13.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:09:13.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:09:43.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:09:43.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:00.364 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-07T09:10:00.365 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T09:10:00.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:10:00.412 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T09:10:00.463 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T09:10:00.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:10:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.592+0000 7f0780d34700 1 Processor -- start 2023-10-07T09:10:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.592+0000 7f0780d34700 1 -- start start 2023-10-07T09:10:00.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.593+0000 7f0780d34700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f077c0b1420 0x7f077c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.593+0000 7f0780d34700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0cc300 con 0x7f077c0cbf30 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.593+0000 7f0780d34700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0ad370 con 0x7f077c0ccf90 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.593+0000 7f0780d34700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c156bf0 con 0x7f077c0b1420 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f0779d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f077c0b1420 0x7f077c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077a59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f077c0cbf30 0x7f077c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46526/0 (socket says 172.21.15.46:46526) 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077a59c700 1 -- 172.21.15.46:0/2969417437 learned_addr learned my addr 172.21.15.46:0/2969417437 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f0779d9b700 1 -- 172.21.15.46:0/2969417437 >> v1:172.21.15.133:6789/0 conn(0x7f077c0ccf90 legacy=0x7f077c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f0779d9b700 1 -- 172.21.15.46:0/2969417437 >> v1:172.21.15.46:6789/0 conn(0x7f077c0cbf30 legacy=0x7f077c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f0779d9b700 1 -- 172.21.15.46:0/2969417437 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0ad650 con 0x7f077c0b1420 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077959a700 1 -- 172.21.15.46:0/2969417437 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425145430 0 0) 0x7f077c0cc300 con 0x7f077c0cbf30 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f0779d9b700 1 --2- 172.21.15.46:0/2969417437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0b1420 0x7f077c0ae410 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f07640098e0 tx=0x7f07640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cab84938e6e7b08 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077959a700 1 -- 172.21.15.46:0/2969417437 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764009e80 con 0x7f077c0b1420 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077959a700 1 -- 172.21.15.46:0/2969417437 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400b820 con 0x7f077c0b1420 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.594+0000 7f077959a700 1 -- 172.21.15.46:0/2969417437 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400bba0 con 0x7f077c0b1420 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 -- 172.21.15.46:0/2969417437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0b1420 msgr2=0x7f077c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 --2- 172.21.15.46:0/2969417437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0b1420 0x7f077c0ae410 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f07640098e0 tx=0x7f07640091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 -- 172.21.15.46:0/2969417437 shutdown_connections 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 --2- 172.21.15.46:0/2969417437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0b1420 0x7f077c0ae410 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 -- 172.21.15.46:0/2969417437 >> 172.21.15.46:0/2969417437 conn(0x7f077c06a320 msgr2=0x7f077c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 -- 172.21.15.46:0/2969417437 shutdown_connections 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.595+0000 7f0780d34700 1 -- 172.21.15.46:0/2969417437 wait complete. 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.596+0000 7f0780d34700 1 Processor -- start 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.596+0000 7f0780d34700 1 -- start start 2023-10-07T09:10:00.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f077c0b1420 0x7f077c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f077c0cbf30 0x7f077c16a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aaba0 con 0x7f077c0ccf90 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0a98b0 con 0x7f077c0b1420 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0780d34700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aa710 con 0x7f077c0cbf30 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57758/0 (socket says 172.21.15.46:57758) 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 -- 172.21.15.46:0/4089402083 learned_addr learned my addr 172.21.15.46:0/4089402083 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077a59c700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f077c0b1420 0x7f077c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f0779d9b700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f077c0cbf30 0x7f077c16a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 -- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f077c0cbf30 msgr2=0x7f077c16a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f077c0cbf30 0x7f077c16a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 -- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f077c0b1420 msgr2=0x7f077c153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f077c0b1420 0x7f077c153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.597+0000 7f077ad9d700 1 -- 172.21.15.46:0/4089402083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f077ad9d700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0774009750 tx=0x7f0774006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400f780 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400f8e0 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0a9b00 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400fca0 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.598+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c0aa0c0 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.599+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c04c3c0 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.599+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0774010680 con 0x7f077c0ccf90 2023-10-07T09:10:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.600+0000 7f07727fc700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 0x7f075c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.600+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f0774086ef0 con 0x7f077c0ccf90 2023-10-07T09:10:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.600+0000 7f077a59c700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 0x7f075c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.600+0000 7f077a59c700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 0x7f075c0697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f076c002230 tx=0x7f076c001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.604+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0774053a20 con 0x7f077c0ccf90 2023-10-07T09:10:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.839+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f077c0aa850 con 0x7f077c0ccf90 2023-10-07T09:10:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.839+0000 7f07727fc700 1 -- 172.21.15.46:0/4089402083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f0774014070 con 0x7f077c0ccf90 2023-10-07T09:10:00.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:00.842 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 msgr2=0x7f075c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 0x7f075c0697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f076c002230 tx=0x7f076c001a20 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 msgr2=0x7f077c16ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0774009750 tx=0x7f0774006f90 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 shutdown_connections 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f075c067320 0x7f075c0697d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f077c0ccf90 0x7f077c16ab80 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f077c0b1420 0x7f077c153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 --2- 172.21.15.46:0/4089402083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f077c0cbf30 0x7f077c16a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 >> 172.21.15.46:0/4089402083 conn(0x7f077c06a320 msgr2=0x7f077c0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 shutdown_connections 2023-10-07T09:10:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.841+0000 7f0780d34700 1 -- 172.21.15.46:0/4089402083 wait complete. 2023-10-07T09:10:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 135 2023-10-07T09:10:00.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:10:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.973+0000 7f1c70eac700 1 Processor -- start 2023-10-07T09:10:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.973+0000 7f1c70eac700 1 -- start start 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c70eac700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c6c159890 0x7f1c6c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c70eac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 0x7f1c6c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c70eac700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c069ee0 con 0x7f1c6c159c60 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c70eac700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c15a160 con 0x7f1c6c159890 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c70eac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0d13a0 con 0x7f1c6c069560 2023-10-07T09:10:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c6a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c6c159890 0x7f1c6c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c69d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c6c159c60 0x7f1c6c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46536/0 (socket says 172.21.15.46:46536) 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.974+0000 7f1c69d9b700 1 -- 172.21.15.46:0/4204320367 learned_addr learned my addr 172.21.15.46:0/4204320367 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6ad9d700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 0x7f1c6c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6a59c700 1 -- 172.21.15.46:0/4204320367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 msgr2=0x7f1c6c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6a59c700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 0x7f1c6c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6a59c700 1 -- 172.21.15.46:0/4204320367 >> v1:172.21.15.46:6789/0 conn(0x7f1c6c159c60 legacy=0x7f1c6c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6959a700 1 -- 172.21.15.46:0/4204320367 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227599516 0 0) 0x7f1c6c069ee0 con 0x7f1c6c159c60 2023-10-07T09:10:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6a59c700 1 -- 172.21.15.46:0/4204320367 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c15e140 con 0x7f1c6c159890 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6ad9d700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 0x7f1c6c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6a59c700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c159890 0x7f1c6c15abd0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098e0 tx=0x7f1c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197d013dd5c571b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6959a700 1 -- 172.21.15.46:0/4204320367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c009e80 con 0x7f1c6c159890 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6959a700 1 -- 172.21.15.46:0/4204320367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00b860 con 0x7f1c6c159890 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c6959a700 1 -- 172.21.15.46:0/4204320367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00bbe0 con 0x7f1c6c159890 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c70eac700 1 -- 172.21.15.46:0/4204320367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c159890 msgr2=0x7f1c6c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.975+0000 7f1c70eac700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c159890 0x7f1c6c15abd0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098e0 tx=0x7f1c5c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 -- 172.21.15.46:0/4204320367 shutdown_connections 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c069560 0x7f1c6c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 --2- 172.21.15.46:0/4204320367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c159890 0x7f1c6c15abd0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 -- 172.21.15.46:0/4204320367 >> 172.21.15.46:0/4204320367 conn(0x7f1c6c068e20 msgr2=0x7f1c6c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 -- 172.21.15.46:0/4204320367 shutdown_connections 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.976+0000 7f1c70eac700 1 -- 172.21.15.46:0/4204320367 wait complete. 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.977+0000 7f1c70eac700 1 Processor -- start 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.977+0000 7f1c70eac700 1 -- start start 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.977+0000 7f1c70eac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c70eac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c159890 0x7f1c6c14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c70eac700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 0x7f1c6c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c70eac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b3d80 con 0x7f1c6c069560 2023-10-07T09:10:00.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c70eac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1575e0 con 0x7f1c6c159890 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c70eac700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c9be0 con 0x7f1c6c159c60 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57784/0 (socket says 172.21.15.46:57784) 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 -- 172.21.15.46:0/443491451 learned_addr learned my addr 172.21.15.46:0/443491451 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c69d9b700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c159890 0x7f1c6c14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6ad9d700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 0x7f1c6c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 -- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 msgr2=0x7f1c6c0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 0x7f1c6c0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 -- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c159890 msgr2=0x7f1c6c14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c159890 0x7f1c6c14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:00.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 -- 172.21.15.46:0/443491451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c6c069560 2023-10-07T09:10:00.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6ad9d700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 0x7f1c6c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:00.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.978+0000 7f1c6a59c700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0899c0 tx=0x7f1c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.979+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00b9d0 con 0x7f1c6c069560 2023-10-07T09:10:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.979+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0b3730 con 0x7f1c6c069560 2023-10-07T09:10:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.979+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00bb50 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.979+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c025670 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.979+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c14c780 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.980+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c0b3590 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.980+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1c5c023070 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.981+0000 7f1c627fc700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 0x7f1c4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.981+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1c5c0862e0 con 0x7f1c6c069560 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.981+0000 7f1c69d9b700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 0x7f1c4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.982+0000 7f1c69d9b700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 0x7f1c4c0697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0ca180 tx=0x7f1c54007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:00.985+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c6c0b3590 con 0x7f1c6c069560 2023-10-07T09:10:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.179+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c6c0b3590 con 0x7f1c6c069560 2023-10-07T09:10:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.180+0000 7f1c627fc700 1 -- 172.21.15.46:0/443491451 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f1c6c0b3590 con 0x7f1c6c069560 2023-10-07T09:10:01.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:01.182 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":201,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:08:28.069963+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.19","mappings":[{"from":0,"to":1}]},{"pgid":"34.25","mappings":[{"from":0,"to":2}]},{"pgid":"34.32","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 msgr2=0x7f1c4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 0x7f1c4c0697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0ca180 tx=0x7f1c54007d30 comp rx=0 tx=0).stop 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 msgr2=0x7f1c6c0c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0899c0 tx=0x7f1c5c017000 comp rx=0 tx=0).stop 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 shutdown_connections 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1c4c067320 0x7f1c4c0697d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c6c159c60 0x7f1c6c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c069560 0x7f1c6c0c9600 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 --2- 172.21.15.46:0/443491451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c159890 0x7f1c6c14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 >> 172.21.15.46:0/443491451 conn(0x7f1c6c068e20 msgr2=0x7f1c6c158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 shutdown_connections 2023-10-07T09:10:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.182+0000 7f1c70eac700 1 -- 172.21.15.46:0/443491451 wait complete. 2023-10-07T09:10:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:58:31.813778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 33, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T09:07:47.201984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '198', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 34, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T09:07:48.362022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T09:10:01.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T09:10:01.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.316+0000 7fcfdfff7700 1 Processor -- start 2023-10-07T09:10:01.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.316+0000 7fcfdfff7700 1 -- start start 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdfff7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcfd8141500 0x7fcfd80c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdfff7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcfd806c0a0 0x7fcfd80c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdfff7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd815c2a0 con 0x7fcfd806bcd0 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdfff7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd80c9880 con 0x7fcfd806c0a0 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdfff7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd815b690 con 0x7fcfd8141500 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfde594700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcfd806c0a0 0x7fcfd80c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfddd93700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcfd806bcd0 0x7fcfd8140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46552/0 (socket says 172.21.15.46:46552) 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfddd93700 1 -- 172.21.15.46:0/2370242715 learned_addr learned my addr 172.21.15.46:0/2370242715 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.317+0000 7fcfdd592700 1 --2- 172.21.15.46:0/2370242715 >> v2:172.21.15.133:3300/0 conn(0x7fcfd8141500 0x7fcfd80c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfde594700 1 -- 172.21.15.46:0/2370242715 >> v2:172.21.15.133:3300/0 conn(0x7fcfd8141500 msgr2=0x7fcfd80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfde594700 1 --2- 172.21.15.46:0/2370242715 >> v2:172.21.15.133:3300/0 conn(0x7fcfd8141500 0x7fcfd80c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfde594700 1 -- 172.21.15.46:0/2370242715 >> v1:172.21.15.46:6789/0 conn(0x7fcfd806bcd0 legacy=0x7fcfd8140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfde594700 1 -- 172.21.15.46:0/2370242715 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd815b970 con 0x7fcfd806c0a0 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdcd91700 1 -- 172.21.15.46:0/2370242715 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242464719 0 0) 0x7fcfd815c2a0 con 0x7fcfd806bcd0 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfde594700 1 --2- 172.21.15.46:0/2370242715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80c9340 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fcfd806c6e0 tx=0x7fcfc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509a4b21c10d771b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdcd91700 1 -- 172.21.15.46:0/2370242715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800e070 con 0x7fcfd806c0a0 2023-10-07T09:10:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdcd91700 1 -- 172.21.15.46:0/2370242715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800bc30 con 0x7fcfd806c0a0 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdcd91700 1 -- 172.21.15.46:0/2370242715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8012430 con 0x7fcfd806c0a0 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdfff7700 1 -- 172.21.15.46:0/2370242715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 msgr2=0x7fcfd80c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.318+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/2370242715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80c9340 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fcfd806c6e0 tx=0x7fcfc8009780 comp rx=0 tx=0).stop 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 -- 172.21.15.46:0/2370242715 shutdown_connections 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/2370242715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80c9340 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/2370242715 >> v2:172.21.15.133:3300/0 conn(0x7fcfd8141500 0x7fcfd80c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 -- 172.21.15.46:0/2370242715 >> 172.21.15.46:0/2370242715 conn(0x7fcfd80ce600 msgr2=0x7fcfd80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:01.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 -- 172.21.15.46:0/2370242715 shutdown_connections 2023-10-07T09:10:01.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.319+0000 7fcfdfff7700 1 -- 172.21.15.46:0/2370242715 wait complete. 2023-10-07T09:10:01.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 Processor -- start 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 -- start start 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd806bcd0 0x7fcfd8157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd8141500 0x7fcfd813fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd806a0d0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd806a2e0 con 0x7fcfd8141500 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.320+0000 7fcfdfff7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd806a5c0 con 0x7fcfd806bcd0 2023-10-07T09:10:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57794/0 (socket says 172.21.15.46:57794) 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 -- 172.21.15.46:0/1748853527 learned_addr learned my addr 172.21.15.46:0/1748853527 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfde594700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd8141500 0x7fcfd813fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfddd93700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd806bcd0 0x7fcfd8157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 -- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd806bcd0 msgr2=0x7fcfd8157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd806bcd0 0x7fcfd8157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 -- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd8141500 msgr2=0x7fcfd813fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd8141500 0x7fcfd813fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 -- 172.21.15.46:0/1748853527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009a20 con 0x7fcfd806c0a0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdd592700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00d860 tx=0x7fcfcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0125f0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc012750 con 0x7fcfd806c0a0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd806a8a0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc012b10 con 0x7fcfd806c0a0 2023-10-07T09:10:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.321+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd806aee0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.322+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd804c3c0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.323+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcfcc01e460 con 0x7fcfd806c0a0 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.323+0000 7fcfd5ffb700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 0x7fcfc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.323+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fcfcc0851f0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.323+0000 7fcfddd93700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 0x7fcfc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.324+0000 7fcfddd93700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 0x7fcfc40697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0007fd0 tx=0x7fcfd0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.327+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfcc0558c0 con 0x7fcfd806c0a0 2023-10-07T09:10:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.519+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfd815bc50 con 0x7fcfd806c0a0 2023-10-07T09:10:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.519+0000 7fcfd5ffb700 1 -- 172.21.15.46:0/1748853527 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v201) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfcc055450 con 0x7fcfd806c0a0 2023-10-07T09:10:01.521 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-07T09:10:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 msgr2=0x7fcfc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 0x7fcfc40697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0007fd0 tx=0x7fcfd0007d30 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 msgr2=0x7fcfd80b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00d860 tx=0x7fcfcc008040 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 shutdown_connections 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fcfc4067320 0x7fcfc40697d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd8141500 0x7fcfd813fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.521+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd806bcd0 0x7fcfd8157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.522+0000 7fcfdfff7700 1 --2- 172.21.15.46:0/1748853527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd806c0a0 0x7fcfd80b2ad0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.522+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 >> 172.21.15.46:0/1748853527 conn(0x7fcfd80ce600 msgr2=0x7fcfd80c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:01.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.522+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 shutdown_connections 2023-10-07T09:10:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.522+0000 7fcfdfff7700 1 -- 172.21.15.46:0/1748853527 wait complete. 2023-10-07T09:10:01.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T09:10:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 Processor -- start 2023-10-07T09:10:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 -- start start 2023-10-07T09:10:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c0b2080 con 0x7f131c0b4e70 2023-10-07T09:10:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c0cfb00 con 0x7f131c0b33b0 2023-10-07T09:10:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.656+0000 7f1320b4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0b5c40 con 0x7f131c0b16d0 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f131c0b4e70 0x7f131c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:37810/0 (socket says 172.21.15.46:37810) 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:42076/0 (socket says 172.21.15.46:42076) 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131b7fe700 1 -- 172.21.15.46:0/2653869711 learned_addr learned my addr 172.21.15.46:0/2653869711 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:60502/0 (socket says 172.21.15.46:60502) 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 -- 172.21.15.46:0/2653869711 >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 msgr2=0x7f131c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 --2- 172.21.15.46:0/2653869711 >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 -- 172.21.15.46:0/2653869711 >> v1:172.21.15.133:6789/0 conn(0x7f131c0b4e70 legacy=0x7f131c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131a7fc700 1 -- 172.21.15.46:0/2653869711 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293856553 0 0) 0x7f131c0b2080 con 0x7f131c0b4e70 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 -- 172.21.15.46:0/2653869711 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0b5f20 con 0x7f131c0b16d0 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131bfff700 1 --2- 172.21.15.46:0/2653869711 >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.657+0000 7f131affd700 1 --2- 172.21.15.46:0/2653869711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f13100098e0 tx=0x7f13100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6a9325601d7763 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f131a7fc700 1 -- 172.21.15.46:0/2653869711 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000b640 con 0x7f131c0b16d0 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f131a7fc700 1 -- 172.21.15.46:0/2653869711 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131000b7a0 con 0x7f131c0b16d0 2023-10-07T09:10:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f131a7fc700 1 -- 172.21.15.46:0/2653869711 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000bb40 con 0x7f131c0b16d0 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 -- 172.21.15.46:0/2653869711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 msgr2=0x7f131c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 --2- 172.21.15.46:0/2653869711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f13100098e0 tx=0x7f13100091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 -- 172.21.15.46:0/2653869711 shutdown_connections 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 --2- 172.21.15.46:0/2653869711 >> v2:172.21.15.133:3300/0 conn(0x7f131c0b33b0 0x7f131c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 --2- 172.21.15.46:0/2653869711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b16d0 0x7f131c0b1b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 -- 172.21.15.46:0/2653869711 >> 172.21.15.46:0/2653869711 conn(0x7f131c0d10c0 msgr2=0x7f131c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 -- 172.21.15.46:0/2653869711 shutdown_connections 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.658+0000 7f1320b4d700 1 -- 172.21.15.46:0/2653869711 wait complete. 2023-10-07T09:10:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.659+0000 7f1320b4d700 1 Processor -- start 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 -- start start 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 0x7f131c0a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b4e70 0x7f131c0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c16abb0 con 0x7f131c0b33b0 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0a8200 con 0x7f131c0b16d0 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f1320b4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0caa80 con 0x7f131c0b4e70 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f131affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f131affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57798/0 (socket says 172.21.15.46:57798) 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.660+0000 7f131affd700 1 -- 172.21.15.46:0/1668549169 learned_addr learned my addr 172.21.15.46:0/1668549169 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131b7fe700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 0x7f131c0a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131bfff700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b4e70 0x7f131c0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 -- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b4e70 msgr2=0x7f131c0aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b4e70 0x7f131c0aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 -- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 msgr2=0x7f131c0a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 0x7f131c0a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 -- 172.21.15.46:0/1668549169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009a20 con 0x7f131c0b33b0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131b7fe700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 0x7f131c0a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f131affd700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f1310009f80 tx=0x7f1310017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131001f070 con 0x7f131c0b33b0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310006af0 con 0x7f131c0b33b0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1310009420 con 0x7f131c0b33b0 2023-10-07T09:10:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000b910 con 0x7f131c0b33b0 2023-10-07T09:10:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.661+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c0cb040 con 0x7f131c0b33b0 2023-10-07T09:10:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.662+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c088990 con 0x7f131c0b33b0 2023-10-07T09:10:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.662+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1310023070 con 0x7f131c0b33b0 2023-10-07T09:10:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.663+0000 7f13037fe700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 0x7f13080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.663+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1310085e10 con 0x7f131c0b33b0 2023-10-07T09:10:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.663+0000 7f131b7fe700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 0x7f13080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.664+0000 7f131b7fe700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 0x7f13080697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f130c0011e0 tx=0x7f130c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.667+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1310089030 con 0x7f131c0b33b0 2023-10-07T09:10:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.858+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f131c04bb80 con 0x7f131c0b33b0 2023-10-07T09:10:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.859+0000 7f13037fe700 1 -- 172.21.15.46:0/1668549169 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v201) v1 ==== 104+0+11 (secure 0 0 0) 0x7f131002a020 con 0x7f131c0b33b0 2023-10-07T09:10:01.861 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 msgr2=0x7f13080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 0x7f13080697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f130c0011e0 tx=0x7f130c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 msgr2=0x7f131c16a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f1310009f80 tx=0x7f1310017000 comp rx=0 tx=0).stop 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 shutdown_connections 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1308067320 0x7f13080697d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f131c0b4e70 0x7f131c0aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f131c0b16d0 0x7f131c0a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 --2- 172.21.15.46:0/1668549169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131c0b33b0 0x7f131c16a670 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 >> 172.21.15.46:0/1668549169 conn(0x7f131c0d10c0 msgr2=0x7f131c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 shutdown_connections 2023-10-07T09:10:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.861+0000 7f1320b4d700 1 -- 172.21.15.46:0/1668549169 wait complete. 2023-10-07T09:10:01.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T09:10:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.995+0000 7f864301b700 1 Processor -- start 2023-10-07T09:10:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f864301b700 1 -- start start 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f864301b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f864301b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c06bdb0 con 0x7f863c069d60 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f864301b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0cb370 con 0x7f863c0c83c0 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f864301b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c159f60 con 0x7f863c0aca80 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f863bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f863c069d60 0x7f863c0c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46556/0 (socket says 172.21.15.46:46556) 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.996+0000 7f863bfff700 1 -- 172.21.15.46:0/2114951683 learned_addr learned my addr 172.21.15.46:0/2114951683 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f8640db7700 1 --2- 172.21.15.46:0/2114951683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037848181 0 0) 0x7f863c06bdb0 con 0x7f863c069d60 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8624003570 con 0x7f863c069d60 2023-10-07T09:10:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089950666 0 0) 0x7f863c0cb370 con 0x7f863c0c83c0 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f8640db7700 1 -- 172.21.15.46:0/2114951683 >> v1:172.21.15.133:6789/0 conn(0x7f863c0c83c0 legacy=0x7f863c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f8640db7700 1 -- 172.21.15.46:0/2114951683 >> v1:172.21.15.46:6789/0 conn(0x7f863c069d60 legacy=0x7f863c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f8640db7700 1 -- 172.21.15.46:0/2114951683 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c06b510 con 0x7f863c0aca80 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f8640db7700 1 --2- 172.21.15.46:0/2114951683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c06aba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8634009ee0 tx=0x7f8634009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8edadbcec9c0d4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400e070 con 0x7f863c0aca80 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863400bc30 con 0x7f863c0aca80 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.997+0000 7f863b7fe700 1 -- 172.21.15.46:0/2114951683 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634012430 con 0x7f863c0aca80 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 -- 172.21.15.46:0/2114951683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 msgr2=0x7f863c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 --2- 172.21.15.46:0/2114951683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c06aba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8634009ee0 tx=0x7f8634009780 comp rx=0 tx=0).stop 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 -- 172.21.15.46:0/2114951683 shutdown_connections 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 --2- 172.21.15.46:0/2114951683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c06aba0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 -- 172.21.15.46:0/2114951683 >> 172.21.15.46:0/2114951683 conn(0x7f863c0cd670 msgr2=0x7f863c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 -- 172.21.15.46:0/2114951683 shutdown_connections 2023-10-07T09:10:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.998+0000 7f864301b700 1 -- 172.21.15.46:0/2114951683 wait complete. 2023-10-07T09:10:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.999+0000 7f864301b700 1 Processor -- start 2023-10-07T09:10:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:01.999+0000 7f864301b700 1 -- start start 2023-10-07T09:10:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c0c83c0 0x7f863c0c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c158820 con 0x7f863c069d60 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c169e50 con 0x7f863c0c83c0 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f864301b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c16a110 con 0x7f863c0aca80 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57814/0 (socket says 172.21.15.46:57814) 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 -- 172.21.15.46:0/1274159627 learned_addr learned my addr 172.21.15.46:0/1274159627 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f863bfff700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f86415b8700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c0c83c0 0x7f863c0c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 -- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 msgr2=0x7f863c0c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c0c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 -- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c0c83c0 msgr2=0x7f863c0c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c0c83c0 0x7f863c0c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.000+0000 7f8640db7700 1 -- 172.21.15.46:0/1274159627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009a20 con 0x7f863c069d60 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f8640db7700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f863c06c6a0 tx=0x7f8634019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634026480 con 0x7f863c069d60 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634026600 con 0x7f863c069d60 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c16a3f0 con 0x7f863c069d60 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340269c0 con 0x7f863c069d60 2023-10-07T09:10:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.001+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c16a9b0 con 0x7f863c069d60 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.002+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c16aba0 con 0x7f863c069d60 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.002+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f863401c400 con 0x7f863c069d60 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.003+0000 7f8638ff9700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 0x7f8628069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.003+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f8634086c80 con 0x7f863c069d60 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.003+0000 7f863bfff700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 0x7f8628069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.004+0000 7f863bfff700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 0x7f8628069800 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ccd40 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.007+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86340537b0 con 0x7f863c069d60 2023-10-07T09:10:02.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.200+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f863c04c3c0 con 0x7f863c069d60 2023-10-07T09:10:02.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.201+0000 7f8638ff9700 1 -- 172.21.15.46:0/1274159627 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v201) v1 ==== 100+0+11 (secure 0 0 0) 0x7f863402b0a0 con 0x7f863c069d60 2023-10-07T09:10:02.203 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-07T09:10:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.202+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 msgr2=0x7f8628069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.202+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 0x7f8628069800 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ccd40 tx=0x7f8630009040 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.202+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 msgr2=0x7f863c1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.202+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f863c06c6a0 tx=0x7f8634019000 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 shutdown_connections 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f8628067350 0x7f8628069800 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f863c0c83c0 0x7f863c0c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f863c069d60 0x7f863c1582e0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 --2- 172.21.15.46:0/1274159627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f863c0aca80 0x7f863c0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 >> 172.21.15.46:0/1274159627 conn(0x7f863c0cd670 msgr2=0x7f863c0c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 shutdown_connections 2023-10-07T09:10:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.203+0000 7f864301b700 1 -- 172.21.15.46:0/1274159627 wait complete. 2023-10-07T09:10:02.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:10:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.333+0000 7f4a8d0ea700 1 Processor -- start 2023-10-07T09:10:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.333+0000 7f4a8d0ea700 1 -- start start 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8d0ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a88159890 0x7f4a8815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8d0ea700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8815a160 con 0x7f4a88069560 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8d0ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a880d13a0 con 0x7f4a88159c60 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8d0ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8815e140 con 0x7f4a88159890 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8759e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4a88069560 0x7f4a880ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46558/0 (socket says 172.21.15.46:46558) 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a8759e700 1 -- 172.21.15.46:0/199803620 learned_addr learned my addr 172.21.15.46:0/199803620 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.334+0000 7f4a86d9d700 1 --2- 172.21.15.46:0/199803620 >> v2:172.21.15.133:3300/0 conn(0x7f4a88159890 0x7f4a8815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190098202 0 0) 0x7f4a8815a160 con 0x7f4a88069560 2023-10-07T09:10:02.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a74003570 con 0x7f4a88069560 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3550508688 0 0) 0x7f4a74003570 con 0x7f4a88069560 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a86d9d700 1 -- 172.21.15.46:0/199803620 >> v1:172.21.15.133:6789/0 conn(0x7f4a88159c60 legacy=0x7f4a8815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a86d9d700 1 -- 172.21.15.46:0/199803620 >> v1:172.21.15.46:6789/0 conn(0x7f4a88069560 legacy=0x7f4a880ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a86d9d700 1 -- 172.21.15.46:0/199803620 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8815a3d0 con 0x7f4a88159890 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a86d9d700 1 --2- 172.21.15.46:0/199803620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88159890 0x7f4a8815abd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4a780098e0 tx=0x7f4a780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e587e1336187ef51 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800017f0 con 0x7f4a88159890 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78011420 con 0x7f4a88159890 2023-10-07T09:10:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.335+0000 7f4a85d9b700 1 -- 172.21.15.46:0/199803620 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780117c0 con 0x7f4a88159890 2023-10-07T09:10:02.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/199803620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88159890 msgr2=0x7f4a8815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/199803620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88159890 0x7f4a8815abd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4a780098e0 tx=0x7f4a780091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/199803620 shutdown_connections 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/199803620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88159890 0x7f4a8815abd0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/199803620 >> 172.21.15.46:0/199803620 conn(0x7f4a88068e20 msgr2=0x7f4a880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/199803620 shutdown_connections 2023-10-07T09:10:02.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.336+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/199803620 wait complete. 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.337+0000 7f4a8d0ea700 1 Processor -- start 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.337+0000 7f4a8d0ea700 1 -- start start 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88069560 0x7f4a880b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 0x7f4a88152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b5dc0 con 0x7f4a88159c60 2023-10-07T09:10:02.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b4140 con 0x7f4a88069560 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8d0ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b5ae0 con 0x7f4a88159890 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57816/0 (socket says 172.21.15.46:57816) 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 -- 172.21.15.46:0/1954701175 learned_addr learned my addr 172.21.15.46:0/1954701175 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a86d9d700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88069560 0x7f4a880b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8659c700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 0x7f4a88152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 -- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 msgr2=0x7f4a88152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 0x7f4a88152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 -- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88069560 msgr2=0x7f4a880b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88069560 0x7f4a880b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 -- 172.21.15.46:0/1954701175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78009420 con 0x7f4a88159c60 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8659c700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 0x7f4a88152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a8759e700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cb90 tx=0x7f4a80007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.338+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80004dc0 con 0x7f4a88159c60 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.339+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8000a6a0 con 0x7f4a88159c60 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.339+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8815bc10 con 0x7f4a88159c60 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.339+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000aa60 con 0x7f4a88159c60 2023-10-07T09:10:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.339+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8815c1d0 con 0x7f4a88159c60 2023-10-07T09:10:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.340+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8815c3f0 con 0x7f4a88159c60 2023-10-07T09:10:02.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.340+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a80007150 con 0x7f4a88159c60 2023-10-07T09:10:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.340+0000 7f4a7effd700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 0x7f4a680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.340+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f4a80084750 con 0x7f4a88159c60 2023-10-07T09:10:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.340+0000 7f4a86d9d700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 0x7f4a680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.341+0000 7f4a86d9d700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 0x7f4a680697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4a780091e0 tx=0x7f4a78016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.344+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a80051490 con 0x7f4a88159c60 2023-10-07T09:10:02.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.580+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a8804c3c0 con 0x7f4a88159c60 2023-10-07T09:10:02.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.580+0000 7f4a7effd700 1 -- 172.21.15.46:0/1954701175 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f4a80018020 con 0x7f4a88159c60 2023-10-07T09:10:02.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:02.582 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:10:02.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 msgr2=0x7f4a680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 0x7f4a680697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4a780091e0 tx=0x7f4a78016000 comp rx=0 tx=0).stop 2023-10-07T09:10:02.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 msgr2=0x7f4a880ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cb90 tx=0x7f4a80007ca0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 shutdown_connections 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4a68067320 0x7f4a680697d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a88159c60 0x7f4a880ce320 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a88069560 0x7f4a880b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 --2- 172.21.15.46:0/1954701175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a88159890 0x7f4a88152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 >> 172.21.15.46:0/1954701175 conn(0x7f4a88068e20 msgr2=0x7f4a880cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 shutdown_connections 2023-10-07T09:10:02.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.583+0000 7f4a8d0ea700 1 -- 172.21.15.46:0/1954701175 wait complete. 2023-10-07T09:10:02.586 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 135 2023-10-07T09:10:02.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:10:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 Processor -- start 2023-10-07T09:10:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 -- start start 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45340caa90 0x7f45340c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453415d7e0 con 0x7f453406bcd0 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453415dac0 con 0x7f453406c0a0 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.714+0000 7f4539479700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340caef0 con 0x7f45340caa90 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f45337fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45340caa90 0x7f45340c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4532ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f453406bcd0 0x7f453415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46560/0 (socket says 172.21.15.46:46560) 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4532ffd700 1 -- 172.21.15.46:0/1985916144 learned_addr learned my addr 172.21.15.46:0/1985916144 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426240929 0 0) 0x7f453415d7e0 con 0x7f453406bcd0 2023-10-07T09:10:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003570 con 0x7f453406bcd0 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f45337fe700 1 -- 172.21.15.46:0/1985916144 >> v1:172.21.15.133:6789/0 conn(0x7f453406c0a0 legacy=0x7f453415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513166684 0 0) 0x7f453415dac0 con 0x7f453406c0a0 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f45337fe700 1 -- 172.21.15.46:0/1985916144 >> v1:172.21.15.46:6789/0 conn(0x7f453406bcd0 legacy=0x7f453415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f45337fe700 1 -- 172.21.15.46:0/1985916144 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453415aa30 con 0x7f45340caa90 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f45337fe700 1 --2- 172.21.15.46:0/1985916144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45340caa90 0x7f45340c8c40 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9efc09c0f1ff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400b640 con 0x7f45340caa90 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452400b7a0 con 0x7f45340caa90 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.715+0000 7f4531ffb700 1 -- 172.21.15.46:0/1985916144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400bb40 con 0x7f45340caa90 2023-10-07T09:10:02.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 -- 172.21.15.46:0/1985916144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45340caa90 msgr2=0x7f45340c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 --2- 172.21.15.46:0/1985916144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45340caa90 0x7f45340c8c40 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 -- 172.21.15.46:0/1985916144 shutdown_connections 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 --2- 172.21.15.46:0/1985916144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45340caa90 0x7f45340c8c40 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 -- 172.21.15.46:0/1985916144 >> 172.21.15.46:0/1985916144 conn(0x7f45340ce600 msgr2=0x7f45340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 -- 172.21.15.46:0/1985916144 shutdown_connections 2023-10-07T09:10:02.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.716+0000 7f4539479700 1 -- 172.21.15.46:0/1985916144 wait complete. 2023-10-07T09:10:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.717+0000 7f4539479700 1 Processor -- start 2023-10-07T09:10:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.717+0000 7f4539479700 1 -- start start 2023-10-07T09:10:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f453406c0a0 0x7f45340b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45340caa90 0x7f4534155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b0740 con 0x7f453406bcd0 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b1e00 con 0x7f453406c0a0 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4539479700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b14d0 con 0x7f45340caa90 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57848/0 (socket says 172.21.15.46:57848) 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 -- 172.21.15.46:0/2804197195 learned_addr learned my addr 172.21.15.46:0/2804197195 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f45327fc700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f453406c0a0 0x7f45340b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 -- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45340caa90 msgr2=0x7f4534155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45340caa90 0x7f4534155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 -- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f453406c0a0 msgr2=0x7f45340b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f453406c0a0 0x7f45340b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 -- 172.21.15.46:0/2804197195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524009420 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f4532ffd700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f452c00cc40 tx=0x7f452c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.718+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00a980 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.719+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00aae0 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.719+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340b17b0 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.719+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00ae80 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.719+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45340b2290 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.720+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453404c3c0 con 0x7f453406bcd0 2023-10-07T09:10:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.720+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f452c007300 con 0x7f453406bcd0 2023-10-07T09:10:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.720+0000 7f452affd700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 0x7f45140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.721+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f452c085090 con 0x7f453406bcd0 2023-10-07T09:10:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.721+0000 7f45327fc700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 0x7f45140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.721+0000 7f45327fc700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 0x7f45140697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f451c001720 tx=0x7f451c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.725+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f452c051d50 con 0x7f453406bcd0 2023-10-07T09:10:02.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.919+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f453415ad10 con 0x7f453406bcd0 2023-10-07T09:10:02.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.920+0000 7f452affd700 1 -- 172.21.15.46:0/2804197195 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f452c055370 con 0x7f453406bcd0 2023-10-07T09:10:02.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:02.922 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":201,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:08:28.069963+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.19","mappings":[{"from":0,"to":1}]},{"pgid":"34.25","mappings":[{"from":0,"to":2}]},{"pgid":"34.32","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:10:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 msgr2=0x7f45140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 0x7f45140697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f451c001720 tx=0x7f451c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 msgr2=0x7f45340b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f452c00cc40 tx=0x7f452c001a60 comp rx=0 tx=0).stop 2023-10-07T09:10:02.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 shutdown_connections 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f4514067320 0x7f45140697d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45340caa90 0x7f4534155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453406bcd0 0x7f45340b00a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 --2- 172.21.15.46:0/2804197195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f453406c0a0 0x7f45340b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 >> 172.21.15.46:0/2804197195 conn(0x7f45340ce600 msgr2=0x7f453406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 shutdown_connections 2023-10-07T09:10:02.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:02.922+0000 7f4539479700 1 -- 172.21.15.46:0/2804197195 wait complete. 2023-10-07T09:10:02.936 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:10:02.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:10:03.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.054+0000 7f55b7993700 1 Processor -- start 2023-10-07T09:10:03.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.054+0000 7f55b7993700 1 -- start start 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b7993700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55b0069d60 0x7f55b00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b7993700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55b00c81f0 0x7f55b00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b7993700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b006bdb0 con 0x7f55b00aca80 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b7993700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00cb370 con 0x7f55b00c81f0 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b7993700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b0159f60 con 0x7f55b0069d60 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b5f30700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55b00c81f0 0x7f55b00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b572f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f55b00aca80 0x7f55b006aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46564/0 (socket says 172.21.15.46:46564) 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.055+0000 7f55b572f700 1 -- 172.21.15.46:0/99305532 learned_addr learned my addr 172.21.15.46:0/99305532 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b4f2e700 1 --2- 172.21.15.46:0/99305532 >> v2:172.21.15.133:3300/0 conn(0x7f55b0069d60 0x7f55b00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b5f30700 1 -- 172.21.15.46:0/99305532 >> v2:172.21.15.133:3300/0 conn(0x7f55b0069d60 msgr2=0x7f55b00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b5f30700 1 --2- 172.21.15.46:0/99305532 >> v2:172.21.15.133:3300/0 conn(0x7f55b0069d60 0x7f55b00c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b5f30700 1 -- 172.21.15.46:0/99305532 >> v1:172.21.15.46:6789/0 conn(0x7f55b00aca80 legacy=0x7f55b006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b5f30700 1 -- 172.21.15.46:0/99305532 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b006b2b0 con 0x7f55b00c81f0 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55affff700 1 -- 172.21.15.46:0/99305532 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986727824 0 0) 0x7f55b006bdb0 con 0x7f55b00aca80 2023-10-07T09:10:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55b5f30700 1 --2- 172.21.15.46:0/99305532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00c81f0 0x7f55b00cb800 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f55b006e540 tx=0x7f55a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c50510b68b10094 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55affff700 1 -- 172.21.15.46:0/99305532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000e070 con 0x7f55b00c81f0 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55affff700 1 -- 172.21.15.46:0/99305532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000bc30 con 0x7f55b00c81f0 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.056+0000 7f55affff700 1 -- 172.21.15.46:0/99305532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0012430 con 0x7f55b00c81f0 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 -- 172.21.15.46:0/99305532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00c81f0 msgr2=0x7f55b00cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 --2- 172.21.15.46:0/99305532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00c81f0 0x7f55b00cb800 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f55b006e540 tx=0x7f55a0009780 comp rx=0 tx=0).stop 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 -- 172.21.15.46:0/99305532 shutdown_connections 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 --2- 172.21.15.46:0/99305532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00c81f0 0x7f55b00cb800 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 --2- 172.21.15.46:0/99305532 >> v2:172.21.15.133:3300/0 conn(0x7f55b0069d60 0x7f55b00c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 -- 172.21.15.46:0/99305532 >> 172.21.15.46:0/99305532 conn(0x7f55b00cd670 msgr2=0x7f55b00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 -- 172.21.15.46:0/99305532 shutdown_connections 2023-10-07T09:10:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.057+0000 7f55b7993700 1 -- 172.21.15.46:0/99305532 wait complete. 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.058+0000 7f55b7993700 1 Processor -- start 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.058+0000 7f55b7993700 1 -- start start 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 0x7f55b0159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55b00c81f0 0x7f55b00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b015eb60 con 0x7f55b00aca80 2023-10-07T09:10:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b015eff0 con 0x7f55b0069d60 2023-10-07T09:10:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b7993700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b015df50 con 0x7f55b00c81f0 2023-10-07T09:10:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57858/0 (socket says 172.21.15.46:57858) 2023-10-07T09:10:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 -- 172.21.15.46:0/4132047750 learned_addr learned my addr 172.21.15.46:0/4132047750 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b572f700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 0x7f55b0159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b5f30700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55b00c81f0 0x7f55b00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 -- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55b00c81f0 msgr2=0x7f55b00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55b00c81f0 0x7f55b00b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 -- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 msgr2=0x7f55b0159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 0x7f55b0159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 -- 172.21.15.46:0/4132047750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0009a20 con 0x7f55b00aca80 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b572f700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 0x7f55b0159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.059+0000 7f55b4f2e700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f55a400d860 tx=0x7f55a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.060+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a40125f0 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.060+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4012750 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.060+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b015e230 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.060+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4012ad0 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.060+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b015e7f0 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.061+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b015ecd0 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.061+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55a401e460 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.061+0000 7f55ad7fa700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 0x7f559c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.061+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f55a4085380 con 0x7f55b00aca80 2023-10-07T09:10:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.062+0000 7f55b572f700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 0x7f559c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.062+0000 7f55b572f700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 0x7f559c0697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001360 tx=0x7f55a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.066+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a4055a50 con 0x7f55b00aca80 2023-10-07T09:10:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.301+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55b004c3c0 con 0x7f55b00aca80 2023-10-07T09:10:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.302+0000 7f55ad7fa700 1 -- 172.21.15.46:0/4132047750 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f55a40555e0 con 0x7f55b00aca80 2023-10-07T09:10:03.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:03.303 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:10:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.303+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 msgr2=0x7f559c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.303+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 0x7f559c0697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001360 tx=0x7f55a8009040 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.303+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 msgr2=0x7f55b015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.303+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f55a400d860 tx=0x7f55a4008040 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 shutdown_connections 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f559c067320 0x7f559c0697d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55b00c81f0 0x7f55b00b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b0069d60 0x7f55b0159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 --2- 172.21.15.46:0/4132047750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55b00aca80 0x7f55b015d5e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 >> 172.21.15.46:0/4132047750 conn(0x7f55b00cd670 msgr2=0x7f55b00cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 shutdown_connections 2023-10-07T09:10:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.304+0000 7f55b7993700 1 -- 172.21.15.46:0/4132047750 wait complete. 2023-10-07T09:10:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 135 2023-10-07T09:10:03.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:10:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.435+0000 7f7529088700 1 Processor -- start 2023-10-07T09:10:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.435+0000 7f7529088700 1 -- start start 2023-10-07T09:10:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7529088700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7524159890 0x7f752415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7529088700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752415a160 con 0x7f7524069560 2023-10-07T09:10:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7529088700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240d13a0 con 0x7f7524159c60 2023-10-07T09:10:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7529088700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752415e140 con 0x7f7524159890 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7522d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7524159890 0x7f752415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7522d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7524159890 0x7f752415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57872/0 (socket says 172.21.15.46:57872) 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.436+0000 7f7522d9d700 1 -- 172.21.15.46:0/1427485 learned_addr learned my addr 172.21.15.46:0/1427485 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7522d9d700 1 -- 172.21.15.46:0/1427485 >> v1:172.21.15.133:6789/0 conn(0x7f7524159c60 legacy=0x7f752415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7522d9d700 1 -- 172.21.15.46:0/1427485 >> v1:172.21.15.46:6789/0 conn(0x7f7524069560 legacy=0x7f75240ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7521d9b700 1 -- 172.21.15.46:0/1427485 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184836964 0 0) 0x7f752415a160 con 0x7f7524069560 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7522d9d700 1 -- 172.21.15.46:0/1427485 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752415a3d0 con 0x7f7524159890 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7522d9d700 1 --2- 172.21.15.46:0/1427485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f752415abd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f751c009930 tx=0x7f751c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e148e72b6d76d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7521d9b700 1 -- 172.21.15.46:0/1427485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00b7e0 con 0x7f7524159890 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7521d9b700 1 -- 172.21.15.46:0/1427485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00b940 con 0x7f7524159890 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7521d9b700 1 -- 172.21.15.46:0/1427485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00bce0 con 0x7f7524159890 2023-10-07T09:10:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7529088700 1 -- 172.21.15.46:0/1427485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 msgr2=0x7f752415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7529088700 1 --2- 172.21.15.46:0/1427485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f752415abd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f751c009930 tx=0x7f751c009250 comp rx=0 tx=0).stop 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7529088700 1 -- 172.21.15.46:0/1427485 shutdown_connections 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7529088700 1 --2- 172.21.15.46:0/1427485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f752415abd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.437+0000 7f7529088700 1 -- 172.21.15.46:0/1427485 >> 172.21.15.46:0/1427485 conn(0x7f7524068e20 msgr2=0x7f75240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.438+0000 7f7529088700 1 -- 172.21.15.46:0/1427485 shutdown_connections 2023-10-07T09:10:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.438+0000 7f7529088700 1 -- 172.21.15.46:0/1427485 wait complete. 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 Processor -- start 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 -- start start 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7524069560 0x7f75240cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7524159c60 0x7f7524157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240ceae0 con 0x7f7524159890 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240ce520 con 0x7f7524069560 2023-10-07T09:10:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.439+0000 7f7529088700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240ce800 con 0x7f7524159c60 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57874/0 (socket says 172.21.15.46:57874) 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 -- 172.21.15.46:0/3237864736 learned_addr learned my addr 172.21.15.46:0/3237864736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f7522d9d700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7524069560 0x7f75240cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752359e700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7524159c60 0x7f7524157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 -- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7524159c60 msgr2=0x7f7524157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7524159c60 0x7f7524157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 -- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7524069560 msgr2=0x7f75240cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7524069560 0x7f75240cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 -- 172.21.15.46:0/3237864736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0094f0 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f752259c700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c810 tx=0x7f750c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c012630 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0127d0 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240b3730 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c012b90 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.440+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524155e60 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.441+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240b3c50 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.442+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f750c01b400 con 0x7f7524159890 2023-10-07T09:10:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.442+0000 7f751affd700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 0x7f75040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.442+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f750c084a60 con 0x7f7524159890 2023-10-07T09:10:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.442+0000 7f7522d9d700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 0x7f75040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.443+0000 7f7522d9d700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 0x7f75040697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f751c009930 tx=0x7f751c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.446+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75240b3c50 con 0x7f7524159890 2023-10-07T09:10:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.684+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75240b3c50 con 0x7f7524159890 2023-10-07T09:10:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.684+0000 7f751affd700 1 -- 172.21.15.46:0/3237864736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f75240b3c50 con 0x7f7524159890 2023-10-07T09:10:03.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:03.686 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T09:07:49.389948+0000","modified":"2023-10-07T09:07:53.004129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9036":{"gid":9036,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1322977630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322977630},{"type":"v1","addr":"172.21.15.46:6835","nonce":1322977630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-07T09:10:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 msgr2=0x7f75040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 0x7f75040697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f751c009930 tx=0x7f751c016000 comp rx=0 tx=0).stop 2023-10-07T09:10:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 msgr2=0x7f7524157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c810 tx=0x7f750c007f30 comp rx=0 tx=0).stop 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 shutdown_connections 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7504067320 0x7f75040697d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7524159c60 0x7f7524157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7524069560 0x7f75240cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 --2- 172.21.15.46:0/3237864736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7524159890 0x7f7524157600 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.686+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 >> 172.21.15.46:0/3237864736 conn(0x7f7524068e20 msgr2=0x7f7524152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.687+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 shutdown_connections 2023-10-07T09:10:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.687+0000 7f7529088700 1 -- 172.21.15.46:0/3237864736 wait complete. 2023-10-07T09:10:03.690 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 135 2023-10-07T09:10:03.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:10:03.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.817+0000 7fbccecba700 1 Processor -- start 2023-10-07T09:10:03.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.817+0000 7fbccecba700 1 -- start start 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.818+0000 7fbccecba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.818+0000 7fbccecba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.818+0000 7fbccecba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc8069ee0 con 0x7fbcc8159c60 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.818+0000 7fbccecba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc815a160 con 0x7fbcc8159890 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.818+0000 7fbccecba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80d13a0 con 0x7fbcc8069560 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccca56700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:42150/0 (socket says 172.21.15.46:42150) 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 -- 172.21.15.46:0/445402309 learned_addr learned my addr 172.21.15.46:0/445402309 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccca56700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.46:60596/0 (socket says 172.21.15.46:60596) 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 -- 172.21.15.46:0/445402309 >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 msgr2=0x7fbcc815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 --2- 172.21.15.46:0/445402309 >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 -- 172.21.15.46:0/445402309 >> v1:172.21.15.133:6789/0 conn(0x7fbcc8159c60 legacy=0x7fbcc815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 -- 172.21.15.46:0/445402309 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc815e140 con 0x7fbcc8069560 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccca56700 1 --2- 172.21.15.46:0/445402309 >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbccd257700 1 --2- 172.21.15.46:0/445402309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00099b0 tx=0x7fbcb0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac35c7434cbc810 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbcc77fe700 1 -- 172.21.15.46:0/445402309 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0009ea0 con 0x7fbcc8069560 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.819+0000 7fbcc77fe700 1 -- 172.21.15.46:0/445402309 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb000b860 con 0x7fbcc8069560 2023-10-07T09:10:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbcc77fe700 1 -- 172.21.15.46:0/445402309 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000bc00 con 0x7fbcc8069560 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 -- 172.21.15.46:0/445402309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 msgr2=0x7fbcc80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 --2- 172.21.15.46:0/445402309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00099b0 tx=0x7fbcb0009250 comp rx=0 tx=0).stop 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 -- 172.21.15.46:0/445402309 shutdown_connections 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 --2- 172.21.15.46:0/445402309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8069560 0x7fbcc80699a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 --2- 172.21.15.46:0/445402309 >> v2:172.21.15.133:3300/0 conn(0x7fbcc8159890 0x7fbcc815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 -- 172.21.15.46:0/445402309 >> 172.21.15.46:0/445402309 conn(0x7fbcc8068e20 msgr2=0x7fbcc80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 -- 172.21.15.46:0/445402309 shutdown_connections 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.820+0000 7fbccecba700 1 -- 172.21.15.46:0/445402309 wait complete. 2023-10-07T09:10:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.821+0000 7fbccecba700 1 Processor -- start 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.821+0000 7fbccecba700 1 -- start start 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcc8159890 0x7fbcc8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8159c60 0x7fbcc816cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8151fa0 con 0x7fbcc8069560 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8151390 con 0x7fbcc8159890 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccecba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8151670 con 0x7fbcc8159c60 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57888/0 (socket says 172.21.15.46:57888) 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 -- 172.21.15.46:0/3478670620 learned_addr learned my addr 172.21.15.46:0/3478670620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbcc7fff700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcc8159890 0x7fbcc8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccd257700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8159c60 0x7fbcc816cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 -- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8159c60 msgr2=0x7fbcc816cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8159c60 0x7fbcc816cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 -- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcc8159890 msgr2=0x7fbcc8152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcc8159890 0x7fbcc8152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.822+0000 7fbccca56700 1 -- 172.21.15.46:0/3478670620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009420 con 0x7fbcc8069560 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbccca56700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ec80 tx=0x7fbcc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000c920 con 0x7fbcc8069560 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000ca80 con 0x7fbcc8069560 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb00094f0 con 0x7fbcc8069560 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000ce00 con 0x7fbcc8069560 2023-10-07T09:10:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.823+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc8151c30 con 0x7fbcc8069560 2023-10-07T09:10:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.824+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc804c3c0 con 0x7fbcc8069560 2023-10-07T09:10:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.824+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbcc0013680 con 0x7fbcc8069560 2023-10-07T09:10:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.825+0000 7fbcc4ff9700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 0x7fbca80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.825+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fbcc00853b0 con 0x7fbcc8069560 2023-10-07T09:10:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.825+0000 7fbcc7fff700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 0x7fbca80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.825+0000 7fbcc7fff700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 0x7fbca80697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80cdcf0 tx=0x7fbcb80016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:03.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:03.829+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcc0051ff0 con 0x7fbcc8069560 2023-10-07T09:10:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.024+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcc8152280 con 0x7fbcc8069560 2023-10-07T09:10:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.025+0000 7fbcc4ff9700 1 -- 172.21.15.46:0/3478670620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15510 (secure 0 0 0) 0x7fbcc0055610 con 0x7fbcc8069560 2023-10-07T09:10:04.027 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:04.027 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":201,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:08:28.069963+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-07T09:07:47.201984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-07T09:07:48.362022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.19","mappings":[{"from":0,"to":1}]},{"pgid":"34.25","mappings":[{"from":0,"to":2}]},{"pgid":"34.32","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:10:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 msgr2=0x7fbca80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 0x7fbca80697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80cdcf0 tx=0x7fbcb80016f0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 msgr2=0x7fbcc80c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ec80 tx=0x7fbcc00091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 shutdown_connections 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbca8067320 0x7fbca80697d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcc8159c60 0x7fbcc816cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcc8069560 0x7fbcc80c68f0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 --2- 172.21.15.46:0/3478670620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcc8159890 0x7fbcc8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 >> 172.21.15.46:0/3478670620 conn(0x7fbcc8068e20 msgr2=0x7fbcc8157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 shutdown_connections 2023-10-07T09:10:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.027+0000 7fbccecba700 1 -- 172.21.15.46:0/3478670620 wait complete. 2023-10-07T09:10:04.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T09:10:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.159+0000 7f1462f3a700 1 Processor -- start 2023-10-07T09:10:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.159+0000 7f1462f3a700 1 -- start start 2023-10-07T09:10:04.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f1462f3a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 0x7f145c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f1462f3a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c15a160 con 0x7f145c15db10 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f1462f3a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c0d13a0 con 0x7f145c159890 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f1462f3a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c15e140 con 0x7f145c159c60 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f14614d7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f145c15db10 0x7f145c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46584/0 (socket says 172.21.15.46:46584) 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.160+0000 7f14614d7700 1 -- 172.21.15.46:0/781622641 learned_addr learned my addr 172.21.15.46:0/781622641 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145bfff700 1 --2- 172.21.15.46:0/781622641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 0x7f145c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828176255 0 0) 0x7f145c15a160 con 0x7f145c15db10 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1448003570 con 0x7f145c15db10 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578614228 0 0) 0x7f145c0d13a0 con 0x7f145c159890 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c15a160 con 0x7f145c159890 2023-10-07T09:10:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962003768 0 0) 0x7f1448003570 con 0x7f145c15db10 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145bfff700 1 -- 172.21.15.46:0/781622641 >> v1:172.21.15.133:6789/0 conn(0x7f145c159890 legacy=0x7f145c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145bfff700 1 -- 172.21.15.46:0/781622641 >> v1:172.21.15.46:6789/0 conn(0x7f145c15db10 legacy=0x7f145c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145bfff700 1 -- 172.21.15.46:0/781622641 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c15a3d0 con 0x7f145c159c60 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145bfff700 1 --2- 172.21.15.46:0/781622641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 0x7f145c15d5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1444009910 tx=0x7f14440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e1c202e18bf6d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454001770 con 0x7f145c159c60 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444011420 con 0x7f145c159c60 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.161+0000 7f145b7fe700 1 -- 172.21.15.46:0/781622641 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440117a0 con 0x7f145c159c60 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 -- 172.21.15.46:0/781622641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 msgr2=0x7f145c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 --2- 172.21.15.46:0/781622641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 0x7f145c15d5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1444009910 tx=0x7f14440091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 -- 172.21.15.46:0/781622641 shutdown_connections 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 --2- 172.21.15.46:0/781622641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159c60 0x7f145c15d5d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 -- 172.21.15.46:0/781622641 >> 172.21.15.46:0/781622641 conn(0x7f145c068e20 msgr2=0x7f145c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:04.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 -- 172.21.15.46:0/781622641 shutdown_connections 2023-10-07T09:10:04.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.162+0000 7f1462f3a700 1 -- 172.21.15.46:0/781622641 wait complete. 2023-10-07T09:10:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.163+0000 7f1462f3a700 1 Processor -- start 2023-10-07T09:10:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.163+0000 7f1462f3a700 1 -- start start 2023-10-07T09:10:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 0x7f145c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 0x7f145c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c151130 con 0x7f145c159c60 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0ce0d0 con 0x7f145c15db10 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1462f3a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0b1b50 con 0x7f145c159890 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57894/0 (socket says 172.21.15.46:57894) 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 -- 172.21.15.46:0/1952628034 learned_addr learned my addr 172.21.15.46:0/1952628034 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f14614d7700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 0x7f145c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1460cd6700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 0x7f145c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 -- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 msgr2=0x7f145c1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 0x7f145c1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 -- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 msgr2=0x7f145c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 0x7f145c0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f145bfff700 1 -- 172.21.15.46:0/1952628034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444009420 con 0x7f145c159c60 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f1460cd6700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 0x7f145c1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.164+0000 7f14614d7700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 0x7f145c0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f145bfff700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f1444009860 tx=0x7f1444016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144401cc50 con 0x7f145c159c60 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144401cdb0 con 0x7f145c159c60 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144401a6a0 con 0x7f145c159c60 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0b1e30 con 0x7f145c159c60 2023-10-07T09:10:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.165+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c150dc0 con 0x7f145c159c60 2023-10-07T09:10:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.166+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c0b1ff0 con 0x7f145c159c60 2023-10-07T09:10:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.166+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f144401aad0 con 0x7f145c159c60 2023-10-07T09:10:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.167+0000 7f1458ff9700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 0x7f143c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.167+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1444086700 con 0x7f145c159c60 2023-10-07T09:10:04.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.167+0000 7f1460cd6700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 0x7f143c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.168+0000 7f1460cd6700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 0x7f143c0697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f144c0010e0 tx=0x7f144c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.171+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1444053300 con 0x7f145c159c60 2023-10-07T09:10:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.411+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f145c1512e0 con 0x7f145c159c60 2023-10-07T09:10:04.413 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-10-07T09:10:04.411+0000 7f8e2840c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T09:10:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.416+0000 7f1458ff9700 1 -- 172.21.15.46:0/1952628034 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v136) v1 ==== 161+0+0 (secure 0 0 0) 0x7f145c1512e0 con 0x7f145c159c60 2023-10-07T09:10:04.420 INFO:tasks.ceph.mds.a.smithi046.stderr: -3298> 2023-10-07T09:07:54.966+0000 7fcc0eced700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T09:10:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 msgr2=0x7f143c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 0x7f143c0697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f144c0010e0 tx=0x7f144c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 msgr2=0x7f145c0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f1444009860 tx=0x7f1444016000 comp rx=0 tx=0).stop 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 shutdown_connections 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f143c067320 0x7f143c0697d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c15db10 0x7f145c0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f145c159890 0x7f145c1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 --2- 172.21.15.46:0/1952628034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f145c159c60 0x7f145c0b0f90 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.419+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 >> 172.21.15.46:0/1952628034 conn(0x7f145c068e20 msgr2=0x7f145c155130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.420+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 shutdown_connections 2023-10-07T09:10:04.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.420+0000 7f1462f3a700 1 -- 172.21.15.46:0/1952628034 wait complete. 2023-10-07T09:10:04.423 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T09:10:04.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T09:10:04.445 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-10-07T09:10:04.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.554+0000 7f85324d0700 1 Processor -- start 2023-10-07T09:10:04.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.554+0000 7f85324d0700 1 -- start start 2023-10-07T09:10:04.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f85324d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 0x7f852c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f85324d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f85324d0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c15a160 con 0x7f852c15db10 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f85324d0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0d13a0 con 0x7f852c159890 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f85324d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c15e140 con 0x7f852c159c60 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 0x7f852c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:42192/0 (socket says 172.21.15.46:42192) 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f8530a6d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f852c15db10 0x7f852c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:37882/0 (socket says 172.21.15.46:37882) 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 -- 172.21.15.46:0/3758960750 learned_addr learned my addr 172.21.15.46:0/3758960750 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 -- 172.21.15.46:0/3758960750 >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 msgr2=0x7f852c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 --2- 172.21.15.46:0/3758960750 >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 0x7f852c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 -- 172.21.15.46:0/3758960750 >> v1:172.21.15.133:6789/0 conn(0x7f852c15db10 legacy=0x7f852c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852b7fe700 1 -- 172.21.15.46:0/3758960750 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c15a3d0 con 0x7f852c159c60 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.555+0000 7f852bfff700 1 --2- 172.21.15.46:0/3758960750 >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 0x7f852c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f852b7fe700 1 --2- 172.21.15.46:0/3758960750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85140099b0 tx=0x7f8514009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb94e5840a85e9c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f852affd700 1 -- 172.21.15.46:0/3758960750 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514009ea0 con 0x7f852c159c60 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f852affd700 1 -- 172.21.15.46:0/3758960750 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400b860 con 0x7f852c159c60 2023-10-07T09:10:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f852affd700 1 -- 172.21.15.46:0/3758960750 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400bc00 con 0x7f852c159c60 2023-10-07T09:10:04.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 -- 172.21.15.46:0/3758960750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 msgr2=0x7f852c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 --2- 172.21.15.46:0/3758960750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85140099b0 tx=0x7f8514009250 comp rx=0 tx=0).stop 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 -- 172.21.15.46:0/3758960750 shutdown_connections 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 --2- 172.21.15.46:0/3758960750 >> v2:172.21.15.133:3300/0 conn(0x7f852c159890 0x7f852c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 --2- 172.21.15.46:0/3758960750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c15d5d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 -- 172.21.15.46:0/3758960750 >> 172.21.15.46:0/3758960750 conn(0x7f852c068e20 msgr2=0x7f852c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 -- 172.21.15.46:0/3758960750 shutdown_connections 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.556+0000 7f85324d0700 1 -- 172.21.15.46:0/3758960750 wait complete. 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.557+0000 7f85324d0700 1 Processor -- start 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 -- start start 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c159890 0x7f852c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0b4d40 con 0x7f852c15db10 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c16e180 con 0x7f852c159890 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.558+0000 7f85324d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0b38e0 con 0x7f852c159c60 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57930/0 (socket says 172.21.15.46:57930) 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 -- 172.21.15.46:0/3291123044 learned_addr learned my addr 172.21.15.46:0/3291123044 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f852bfff700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c159890 0x7f852c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f852b7fe700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 -- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 msgr2=0x7f852c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 -- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c159890 msgr2=0x7f852c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c159890 0x7f852c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 -- 172.21.15.46:0/3291123044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009420 con 0x7f852c15db10 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8530a6d700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f852400cca0 tx=0x7f8524001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524005df0 con 0x7f852c15db10 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852400a5f0 con 0x7f852c15db10 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140094f0 con 0x7f852c15db10 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852400a970 con 0x7f852c15db10 2023-10-07T09:10:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.559+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c16d6a0 con 0x7f852c15db10 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.560+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c04c3c0 con 0x7f852c15db10 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.561+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f852400ad20 con 0x7f852c15db10 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.561+0000 7f8523fff700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 0x7f850c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.561+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f8524084c70 con 0x7f852c15db10 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.561+0000 7f852bfff700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 0x7f850c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.562+0000 7f852bfff700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 0x7f850c0697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f851c009f40 tx=0x7f851c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.565+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85240518d0 con 0x7f852c15db10 2023-10-07T09:10:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:04.802+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f852c06a5b0 con 0x7f852c15db10 2023-10-07T09:10:05.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.416+0000 7f8523fff700 1 -- 172.21.15.46:0/3291123044 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v137) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8524054ef0 con 0x7f852c15db10 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 msgr2=0x7f850c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 0x7f850c0697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f851c009f40 tx=0x7f851c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 msgr2=0x7f852c0b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f852400cca0 tx=0x7f8524001a70 comp rx=0 tx=0).stop 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 shutdown_connections 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f850c067320 0x7f850c0697d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f852c15db10 0x7f852c0b46c0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c159890 0x7f852c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 --2- 172.21.15.46:0/3291123044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f852c159c60 0x7f852c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 >> 172.21.15.46:0/3291123044 conn(0x7f852c068e20 msgr2=0x7f852c158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:05.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 shutdown_connections 2023-10-07T09:10:05.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.419+0000 7f85324d0700 1 -- 172.21.15.46:0/3291123044 wait complete. 2023-10-07T09:10:05.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T09:10:05.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.606+0000 7f2321ef1700 1 Processor -- start 2023-10-07T09:10:05.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.606+0000 7f2321ef1700 1 -- start start 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f2321ef1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f231c159ec0 0x7f231c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f2321ef1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c0cf350 0x7f231c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f2321ef1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0b5b00 con 0x7f231c0b53d0 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f2321ef1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0b5850 con 0x7f231c159ec0 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f2321ef1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c0b5da0 con 0x7f231c0cf350 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.607+0000 7f231b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f231c159ec0 0x7f231c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f231c0b53d0 0x7f231c0cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46602/0 (socket says 172.21.15.46:46602) 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231affd700 1 -- 172.21.15.46:0/4077823251 learned_addr learned my addr 172.21.15.46:0/4077823251 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f231c159ec0 0x7f231c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57946/0 (socket says 172.21.15.46:57946) 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231bfff700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c0cf350 0x7f231c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 -- 172.21.15.46:0/4077823251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c0cf350 msgr2=0x7f231c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c0cf350 0x7f231c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 -- 172.21.15.46:0/4077823251 >> v1:172.21.15.46:6789/0 conn(0x7f231c0b53d0 legacy=0x7f231c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 -- 172.21.15.46:0/4077823251 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0b6080 con 0x7f231c159ec0 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231a7fc700 1 -- 172.21.15.46:0/4077823251 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339121581 0 0) 0x7f231c0b5b00 con 0x7f231c0b53d0 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231b7fe700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c159ec0 0x7f231c0b4e90 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f230c0098d0 tx=0x7f230c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ce9c485bb616c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231a7fc700 1 -- 172.21.15.46:0/4077823251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c005c10 con 0x7f231c159ec0 2023-10-07T09:10:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231a7fc700 1 -- 172.21.15.46:0/4077823251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c005d70 con 0x7f231c159ec0 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.608+0000 7f231a7fc700 1 -- 172.21.15.46:0/4077823251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c006280 con 0x7f231c159ec0 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 -- 172.21.15.46:0/4077823251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c159ec0 msgr2=0x7f231c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c159ec0 0x7f231c0b4e90 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f230c0098d0 tx=0x7f230c009120 comp rx=0 tx=0).stop 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 -- 172.21.15.46:0/4077823251 shutdown_connections 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c0cf350 0x7f231c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 --2- 172.21.15.46:0/4077823251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c159ec0 0x7f231c0b4e90 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 -- 172.21.15.46:0/4077823251 >> 172.21.15.46:0/4077823251 conn(0x7f231c0999f0 msgr2=0x7f231c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 -- 172.21.15.46:0/4077823251 shutdown_connections 2023-10-07T09:10:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.609+0000 7f2321ef1700 1 -- 172.21.15.46:0/4077823251 wait complete. 2023-10-07T09:10:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.610+0000 7f2321ef1700 1 Processor -- start 2023-10-07T09:10:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.610+0000 7f2321ef1700 1 -- start start 2023-10-07T09:10:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231c0b53d0 0x7f231c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 0x7f231c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c150760 con 0x7f231c0cf350 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c069380 con 0x7f231c0b53d0 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f2321ef1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c069660 con 0x7f231c159ec0 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57954/0 (socket says 172.21.15.46:57954) 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 -- 172.21.15.46:0/2922746853 learned_addr learned my addr 172.21.15.46:0/2922746853 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231b7fe700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231c0b53d0 0x7f231c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231bfff700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 0x7f231c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 -- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 msgr2=0x7f231c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 0x7f231c06a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 -- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231c0b53d0 msgr2=0x7f231c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231c0b53d0 0x7f231c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 -- 172.21.15.46:0/2922746853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0093c0 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231bfff700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 0x7f231c06a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.611+0000 7f231affd700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f231000c5b0 tx=0x7f2310001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.612+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310005b30 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.612+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310005c90 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.612+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c069940 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.612+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310007300 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.612+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c06ae20 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.613+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c063c90 con 0x7f231c0cf350 2023-10-07T09:10:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.613+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f231001b3b0 con 0x7f231c0cf350 2023-10-07T09:10:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.613+0000 7f23037fe700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 0x7f23080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.614+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f2310084250 con 0x7f231c0cf350 2023-10-07T09:10:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.614+0000 7f231b7fe700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 0x7f23080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.614+0000 7f231b7fe700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 0x7f23080697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f230c009160 tx=0x7f230c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.618+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2310050e30 con 0x7f231c0cf350 2023-10-07T09:10:05.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:05.809+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f231c0718b0 con 0x7f231c0cf350 2023-10-07T09:10:06.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.420+0000 7f23037fe700 1 -- 172.21.15.46:0/2922746853 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v203) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2310054450 con 0x7f231c0cf350 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 msgr2=0x7f23080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 0x7f23080697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f230c009160 tx=0x7f230c016000 comp rx=0 tx=0).stop 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 msgr2=0x7f231c150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f231000c5b0 tx=0x7f2310001070 comp rx=0 tx=0).stop 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 shutdown_connections 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2308067320 0x7f23080697d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f231c159ec0 0x7f231c06a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231c0b53d0 0x7f231c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 --2- 172.21.15.46:0/2922746853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f231c0cf350 0x7f231c150220 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 >> 172.21.15.46:0/2922746853 conn(0x7f231c0999f0 msgr2=0x7f231c151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:06.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 shutdown_connections 2023-10-07T09:10:06.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.424+0000 7f2321ef1700 1 -- 172.21.15.46:0/2922746853 wait complete. 2023-10-07T09:10:06.427 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-07T09:10:06.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T09:10:06.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.566+0000 7ff0daac4700 1 Processor -- start 2023-10-07T09:10:06.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.566+0000 7ff0daac4700 1 -- start start 2023-10-07T09:10:06.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 0x7ff0d40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d40cc970 0x7ff0d40697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 0x7ff0d406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d406aa30 con 0x7ff0d40cc970 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40cce10 con 0x7ff0d40cb560 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0daac4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4159db0 con 0x7ff0d4069cf0 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0d92c1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d40cc970 0x7ff0d40697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0d92c1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d40cc970 0x7ff0d40697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57960/0 (socket says 172.21.15.46:57960) 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.567+0000 7ff0d92c1700 1 -- 172.21.15.46:0/3503645773 learned_addr learned my addr 172.21.15.46:0/3503645773 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0da2c3700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 0x7ff0d406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d9ac2700 1 --2- 172.21.15.46:0/3503645773 >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 0x7ff0d40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 -- 172.21.15.46:0/3503645773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 msgr2=0x7ff0d406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 0x7ff0d406d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 -- 172.21.15.46:0/3503645773 >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 msgr2=0x7ff0d40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 --2- 172.21.15.46:0/3503645773 >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 0x7ff0d40cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 -- 172.21.15.46:0/3503645773 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d406a470 con 0x7ff0d40cc970 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0da2c3700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 0x7ff0d406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d9ac2700 1 --2- 172.21.15.46:0/3503645773 >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 0x7ff0d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d92c1700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40697b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80099b0 tx=0x7ff0c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992f01915566513b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d8ac0700 1 -- 172.21.15.46:0/3503645773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800b820 con 0x7ff0d40cc970 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d8ac0700 1 -- 172.21.15.46:0/3503645773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800b980 con 0x7ff0d40cc970 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0d8ac0700 1 -- 172.21.15.46:0/3503645773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800bd20 con 0x7ff0d40cc970 2023-10-07T09:10:06.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 -- 172.21.15.46:0/3503645773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 msgr2=0x7ff0d40697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40697b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80099b0 tx=0x7ff0c8009250 comp rx=0 tx=0).stop 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 -- 172.21.15.46:0/3503645773 shutdown_connections 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d4069cf0 0x7ff0d406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 --2- 172.21.15.46:0/3503645773 >> v2:172.21.15.133:3300/0 conn(0x7ff0d40cb560 0x7ff0d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 --2- 172.21.15.46:0/3503645773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40697b0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.568+0000 7ff0daac4700 1 -- 172.21.15.46:0/3503645773 >> 172.21.15.46:0/3503645773 conn(0x7ff0d406baf0 msgr2=0x7ff0d406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.569+0000 7ff0daac4700 1 -- 172.21.15.46:0/3503645773 shutdown_connections 2023-10-07T09:10:06.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.569+0000 7ff0daac4700 1 -- 172.21.15.46:0/3503645773 wait complete. 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 Processor -- start 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 -- start start 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d4069cf0 0x7ff0d4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d40cb560 0x7ff0d40c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c6400 con 0x7ff0d40cc970 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c5830 con 0x7ff0d4069cf0 2023-10-07T09:10:06.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.570+0000 7ff0daac4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c5ad0 con 0x7ff0d40cb560 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57972/0 (socket says 172.21.15.46:57972) 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 -- 172.21.15.46:0/2453521456 learned_addr learned my addr 172.21.15.46:0/2453521456 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0d92c1700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d40cb560 0x7ff0d40c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0d9ac2700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d4069cf0 0x7ff0d4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 -- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d40cb560 msgr2=0x7ff0d40c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d40cb560 0x7ff0d40c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 -- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d4069cf0 msgr2=0x7ff0d4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d4069cf0 0x7ff0d4154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 -- 172.21.15.46:0/2453521456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80094f0 con 0x7ff0d40cc970 2023-10-07T09:10:06.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0da2c3700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400cf60 tx=0x7ff0c4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400ae40 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4015440 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40c5db0 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.571+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4015800 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.572+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40c79a0 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.573+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d404c3c0 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.573+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff0c400d440 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.573+0000 7ff0d1ffb700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 0x7ff0c0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.573+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5440+0+0 (secure 0 0 0) 0x7ff0c40851f0 con 0x7ff0d40cc970 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.573+0000 7ff0d9ac2700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 0x7ff0c0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:06.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.574+0000 7ff0d9ac2700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 0x7ff0c0069800 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4158230 tx=0x7ff0cc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:06.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.578+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0c4051f90 con 0x7ff0d40cc970 2023-10-07T09:10:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:06.772+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0d406a750 con 0x7ff0d40cc970 2023-10-07T09:10:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.422+0000 7ff0d1ffb700 1 -- 172.21.15.46:0/2453521456 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v204) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0c40555b0 con 0x7ff0d40cc970 2023-10-07T09:10:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.428+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 msgr2=0x7ff0c0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.428+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 0x7ff0c0069800 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4158230 tx=0x7ff0cc006f90 comp rx=0 tx=0).stop 2023-10-07T09:10:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.428+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 msgr2=0x7ff0d40b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.428+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400cf60 tx=0x7ff0c4007870 comp rx=0 tx=0).stop 2023-10-07T09:10:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 shutdown_connections 2023-10-07T09:10:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff0c0067350 0x7ff0c0069800 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d40cc970 0x7ff0d40b33c0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d4069cf0 0x7ff0d4154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 --2- 172.21.15.46:0/2453521456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d40cb560 0x7ff0d40c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 >> 172.21.15.46:0/2453521456 conn(0x7ff0d406baf0 msgr2=0x7ff0d40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 shutdown_connections 2023-10-07T09:10:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.429+0000 7ff0daac4700 1 -- 172.21.15.46:0/2453521456 wait complete. 2023-10-07T09:10:07.432 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-07T09:10:07.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T09:10:07.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.571+0000 7fba1359e700 1 Processor -- start 2023-10-07T09:10:07.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.571+0000 7fba1359e700 1 -- start start 2023-10-07T09:10:07.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba141407e0 0x7fba1406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba14140bb0 0x7fba1406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1406d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140c6820 con 0x7fba141407e0 2023-10-07T09:10:07.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140c6de0 con 0x7fba14140bb0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406de60 con 0x7fba1406d4f0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba141407e0 0x7fba1406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba141407e0 0x7fba1406a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57980/0 (socket says 172.21.15.46:57980) 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 -- 172.21.15.46:0/3191045664 learned_addr learned my addr 172.21.15.46:0/3191045664 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba11d9b700 1 --2- 172.21.15.46:0/3191045664 >> v2:172.21.15.133:3300/0 conn(0x7fba14140bb0 0x7fba1406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba12d9d700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1406d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 -- 172.21.15.46:0/3191045664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 msgr2=0x7fba1406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1406d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 -- 172.21.15.46:0/3191045664 >> v2:172.21.15.133:3300/0 conn(0x7fba14140bb0 msgr2=0x7fba1406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 --2- 172.21.15.46:0/3191045664 >> v2:172.21.15.133:3300/0 conn(0x7fba14140bb0 0x7fba1406a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 -- 172.21.15.46:0/3191045664 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14141270 con 0x7fba141407e0 2023-10-07T09:10:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba12d9d700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1406d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.572+0000 7fba1259c700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1406a180 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fba140c3210 tx=0x7fba04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1b4535ca5014d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1159a700 1 -- 172.21.15.46:0/3191045664 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e070 con 0x7fba141407e0 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1159a700 1 -- 172.21.15.46:0/3191045664 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400ba50 con 0x7fba141407e0 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1159a700 1 -- 172.21.15.46:0/3191045664 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040092e0 con 0x7fba141407e0 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 -- 172.21.15.46:0/3191045664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 msgr2=0x7fba1406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1406a180 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fba140c3210 tx=0x7fba04009840 comp rx=0 tx=0).stop 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 -- 172.21.15.46:0/3191045664 shutdown_connections 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1406d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 --2- 172.21.15.46:0/3191045664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1406a180 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 --2- 172.21.15.46:0/3191045664 >> v2:172.21.15.133:3300/0 conn(0x7fba14140bb0 0x7fba1406a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 -- 172.21.15.46:0/3191045664 >> 172.21.15.46:0/3191045664 conn(0x7fba140cc1e0 msgr2=0x7fba140cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 -- 172.21.15.46:0/3191045664 shutdown_connections 2023-10-07T09:10:07.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.573+0000 7fba1359e700 1 -- 172.21.15.46:0/3191045664 wait complete. 2023-10-07T09:10:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.574+0000 7fba1359e700 1 Processor -- start 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.574+0000 7fba1359e700 1 -- start start 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba14140bb0 0x7fba1413f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1413e0b0 con 0x7fba141407e0 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140ca9c0 con 0x7fba14140bb0 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140cae50 con 0x7fba1406d4f0 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57988/0 (socket says 172.21.15.46:57988) 2023-10-07T09:10:07.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 -- 172.21.15.46:0/1876584198 learned_addr learned my addr 172.21.15.46:0/1876584198 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba12d9d700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba14140bb0 0x7fba1413f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba1259c700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 -- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 msgr2=0x7fba1413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1413cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 -- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba14140bb0 msgr2=0x7fba1413f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba14140bb0 0x7fba1413f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.575+0000 7fba11d9b700 1 -- 172.21.15.46:0/1876584198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009ae0 con 0x7fba141407e0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba11d9b700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00d860 tx=0x7fb9fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc009610 con 0x7fba141407e0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc009770 con 0x7fba141407e0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba140c9db0 con 0x7fba141407e0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc009b30 con 0x7fba141407e0 2023-10-07T09:10:07.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.576+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba140ca370 con 0x7fba141407e0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.577+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba140cab50 con 0x7fba141407e0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.577+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb9fc01e460 con 0x7fba141407e0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.578+0000 7fba0a7fc700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 0x7fb9f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.578+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb9fc084f90 con 0x7fba141407e0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.578+0000 7fba1259c700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 0x7fb9f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.579+0000 7fba1259c700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 0x7fb9f40697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fba04009880 tx=0x7fba04018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.582+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9fc051f20 con 0x7fba141407e0 2023-10-07T09:10:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.775+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fba1406acf0 con 0x7fba141407e0 2023-10-07T09:10:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.779+0000 7fba0a7fc700 1 -- 172.21.15.46:0/1876584198 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9fc055540 con 0x7fba141407e0 2023-10-07T09:10:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 msgr2=0x7fb9f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 0x7fb9f40697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fba04009880 tx=0x7fba04018000 comp rx=0 tx=0).stop 2023-10-07T09:10:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 msgr2=0x7fba1413efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00d860 tx=0x7fb9fc008040 comp rx=0 tx=0).stop 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 shutdown_connections 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb9f4067320 0x7fb9f40697d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba14140bb0 0x7fba1413f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1406d4f0 0x7fba1413cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 --2- 172.21.15.46:0/1876584198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba141407e0 0x7fba1413efa0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 >> 172.21.15.46:0/1876584198 conn(0x7fba140cc1e0 msgr2=0x7fba140af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 shutdown_connections 2023-10-07T09:10:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.781+0000 7fba1359e700 1 -- 172.21.15.46:0/1876584198 wait complete. 2023-10-07T09:10:07.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-07T09:10:07.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.913+0000 7f70f4d3d700 1 Processor -- start 2023-10-07T09:10:07.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.913+0000 7f70f4d3d700 1 -- start start 2023-10-07T09:10:07.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70f4d3d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f70f0069560 0x7f70f00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70f4d3d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f0069ee0 con 0x7f70f0159c60 2023-10-07T09:10:07.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70f4d3d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f015a160 con 0x7f70f0159890 2023-10-07T09:10:07.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70f4d3d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f00d13a0 con 0x7f70f0069560 2023-10-07T09:10:07.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f70f0069560 0x7f70f00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70edd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f70f0159c60 0x7f70f015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46614/0 (socket says 172.21.15.46:46614) 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f70f0069560 0x7f70f00699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57992/0 (socket says 172.21.15.46:57992) 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70edd9b700 1 -- 172.21.15.46:0/3408851458 learned_addr learned my addr 172.21.15.46:0/3408851458 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 -- 172.21.15.46:0/3408851458 >> v1:172.21.15.133:6789/0 conn(0x7f70f0159890 legacy=0x7f70f015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 -- 172.21.15.46:0/3408851458 >> v1:172.21.15.46:6789/0 conn(0x7f70f0159c60 legacy=0x7f70f015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 -- 172.21.15.46:0/3408851458 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f015e140 con 0x7f70f0069560 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70eed9d700 1 --2- 172.21.15.46:0/3408851458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00699a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009e60 tx=0x7f70e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0e2fda54986b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.914+0000 7f70ed59a700 1 -- 172.21.15.46:0/3408851458 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800e070 con 0x7f70f0069560 2023-10-07T09:10:07.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70ed59a700 1 -- 172.21.15.46:0/3408851458 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800bc30 con 0x7f70f0069560 2023-10-07T09:10:07.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70ed59a700 1 -- 172.21.15.46:0/3408851458 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012430 con 0x7f70f0069560 2023-10-07T09:10:07.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 -- 172.21.15.46:0/3408851458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 msgr2=0x7f70f00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/3408851458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00699a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009e60 tx=0x7f70e8009780 comp rx=0 tx=0).stop 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 -- 172.21.15.46:0/3408851458 shutdown_connections 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/3408851458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00699a0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 -- 172.21.15.46:0/3408851458 >> 172.21.15.46:0/3408851458 conn(0x7f70f0068e20 msgr2=0x7f70f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 -- 172.21.15.46:0/3408851458 shutdown_connections 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.915+0000 7f70f4d3d700 1 -- 172.21.15.46:0/3408851458 wait complete. 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.916+0000 7f70f4d3d700 1 Processor -- start 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.916+0000 7f70f4d3d700 1 -- start start 2023-10-07T09:10:07.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f70f0159890 0x7f70f00b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f0159c60 0x7f70f016ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00ca900 con 0x7f70f0069560 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00b6460 con 0x7f70f0159c60 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70f4d3d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00b3640 con 0x7f70f0159890 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57994/0 (socket says 172.21.15.46:57994) 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 -- 172.21.15.46:0/2035517124 learned_addr learned my addr 172.21.15.46:0/2035517124 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:07.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70eed9d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f0159c60 0x7f70f016ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70edd9b700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f70f0159890 0x7f70f00b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 -- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f70f0159890 msgr2=0x7f70f00b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f70f0159890 0x7f70f00b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 -- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f0159c60 msgr2=0x7f70f016ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f0159c60 0x7f70f016ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.917+0000 7f70ee59c700 1 -- 172.21.15.46:0/2035517124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8009a20 con 0x7f70f0069560 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70ee59c700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c5c0 tx=0x7f70e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011590 con 0x7f70f0069560 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0011710 con 0x7f70f0069560 2023-10-07T09:10:07.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011ad0 con 0x7f70f0069560 2023-10-07T09:10:07.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f00b3920 con 0x7f70f0069560 2023-10-07T09:10:07.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.918+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f00c9e20 con 0x7f70f0069560 2023-10-07T09:10:07.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.919+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f004c3c0 con 0x7f70f0069560 2023-10-07T09:10:07.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.919+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f70e001b3b0 con 0x7f70f0069560 2023-10-07T09:10:07.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.920+0000 7f70de7fc700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:07.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.920+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f70e0083d80 con 0x7f70f0069560 2023-10-07T09:10:07.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.920+0000 7f70edd9b700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:07.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.921+0000 7f70edd9b700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 0x7f70d00697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70f0167070 tx=0x7f70e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:07.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:07.924+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70e0050d10 con 0x7f70f0069560 2023-10-07T09:10:08.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.201+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f70f00caa80 con 0x7f70f0069560 2023-10-07T09:10:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.423+0000 7f70de7fc700 1 -- 172.21.15.46:0/2035517124 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v554) v1 ==== 131+0+0 (secure 0 0 0) 0x7f70e0017070 con 0x7f70f0069560 2023-10-07T09:10:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 msgr2=0x7f70d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 0x7f70d00697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70f0167070 tx=0x7f70e4009040 comp rx=0 tx=0).stop 2023-10-07T09:10:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 msgr2=0x7f70f00cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c5c0 tx=0x7f70e000c8d0 comp rx=0 tx=0).stop 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 shutdown_connections 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f0159c60 0x7f70f016ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70f0069560 0x7f70f00cf5a0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 --2- 172.21.15.46:0/2035517124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f70f0159890 0x7f70f00b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 >> 172.21.15.46:0/2035517124 conn(0x7f70f0068e20 msgr2=0x7f70f00b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 shutdown_connections 2023-10-07T09:10:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:08.425+0000 7f70f4d3d700 1 -- 172.21.15.46:0/2035517124 wait complete. 2023-10-07T09:10:08.442 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used ... ERROR 2023-10-07T09:10:08.442 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-07T09:10:08.443 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.444 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-07T09:10:08.445 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-07T09:10:08.446 INFO:tasks.cephfs_test_runner:Ran 12 tests in 663.420s 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-07T09:10:08.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-07T09:10:08.448 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-07T09:10:08.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-07T09:10:08.450 INFO:tasks.cephfs_test_runner: 2023-10-07T09:10:08.451 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:10:08.520 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ab0a1e125f3d4ee69a288c7816f55bd0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-07T09:10:08.521 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-07T09:10:08.532 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-07T09:10:08.540 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-07T09:10:08.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.541 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:10:08.568 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T09:10:08.568 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T09:10:08.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T09:10:08.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T09:10:08.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-07T09:10:08.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.809 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-07T09:10:08.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-07T09:10:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-10-07T09:10:08.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:08.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.896 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:10:08.915 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T09:10:08.915 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T09:10:08.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:08.915 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T09:10:09.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:09.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T09:10:09.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:09.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-10-07T09:10:09.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:09.152 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-10-07T09:10:09.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T09:10:09.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-10-07T09:10:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-10-07T09:10:09.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:09.239 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-07T09:10:09.248 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-07T09:10:09.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:10:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.369+0000 7efc43dc8700 1 Processor -- start 2023-10-07T09:10:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.369+0000 7efc43dc8700 1 -- start start 2023-10-07T09:10:09.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc43dc8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc3c159890 0x7efc3c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc43dc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc3c159c60 0x7efc3c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc43dc8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c15a160 con 0x7efc3c15db10 2023-10-07T09:10:09.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc43dc8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c15df50 con 0x7efc3c159890 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc43dc8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0d13a0 con 0x7efc3c159c60 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc3c159890 0x7efc3c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc3c159890 0x7efc3c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58008/0 (socket says 172.21.15.46:58008) 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 -- 172.21.15.46:0/1879789769 learned_addr learned my addr 172.21.15.46:0/1879789769 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41363700 1 --2- 172.21.15.46:0/1879789769 >> v2:172.21.15.133:3300/0 conn(0x7efc3c159c60 0x7efc3c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 -- 172.21.15.46:0/1879789769 >> v2:172.21.15.133:3300/0 conn(0x7efc3c159c60 msgr2=0x7efc3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 --2- 172.21.15.46:0/1879789769 >> v2:172.21.15.133:3300/0 conn(0x7efc3c159c60 0x7efc3c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.370+0000 7efc41b64700 1 -- 172.21.15.46:0/1879789769 >> v1:172.21.15.133:6789/0 conn(0x7efc3c15db10 legacy=0x7efc3c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc41b64700 1 -- 172.21.15.46:0/1879789769 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c15e140 con 0x7efc3c159890 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc41b64700 1 --2- 172.21.15.46:0/1879789769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c159890 0x7efc3c15abd0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0b67f0 tx=0x7efc2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de3a06cfee68398 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc40b62700 1 -- 172.21.15.46:0/1879789769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00e070 con 0x7efc3c159890 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc40b62700 1 -- 172.21.15.46:0/1879789769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00ba20 con 0x7efc3c159890 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc40b62700 1 -- 172.21.15.46:0/1879789769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0092e0 con 0x7efc3c159890 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 -- 172.21.15.46:0/1879789769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c159890 msgr2=0x7efc3c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 --2- 172.21.15.46:0/1879789769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c159890 0x7efc3c15abd0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0b67f0 tx=0x7efc2c009840 comp rx=0 tx=0).stop 2023-10-07T09:10:09.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 -- 172.21.15.46:0/1879789769 shutdown_connections 2023-10-07T09:10:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 --2- 172.21.15.46:0/1879789769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c159890 0x7efc3c15abd0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 --2- 172.21.15.46:0/1879789769 >> v2:172.21.15.133:3300/0 conn(0x7efc3c159c60 0x7efc3c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.371+0000 7efc43dc8700 1 -- 172.21.15.46:0/1879789769 >> 172.21.15.46:0/1879789769 conn(0x7efc3c068e20 msgr2=0x7efc3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.372+0000 7efc43dc8700 1 -- 172.21.15.46:0/1879789769 shutdown_connections 2023-10-07T09:10:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.372+0000 7efc43dc8700 1 -- 172.21.15.46:0/1879789769 wait complete. 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 Processor -- start 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 -- start start 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc3c159890 0x7efc3c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc3c159c60 0x7efc3c158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0b41c0 con 0x7efc3c15db10 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0b4350 con 0x7efc3c159890 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc43dc8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c158bb0 con 0x7efc3c159c60 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc42365700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc42365700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58024/0 (socket says 172.21.15.46:58024) 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.373+0000 7efc42365700 1 -- 172.21.15.46:0/3286809947 learned_addr learned my addr 172.21.15.46:0/3286809947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc41b64700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc3c159890 0x7efc3c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc41363700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc3c159c60 0x7efc3c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 -- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc3c159c60 msgr2=0x7efc3c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc3c159c60 0x7efc3c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 -- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc3c159890 msgr2=0x7efc3c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc3c159890 0x7efc3c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 -- 172.21.15.46:0/3286809947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c009ae0 con 0x7efc3c15db10 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc42365700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c4f0 tx=0x7efc34007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400ce60 con 0x7efc3c15db10 2023-10-07T09:10:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34011590 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0c8890 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011930 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.374+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0c8e50 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.375+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c04c3c0 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.375+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efc34011ca0 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.376+0000 7efc39ffb700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 0x7efc280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.376+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efc34083c90 con 0x7efc3c15db10 2023-10-07T09:10:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.376+0000 7efc41b64700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 0x7efc280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.376+0000 7efc41b64700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 0x7efc280697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009880 tx=0x7efc2c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.380+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc34050c20 con 0x7efc3c15db10 2023-10-07T09:10:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.573+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc3c0b4490 con 0x7efc3c15db10 2023-10-07T09:10:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.574+0000 7efc39ffb700 1 -- 172.21.15.46:0/3286809947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+12273 (secure 0 0 0) 0x7efc34017020 con 0x7efc3c15db10 2023-10-07T09:10:09.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":204,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:10:07.420261+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6835/1322977630":"2023-10-08T09:10:04.413079+0000","172.21.15.46:6832/1322977630":"2023-10-08T09:10:04.413079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:10:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 msgr2=0x7efc280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 0x7efc280697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009880 tx=0x7efc2c018000 comp rx=0 tx=0).stop 2023-10-07T09:10:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 msgr2=0x7efc3c0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c4f0 tx=0x7efc34007f50 comp rx=0 tx=0).stop 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 shutdown_connections 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7efc28067320 0x7efc280697d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc3c15db10 0x7efc3c0c9fe0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc3c159890 0x7efc3c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 --2- 172.21.15.46:0/3286809947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc3c159c60 0x7efc3c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 >> 172.21.15.46:0/3286809947 conn(0x7efc3c068e20 msgr2=0x7efc3c0c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 shutdown_connections 2023-10-07T09:10:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.576+0000 7efc43dc8700 1 -- 172.21.15.46:0/3286809947 wait complete. 2023-10-07T09:10:09.590 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-07T09:10:09.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:10:09.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.708+0000 7fd7118ae700 1 Processor -- start 2023-10-07T09:10:09.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.708+0000 7fd7118ae700 1 -- start start 2023-10-07T09:10:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7118ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7118ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd70c1597f0 0x7fd70c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7118ae700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0b11d0 con 0x7fd70c15d230 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7118ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0b14b0 con 0x7fd70c1597f0 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7118ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b1790 con 0x7fd70c159420 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7110ad700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd70c15d230 0x7fd70c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60560/0 (socket says 172.21.15.46:60560) 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7110ad700 1 -- 172.21.15.46:0/2027500955 learned_addr learned my addr 172.21.15.46:0/2027500955 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd7108ac700 1 --2- 172.21.15.46:0/2027500955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686211196 0 0) 0x7fd70c0b11d0 con 0x7fd70c15d230 2023-10-07T09:10:09.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd70bfff700 1 --2- 172.21.15.46:0/2027500955 >> v2:172.21.15.133:3300/0 conn(0x7fd70c1597f0 0x7fd70c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.709+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f4003570 con 0x7fd70c15d230 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1552914777 0 0) 0x7fd6f4003570 con 0x7fd70c15d230 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd7108ac700 1 -- 172.21.15.46:0/2027500955 >> v2:172.21.15.133:3300/0 conn(0x7fd70c1597f0 msgr2=0x7fd70c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd7108ac700 1 --2- 172.21.15.46:0/2027500955 >> v2:172.21.15.133:3300/0 conn(0x7fd70c1597f0 0x7fd70c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd7108ac700 1 -- 172.21.15.46:0/2027500955 >> v1:172.21.15.46:6789/0 conn(0x7fd70c15d230 legacy=0x7fd70c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd7108ac700 1 -- 172.21.15.46:0/2027500955 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0b1a70 con 0x7fd70c159420 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd7108ac700 1 --2- 172.21.15.46:0/2027500955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c0b5f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0098e0 tx=0x7fd6fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc5e79218b4e9ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040017f0 con 0x7fd70c159420 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc011420 con 0x7fd70c159420 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.710+0000 7fd70b7fe700 1 -- 172.21.15.46:0/2027500955 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0117a0 con 0x7fd70c159420 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 -- 172.21.15.46:0/2027500955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 msgr2=0x7fd70c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 --2- 172.21.15.46:0/2027500955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c0b5f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0098e0 tx=0x7fd6fc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 -- 172.21.15.46:0/2027500955 shutdown_connections 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 --2- 172.21.15.46:0/2027500955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c0b5f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 --2- 172.21.15.46:0/2027500955 >> v2:172.21.15.133:3300/0 conn(0x7fd70c1597f0 0x7fd70c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 -- 172.21.15.46:0/2027500955 >> 172.21.15.46:0/2027500955 conn(0x7fd70c0d0660 msgr2=0x7fd70c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 -- 172.21.15.46:0/2027500955 shutdown_connections 2023-10-07T09:10:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.711+0000 7fd7118ae700 1 -- 172.21.15.46:0/2027500955 wait complete. 2023-10-07T09:10:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.712+0000 7fd7118ae700 1 Processor -- start 2023-10-07T09:10:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.712+0000 7fd7118ae700 1 -- start start 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd70c1597f0 0x7fd70c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15b480 con 0x7fd70c15d230 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15b760 con 0x7fd70c1597f0 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7118ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15ba40 con 0x7fd70c159420 2023-10-07T09:10:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33314/0 (socket says 172.21.15.46:33314) 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 -- 172.21.15.46:0/1808829612 learned_addr learned my addr 172.21.15.46:0/1808829612 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7108ac700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd70bfff700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd70c1597f0 0x7fd70c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 -- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 msgr2=0x7fd70c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 -- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd70c1597f0 msgr2=0x7fd70c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd70c1597f0 0x7fd70c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 -- 172.21.15.46:0/1808829612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009420 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd7110ad700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fd70400cb90 tx=0x7fd7040015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704004dc0 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400a5d0 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.713+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400a990 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.714+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c15bd20 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.714+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c15b170 con 0x7fd70c15d230 2023-10-07T09:10:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.715+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c15c240 con 0x7fd70c15d230 2023-10-07T09:10:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.715+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd70400ad40 con 0x7fd70c15d230 2023-10-07T09:10:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.715+0000 7fd708ff9700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 0x7fd6f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.716+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd704084040 con 0x7fd70c15d230 2023-10-07T09:10:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.716+0000 7fd7108ac700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 0x7fd6f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.716+0000 7fd7108ac700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 0x7fd6f80697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0091e0 tx=0x7fd6fc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.720+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd70c15c240 con 0x7fd70c15d230 2023-10-07T09:10:09.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.907+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd70c15c240 con 0x7fd6f8067320 2023-10-07T09:10:09.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.909+0000 7fd708ff9700 1 -- 172.21.15.46:0/1808829612 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51022 (secure 0 0 0) 0x7fd70c15c240 con 0x7fd6f8067320 2023-10-07T09:10:09.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:09.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.911+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 msgr2=0x7fd6f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.911+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 0x7fd6f80697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0091e0 tx=0x7fd6fc016000 comp rx=0 tx=0).stop 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.911+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 msgr2=0x7fd70c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.911+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fd70400cb90 tx=0x7fd7040015b0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 shutdown_connections 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd6f8067320 0x7fd6f80697d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd70c15d230 0x7fd70c153500 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd70c159420 0x7fd70c15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 --2- 172.21.15.46:0/1808829612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd70c1597f0 0x7fd70c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:09.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 >> 172.21.15.46:0/1808829612 conn(0x7fd70c0d0660 msgr2=0x7fd70c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:09.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 shutdown_connections 2023-10-07T09:10:09.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:09.912+0000 7fd7118ae700 1 -- 172.21.15.46:0/1808829612 wait complete. 2023-10-07T09:10:09.915 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:10:09.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2023-10-07T09:10:07.930353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448720,"kb_used_data":21264,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752526000,"statfs":{"total":773094113280,"available":770586624000,"internally_reserved":0,"allocated":21774336,"data_stored":10409062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001420"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":326,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-07T09:08:28.673469+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:08:28.673469+0000","last_peered":"2023-10-07T09:08:28.673469+0000","last_clean":"2023-10-07T09:08:28.673469+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:08:28.673469+0000","last_undegraded":"2023-10-07T09:08:28.673469+0000","last_fullsized":"2023-10-07T09:08:28.673469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304480,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067360,"statfs":{"total":96636764160,"available":96324976640,"internally_reserved":0,"allocated":3170304,"data_stored":1745007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.23599999999999999},"max":{"1min":0.71099999999999997,"5min":0.753,"15min":0.85799999999999998},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.81399999999999995,"15min":0.96099999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26700000000000002},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":0.83899999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88600000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.82899999999999996,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.84599999999999997},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64200000000000002,"5min":0.81699999999999995,"15min":0.84999999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.89000000000000001,"15min":0.89500000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69399999999999995,"5min":0.82499999999999996,"15min":0.93000000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.88400000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.84199999999999997},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.35999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75600000000000001,"5min":0.81299999999999994,"15min":1.29},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":4.0880000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.49199999999999999,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.84899999999999998},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.84199999999999997,"15min":0.91900000000000004},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.371},"max":{"1min":0.76800000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307996,"kb_used_data":2516,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063844,"statfs":{"total":96636764160,"available":96321376256,"internally_reserved":0,"allocated":2576384,"data_stored":1154187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34100000000000003},"min":{"1min":0.245,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.57999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.30199999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.65700000000000003,"15min":1.3859999999999999},"last":0.443}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.33300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.59799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.372},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.90400000000000003,"15min":11.32},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":1.077,"15min":11.880000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66700000000000004},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67800000000000005,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.875,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.1899999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66500000000000004,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":5.3920000000000003},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.325,"15min":4.5209999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93600000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308572,"kb_used_data":3092,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063268,"statfs":{"total":96636764160,"available":96320786432,"internally_reserved":0,"allocated":3166208,"data_stored":1744501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.191},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24099999999999999},"max":{"1min":0.61399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.378,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.53300000000000003,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.86599999999999999,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":0.84899999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.496},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.55500000000000005,"5min":0.41299999999999998,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.53500000000000003,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.96299999999999997,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.52300000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":1.01,"15min":1.01},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.60499999999999998,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":1.0389999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1157936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":10.214},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.308,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":1.1899999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.70599999999999996,"15min":0.755},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.42799999999999999,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":10.144},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.44500000000000001,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":10.071},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.64100000000000001,"5min":0.68799999999999994,"15min":10.183},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.51300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76900000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":1.0549999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.89200000000000002},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.64100000000000001,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0880000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":4.4240000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.94399999999999995},"min":{"1min":0.61799999999999999,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89600000000000002,"15min":4.391},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.61299999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.93799999999999994,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1147997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.52600000000000002,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.48599999999999999,"5min":0.54600000000000004,"15min":12.038},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46200000000000002,"5min":0.622,"15min":2.3450000000000002},"last":0.308},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.42699999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":2.3380000000000001},"last":0.441}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40300000000000002,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":6.1230000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.432,"15min":0.443},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":1.2330000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.751},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.81399999999999995,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.318},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":2.081},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.35199999999999998},"max":{"1min":0.77200000000000002,"5min":0.85699999999999998,"15min":2.1099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.505,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.92800000000000005,"15min":2.1960000000000002},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.135,"15min":12.007},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":2.0459999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.52400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.81299999999999994},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.84599999999999997,"5min":1.179,"15min":11.973000000000001},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1151204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.67600000000000005},"min":{"1min":0.39100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.63600000000000001,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.63200000000000001},"min":{"1min":0.41599999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.75900000000000001},"min":{"1min":0.499,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.73299999999999998},"min":{"1min":0.42699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82599999999999996,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":10.01},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.88100000000000001,"15min":5.569},"last":0.436},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.73199999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76800000000000002,"5min":0.93500000000000005,"15min":10.131},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.66500000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.70299999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.78800000000000003,"15min":1.127},"last":0.627},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":9.7799999999999994},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.499,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":6.3970000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":6.5650000000000004},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":1.478},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":2.9249999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67300000000000004,"5min":0.77800000000000002,"15min":0.96799999999999997},"last":0.5},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":2.1400000000000001},"last":0.438},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":3.9470000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.0740000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91600000000000004},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:10:09.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:10:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 Processor -- start 2023-10-07T09:10:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 -- start start 2023-10-07T09:10:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5734159c60 0x7f573415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 0x7f5734069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573415a160 con 0x7f5734159890 2023-10-07T09:10:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573415df50 con 0x7f5734159c60 2023-10-07T09:10:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.046+0000 7f573a75f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57340d13a0 con 0x7f573415db10 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5734159c60 0x7f573415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5734159c60 0x7f573415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33320/0 (socket says 172.21.15.46:33320) 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 -- 172.21.15.46:0/1100513494 learned_addr learned my addr 172.21.15.46:0/1100513494 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f5738cfc700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 0x7f5734069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 -- 172.21.15.46:0/1100513494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 msgr2=0x7f5734069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 0x7f5734069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 -- 172.21.15.46:0/1100513494 >> v1:172.21.15.133:6789/0 conn(0x7f5734159890 legacy=0x7f573415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 -- 172.21.15.46:0/1100513494 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573415e140 con 0x7f5734159c60 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f5738cfc700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 0x7f5734069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f57337fe700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159c60 0x7f573415d5d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f57240099b0 tx=0x7f5724009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ef0ade9dab56cb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f5732ffd700 1 -- 172.21.15.46:0/1100513494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400b860 con 0x7f5734159c60 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f5732ffd700 1 -- 172.21.15.46:0/1100513494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400b9c0 con 0x7f5734159c60 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.047+0000 7f5732ffd700 1 -- 172.21.15.46:0/1100513494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400bd60 con 0x7f5734159c60 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 -- 172.21.15.46:0/1100513494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159c60 msgr2=0x7f573415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159c60 0x7f573415d5d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f57240099b0 tx=0x7f5724009250 comp rx=0 tx=0).stop 2023-10-07T09:10:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 -- 172.21.15.46:0/1100513494 shutdown_connections 2023-10-07T09:10:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f573415db10 0x7f5734069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 --2- 172.21.15.46:0/1100513494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159c60 0x7f573415d5d0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 -- 172.21.15.46:0/1100513494 >> 172.21.15.46:0/1100513494 conn(0x7f5734068e20 msgr2=0x7f57340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 -- 172.21.15.46:0/1100513494 shutdown_connections 2023-10-07T09:10:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.048+0000 7f573a75f700 1 -- 172.21.15.46:0/1100513494 wait complete. 2023-10-07T09:10:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.049+0000 7f573a75f700 1 Processor -- start 2023-10-07T09:10:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.049+0000 7f573a75f700 1 -- start start 2023-10-07T09:10:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5734159c60 0x7f5734158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 0x7f5734149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573416a9c0 con 0x7f5734159890 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5734158ad0 con 0x7f573415db10 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f573a75f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573416a090 con 0x7f5734159c60 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33326/0 (socket says 172.21.15.46:33326) 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 -- 172.21.15.46:0/1018879089 learned_addr learned my addr 172.21.15.46:0/1018879089 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f57337fe700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5734159c60 0x7f5734158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5738cfc700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 0x7f5734149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 -- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5734159c60 msgr2=0x7f5734158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5734159c60 0x7f5734158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 -- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 msgr2=0x7f5734149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 0x7f5734149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5733fff700 1 -- 172.21.15.46:0/1018879089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240094f0 con 0x7f5734159890 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.050+0000 7f5738cfc700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 0x7f5734149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f5733fff700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c590 tx=0x7f571c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c011590 con 0x7f5734159890 2023-10-07T09:10:10.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c011710 con 0x7f5734159890 2023-10-07T09:10:10.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573416a370 con 0x7f5734159890 2023-10-07T09:10:10.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c011ad0 con 0x7f5734159890 2023-10-07T09:10:10.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.051+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57340c7ad0 con 0x7f5734159890 2023-10-07T09:10:10.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.052+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573404c3c0 con 0x7f5734159890 2023-10-07T09:10:10.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.052+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f571c01b3b0 con 0x7f5734159890 2023-10-07T09:10:10.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.053+0000 7f572bfff700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 0x7f57140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.053+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f571c083eb0 con 0x7f5734159890 2023-10-07T09:10:10.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.053+0000 7f57337fe700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 0x7f57140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.054+0000 7f57337fe700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 0x7f57140697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f57240099b0 tx=0x7f5724017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.057+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f571c050e40 con 0x7f5734159890 2023-10-07T09:10:10.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.245+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f573416ab00 con 0x7f5714067320 2023-10-07T09:10:10.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.248+0000 7f572bfff700 1 -- 172.21.15.46:0/1018879089 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51022 (secure 0 0 0) 0x7f572400bb30 con 0x7f5714067320 2023-10-07T09:10:10.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 msgr2=0x7f57140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 0x7f57140697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f57240099b0 tx=0x7f5724017000 comp rx=0 tx=0).stop 2023-10-07T09:10:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 msgr2=0x7f57340ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c590 tx=0x7f571c00c8a0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 shutdown_connections 2023-10-07T09:10:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5714067320 0x7f57140697d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573415db10 0x7f5734149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5734159890 0x7f57340ca1f0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 --2- 172.21.15.46:0/1018879089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5734159c60 0x7f5734158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.249+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 >> 172.21.15.46:0/1018879089 conn(0x7f5734068e20 msgr2=0x7f5734153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.250+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 shutdown_connections 2023-10-07T09:10:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.250+0000 7f573a75f700 1 -- 172.21.15.46:0/1018879089 wait complete. 2023-10-07T09:10:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:10:10.263 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2023-10-07T09:10:09.930721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448720,"kb_used_data":21264,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752526000,"statfs":{"total":773094113280,"available":770586624000,"internally_reserved":0,"allocated":21774336,"data_stored":10409062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001219"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":326,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-07T09:08:28.673469+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:08:28.673469+0000","last_peered":"2023-10-07T09:08:28.673469+0000","last_clean":"2023-10-07T09:08:28.673469+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:08:28.673469+0000","last_undegraded":"2023-10-07T09:08:28.673469+0000","last_fullsized":"2023-10-07T09:08:28.673469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304480,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067360,"statfs":{"total":96636764160,"available":96324976640,"internally_reserved":0,"allocated":3170304,"data_stored":1745007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.23599999999999999},"max":{"1min":0.71099999999999997,"5min":0.753,"15min":0.85799999999999998},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.81399999999999995,"15min":0.96099999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26700000000000002},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":0.83899999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88600000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.82899999999999996,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.84599999999999997},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64200000000000002,"5min":0.81699999999999995,"15min":0.84999999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.89000000000000001,"15min":0.89500000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69399999999999995,"5min":0.82499999999999996,"15min":0.93000000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.88400000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.84199999999999997},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.35999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75600000000000001,"5min":0.81299999999999994,"15min":1.29},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":4.0880000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.49199999999999999,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.84899999999999998},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.84199999999999997,"15min":0.91900000000000004},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.371},"max":{"1min":0.76800000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307996,"kb_used_data":2516,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063844,"statfs":{"total":96636764160,"available":96321376256,"internally_reserved":0,"allocated":2576384,"data_stored":1154187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34100000000000003},"min":{"1min":0.245,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.57999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.30199999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.65700000000000003,"15min":1.3859999999999999},"last":0.443}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.33300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.59799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.372},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.90400000000000003,"15min":11.32},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":1.077,"15min":11.880000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66700000000000004},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67800000000000005,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.875,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.1899999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66500000000000004,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":5.3920000000000003},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.325,"15min":4.5209999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93600000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308572,"kb_used_data":3092,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063268,"statfs":{"total":96636764160,"available":96320786432,"internally_reserved":0,"allocated":3166208,"data_stored":1744501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.191},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24099999999999999},"max":{"1min":0.61399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.378,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.53300000000000003,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.86599999999999999,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":0.84899999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.496},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.55500000000000005,"5min":0.41299999999999998,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.53500000000000003,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.96299999999999997,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.52300000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":1.01,"15min":1.01},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.60499999999999998,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":1.0389999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1157936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":10.214},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.308,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":1.1899999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.70599999999999996,"15min":0.755},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.42799999999999999,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":10.144},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.44500000000000001,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":10.071},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.64100000000000001,"5min":0.68799999999999994,"15min":10.183},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.51300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76900000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":1.0549999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.89200000000000002},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.64100000000000001,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0880000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":4.4240000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.94399999999999995},"min":{"1min":0.61799999999999999,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89600000000000002,"15min":4.391},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.61299999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.93799999999999994,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1147997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.52600000000000002,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.48599999999999999,"5min":0.54600000000000004,"15min":12.038},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46200000000000002,"5min":0.622,"15min":2.3450000000000002},"last":0.308},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.42699999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":2.3380000000000001},"last":0.441}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40300000000000002,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":6.1230000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.432,"15min":0.443},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":1.2330000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.751},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.81399999999999995,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.318},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":2.081},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.35199999999999998},"max":{"1min":0.77200000000000002,"5min":0.85699999999999998,"15min":2.1099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.505,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.92800000000000005,"15min":2.1960000000000002},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.135,"15min":12.007},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":2.0459999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.52400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.81299999999999994},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.84599999999999997,"5min":1.179,"15min":11.973000000000001},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1151204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.67600000000000005},"min":{"1min":0.39100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.63600000000000001,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.63200000000000001},"min":{"1min":0.41599999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.75900000000000001},"min":{"1min":0.499,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.73299999999999998},"min":{"1min":0.42699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82599999999999996,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":10.01},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.88100000000000001,"15min":5.569},"last":0.436},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.73199999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76800000000000002,"5min":0.93500000000000005,"15min":10.131},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.66500000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.70299999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.78800000000000003,"15min":1.127},"last":0.627},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":9.7799999999999994},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.499,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":6.3970000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":6.5650000000000004},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":1.478},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":2.9249999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67300000000000004,"5min":0.77800000000000002,"15min":0.96799999999999997},"last":0.5},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":2.1400000000000001},"last":0.438},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":3.9470000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.0740000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91600000000000004},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:10:10.265 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-07T09:10:10.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:10:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.383+0000 7ff6c49f7700 1 Processor -- start 2023-10-07T09:10:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.383+0000 7ff6c49f7700 1 -- start start 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.384+0000 7ff6c49f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6c0159420 0x7ff6c00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.384+0000 7ff6c49f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.384+0000 7ff6c49f7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00b11d0 con 0x7ff6c015d230 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.384+0000 7ff6c49f7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00b14b0 con 0x7ff6c0159420 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.384+0000 7ff6c49f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00b1790 con 0x7ff6c01597f0 2023-10-07T09:10:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6bf7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6c0159420 0x7ff6c00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:36380/0 (socket says 172.21.15.46:36380) 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 -- 172.21.15.46:0/1435182746 learned_addr learned my addr 172.21.15.46:0/1435182746 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 -- 172.21.15.46:0/1435182746 >> v2:172.21.15.133:3300/0 conn(0x7ff6c0159420 msgr2=0x7ff6c00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 --2- 172.21.15.46:0/1435182746 >> v2:172.21.15.133:3300/0 conn(0x7ff6c0159420 0x7ff6c00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 -- 172.21.15.46:0/1435182746 >> v1:172.21.15.133:6789/0 conn(0x7ff6c015d230 legacy=0x7ff6c00b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 -- 172.21.15.46:0/1435182746 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00b1a70 con 0x7ff6c01597f0 2023-10-07T09:10:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6beffd700 1 --2- 172.21.15.46:0/1435182746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40099b0 tx=0x7ff6b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e3e29b70d56b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6be7fc700 1 -- 172.21.15.46:0/1435182746 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4009ea0 con 0x7ff6c01597f0 2023-10-07T09:10:10.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6be7fc700 1 -- 172.21.15.46:0/1435182746 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400b860 con 0x7ff6c01597f0 2023-10-07T09:10:10.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.385+0000 7ff6be7fc700 1 -- 172.21.15.46:0/1435182746 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400bc00 con 0x7ff6c01597f0 2023-10-07T09:10:10.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 -- 172.21.15.46:0/1435182746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 msgr2=0x7ff6c00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/1435182746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40099b0 tx=0x7ff6b4009250 comp rx=0 tx=0).stop 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 -- 172.21.15.46:0/1435182746 shutdown_connections 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/1435182746 >> v2:172.21.15.133:3300/0 conn(0x7ff6c0159420 0x7ff6c00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/1435182746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c01597f0 0x7ff6c00b2270 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 -- 172.21.15.46:0/1435182746 >> 172.21.15.46:0/1435182746 conn(0x7ff6c00d0660 msgr2=0x7ff6c00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 -- 172.21.15.46:0/1435182746 shutdown_connections 2023-10-07T09:10:10.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.386+0000 7ff6c49f7700 1 -- 172.21.15.46:0/1435182746 wait complete. 2023-10-07T09:10:10.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.387+0000 7ff6c49f7700 1 Processor -- start 2023-10-07T09:10:10.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.387+0000 7ff6c49f7700 1 -- start start 2023-10-07T09:10:10.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c01597f0 0x7ff6c01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6c015d230 0x7ff6c0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c016ae40 con 0x7ff6c015d230 2023-10-07T09:10:10.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015a0b0 con 0x7ff6c01597f0 2023-10-07T09:10:10.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6c49f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0151e70 con 0x7ff6c0159420 2023-10-07T09:10:10.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6c015d230 0x7ff6c0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:36396/0 (socket says 172.21.15.46:36396) 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6beffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c01597f0 0x7ff6c01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 -- 172.21.15.46:0/3530526068 learned_addr learned my addr 172.21.15.46:0/3530526068 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 -- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c01597f0 msgr2=0x7ff6c01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c01597f0 0x7ff6c01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 -- 172.21.15.46:0/3530526068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6c015d230 msgr2=0x7ff6c0152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.388+0000 7ff6bf7fe700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6c015d230 0x7ff6c0152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6bf7fe700 1 -- 172.21.15.46:0/3530526068 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40094f0 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6bf7fe700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000ecb0 tx=0x7ff6b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000c850 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b000c9b0 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0152150 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000cd50 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.389+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c0159d40 con 0x7ff6c0159420 2023-10-07T09:10:10.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.390+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c015a390 con 0x7ff6c0159420 2023-10-07T09:10:10.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.390+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff6b0013680 con 0x7ff6c0159420 2023-10-07T09:10:10.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.391+0000 7ff6a77fe700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 0x7ff6ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.391+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff6b0084c40 con 0x7ff6c0159420 2023-10-07T09:10:10.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.391+0000 7ff6beffd700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 0x7ff6ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.391+0000 7ff6beffd700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 0x7ff6ac0697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40099b0 tx=0x7ff6b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.396+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6b0051b90 con 0x7ff6c0159420 2023-10-07T09:10:10.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.584+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6c004c3c0 con 0x7ff6ac067320 2023-10-07T09:10:10.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.587+0000 7ff6a77fe700 1 -- 172.21.15.46:0/3530526068 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51022 (secure 0 0 0) 0x7ff6c004c3c0 con 0x7ff6ac067320 2023-10-07T09:10:10.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 msgr2=0x7ff6ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 0x7ff6ac0697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40099b0 tx=0x7ff6b4017000 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 msgr2=0x7ff6c014d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000ecb0 tx=0x7ff6b00091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 shutdown_connections 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff6ac067320 0x7ff6ac0697d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6c015d230 0x7ff6c0152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6c0159420 0x7ff6c014d030 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 --2- 172.21.15.46:0/3530526068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c01597f0 0x7ff6c01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 >> 172.21.15.46:0/3530526068 conn(0x7ff6c00d0660 msgr2=0x7ff6c015d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 shutdown_connections 2023-10-07T09:10:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.589+0000 7ff6c49f7700 1 -- 172.21.15.46:0/3530526068 wait complete. 2023-10-07T09:10:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:10:10.603 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2023-10-07T09:10:09.930721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448720,"kb_used_data":21264,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752526000,"statfs":{"total":773094113280,"available":770586624000,"internally_reserved":0,"allocated":21774336,"data_stored":10409062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001219"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":326,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-07T09:08:28.673469+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:08:28.673469+0000","last_peered":"2023-10-07T09:08:28.673469+0000","last_clean":"2023-10-07T09:08:28.673469+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:08:28.673469+0000","last_undegraded":"2023-10-07T09:08:28.673469+0000","last_fullsized":"2023-10-07T09:08:28.673469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304480,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067360,"statfs":{"total":96636764160,"available":96324976640,"internally_reserved":0,"allocated":3170304,"data_stored":1745007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.23599999999999999},"max":{"1min":0.71099999999999997,"5min":0.753,"15min":0.85799999999999998},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.81399999999999995,"15min":0.96099999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26700000000000002},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":0.83899999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88600000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.82899999999999996,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.84599999999999997},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64200000000000002,"5min":0.81699999999999995,"15min":0.84999999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.89000000000000001,"15min":0.89500000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69399999999999995,"5min":0.82499999999999996,"15min":0.93000000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.88400000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.84199999999999997},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.35999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75600000000000001,"5min":0.81299999999999994,"15min":1.29},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":4.0880000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.49199999999999999,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.84899999999999998},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.84199999999999997,"15min":0.91900000000000004},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.371},"max":{"1min":0.76800000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307996,"kb_used_data":2516,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063844,"statfs":{"total":96636764160,"available":96321376256,"internally_reserved":0,"allocated":2576384,"data_stored":1154187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34100000000000003},"min":{"1min":0.245,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.57999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.30199999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.65700000000000003,"15min":1.3859999999999999},"last":0.443}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.33300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.59799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.372},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.90400000000000003,"15min":11.32},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":1.077,"15min":11.880000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66700000000000004},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67800000000000005,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.875,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.1899999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66500000000000004,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":5.3920000000000003},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.325,"15min":4.5209999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93600000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308572,"kb_used_data":3092,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063268,"statfs":{"total":96636764160,"available":96320786432,"internally_reserved":0,"allocated":3166208,"data_stored":1744501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.191},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24099999999999999},"max":{"1min":0.61399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.378,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.53300000000000003,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.86599999999999999,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":0.84899999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.496},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.55500000000000005,"5min":0.41299999999999998,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.53500000000000003,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.96299999999999997,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.52300000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":1.01,"15min":1.01},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.60499999999999998,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":1.0389999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1157936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":10.214},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.308,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":1.1899999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.70599999999999996,"15min":0.755},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.42799999999999999,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":10.144},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.44500000000000001,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":10.071},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.64100000000000001,"5min":0.68799999999999994,"15min":10.183},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.51300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76900000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":1.0549999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.89200000000000002},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.64100000000000001,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0880000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":4.4240000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.94399999999999995},"min":{"1min":0.61799999999999999,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89600000000000002,"15min":4.391},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.61299999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.93799999999999994,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1147997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.52600000000000002,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.48599999999999999,"5min":0.54600000000000004,"15min":12.038},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46200000000000002,"5min":0.622,"15min":2.3450000000000002},"last":0.308},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.42699999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":2.3380000000000001},"last":0.441}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40300000000000002,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":6.1230000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.432,"15min":0.443},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":1.2330000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.751},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.81399999999999995,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.318},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":2.081},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.35199999999999998},"max":{"1min":0.77200000000000002,"5min":0.85699999999999998,"15min":2.1099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.505,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.92800000000000005,"15min":2.1960000000000002},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.135,"15min":12.007},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":2.0459999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.52400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.81299999999999994},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.84599999999999997,"5min":1.179,"15min":11.973000000000001},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1151204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.67600000000000005},"min":{"1min":0.39100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.63600000000000001,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.63200000000000001},"min":{"1min":0.41599999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.75900000000000001},"min":{"1min":0.499,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.73299999999999998},"min":{"1min":0.42699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82599999999999996,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":10.01},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.88100000000000001,"15min":5.569},"last":0.436},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.73199999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76800000000000002,"5min":0.93500000000000005,"15min":10.131},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.66500000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.70299999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1154133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.78800000000000003,"15min":1.127},"last":0.627},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":9.7799999999999994},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.499,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":6.3970000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":6.5650000000000004},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":1.478},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":2.9249999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67300000000000004,"5min":0.77800000000000002,"15min":0.96799999999999997},"last":0.5},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":2.1400000000000001},"last":0.438},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":3.9470000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.0740000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91600000000000004},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:10:10.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T09:10:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.722+0000 7f325dca4700 1 Processor -- start 2023-10-07T09:10:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.722+0000 7f325dca4700 1 -- start start 2023-10-07T09:10:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325dca4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f32580ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325dca4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580cefe0 con 0x7f32581593b0 2023-10-07T09:10:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325dca4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580cfe20 con 0x7f32580b1e50 2023-10-07T09:10:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325dca4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580cf210 con 0x7f3258159780 2023-10-07T09:10:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325cca2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f32581593b0 0x7f32580b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60576/0 (socket says 172.21.15.46:60576) 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325cca2700 1 -- 172.21.15.46:0/964985006 learned_addr learned my addr 172.21.15.46:0/964985006 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526149820 0 0) 0x7f32580cefe0 con 0x7f32581593b0 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3240003570 con 0x7f32581593b0 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.723+0000 7f325d4a3700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f32580ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442101154 0 0) 0x7f3240003570 con 0x7f32581593b0 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 msgr2=0x7f32580ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f32580ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 >> v1:172.21.15.133:6789/0 conn(0x7f32580b1e50 legacy=0x7f32580b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580cf4f0 con 0x7f32581593b0 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f32500017f0 con 0x7f32581593b0 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 >> v1:172.21.15.46:6789/0 conn(0x7f32581593b0 legacy=0x7f32580b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f3240003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32400040c0 0x7f3240004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3240004da0 0x7f32400051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580cf210 con 0x7f3240004da0 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324000bc70 con 0x7f32400040c0 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324000be30 con 0x7f3258159780 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3240004da0 0x7f32400051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325cca2700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f3240003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f3257fff700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32400040c0 0x7f3240004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 -- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 msgr2=0x7f3240003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3258159780 0x7f3240003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 -- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32400040c0 msgr2=0x7f3240004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32400040c0 0x7f3240004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 -- 172.21.15.46:0/964985006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240003570 con 0x7f3240004da0 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f3257fff700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32400040c0 0x7f3240004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f325d4a3700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3240004da0 0x7f32400051f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f324800bb90 tx=0x7f3248008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d28aa57bceca500 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800d5d0 con 0x7f3240004da0 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800d730 con 0x7f3240004da0 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.724+0000 7f32577fe700 1 -- 172.21.15.46:0/964985006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800daf0 con 0x7f3240004da0 2023-10-07T09:10:10.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 -- 172.21.15.46:0/964985006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3240004da0 msgr2=0x7f32400051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 --2- 172.21.15.46:0/964985006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3240004da0 0x7f32400051f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f324800bb90 tx=0x7f3248008040 comp rx=0 tx=0).stop 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325d4a3700 1 -- 172.21.15.46:0/964985006 reap_dead start 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 -- 172.21.15.46:0/964985006 shutdown_connections 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 -- 172.21.15.46:0/964985006 >> 172.21.15.46:0/964985006 conn(0x7f32580d1130 msgr2=0x7f32580b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 -- 172.21.15.46:0/964985006 shutdown_connections 2023-10-07T09:10:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.725+0000 7f325dca4700 1 -- 172.21.15.46:0/964985006 wait complete. 2023-10-07T09:10:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.726+0000 7f325dca4700 1 Processor -- start 2023-10-07T09:10:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.726+0000 7f325dca4700 1 -- start start 2023-10-07T09:10:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 0x7f3258154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32580b0d80 0x7f32580b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581695b0 con 0x7f32580c7130 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580b1730 con 0x7f32580b0d80 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325dca4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325816a0f0 con 0x7f3240004da0 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325cca2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 0x7f3258154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33346/0 (socket says 172.21.15.46:33346) 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 -- 172.21.15.46:0/177744690 learned_addr learned my addr 172.21.15.46:0/177744690 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325cca2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 0x7f3258154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.46:36410/0 (socket says 172.21.15.46:36410) 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f3257fff700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32580b0d80 0x7f32580b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 -- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 msgr2=0x7f3258154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 0x7f3258154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 -- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32580b0d80 msgr2=0x7f32580b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32580b0d80 0x7f32580b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.727+0000 7f325d4a3700 1 -- 172.21.15.46:0/177744690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325816a580 con 0x7f32580c7130 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f325d4a3700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3248006fd0 tx=0x7f324801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800d5d0 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800de60 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580c7e80 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248014d40 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.728+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3258169aa0 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.729+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325804c3c0 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.729+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f324801d3f0 con 0x7f32580c7130 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.730+0000 7f3254ff9700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.730+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3248000e40 con 0x7f32580c7130 2023-10-07T09:10:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.730+0000 7f325cca2700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.730+0000 7f325cca2700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 0x7f32440697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3250001460 tx=0x7f32580cfd90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.734+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3248052e80 con 0x7f32580c7130 2023-10-07T09:10:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.925+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f325804c3c0 con 0x7f32580c7130 2023-10-07T09:10:10.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.926+0000 7f3254ff9700 1 -- 172.21.15.46:0/177744690 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+12273 (secure 0 0 0) 0x7f32480564a0 con 0x7f32580c7130 2023-10-07T09:10:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:10.928 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":204,"fsid":"28716a76-cc98-43f4-9a5b-38266bddfb96","created":"2023-10-07T08:58:20.112382+0000","modified":"2023-10-07T09:10:07.420261+0000","last_up_change":"2023-10-07T08:58:30.223741+0000","last_in_change":"2023-10-07T08:58:22.533842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:58:31.813778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f56cc423-ff67-41b9-bd9d-a86cd44b3af0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":90815},{"type":"v1","addr":"172.21.15.46:6809","nonce":90815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":90815},{"type":"v1","addr":"172.21.15.46:6811","nonce":90815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":90815},{"type":"v1","addr":"172.21.15.46:6815","nonce":90815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":90815},{"type":"v1","addr":"172.21.15.46:6813","nonce":90815}]},"public_addr":"172.21.15.46:6809/90815","cluster_addr":"172.21.15.46:6811/90815","heartbeat_back_addr":"172.21.15.46:6815/90815","heartbeat_front_addr":"172.21.15.46:6813/90815","state":["exists","up"]},{"osd":1,"uuid":"0286373a-6c70-4f10-b219-3f8d5e4fdd0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":90817},{"type":"v1","addr":"172.21.15.46:6817","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":90817},{"type":"v1","addr":"172.21.15.46:6819","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":90817},{"type":"v1","addr":"172.21.15.46:6823","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":90817},{"type":"v1","addr":"172.21.15.46:6821","nonce":90817}]},"public_addr":"172.21.15.46:6817/90817","cluster_addr":"172.21.15.46:6819/90817","heartbeat_back_addr":"172.21.15.46:6823/90817","heartbeat_front_addr":"172.21.15.46:6821/90817","state":["exists","up"]},{"osd":2,"uuid":"7fb775db-f310-42c7-97c1-feab5e9067fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":90828},{"type":"v1","addr":"172.21.15.46:6825","nonce":90828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":90828},{"type":"v1","addr":"172.21.15.46:6827","nonce":90828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":90828},{"type":"v1","addr":"172.21.15.46:6831","nonce":90828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":90828},{"type":"v1","addr":"172.21.15.46:6829","nonce":90828}]},"public_addr":"172.21.15.46:6825/90828","cluster_addr":"172.21.15.46:6827/90828","heartbeat_back_addr":"172.21.15.46:6831/90828","heartbeat_front_addr":"172.21.15.46:6829/90828","state":["exists","up"]},{"osd":3,"uuid":"0dcea128-967c-45b2-a95c-11e4f367e369","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":90816},{"type":"v1","addr":"172.21.15.46:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":90816},{"type":"v1","addr":"172.21.15.46:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":90816},{"type":"v1","addr":"172.21.15.46:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":90816},{"type":"v1","addr":"172.21.15.46:6805","nonce":90816}]},"public_addr":"172.21.15.46:6801/90816","cluster_addr":"172.21.15.46:6803/90816","heartbeat_back_addr":"172.21.15.46:6807/90816","heartbeat_front_addr":"172.21.15.46:6805/90816","state":["exists","up"]},{"osd":4,"uuid":"caae2971-c367-4899-ba56-194832b7f8fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":91062},{"type":"v1","addr":"172.21.15.133:6801","nonce":91062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":91062},{"type":"v1","addr":"172.21.15.133:6803","nonce":91062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":91062},{"type":"v1","addr":"172.21.15.133:6807","nonce":91062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":91062},{"type":"v1","addr":"172.21.15.133:6805","nonce":91062}]},"public_addr":"172.21.15.133:6801/91062","cluster_addr":"172.21.15.133:6803/91062","heartbeat_back_addr":"172.21.15.133:6807/91062","heartbeat_front_addr":"172.21.15.133:6805/91062","state":["exists","up"]},{"osd":5,"uuid":"0f3b551a-d190-4c7b-8833-ccd5e4699884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":91092},{"type":"v1","addr":"172.21.15.133:6819","nonce":91092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":91092},{"type":"v1","addr":"172.21.15.133:6824","nonce":91092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":91092},{"type":"v1","addr":"172.21.15.133:6831","nonce":91092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":91092},{"type":"v1","addr":"172.21.15.133:6828","nonce":91092}]},"public_addr":"172.21.15.133:6819/91092","cluster_addr":"172.21.15.133:6824/91092","heartbeat_back_addr":"172.21.15.133:6831/91092","heartbeat_front_addr":"172.21.15.133:6828/91092","state":["exists","up"]},{"osd":6,"uuid":"34e8988a-6aba-4aba-b0d8-b8f660de39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":91063},{"type":"v1","addr":"172.21.15.133:6809","nonce":91063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":91063},{"type":"v1","addr":"172.21.15.133:6811","nonce":91063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":91063},{"type":"v1","addr":"172.21.15.133:6815","nonce":91063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":91063},{"type":"v1","addr":"172.21.15.133:6813","nonce":91063}]},"public_addr":"172.21.15.133:6809/91063","cluster_addr":"172.21.15.133:6811/91063","heartbeat_back_addr":"172.21.15.133:6815/91063","heartbeat_front_addr":"172.21.15.133:6813/91063","state":["exists","up"]},{"osd":7,"uuid":"777ffe16-a7f3-4f7e-94b6-09d1014bc1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":91093},{"type":"v1","addr":"172.21.15.133:6818","nonce":91093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":91093},{"type":"v1","addr":"172.21.15.133:6822","nonce":91093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":91093},{"type":"v1","addr":"172.21.15.133:6829","nonce":91093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":91093},{"type":"v1","addr":"172.21.15.133:6825","nonce":91093}]},"public_addr":"172.21.15.133:6818/91093","cluster_addr":"172.21.15.133:6822/91093","heartbeat_back_addr":"172.21.15.133:6829/91093","heartbeat_front_addr":"172.21.15.133:6825/91093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.693022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.688773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.731385+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.725954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640792+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.451791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.640715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:58:27.650022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6835/1322977630":"2023-10-08T09:10:04.413079+0000","172.21.15.46:6832/1322977630":"2023-10-08T09:10:04.413079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T09:10:10.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 msgr2=0x7f32440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 0x7f32440697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3250001460 tx=0x7f32580cfd90 comp rx=0 tx=0).stop 2023-10-07T09:10:10.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 msgr2=0x7f32580c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:10.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3248006fd0 tx=0x7f324801b000 comp rx=0 tx=0).stop 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 shutdown_connections 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32580c7130 0x7f32580c75a0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3240004da0 0x7f3258154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 --2- 172.21.15.46:0/177744690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32580b0d80 0x7f32580b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 >> 172.21.15.46:0/177744690 conn(0x7f32580d1130 msgr2=0x7f3258157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 shutdown_connections 2023-10-07T09:10:10.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:10.928+0000 7f325dca4700 1 -- 172.21.15.46:0/177744690 wait complete. 2023-10-07T09:10:11.943 INFO:tasks.ceph:Scrubbing osd.0 2023-10-07T09:10:11.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:12.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.079+0000 7f66ffe48700 1 Processor -- start 2023-10-07T09:10:12.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.080+0000 7f66ffe48700 1 -- start start 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66ffe48700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66f80cd910 0x7f66f80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66ffe48700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66f80b55a0 0x7f66f80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66ffe48700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80b5b00 con 0x7f66f8159ec0 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66ffe48700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80b5da0 con 0x7f66f80b55a0 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66ffe48700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80b6080 con 0x7f66f80cd910 2023-10-07T09:10:12.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66f80b55a0 0x7f66f80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fdbe4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f66f8159ec0 0x7f66f80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60580/0 (socket says 172.21.15.46:60580) 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fdbe4700 1 -- 172.21.15.46:0/670900316 learned_addr learned my addr 172.21.15.46:0/670900316 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fd3e3700 1 --2- 172.21.15.46:0/670900316 >> v2:172.21.15.133:3300/0 conn(0x7f66f80cd910 0x7f66f80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fcbe2700 1 -- 172.21.15.46:0/670900316 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388479049 0 0) 0x7f66f80b5b00 con 0x7f66f8159ec0 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fcbe2700 1 -- 172.21.15.46:0/670900316 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e0003570 con 0x7f66f8159ec0 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 -- 172.21.15.46:0/670900316 >> v2:172.21.15.133:3300/0 conn(0x7f66f80cd910 msgr2=0x7f66f80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 --2- 172.21.15.46:0/670900316 >> v2:172.21.15.133:3300/0 conn(0x7f66f80cd910 0x7f66f80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 -- 172.21.15.46:0/670900316 >> v1:172.21.15.46:6789/0 conn(0x7f66f8159ec0 legacy=0x7f66f80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 -- 172.21.15.46:0/670900316 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80cc100 con 0x7f66f80b55a0 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fe3e5700 1 --2- 172.21.15.46:0/670900316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f80b55a0 0x7f66f80ce880 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009e60 tx=0x7f66e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cf3dfeaea43272 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fcbe2700 1 -- 172.21.15.46:0/670900316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e800e070 con 0x7f66f80b55a0 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fcbe2700 1 -- 172.21.15.46:0/670900316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e800bb20 con 0x7f66f80b55a0 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.081+0000 7f66fcbe2700 1 -- 172.21.15.46:0/670900316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8012430 con 0x7f66f80b55a0 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 -- 172.21.15.46:0/670900316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f80b55a0 msgr2=0x7f66f80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 --2- 172.21.15.46:0/670900316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f80b55a0 0x7f66f80ce880 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009e60 tx=0x7f66e8009780 comp rx=0 tx=0).stop 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 -- 172.21.15.46:0/670900316 shutdown_connections 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 --2- 172.21.15.46:0/670900316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f80b55a0 0x7f66f80ce880 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 --2- 172.21.15.46:0/670900316 >> v2:172.21.15.133:3300/0 conn(0x7f66f80cd910 0x7f66f80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 -- 172.21.15.46:0/670900316 >> 172.21.15.46:0/670900316 conn(0x7f66f80999f0 msgr2=0x7f66f80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 -- 172.21.15.46:0/670900316 shutdown_connections 2023-10-07T09:10:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.082+0000 7f66ffe48700 1 -- 172.21.15.46:0/670900316 wait complete. 2023-10-07T09:10:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.083+0000 7f66ffe48700 1 Processor -- start 2023-10-07T09:10:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.083+0000 7f66ffe48700 1 -- start start 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f80b55a0 0x7f66f8167170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 0x7f66f8169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66f816a700 0x7f66f8168c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f809e380 con 0x7f66f8159ec0 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f816a4a0 con 0x7f66f80b55a0 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66ffe48700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80ad520 con 0x7f66f816a700 2023-10-07T09:10:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66fd3e3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 0x7f66f8169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66fd3e3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 0x7f66f8169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33364/0 (socket says 172.21.15.46:33364) 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66fd3e3700 1 -- 172.21.15.46:0/4028413862 learned_addr learned my addr 172.21.15.46:0/4028413862 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66fe3e5700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66f816a700 0x7f66f8168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.084+0000 7f66fdbe4700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f80b55a0 0x7f66f8167170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 -- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66f816a700 msgr2=0x7f66f8168c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66f816a700 0x7f66f8168c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 -- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f80b55a0 msgr2=0x7f66f8167170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f80b55a0 0x7f66f8167170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009a20 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66fd3e3700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 0x7f66f8169f60 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00d860 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0125f0 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec012750 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f816ab90 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec012af0 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.085+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f816b150 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.086+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66f8063c90 con 0x7f66f8159ec0 2023-10-07T09:10:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f66ec013480 con 0x7f66f8159ec0 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f66e4067320 0x7f66e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f66ec084cd0 con 0x7f66f8159ec0 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7f66e406d170 0x7f66e406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66e406fc50 con 0x7f66e406d170 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec08a220 con 0x7f66f8159ec0 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66fdbe4700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f66e4067320 0x7f66e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.087+0000 7f66fe3e5700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7f66e406d170 0x7f66e406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.088+0000 7f66fe3e5700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7f66e406d170 0x7f66e406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.088+0000 7f66fdbe4700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f66e4067320 0x7f66e40697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001360 tx=0x7f66f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.088+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== osd.0 v2:172.21.15.46:6808/90815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f66e406fc50 con 0x7f66e406d170 2023-10-07T09:10:12.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.102+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 --> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66f80718b0 con 0x7f66e406d170 2023-10-07T09:10:12.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.102+0000 7f66f5ffb700 1 -- 172.21.15.46:0/4028413862 <== osd.0 v2:172.21.15.46:6808/90815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f66f80718b0 con 0x7f66e406d170 2023-10-07T09:10:12.104 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:12.104 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:12.104 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:12.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.102+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7f66e406d170 msgr2=0x7f66e406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.102+0000 7f66ffe48700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:6808/90815,v1:172.21.15.46:6809/90815] conn(0x7f66e406d170 0x7f66e406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f66e4067320 msgr2=0x7f66e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f66e4067320 0x7f66e40697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001360 tx=0x7f66f0009040 comp rx=0 tx=0).stop 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 msgr2=0x7f66f8169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 --2- 172.21.15.46:0/4028413862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f8159ec0 0x7f66f8169f60 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00d860 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66fe3e5700 1 -- 172.21.15.46:0/4028413862 reap_dead start 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 shutdown_connections 2023-10-07T09:10:12.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 >> 172.21.15.46:0/4028413862 conn(0x7f66f80999f0 msgr2=0x7f66f80cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 shutdown_connections 2023-10-07T09:10:12.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.103+0000 7f66ffe48700 1 -- 172.21.15.46:0/4028413862 wait complete. 2023-10-07T09:10:12.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-07T09:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.234+0000 7f24ff996700 1 Processor -- start 2023-10-07T09:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.235+0000 7f24ff996700 1 -- start start 2023-10-07T09:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.235+0000 7f24ff996700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f24f8159c60 0x7f24f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.235+0000 7f24ff996700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24f815db10 0x7f24f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.235+0000 7f24ff996700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f815a160 con 0x7f24f8159890 2023-10-07T09:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24ff996700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f815df50 con 0x7f24f8159c60 2023-10-07T09:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24ff996700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f80d13a0 con 0x7f24f815db10 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f24f8159c60 0x7f24f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f24f8159c60 0x7f24f815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33368/0 (socket says 172.21.15.46:33368) 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 -- 172.21.15.46:0/1443910050 learned_addr learned my addr 172.21.15.46:0/1443910050 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fdf33700 1 --2- 172.21.15.46:0/1443910050 >> v2:172.21.15.133:3300/0 conn(0x7f24f815db10 0x7f24f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 -- 172.21.15.46:0/1443910050 >> v2:172.21.15.133:3300/0 conn(0x7f24f815db10 msgr2=0x7f24f8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 --2- 172.21.15.46:0/1443910050 >> v2:172.21.15.133:3300/0 conn(0x7f24f815db10 0x7f24f8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 -- 172.21.15.46:0/1443910050 >> v1:172.21.15.133:6789/0 conn(0x7f24f8159890 legacy=0x7f24f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 -- 172.21.15.46:0/1443910050 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f815e140 con 0x7f24f8159c60 2023-10-07T09:10:12.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24fcf31700 1 --2- 172.21.15.46:0/1443910050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f815d5d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f24f806a890 tx=0x7f24ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15e957dabd931e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24f7fff700 1 -- 172.21.15.46:0/1443910050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009e70 con 0x7f24f8159c60 2023-10-07T09:10:12.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24f7fff700 1 -- 172.21.15.46:0/1443910050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00b860 con 0x7f24f8159c60 2023-10-07T09:10:12.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.236+0000 7f24f7fff700 1 -- 172.21.15.46:0/1443910050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00bc00 con 0x7f24f8159c60 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 -- 172.21.15.46:0/1443910050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 msgr2=0x7f24f815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 --2- 172.21.15.46:0/1443910050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f815d5d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f24f806a890 tx=0x7f24ec009250 comp rx=0 tx=0).stop 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 -- 172.21.15.46:0/1443910050 shutdown_connections 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 --2- 172.21.15.46:0/1443910050 >> v2:172.21.15.133:3300/0 conn(0x7f24f815db10 0x7f24f8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 --2- 172.21.15.46:0/1443910050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f815d5d0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 -- 172.21.15.46:0/1443910050 >> 172.21.15.46:0/1443910050 conn(0x7f24f8068e20 msgr2=0x7f24f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 -- 172.21.15.46:0/1443910050 shutdown_connections 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.237+0000 7f24ff996700 1 -- 172.21.15.46:0/1443910050 wait complete. 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.238+0000 7f24ff996700 1 Processor -- start 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.238+0000 7f24ff996700 1 -- start start 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f8159890 0x7f24f8140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24f815db10 0x7f24f80b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8141300 con 0x7f24f8159c60 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80cd6d0 con 0x7f24f8159890 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24ff996700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80cd9b0 con 0x7f24f815db10 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33376/0 (socket says 172.21.15.46:33376) 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 -- 172.21.15.46:0/2757542037 learned_addr learned my addr 172.21.15.46:0/2757542037 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fd732700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f8159890 0x7f24f8140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fdf33700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24f815db10 0x7f24f80b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 -- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24f815db10 msgr2=0x7f24f80b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24f815db10 0x7f24f80b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 -- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f8159890 msgr2=0x7f24f8140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f8159890 0x7f24f8140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.239+0000 7f24fcf31700 1 -- 172.21.15.46:0/2757542037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0094f0 con 0x7f24f8159c60 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24fcf31700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f24f8070e20 tx=0x7f24ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00bbe0 con 0x7f24f8159c60 2023-10-07T09:10:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec011420 con 0x7f24f8159c60 2023-10-07T09:10:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f80cdc90 con 0x7f24f8159c60 2023-10-07T09:10:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0117e0 con 0x7f24f8159c60 2023-10-07T09:10:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.240+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f80ce250 con 0x7f24f8159c60 2023-10-07T09:10:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.241+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f80ce440 con 0x7f24f8159c60 2023-10-07T09:10:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.241+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24ec011c10 con 0x7f24f8159c60 2023-10-07T09:10:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.242+0000 7f24f57fa700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.242+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f24ec0861c0 con 0x7f24f8159c60 2023-10-07T09:10:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.242+0000 7f24fd732700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.243+0000 7f24fd732700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24e8007fd0 tx=0x7f24e80016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.246+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24ec053150 con 0x7f24f8159c60 2023-10-07T09:10:12.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.440+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f24f804c3c0 con 0x7f24e4067320 2023-10-07T09:10:12.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.441+0000 7f24f57fa700 1 -- 172.21.15.46:0/2757542037 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f24f804c3c0 con 0x7f24e4067320 2023-10-07T09:10:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 msgr2=0x7f24e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24e8007fd0 tx=0x7f24e80016f0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 msgr2=0x7f24f80b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f24f8070e20 tx=0x7f24ec017000 comp rx=0 tx=0).stop 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 shutdown_connections 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f24e4067320 0x7f24e40697d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f24f815db10 0x7f24f80b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f8159890 0x7f24f8140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 --2- 172.21.15.46:0/2757542037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8159c60 0x7f24f80b3590 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 >> 172.21.15.46:0/2757542037 conn(0x7f24f8068e20 msgr2=0x7f24f8157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 shutdown_connections 2023-10-07T09:10:12.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.443+0000 7f24ff996700 1 -- 172.21.15.46:0/2757542037 wait complete. 2023-10-07T09:10:12.447 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2023-10-07T09:10:12.457 INFO:tasks.ceph:Scrubbing osd.1 2023-10-07T09:10:12.457 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:12.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.578+0000 7fc10dbc5700 1 Processor -- start 2023-10-07T09:10:12.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.579+0000 7fc10dbc5700 1 -- start start 2023-10-07T09:10:12.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.579+0000 7fc10dbc5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1080b42c0 0x7fc1080ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.579+0000 7fc10dbc5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080cefd0 con 0x7fc108155360 2023-10-07T09:10:12.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.579+0000 7fc10dbc5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10815c320 con 0x7fc1080ceb60 2023-10-07T09:10:12.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.579+0000 7fc10dbc5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10815b710 con 0x7fc1080b42c0 2023-10-07T09:10:12.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1077fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc108155360 0x7fc1080b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60588/0 (socket says 172.21.15.46:60588) 2023-10-07T09:10:12.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1077fe700 1 -- 172.21.15.46:0/150036167 learned_addr learned my addr 172.21.15.46:0/150036167 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:12.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc106ffd700 1 --2- 172.21.15.46:0/150036167 >> v2:172.21.15.133:3300/0 conn(0x7fc1080b42c0 0x7fc1080ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852845144 0 0) 0x7fc0f8001110 con 0x7fc108155360 2023-10-07T09:10:12.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f0003570 con 0x7fc108155360 2023-10-07T09:10:12.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095617424 0 0) 0x7fc10815c320 con 0x7fc1080ceb60 2023-10-07T09:10:12.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8001110 con 0x7fc1080ceb60 2023-10-07T09:10:12.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021758520 0 0) 0x7fc0f0003570 con 0x7fc108155360 2023-10-07T09:10:12.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 >> v2:172.21.15.133:3300/0 conn(0x7fc1080b42c0 msgr2=0x7fc1080ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 --2- 172.21.15.46:0/150036167 >> v2:172.21.15.133:3300/0 conn(0x7fc1080b42c0 0x7fc1080ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 >> v1:172.21.15.133:6789/0 conn(0x7fc1080ceb60 legacy=0x7fc1080cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10815b9f0 con 0x7fc108155360 2023-10-07T09:10:12.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fc0f8001600 con 0x7fc108155360 2023-10-07T09:10:12.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 >> v1:172.21.15.46:6789/0 conn(0x7fc108155360 legacy=0x7fc1080b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 0x7fc0f0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0004810 0x7fc0f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0f00051c0 0x7fc0f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10815b710 con 0x7fc0f0003bf0 2023-10-07T09:10:12.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f000c0b0 con 0x7fc0f0004810 2023-10-07T09:10:12.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f000c270 con 0x7fc0f00051c0 2023-10-07T09:10:12.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc106ffd700 1 --2- 172.21.15.46:0/150036167 >> v2:172.21.15.133:3300/0 conn(0x7fc1080b42c0 0x7fc1080ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:12.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.580+0000 7fc1077fe700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 0x7fc0f0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc107fff700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0f00051c0 0x7fc0f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc106ffd700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0004810 0x7fc0f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 -- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0f00051c0 msgr2=0x7fc0f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0f00051c0 0x7fc0f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 -- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0004810 msgr2=0x7fc0f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0004810 0x7fc0f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 -- 172.21.15.46:0/150036167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0003570 con 0x7fc0f0003bf0 2023-10-07T09:10:12.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc107fff700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0f00051c0 0x7fc0f000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:12.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc107fff700 1 -- 172.21.15.46:0/150036167 reap_dead start 2023-10-07T09:10:12.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1077fe700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 0x7fc0f0003fe0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c440 tx=0x7fc0f8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28820309bd236a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800cd70 con 0x7fc0f0003bf0 2023-10-07T09:10:12.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8005920 con 0x7fc0f0003bf0 2023-10-07T09:10:12.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc1067fc700 1 -- 172.21.15.46:0/150036167 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8005ce0 con 0x7fc0f0003bf0 2023-10-07T09:10:12.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc10dbc5700 1 -- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 msgr2=0x7fc0f0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.581+0000 7fc10dbc5700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 0x7fc0f0003fe0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c440 tx=0x7fc0f8007a00 comp rx=0 tx=0).stop 2023-10-07T09:10:12.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.582+0000 7fc10dbc5700 1 -- 172.21.15.46:0/150036167 shutdown_connections 2023-10-07T09:10:12.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.582+0000 7fc10dbc5700 1 --2- 172.21.15.46:0/150036167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f0003bf0 0x7fc0f0003fe0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.582+0000 7fc10dbc5700 1 -- 172.21.15.46:0/150036167 >> 172.21.15.46:0/150036167 conn(0x7fc10806baf0 msgr2=0x7fc10806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.582+0000 7fc10dbc5700 1 -- 172.21.15.46:0/150036167 shutdown_connections 2023-10-07T09:10:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.582+0000 7fc10dbc5700 1 -- 172.21.15.46:0/150036167 wait complete. 2023-10-07T09:10:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.583+0000 7fc10dbc5700 1 Processor -- start 2023-10-07T09:10:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.583+0000 7fc10dbc5700 1 -- start start 2023-10-07T09:10:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0003bf0 0x7fc10814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 0x7fc108156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc108157200 0x7fc1081509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081559d0 con 0x7fc1080aedb0 2023-10-07T09:10:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108156830 con 0x7fc0f0003bf0 2023-10-07T09:10:12.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108155c20 con 0x7fc108157200 2023-10-07T09:10:12.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 0x7fc108156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 0x7fc108156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33390/0 (socket says 172.21.15.46:33390) 2023-10-07T09:10:12.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 -- 172.21.15.46:0/1161068570 learned_addr learned my addr 172.21.15.46:0/1161068570 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc107fff700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc108157200 0x7fc1081509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc1077fe700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0003bf0 0x7fc10814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 -- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc108157200 msgr2=0x7fc1081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc108157200 0x7fc1081509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 -- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0003bf0 msgr2=0x7fc10814c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0f0003bf0 0x7fc10814c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108155f00 con 0x7fc1080aedb0 2023-10-07T09:10:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc107fff700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc108157200 0x7fc1081509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc106ffd700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 0x7fc108156cc0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0119c0 tx=0x7fc0fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00f880 con 0x7fc1080aedb0 2023-10-07T09:10:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc00f9e0 con 0x7fc1080aedb0 2023-10-07T09:10:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00fda0 con 0x7fc1080aedb0 2023-10-07T09:10:12.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1081561e0 con 0x7fc1080aedb0 2023-10-07T09:10:12.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.584+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080ae1a0 con 0x7fc1080aedb0 2023-10-07T09:10:12.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.585+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1080718b0 con 0x7fc1080aedb0 2023-10-07T09:10:12.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc0fc015670 con 0x7fc1080aedb0 2023-10-07T09:10:12.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0f4067320 0x7fc0f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc0fc084d90 con 0x7fc1080aedb0 2023-10-07T09:10:12.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7fc0f406d170 0x7fc0f406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f406fc50 con 0x7fc0f406d170 2023-10-07T09:10:12.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.586+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0fc087290 con 0x7fc1080aedb0 2023-10-07T09:10:12.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.587+0000 7fc107fff700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7fc0f406d170 0x7fc0f406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.587+0000 7fc1077fe700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0f4067320 0x7fc0f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.587+0000 7fc107fff700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7fc0f406d170 0x7fc0f406f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.587+0000 7fc1077fe700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0f4067320 0x7fc0f40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007e20 tx=0x7fc0f8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.588+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== osd.1 v2:172.21.15.46:6816/90817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc0f406fc50 con 0x7fc0f406d170 2023-10-07T09:10:12.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.601+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 --> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc10815bcd0 con 0x7fc0f406d170 2023-10-07T09:10:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.601+0000 7fc0ef7fe700 1 -- 172.21.15.46:0/1161068570 <== osd.1 v2:172.21.15.46:6816/90817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc10815bcd0 con 0x7fc0f406d170 2023-10-07T09:10:12.612 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:12.612 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:12.613 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7fc0f406d170 msgr2=0x7fc0f406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:6816/90817,v1:172.21.15.46:6817/90817] conn(0x7fc0f406d170 0x7fc0f406f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0f4067320 msgr2=0x7fc0f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc0f4067320 0x7fc0f40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007e20 tx=0x7fc0f8015000 comp rx=0 tx=0).stop 2023-10-07T09:10:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 msgr2=0x7fc108156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 --2- 172.21.15.46:0/1161068570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1080aedb0 0x7fc108156cc0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0119c0 tx=0x7fc0fc008040 comp rx=0 tx=0).stop 2023-10-07T09:10:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc107fff700 1 -- 172.21.15.46:0/1161068570 reap_dead start 2023-10-07T09:10:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 shutdown_connections 2023-10-07T09:10:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 >> 172.21.15.46:0/1161068570 conn(0x7fc10806baf0 msgr2=0x7fc10815a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 shutdown_connections 2023-10-07T09:10:12.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.602+0000 7fc10dbc5700 1 -- 172.21.15.46:0/1161068570 wait complete. 2023-10-07T09:10:12.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-07T09:10:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.736+0000 7fb1035b8700 1 Processor -- start 2023-10-07T09:10:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.736+0000 7fb1035b8700 1 -- start start 2023-10-07T09:10:12.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb1035b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc1599e0 0x7fb0fc06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb1035b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb1035b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc06c470 con 0x7fb0fc159610 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb1035b8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc06b860 con 0x7fb0fc0c8010 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb1035b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc06bb40 con 0x7fb0fc1599e0 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb101b55700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb101b55700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33406/0 (socket says 172.21.15.46:33406) 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb101b55700 1 -- 172.21.15.46:0/407952675 learned_addr learned my addr 172.21.15.46:0/407952675 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.737+0000 7fb100b53700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc1599e0 0x7fb0fc06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb101b55700 1 -- 172.21.15.46:0/407952675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc1599e0 msgr2=0x7fb0fc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb101b55700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc1599e0 0x7fb0fc06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb101b55700 1 -- 172.21.15.46:0/407952675 >> v1:172.21.15.133:6789/0 conn(0x7fb0fc159610 legacy=0x7fb0fc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb101b55700 1 -- 172.21.15.46:0/407952675 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc06be20 con 0x7fb0fc0c8010 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb101b55700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009f50 tx=0x7fb0ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f47c70685be105 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb0fbfff700 1 -- 172.21.15.46:0/407952675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00e070 con 0x7fb0fc0c8010 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb0fbfff700 1 -- 172.21.15.46:0/407952675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00b9c0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb0fbfff700 1 -- 172.21.15.46:0/407952675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0092e0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb1035b8700 1 -- 172.21.15.46:0/407952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 msgr2=0x7fb0fc0c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb1035b8700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009f50 tx=0x7fb0ec009840 comp rx=0 tx=0).stop 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb1035b8700 1 -- 172.21.15.46:0/407952675 shutdown_connections 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb1035b8700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0c5a60 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.738+0000 7fb1035b8700 1 --2- 172.21.15.46:0/407952675 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc1599e0 0x7fb0fc06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.739+0000 7fb1035b8700 1 -- 172.21.15.46:0/407952675 >> 172.21.15.46:0/407952675 conn(0x7fb0fc0cc780 msgr2=0x7fb0fc0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.739+0000 7fb1035b8700 1 -- 172.21.15.46:0/407952675 shutdown_connections 2023-10-07T09:10:12.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.739+0000 7fb1035b8700 1 -- 172.21.15.46:0/407952675 wait complete. 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.740+0000 7fb1035b8700 1 Processor -- start 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.740+0000 7fb1035b8700 1 -- start start 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 0x7fb0fc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc1599e0 0x7fb0fc0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc14ec30 con 0x7fb0fc0c8010 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc14f6f0 con 0x7fb0fc1599e0 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc157070 con 0x7fb0fc159610 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33416/0 (socket says 172.21.15.46:33416) 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 -- 172.21.15.46:0/3555532993 learned_addr learned my addr 172.21.15.46:0/3555532993 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb100b53700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 0x7fb0fc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101b55700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc1599e0 0x7fb0fc0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 -- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 msgr2=0x7fb0fc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 0x7fb0fc15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 -- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc1599e0 msgr2=0x7fb0fc0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc1599e0 0x7fb0fc0b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 -- 172.21.15.46:0/3555532993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009ae0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb100b53700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 0x7fb0fc15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb101354700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c7c0 tx=0x7fb0f4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011590 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f40116f0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc14ee50 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011ab0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.741+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc14f410 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.742+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc04c3c0 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.743+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb0f401c440 con 0x7fb0fc0c8010 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.743+0000 7fb0f97fa700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 0x7fb0e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.743+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb0f4083e10 con 0x7fb0fc0c8010 2023-10-07T09:10:12.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.743+0000 7fb100b53700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 0x7fb0e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:12.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.744+0000 7fb100b53700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 0x7fb0e80697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006f00 tx=0x7fb0f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:12.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.747+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f4087030 con 0x7fb0fc0c8010 2023-10-07T09:10:12.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.946+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0fc1571b0 con 0x7fb0e8067320 2023-10-07T09:10:12.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.947+0000 7fb0f97fa700 1 -- 172.21.15.46:0/3555532993 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0f0010950 con 0x7fb0e8067320 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 msgr2=0x7fb0e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 0x7fb0e80697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006f00 tx=0x7fb0f0008040 comp rx=0 tx=0).stop 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 msgr2=0x7fb0fc0b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c7c0 tx=0x7fb0f4007f40 comp rx=0 tx=0).stop 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 shutdown_connections 2023-10-07T09:10:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb0e8067320 0x7fb0e80697d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc1599e0 0x7fb0fc0b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0fc0c8010 0x7fb0fc0b0280 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 --2- 172.21.15.46:0/3555532993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0fc159610 0x7fb0fc15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 >> 172.21.15.46:0/3555532993 conn(0x7fb0fc0cc780 msgr2=0x7fb0fc153950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 shutdown_connections 2023-10-07T09:10:12.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:12.949+0000 7fb1035b8700 1 -- 172.21.15.46:0/3555532993 wait complete. 2023-10-07T09:10:12.953 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2023-10-07T09:10:12.963 INFO:tasks.ceph:Scrubbing osd.2 2023-10-07T09:10:12.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:13.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.085+0000 7f2aae0fa700 1 Processor -- start 2023-10-07T09:10:13.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.085+0000 7f2aae0fa700 1 -- start start 2023-10-07T09:10:13.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aae0fa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2aa8159ec0 0x7f2aa80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aae0fa700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa80b5b00 con 0x7f2aa80b53d0 2023-10-07T09:10:13.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aae0fa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa80b5850 con 0x7f2aa80cf350 2023-10-07T09:10:13.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aae0fa700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa80b5da0 con 0x7f2aa8159ec0 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2aa8159ec0 0x7f2aa80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2aa80b53d0 0x7f2aa80cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60594/0 (socket says 172.21.15.46:60594) 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa6ffd700 1 -- 172.21.15.46:0/482986111 learned_addr learned my addr 172.21.15.46:0/482986111 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa77fe700 1 -- 172.21.15.46:0/482986111 >> v1:172.21.15.133:6789/0 conn(0x7f2aa80cf350 legacy=0x7f2aa80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa77fe700 1 -- 172.21.15.46:0/482986111 >> v1:172.21.15.46:6789/0 conn(0x7f2aa80b53d0 legacy=0x7f2aa80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa77fe700 1 -- 172.21.15.46:0/482986111 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80b6080 con 0x7f2aa8159ec0 2023-10-07T09:10:13.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.086+0000 7f2aa67fc700 1 -- 172.21.15.46:0/482986111 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521564386 0 0) 0x7f2aa80b5b00 con 0x7f2aa80b53d0 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aa77fe700 1 --2- 172.21.15.46:0/482986111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa8159ec0 0x7f2aa80b4e90 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a98009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeb54ad3c5e65be server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aa67fc700 1 -- 172.21.15.46:0/482986111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98009e70 con 0x7f2aa8159ec0 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aa67fc700 1 -- 172.21.15.46:0/482986111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a98005c10 con 0x7f2aa8159ec0 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aa67fc700 1 -- 172.21.15.46:0/482986111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800b650 con 0x7f2aa8159ec0 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 -- 172.21.15.46:0/482986111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa8159ec0 msgr2=0x7f2aa80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 --2- 172.21.15.46:0/482986111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa8159ec0 0x7f2aa80b4e90 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a98009120 comp rx=0 tx=0).stop 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 -- 172.21.15.46:0/482986111 shutdown_connections 2023-10-07T09:10:13.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 --2- 172.21.15.46:0/482986111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa8159ec0 0x7f2aa80b4e90 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 -- 172.21.15.46:0/482986111 >> 172.21.15.46:0/482986111 conn(0x7f2aa80999f0 msgr2=0x7f2aa80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 -- 172.21.15.46:0/482986111 shutdown_connections 2023-10-07T09:10:13.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.087+0000 7f2aae0fa700 1 -- 172.21.15.46:0/482986111 wait complete. 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 Processor -- start 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 -- start start 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aa80b53d0 0x7f2aa816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 0x7f2aa816d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa8159ec0 0x7f2aa8069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa816d600 con 0x7f2aa80cf350 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa80698a0 con 0x7f2aa8159ec0 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.089+0000 7f2aae0fa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8069ad0 con 0x7f2aa80b53d0 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 0x7f2aa816d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 0x7f2aa816d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33422/0 (socket says 172.21.15.46:33422) 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 -- 172.21.15.46:0/1585368954 learned_addr learned my addr 172.21.15.46:0/1585368954 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa7fff700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa8159ec0 0x7f2aa8069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa77fe700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aa80b53d0 0x7f2aa816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 -- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aa80b53d0 msgr2=0x7f2aa816a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2aa80b53d0 0x7f2aa816a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 -- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa8159ec0 msgr2=0x7f2aa8069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa8159ec0 0x7f2aa8069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a980093c0 con 0x7f2aa80cf350 2023-10-07T09:10:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aa6ffd700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 0x7f2aa816d0c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c560 tx=0x7f2a9c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005b30 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c005c90 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa8069db0 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007320 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.090+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa806a370 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.091+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2aa80cf890 con 0x7f2aa80cf350 2023-10-07T09:10:13.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2a9c01b3b0 con 0x7f2aa80cf350 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a94067320 0x7f2a940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2a9c083f20 con 0x7f2aa80cf350 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f2a9406d170 0x7f2a9406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a9406fc50 con 0x7f2a9406d170 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2aa77fe700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a94067320 0x7f2a940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a9c086480 con 0x7f2aa80cf350 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.092+0000 7f2aa7fff700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f2a9406d170 0x7f2a9406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.093+0000 7f2aa7fff700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f2a9406d170 0x7f2a9406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.093+0000 7f2aa77fe700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a94067320 0x7f2a940697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009160 tx=0x7f2a98016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.093+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== osd.2 v2:172.21.15.46:6824/90828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2a9406fc50 con 0x7f2a9406d170 2023-10-07T09:10:13.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.107+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 --> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2aa80b6500 con 0x7f2a9406d170 2023-10-07T09:10:13.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.107+0000 7f2a8f7fe700 1 -- 172.21.15.46:0/1585368954 <== osd.2 v2:172.21.15.46:6824/90828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2aa80b6500 con 0x7f2a9406d170 2023-10-07T09:10:13.109 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:13.109 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:13.110 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f2a9406d170 msgr2=0x7f2a9406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:6824/90828,v1:172.21.15.46:6825/90828] conn(0x7f2a9406d170 0x7f2a9406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a94067320 msgr2=0x7f2a940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2a94067320 0x7f2a940697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009160 tx=0x7f2a98016000 comp rx=0 tx=0).stop 2023-10-07T09:10:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 msgr2=0x7f2aa816d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 --2- 172.21.15.46:0/1585368954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2aa80cf350 0x7f2aa816d0c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c560 tx=0x7f2a9c000fe0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aa7fff700 1 -- 172.21.15.46:0/1585368954 reap_dead start 2023-10-07T09:10:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 shutdown_connections 2023-10-07T09:10:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 >> 172.21.15.46:0/1585368954 conn(0x7f2aa80999f0 msgr2=0x7f2aa81592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 shutdown_connections 2023-10-07T09:10:13.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.108+0000 7f2aae0fa700 1 -- 172.21.15.46:0/1585368954 wait complete. 2023-10-07T09:10:13.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-07T09:10:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.239+0000 7f0bc7f5b700 1 Processor -- start 2023-10-07T09:10:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.240+0000 7f0bc7f5b700 1 -- start start 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.240+0000 7f0bc7f5b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0bc0159c60 0x7f0bc015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc7f5b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc015a160 con 0x7f0bc015db10 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc7f5b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00d13a0 con 0x7f0bc0159890 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc7f5b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc015df50 con 0x7f0bc0159c60 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc54f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0bc0159c60 0x7f0bc015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc64f8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0bc015db10 0x7f0bc0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60598/0 (socket says 172.21.15.46:60598) 2023-10-07T09:10:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc64f8700 1 -- 172.21.15.46:0/12226239 learned_addr learned my addr 172.21.15.46:0/12226239 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc54f6700 1 -- 172.21.15.46:0/12226239 >> v1:172.21.15.133:6789/0 conn(0x7f0bc0159890 legacy=0x7f0bc015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc54f6700 1 -- 172.21.15.46:0/12226239 >> v1:172.21.15.46:6789/0 conn(0x7f0bc015db10 legacy=0x7f0bc0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc54f6700 1 -- 172.21.15.46:0/12226239 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc015e140 con 0x7f0bc0159c60 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc4cf5700 1 -- 172.21.15.46:0/12226239 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717578902 0 0) 0x7f0bc015a160 con 0x7f0bc015db10 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc54f6700 1 --2- 172.21.15.46:0/12226239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159c60 0x7f0bc015d5d0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d1b569487687c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc4cf5700 1 -- 172.21.15.46:0/12226239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4009e80 con 0x7f0bc0159c60 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc4cf5700 1 -- 172.21.15.46:0/12226239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb400b860 con 0x7f0bc0159c60 2023-10-07T09:10:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.241+0000 7f0bc4cf5700 1 -- 172.21.15.46:0/12226239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400bbe0 con 0x7f0bc0159c60 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/12226239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159c60 msgr2=0x7f0bc015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/12226239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159c60 0x7f0bc015d5d0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb40091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/12226239 shutdown_connections 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/12226239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159c60 0x7f0bc015d5d0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/12226239 >> 172.21.15.46:0/12226239 conn(0x7f0bc0068e20 msgr2=0x7f0bc00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/12226239 shutdown_connections 2023-10-07T09:10:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.242+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/12226239 wait complete. 2023-10-07T09:10:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.243+0000 7f0bc7f5b700 1 Processor -- start 2023-10-07T09:10:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.243+0000 7f0bc7f5b700 1 -- start start 2023-10-07T09:10:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 0x7f0bc016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 0x7f0bc0169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc016aea0 con 0x7f0bc0159890 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc016a8e0 con 0x7f0bc015db10 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc7f5b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc016abc0 con 0x7f0bc0159c60 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33428/0 (socket says 172.21.15.46:33428) 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 -- 172.21.15.46:0/814685512 learned_addr learned my addr 172.21.15.46:0/814685512 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc64f8700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 0x7f0bc0169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc54f6700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 0x7f0bc016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 -- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 msgr2=0x7f0bc016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 0x7f0bc016b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 -- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 msgr2=0x7f0bc0169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 0x7f0bc0169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 -- 172.21.15.46:0/814685512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009420 con 0x7f0bc0159890 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc54f6700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 0x7f0bc016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc64f8700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 0x7f0bc0169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bc5cf7700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800cb10 tx=0x7f0bb80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.244+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800a760 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.245+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb800a8e0 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.245+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc00b36c0 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.245+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800aca0 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.245+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc00b5330 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.246+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc004c3c0 con 0x7f0bc0159890 2023-10-07T09:10:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.246+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0bb8003030 con 0x7f0bc0159890 2023-10-07T09:10:13.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.246+0000 7f0bbdffb700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 0x7f0bac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.246+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0bb8084a60 con 0x7f0bc0159890 2023-10-07T09:10:13.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.247+0000 7f0bc54f6700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 0x7f0bac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.247+0000 7f0bc54f6700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 0x7f0bac0697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40093f0 tx=0x7f0bb4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.251+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bb80519f0 con 0x7f0bc0159890 2023-10-07T09:10:13.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:13.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:13.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.444+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc00b5550 con 0x7f0bac067320 2023-10-07T09:10:13.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.446+0000 7f0bbdffb700 1 -- 172.21.15.46:0/814685512 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0bc00b5550 con 0x7f0bac067320 2023-10-07T09:10:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 msgr2=0x7f0bac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 0x7f0bac0697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40093f0 tx=0x7f0bb4017000 comp rx=0 tx=0).stop 2023-10-07T09:10:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 msgr2=0x7f0bc016ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800cb10 tx=0x7f0bb80017b0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 shutdown_connections 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f0bac067320 0x7f0bac0697d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc015db10 0x7f0bc0169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bc0159890 0x7f0bc016ce10 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 --2- 172.21.15.46:0/814685512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc0159c60 0x7f0bc016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 >> 172.21.15.46:0/814685512 conn(0x7f0bc0068e20 msgr2=0x7f0bc00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 shutdown_connections 2023-10-07T09:10:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.447+0000 7f0bc7f5b700 1 -- 172.21.15.46:0/814685512 wait complete. 2023-10-07T09:10:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2023-10-07T09:10:13.461 INFO:tasks.ceph:Scrubbing osd.3 2023-10-07T09:10:13.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.582+0000 7f192c59d700 1 Processor -- start 2023-10-07T09:10:13.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.582+0000 7f192c59d700 1 -- start start 2023-10-07T09:10:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f19240b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19240b53d0 0x7f19240cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19240cce40 0x7f19240cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240b5b00 con 0x7f19240cce40 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240b5da0 con 0x7f19240b53d0 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192c59d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b6080 con 0x7f1924159ec0 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.583+0000 7f192ab3a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19240cce40 0x7f19240cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19240cce40 0x7f19240cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33436/0 (socket says 172.21.15.46:33436) 2023-10-07T09:10:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 -- 172.21.15.46:0/2079166632 learned_addr learned my addr 172.21.15.46:0/2079166632 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f1929b38700 1 --2- 172.21.15.46:0/2079166632 >> v2:172.21.15.133:3300/0 conn(0x7f19240b53d0 0x7f19240cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192a339700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f19240b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 -- 172.21.15.46:0/2079166632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 msgr2=0x7f19240b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f19240b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 -- 172.21.15.46:0/2079166632 >> v2:172.21.15.133:3300/0 conn(0x7f19240b53d0 msgr2=0x7f19240cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 --2- 172.21.15.46:0/2079166632 >> v2:172.21.15.133:3300/0 conn(0x7f19240b53d0 0x7f19240cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 -- 172.21.15.46:0/2079166632 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240cc100 con 0x7f19240cce40 2023-10-07T09:10:13.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f192ab3a700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240cce40 0x7f19240cd280 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1924089880 tx=0x7f191c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225df419031200c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f1929337700 1 -- 172.21.15.46:0/2079166632 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00b640 con 0x7f19240cce40 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f1929337700 1 -- 172.21.15.46:0/2079166632 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00b7a0 con 0x7f19240cce40 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.584+0000 7f1929337700 1 -- 172.21.15.46:0/2079166632 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00bb60 con 0x7f19240cce40 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 -- 172.21.15.46:0/2079166632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240cce40 msgr2=0x7f19240cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240cce40 0x7f19240cd280 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1924089880 tx=0x7f191c009250 comp rx=0 tx=0).stop 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 -- 172.21.15.46:0/2079166632 shutdown_connections 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240cce40 0x7f19240cd280 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 --2- 172.21.15.46:0/2079166632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f19240b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 --2- 172.21.15.46:0/2079166632 >> v2:172.21.15.133:3300/0 conn(0x7f19240b53d0 0x7f19240cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 -- 172.21.15.46:0/2079166632 >> 172.21.15.46:0/2079166632 conn(0x7f19240999f0 msgr2=0x7f19240b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 -- 172.21.15.46:0/2079166632 shutdown_connections 2023-10-07T09:10:13.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.585+0000 7f192c59d700 1 -- 172.21.15.46:0/2079166632 wait complete. 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.586+0000 7f192c59d700 1 Processor -- start 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.586+0000 7f192c59d700 1 -- start start 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 0x7f192409de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19240cce40 0x7f19241587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f1924158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241565e0 con 0x7f19240b53d0 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192406b110 con 0x7f19240cce40 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192409e340 con 0x7f1924159ec0 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 0x7f192409de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 0x7f192409de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33440/0 (socket says 172.21.15.46:33440) 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 -- 172.21.15.46:0/625019902 learned_addr learned my addr 172.21.15.46:0/625019902 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192ab3a700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f1924158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f1929b38700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19240cce40 0x7f19241587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 -- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 msgr2=0x7f1924158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1924159ec0 0x7f1924158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 -- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19240cce40 msgr2=0x7f19241587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19240cce40 0x7f19241587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0094f0 con 0x7f19240b53d0 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192a339700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 0x7f192409de00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1914009ea0 tx=0x7f191400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400cc00 con 0x7f19240b53d0 2023-10-07T09:10:13.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400f040 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192406a070 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914014480 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1924155f90 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.588+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19240636f0 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f19140147f0 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1910067320 0x7f19100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1914085330 con 0x7f19240b53d0 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f191006d170 0x7f191006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f191006fc50 con 0x7f191006d170 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.589+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1914087890 con 0x7f19240b53d0 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.590+0000 7f192ab3a700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f191006d170 0x7f191006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.590+0000 7f1929b38700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1910067320 0x7f19100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.590+0000 7f192ab3a700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f191006d170 0x7f191006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.590+0000 7f1929b38700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1910067320 0x7f19100697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19180093f0 tx=0x7f1918008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.590+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== osd.3 v2:172.21.15.46:6800/90816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f191006fc50 con 0x7f191006d170 2023-10-07T09:10:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.604+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 --> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1924063c90 con 0x7f191006d170 2023-10-07T09:10:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f19227fc700 1 -- 172.21.15.46:0/625019902 <== osd.3 v2:172.21.15.46:6800/90816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1924063c90 con 0x7f191006d170 2023-10-07T09:10:13.607 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:13.607 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f191006d170 msgr2=0x7f191006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:6800/90816,v1:172.21.15.46:6801/90816] conn(0x7f191006d170 0x7f191006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1910067320 msgr2=0x7f19100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1910067320 0x7f19100697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19180093f0 tx=0x7f1918008040 comp rx=0 tx=0).stop 2023-10-07T09:10:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 msgr2=0x7f192409de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 --2- 172.21.15.46:0/625019902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19240b53d0 0x7f192409de00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1914009ea0 tx=0x7f191400b040 comp rx=0 tx=0).stop 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192ab3a700 1 -- 172.21.15.46:0/625019902 reap_dead start 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 shutdown_connections 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 >> 172.21.15.46:0/625019902 conn(0x7f19240999f0 msgr2=0x7f1924155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 shutdown_connections 2023-10-07T09:10:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.605+0000 7f192c59d700 1 -- 172.21.15.46:0/625019902 wait complete. 2023-10-07T09:10:13.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-07T09:10:13.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 Processor -- start 2023-10-07T09:10:13.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 -- start start 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5584159c60 0x7f558415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558415a160 con 0x7f5584159890 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840d13a0 con 0x7f558415db10 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f55890ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558415df50 con 0x7f5584159c60 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5582d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5584159890 0x7f558415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60612/0 (socket says 172.21.15.46:60612) 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5582d9d700 1 -- 172.21.15.46:0/2609524745 learned_addr learned my addr 172.21.15.46:0/2609524745 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f558259c700 1 --2- 172.21.15.46:0/2609524745 >> v2:172.21.15.133:3300/0 conn(0x7f5584159c60 0x7f558415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570974552 0 0) 0x7f558415a160 con 0x7f5584159890 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c003570 con 0x7f5584159890 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537334900 0 0) 0x7f556c003570 con 0x7f5584159890 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 >> v2:172.21.15.133:3300/0 conn(0x7f5584159c60 msgr2=0x7f558415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 --2- 172.21.15.46:0/2609524745 >> v2:172.21.15.133:3300/0 conn(0x7f5584159c60 0x7f558415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 >> v1:172.21.15.133:6789/0 conn(0x7f558415db10 legacy=0x7f5584069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558415e140 con 0x7f5584159890 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7f5574001470 con 0x7f5584159890 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 >> v1:172.21.15.46:6789/0 conn(0x7f5584159890 legacy=0x7f558415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c003a60 0x7f556c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 0x7f556c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556c0051c0 0x7f556c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c00c0a0 con 0x7f556c004810 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c00c210 con 0x7f556c0051c0 2023-10-07T09:10:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.737+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c00c3d0 con 0x7f556c003a60 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 0x7f556c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f5582d9d700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c003a60 0x7f556c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558359e700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556c0051c0 0x7f556c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 -- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c003a60 msgr2=0x7f556c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c003a60 0x7f556c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 -- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556c0051c0 msgr2=0x7f556c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556c0051c0 0x7f556c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558359e700 1 -- 172.21.15.46:0/2609524745 reap_dead start 2023-10-07T09:10:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 -- 172.21.15.46:0/2609524745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c003570 con 0x7f556c004810 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f558259c700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 0x7f556c004c80 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c00 tx=0x7f55780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d18d11bbc2e3601 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800e710 con 0x7f556c004810 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557800e870 con 0x7f556c004810 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.738+0000 7f5581d9b700 1 -- 172.21.15.46:0/2609524745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800ec30 con 0x7f556c004810 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 -- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 msgr2=0x7f556c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 0x7f556c004c80 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c00 tx=0x7f55780091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 -- 172.21.15.46:0/2609524745 shutdown_connections 2023-10-07T09:10:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 --2- 172.21.15.46:0/2609524745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556c004810 0x7f556c004c80 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 -- 172.21.15.46:0/2609524745 >> 172.21.15.46:0/2609524745 conn(0x7f5584068e20 msgr2=0x7f55840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 -- 172.21.15.46:0/2609524745 shutdown_connections 2023-10-07T09:10:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.739+0000 7f55890ce700 1 -- 172.21.15.46:0/2609524745 wait complete. 2023-10-07T09:10:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.740+0000 7f55890ce700 1 Processor -- start 2023-10-07T09:10:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.740+0000 7f55890ce700 1 -- start start 2023-10-07T09:10:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 0x7f55840cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584151360 0x7f55840b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558416d1d0 con 0x7f55840b1e40 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cd4a0 con 0x7f5584151360 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cd780 con 0x7f556c004810 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33448/0 (socket says 172.21.15.46:33448) 2023-10-07T09:10:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 -- 172.21.15.46:0/3027905526 learned_addr learned my addr 172.21.15.46:0/3027905526 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f5582d9d700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 0x7f55840cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558259c700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584151360 0x7f55840b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 -- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 msgr2=0x7f55840cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 0x7f55840cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 -- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584151360 msgr2=0x7f55840b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584151360 0x7f55840b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 -- 172.21.15.46:0/3027905526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840cda60 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f5582d9d700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 0x7f55840cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f558359e700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f55840cadc0 tx=0x7f557c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c006e80 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c014480 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840cdd40 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c014840 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55840cd0c0 con 0x7f55840b1e40 2023-10-07T09:10:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.742+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558416d380 con 0x7f55840b1e40 2023-10-07T09:10:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.743+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f557c007070 con 0x7f55840b1e40 2023-10-07T09:10:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.743+0000 7f556affd700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 0x7f55700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.743+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f557c084610 con 0x7f55840b1e40 2023-10-07T09:10:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.744+0000 7f5582d9d700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 0x7f55700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.744+0000 7f5582d9d700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 0x7f55700697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f55740015a0 tx=0x7f5574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.748+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f558416d380 con 0x7f55840b1e40 2023-10-07T09:10:13.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.942+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f558404c3c0 con 0x7f5570067320 2023-10-07T09:10:13.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.942+0000 7f556affd700 1 -- 172.21.15.46:0/3027905526 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f558404c3c0 con 0x7f5570067320 2023-10-07T09:10:13.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 msgr2=0x7f55700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 0x7f55700697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f55740015a0 tx=0x7f5574009040 comp rx=0 tx=0).stop 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 msgr2=0x7f5584152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f55840cadc0 tx=0x7f557c001640 comp rx=0 tx=0).stop 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 shutdown_connections 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f5570067320 0x7f55700697d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55840b1e40 0x7f5584152ad0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f556c004810 0x7f55840cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 --2- 172.21.15.46:0/3027905526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584151360 0x7f55840b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:13.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 >> 172.21.15.46:0/3027905526 conn(0x7f5584068e20 msgr2=0x7f558414d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:13.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 shutdown_connections 2023-10-07T09:10:13.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:13.945+0000 7f55890ce700 1 -- 172.21.15.46:0/3027905526 wait complete. 2023-10-07T09:10:13.948 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2023-10-07T09:10:13.958 INFO:tasks.ceph:Scrubbing osd.4 2023-10-07T09:10:13.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:14.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.080+0000 7fd77937f700 1 Processor -- start 2023-10-07T09:10:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.080+0000 7fd77937f700 1 -- start start 2023-10-07T09:10:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd77937f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 0x7fd7740ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd77937f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd7740ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd77937f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740b5b00 con 0x7fd774159ec0 2023-10-07T09:10:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd77937f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740b5da0 con 0x7fd7740cd910 2023-10-07T09:10:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd77937f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740b6080 con 0x7fd7740b55a0 2023-10-07T09:10:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd772ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd774159ec0 0x7fd7740b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60622/0 (socket says 172.21.15.46:60622) 2023-10-07T09:10:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd772ffd700 1 -- 172.21.15.46:0/4178491476 learned_addr learned my addr 172.21.15.46:0/4178491476 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd7737fe700 1 --2- 172.21.15.46:0/4178491476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd7740ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.081+0000 7fd7727fc700 1 --2- 172.21.15.46:0/4178491476 >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 0x7fd7740ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd771ffb700 1 -- 172.21.15.46:0/4178491476 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829548184 0 0) 0x7fd7740b5b00 con 0x7fd774159ec0 2023-10-07T09:10:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd771ffb700 1 -- 172.21.15.46:0/4178491476 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd760003570 con 0x7fd774159ec0 2023-10-07T09:10:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7737fe700 1 -- 172.21.15.46:0/4178491476 >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 msgr2=0x7fd7740ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7737fe700 1 --2- 172.21.15.46:0/4178491476 >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 0x7fd7740ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7737fe700 1 -- 172.21.15.46:0/4178491476 >> v1:172.21.15.46:6789/0 conn(0x7fd774159ec0 legacy=0x7fd7740b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7737fe700 1 -- 172.21.15.46:0/4178491476 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740cc100 con 0x7fd7740b55a0 2023-10-07T09:10:14.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7727fc700 1 --2- 172.21.15.46:0/4178491476 >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 0x7fd7740ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:14.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd7737fe700 1 --2- 172.21.15.46:0/4178491476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd7740ce880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd764009e90 tx=0x7fd764009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dd54a8f84d0c54c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd771ffb700 1 -- 172.21.15.46:0/4178491476 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400e070 con 0x7fd7740b55a0 2023-10-07T09:10:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd771ffb700 1 -- 172.21.15.46:0/4178491476 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400bb40 con 0x7fd7740b55a0 2023-10-07T09:10:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.082+0000 7fd771ffb700 1 -- 172.21.15.46:0/4178491476 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764012430 con 0x7fd7740b55a0 2023-10-07T09:10:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 -- 172.21.15.46:0/4178491476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 msgr2=0x7fd7740ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 --2- 172.21.15.46:0/4178491476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd7740ce880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd764009e90 tx=0x7fd764009780 comp rx=0 tx=0).stop 2023-10-07T09:10:14.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 -- 172.21.15.46:0/4178491476 shutdown_connections 2023-10-07T09:10:14.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 --2- 172.21.15.46:0/4178491476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd7740ce880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 --2- 172.21.15.46:0/4178491476 >> v2:172.21.15.133:3300/0 conn(0x7fd7740cd910 0x7fd7740ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 -- 172.21.15.46:0/4178491476 >> 172.21.15.46:0/4178491476 conn(0x7fd7740999f0 msgr2=0x7fd7740b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 -- 172.21.15.46:0/4178491476 shutdown_connections 2023-10-07T09:10:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.083+0000 7fd77937f700 1 -- 172.21.15.46:0/4178491476 wait complete. 2023-10-07T09:10:14.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.084+0000 7fd77937f700 1 Processor -- start 2023-10-07T09:10:14.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.084+0000 7fd77937f700 1 -- start start 2023-10-07T09:10:14.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd77406a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd774159ec0 0x7fd77406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 0x7fd774169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774147ac0 con 0x7fd7741691e0 2023-10-07T09:10:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77416aec0 con 0x7fd774159ec0 2023-10-07T09:10:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd77937f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77416a320 con 0x7fd7740b55a0 2023-10-07T09:10:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 0x7fd774169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 0x7fd774169630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33464/0 (socket says 172.21.15.46:33464) 2023-10-07T09:10:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 -- 172.21.15.46:0/2054453562 learned_addr learned my addr 172.21.15.46:0/2054453562 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd772ffd700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd77406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7727fc700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd774159ec0 0x7fd77406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 -- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 msgr2=0x7fd77406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7740b55a0 0x7fd77406a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 -- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd774159ec0 msgr2=0x7fd77406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd774159ec0 0x7fd77406a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.085+0000 7fd7737fe700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009420 con 0x7fd7741691e0 2023-10-07T09:10:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd7737fe700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 0x7fd774169630 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd76400b610 tx=0x7fd764019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764027470 con 0x7fd7741691e0 2023-10-07T09:10:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7640275d0 con 0x7fd7741691e0 2023-10-07T09:10:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764009a20 con 0x7fd7741691e0 2023-10-07T09:10:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764027990 con 0x7fd7741691e0 2023-10-07T09:10:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.086+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77416a870 con 0x7fd7741691e0 2023-10-07T09:10:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.087+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd774063c90 con 0x7fd7741691e0 2023-10-07T09:10:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.087+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd764024070 con 0x7fd7741691e0 2023-10-07T09:10:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd76affd700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd754067320 0x7fd7540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd7640870d0 con 0x7fd7741691e0 2023-10-07T09:10:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd76affd700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7fd75406d170 0x7fd75406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75406fc50 con 0x7fd75406d170 2023-10-07T09:10:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd764089580 con 0x7fd7741691e0 2023-10-07T09:10:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd772ffd700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd754067320 0x7fd7540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd7727fc700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7fd75406d170 0x7fd75406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.088+0000 7fd772ffd700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd754067320 0x7fd7540697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd76c001360 tx=0x7fd76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.089+0000 7fd7727fc700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7fd75406d170 0x7fd75406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.089+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== osd.4 v2:172.21.15.133:6800/91062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd75406fc50 con 0x7fd75406d170 2023-10-07T09:10:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.103+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 --> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7740718b0 con 0x7fd75406d170 2023-10-07T09:10:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd76affd700 1 -- 172.21.15.46:0/2054453562 <== osd.4 v2:172.21.15.133:6800/91062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd7740718b0 con 0x7fd75406d170 2023-10-07T09:10:14.106 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:14.107 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:14.107 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7fd75406d170 msgr2=0x7fd75406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6800/91062,v1:172.21.15.133:6801/91062] conn(0x7fd75406d170 0x7fd75406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd754067320 msgr2=0x7fd7540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fd754067320 0x7fd7540697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd76c001360 tx=0x7fd76c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 msgr2=0x7fd774169630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 --2- 172.21.15.46:0/2054453562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7741691e0 0x7fd774169630 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd76400b610 tx=0x7fd764019000 comp rx=0 tx=0).stop 2023-10-07T09:10:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd7737fe700 1 -- 172.21.15.46:0/2054453562 reap_dead start 2023-10-07T09:10:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 shutdown_connections 2023-10-07T09:10:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 >> 172.21.15.46:0/2054453562 conn(0x7fd7740999f0 msgr2=0x7fd7740c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 shutdown_connections 2023-10-07T09:10:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.104+0000 7fd77937f700 1 -- 172.21.15.46:0/2054453562 wait complete. 2023-10-07T09:10:14.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-07T09:10:14.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.236+0000 7f320d2a6700 1 Processor -- start 2023-10-07T09:10:14.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.236+0000 7f320d2a6700 1 -- start start 2023-10-07T09:10:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 0x7f32080cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32080b5fb0 0x7f32081598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f320815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080d01f0 con 0x7f32080b5fb0 2023-10-07T09:10:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080cf5e0 con 0x7f32081594d0 2023-10-07T09:10:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080cf8c0 con 0x7f3208159de0 2023-10-07T09:10:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32080b5fb0 0x7f32081598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32080b5fb0 0x7f32081598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33476/0 (socket says 172.21.15.46:33476) 2023-10-07T09:10:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 -- 172.21.15.46:0/3144580189 learned_addr learned my addr 172.21.15.46:0/3144580189 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32077fe700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f320815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f3206ffd700 1 --2- 172.21.15.46:0/3144580189 >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 0x7f32080cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 -- 172.21.15.46:0/3144580189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 msgr2=0x7f320815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f320815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 -- 172.21.15.46:0/3144580189 >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 msgr2=0x7f32080cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 --2- 172.21.15.46:0/3144580189 >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 0x7f32080cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 -- 172.21.15.46:0/3144580189 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080cfba0 con 0x7f32080b5fb0 2023-10-07T09:10:14.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f3206ffd700 1 --2- 172.21.15.46:0/3144580189 >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 0x7f32080cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:14.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f32067fc700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f32081598a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3208089720 tx=0x7f31f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18182d33561ec5c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f3205ffb700 1 -- 172.21.15.46:0/3144580189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000b860 con 0x7f32080b5fb0 2023-10-07T09:10:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f3205ffb700 1 -- 172.21.15.46:0/3144580189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000b9c0 con 0x7f32080b5fb0 2023-10-07T09:10:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f3205ffb700 1 -- 172.21.15.46:0/3144580189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000bd60 con 0x7f32080b5fb0 2023-10-07T09:10:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- 172.21.15.46:0/3144580189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 msgr2=0x7f32081598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f32081598a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3208089720 tx=0x7f31f0009250 comp rx=0 tx=0).stop 2023-10-07T09:10:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- 172.21.15.46:0/3144580189 shutdown_connections 2023-10-07T09:10:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f320815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- 172.21.15.46:0/3144580189 >> v2:172.21.15.133:3300/0 conn(0x7f32081594d0 0x7f32080cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 --2- 172.21.15.46:0/3144580189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f32081598a0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- 172.21.15.46:0/3144580189 >> 172.21.15.46:0/3144580189 conn(0x7f32080d05f0 msgr2=0x7f32080d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- 172.21.15.46:0/3144580189 shutdown_connections 2023-10-07T09:10:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.238+0000 7f320d2a6700 1 -- 172.21.15.46:0/3144580189 wait complete. 2023-10-07T09:10:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 Processor -- start 2023-10-07T09:10:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 -- start start 2023-10-07T09:10:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32081594d0 0x7f320815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f3208152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320815ed10 con 0x7f32080b5fb0 2023-10-07T09:10:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3208169770 con 0x7f32081594d0 2023-10-07T09:10:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f320d2a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3208157990 con 0x7f3208159de0 2023-10-07T09:10:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f3206ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f3206ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33488/0 (socket says 172.21.15.46:33488) 2023-10-07T09:10:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.240+0000 7f3206ffd700 1 -- 172.21.15.46:0/1311355559 learned_addr learned my addr 172.21.15.46:0/1311355559 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 -- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 msgr2=0x7f3208152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f3208152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 -- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32081594d0 msgr2=0x7f320815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32081594d0 0x7f320815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 -- 172.21.15.46:0/1311355559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00094f0 con 0x7f32080b5fb0 2023-10-07T09:10:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f3206ffd700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f320000a400 tx=0x7f3200007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000d650 con 0x7f32080b5fb0 2023-10-07T09:10:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320000d7b0 con 0x7f32080b5fb0 2023-10-07T09:10:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3208157c70 con 0x7f32080b5fb0 2023-10-07T09:10:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000db50 con 0x7f32080b5fb0 2023-10-07T09:10:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.241+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3208158230 con 0x7f32080b5fb0 2023-10-07T09:10:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.242+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320804c3c0 con 0x7f32080b5fb0 2023-10-07T09:10:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.243+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3200015440 con 0x7f32080b5fb0 2023-10-07T09:10:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.243+0000 7f31feffd700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 0x7f31e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.243+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3200085260 con 0x7f32080b5fb0 2023-10-07T09:10:14.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.243+0000 7f32067fc700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 0x7f31e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.244+0000 7f32067fc700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 0x7f31e80697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3208089720 tx=0x7f31f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.248+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f320004e5a0 con 0x7f32080b5fb0 2023-10-07T09:10:14.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.441+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f32080b37f0 con 0x7f31e8067320 2023-10-07T09:10:14.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.441+0000 7f31feffd700 1 -- 172.21.15.46:0/1311355559 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32080b37f0 con 0x7f31e8067320 2023-10-07T09:10:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 msgr2=0x7f31e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 0x7f31e80697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3208089720 tx=0x7f31f0017000 comp rx=0 tx=0).stop 2023-10-07T09:10:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 msgr2=0x7f3208157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f320000a400 tx=0x7f3200007910 comp rx=0 tx=0).stop 2023-10-07T09:10:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 shutdown_connections 2023-10-07T09:10:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f31e8067320 0x7f31e80697d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3208159de0 0x7f3208152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32080b5fb0 0x7f3208157370 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 --2- 172.21.15.46:0/1311355559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32081594d0 0x7f320815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 >> 172.21.15.46:0/1311355559 conn(0x7f32080d05f0 msgr2=0x7f32080cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 shutdown_connections 2023-10-07T09:10:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.443+0000 7f320d2a6700 1 -- 172.21.15.46:0/1311355559 wait complete. 2023-10-07T09:10:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2023-10-07T09:10:14.457 INFO:tasks.ceph:Scrubbing osd.5 2023-10-07T09:10:14.457 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.578+0000 7fb5b22dd700 1 Processor -- start 2023-10-07T09:10:14.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.578+0000 7fb5b22dd700 1 -- start start 2023-10-07T09:10:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5b22dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5ac0b55a0 0x7fb5ac164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5b22dd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0cfa60 con 0x7fb5ac159ec0 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5b22dd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0b5b00 con 0x7fb5ac0cd910 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5b22dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b5da0 con 0x7fb5ac0b55a0 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5abfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb5ac159ec0 0x7fb5ac0b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60632/0 (socket says 172.21.15.46:60632) 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5abfff700 1 -- 172.21.15.46:0/62494681 learned_addr learned my addr 172.21.15.46:0/62494681 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5b087a700 1 --2- 172.21.15.46:0/62494681 >> v2:172.21.15.133:3300/0 conn(0x7fb5ac0b55a0 0x7fb5ac164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085837336 0 0) 0x7fb5ac0cfa60 con 0x7fb5ac159ec0 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb598003570 con 0x7fb5ac159ec0 2023-10-07T09:10:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722110192 0 0) 0x7fb5ac0b5b00 con 0x7fb5ac0cd910 2023-10-07T09:10:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ac0cfa60 con 0x7fb5ac0cd910 2023-10-07T09:10:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768184211 0 0) 0x7fb598003570 con 0x7fb5ac159ec0 2023-10-07T09:10:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 >> v2:172.21.15.133:3300/0 conn(0x7fb5ac0b55a0 msgr2=0x7fb5ac164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 --2- 172.21.15.46:0/62494681 >> v2:172.21.15.133:3300/0 conn(0x7fb5ac0b55a0 0x7fb5ac164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 >> v1:172.21.15.133:6789/0 conn(0x7fb5ac0cd910 legacy=0x7fb5ac0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0b6080 con 0x7fb5ac159ec0 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7fb59c0015f0 con 0x7fb5ac159ec0 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 >> v1:172.21.15.46:6789/0 conn(0x7fb5ac159ec0 legacy=0x7fb5ac0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb598003c40 0x7fb598004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb598004810 0x7fb598004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb59800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b5da0 con 0x7fb598005210 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800c130 con 0x7fb598003c40 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.579+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800c2f0 con 0x7fb598004810 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb59800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5abfff700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb598003c40 0x7fb598004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5ab7fe700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb598004810 0x7fb598004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 -- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb598004810 msgr2=0x7fb598004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb598004810 0x7fb598004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 -- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb598003c40 msgr2=0x7fb598004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb598003c40 0x7fb598004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 -- 172.21.15.46:0/62494681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598003570 con 0x7fb598005210 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 -- 172.21.15.46:0/62494681 reap_dead start 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5b087a700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb59800ba60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400e210 tx=0x7fb5a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ada6818c68c8f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400eac0 con 0x7fb598005210 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400f040 con 0x7fb598005210 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.580+0000 7fb5aaffd700 1 -- 172.21.15.46:0/62494681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400ee70 con 0x7fb598005210 2023-10-07T09:10:14.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 -- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 msgr2=0x7fb59800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb59800ba60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400e210 tx=0x7fb5a400b040 comp rx=0 tx=0).stop 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 -- 172.21.15.46:0/62494681 shutdown_connections 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 --2- 172.21.15.46:0/62494681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb59800ba60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 -- 172.21.15.46:0/62494681 >> 172.21.15.46:0/62494681 conn(0x7fb5ac0999f0 msgr2=0x7fb5ac0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 -- 172.21.15.46:0/62494681 shutdown_connections 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.581+0000 7fb5b22dd700 1 -- 172.21.15.46:0/62494681 wait complete. 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.582+0000 7fb5b22dd700 1 Processor -- start 2023-10-07T09:10:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.582+0000 7fb5b22dd700 1 -- start start 2023-10-07T09:10:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb5ac1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5ac0c98c0 0x7fb5ac0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac153400 0x7fb5ac1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1529f0 con 0x7fb598005210 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0ca270 con 0x7fb5ac153400 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac151c00 con 0x7fb5ac0c98c0 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb5ac1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb5ac1516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33502/0 (socket says 172.21.15.46:33502) 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 -- 172.21.15.46:0/3853561084 learned_addr learned my addr 172.21.15.46:0/3853561084 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b087a700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac153400 0x7fb5ac1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5ab7fe700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5ac0c98c0 0x7fb5ac0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 -- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5ac0c98c0 msgr2=0x7fb5ac0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5ac0c98c0 0x7fb5ac0c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 -- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac153400 msgr2=0x7fb5ac1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac153400 0x7fb5ac1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac06a670 con 0x7fb598005210 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b087a700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac153400 0x7fb5ac1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5abfff700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb5ac1516c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00f910 tx=0x7fb59c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00fe50 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0072e0 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac06a950 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0076a0 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.583+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac152c00 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.584+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5ac063c90 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb59c005a00 con 0x7fb598005210 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb58c067320 0x7fb58c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb59c085430 con 0x7fb598005210 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fb58c06d000 0x7fb58c06f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb58c06fae0 con 0x7fb58c06d000 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb59c0857c0 con 0x7fb598005210 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.585+0000 7fb5ab7fe700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb58c067320 0x7fb58c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.586+0000 7fb5b087a700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fb58c06d000 0x7fb58c06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.586+0000 7fb5ab7fe700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb58c067320 0x7fb58c0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0c6040 tx=0x7fb594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.586+0000 7fb5b087a700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fb58c06d000 0x7fb58c06f410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.588+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== osd.5 v2:172.21.15.133:6817/91092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb58c06fae0 con 0x7fb58c06d000 2023-10-07T09:10:14.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.600+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 --> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5ac06adf0 con 0x7fb58c06d000 2023-10-07T09:10:14.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5a3fff700 1 -- 172.21.15.46:0/3853561084 <== osd.5 v2:172.21.15.133:6817/91092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb5ac06adf0 con 0x7fb58c06d000 2023-10-07T09:10:14.603 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:14.603 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:14.603 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:14.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fb58c06d000 msgr2=0x7fb58c06f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6817/91092,v1:172.21.15.133:6819/91092] conn(0x7fb58c06d000 0x7fb58c06f410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb58c067320 msgr2=0x7fb58c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb58c067320 0x7fb58c0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0c6040 tx=0x7fb594009040 comp rx=0 tx=0).stop 2023-10-07T09:10:14.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 msgr2=0x7fb5ac1516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 --2- 172.21.15.46:0/3853561084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb598005210 0x7fb5ac1516c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00f910 tx=0x7fb59c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b087a700 1 -- 172.21.15.46:0/3853561084 reap_dead start 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 shutdown_connections 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 >> 172.21.15.46:0/3853561084 conn(0x7fb5ac0999f0 msgr2=0x7fb5ac0cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 shutdown_connections 2023-10-07T09:10:14.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.601+0000 7fb5b22dd700 1 -- 172.21.15.46:0/3853561084 wait complete. 2023-10-07T09:10:14.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-07T09:10:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.732+0000 7fbf9359e700 1 Processor -- start 2023-10-07T09:10:14.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.732+0000 7fbf9359e700 1 -- start start 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.733+0000 7fbf9359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf9406e8c0 0x7fbf940c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.733+0000 7fbf9359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 0x7fbf940b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.733+0000 7fbf9359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9415aa30 con 0x7fbf94153df0 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.733+0000 7fbf9359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940c8aa0 con 0x7fbf9406e8c0 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.733+0000 7fbf9359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415a100 con 0x7fbf940c8660 2023-10-07T09:10:14.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf91d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf9406e8c0 0x7fbf940c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 0x7fbf940b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbf94153df0 0x7fbf94063230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.46:52908/0 (socket says 172.21.15.46:52908) 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9259c700 1 -- 172.21.15.46:0/3155251873 learned_addr learned my addr 172.21.15.46:0/3155251873 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9159a700 1 -- 172.21.15.46:0/3155251873 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286411433 0 0) 0x7fbf9415aa30 con 0x7fbf94153df0 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9159a700 1 -- 172.21.15.46:0/3155251873 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf80003570 con 0x7fbf94153df0 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 -- 172.21.15.46:0/3155251873 >> v2:172.21.15.133:3300/0 conn(0x7fbf9406e8c0 msgr2=0x7fbf940c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 --2- 172.21.15.46:0/3155251873 >> v2:172.21.15.133:3300/0 conn(0x7fbf9406e8c0 0x7fbf940c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 -- 172.21.15.46:0/3155251873 >> v1:172.21.15.133:6789/0 conn(0x7fbf94153df0 legacy=0x7fbf94063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 -- 172.21.15.46:0/3155251873 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9415a3e0 con 0x7fbf940c8660 2023-10-07T09:10:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf92d9d700 1 --2- 172.21.15.46:0/3155251873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 0x7fbf940b0bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0098e0 tx=0x7fbf8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a34ba422e8e4bab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9159a700 1 -- 172.21.15.46:0/3155251873 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c011630 con 0x7fbf940c8660 2023-10-07T09:10:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9159a700 1 -- 172.21.15.46:0/3155251873 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c011790 con 0x7fbf940c8660 2023-10-07T09:10:14.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.734+0000 7fbf9159a700 1 -- 172.21.15.46:0/3155251873 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c011b30 con 0x7fbf940c8660 2023-10-07T09:10:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 -- 172.21.15.46:0/3155251873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 msgr2=0x7fbf940b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 --2- 172.21.15.46:0/3155251873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 0x7fbf940b0bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0098e0 tx=0x7fbf8c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 -- 172.21.15.46:0/3155251873 shutdown_connections 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 --2- 172.21.15.46:0/3155251873 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf940c8660 0x7fbf940b0bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 --2- 172.21.15.46:0/3155251873 >> v2:172.21.15.133:3300/0 conn(0x7fbf9406e8c0 0x7fbf940c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 -- 172.21.15.46:0/3155251873 >> 172.21.15.46:0/3155251873 conn(0x7fbf9406ddb0 msgr2=0x7fbf9406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 -- 172.21.15.46:0/3155251873 shutdown_connections 2023-10-07T09:10:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.735+0000 7fbf9359e700 1 -- 172.21.15.46:0/3155251873 wait complete. 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.736+0000 7fbf9359e700 1 Processor -- start 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.736+0000 7fbf9359e700 1 -- start start 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9406e8c0 0x7fbf9416cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf94153df0 0x7fbf94146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf941588f0 con 0x7fbf940c8660 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9416de00 con 0x7fbf9406e8c0 2023-10-07T09:10:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94151150 con 0x7fbf94153df0 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33508/0 (socket says 172.21.15.46:33508) 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 -- 172.21.15.46:0/1129946958 learned_addr learned my addr 172.21.15.46:0/1129946958 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf9259c700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9406e8c0 0x7fbf9416cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf92d9d700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf94153df0 0x7fbf94146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 -- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf94153df0 msgr2=0x7fbf94146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf94153df0 0x7fbf94146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 -- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9406e8c0 msgr2=0x7fbf9416cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9406e8c0 0x7fbf9416cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 -- 172.21.15.46:0/1129946958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c009420 con 0x7fbf940c8660 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.737+0000 7fbf91d9b700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00e960 tx=0x7fbf7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c013680 con 0x7fbf940c8660 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0137e0 con 0x7fbf940c8660 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9416d560 con 0x7fbf940c8660 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c013b80 con 0x7fbf940c8660 2023-10-07T09:10:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9416db20 con 0x7fbf940c8660 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.738+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf941512c0 con 0x7fbf940c8660 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.739+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbf7c0123d0 con 0x7fbf940c8660 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.739+0000 7fbf8a7fc700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 0x7fbf740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.739+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbf7c084a60 con 0x7fbf940c8660 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.740+0000 7fbf9259c700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 0x7fbf740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.740+0000 7fbf9259c700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 0x7fbf740697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005c50 tx=0x7fbf84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.744+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf7c0519f0 con 0x7fbf940c8660 2023-10-07T09:10:14.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.937+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf9404c3c0 con 0x7fbf74067320 2023-10-07T09:10:14.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.937+0000 7fbf8a7fc700 1 -- 172.21.15.46:0/1129946958 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf9404c3c0 con 0x7fbf74067320 2023-10-07T09:10:14.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 msgr2=0x7fbf740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 0x7fbf740697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005c50 tx=0x7fbf84009040 comp rx=0 tx=0).stop 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 msgr2=0x7fbf941583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00e960 tx=0x7fbf7c0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 shutdown_connections 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fbf74067320 0x7fbf740697d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf94153df0 0x7fbf94146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9406e8c0 0x7fbf9416cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 --2- 172.21.15.46:0/1129946958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf940c8660 0x7fbf941583b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:14.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 >> 172.21.15.46:0/1129946958 conn(0x7fbf9406ddb0 msgr2=0x7fbf940ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:14.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 shutdown_connections 2023-10-07T09:10:14.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:14.939+0000 7fbf9359e700 1 -- 172.21.15.46:0/1129946958 wait complete. 2023-10-07T09:10:14.944 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2023-10-07T09:10:14.953 INFO:tasks.ceph:Scrubbing osd.6 2023-10-07T09:10:14.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:15.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.075+0000 7fea5c9bf700 1 Processor -- start 2023-10-07T09:10:15.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.075+0000 7fea5c9bf700 1 -- start start 2023-10-07T09:10:15.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.076+0000 7fea5c9bf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea580b55a0 0x7fea58164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.076+0000 7fea5c9bf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580cfa60 con 0x7fea580cd910 2023-10-07T09:10:15.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.076+0000 7fea5c9bf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580b5b00 con 0x7fea58159ec0 2023-10-07T09:10:15.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.076+0000 7fea5c9bf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea580b5da0 con 0x7fea580b55a0 2023-10-07T09:10:15.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea580b55a0 0x7fea58164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea55d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fea580cd910 0x7fea580ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60648/0 (socket says 172.21.15.46:60648) 2023-10-07T09:10:15.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea580b55a0 0x7fea58164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33520/0 (socket says 172.21.15.46:33520) 2023-10-07T09:10:15.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea55d9b700 1 -- 172.21.15.46:0/134242276 learned_addr learned my addr 172.21.15.46:0/134242276 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:15.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 -- 172.21.15.46:0/134242276 >> v1:172.21.15.133:6789/0 conn(0x7fea58159ec0 legacy=0x7fea580b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 -- 172.21.15.46:0/134242276 >> v1:172.21.15.46:6789/0 conn(0x7fea580cd910 legacy=0x7fea580ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 -- 172.21.15.46:0/134242276 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580b6080 con 0x7fea580b55a0 2023-10-07T09:10:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea56d9d700 1 --2- 172.21.15.46:0/134242276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580b55a0 0x7fea58164400 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fea48009e90 tx=0x7fea48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d52a7ab05e5046 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea5559a700 1 -- 172.21.15.46:0/134242276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800e070 con 0x7fea580b55a0 2023-10-07T09:10:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea5559a700 1 -- 172.21.15.46:0/134242276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800bbf0 con 0x7fea580b55a0 2023-10-07T09:10:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.077+0000 7fea5559a700 1 -- 172.21.15.46:0/134242276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48012430 con 0x7fea580b55a0 2023-10-07T09:10:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 -- 172.21.15.46:0/134242276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580b55a0 msgr2=0x7fea58164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 --2- 172.21.15.46:0/134242276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580b55a0 0x7fea58164400 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fea48009e90 tx=0x7fea48009780 comp rx=0 tx=0).stop 2023-10-07T09:10:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 -- 172.21.15.46:0/134242276 shutdown_connections 2023-10-07T09:10:15.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 --2- 172.21.15.46:0/134242276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580b55a0 0x7fea58164400 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 -- 172.21.15.46:0/134242276 >> 172.21.15.46:0/134242276 conn(0x7fea580999f0 msgr2=0x7fea580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 -- 172.21.15.46:0/134242276 shutdown_connections 2023-10-07T09:10:15.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.078+0000 7fea5c9bf700 1 -- 172.21.15.46:0/134242276 wait complete. 2023-10-07T09:10:15.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.079+0000 7fea5c9bf700 1 Processor -- start 2023-10-07T09:10:15.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.079+0000 7fea5c9bf700 1 -- start start 2023-10-07T09:10:15.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea580b55a0 0x7fea58154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 0x7fea581510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea58169c10 0x7fea580c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58155200 con 0x7fea58159ec0 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58151c90 con 0x7fea58169c10 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5c9bf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58068900 con 0x7fea580b55a0 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 0x7fea581510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 0x7fea581510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33534/0 (socket says 172.21.15.46:33534) 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 -- 172.21.15.46:0/925883210 learned_addr learned my addr 172.21.15.46:0/925883210 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea5659c700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea580b55a0 0x7fea58154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea56d9d700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea58169c10 0x7fea580c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 -- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea580b55a0 msgr2=0x7fea58154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea580b55a0 0x7fea58154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 -- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea58169c10 msgr2=0x7fea580c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea58169c10 0x7fea580c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48009a20 con 0x7fea58159ec0 2023-10-07T09:10:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea56d9d700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea58169c10 0x7fea580c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.080+0000 7fea55d9b700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 0x7fea581510e0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c7c0 tx=0x7fea40007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40005b30 con 0x7fea58159ec0 2023-10-07T09:10:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40005cb0 con 0x7fea58159ec0 2023-10-07T09:10:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea58068be0 con 0x7fea58159ec0 2023-10-07T09:10:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40004a80 con 0x7fea58159ec0 2023-10-07T09:10:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea580691a0 con 0x7fea58159ec0 2023-10-07T09:10:15.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.081+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea58063c90 con 0x7fea58159ec0 2023-10-07T09:10:15.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.082+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fea400070d0 con 0x7fea58159ec0 2023-10-07T09:10:15.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.082+0000 7fea4e7fc700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea38067320 0x7fea380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.082+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fea40083cb0 con 0x7fea58159ec0 2023-10-07T09:10:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.082+0000 7fea4e7fc700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7fea3806d170 0x7fea3806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea3806fc50 con 0x7fea3806d170 2023-10-07T09:10:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea40086210 con 0x7fea58159ec0 2023-10-07T09:10:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea5659c700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea38067320 0x7fea380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea56d9d700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7fea3806d170 0x7fea3806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea5659c700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea38067320 0x7fea380697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fea580c60d0 tx=0x7fea50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.083+0000 7fea56d9d700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7fea3806d170 0x7fea3806f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.084+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== osd.6 v2:172.21.15.133:6808/91063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fea3806fc50 con 0x7fea3806d170 2023-10-07T09:10:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.098+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 --> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea580718b0 con 0x7fea3806d170 2023-10-07T09:10:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea4e7fc700 1 -- 172.21.15.46:0/925883210 <== osd.6 v2:172.21.15.133:6808/91063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fea580718b0 con 0x7fea3806d170 2023-10-07T09:10:15.100 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:15.100 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:15.100 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7fea3806d170 msgr2=0x7fea3806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6808/91063,v1:172.21.15.133:6809/91063] conn(0x7fea3806d170 0x7fea3806f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea38067320 msgr2=0x7fea380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fea38067320 0x7fea380697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fea580c60d0 tx=0x7fea50009040 comp rx=0 tx=0).stop 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 msgr2=0x7fea581510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 --2- 172.21.15.46:0/925883210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58159ec0 0x7fea581510e0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c7c0 tx=0x7fea40007f40 comp rx=0 tx=0).stop 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea56d9d700 1 -- 172.21.15.46:0/925883210 reap_dead start 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 shutdown_connections 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 >> 172.21.15.46:0/925883210 conn(0x7fea580999f0 msgr2=0x7fea580ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 shutdown_connections 2023-10-07T09:10:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.099+0000 7fea5c9bf700 1 -- 172.21.15.46:0/925883210 wait complete. 2023-10-07T09:10:15.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-07T09:10:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.230+0000 7f1adb307700 1 Processor -- start 2023-10-07T09:10:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 -- start start 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad4159890 0x7f1ad415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ad4159c60 0x7f1ad415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ad415db10 0x7f1ad4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad415a160 con 0x7f1ad415db10 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40d13a0 con 0x7f1ad4159c60 2023-10-07T09:10:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.231+0000 7f1adb307700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad415e140 con 0x7f1ad4159890 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ad415db10 0x7f1ad4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ad415db10 0x7f1ad4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33542/0 (socket says 172.21.15.46:33542) 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 -- 172.21.15.46:0/986403846 learned_addr learned my addr 172.21.15.46:0/986403846 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad90a3700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad4159890 0x7f1ad415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad88a2700 1 --2- 172.21.15.46:0/986403846 >> v2:172.21.15.133:3300/0 conn(0x7f1ad4159c60 0x7f1ad415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 -- 172.21.15.46:0/986403846 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad4159890 msgr2=0x7f1ad415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad4159890 0x7f1ad415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 -- 172.21.15.46:0/986403846 >> v2:172.21.15.133:3300/0 conn(0x7f1ad4159c60 msgr2=0x7f1ad415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 --2- 172.21.15.46:0/986403846 >> v2:172.21.15.133:3300/0 conn(0x7f1ad4159c60 0x7f1ad415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 -- 172.21.15.46:0/986403846 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad415a3d0 con 0x7f1ad415db10 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad98a4700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad415db10 0x7f1ad4069560 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40650f0 tx=0x7f1ac4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc2ceef1e37319f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad3fff700 1 -- 172.21.15.46:0/986403846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400e070 con 0x7f1ad415db10 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad3fff700 1 -- 172.21.15.46:0/986403846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400b970 con 0x7f1ad415db10 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.232+0000 7f1ad3fff700 1 -- 172.21.15.46:0/986403846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40092e0 con 0x7f1ad415db10 2023-10-07T09:10:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 -- 172.21.15.46:0/986403846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad415db10 msgr2=0x7f1ad4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad415db10 0x7f1ad4069560 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40650f0 tx=0x7f1ac4009840 comp rx=0 tx=0).stop 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 -- 172.21.15.46:0/986403846 shutdown_connections 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad415db10 0x7f1ad4069560 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 --2- 172.21.15.46:0/986403846 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad4159890 0x7f1ad415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 --2- 172.21.15.46:0/986403846 >> v2:172.21.15.133:3300/0 conn(0x7f1ad4159c60 0x7f1ad415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 -- 172.21.15.46:0/986403846 >> 172.21.15.46:0/986403846 conn(0x7f1ad4068e20 msgr2=0x7f1ad40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 -- 172.21.15.46:0/986403846 shutdown_connections 2023-10-07T09:10:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.233+0000 7f1adb307700 1 -- 172.21.15.46:0/986403846 wait complete. 2023-10-07T09:10:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.234+0000 7f1adb307700 1 Processor -- start 2023-10-07T09:10:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.234+0000 7f1adb307700 1 -- start start 2023-10-07T09:10:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad4159890 0x7f1ad4151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 0x7f1ad4142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b28f0 con 0x7f1ad4159c60 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4142990 con 0x7f1ad4159890 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1adb307700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad416a7f0 con 0x7f1ad415db10 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33546/0 (socket says 172.21.15.46:33546) 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 -- 172.21.15.46:0/3397346379 learned_addr learned my addr 172.21.15.46:0/3397346379 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad90a3700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad4159890 0x7f1ad4151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad98a4700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 0x7f1ad4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 -- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 msgr2=0x7f1ad4142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 0x7f1ad4142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 -- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad4159890 msgr2=0x7f1ad4151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad4159890 0x7f1ad4151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 -- 172.21.15.46:0/3397346379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009ae0 con 0x7f1ad4159c60 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad98a4700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 0x7f1ad4142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.235+0000 7f1ad88a2700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ec80 tx=0x7f1ac80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.236+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800c850 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.236+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800c9b0 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.236+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4169be0 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.236+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800cd70 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.236+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad416a1a0 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.237+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad416a980 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.237+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1ac8013680 con 0x7f1ad4159c60 2023-10-07T09:10:15.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.237+0000 7f1ad17fa700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 0x7f1ac00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.238+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ac8084bb0 con 0x7f1ad4159c60 2023-10-07T09:10:15.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.238+0000 7f1ad90a3700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 0x7f1ac00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.238+0000 7f1ad90a3700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 0x7f1ac00697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415d340 tx=0x7f1acc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.242+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ac8051b40 con 0x7f1ad4159c60 2023-10-07T09:10:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.435+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad404c3c0 con 0x7f1ac0067320 2023-10-07T09:10:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.436+0000 7f1ad17fa700 1 -- 172.21.15.46:0/3397346379 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ad404c3c0 con 0x7f1ac0067320 2023-10-07T09:10:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 msgr2=0x7f1ac00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 0x7f1ac00697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415d340 tx=0x7f1acc0091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 msgr2=0x7f1ad40b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ec80 tx=0x7f1ac80091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 shutdown_connections 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f1ac0067320 0x7f1ac00697d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad415db10 0x7f1ad4142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad4159890 0x7f1ad4151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 --2- 172.21.15.46:0/3397346379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad4159c60 0x7f1ad40b23b0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 >> 172.21.15.46:0/3397346379 conn(0x7f1ad4068e20 msgr2=0x7f1ad41583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 shutdown_connections 2023-10-07T09:10:15.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.438+0000 7f1adb307700 1 -- 172.21.15.46:0/3397346379 wait complete. 2023-10-07T09:10:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2023-10-07T09:10:15.451 INFO:tasks.ceph:Scrubbing osd.7 2023-10-07T09:10:15.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-07T09:10:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.573+0000 7f95ab082700 1 Processor -- start 2023-10-07T09:10:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.573+0000 7f95ab082700 1 -- start start 2023-10-07T09:10:15.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95ab082700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95a40b42c0 0x7f95a40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95ab082700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a40cefd0 con 0x7f95a4155360 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95ab082700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a415c320 con 0x7f95a40ceb60 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95ab082700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a415b710 con 0x7f95a40b42c0 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95a8e1e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95a4155360 0x7f95a40b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60650/0 (socket says 172.21.15.46:60650) 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95a8e1e700 1 -- 172.21.15.46:0/3128578549 learned_addr learned my addr 172.21.15.46:0/3128578549 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.574+0000 7f95a3fff700 1 --2- 172.21.15.46:0/3128578549 >> v2:172.21.15.46:3300/0 conn(0x7f95a40b42c0 0x7f95a40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a37fe700 1 -- 172.21.15.46:0/3128578549 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962223829 0 0) 0x7f959c001490 con 0x7f95a4155360 2023-10-07T09:10:15.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a37fe700 1 -- 172.21.15.46:0/3128578549 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c003570 con 0x7f95a4155360 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a3fff700 1 -- 172.21.15.46:0/3128578549 >> v1:172.21.15.133:6789/0 conn(0x7f95a40ceb60 legacy=0x7f95a40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a3fff700 1 -- 172.21.15.46:0/3128578549 >> v1:172.21.15.46:6789/0 conn(0x7f95a4155360 legacy=0x7f95a40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a3fff700 1 -- 172.21.15.46:0/3128578549 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a415b9f0 con 0x7f95a40b42c0 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a3fff700 1 --2- 172.21.15.46:0/3128578549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a40b42c0 0x7f95a40ce620 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f95980098e0 tx=0x7f95980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cd450d41ac47db server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a37fe700 1 -- 172.21.15.46:0/3128578549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800b640 con 0x7f95a40b42c0 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a37fe700 1 -- 172.21.15.46:0/3128578549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800b7a0 con 0x7f95a40b42c0 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.575+0000 7f95a37fe700 1 -- 172.21.15.46:0/3128578549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800bb40 con 0x7f95a40b42c0 2023-10-07T09:10:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 -- 172.21.15.46:0/3128578549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a40b42c0 msgr2=0x7f95a40ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 --2- 172.21.15.46:0/3128578549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a40b42c0 0x7f95a40ce620 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f95980098e0 tx=0x7f95980091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 -- 172.21.15.46:0/3128578549 shutdown_connections 2023-10-07T09:10:15.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 --2- 172.21.15.46:0/3128578549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a40b42c0 0x7f95a40ce620 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 -- 172.21.15.46:0/3128578549 >> 172.21.15.46:0/3128578549 conn(0x7f95a406baf0 msgr2=0x7f95a406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 -- 172.21.15.46:0/3128578549 shutdown_connections 2023-10-07T09:10:15.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.576+0000 7f95ab082700 1 -- 172.21.15.46:0/3128578549 wait complete. 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.577+0000 7f95ab082700 1 Processor -- start 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.577+0000 7f95ab082700 1 -- start start 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a40b42c0 0x7f95a414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40ceb60 0x7f95a414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 0x7f95a40adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40af750 con 0x7f95a4155360 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a414efd0 con 0x7f95a40ceb60 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41537c0 con 0x7f95a40b42c0 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 0x7f95a40adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 0x7f95a40adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33576/0 (socket says 172.21.15.46:33576) 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 -- 172.21.15.46:0/2663689960 learned_addr learned my addr 172.21.15.46:0/2663689960 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a3fff700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40ceb60 0x7f95a414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a8e1e700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a40b42c0 0x7f95a414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 -- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a40b42c0 msgr2=0x7f95a414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95a40b42c0 0x7f95a414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 -- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40ceb60 msgr2=0x7f95a414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95a40ceb60 0x7f95a414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009420 con 0x7f95a4155360 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a961f700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 0x7f95a40adee0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f959400c560 tx=0x7f9594007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594001120 con 0x7f95a4155360 2023-10-07T09:10:15.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594011590 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a4153aa0 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594011950 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.578+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a414d880 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.579+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95a414eae0 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9594011d00 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9594083e40 con 0x7f95a4155360 2023-10-07T09:10:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f959006d170 0x7f959006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f959006fc50 con 0x7f959006d170 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a8e1e700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.580+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9594086340 con 0x7f95a4155360 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.581+0000 7f95a3fff700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f959006d170 0x7f959006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.581+0000 7f95a8e1e700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f959c0015f0 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.581+0000 7f95a3fff700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f959006d170 0x7f959006f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.582+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== osd.7 v2:172.21.15.133:6816/91093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f959006fc50 con 0x7f959006d170 2023-10-07T09:10:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.596+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 --> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95a40718b0 con 0x7f959006d170 2023-10-07T09:10:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.596+0000 7f95a0ff9700 1 -- 172.21.15.46:0/2663689960 <== osd.7 v2:172.21.15.133:6816/91093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f95a40718b0 con 0x7f959006d170 2023-10-07T09:10:15.598 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-07T09:10:15.599 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-07T09:10:15.599 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-07T09:10:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f959006d170 msgr2=0x7f959006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6816/91093,v1:172.21.15.133:6818/91093] conn(0x7f959006d170 0x7f959006f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 msgr2=0x7f95900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f9590067320 0x7f95900697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f959c0015f0 tx=0x7f959c009040 comp rx=0 tx=0).stop 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 msgr2=0x7f95a40adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 --2- 172.21.15.46:0/2663689960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4155360 0x7f95a40adee0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f959400c560 tx=0x7f9594007ef0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95a961f700 1 -- 172.21.15.46:0/2663689960 reap_dead start 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 shutdown_connections 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 >> 172.21.15.46:0/2663689960 conn(0x7f95a406baf0 msgr2=0x7f95a40b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 shutdown_connections 2023-10-07T09:10:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.597+0000 7f95ab082700 1 -- 172.21.15.46:0/2663689960 wait complete. 2023-10-07T09:10:15.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-07T09:10:15.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.728+0000 7f2eb695b700 1 Processor -- start 2023-10-07T09:10:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 -- start start 2023-10-07T09:10:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 0x7f2eb015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2eb0159c60 0x7f2eb015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 0x7f2eb0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb015a160 con 0x7f2eb0159c60 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00d13a0 con 0x7f2eb015db10 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eb695b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb015e140 con 0x7f2eb0159890 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eaf7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2eb0159c60 0x7f2eb015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.729+0000 7f2eaf7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2eb0159c60 0x7f2eb015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33582/0 (socket says 172.21.15.46:33582) 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 -- 172.21.15.46:0/3710500560 learned_addr learned my addr 172.21.15.46:0/3710500560 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaffff700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 0x7f2eb015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eb4ef8700 1 --2- 172.21.15.46:0/3710500560 >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 0x7f2eb0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 -- 172.21.15.46:0/3710500560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 msgr2=0x7f2eb015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 0x7f2eb015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 -- 172.21.15.46:0/3710500560 >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 msgr2=0x7f2eb0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/3710500560 >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 0x7f2eb0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 -- 172.21.15.46:0/3710500560 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb015a3d0 con 0x7f2eb0159c60 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaffff700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 0x7f2eb015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eb4ef8700 1 --2- 172.21.15.46:0/3710500560 >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 0x7f2eb0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159c60 0x7f2eb015d5d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0089b50 tx=0x7f2ea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59f1d756c146bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaeffd700 1 -- 172.21.15.46:0/3710500560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000b860 con 0x7f2eb0159c60 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaeffd700 1 -- 172.21.15.46:0/3710500560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000b9c0 con 0x7f2eb0159c60 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.730+0000 7f2eaeffd700 1 -- 172.21.15.46:0/3710500560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000bd60 con 0x7f2eb0159c60 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 -- 172.21.15.46:0/3710500560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159c60 msgr2=0x7f2eb015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159c60 0x7f2eb015d5d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0089b50 tx=0x7f2ea0009250 comp rx=0 tx=0).stop 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 -- 172.21.15.46:0/3710500560 shutdown_connections 2023-10-07T09:10:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 --2- 172.21.15.46:0/3710500560 >> v2:172.21.15.133:3300/0 conn(0x7f2eb015db10 0x7f2eb0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159890 0x7f2eb015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 --2- 172.21.15.46:0/3710500560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159c60 0x7f2eb015d5d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 -- 172.21.15.46:0/3710500560 >> 172.21.15.46:0/3710500560 conn(0x7f2eb0068e20 msgr2=0x7f2eb00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 -- 172.21.15.46:0/3710500560 shutdown_connections 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.731+0000 7f2eb695b700 1 -- 172.21.15.46:0/3710500560 wait complete. 2023-10-07T09:10:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.732+0000 7f2eb695b700 1 Processor -- start 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.732+0000 7f2eb695b700 1 -- start start 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159c60 0x7f2eb00cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb015db10 0x7f2eb0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00cffc0 con 0x7f2eb0159890 2023-10-07T09:10:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b3730 con 0x7f2eb015db10 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b3a10 con 0x7f2eb0159c60 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33588/0 (socket says 172.21.15.46:33588) 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 -- 172.21.15.46:0/164040591 learned_addr learned my addr 172.21.15.46:0/164040591 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159c60 0x7f2eb00cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb4ef8700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb015db10 0x7f2eb0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 -- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159c60 msgr2=0x7f2eb00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159c60 0x7f2eb00cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 -- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb015db10 msgr2=0x7f2eb0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb015db10 0x7f2eb0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 -- 172.21.15.46:0/164040591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00094f0 con 0x7f2eb0159890 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eaffff700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e8d0 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800ee70 con 0x7f2eb0159890 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9800c5e0 con 0x7f2eb0159890 2023-10-07T09:10:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00b3cf0 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800c980 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.733+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb00ca660 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.734+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00b4340 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.735+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2e98013410 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.735+0000 7f2ea7fff700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 0x7f2e900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.735+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2e98084860 con 0x7f2eb0159890 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.735+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 0x7f2e900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.736+0000 7f2eaf7fe700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 0x7f2e900697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0089b50 tx=0x7f2ea0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:15.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.740+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e98055170 con 0x7f2eb0159890 2023-10-07T09:10:15.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.934+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2eb004c3c0 con 0x7f2e90067320 2023-10-07T09:10:15.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.934+0000 7f2ea7fff700 1 -- 172.21.15.46:0/164040591 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2eb004c3c0 con 0x7f2e90067320 2023-10-07T09:10:15.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 msgr2=0x7f2e900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 0x7f2e900697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0089b50 tx=0x7f2ea0017000 comp rx=0 tx=0).stop 2023-10-07T09:10:15.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 msgr2=0x7f2eb00ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:15.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e8d0 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2023-10-07T09:10:15.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 shutdown_connections 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f2e90067320 0x7f2e900697d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb015db10 0x7f2eb0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2eb0159890 0x7f2eb00ca120 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 --2- 172.21.15.46:0/164040591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb0159c60 0x7f2eb00cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 >> 172.21.15.46:0/164040591 conn(0x7f2eb0068e20 msgr2=0x7f2eb00c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 shutdown_connections 2023-10-07T09:10:15.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:15.936+0000 7f2eb695b700 1 -- 172.21.15.46:0/164040591 wait complete. 2023-10-07T09:10:15.939 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2023-10-07T09:10:15.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:10:16.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.068+0000 7fc70e361700 1 Processor -- start 2023-10-07T09:10:16.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.068+0000 7fc70e361700 1 -- start start 2023-10-07T09:10:16.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70e361700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc708159890 0x7fc70815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70e361700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc708159c60 0x7fc70815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70e361700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70815a160 con 0x7fc70815db10 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70e361700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70815df50 con 0x7fc708159890 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70e361700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080d13a0 con 0x7fc708159c60 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc707fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc708159890 0x7fc70815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70c8fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc70815db10 0x7fc708069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60664/0 (socket says 172.21.15.46:60664) 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc70c8fe700 1 -- 172.21.15.46:0/1081916524 learned_addr learned my addr 172.21.15.46:0/1081916524 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.069+0000 7fc7077fe700 1 --2- 172.21.15.46:0/1081916524 >> v2:172.21.15.133:3300/0 conn(0x7fc708159c60 0x7fc70815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:16.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc707fff700 1 -- 172.21.15.46:0/1081916524 >> v2:172.21.15.133:3300/0 conn(0x7fc708159c60 msgr2=0x7fc70815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc707fff700 1 --2- 172.21.15.46:0/1081916524 >> v2:172.21.15.133:3300/0 conn(0x7fc708159c60 0x7fc70815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc707fff700 1 -- 172.21.15.46:0/1081916524 >> v1:172.21.15.46:6789/0 conn(0x7fc70815db10 legacy=0x7fc708069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc706ffd700 1 -- 172.21.15.46:0/1081916524 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334505062 0 0) 0x7fc70815a160 con 0x7fc70815db10 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc707fff700 1 -- 172.21.15.46:0/1081916524 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70815e140 con 0x7fc708159890 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc707fff700 1 --2- 172.21.15.46:0/1081916524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc708159890 0x7fc70815abd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b67f0 tx=0x7fc6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d976e50eb75a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc706ffd700 1 -- 172.21.15.46:0/1081916524 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0011630 con 0x7fc708159890 2023-10-07T09:10:16.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc706ffd700 1 -- 172.21.15.46:0/1081916524 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0011790 con 0x7fc708159890 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc706ffd700 1 -- 172.21.15.46:0/1081916524 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0011b30 con 0x7fc708159890 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 -- 172.21.15.46:0/1081916524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc708159890 msgr2=0x7fc70815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 --2- 172.21.15.46:0/1081916524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc708159890 0x7fc70815abd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b67f0 tx=0x7fc6f00091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 -- 172.21.15.46:0/1081916524 shutdown_connections 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 --2- 172.21.15.46:0/1081916524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc708159890 0x7fc70815abd0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 --2- 172.21.15.46:0/1081916524 >> v2:172.21.15.133:3300/0 conn(0x7fc708159c60 0x7fc70815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 -- 172.21.15.46:0/1081916524 >> 172.21.15.46:0/1081916524 conn(0x7fc708068e20 msgr2=0x7fc7080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 -- 172.21.15.46:0/1081916524 shutdown_connections 2023-10-07T09:10:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.070+0000 7fc70e361700 1 -- 172.21.15.46:0/1081916524 wait complete. 2023-10-07T09:10:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 Processor -- start 2023-10-07T09:10:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 -- start start 2023-10-07T09:10:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc708159890 0x7fc7080c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 0x7fc7081576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c91b0 con 0x7fc70815db10 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70816a480 con 0x7fc708159c60 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.072+0000 7fc70e361700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c8ed0 con 0x7fc708159890 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33616/0 (socket says 172.21.15.46:33616) 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 -- 172.21.15.46:0/3040650333 learned_addr learned my addr 172.21.15.46:0/3040650333 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 -- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc708159890 msgr2=0x7fc7080c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc708159890 0x7fc7080c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc7077fe700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 0x7fc7081576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 -- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 msgr2=0x7fc7081576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 0x7fc7081576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 -- 172.21.15.46:0/3040650333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009420 con 0x7fc70815db10 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc7077fe700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 0x7fc7081576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70c8fe700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc70000cc40 tx=0x7fc700001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:16.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000a920 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70000aaa0 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc708169e30 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000ae60 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.073+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080c8bc0 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.074+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70804c3c0 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.075+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc700007300 con 0x7fc70815db10 2023-10-07T09:10:16.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.075+0000 7fc6fffff700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 0x7fc6e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:16.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.075+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc700084ce0 con 0x7fc70815db10 2023-10-07T09:10:16.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.075+0000 7fc707fff700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 0x7fc6e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:16.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.076+0000 7fc707fff700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 0x7fc6e80697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc70815a6e0 tx=0x7fc6f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:16.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.079+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc700051cf0 con 0x7fc70815db10 2023-10-07T09:10:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.266+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7080b0120 con 0x7fc6e8067320 2023-10-07T09:10:16.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.268+0000 7fc6fffff700 1 -- 172.21.15.46:0/3040650333 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51054 (secure 0 0 0) 0x7fc7080b0120 con 0x7fc6e8067320 2023-10-07T09:10:16.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:16.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 msgr2=0x7fc6e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 0x7fc6e80697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc70815a6e0 tx=0x7fc6f0017000 comp rx=0 tx=0).stop 2023-10-07T09:10:16.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 msgr2=0x7fc7080c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc70000cc40 tx=0x7fc700001970 comp rx=0 tx=0).stop 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 shutdown_connections 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fc6e8067320 0x7fc6e80697d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc70815db10 0x7fc7080c78a0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc708159890 0x7fc7080c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 --2- 172.21.15.46:0/3040650333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc708159c60 0x7fc7081576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.270+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 >> 172.21.15.46:0/3040650333 conn(0x7fc708068e20 msgr2=0x7fc708153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.271+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 shutdown_connections 2023-10-07T09:10:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:16.271+0000 7fc70e361700 1 -- 172.21.15.46:0/3040650333 wait complete. 2023-10-07T09:10:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:10:16.283 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":550,"stamp":"2023-10-07T09:10:15.931816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448936,"kb_used_data":21480,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752525784,"statfs":{"total":773094113280,"available":770586402816,"internally_reserved":0,"allocated":21995520,"data_stored":10506696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.510094"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":328,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-10-07T09:10:06.422686+0000","last_change":"2023-10-07T08:58:33.623709+0000","last_active":"2023-10-07T09:10:06.422686+0000","last_peered":"2023-10-07T09:10:06.422686+0000","last_clean":"2023-10-07T09:10:06.422686+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:10:06.422686+0000","last_undegraded":"2023-10-07T09:10:06.422686+0000","last_fullsized":"2023-10-07T09:10:06.422686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:58:32.226575+0000","last_clean_scrub_stamp":"2023-10-07T08:58:32.226575+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:40.798269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304504,"kb_used_data":3120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067336,"statfs":{"total":96636764160,"available":96324952064,"internally_reserved":0,"allocated":3194880,"data_stored":1756113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.23599999999999999},"max":{"1min":0.71099999999999997,"5min":0.753,"15min":0.85799999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.81399999999999995,"15min":0.96099999999999997},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26700000000000002},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":0.83899999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":0.93000000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88600000000000001},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.82899999999999996,"15min":0.86299999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.84599999999999997},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64200000000000002,"5min":0.81699999999999995,"15min":0.84999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"last":0.747}]},{"osd":5,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.89000000000000001,"15min":0.89500000000000002},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69399999999999995,"5min":0.82499999999999996,"15min":0.93000000000000005},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.88400000000000001},"last":0.82899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.84199999999999997},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.35999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.87,"15min":0.87},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75600000000000001,"5min":0.81299999999999994,"15min":1.29},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":4.0880000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.49199999999999999,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.84899999999999998},"last":0.747}]},{"osd":4,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.503},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.84199999999999997,"15min":0.91900000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.371},"max":{"1min":0.76800000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34100000000000003},"min":{"1min":0.245,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.57999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.30199999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.65700000000000003,"15min":1.3859999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.33300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.59799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.90400000000000003,"15min":11.32},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":1.077,"15min":11.880000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66700000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67800000000000005,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.875,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.1899999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66500000000000004,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":5.3920000000000003},"last":0.626}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.325,"15min":4.5209999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93600000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.59899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308600,"kb_used_data":3120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063240,"statfs":{"total":96636764160,"available":96320757760,"internally_reserved":0,"allocated":3194880,"data_stored":1756113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.372},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.191},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24099999999999999},"max":{"1min":0.61399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.437}]},{"osd":4,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.378,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.53300000000000003,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.86599999999999999,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.49399999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":0.84899999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.55500000000000005,"5min":0.41299999999999998,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.53500000000000003,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.96299999999999997,"15min":1},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.52300000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":1.01,"15min":1.01},"last":0.54600000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.60499999999999998,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":1.0389999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":10.214},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.308,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":1.1899999999999999},"last":0.374}]},{"osd":1,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.70599999999999996,"15min":0.755},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.42799999999999999,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":10.144},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.44500000000000001,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":10.071},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.64100000000000001,"5min":0.68799999999999994,"15min":10.183},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.51300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76900000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":1.0549999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.89200000000000002},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.64100000000000001,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0880000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":4.4240000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.94399999999999995},"min":{"1min":0.61799999999999999,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89600000000000002,"15min":4.391},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.61299999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.93799999999999994,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.52600000000000002,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.309},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.48599999999999999,"5min":0.54600000000000004,"15min":12.038},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46200000000000002,"5min":0.622,"15min":2.3450000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.42699999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":2.3380000000000001},"last":0.379}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40300000000000002,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":6.1230000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.432,"15min":0.443},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":1.2330000000000001},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.751},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.81399999999999995,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.318},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":2.081},"last":0.54300000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.35199999999999998},"max":{"1min":0.77200000000000002,"5min":0.85699999999999998,"15min":2.1099999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.505,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.92800000000000005,"15min":2.1960000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.135,"15min":12.007},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":2.0459999999999998},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.52400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.81299999999999994},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.84599999999999997,"5min":1.179,"15min":11.973000000000001},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.67600000000000005},"min":{"1min":0.39100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.63600000000000001,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.63200000000000001},"min":{"1min":0.41599999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.505}]},{"osd":1,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.75900000000000001},"min":{"1min":0.499,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.73299999999999998},"min":{"1min":0.42699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82599999999999996,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.629},{"interface":"front","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":10.01},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.88100000000000001,"15min":5.569},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.73199999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76800000000000002,"5min":0.93500000000000005,"15min":10.131},"last":0.752}]},{"osd":5,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.66500000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82499999999999996}]},{"osd":7,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.70299999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.78800000000000003,"15min":1.127},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":9.7799999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.499,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":6.3970000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":6.5650000000000004},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":1.478},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":2.9249999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67300000000000004,"5min":0.77800000000000002,"15min":0.96799999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":2.1400000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":3.9470000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.0740000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91600000000000004},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:10:16.287 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-07T08:58:32.226575+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=7, tm_hour=8, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=280, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=7, tm_hour=9, tm_min=10, tm_sec=10, tm_wday=5, tm_yday=280, tm_isdst=0) 2023-10-07T09:10:16.287 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-07T09:10:36.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T09:10:36.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.420+0000 7ff19379e700 1 Processor -- start 2023-10-07T09:10:36.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 -- start start 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff18c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff18c0ccf90 0x7ff18c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0cc300 con 0x7ff18c0cbf30 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c156bf0 con 0x7ff18c0ccf90 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.421+0000 7ff19379e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0ae950 con 0x7ff18c0b1420 2023-10-07T09:10:36.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff19153a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff18c0cbf30 0x7ff18c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53462/0 (socket says 172.21.15.46:53462) 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff19153a700 1 -- 172.21.15.46:0/2212769 learned_addr learned my addr 172.21.15.46:0/2212769 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff191d3b700 1 --2- 172.21.15.46:0/2212769 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0ccf90 0x7ff18c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff190d39700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff18c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398318778 0 0) 0x7ff18c0cc300 con 0x7ff18c0cbf30 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff174003570 con 0x7ff18c0cbf30 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184720114 0 0) 0x7ff174003570 con 0x7ff18c0cbf30 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 msgr2=0x7ff18c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:36.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff18c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0ccf90 msgr2=0x7ff18c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 --2- 172.21.15.46:0/2212769 >> v2:172.21.15.133:3300/0 conn(0x7ff18c0ccf90 0x7ff18c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0ad370 con 0x7ff18c0cbf30 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2357511240 0 0) 0x7ff17c0017f0 con 0x7ff18c0cbf30 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 >> v1:172.21.15.46:6789/0 conn(0x7ff18c0cbf30 legacy=0x7ff18c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174003a90 0x7ff174003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174004810 0x7ff174004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff1740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c156bf0 con 0x7ff174004810 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0ae950 con 0x7ff174003a90 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17400ba60 con 0x7ff18c0b1420 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.422+0000 7ff190d39700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174004810 0x7ff174004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff191d3b700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff1740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff19153a700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174003a90 0x7ff174003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 -- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 msgr2=0x7ff1740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:36.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c0b1420 0x7ff1740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 -- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174003a90 msgr2=0x7ff174003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174003a90 0x7ff174003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 -- 172.21.15.46:0/2212769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff174003570 con 0x7ff174004810 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff190d39700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174004810 0x7ff174004c80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7ff180009c30 tx=0x7ff1800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd011b94b3ad43f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000e710 con 0x7ff174004810 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18000e870 con 0x7ff174004810 2023-10-07T09:10:36.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.423+0000 7ff18bfff700 1 -- 172.21.15.46:0/2212769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000ec30 con 0x7ff174004810 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 -- 172.21.15.46:0/2212769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174004810 msgr2=0x7ff174004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 --2- 172.21.15.46:0/2212769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff174004810 0x7ff174004c80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7ff180009c30 tx=0x7ff1800091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff191d3b700 1 -- 172.21.15.46:0/2212769 reap_dead start 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 -- 172.21.15.46:0/2212769 shutdown_connections 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 -- 172.21.15.46:0/2212769 >> 172.21.15.46:0/2212769 conn(0x7ff18c06a320 msgr2=0x7ff18c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 -- 172.21.15.46:0/2212769 shutdown_connections 2023-10-07T09:10:36.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.424+0000 7ff19379e700 1 -- 172.21.15.46:0/2212769 wait complete. 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.425+0000 7ff19379e700 1 Processor -- start 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.425+0000 7ff19379e700 1 -- start start 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174004810 0x7ff18c154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c1596d0 0x7ff18c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c158630 con 0x7ff18c0c7260 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c158910 con 0x7ff174004810 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19379e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c158bf0 con 0x7ff18c1596d0 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32856/0 (socket says 172.21.15.46:32856) 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 -- 172.21.15.46:0/3783064789 learned_addr learned my addr 172.21.15.46:0/3783064789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff19153a700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174004810 0x7ff18c154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff190d39700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c1596d0 0x7ff18c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 -- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c1596d0 msgr2=0x7ff18c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c1596d0 0x7ff18c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 -- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174004810 msgr2=0x7ff18c154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174004810 0x7ff18c154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 -- 172.21.15.46:0/3783064789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c158ed0 con 0x7ff18c0c7260 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.426+0000 7ff191d3b700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b03d0 tx=0x7ff1840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.427+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184013750 con 0x7ff18c0c7260 2023-10-07T09:10:36.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.427+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1840138b0 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.427+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c1591b0 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.427+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184013c50 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.427+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c158290 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.428+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c04c3c0 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.429+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff184014650 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.429+0000 7ff1897fa700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.429+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff184085240 con 0x7ff18c0c7260 2023-10-07T09:10:36.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.429+0000 7ff19153a700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.430+0000 7ff19153a700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001580 tx=0x7ff17c006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.433+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff184052350 con 0x7ff18c0c7260 2023-10-07T09:10:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.620+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 --> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff18c0ad650 con 0x7ff178067320 2023-10-07T09:10:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.622+0000 7ff1897fa700 1 -- 172.21.15.46:0/3783064789 <== mgr.4100 v2:172.21.15.133:6832/90477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51070 (secure 0 0 0) 0x7ff18c0ad650 con 0x7ff178067320 2023-10-07T09:10:36.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 msgr2=0x7ff1780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001580 tx=0x7ff17c006040 comp rx=0 tx=0).stop 2023-10-07T09:10:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 msgr2=0x7ff18c0a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b03d0 tx=0x7ff1840091a0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 shutdown_connections 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7ff178067320 0x7ff1780697d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff18c0c7260 0x7ff18c0a5610 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174004810 0x7ff18c154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 --2- 172.21.15.46:0/3783064789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff18c1596d0 0x7ff18c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.624+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 >> 172.21.15.46:0/3783064789 conn(0x7ff18c06a320 msgr2=0x7ff18c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.625+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 shutdown_connections 2023-10-07T09:10:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.625+0000 7ff19379e700 1 -- 172.21.15.46:0/3783064789 wait complete. 2023-10-07T09:10:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-07T09:10:36.637 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-10-07T09:10:35.935985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448936,"kb_used_data":21480,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752525784,"statfs":{"total":773094113280,"available":770586402816,"internally_reserved":0,"allocated":21995520,"data_stored":10506696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002429"},"pg_stats":[{"pgid":"1.0","version":"204'119","reported_seq":341,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-07T09:10:18.448055+0000","last_change":"2023-10-07T09:10:18.448026+0000","last_active":"2023-10-07T09:10:18.448055+0000","last_peered":"2023-10-07T09:10:18.448055+0000","last_clean":"2023-10-07T09:10:18.448055+0000","last_became_active":"2023-10-07T08:58:33.622689+0000","last_became_peered":"2023-10-07T08:58:33.622689+0000","last_unstale":"2023-10-07T09:10:18.448055+0000","last_undegraded":"2023-10-07T09:10:18.448055+0000","last_fullsized":"2023-10-07T09:10:18.448055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'119","last_scrub_stamp":"2023-10-07T09:10:18.447926+0000","last_deep_scrub":"204'119","last_deep_scrub_stamp":"2023-10-07T09:10:18.447926+0000","last_clean_scrub_stamp":"2023-10-07T09:10:18.447926+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:19.303714+0000","scrub_duration":0.0052203919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304504,"kb_used_data":3120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067336,"statfs":{"total":96636764160,"available":96324952064,"internally_reserved":0,"allocated":3194880,"data_stored":1756113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.23599999999999999},"max":{"1min":0.71099999999999997,"5min":0.753,"15min":0.85799999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.81399999999999995,"15min":0.96099999999999997},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26700000000000002},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":0.83899999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":0.93000000000000005},"last":0.745},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88600000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.82899999999999996,"15min":0.86299999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.84599999999999997},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64200000000000002,"5min":0.81699999999999995,"15min":0.84999999999999998},"last":0.5},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.90700000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.38,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.89000000000000001,"15min":0.89500000000000002},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:10:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69399999999999995,"5min":0.82499999999999996,"15min":0.93000000000000005},"last":0.629},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.88400000000000001},"last":0.73399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.84199999999999997},"last":0.628}]},{"osd":1,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.35999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.87,"15min":0.87},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75600000000000001,"5min":0.81299999999999994,"15min":1.29},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":4.0880000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.49199999999999999,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.84899999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.504},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.85199999999999998,"15min":0.85999999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.84199999999999997,"15min":0.91900000000000004},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 7 09:10:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.85199999999999998,"15min":0.91000000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.371},"max":{"1min":0.76800000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34100000000000003},"min":{"1min":0.245,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.57999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.30199999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.65700000000000003,"15min":1.3859999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.33300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.59799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.90400000000000003,"15min":11.32},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":1.077,"15min":11.880000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.221},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66700000000000004},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67800000000000005,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.875,"5min":7.6509999999999998,"15min":7.6509999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":1.1899999999999999,"5min":2.9740000000000002,"15min":4.4850000000000003},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66500000000000004,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":1.4890000000000001,"15min":5.3540000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":5.3920000000000003},"last":0.86499999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.325,"15min":4.5209999999999999},"last":0.751},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93600000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308600,"kb_used_data":3120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063240,"statfs":{"total":96636764160,"available":96320757760,"internally_reserved":0,"allocated":3194880,"data_stored":1756113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.223,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.191},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.33500000000000002,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24099999999999999},"max":{"1min":0.61399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.378,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.95399999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.53300000000000003,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.86599999999999999,"5min":0.93500000000000005,"15min":0.95399999999999996},"last":0.66900000000000004}]},{"osd":5,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":0.84899999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.55500000000000005,"5min":0.41299999999999998,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.53500000000000003,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.96299999999999997,"15min":1},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.52300000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":1.01,"15min":1.01},"last":0.72899999999999998}]},{"osd":7,"last update":"Sat Oct 7 09:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.60499999999999998,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":1.0389999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":10.214},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.443,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.308,"5min":0.23799999999999999,"15min":0.214},"max":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":1.1899999999999999},"last":0.374}]},{"osd":1,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.28799999999999998,"5min":0.221,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.70599999999999996,"15min":0.755},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.42799999999999999,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":10.144},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.44500000000000001,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":10.071},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.64100000000000001,"5min":0.68799999999999994,"15min":10.183},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.51300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76900000000000002,"5min":0.99099999999999999,"15min":1.1579999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":1.0549999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.89200000000000002},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":1.3680000000000001,"15min":20.922000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.64100000000000001,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0880000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":4.4240000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.94399999999999995},"min":{"1min":0.61799999999999999,"5min":0.41899999999999998,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92400000000000004,"15min":20.963999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Oct 7 09:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89600000000000002,"15min":4.391},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.61299999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.93799999999999994,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.79600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308020,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063820,"statfs":{"total":96636764160,"available":96321351680,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.52600000000000002,"5min":0.61099999999999999,"15min":5.5709999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.48599999999999999,"5min":0.54600000000000004,"15min":12.038},"last":0.52800000000000002}]},{"osd":1,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46200000000000002,"5min":0.622,"15min":2.3450000000000002},"last":0.441},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.42699999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":2.3380000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40300000000000002,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":6.1230000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.432,"15min":0.443},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":1.2330000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.751},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.81399999999999995,"5min":1.1599999999999999,"15min":11.933999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.318},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":2.081},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.40600000000000003,"15min":0.35199999999999998},"max":{"1min":0.77200000000000002,"5min":0.85699999999999998,"15min":2.1099999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.505,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.92800000000000005,"15min":2.1960000000000002},"last":0.878}]},{"osd":6,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.135,"15min":12.007},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":2.0459999999999998},"last":0.89900000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.52400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":2.1699999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.81299999999999994},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"max":{"1min":0.84599999999999997,"5min":1.179,"15min":11.973000000000001},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.67600000000000005},"min":{"1min":0.39100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.63600000000000001,"5min":0.77400000000000002,"15min":9.7040000000000006},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.63200000000000001},"min":{"1min":0.41599999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":5.6319999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":9.8620000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.75900000000000001},"min":{"1min":0.499,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.82299999999999995,"15min":9.8439999999999994},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.73299999999999998},"min":{"1min":0.42699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82599999999999996,"5min":0.84099999999999997,"15min":9.9979999999999993},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.75700000000000001},"min":{"1min":0.46500000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":10.01},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.66800000000000004,"5min":0.88100000000000001,"15min":5.569},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.73199999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76800000000000002,"5min":0.93500000000000005,"15min":10.131},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.27800000000000002},"max":{"1min":0.66500000000000004,"5min":0.81599999999999995,"15min":0.82099999999999995},"last":0.44500000000000001}]},{"osd":6,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Oct 7 09:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.70299999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.78800000000000003,"15min":1.127},"last":0.497},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":9.7799999999999994},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.499,"5min":0.41099999999999998,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":6.3970000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":6.5650000000000004},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":1.478},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":2.9249999999999998},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67300000000000004,"5min":0.77800000000000002,"15min":0.96799999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.624}]},{"osd":6,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":2.1400000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":3.9470000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Sat Oct 7 09:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.0740000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91600000000000004},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T09:10:36.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-07T09:10:36.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.758+0000 7fb7c67da700 1 Processor -- start 2023-10-07T09:10:36.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.758+0000 7fb7c67da700 1 -- start start 2023-10-07T09:10:36.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c67da700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7c0159890 0x7fb7c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c67da700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7c0069560 0x7fb7c00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c67da700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c0069ee0 con 0x7fb7c0159c60 2023-10-07T09:10:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c67da700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c015a160 con 0x7fb7c0069560 2023-10-07T09:10:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c67da700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00d13a0 con 0x7fb7c0159890 2023-10-07T09:10:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7c4d77700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7c0069560 0x7fb7c00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7bf7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb7c0159c60 0x7fb7c015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53472/0 (socket says 172.21.15.46:53472) 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.759+0000 7fb7bf7fe700 1 -- 172.21.15.46:0/2322162482 learned_addr learned my addr 172.21.15.46:0/2322162482 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7bffff700 1 --2- 172.21.15.46:0/2322162482 >> v2:172.21.15.133:3300/0 conn(0x7fb7c0159890 0x7fb7c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7c4d77700 1 -- 172.21.15.46:0/2322162482 >> v2:172.21.15.133:3300/0 conn(0x7fb7c0159890 msgr2=0x7fb7c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7c4d77700 1 --2- 172.21.15.46:0/2322162482 >> v2:172.21.15.133:3300/0 conn(0x7fb7c0159890 0x7fb7c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7c4d77700 1 -- 172.21.15.46:0/2322162482 >> v1:172.21.15.46:6789/0 conn(0x7fb7c0159c60 legacy=0x7fb7c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7beffd700 1 -- 172.21.15.46:0/2322162482 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709580115 0 0) 0x7fb7c0069ee0 con 0x7fb7c0159c60 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7c4d77700 1 -- 172.21.15.46:0/2322162482 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c015e140 con 0x7fb7c0069560 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7c4d77700 1 --2- 172.21.15.46:0/2322162482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00699a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00d1090 tx=0x7fb7b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a9444c40e1f005 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7beffd700 1 -- 172.21.15.46:0/2322162482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800e070 con 0x7fb7c0069560 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7beffd700 1 -- 172.21.15.46:0/2322162482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800bc30 con 0x7fb7c0069560 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.760+0000 7fb7beffd700 1 -- 172.21.15.46:0/2322162482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8012430 con 0x7fb7c0069560 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 -- 172.21.15.46:0/2322162482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 msgr2=0x7fb7c00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2322162482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00699a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00d1090 tx=0x7fb7b8009780 comp rx=0 tx=0).stop 2023-10-07T09:10:36.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 -- 172.21.15.46:0/2322162482 shutdown_connections 2023-10-07T09:10:36.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2322162482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00699a0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2322162482 >> v2:172.21.15.133:3300/0 conn(0x7fb7c0159890 0x7fb7c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 -- 172.21.15.46:0/2322162482 >> 172.21.15.46:0/2322162482 conn(0x7fb7c0068e20 msgr2=0x7fb7c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:36.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 -- 172.21.15.46:0/2322162482 shutdown_connections 2023-10-07T09:10:36.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.761+0000 7fb7c67da700 1 -- 172.21.15.46:0/2322162482 wait complete. 2023-10-07T09:10:36.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.762+0000 7fb7c67da700 1 Processor -- start 2023-10-07T09:10:36.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.762+0000 7fb7c67da700 1 -- start start 2023-10-07T09:10:36.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c0159890 0x7fb7c0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 0x7fb7c01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00cf210 con 0x7fb7c0069560 2023-10-07T09:10:36.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00cf4f0 con 0x7fb7c0159890 2023-10-07T09:10:36.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c67da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00cf7d0 con 0x7fb7c0159c60 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32886/0 (socket says 172.21.15.46:32886) 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 -- 172.21.15.46:0/2387123061 learned_addr learned my addr 172.21.15.46:0/2387123061 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c4d77700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 0x7fb7c01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bf7fe700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c0159890 0x7fb7c0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 -- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 msgr2=0x7fb7c01552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 0x7fb7c01552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 -- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c0159890 msgr2=0x7fb7c0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c0159890 0x7fb7c0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 -- 172.21.15.46:0/2387123061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009a20 con 0x7fb7c0069560 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7c4d77700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 0x7fb7c01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7bffff700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d890 tx=0x7fb7a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.763+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800b600 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.764+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800b760 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.764+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c00cfab0 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.764+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800bae0 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.764+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c00ceec0 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.765+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c00cfe20 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.765+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb7a801e460 con 0x7fb7c0069560 2023-10-07T09:10:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.765+0000 7fb7b7fff700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 0x7fb7a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:36.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.765+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb7a8085020 con 0x7fb7c0069560 2023-10-07T09:10:36.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.766+0000 7fb7bf7fe700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 0x7fb7a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:36.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.766+0000 7fb7bf7fe700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 0x7fb7a00697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb7c01558c0 tx=0x7fb7b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:36.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.770+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7a8051fb0 con 0x7fb7c0069560 2023-10-07T09:10:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.961+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb7c00cf350 con 0x7fb7c0069560 2023-10-07T09:10:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.965+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7a8051fb0 con 0x7fb7c0069560 2023-10-07T09:10:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.966+0000 7fb7b7fff700 1 -- 172.21.15.46:0/2387123061 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb7c00cf350 con 0x7fb7c0069560 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 msgr2=0x7fb7a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 0x7fb7a00697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb7c01558c0 tx=0x7fb7b0009040 comp rx=0 tx=0).stop 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 msgr2=0x7fb7c00b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d890 tx=0x7fb7a8008040 comp rx=0 tx=0).stop 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 shutdown_connections 2023-10-07T09:10:36.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7fb7a0067320 0x7fb7a00697d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c0159c60 0x7fb7c01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c0069560 0x7fb7c00b5d70 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 --2- 172.21.15.46:0/2387123061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c0159890 0x7fb7c0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 >> 172.21.15.46:0/2387123061 conn(0x7fb7c0068e20 msgr2=0x7fb7c00cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 shutdown_connections 2023-10-07T09:10:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:36.968+0000 7fb7c67da700 1 -- 172.21.15.46:0/2387123061 wait complete. 2023-10-07T09:10:36.980 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T09:10:36.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T09:10:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.099+0000 7f7e77763700 1 Processor -- start 2023-10-07T09:10:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.099+0000 7f7e77763700 1 -- start start 2023-10-07T09:10:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e77763700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e77763700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 0x7f7e7015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e77763700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7015a160 con 0x7f7e7015db10 2023-10-07T09:10:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e77763700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700d13a0 con 0x7f7e70159c60 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e77763700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7015e140 con 0x7f7e70159890 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e75d00700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7e7015db10 0x7f7e70069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53482/0 (socket says 172.21.15.46:53482) 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e75d00700 1 -- 172.21.15.46:0/2554265351 learned_addr learned my addr 172.21.15.46:0/2554265351 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e74cfe700 1 --2- 172.21.15.46:0/2554265351 >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 0x7f7e7015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 --2- 172.21.15.46:0/2554265351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e67fff700 1 -- 172.21.15.46:0/2554265351 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704096523 0 0) 0x7f7e7015a160 con 0x7f7e7015db10 2023-10-07T09:10:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e67fff700 1 -- 172.21.15.46:0/2554265351 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003570 con 0x7f7e7015db10 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 -- 172.21.15.46:0/2554265351 >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 msgr2=0x7f7e7015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 --2- 172.21.15.46:0/2554265351 >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 0x7f7e7015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 -- 172.21.15.46:0/2554265351 >> v1:172.21.15.46:6789/0 conn(0x7f7e7015db10 legacy=0x7f7e70069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 -- 172.21.15.46:0/2554265351 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7015a3d0 con 0x7f7e70159890 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e74cfe700 1 --2- 172.21.15.46:0/2554265351 >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 0x7f7e7015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.100+0000 7f7e754ff700 1 --2- 172.21.15.46:0/2554265351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7015abd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e60 tx=0x7f7e6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ae1b985274c383 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e67fff700 1 -- 172.21.15.46:0/2554265351 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00e070 con 0x7f7e70159890 2023-10-07T09:10:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e67fff700 1 -- 172.21.15.46:0/2554265351 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e6c00bab0 con 0x7f7e70159890 2023-10-07T09:10:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e67fff700 1 -- 172.21.15.46:0/2554265351 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00be90 con 0x7f7e70159890 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 -- 172.21.15.46:0/2554265351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 msgr2=0x7f7e7015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 --2- 172.21.15.46:0/2554265351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7015abd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e60 tx=0x7f7e6c009780 comp rx=0 tx=0).stop 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 -- 172.21.15.46:0/2554265351 shutdown_connections 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 --2- 172.21.15.46:0/2554265351 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7015abd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 --2- 172.21.15.46:0/2554265351 >> v2:172.21.15.133:3300/0 conn(0x7f7e70159c60 0x7f7e7015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 -- 172.21.15.46:0/2554265351 >> 172.21.15.46:0/2554265351 conn(0x7f7e70068e20 msgr2=0x7f7e700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 -- 172.21.15.46:0/2554265351 shutdown_connections 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.101+0000 7f7e77763700 1 -- 172.21.15.46:0/2554265351 wait complete. 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.102+0000 7f7e77763700 1 Processor -- start 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.102+0000 7f7e77763700 1 -- start start 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7014c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e70159c60 0x7f7e700b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700cdf80 con 0x7f7e7015db10 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700b4750 con 0x7f7e70159c60 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e77763700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7014c910 con 0x7f7e70159890 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e75d00700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e75d00700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32900/0 (socket says 172.21.15.46:32900) 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e75d00700 1 -- 172.21.15.46:0/530747736 learned_addr learned my addr 172.21.15.46:0/530747736 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e754ff700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7014c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.103+0000 7f7e74cfe700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e70159c60 0x7f7e700b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 -- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 msgr2=0x7f7e7014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7014c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 -- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e70159c60 msgr2=0x7f7e700b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e70159c60 0x7f7e700b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 -- 172.21.15.46:0/530747736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009420 con 0x7f7e7015db10 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e75d00700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f7e680010e0 tx=0x7f7e68007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68005c00 con 0x7f7e7015db10 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e68005d60 con 0x7f7e7015db10 2023-10-07T09:10:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680072e0 con 0x7f7e7015db10 2023-10-07T09:10:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c009a20 con 0x7f7e7015db10 2023-10-07T09:10:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.104+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e700cd370 con 0x7f7e7015db10 2023-10-07T09:10:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.105+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7004c3c0 con 0x7f7e7015db10 2023-10-07T09:10:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.105+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7e68007690 con 0x7f7e7015db10 2023-10-07T09:10:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.106+0000 7f7e657fa700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 0x7f7e540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T09:10:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.106+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e68083ee0 con 0x7f7e7015db10 2023-10-07T09:10:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.106+0000 7f7e754ff700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 0x7f7e540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T09:10:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.106+0000 7f7e754ff700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 0x7f7e540697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e60 tx=0x7f7e6c009780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T09:10:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.110+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e6804b5a0 con 0x7f7e7015db10 2023-10-07T09:10:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.345+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e700ce0c0 con 0x7f7e7015db10 2023-10-07T09:10:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.345+0000 7f7e657fa700 1 -- 172.21.15.46:0/530747736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+3531 (secure 0 0 0) 0x7f7e68017020 con 0x7f7e7015db10 2023-10-07T09:10:37.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-07T09:10:37.346 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":137,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/716380900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":716380900},{"type":"v1","addr":"172.21.15.133:6836","nonce":716380900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1510282039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1510282039},{"type":"v1","addr":"172.21.15.133:6837","nonce":1510282039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1193085684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1193085684},{"type":"v1","addr":"172.21.15.46:6834","nonce":1193085684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/80201650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":80201650},{"type":"v1","addr":"172.21.15.46:6835","nonce":80201650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[]} 2023-10-07T09:10:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 msgr2=0x7f7e540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 0x7f7e540697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e60 tx=0x7f7e6c009780 comp rx=0 tx=0).stop 2023-10-07T09:10:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 msgr2=0x7f7e7015c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f7e680010e0 tx=0x7f7e68007dd0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 shutdown_connections 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:6832/90477,v1:172.21.15.133:6833/90477] conn(0x7f7e54067320 0x7f7e540697d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7015db10 0x7f7e7015c4a0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e70159890 0x7f7e7014c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 --2- 172.21.15.46:0/530747736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e70159c60 0x7f7e700b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T09:10:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 >> 172.21.15.46:0/530747736 conn(0x7f7e70068e20 msgr2=0x7f7e701546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T09:10:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 shutdown_connections 2023-10-07T09:10:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-07T09:10:37.347+0000 7f7e77763700 1 -- 172.21.15.46:0/530747736 wait complete. 2023-10-07T09:10:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 137 2023-10-07T09:10:37.360 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-07T09:10:37.360 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-07T09:10:37.361 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T09:10:37.361 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.370 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T09:10:37.370 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T09:10:37.370 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.419 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T09:10:37.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T09:10:37.419 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.431 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T09:10:37.431 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T09:10:37.431 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.482 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T09:10:37.482 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-07T09:10:37.483 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-07T09:10:37.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.515 INFO:tasks.ceph.osd.0:Stopped 2023-10-07T09:10:37.515 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-07T09:10:37.516 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.585 INFO:tasks.ceph.osd.1:Stopped 2023-10-07T09:10:37.585 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-07T09:10:37.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.654 INFO:tasks.ceph.osd.2:Stopped 2023-10-07T09:10:37.654 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-07T09:10:37.654 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.727 INFO:tasks.ceph.osd.3:Stopped 2023-10-07T09:10:37.728 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-07T09:10:37.728 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.768 INFO:tasks.ceph.osd.4:Stopped 2023-10-07T09:10:37.769 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-07T09:10:37.769 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.800 INFO:tasks.ceph.osd.5:Stopped 2023-10-07T09:10:37.801 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-07T09:10:37.801 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.866 INFO:tasks.ceph.osd.6:Stopped 2023-10-07T09:10:37.868 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-07T09:10:37.868 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.935 INFO:tasks.ceph.osd.7:Stopped 2023-10-07T09:10:37.936 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-07T09:10:37.936 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-07T09:10:37.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:37.959 INFO:tasks.ceph.mgr.y:Stopped 2023-10-07T09:10:37.959 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-07T09:10:37.960 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:38.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-07T09:10:38.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-07T09:10:38.004 INFO:tasks.ceph.mgr.x:Stopped 2023-10-07T09:10:38.004 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-07T09:10:38.004 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-07T09:10:38.004 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:38.015 INFO:tasks.ceph.mon.a:Stopped 2023-10-07T09:10:38.016 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-07T09:10:38.016 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:38.055 INFO:tasks.ceph.mon.b:Stopped 2023-10-07T09:10:38.056 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-07T09:10:38.056 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T09:10:38.107 INFO:tasks.ceph.mon.c:Stopped 2023-10-07T09:10:38.108 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-07T09:10:38.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-07T09:10:38.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:10:38.140 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-07T09:10:38.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:10:38.421 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-07T09:10:38.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:10:38.509 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-07T09:10:38.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:10:38.610 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-07T09:10:38.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:10:38.657 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-07T09:10:38.827 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:10:38.828 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-07T09:10:38.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:10:38.931 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-07T09:10:39.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:10:39.015 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-07T09:10:39.084 INFO:tasks.ceph:Archiving mon data... 2023-10-07T09:10:39.086 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/data/mon.a.tgz 2023-10-07T09:10:39.087 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-10-07T09:10:39.103 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.PXtLoeQDIT 2023-10-07T09:10:39.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PXtLoeQDIT 2023-10-07T09:10:39.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.PXtLoeQDIT 2023-10-07T09:10:39.388 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.PXtLoeQDIT is 578KB 2023-10-07T09:10:39.470 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.PXtLoeQDIT 2023-10-07T09:10:39.489 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/data/mon.b.tgz 2023-10-07T09:10:39.489 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-10-07T09:10:39.511 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.Ftxxp5bJp9 2023-10-07T09:10:39.511 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Ftxxp5bJp9 2023-10-07T09:10:39.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.Ftxxp5bJp9 2023-10-07T09:10:39.798 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.Ftxxp5bJp9 is 585KB 2023-10-07T09:10:39.840 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.Ftxxp5bJp9 2023-10-07T09:10:39.856 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/data/mon.c.tgz 2023-10-07T09:10:39.856 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-10-07T09:10:39.913 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.UPE7ZpKVEV 2023-10-07T09:10:39.914 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.UPE7ZpKVEV 2023-10-07T09:10:40.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.UPE7ZpKVEV 2023-10-07T09:10:40.162 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.UPE7ZpKVEV is 585KB 2023-10-07T09:10:40.262 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.UPE7ZpKVEV 2023-10-07T09:10:40.275 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-07T09:10:40.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-07T09:10:40.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-07T09:10:40.339 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-07T09:10:40.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-07T09:10:40.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-07T09:10:40.373 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-07T09:10:40.404 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-07T09:10:40.411 INFO:tasks.ceph:Archiving crash dumps... 2023-10-07T09:10:40.413 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi046/crash 2023-10-07T09:10:40.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-07T09:10:40.446 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi133/crash 2023-10-07T09:10:40.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-07T09:10:40.474 INFO:tasks.ceph:Shutting down logrotate 2023-10-07T09:10:40.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:40.491 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:40.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:40.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-07T09:10:40.637 INFO:tasks.ceph:Compressing logs... 2023-10-07T09:10:40.637 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T09:10:40.656 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T09:10:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100177.log 2023-10-07T09:10:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98359.log 2023-10-07T09:10:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102139.log 2023-10-07T09:10:40.728 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100177.log.gz 2023-10-07T09:10:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.98359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98788.log 2023-10-07T09:10:40.728 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98359.log.gz 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.102139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99206.log 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102139.log.gz 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.98788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90794.log 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98788.log.gz 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.99206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100584.log 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99206.log.gz 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90836.log 2023-10-07T09:10:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100584.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90794.log.gz 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101753.log 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100584.log.gz 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98792.log 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90836.log.gz/var/log/ceph/ceph-client.1.101753.log: 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101753.log.gz 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.98792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100580.log 2023-10-07T09:10:40.730 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98792.log.gz 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102143.log 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100958.log 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100580.log.gz 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.102143.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.1.102143.log.gz--verbose 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:-- /var/log/ceph/ceph-osd.7.log 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100958.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100958.log.gz 2023-10-07T09:10:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90966.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101749.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90966.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90966.log.gz 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.1.101749.log: -- /var/log/ceph/ceph-mds.d.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101749.log.gz 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102909.log 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.102909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102909.log.gz 2023-10-07T09:10:40.732 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100962.log 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102522.log 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100962.log.gz 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.102522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102522.log.gz 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97981.log 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-07T09:10:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.3.97981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97981.log.gz 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101359.log 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100181.log 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.101359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101359.log.gz 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.100181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100181.log.gz 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98363.log 2023-10-07T09:10:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.98363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98363.log.gz 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99771.log 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.99771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99771.log.gz 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102518.log 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.102518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102518.log.gz 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90670.log 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90670.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90670.log.gz 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97623.log 2023-10-07T09:10:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.97623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97623.log.gz 2023-10-07T09:10:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-07T09:10:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97985.log 2023-10-07T09:10:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.3.97985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97985.log.gz 2023-10-07T09:10:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90923.log 2023-10-07T09:10:40.763 INFO:teuthology.orchestra.run.smithi133.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90923.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90923.log.gz 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99202.log 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.99202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99202.log.gz 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90710.log 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90710.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90710.log.gz 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90751.log 2023-10-07T09:10:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90751.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90751.log.gz 2023-10-07T09:10:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101363.log 2023-10-07T09:10:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.101363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101363.log.gz 2023-10-07T09:10:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-07T09:10:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97615.log 2023-10-07T09:10:40.795 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.97615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97615.log.gz 2023-10-07T09:10:40.795 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90880.log 2023-10-07T09:10:40.808 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90880.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90880.log.gz 2023-10-07T09:10:40.808 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102905.log 2023-10-07T09:10:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.102905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102905.log.gz 2023-10-07T09:10:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99775.log 2023-10-07T09:10:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.99775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99775.log.gz 2023-10-07T09:10:40.897 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101157.log 2023-10-07T09:10:40.897 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176097.log 2023-10-07T09:10:40.897 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158106.log 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164024.log 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101157.log.gz 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176097.log.gz 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169607.log 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177670.log 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164024.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158106.log.gz 2023-10-07T09:10:40.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162580.log 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164024.log.gz 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100403.log 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169607.log.gz 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177670.log.gz 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179277.log 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100995.log 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100403.log.gz 2023-10-07T09:10:40.899 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173122.log 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.162580.log.gz 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168295.log 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179277.log.gz 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100995.log.gz 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161184.log 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173122.log.gz 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103482.log 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161184.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168295.log.gz 2023-10-07T09:10:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105868.log 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161184.log.gz 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164106.log 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103482.log.gz 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179781.log 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164106.log: gzip -5 --verbose 89.4%-- /var/log/ceph/ceph-client.admin.165961.log -- replaced with /var/log/ceph/ceph-client.admin.105868.log.gz 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179781.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164106.log.gz 2023-10-07T09:10:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173970.log 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179781.log.gz 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158776.log 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173970.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165961.log.gz 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162884.log 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158776.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173970.log.gz 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106120.log 2023-10-07T09:10:40.902 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3%/var/log/ceph/ceph-client.admin.162884.log: -- replaced with /var/log/ceph/ceph-client.admin.158776.log.gz 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159028.log 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106120.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162884.log.gz 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159645.log 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159028.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106120.log.gz 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107978.log 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159028.log.gz 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105700.log 2023-10-07T09:10:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161478.log 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159645.log.gz 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105700.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107978.log.gz 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170384.log 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105700.log.gz 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178966.log 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170384.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161478.log.gz 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169269.log 2023-10-07T09:10:40.904 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170384.log.gz 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100361.log 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178966.log: /var/log/ceph/ceph-client.admin.169269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161911.log 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178966.log.gz 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160584.log 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169269.log.gz 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161911.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100361.log.gz 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160890.log 2023-10-07T09:10:40.905 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0%/var/log/ceph/ceph-client.0.160584.log: -- replaced with /var/log/ceph/ceph-client.admin.161911.log.gz 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102983.log 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.160584.log.gz 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168608.log 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160890.log.gz 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165571.log 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168608.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102983.log.gz 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100024.log 2023-10-07T09:10:40.906 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168608.log.gz 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103084.log 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165571.log.gz 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162056.log 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100024.log.gz 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165835.log 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96433.log 88.3% 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103084.log.gz 2023-10-07T09:10:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165835.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.162056.log.gz 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.175868.log 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165835.log.gz 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160069.log 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97139.log 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96433.log.gz 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175868.log.gz 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160974.log 2023-10-07T09:10:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97139.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160069.log.gz 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97476.log 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97139.log.gz 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163485.log 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97476.log: gzip 89.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.160974.log.gz--verbose 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.173771.log 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97476.log.gz 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170720.log 2023-10-07T09:10:40.909 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173771.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163485.log.gz 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156569.log 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170720.log: 88.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.173771.log.gz--verbose 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.178756.log 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156569.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170720.log.gz 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166995.log 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178756.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156569.log.gz 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157872.log 2023-10-07T09:10:40.910 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178756.log.gz 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160237.log 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166995.log.gz 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163757.log 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105073.log 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157872.log.gz 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163757.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.165420.log 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160237.log.gz 2023-10-07T09:10:40.911 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163757.log.gz 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102171.log 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100617.log 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102171.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165420.log.gz 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101781.log 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.105073.log.gz 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97135.log 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102171.log.gz 2023-10-07T09:10:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101781.log: gzip -5 --verbose -- 88.9%/var/log/ceph/ceph-mds.a.log 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100617.log.gz 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97135.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101781.log.gz 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100192.log 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97135.log.gz 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169841.log 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168169.log 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100192.log.gzgzip 2023-10-07T09:10:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.173645.log 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168169.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169841.log.gz 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157240.log 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168169.log.gz/var/log/ceph/ceph-client.admin.173645.log: 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165468.log 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173645.log.gz 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102937.log 2023-10-07T09:10:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165468.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157240.log.gzgzip 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.99193.log 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2%/var/log/ceph/ceph-client.admin.102937.log: -- replaced with /var/log/ceph/ceph-client.admin.165468.log.gz 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101401.log 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.99193.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102937.log.gz 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163629.log 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99193.log.gz 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107103.log 2023-10-07T09:10:40.915 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101401.log.gz 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179403.log 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107103.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163629.log.gz 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156838.log 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179403.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107103.log.gz 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160932.log 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156838.log: gzip 88.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.179403.log.gz--verbose 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.97469.log 2023-10-07T09:10:40.916 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156838.log.gz 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164917.log 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160932.log.gz 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173332.log 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97818.log 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97469.log.gz 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173332.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164917.log.gz 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100869.log 2023-10-07T09:10:40.917 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173332.log.gz 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163010.log 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178600.log 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97818.log.gz 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163010.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100869.log.gz 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103025.log 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163010.log.gz 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106476.log 2023-10-07T09:10:40.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174654.log 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178600.log.gz 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106476.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103025.log.gz 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170247.log 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106476.log.gz 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162454.log 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101235.log 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174654.log.gz 2023-10-07T09:10:40.919 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162454.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.170247.log.gz 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167207.log 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162454.log.gz 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101875.log 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157956.log 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101235.log.gz 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101875.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167207.log.gz 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176012.log 2023-10-07T09:10:40.920 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101875.log.gz 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101485.log 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100701.log 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157956.log.gz 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101485.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176012.log.gz 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174135.log 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101485.log.gz 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.100701.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.171864.log 2023-10-07T09:10:40.921 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174220.log 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100701.log.gz 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171864.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174135.log.gz 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176546.log 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.171864.log.gz 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171552.log 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168897.log 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174220.log.gz 2023-10-07T09:10:40.922 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171552.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176546.log.gz 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167081.log 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171552.log.gz 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162150.log 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161394.log 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168897.log.gz 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162150.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167081.log.gz 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175344.log 2023-10-07T09:10:40.923 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162150.log.gz 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177072.log 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175344.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161394.log.gz 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163799.log 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177072.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175344.log.gz 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97472.log 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177072.log.gz 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99856.log 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163799.log.gz 2023-10-07T09:10:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108020.log 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7%/var/log/ceph/ceph-client.admin.99856.log: -- replaced with /var/log/ceph/ceph-client.admin.97472.log.gz 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170972.log 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108020.log: gzip 88.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.99856.log.gz 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.106204.log 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170972.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108020.log.gz 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175952.log 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106204.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170972.log.gz 2023-10-07T09:10:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107187.log 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106204.log.gz 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173892.log 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162100.log 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175952.log.gz 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173892.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107187.log.gz 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168463.log 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173892.log.gz 2023-10-07T09:10:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162100.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84562.log 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168463.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162100.log.gz 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167939.log 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168463.log.gz 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.84562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103650.log 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84562.log.gz 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105349.log 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103650.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.167939.log.gz 2023-10-07T09:10:40.927 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175470.log 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103650.log.gz 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.105349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172336.log 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105349.log.gz 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158303.log 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172336.log: gzip -5 --verbose 87.6%-- /var/log/ceph/ceph-client.admin.167291.log 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.175470.log.gz 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.158303.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172336.log.gz 2023-10-07T09:10:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.0.158303.log.gz-- 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163191.log 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168505.log 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163191.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167291.log.gz 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102465.log 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163191.log.gz 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161520.log 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168505.log.gz 2023-10-07T09:10:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171118.log 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164318.log 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161520.log.gz 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171118.log: 90.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.102465.log.gz-5 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106036.log 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171822.log 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164318.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171118.log.gz 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103398.log 2023-10-07T09:10:40.930 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164318.log.gz 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106036.log.gz 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179361.log 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174442.log 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171822.log.gz 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179361.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103398.log.gz 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97138.log 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179361.log.gz 2023-10-07T09:10:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105562.log 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159687.log 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174442.log.gz 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105562.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97138.log.gz 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159238.log 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105562.log.gz 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166815.log 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159238.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159687.log.gz 2023-10-07T09:10:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97133.log 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159238.log.gz 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157162.log 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1%/var/log/ceph/ceph-client.admin.97133.log: -- replaced with /var/log/ceph/ceph-client.admin.166815.log.gz 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164412.log 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176596.log 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97133.log.gz 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157162.log.gz 2023-10-07T09:10:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103879.log 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164641.log 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176596.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164412.log.gz 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107481.log 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103879.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176596.log.gz 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162646.log 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103879.log.gz 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107481.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164641.log.gz 2023-10-07T09:10:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179050.log 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107481.log.gz 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96252.log 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179050.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.162646.log.gz--verbose 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.160321.log 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179235.log 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179050.log.gz 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96252.log.gz 2023-10-07T09:10:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101695.log 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103356.log 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101695.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179235.log.gz 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 91.2%--verbose -- /var/log/ceph/ceph-client.admin.175616.log -- replaced with /var/log/ceph/ceph-client.admin.160321.log.gz 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101695.log.gz 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105394.log 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103356.log.gz 2023-10-07T09:10:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166003.log 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96569.log 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175616.log.gz 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166003.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105394.log.gz 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101317.log 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166003.log.gz 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172378.log 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102728.log 2023-10-07T09:10:40.937 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96569.log.gz 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107313.log 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101317.log.gz 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.102728.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172378.log.gz 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103753.log 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102728.log.gz 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163317.log 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103753.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107313.log.gz 2023-10-07T09:10:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156401.log 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163317.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103753.log.gz 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161352.log 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156401.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.163317.log.gz-5 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.162242.log 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156401.log.gz 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161268.log 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1%/var/log/ceph/ceph-client.admin.162242.log: -- replaced with /var/log/ceph/ceph-client.admin.161352.log.gz 2023-10-07T09:10:40.939 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175039.log 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161268.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162242.log.gz 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.161268.log.gz 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.175039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96882.log 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175039.log.gz 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99730.log 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107397.log 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96882.log.gz 2023-10-07T09:10:40.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99814.log 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166190.log 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99730.log.gz 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.162839.log 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107397.log.gz 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99814.log.gz 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96136.log 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166190.log: /var/log/ceph/ceph-client.0.162839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97816.log 2023-10-07T09:10:40.941 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.162839.log.gz 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166190.log.gz 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107886.log 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96136.log.gz 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96798.log 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97816.log.gz 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175742.log 2023-10-07T09:10:40.942 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107886.log: gzip /var/log/ceph/ceph-client.admin.96798.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.167249.log 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107886.log.gz 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175742.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96798.log.gz 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170038.log 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167249.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175742.log.gz 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174570.log 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167249.log.gz 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.170038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179134.log 2023-10-07T09:10:40.943 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170038.log.gz 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100277.log 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179134.log: 89.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.174570.log.gz--verbose 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.96756.log 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100277.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.179134.log.gz 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177628.log 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100277.log.gz 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158650.log 2023-10-07T09:10:40.944 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96756.log.gz/var/log/ceph/ceph-client.admin.177628.log: 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100743.log 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158650.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177628.log.gzgzip 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.170034.log 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158650.log.gz/var/log/ceph/ceph-client.admin.100743.log: 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99982.log 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100743.log.gz 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.170034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168023.log 2023-10-07T09:10:40.945 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170034.log.gz 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160580.log 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168023.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99982.log.gz 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104863.log 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168023.log.gz 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.160580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159603.log 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.160580.log.gz 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164809.log 2023-10-07T09:10:40.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103230.log 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104863.log.gz 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159603.log.gz 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156443.log 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164809.log.gz 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103272.log 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157662.log 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103230.log.gz 2023-10-07T09:10:40.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103272.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156443.log.gz 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172934.log 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5%/var/log/ceph/ceph-client.admin.157662.log: -- replaced with /var/log/ceph/ceph-client.admin.103272.log.gz 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159771.log 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172934.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.157662.log.gz 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169481.log 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172934.log.gz 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97475.log 2023-10-07T09:10:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169481.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159771.log.gz 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166274.log 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97475.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169481.log.gz 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176724.log 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97475.log.gz 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178558.log 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176724.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166274.log.gz 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157056.log 2023-10-07T09:10:40.949 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176724.log.gz 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177544.log 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178558.log.gz 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171507.log 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177544.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.157056.log.gz-5 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103710.log 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177544.log.gz 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101737.log 2023-10-07T09:10:40.950 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171507.log.gz 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161827.log 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101737.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103710.log.gz 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175428.log 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161827.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101737.log.gz 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102853.log 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161827.log.gz 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96527.log 2023-10-07T09:10:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102853.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175428.log.gz 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166087.log 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102853.log.gz 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98150.log 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166087.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96527.log.gz 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169733.log 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96477.log 89.1% 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166087.log.gz 2023-10-07T09:10:40.952 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98150.log.gz 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106162.log 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169733.log.gz 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175168.log 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160027.log 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96477.log.gz 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106162.log.gz 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170121.log 2023-10-07T09:10:40.953 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.175168.log.gz 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166417.log 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170121.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.160027.log.gz 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179008.log 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170121.log.gz 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173038.log 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166417.log.gz 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107271.log 2023-10-07T09:10:40.954 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179008.log.gz 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106678.log 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107271.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173038.log.gz 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160279.log 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107271.log.gz 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103921.log 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100785.log 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106678.log.gz 2023-10-07T09:10:40.955 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160279.log.gz 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161016.log 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103921.log.gz 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159381.log 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161016.log: gzip 88.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.100785.log.gz--verbose 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.102297.log 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161016.log.gz 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97140.log 2023-10-07T09:10:40.956 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159381.log.gz 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158944.log 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97140.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102297.log.gz 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176139.log 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97140.log.gz 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169439.log 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158944.log.gz 2023-10-07T09:10:40.957 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163569.log 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169439.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176139.log.gz 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165709.log 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163569.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169439.log.gz 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172808.log 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163569.log.gz 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105784.log 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165709.log.gz 2023-10-07T09:10:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165110.log 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105784.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172808.log.gz 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169523.log 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.165110.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105784.log.gz 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102129.log 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165110.log.gz 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106804.log 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103126.log 2023-10-07T09:10:40.959 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169523.log.gz 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102129.log.gz 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175826.log 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106804.log.gz 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165198.log 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175826.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.103126.log.gz--verbose 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.165667.log 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175826.log.gz 2023-10-07T09:10:40.960 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104947.log 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165198.log.gz 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178924.log 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170804.log 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165667.log.gz 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178924.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104947.log.gzgzip 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.178431.log 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170804.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178924.log.gz 2023-10-07T09:10:40.961 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98402.log 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178431.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170804.log.gz 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108062.log 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178431.log.gz 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98318.log 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98402.log.gz 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157788.log 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98318.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108062.log.gz 2023-10-07T09:10:40.962 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104353.log 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157788.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98318.log.gz 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173248.log 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104353.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157788.log.gz 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159154.log 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104353.log.gz 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173290.log 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159154.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173248.log.gz 2023-10-07T09:10:40.963 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158902.log 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159154.log.gz 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173290.log.gz 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161058.log 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172032.log 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161058.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158902.log.gz 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102003.log 2023-10-07T09:10:40.964 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161058.log.gz 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105520.log 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179613.log 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102003.log.gz 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.172032.log.gz 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175386.log 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105520.log.gz 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168734.log 2023-10-07T09:10:40.965 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179613.log: /var/log/ceph/ceph-client.admin.175386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166045.log 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179613.log.gz 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168734.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175386.log.gz 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160111.log 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168734.log.gz 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172640.log 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171056.log 2023-10-07T09:10:40.966 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166045.log.gz 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172640.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160111.log.gzgzip 89.2% 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:-5 -- replaced with /var/log/ceph/ceph.audit.log.gz--verbose 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.172554.log 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172640.log.gz 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168337.log 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172291.log 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171056.log.gz 2023-10-07T09:10:40.967 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168337.log: gzip -5 87.6%--verbose -- replaced with /var/log/ceph/ceph-client.admin.172554.log.gz-- 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172850.log 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3%/var/log/ceph/ceph-client.0.172291.log: -- replaced with /var/log/ceph/ceph-client.admin.168337.log.gz 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166316.log 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.172291.log.gz 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166647.log 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172850.log.gz 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175126.log 2023-10-07T09:10:40.968 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166316.log.gz 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.166647.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.175210.log 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162328.log 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166647.log.gz 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175210.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175126.log.gz 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173603.log 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104527.log 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175210.log.gz 2023-10-07T09:10:40.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173603.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162328.log.gz 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176181.log 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173603.log.gz 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165510.log 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104527.log: /var/log/ceph/ceph-client.admin.176181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101825.log 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104527.log.gz 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172462.log 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176181.log.gz 2023-10-07T09:10:40.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101825.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165510.log.gzgzip 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.171738.log 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171421.log 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101825.log.gz 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103524.log 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172462.log.gz 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171738.log.gz 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159943.log 2023-10-07T09:10:40.971 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171421.log.gz 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177156.log 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173080.log 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103524.log.gz 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159943.log.gz 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171278.log 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177156.log.gz 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175532.log 2023-10-07T09:10:40.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171278.log: gzip 88.3%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.173080.log.gz/var/log/ceph/ceph-client.admin.102769.log 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4%/var/log/ceph/ceph-client.admin.175532.log: -- replaced with /var/log/ceph/ceph-client.admin.171278.log.gz 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168565.log 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175532.log.gz 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172295.log 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160709.log 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102769.log.gz 2023-10-07T09:10:40.973 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168565.log.gz 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170678.log 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.172295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.172295.log.gz 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178371.log 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170678.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160709.log.gz 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156653.log 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170678.log.gz 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164454.log 2023-10-07T09:10:40.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178371.log: /var/log/ceph/ceph-client.admin.156653.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178371.log.gz 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164454.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156653.log.gz 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179571.log 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164454.log.gz 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177030.log 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107606.log 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179571.log.gz 2023-10-07T09:10:40.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166557.log 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177030.log.gz 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173458.log 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162412.log 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107606.log.gz 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166557.log.gz 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100575.log 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173458.log.gz 2023-10-07T09:10:40.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159196.log 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100575.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.162412.log.gz--verbose 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.177762.log 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100575.log.gz 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159112.log 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8%/var/log/ceph/ceph-client.admin.177762.log: -- replaced with /var/log/ceph/ceph-client.admin.159196.log.gz 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96714.log 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176946.log 2023-10-07T09:10:40.977 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.177762.log.gz 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159112.log.gz 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160751.log 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96714.log.gz 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156880.log 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173729.log 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176946.log.gz 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160751.log.gz 2023-10-07T09:10:40.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164767.log 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156880.log.gz 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175658.log 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164767.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.173729.log.gz-5 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.175302.log 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164767.log.gz 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163149.log 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175658.log.gz 2023-10-07T09:10:40.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172682.log 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157914.log 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175302.log.gz 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163149.log.gz 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104103.log 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172682.log.gz 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97131.log 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157914.log.gz 2023-10-07T09:10:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161869.log 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97131.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104103.log.gz 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167375.log 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97131.log.gz 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157014.log 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163052.log 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161869.log.gz 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156485.log 2023-10-07T09:10:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163052.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.167375.log.gz 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157014.log.gz 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161310.log 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163052.log.gz 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100234.log 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156485.log.gz 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161142.log 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100234.log: gzip -5 89.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.161310.log.gz/var/log/ceph/ceph-client.admin.175574.log 2023-10-07T09:10:40.982 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161142.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100234.log.gz 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102255.log 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156972.log 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161142.log.gz 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102255.log: gzip -5 --verbose 88.3%-- /var/log/ceph/ceph-client.admin.157448.log -- replaced with /var/log/ceph/ceph-client.admin.175574.log.gz 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166147.log 2023-10-07T09:10:40.983 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102255.log.gz 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157448.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156972.log.gz 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107145.log 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157448.log.gz 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168975.log 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107145.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166147.log.gz 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164362.log 2023-10-07T09:10:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168975.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107145.log.gz 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98108.log 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168975.log.gz 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167805.log 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106636.log 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164362.log.gz 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167805.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98108.log.gz 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159815.log 2023-10-07T09:10:40.985 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167805.log.gz 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170426.log 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159815.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106636.log.gz 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106893.log 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170426.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159815.log.gz 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171990.log 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170426.log.gz 2023-10-07T09:10:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174528.log 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171990.log: gzip -5 --verbose -- 87.9%/var/log/ceph/ceph-client.admin.158040.log 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106893.log.gz 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174528.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171990.log.gz 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179445.log 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174528.log.gz 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156262.log 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165919.log 2023-10-07T09:10:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156262.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179445.log.gz 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 91.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.158040.log.gz--verbose 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.102213.log 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156262.log.gz 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158512.log 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167634.log 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102213.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165919.log.gz 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174358.log 2023-10-07T09:10:40.988 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102213.log.gz 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.167634.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158512.log.gz 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158428.log 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.167634.log.gz 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165240.log 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158428.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174358.log.gz 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168127.log 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.158428.log.gz 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99646.log 2023-10-07T09:10:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163673.log 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165240.log.gz 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99646.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168127.log.gz 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106330.log 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99646.log.gz 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107229.log 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102087.log 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163673.log.gz 2023-10-07T09:10:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106330.log.gz 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97688.log 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107229.log.gz 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107540.log 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162012.log 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102087.log.gz 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107540.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97688.log.gz 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102339.log 2023-10-07T09:10:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164683.log 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.107540.log.gz 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102339.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162012.log.gz 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166903.log 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104989.log 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164683.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102339.log.gz 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176223.log 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164683.log.gz 2023-10-07T09:10:40.992 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166903.log.gz 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101611.log 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98192.log 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104989.log.gz 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101611.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176223.log.gz 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167721.log 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101611.log.gz 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161667.log 2023-10-07T09:10:40.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168211.log 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98192.log.gz 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161667.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167721.log.gz 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163443.log 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161667.log.gz 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105826.log 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175700.log 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168211.log.gz 2023-10-07T09:10:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163443.log.gz 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90551.log 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105826.log.gz 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162496.log 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157620.log 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175700.log.gz 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165114.log 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.90551.log.gz 2023-10-07T09:10:40.995 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162496.log.gz 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172766.log 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.165114.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157620.log.gz 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165114.log.gz 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178203.log 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159985.log 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172766.log.gz 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105478.log 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178203.log.gz 2023-10-07T09:10:40.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178840.log 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163233.log 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159985.log.gz 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105478.log.gz 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104821.log 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178840.log.gz 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169225.log 2023-10-07T09:10:40.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100953.log 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163233.log.gz 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169225.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104821.log.gz 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162968.log 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169225.log.gz 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171694.log 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171320.log 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100953.log.gz 2023-10-07T09:10:40.998 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162968.log.gz 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98654.log 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171694.log.gz 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165751.log 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98654.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171320.log.gz 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163527.log 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107061.log 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.98654.log.gz 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165751.log.gz 2023-10-07T09:10:40.999 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158860.log 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107061.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163527.log.gz 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159729.log 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107061.log.gz 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176680.log 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158860.log.gz 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176860.log 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176680.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159729.log.gz 2023-10-07T09:10:41.000 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105994.log 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176860.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176680.log.gz 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161100.log 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176860.log.gz 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158344.log 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176055.log 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105994.log.gz 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158344.log: gzip -5 89.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.161100.log.gz/var/log/ceph/ceph-client.admin.96611.log 2023-10-07T09:10:41.001 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158344.log.gz 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174093.log 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96611.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176055.log.gz 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104611.log 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96611.log.gz 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97473.log 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104611.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174093.log.gz 2023-10-07T09:10:41.002 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157364.log 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161436.log 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104611.log.gz 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157364.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97473.log.gz 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167981.log 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157364.log.gz 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160793.log 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167981.log: gzip -5 --verbose 88.1%-- /var/log/ceph/ceph-client.admin.103795.log 2023-10-07T09:10:41.003 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161436.log.gz 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167981.log.gz 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104485.log 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160793.log.gz 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96055.log 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103795.log.gz 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166232.log 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96055.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104485.log.gz 2023-10-07T09:10:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98788.log 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96055.log.gz 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164232.log 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98788.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166232.log.gz 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97820.log 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98788.log.gz 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158554.log 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164232.log.gz 2023-10-07T09:10:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156922.log 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97820.log.gz 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98486.log 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156922.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158554.log.gz 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156754.log 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156922.log.gz 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158386.log 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156754.log: gzip 88.5%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.98486.log.gz/var/log/ceph/ceph-client.admin.172598.log 2023-10-07T09:10:41.006 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158386.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156754.log.gz 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162538.log 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158386.log.gz 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162370.log 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159339.log 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172598.log.gz 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162370.log: gzip 89.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.162538.log.gz--verbose 2023-10-07T09:10:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.95962.log 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162370.log.gz 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161970.log 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158818.log 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159339.log.gz 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161970.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95962.log.gz 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101055.log 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161970.log.gz 2023-10-07T09:10:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156359.log 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101055.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158818.log.gz 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156359.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101055.log.gz 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106762.log 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156359.log.gz 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164540.log 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160625.log 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164540.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.106762.log.gz-5 2023-10-07T09:10:41.009 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.167763.log 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164540.log.gz 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102895.log 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167763.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160625.log.gz 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156695.log 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167763.log.gz 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157490.log 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100066.log 2023-10-07T09:10:41.010 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4%/var/log/ceph/ceph-client.admin.156695.log: -- replaced with /var/log/ceph/ceph-client.admin.102895.log.gz 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157490.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.156695.log.gz--verbose 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.171196.log 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162192.log 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100066.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157490.log.gz 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101527.log 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100066.log.gz 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106977.log 2023-10-07T09:10:41.011 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171196.log.gz/var/log/ceph/ceph-client.admin.162192.log: 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162192.log.gz 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169649.log 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106977.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101527.log.gz 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169649.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106977.log.gz 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100319.log 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164496.log 2023-10-07T09:10:41.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.169649.log.gz 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101959.log 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166953.log 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100319.log.gz 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101959.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164496.log.gz 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178119.log 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101959.log.gz 2023-10-07T09:10:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165366.log 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166953.log: /var/log/ceph/ceph-client.admin.178119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162926.log 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166953.log.gz 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165366.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178119.log.gz 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178287.log 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165366.log.gz 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105353.log 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162926.log.gz 2023-10-07T09:10:41.014 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107019.log 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178287.log: /var/log/ceph/ceph-client.0.105353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169099.log 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105353.log.gz 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178287.log.gz 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170930.log 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107019.log.gz 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178245.log 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169099.log.gz 2023-10-07T09:10:41.015 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168793.log 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170930.log: /var/log/ceph/ceph-client.admin.178245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160387.log 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170930.log.gz 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178245.log.gz 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160195.log 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168793.log.gz 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177306.log 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96924.log 2023-10-07T09:10:41.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160195.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160387.log.gz 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177306.log: gzip 87.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.160195.log.gz--verbose 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.167897.log 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177306.log.gz 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176344.log 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96924.log: /var/log/ceph/ceph-client.admin.167897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97141.log 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96924.log.gz 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176344.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.167897.log.gz 2023-10-07T09:10:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177586.log 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176344.log.gz 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179092.log 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106720.log 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177586.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97141.log.gz 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179092.log: gzip -5 --verbose -- 88.6%/var/log/ceph/ceph-client.admin.172724.log 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177586.log.gz 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179092.log.gz 2023-10-07T09:10:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96389.log 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106720.log: /var/log/ceph/ceph-client.admin.172724.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106720.log.gz 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96389.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172724.log.gz 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105031.log 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96389.log.gz 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179655.log 2023-10-07T09:10:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97474.log 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105031.log: /var/log/ceph/ceph-client.admin.179655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168835.log 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105031.log.gz 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179655.log.gz 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104397.log 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98276.log 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168835.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97474.log.gz 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157406.log 2023-10-07T09:10:41.020 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168835.log.gz 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104397.log.gz 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98234.log 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157406.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98276.log.gz 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178882.log 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157406.log.gz 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168650.log 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99772.log 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178882.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98234.log.gz 2023-10-07T09:10:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174612.log 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178882.log.gz 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159521.log 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168650.log.gz 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174612.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99772.log.gz 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169775.log 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104905.log 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174612.log.gz 2023-10-07T09:10:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169775.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159521.log.gzgzip 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.170205.log 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173374.log 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170205.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104905.log.gz 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178474.log 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.169775.log.gz 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173374.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170205.log.gz 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101917.log 2023-10-07T09:10:41.023 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167638.log 2023-10-07T09:10:41.025 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173374.log.gz 2023-10-07T09:10:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178474.log: /var/log/ceph/ceph-client.admin.101917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177503.log 2023-10-07T09:10:41.025 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178474.log.gz 2023-10-07T09:10:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.167638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178161.log 2023-10-07T09:10:41.025 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101917.log.gz 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.167638.log.gz 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.177503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105156.log 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.177503.log.gz 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163841.log 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105156.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178161.log.gz 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.99601.log 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105156.log.gz 2023-10-07T09:10:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163841.log: /var/log/ceph/ceph-client.2.99601.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163841.log.gz 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.99601.log.gz 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158299.log 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175784.log 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.158299.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.0.158299.log.gz--verbose 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.2.99605.log 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175084.log 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175784.log: /var/log/ceph/ceph-client.2.99605.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.2.99605.log.gz--verbose 2023-10-07T09:10:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.179176.log 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175784.log.gz 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164148.log 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175084.log: /var/log/ceph/ceph-client.admin.179176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104311.log 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175084.log.gz 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171014.log 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179176.log.gz 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164148.log.gz 2023-10-07T09:10:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171610.log 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103837.log 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104311.log.gz 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171610.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171014.log.gz 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159443.log 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104779.log 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171610.log.gz 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103837.log.gz 2023-10-07T09:10:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178329.log 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164851.log 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104779.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159443.log.gz 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165877.log 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104779.log.gz 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178329.log.gz 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103608.log 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107844.log 2023-10-07T09:10:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174846.log 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165877.log.gz 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.164851.log.gz 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103608.log.gz 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165793.log 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179529.log 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174846.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107844.log.gz 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177951.log 2023-10-07T09:10:41.031 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174846.log.gz 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165793.log.gz 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178516.log 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.177951.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.166859.log 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179529.log.gz 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106935.log 87.4% 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177951.log.gz 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169355.log 2023-10-07T09:10:41.032 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178516.log.gz 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106935.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166859.log.gz 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104441.log 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106849.log 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169355.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106935.log.gz 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171463.log 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169355.log.gz 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174696.log 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104441.log.gz 2023-10-07T09:10:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171463.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106849.log.gz 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98570.log 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98360.log 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174696.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171463.log.gz 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177499.log 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174696.log.gz 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.98570.log.gz 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106078.log 2023-10-07T09:10:41.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.177499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.177499.log.gz 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.98360.log.gz--verbose 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.163946.log 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106414.log 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106078.log: /var/log/ceph/ceph-client.admin.163946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163883.log 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106078.log.gz 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163946.log.gz 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163401.log 2023-10-07T09:10:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.163883.log: --verbose -- /var/log/ceph/ceph-client.admin.98444.log 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106414.log.gz 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164190.log 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163883.log.gz 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98444.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163401.log.gz 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175043.log 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102531.log 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98444.log.gz 2023-10-07T09:10:41.036 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164190.log.gz 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.175043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169565.log 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175043.log.gz 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165282.log 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97819.log 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102531.log.gz 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165282.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.169565.log.gz-5 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.102423.log 2023-10-07T09:10:41.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170342.log 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165282.log.gz 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105742.log 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97819.log.gz 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102724.log 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102423.log.gz 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105742.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.170342.log.gz--verbose 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.156796.log 2023-10-07T09:10:41.038 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105742.log.gz 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.102724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173687.log 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102724.log.gz 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102381.log 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173687.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156796.log.gz 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96347.log 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102381.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173687.log.gz 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99201.log 2023-10-07T09:10:41.039 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102381.log.gz 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168379.log 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.99201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96347.log.gz 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100108.log 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99201.log.gz 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177198.log 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100108.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168379.log.gz 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166479.log 2023-10-07T09:10:41.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177198.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100108.log.gz 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105910.log 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177198.log.gz 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159070.log 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105910.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166479.log.gz 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170636.log 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97477.log 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105910.log.gz 2023-10-07T09:10:41.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170636.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159070.log.gz 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177114.log 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100659.log 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97477.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170636.log.gz 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90943.log 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97477.log.gz 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177114.log.gz 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168421.log 2023-10-07T09:10:41.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90943.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.100659.log.gz--verbose 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.98024.log 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90943.log.gz 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171362.log 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4%/var/log/ceph/ceph-client.admin.98024.log: -- replaced with /var/log/ceph/ceph-client.admin.168421.log.gz 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96298.log 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159859.log 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171362.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98024.log.gz 2023-10-07T09:10:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178798.log 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171362.log.gz 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100445.log 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96298.log.gz 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178798.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159859.log.gz 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96840.log 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170163.log 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178798.log.gz 2023-10-07T09:10:41.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173416.log 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100445.log.gz 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166689.log 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96840.log.gz 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173416.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170163.log.gz 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107439.log 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176422.log 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173416.log.gz 2023-10-07T09:10:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168085.log 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166689.log.gz 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174308.log 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107439.log.gz 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176422.log.gz 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96655.log 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169141.log 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174308.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168085.log.gz 2023-10-07T09:10:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179319.log 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174308.log.gz 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96655.log.gz 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158734.log 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170468.log 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169141.log.gz 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158734.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179319.log.gz 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170468.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158734.log.gz 2023-10-07T09:10:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101653.log 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176988.log 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170468.log.gz 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161745.log 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101653.log.gz 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167165.log 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161745.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176988.log.gzgzip 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.104695.log 2023-10-07T09:10:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173813.log 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161745.log.gz 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104695.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.97815.log 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.167165.log.gz 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104695.log.gz 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103314.log 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97815.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173813.log.gz 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174780.log 2023-10-07T09:10:41.049 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97815.log.gz 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98066.log 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174780.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.103314.log.gz--verbose 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.97821.log 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166773.log /var/log/ceph/ceph-client.admin.98066.log: 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97821.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98066.log.gz 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.174780.log.gz 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97821.log.gz 2023-10-07T09:10:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106246.log 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166773.log.gz 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157322.log 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106554.log 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160153.log 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106246.log.gz 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157322.log.gz 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178035.log 2023-10-07T09:10:41.051 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166358.log 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160153.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106554.log.gz 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178035.log: gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.160153.log.gz/var/log/ceph/ceph-client.admin.105436.log 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166358.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178035.log.gz 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166358.log.gz 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105436.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105436.log.gz 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167679.log 2023-10-07T09:10:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172098.log 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176768.log 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164274.log 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167679.log.gz 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172996.log 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172098.log.gz 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157098.log 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164274.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176768.log.gz 2023-10-07T09:10:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161604.log 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164274.log.gz 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173561.log 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172996.log.gz 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161604.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157098.log.gz 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173561.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161604.log.gz 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173561.log.gz 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165324.log 2023-10-07T09:10:41.054 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176638.log 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179739.log 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174051.log 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165324.log.gz 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161562.log 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176638.log.gz 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163359.log 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179739.log.gz 2023-10-07T09:10:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165155.log 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174051.log.gz 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177240.log 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161562.log.gz 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163359.log.gz 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.165155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156527.log 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156611.log 2023-10-07T09:10:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177240.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165155.log.gz 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156527.log: /var/log/ceph/ceph-client.admin.156611.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156527.log.gz 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.177240.log.gz 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156611.log.gz 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103440.log 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179487.log 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167037.log 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103440.log.gz 2023-10-07T09:10:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179487.log: /var/log/ceph/ceph-client.admin.167037.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179487.log.gz 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167037.log.gz 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157534.log 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169397.log 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167333.log 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.169397.log: -5 --verbose -- /var/log/ceph/ceph-client.0.107799.log 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157534.log.gz 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99688.log 2023-10-07T09:10:41.058 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169397.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.107799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172892.log 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167333.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107799.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176504.log 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172892.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99688.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172892.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176504.log.gz 2023-10-07T09:10:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169691.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167123.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169691.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173206.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.169691.log.gz 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: gzip 88.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.167123.log.gz--verbose 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.97137.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.173206.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.177993.log 2023-10-07T09:10:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97137.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173206.log.gz 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97137.log.gz 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177993.log.gz 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168253.log 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174486.log 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177803.log 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174486.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168253.log.gz 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.177803.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174486.log.gz 2023-10-07T09:10:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157746.log 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.177803.log.gz 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176902.log 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159297.log 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157746.log: /var/log/ceph/ceph-client.admin.176902.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157746.log.gz 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159297.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176902.log.gz 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159297.log.gz 2023-10-07T09:10:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102811.log 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163275.log 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157830.log 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8%/var/log/ceph/ceph-client.admin.163275.log: -- replaced with /var/log/ceph/ceph-client.admin.102811.log.gz 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157830.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163275.log.gz 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157830.log.gz 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104653.log 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178077.log 2023-10-07T09:10:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98612.log 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.178077.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104653.log.gz 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157998.log 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98612.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178077.log.gz 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98612.log.gz 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157998.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157998.log.gz 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174738.log 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170594.log 2023-10-07T09:10:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103963.log 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2%/var/log/ceph/ceph-client.admin.170594.log: -- replaced with /var/log/ceph/ceph-client.admin.174738.log.gz 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106372.log 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.103963.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170594.log.gz 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104269.log 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103963.log.gz 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176282.log 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106372.log.gz 2023-10-07T09:10:41.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104269.log.gz 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176282.log.gz 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101359.log 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100150.log 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157704.log 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100150.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101359.log.gz 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157704.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100150.log.gz 2023-10-07T09:10:41.066 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157704.log.gz 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171780.log 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171652.log 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167441.log 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171780.log.gz 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171652.log: /var/log/ceph/ceph-client.admin.167441.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171652.log.gz 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167441.log.gz 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158470.log 2023-10-07T09:10:41.067 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157578.log 2023-10-07T09:10:41.068 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107355.log 2023-10-07T09:10:41.068 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158470.log: /var/log/ceph/ceph-client.admin.157578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170552.log 2023-10-07T09:10:41.068 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158470.log.gz 2023-10-07T09:10:41.068 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107355.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.157578.log.gz--verbose 2023-10-07T09:10:41.068 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.102045.log 2023-10-07T09:10:41.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164599.log 2023-10-07T09:10:41.070 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107355.log.gz 2023-10-07T09:10:41.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170762.log 88.1% 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170552.log.gz 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103566.log 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102045.log.gz 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164599.log.gz 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170762.log: /var/log/ceph/ceph-client.admin.103566.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170762.log.gz 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103566.log.gz 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159901.log 2023-10-07T09:10:41.071 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105952.log 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173164.log 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104569.log 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159901.log.gz 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173164.log: 89.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.105952.log.gz--verbose 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.99242.log 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166731.log 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104569.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173164.log.gz 2023-10-07T09:10:41.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99242.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.104569.log.gz-5 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.104737.log 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97817.log 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99242.log.gz 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96966.log 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166731.log.gz 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99898.log 88.4% 2023-10-07T09:10:41.073 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104737.log.gz 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97817.log.gz 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96182.log 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101115.log 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96966.log.gz 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96182.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99898.log.gz 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172420.log 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169057.log 2023-10-07T09:10:41.074 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96182.log.gz 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104185.log 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101115.log.gz 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158692.log 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172420.log.gz 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169057.log.gz 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173518.log 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98528.log 2023-10-07T09:10:41.075 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104185.log.gz 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158692.log: /var/log/ceph/ceph-client.admin.173518.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158692.log.gz 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98528.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173518.log.gz 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98528.log.gz 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.162843.log 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163715.log 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.162843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162286.log 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.162843.log.gz 2023-10-07T09:10:41.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90814.log 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179699.log 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163715.log.gz 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162286.log.gz 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179699.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90814.log.gz 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179699.log.gz 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174178.log 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169313.log 2023-10-07T09:10:41.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99940.log 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174178.log.gz 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164725.log 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161226.log 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99940.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169313.log.gz 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164725.log: gzip 89.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.99940.log.gz--verbose 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.174400.log 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161226.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164725.log.gz 2023-10-07T09:10:41.078 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161226.log.gz 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171948.log 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104227.log 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174400.log.gz 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170846.log 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156220.log 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171948.log.gz 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104227.log.gz 2023-10-07T09:10:41.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97464.log 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169183.log 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170846.log.gz 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156220.log: /var/log/ceph/ceph-client.admin.97464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104025.log 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156220.log.gz 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169183.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97464.log.gz 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169183.log.gz 2023-10-07T09:10:41.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170079.log 2023-10-07T09:10:41.081 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105604.log 2023-10-07T09:10:41.081 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104025.log.gz 2023-10-07T09:10:41.081 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175910.log 2023-10-07T09:10:41.081 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158986.log 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170079.log.gz 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105604.log.gz 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.175910.log: /var/log/ceph/ceph-client.admin.158986.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175910.log.gz 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158986.log.gz 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174264.log 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170888.log 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168692.log 2023-10-07T09:10:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106288.log 2023-10-07T09:10:41.083 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174264.log.gz 2023-10-07T09:10:41.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168692.log: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.170888.log.gz--verbose 2023-10-07T09:10:41.083 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.101443.log 2023-10-07T09:10:41.083 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107803.log 2023-10-07T09:10:41.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106288.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168692.log.gz 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101443.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106288.log.gz 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.107803.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101443.log.gz 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107803.log.gz 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170510.log 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100827.log 2023-10-07T09:10:41.086 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170510.log.gz 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101569.log 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.100827.log: -- /var/log/ceph/ceph-client.admin.160667.log 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101569.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100827.log.gz 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160667.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101569.log.gz 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100911.log 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160667.log.gz 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107936.log 2023-10-07T09:10:41.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176818.log 2023-10-07T09:10:41.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100911.log: /var/log/ceph/ceph-client.admin.107936.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100911.log.gz 2023-10-07T09:10:41.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.176818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107936.log.gz 2023-10-07T09:10:41.088 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176818.log.gz 2023-10-07T09:10:41.088 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171906.log 2023-10-07T09:10:41.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171906.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171906.log.gz 2023-10-07T09:10:41.164 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-07T09:10:41.210 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-07T09:10:41.439 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-07T09:10:41.469 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-07T09:10:41.497 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-07T09:10:41.502 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-07T09:10:41.561 INFO:teuthology.orchestra.run.smithi133.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-07T09:10:41.614 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-07T09:10:41.623 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-07T09:10:41.689 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-07T09:10:41.691 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-07T09:10:41.761 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-07T09:10:41.763 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-07T09:10:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m1.095s 2023-10-07T09:10:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m4.028s 2023-10-07T09:10:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.499s 2023-10-07T09:10:43.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-10-07T09:10:43.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-07T09:10:45.859 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-07T09:10:45.860 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-10-07T09:10:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m5.163s 2023-10-07T09:10:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m10.125s 2023-10-07T09:10:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.360s 2023-10-07T09:10:45.861 INFO:tasks.ceph:Archiving logs... 2023-10-07T09:10:45.861 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi046/log 2023-10-07T09:10:45.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T09:10:47.012 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi133/log 2023-10-07T09:10:47.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T09:10:48.379 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-07T09:10:48.388 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-07T09:10:48.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T09:10:48.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T09:10:48.469 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-07T09:10:48.478 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-07T09:10:48.479 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T09:10:48.481 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T09:10:48.496 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-10-07T09:10:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-10-07T09:10:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:210 Number of sources = 4 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -127us[ -127us] +/- 78ms 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 +24us[ +31us] +/- 63ms 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +103us[ +103us] +/- 74ms 2023-10-07T09:10:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:210 Number of sources = 4 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -129us[ -123us] +/- 78ms 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 +29us[ +36us] +/- 63ms 2023-10-07T09:10:48.501 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +81us[ +88us] +/- 74ms 2023-10-07T09:10:48.502 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T09:10:48.502 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-07T09:10:48.513 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-07T09:10:48.514 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-07T09:10:48.538 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T09:10:48.603 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T09:10:48.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T09:10:48.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:48.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T09:10:48.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:48.764 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-07T09:10:48.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-07T09:10:48.786 INFO:teuthology.task.internal:Duration was 1431.137691 seconds 2023-10-07T09:10:48.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-07T09:10:48.819 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-07T09:10:48.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T09:10:48.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T09:10:48.866 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T09:10:48.871 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T09:10:49.019 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-07T09:10:49.019 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2023-10-07T09:10:49.021 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T09:10:49.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-10-07T09:10:49.044 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T09:10:49.063 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-07T09:10:49.063 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T09:10:49.087 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T09:10:49.142 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-07T09:10:49.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T09:10:49.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T09:10:49.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-07T09:10:49.271 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-07T09:10:49.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T09:10:49.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T09:10:49.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-07T09:10:49.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T09:10:49.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T09:10:49.362 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2023-10-07T09:10:49.385 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-10-07T09:10:49.399 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T09:10:49.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:49.431 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T09:10:49.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T09:10:49.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-07T09:10:49.463 INFO:teuthology.task.internal:Transferring archived files... 2023-10-07T09:10:49.464 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi046 2023-10-07T09:10:49.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T09:10:49.505 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291/remote/smithi133 2023-10-07T09:10:49.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T09:10:49.541 INFO:teuthology.task.internal:Removing archive directory... 2023-10-07T09:10:49.541 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T09:10:49.543 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T09:10:49.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-07T09:10:49.603 INFO:teuthology.task.internal:Not uploading archives. 2023-10-07T09:10:49.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-07T09:10:49.682 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-07T09:10:49.683 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T09:10:49.685 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T09:10:49.698 INFO:teuthology.orchestra.run.smithi046.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 09:10 /home/ubuntu/cephtest 2023-10-07T09:10:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 09:10 /home/ubuntu/cephtest 2023-10-07T09:10:49.700 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-07T09:10:49.747 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-07T09:10:49.881 INFO:teuthology.nuke:Checking targets against current locks 2023-10-07T09:10:49.905 DEBUG:teuthology.nuke:shortname: smithi046 2023-10-07T09:10:49.905 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T09:10:49.927 DEBUG:teuthology.nuke:shortname: smithi133 2023-10-07T09:10:49.928 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T09:10:49.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:39:53.287276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMizICYrSuj0JLA84CqKR01RR1r4+yAWvnpDbWKXz2nI9imHUcwnkQSziagr04+RZakxWCeBl/Np614nWfQFvRw='} 2023-10-07T09:10:49.958 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:39:53.285305', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIuEOzbetpGZoWEiQY9UMReh/o20TP9sxSQfSnkYu49JiCZpXdgHiW+UVS7yKZfWCLF0lG6+XiPPCZqB8uTFFk='} 2023-10-07T09:10:49.985 INFO:teuthology.orchestra.console.smithi046:Power off 2023-10-07T09:10:49.986 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T09:10:50.011 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-10-07T09:10:50.011 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:50.029 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-07T09:10:50.030 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T09:10:50.043 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-10-07T09:10:50.061 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-07T09:10:50.061 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:50.089 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-07T09:10:54.044 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:54.090 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:54.155 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-10-07T09:10:54.200 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-07T09:10:58.157 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:58.201 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T09:10:58.266 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-07T09:10:58.312 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-07T09:10:58.368 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-10-07T09:10:58.413 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-07T09:10:58.517 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1431.1376914978027 failure_reason: 'Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ab0a1e125f3d4ee69a288c7816f55bd0 status: fail success: false 2023-10-07T09:10:58.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-07T09:10:58.601 INFO:teuthology.run:FAIL